Test
Ticker Methods
DFEN · Run #2
ticker_method:DFEN:up:baseline
Ticker DFEN
Direction up
Window expanding
Slice top 4%
Attempt 0
Holdout
0.1250
Gap
0.4750
Lift
2.7947
Slice
4
Rolling 6M
x: window end, y: top slice precision
Rolling 12M
x: window end, y: top slice precision
Split Summary
| Split | Base Rate | Top Slice | Lift | Oracle | Capture |
|---|---|---|---|---|---|
| valid | 0.2058 | 0.2683 | 1.3039 | 0.2683 | 0.0531 |
| test | 0.2147 | 0.6000 | 2.7947 | 0.6000 | 0.1184 |
| holdout | 0.2353 | 0.1250 | 0.5312 | 0.1250 | 0.0227 |
Threshold Diagnostics
| Split | Threshold | Pred+ | Threshold P | Threshold R | Threshold F1 |
|---|---|---|---|---|---|
| valid | 0.0500 | 0.9751 | 0.2039 | 0.9662 | 0.3367 |
| test | 0.0500 | 0.9915 | 0.2137 | 0.9868 | 0.3513 |
| holdout | 0.0500 | 1.0000 | 0.2353 | 1.0000 | 0.3810 |
Top 1% to 10% Slice Table
| Split | Top % | Count | Precision | Gap | Lift | Oracle | Capture |
|---|---|---|---|---|---|---|---|
| valid | 1 | 11 | 0.0909 | -0.1149 | 0.4418 | 0.0909 | 0.0048 |
| valid | 2 | 21 | 0.1905 | -0.0153 | 0.9257 | 0.1905 | 0.0193 |
| valid | 3 | 31 | 0.2258 | 0.0200 | 1.0974 | 0.2258 | 0.0338 |
| valid | 4 | 41 | 0.2683 | 0.0625 | 1.3039 | 0.2683 | 0.0531 |
| valid | 5 | 51 | 0.2549 | 0.0491 | 1.2388 | 0.2549 | 0.0628 |
| valid | 6 | 61 | 0.2459 | 0.0401 | 1.1951 | 0.2459 | 0.0725 |
| valid | 7 | 71 | 0.2535 | 0.0478 | 1.2321 | 0.2535 | 0.0870 |
| valid | 8 | 81 | 0.2346 | 0.0288 | 1.1400 | 0.2346 | 0.0918 |
| valid | 9 | 91 | 0.2308 | 0.0250 | 1.1215 | 0.2308 | 0.1014 |
| valid | 10 | 101 | 0.2376 | 0.0319 | 1.1548 | 0.2376 | 0.1159 |
| test | 1 | 4 | 0.7500 | 0.5353 | 3.4934 | 0.7500 | 0.0395 |
| test | 2 | 8 | 0.6250 | 0.4103 | 2.9112 | 0.6250 | 0.0658 |
| test | 3 | 11 | 0.5455 | 0.3308 | 2.5407 | 0.5455 | 0.0789 |
| test | 4 | 15 | 0.6000 | 0.3853 | 2.7947 | 0.6000 | 0.1184 |
| test | 5 | 18 | 0.5556 | 0.3409 | 2.5877 | 0.5556 | 0.1316 |
| test | 6 | 22 | 0.5909 | 0.3762 | 2.7524 | 0.5909 | 0.1711 |
| test | 7 | 25 | 0.5200 | 0.3053 | 2.4221 | 0.5200 | 0.1711 |
| test | 8 | 29 | 0.4828 | 0.2681 | 2.2486 | 0.4828 | 0.1842 |
| test | 9 | 32 | 0.4688 | 0.2541 | 2.1834 | 0.4688 | 0.1974 |
| test | 10 | 36 | 0.4167 | 0.2020 | 1.9408 | 0.4167 | 0.1974 |
| holdout | 1 | 2 | 0.0000 | -0.2353 | 0.0000 | 0.0000 | 0.0000 |
| holdout | 2 | 4 | 0.2500 | 0.0147 | 1.0625 | 0.2500 | 0.0227 |
| holdout | 3 | 6 | 0.1667 | -0.0686 | 0.7083 | 0.1667 | 0.0227 |
| holdout | 4 | 8 | 0.1250 | -0.1103 | 0.5312 | 0.1250 | 0.0227 |
| holdout | 5 | 10 | 0.3000 | 0.0647 | 1.2750 | 0.3000 | 0.0682 |
| holdout | 6 | 12 | 0.2500 | 0.0147 | 1.0625 | 0.2500 | 0.0682 |
| holdout | 7 | 14 | 0.2143 | -0.0210 | 0.9107 | 0.2143 | 0.0682 |
| holdout | 8 | 15 | 0.2000 | -0.0353 | 0.8500 | 0.2000 | 0.0682 |
| holdout | 9 | 17 | 0.1765 | -0.0588 | 0.7500 | 0.1765 | 0.0682 |
| holdout | 10 | 19 | 0.1579 | -0.0774 | 0.6711 | 0.1579 | 0.0682 |