All cells, sorted by task/model/harness. 1 = true; 0 = false. UNKNOWN is not zero.
Times and counters prefixed all_ charge every attempt, including retries and failures.
terminal_span_seconds includes deferred queue waits. It does not mean clean completion.
Compaction session entries include CURRENT working-set materializations, not only LLM summaries.
CSV contains full precision and per-counter attempt coverage; see methodology.
| task_id | model | harness | attempts | retries | primary_strict_pass | primary_runtime_clean | primary_strict_runtime_clean | terminal_strict_pass | terminal_runtime_clean | terminal_strict_runtime_clean | all_agent_wall_seconds | all_lifecycle_wall_seconds | terminal_span_seconds | whole_cost_usd | known_cost_subtotal_usd | whole_cost_complete_attempts | all_session_compactions | all_compaction_completions | all_compaction_failures | all_compaction_requests | all_child_sessions | all_session_count |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 66.738841 | 66.967366 | 66.967374 | 0.161158 | 0.161158 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 1 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 100.796897 | 101.024580 | 101.024588 | 0.228976 | 0.228976 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 1 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 59.896210 | 60.637120 | 60.637136 | 0.022394 | 0.022394 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 1 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 73.908960 | 74.130989 | 74.131003 | 0.025251 | 0.025251 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 1 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 88.840509 | 89.069282 | 89.069290 | 0.145562 | 0.145562 | 1 | 8 | 0 | 0 | 0 | 0 | 1 |
| 1 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 86.316398 | 86.556480 | 86.556489 | 0.124993 | 0.124993 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 2 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 92.298291 | 92.580978 | 92.580984 | 0.238336 | 0.238336 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 2 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 113.334997 | 113.654711 | 113.654719 | 0.408666 | 0.408666 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 2 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 70.734696 | 70.998166 | 70.998176 | 0.023212 | 0.023212 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 2 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 110.945212 | 111.245072 | 111.245081 | 0.037901 | 0.037901 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 2 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 123.643058 | 123.943434 | 123.943441 | 0.285398 | 0.285398 | 1 | 12 | 0 | 0 | 0 | 0 | 1 |
| 2 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 114.957340 | 115.274817 | 115.274824 | 0.198754 | 0.198754 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 3 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 90.512607 | 91.508737 | 91.508748 | 0.274310 | 0.274310 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 3 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 126.658258 | 127.713880 | 127.713888 | 0.311088 | 0.311088 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 3 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 238.181783 | 239.294201 | 239.294215 | 0.088030 | 0.088030 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 3 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 243.332767 | 244.360751 | 244.360759 | 0.092927 | 0.092927 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 3 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 210.092181 | 211.108020 | 211.108029 | 0.435214 | 0.435214 | 1 | 16 | 0 | 0 | 0 | 0 | 1 |
| 3 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 205.197474 | 206.256020 | 206.256028 | 0.362918 | 0.362918 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 4 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 75.644583 | 75.878487 | 75.878500 | 0.216290 | 0.216290 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 4 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 90.429007 | 90.679405 | 90.679416 | 0.290302 | 0.290302 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 4 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 45.769244 | 46.009492 | 46.009505 | 0.016592 | 0.016592 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 4 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 49.859540 | 50.101620 | 50.101628 | 0.018586 | 0.018586 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 4 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 76.037692 | 76.287521 | 76.287535 | 0.137618 | 0.137618 | 1 | 6 | 0 | 0 | 0 | 0 | 1 |
| 4 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 93.149168 | 93.400902 | 93.400912 | 0.208244 | 0.208244 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 5 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 145.145372 | 145.498224 | 145.498239 | 0.539524 | 0.539524 | 1 | 10 | 0 | 0 | 0 | 0 | 1 |
| 5 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 182.272514 | 182.613718 | 182.613734 | 0.413364 | 0.413364 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 5 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 367.935298 | 368.283266 | 368.283281 | 0.120879 | 0.120879 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 5 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 356.901734 | 357.253097 | 357.253107 | 0.123280 | 0.123280 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 5 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 334.656377 | 335.008568 | 335.008579 | 0.652025 | 0.652025 | 1 | 19 | 0 | 0 | 0 | 0 | 1 |
| 5 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 193.769401 | 194.125742 | 194.125752 | 0.425551 | 0.425551 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 6 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 241.825638 | 242.228610 | 242.228621 | 0.842718 | 0.842718 | 1 | 11 | 1 | 0 | 1 | 0 | 1 |
| 6 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 467.175772 | 468.628972 | 10774.954322 | 1.589960 | 1.589960 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 6 | deepseek | current | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 2400.000440 | 2401.466050 | 9685.627117 | 0.517556 | 0.517556 | 2 | 7 | 2 | 0 | 2 | 0 | 2 |
| 6 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 771.597780 | 771.978372 | 771.978381 | UNKNOWN | 0.230299 | 0 | 1 | 1 | 0 | 1 | 0 | 1 |
| 6 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 864.260420 | 904.387882 | 904.387890 | 1.752567 | 1.752567 | 1 | 39 | 2 | 0 | 1 | 0 | 1 |
| 6 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 507.645402 | 509.125926 | 10715.405409 | 1.057382 | 1.057382 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 7 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 62.106835 | 62.355953 | 62.355969 | 0.158142 | 0.158142 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 7 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 107.309922 | 107.554486 | 107.554496 | 0.255546 | 0.255546 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 7 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 44.252318 | 44.497340 | 44.497350 | 0.013732 | 0.013732 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 7 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 44.227989 | 44.462668 | 44.462677 | 0.013545 | 0.013545 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 7 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 98.661355 | 98.889068 | 98.889077 | 0.150754 | 0.150754 | 1 | 6 | 0 | 0 | 0 | 0 | 1 |
| 7 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 102.166934 | 102.411883 | 102.411900 | 0.278094 | 0.278094 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 8 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 162.359236 | 162.631535 | 162.631545 | 0.556246 | 0.556246 | 1 | 10 | 0 | 0 | 0 | 0 | 1 |
| 8 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 152.088102 | 152.361542 | 152.361556 | 0.388546 | 0.388546 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 8 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 358.635025 | 358.903785 | 358.903796 | 0.093704 | 0.093704 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 8 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 390.887877 | 391.156649 | 391.156658 | 0.107865 | 0.107865 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 8 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 295.334718 | 295.607147 | 295.607156 | UNKNOWN | 0.531978 | 0 | 15 | 0 | 0 | 0 | 0 | 1 |
| 8 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 236.616025 | 236.890626 | 236.890643 | 0.394617 | 0.394617 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 9 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 70.082364 | 72.858436 | 72.858452 | 0.177770 | 0.177770 | 1 | 3 | 0 | 0 | 0 | 0 | 1 |
| 9 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 83.094642 | 85.691239 | 85.691256 | 0.219924 | 0.219924 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 9 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 83.584299 | 86.159249 | 86.159259 | 0.025157 | 0.025157 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 9 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 89.575490 | 92.344464 | 92.344477 | 0.033375 | 0.033375 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 9 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 95.121748 | 98.020133 | 98.020142 | 0.138213 | 0.138213 | 1 | 6 | 0 | 0 | 0 | 0 | 1 |
| 9 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 114.664046 | 117.382343 | 117.382358 | 0.260870 | 0.260870 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 10 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 69.872978 | 71.257823 | 71.257832 | 0.183762 | 0.183762 | 1 | 3 | 0 | 0 | 0 | 0 | 1 |
| 10 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 75.814622 | 77.191556 | 77.191565 | 0.243052 | 0.243052 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 10 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 84.191754 | 85.573711 | 85.573719 | 0.026904 | 0.026904 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 10 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 155.248730 | 156.677029 | 156.677037 | 0.029057 | 0.029057 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 10 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 74.239806 | 75.615243 | 75.615251 | 0.166053 | 0.166053 | 1 | 7 | 0 | 0 | 0 | 0 | 1 |
| 10 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 144.352196 | 145.779102 | 145.779110 | 0.209273 | 0.209273 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 11 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 121.286582 | 121.594933 | 121.594945 | 0.352472 | 0.352472 | 1 | 5 | 0 | 0 | 0 | 0 | 1 |
| 11 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 136.334784 | 136.644111 | 136.644121 | 0.321442 | 0.321442 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 11 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 119.184544 | 119.493272 | 119.493281 | 0.033853 | 0.033853 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 11 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 126.689012 | 126.999062 | 126.999071 | 0.040856 | 0.040856 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 11 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 157.288959 | 157.598378 | 157.598393 | 0.292022 | 0.292022 | 1 | 13 | 0 | 0 | 0 | 0 | 1 |
| 11 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 224.144565 | 224.452665 | 224.452675 | UNKNOWN | 0.339689 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| 12 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 206.328896 | 207.100510 | 207.100525 | 0.682918 | 0.682918 | 1 | 9 | 1 | 0 | 1 | 0 | 1 |
| 12 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 396.086142 | 397.622700 | 10184.428917 | 1.059462 | 1.059462 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 12 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 142.096063 | 142.854100 | 142.854109 | UNKNOWN | 0.049861 | 0 | 4 | 1 | 0 | 1 | 0 | 1 |
| 12 | deepseek | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 292.299547 | 293.855654 | 6996.212533 | 0.095343 | 0.095343 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 12 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 227.841835 | 228.617272 | 228.617282 | 0.528212 | 0.528212 | 1 | 18 | 1 | 0 | 1 | 0 | 1 |
| 12 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 460.218630 | 461.806180 | 9884.555906 | 0.739841 | 0.739841 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 13 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 716.925987 | 824.700495 | 824.700503 | 1.274068 | 1.274068 | 1 | 13 | 2 | 0 | 2 | 0 | 1 |
| 13 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 317.252674 | 321.335161 | 321.335173 | 1.869530 | 1.869530 | 1 | 2 | 2 | 0 | 2 | 0 | 1 |
| 13 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 860.128109 | 865.112520 | 865.112533 | 0.287778 | 0.287778 | 1 | 6 | 2 | 0 | 2 | 0 | 1 |
| 13 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 530.202018 | 535.463311 | 535.463320 | UNKNOWN | 0.181311 | 0 | 2 | 2 | 0 | 2 | 0 | 1 |
| 13 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 690.635013 | 695.029632 | 695.029641 | 1.951908 | 1.951908 | 1 | 33 | 4 | 0 | 2 | 0 | 1 |
| 13 | sol | vanilla | 2 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 1210.208133 | 1269.845720 | 10253.479122 | UNKNOWN | 3.105168 | 1 | 4 | 4 | 0 | 4 | 0 | 2 |
| 14 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 81.756646 | 81.926398 | 81.926409 | 0.228514 | 0.228514 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 14 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 103.962146 | 104.135886 | 104.135895 | 0.236198 | 0.236198 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 14 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 109.762105 | 109.927326 | 109.927341 | 0.031716 | 0.031716 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 14 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 157.536138 | 157.704710 | 157.704724 | 0.048626 | 0.048626 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 14 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 140.583199 | 140.757035 | 140.757047 | 0.215027 | 0.215027 | 1 | 8 | 0 | 0 | 0 | 0 | 1 |
| 14 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 179.775245 | 179.947878 | 179.947886 | 0.259830 | 0.259830 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 15 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 111.641359 | 111.854280 | 111.854287 | 0.362472 | 0.362472 | 1 | 8 | 0 | 0 | 0 | 0 | 1 |
| 15 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 95.129497 | 95.335039 | 95.335046 | 0.235102 | 0.235102 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 15 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 63.178280 | 63.389221 | 63.389229 | 0.018110 | 0.018110 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 15 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 111.381271 | 111.590370 | 111.590378 | 0.033335 | 0.033335 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 15 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 131.220002 | 131.444506 | 131.444513 | 0.178425 | 0.178425 | 1 | 8 | 0 | 0 | 0 | 0 | 1 |
| 15 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 132.486101 | 132.714200 | 132.714208 | 0.188948 | 0.188948 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 16 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 238.177145 | 238.556001 | 238.556012 | 0.804542 | 0.804542 | 1 | 14 | 0 | 0 | 0 | 0 | 1 |
| 16 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 219.556844 | 219.944452 | 219.944466 | 0.637576 | 0.637576 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 16 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 260.764876 | 261.129293 | 261.129304 | 0.080341 | 0.080341 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 16 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 273.874876 | 274.248750 | 274.248764 | 0.083730 | 0.083730 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 16 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 485.336046 | 485.747140 | 485.747154 | 0.753653 | 0.753653 | 1 | 21 | 0 | 0 | 0 | 0 | 1 |
| 16 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 265.584634 | 265.976417 | 265.976426 | 0.491910 | 0.491910 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 17 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 203.248260 | 203.926145 | 203.926161 | 1.344594 | 1.344594 | 1 | 11 | 1 | 0 | 1 | 0 | 1 |
| 17 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 413.868341 | 415.186042 | 9479.947190 | 1.013740 | 1.013740 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 17 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 265.712548 | 266.396662 | 266.396671 | 0.084457 | 0.084457 | 1 | 4 | 1 | 0 | 1 | 0 | 1 |
| 17 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 225.742337 | 226.397831 | 226.397847 | 0.090665 | 0.090665 | 1 | 1 | 1 | 0 | 1 | 0 | 1 |
| 17 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 290.621113 | 291.320438 | 291.320450 | 0.595665 | 0.595665 | 1 | 20 | 1 | 0 | 1 | 0 | 1 |
| 17 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 630.817057 | 632.160423 | 9342.446796 | 1.441380 | 1.441380 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 18 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 146.611075 | 151.381456 | 151.381464 | 0.381296 | 0.381296 | 1 | 6 | 0 | 0 | 0 | 0 | 1 |
| 18 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 187.784518 | 192.654650 | 192.654658 | 0.484792 | 0.484792 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 18 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 182.921085 | 187.443618 | 187.443627 | 0.048824 | 0.048824 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 18 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 285.689667 | 291.182573 | 291.182582 | 0.097920 | 0.097920 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 18 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 329.132101 | 335.796942 | 335.796950 | 0.937334 | 0.937334 | 1 | 22 | 1 | 0 | 0 | 0 | 1 |
| 18 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 238.519548 | 243.364897 | 243.364906 | 0.374075 | 0.374075 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 19 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 90.331953 | 111.371978 | 111.371986 | 0.200028 | 0.200028 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 19 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 117.718544 | 138.804330 | 138.804338 | 0.258258 | 0.258258 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 19 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 152.321407 | 172.053435 | 172.053442 | 0.033646 | 0.033646 | 1 | 1 | 0 | 0 | 0 | 0 | 1 |
| 19 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 212.911600 | 231.143790 | 231.143798 | 0.047476 | 0.047476 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 19 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 166.562902 | 189.167525 | 189.167534 | 0.199660 | 0.199660 | 1 | 8 | 0 | 0 | 0 | 0 | 1 |
| 19 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 168.749123 | 190.502243 | 190.502252 | 0.236473 | 0.236473 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 20 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 175.031750 | 175.522798 | 175.522807 | 0.569488 | 0.569488 | 1 | 8 | 1 | 0 | 1 | 0 | 1 |
| 20 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 337.659746 | 338.636804 | 9147.699914 | 0.881132 | 0.881132 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 20 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 127.484373 | 128.020735 | 128.020745 | 0.046546 | 0.046546 | 1 | 4 | 1 | 0 | 1 | 0 | 1 |
| 20 | deepseek | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 320.895081 | 321.943704 | 5194.223103 | 0.110540 | 0.110540 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 20 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 261.974678 | 262.468529 | 262.468536 | 0.663546 | 0.663546 | 1 | 21 | 1 | 0 | 1 | 0 | 1 |
| 20 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 471.708572 | 472.746864 | 8893.964195 | 0.826189 | 0.826189 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 21 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 114.425131 | 114.984092 | 114.984101 | 0.412736 | 0.412736 | 1 | 7 | 0 | 0 | 0 | 0 | 1 |
| 21 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 168.549940 | 169.089110 | 169.089120 | 0.395650 | 0.395650 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 21 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 176.784732 | 177.313477 | 177.313485 | 0.048845 | 0.048845 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 21 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 253.602461 | 254.164445 | 254.164453 | 0.080317 | 0.080317 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 21 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 156.287940 | 156.847299 | 156.847312 | 0.273492 | 0.273492 | 1 | 9 | 0 | 0 | 0 | 0 | 1 |
| 21 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 197.351252 | 197.885529 | 197.885536 | 0.297452 | 0.297452 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 22 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 182.784970 | 183.199541 | 183.199550 | 0.713490 | 0.713490 | 1 | 10 | 1 | 0 | 1 | 0 | 1 |
| 22 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 391.919607 | 392.750013 | 9005.418895 | 1.183396 | 1.183396 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 22 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 464.857641 | 465.220641 | 465.220650 | 0.169343 | 0.169343 | 1 | 4 | 1 | 0 | 1 | 0 | 1 |
| 22 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 271.676235 | 272.091499 | 272.091507 | 0.098938 | 0.098938 | 1 | 1 | 1 | 0 | 1 | 0 | 1 |
| 22 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 386.109586 | 386.565496 | 386.565508 | 0.845190 | 0.845190 | 1 | 21 | 1 | 0 | 1 | 0 | 1 |
| 22 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 519.023031 | 519.923327 | 8782.017907 | 0.958921 | 0.958921 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 23 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 234.421917 | 234.762261 | 234.762275 | 0.849326 | 0.849326 | 1 | 9 | 1 | 0 | 1 | 0 | 1 |
| 23 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 436.755351 | 437.428947 | 9000.148073 | 1.408298 | 1.408298 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 23 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 346.163796 | 346.503680 | 346.503688 | 0.120529 | 0.120529 | 1 | 5 | 1 | 0 | 1 | 0 | 1 |
| 23 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 346.224434 | 346.562738 | 346.562753 | UNKNOWN | 0.145543 | 0 | 1 | 1 | 0 | 1 | 0 | 1 |
| 23 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 416.481798 | 416.828570 | 416.828581 | 1.276486 | 1.276486 | 1 | 28 | 2 | 0 | 1 | 0 | 1 |
| 23 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 544.456068 | 545.132016 | 8799.650253 | 1.061840 | 1.061840 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 24 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 218.502145 | 219.002326 | 219.002340 | 0.740994 | 0.740994 | 1 | 8 | 1 | 0 | 1 | 0 | 1 |
| 24 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 521.334502 | 522.326182 | 9005.195212 | 1.799638 | 1.799638 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 24 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 718.125573 | 718.582315 | 718.582327 | 0.258370 | 0.258370 | 1 | 4 | 1 | 0 | 1 | 0 | 1 |
| 24 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 507.722563 | 508.179102 | 508.179110 | UNKNOWN | 0.170059 | 0 | 1 | 1 | 0 | 1 | 0 | 1 |
| 24 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 412.788486 | 413.340268 | 413.340277 | 1.237880 | 1.237880 | 1 | 29 | 2 | 0 | 1 | 0 | 1 |
| 24 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 660.286694 | 661.434298 | 8831.107052 | 1.549476 | 1.549476 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 25 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 135.130638 | 143.517673 | 143.517680 | 0.437190 | 0.437190 | 1 | 6 | 0 | 0 | 0 | 0 | 1 |
| 25 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 173.784276 | 182.514852 | 182.514860 | 0.411126 | 0.411126 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 25 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 237.860670 | 244.781637 | 244.781645 | 0.064025 | 0.064025 | 1 | 2 | 0 | 0 | 0 | 0 | 1 |
| 25 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 322.562600 | 330.080661 | 330.080670 | 0.076972 | 0.076972 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 25 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 288.771393 | 296.666400 | 296.666408 | 0.470415 | 0.470415 | 1 | 16 | 0 | 0 | 0 | 0 | 1 |
| 25 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 275.881766 | 284.503090 | 284.503102 | 0.503095 | 0.503095 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 26 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 106.108961 | 106.361650 | 106.361660 | 0.344410 | 0.344410 | 1 | 4 | 0 | 0 | 0 | 0 | 1 |
| 26 | astra | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 125.302742 | 125.545315 | 125.545325 | 0.311040 | 0.311040 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 26 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 118.457821 | 118.701405 | 118.701413 | UNKNOWN | 0.027735 | 0 | 2 | 0 | 0 | 0 | 0 | 1 |
| 26 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 145.984557 | 146.227901 | 146.227911 | 0.043124 | 0.043123 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 26 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 174.448481 | 174.759506 | 174.759513 | 0.341115 | 0.341115 | 1 | 12 | 0 | 0 | 0 | 0 | 1 |
| 26 | sol | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 177.006690 | 177.319676 | 177.319684 | 0.278546 | 0.278546 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
| 27 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 462.585681 | 464.897250 | 464.897264 | 1.326226 | 1.326226 | 1 | 15 | 2 | 0 | 2 | 0 | 1 |
| 27 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 2231.891192 | 2235.328356 | 3016.645900 | UNKNOWN | 5.689586 | 0 | 2 | 2 | 2 | 4 | 0 | 2 |
| 27 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 864.887744 | 865.886712 | 865.886720 | 0.345909 | 0.345909 | 1 | 6 | 2 | 0 | 2 | 0 | 1 |
| 27 | deepseek | vanilla | 2 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 3248.893093 | 3251.074712 | 3251.410488 | UNKNOWN | 0.846514 | 1 | 2 | 2 | 1 | 3 | 0 | 2 |
| 27 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 725.923881 | 729.645011 | 729.645020 | 1.314501 | 1.314501 | 1 | 28 | 3 | 0 | 2 | 0 | 1 |
| 27 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 1581.020934 | 1585.821585 | 2824.849295 | 2.722464 | 2.722464 | 2 | 2 | 2 | 2 | 4 | 0 | 2 |
| 28 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 349.564459 | 350.167248 | 350.167259 | 1.374588 | 1.374588 | 1 | 14 | 2 | 0 | 2 | 0 | 1 |
| 28 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 818.535571 | 819.731634 | 9138.261653 | 2.483110 | 2.483110 | 2 | 0 | 0 | 4 | 4 | 0 | 2 |
| 28 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 478.995940 | 479.602713 | 479.602723 | 0.179372 | 0.179372 | 1 | 6 | 2 | 0 | 2 | 0 | 1 |
| 28 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 405.555804 | 406.156900 | 406.156909 | UNKNOWN | 0.156510 | 0 | 2 | 2 | 0 | 2 | 0 | 1 |
| 28 | sol | current | 2 | 1 | 0 | 1 | 0 | 1 | 1 | 1 | 861.639617 | 862.871940 | 3046.278329 | 1.827250 | 1.827250 | 2 | 50 | 4 | 0 | 4 | 0 | 2 |
| 28 | sol | vanilla | 2 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 822.862763 | 824.044194 | 8305.684942 | 1.824838 | 1.824838 | 2 | 2 | 2 | 2 | 4 | 0 | 2 |
| 29 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 249.412081 | 249.956609 | 249.956618 | 0.810954 | 0.810954 | 1 | 11 | 1 | 0 | 1 | 0 | 1 |
| 29 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 649.065951 | 650.158815 | 9024.623672 | 1.895526 | 1.895526 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 29 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 231.819868 | 232.371872 | 232.371883 | UNKNOWN | 0.071762 | 0 | 4 | 1 | 0 | 1 | 0 | 1 |
| 29 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 336.220718 | 336.798181 | 336.798191 | 0.120536 | 0.120536 | 1 | 1 | 1 | 0 | 1 | 0 | 1 |
| 29 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 260.201219 | 260.745703 | 260.745716 | 0.467954 | 0.467954 | 1 | 15 | 1 | 0 | 1 | 0 | 1 |
| 29 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 693.711630 | 694.816543 | 8239.021728 | 1.272992 | 1.272992 | 2 | 0 | 0 | 2 | 2 | 0 | 2 |
| 30 | astra | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 506.770935 | 515.592859 | 515.592868 | 1.854338 | 1.854338 | 1 | 17 | 2 | 0 | 2 | 0 | 1 |
| 30 | astra | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 1133.050615 | 1150.966405 | 9289.728115 | UNKNOWN | 3.228524 | 1 | 0 | 0 | 4 | 4 | 0 | 2 |
| 30 | deepseek | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 817.976940 | 822.955885 | 822.955894 | 0.288412 | 0.288412 | 1 | 7 | 2 | 0 | 2 | 0 | 1 |
| 30 | deepseek | vanilla | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 800.962019 | 805.921066 | 805.921075 | UNKNOWN | 0.273336 | 0 | 2 | 2 | 0 | 2 | 0 | 1 |
| 30 | sol | current | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 890.536778 | 895.267271 | 895.267281 | 2.373492 | 2.373492 | 1 | 54 | 4 | 0 | 2 | 0 | 1 |
| 30 | sol | vanilla | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 1171.402351 | 1181.310595 | 8469.522005 | 2.990244 | 2.990244 | 2 | 2 | 2 | 2 | 4 | 0 | 2 |