Configurations
Exam score is out of 50; pass is 37. p̂ is mean per-question accuracy over every (run, question) score. The three SEs are for p̂: naive (Eq. 1, all scores independent), clustered by question id (Eq. 4 — replicas of the same question share a cluster), and clustered by E-group (same topic).
claude-opus-4-8
| p̂ | 95.2% |
|---|---|
| SE naive | 1.4% |
| SE clustered by question | 2.9% (2.12× naive) |
| SE clustered by E-group | 2.9% |
| 95% CI (by question) | 89.6% – 100.0% |
claude-sonnet-4-6
| p̂ | 96.6% |
|---|---|
| SE naive | 0.3% |
| SE clustered by question | 0.7% (2.10× naive) |
| SE clustered by E-group | 0.9% |
| 95% CI (by question) | 95.2% – 98.0% |
claude-sonnet-4-6 · thinking:high
| p̂ | 88.4% |
|---|---|
| SE naive | 1.4% |
| SE clustered by question | 1.6% (1.12× naive) |
| SE clustered by E-group | 1.6% |
| 95% CI (by question) | 85.2% – 91.6% |
claude-haiku-4-5-20251001
| p̂ | 85.5% |
|---|---|
| SE naive | 0.7% |
| SE clustered by question | 1.5% (1.98× naive) |
| SE clustered by E-group | 1.7% |
| 95% CI (by question) | 82.6% – 88.4% |
claude-haiku-4-5-20251001 · first34
| p̂ | 85.2% |
|---|---|
| SE naive | 0.7% |
| SE clustered by question | 2.2% (2.94× naive) |
| SE clustered by E-group | 2.3% |
| 95% CI (by question) | 80.9% – 89.6% |
claude-haiku-4-5-20251001 · first42
| p̂ | 85.1% |
|---|---|
| SE naive | 0.8% |
| SE clustered by question | 2.2% (2.94× naive) |
| SE clustered by E-group | 2.4% |
| 95% CI (by question) | 80.8% – 89.4% |
claude-haiku-4-5-20251001 · first9
| p̂ | 86.0% |
|---|---|
| SE naive | 0.7% |
| SE clustered by question | 1.5% (2.02× naive) |
| SE clustered by E-group | 1.7% |
| 95% CI (by question) | 83.2% – 88.9% |
Paired comparisons
Sec. 3.3: for questions both configurations answered, the per-question accuracy difference (A − B, means over replicas), its SE across questions, and the same clustered by E-group. A CI that excludes 0 separates the two.
| A | B | shared q | A p̂ | B p̂ | diff | SE | 95% CI | SE (E-group) | 95% CI (E-group) |
|---|---|---|---|---|---|---|---|---|---|
| claude-opus-4-8 | claude-sonnet-4-6 | 50 | 95.2% | 98.4% | -3.2% | 2.2% | -7.4% – 1.1% | 2.1% | -7.4% – 1.0% |
| claude-opus-4-8 | claude-sonnet-4-6 · thinking:high | 50 | 95.2% | 88.4% | 6.8% | 2.2% | 2.5% – 11.1% | 2.2% | 2.6% – 11.0% |
| claude-opus-4-8 | claude-haiku-4-5-20251001 | 50 | 95.2% | 86.3% | 8.9% | 4.9% | -0.8% – 18.5% | 4.9% | -0.7% – 18.4% |
| claude-opus-4-8 | claude-haiku-4-5-20251001 · first34 | 49 | 95.1% | 88.1% | 7.0% | 4.6% | -2.1% – 16.1% | 4.6% | -2.0% – 16.0% |
| claude-opus-4-8 | claude-haiku-4-5-20251001 · first42 | 49 | 95.1% | 88.1% | 7.0% | 4.7% | -2.2% – 16.2% | 4.6% | -2.1% – 16.1% |
| claude-opus-4-8 | claude-haiku-4-5-20251001 · first9 | 50 | 95.2% | 89.9% | 5.3% | 4.3% | -3.2% – 13.8% | 4.3% | -3.1% – 13.7% |
| claude-sonnet-4-6 | claude-sonnet-4-6 · thinking:high | 50 | 98.4% | 88.4% | 10.0% | 0.3% | 9.4% – 10.5% | 0.3% | 9.4% – 10.5% |
| claude-sonnet-4-6 | claude-haiku-4-5-20251001 | 602 | 96.1% | 86.2% | 9.9% | 1.3% | 7.4% – 12.4% | 1.4% | 7.2% – 12.5% |
| claude-sonnet-4-6 | claude-haiku-4-5-20251001 · first34 | 591 | 96.2% | 87.3% | 8.9% | 1.2% | 6.5% – 11.3% | 1.2% | 6.5% – 11.3% |
| claude-sonnet-4-6 | claude-haiku-4-5-20251001 · first42 | 591 | 96.2% | 87.4% | 8.8% | 1.2% | 6.4% – 11.2% | 1.3% | 6.2% – 11.4% |
| claude-sonnet-4-6 | claude-haiku-4-5-20251001 · first9 | 592 | 96.1% | 86.8% | 9.3% | 1.2% | 6.8% – 11.7% | 1.3% | 6.8% – 11.8% |
| claude-sonnet-4-6 · thinking:high | claude-haiku-4-5-20251001 | 50 | 88.4% | 86.3% | 2.1% | 5.0% | -7.7% – 11.9% | 5.0% | -7.6% – 11.8% |
| claude-sonnet-4-6 · thinking:high | claude-haiku-4-5-20251001 · first34 | 49 | 88.4% | 88.1% | 0.3% | 4.8% | -9.1% – 9.6% | 4.7% | -9.0% – 9.5% |
| claude-sonnet-4-6 · thinking:high | claude-haiku-4-5-20251001 · first42 | 49 | 88.4% | 88.1% | 0.3% | 4.8% | -9.1% – 9.7% | 4.7% | -9.0% – 9.6% |
| claude-sonnet-4-6 · thinking:high | claude-haiku-4-5-20251001 · first9 | 50 | 88.4% | 89.9% | -1.5% | 4.4% | -10.2% – 7.2% | 4.4% | -10.1% – 7.1% |
| claude-haiku-4-5-20251001 | claude-haiku-4-5-20251001 · first34 | 591 | 86.9% | 87.3% | -0.3% | 0.4% | -1.2% – 0.5% | 0.4% | -1.1% – 0.4% |
| claude-haiku-4-5-20251001 | claude-haiku-4-5-20251001 · first42 | 591 | 86.2% | 87.4% | -1.2% | 0.5% | -2.3% – -0.2% | 0.5% | -2.2% – -0.2% |
| claude-haiku-4-5-20251001 | claude-haiku-4-5-20251001 · first9 | 592 | 86.4% | 86.8% | -0.4% | 0.4% | -1.3% – 0.4% | 0.4% | -1.2% – 0.4% |
| claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 · first42 | 580 | 87.3% | 88.0% | -0.7% | 0.4% | -1.5% – 0.1% | 0.4% | -1.5% – 0.2% |
| claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 · first9 | 581 | 87.4% | 87.5% | -0.0% | 0.5% | -0.9% – 0.9% | 0.5% | -0.9% – 0.9% |
| claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 · first9 | 581 | 87.5% | 87.0% | 0.5% | 0.5% | -0.5% – 1.4% | 0.5% | -0.5% – 1.5% |
Pool map
Every question in the pool, one row per E-group, colored by observed accuracy for the configuration. Hover a cell for id, accuracy, sample count, and question text. Grey cells were never sampled. Rows are the paper's clusters made visible.
claude-opus-4-8
claude-sonnet-4-6
claude-sonnet-4-6 · thinking:high
claude-haiku-4-5-20251001
claude-haiku-4-5-20251001 · first34
claude-haiku-4-5-20251001 · first42
claude-haiku-4-5-20251001 · first9
Accuracy by subelement
| subelement | claude-opus-4-8 | claude-sonnet-4-6 | claude-sonnet-4-6 · thinking:high | claude-haiku-4-5-20251001 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 · first9 |
|---|---|---|---|---|---|---|---|
| E0 | 100.0% (5/5) | 96.4% (53/55) | 100.0% (10/10) | 73.3% (33/45) | 75.6% (34/45) | 75.6% (34/45) | 82.2% (37/45) |
| E1 | 100.0% (30/30) | 92.7% (306/330) | 88.3% (53/60) | 69.6% (188/270) | 63.0% (170/270) | 59.3% (160/270) | 68.9% (186/270) |
| E2 | 80.0% (20/25) | 98.5% (271/275) | 90.0% (45/50) | 86.2% (194/225) | 88.4% (199/225) | 88.4% (199/225) | 87.1% (196/225) |
| E3 | 100.0% (15/15) | 97.6% (161/165) | 90.0% (27/30) | 93.3% (126/135) | 93.3% (126/135) | 94.8% (128/135) | 93.3% (126/135) |
| E4 | 80.0% (20/25) | 90.9% (250/275) | 74.0% (37/50) | 92.0% (207/225) | 92.9% (209/225) | 93.3% (210/225) | 92.4% (208/225) |
| E5 | 100.0% (20/20) | 96.4% (212/220) | 90.0% (36/40) | 82.8% (149/180) | 83.9% (151/180) | 85.0% (153/180) | 83.9% (151/180) |
| E6 | 100.0% (30/30) | 96.7% (319/330) | 90.0% (54/60) | 87.4% (236/270) | 88.1% (238/270) | 86.7% (234/270) | 86.7% (234/270) |
| E7 | 100.0% (40/40) | 99.3% (437/440) | 90.0% (72/80) | 93.3% (336/360) | 92.8% (334/360) | 93.3% (336/360) | 93.1% (335/360) |
| E8 | 100.0% (20/20) | 100.0% (220/220) | 90.0% (36/40) | 95.6% (172/180) | 95.0% (171/180) | 98.3% (177/180) | 96.1% (173/180) |
| E9 | 95.0% (38/40) | 97.0% (427/440) | 90.0% (72/80) | 78.3% (282/360) | 79.4% (286/360) | 78.9% (284/360) | 80.6% (290/360) |
Questions missed
All configurations pooled, lowest accuracy first. Given-answer counts show whether misses agree on a wrong choice (a knowledge gap) or scatter (guessing).
| id | group | acc | n | key | given | question |
|---|---|---|---|---|---|---|
| 34 | E1C | 0.0% | 69 | D | A×69 | In what portion of the 630 -meter band are phone emissions permitted? |
| 42 | E1D | 0.0% | 57 | D | B×54, A×3 | Which VHF amateur bands have frequencies authorized for space stations? |
| 292 | E6A | 0.0% | 15 | A | B×11, C×4 | In Figure E6 -1, which is the schematic symbol for a P -channel junction FET? |
| 277 | E5D | 0.0% | 15 | D | B×15 | What is the primary cause of loss in film capacitors at RF? |
| 391 | E7D | 0.0% | 15 | A | B×12, C×3 | What is the purpose of C2 in the circuit shown in Figure E7 -2? |
| 279 | E5D | 0.0% | 15 | D | C×15 | As a conductor ’s diameter increases , what is the effect on its electrical length? |
| 231 | E4E | 0.0% | 15 | C | A×10, B×5 | Where should a station AC surge protector be installed? |
| 67 | E1F | 0.0% | 15 | B | C×12, A×3 | Who may be the control operator of an auxiliary station? |
| 209 | E4D | 0.0% | 15 | A | B×15 | What transmitter frequencies would create an intermodulation -product signal in a receiver tuned to 146.70 MHz when a nearby station transmits on 146.52 MHz? |
| 232 | E4E | 0.0% | 15 | D | B×15 | What is the purpose of a single point ground panel ? |
| 27 | E1C | 0.0% | 12 | B | A×12 | Under what situation may a station transmit third party communications while being automatically controlled ? |
| 303 | E6B | 6.7% | 30 | B | C×28, B×2 | In Figure E6 -2, which is the schematic symbol for a Schottky diode? |
| 276 | E5D | 6.7% | 15 | B | C×14, B×1 | What combines to create the self -resonance of a component? |
| 55 | E1E | 13.3% | 15 | A | D×13, A×2 | What may be the penalty for a VE who fraudulently administers or certifies an examination? |
| 322 | E6D | 13.3% | 15 | D | C×13, D×2 | What is the current that flows in the primary winding of a transformer when there is no load on the secondary winding? |
| 511 | E9B | 13.3% | 15 | D | C×10, B×3, D×2 | What is the front- to-back ratio of the antenna radiation pattern shown in Figure E9 -1? |
| 512 | E9B | 16.7% | 30 | D | B×24, D×5, A×1 | What is the front- to-side ratio of the antenna radiation pattern shown in Figure E9 -1? |
| 54 | E1E | 16.7% | 30 | C | D×25, C×5 | To which of the following examinees may a VE not administer an examination? |
| 3 | E1A | 16.7% | 12 | C | B×9, C×2, D×1 | What is the highest legal carrier frequency on the 20 -meter band for transmitting a 2.8 kHz wide USB data signal? |
| 127 | E2E | 20.0% | 30 | A | D×24, A×6 | What is the difference between direct FSK and audio FSK? |
| 559 | E9F | 20.0% | 30 | B | A×23, B×6, C×1 | What impedance does a 1/2 -wavelength transmission line present to an RF generator when the line is shorted at the far end? |
| 581 | E9H | 20.0% | 30 | D | B×15, C×9, D×6 | What is r eceiving directivity factor (RDF)? |
| 405 | E7E | 20.0% | 30 | A | B×24, A×6 | Why is de-emphasis used in FM communications receivers? |
| 554 | E9E | 20.0% | 30 | C | B×24, C×6 | Which of the following is used to shunt feed a grounded tower at its base? |
| 63 | E1F | 20.0% | 30 | A | D×24, A×6 | Under what circumstances might the FCC issue a Special Temporary Authority (STA) to an amateur station? |
| 335 | E6E | 20.0% | 30 | C | D×24, C×6 | How is power supplied to the most common type of MMIC? |
| 376 | E7C | 20.0% | 30 | A | D×24, A×6 | What is the purpose of adding an inductor to a Pi -network to create a Pi -L-network ? |
| 162 | E3C | 20.0% | 30 | A | C×24, A×6 | How does the VHF/UHF radio horizon compare to the geographic horizon? |
| 323 | E6D | 20.0% | 30 | B | C×24, B×6 | Which of the following materials has the highest temperature stability of its magnetic characteristics? |
| 375 | E7C | 20.0% | 15 | B | A×12, B×3 | What is the frequency response of a T -network with series capacitors and a shunt inductor? |
| 114 | E2D | 20.0% | 15 | A | B×12, A×3 | What type of modulation is used by JT65? |
| 298 | E6B | 20.0% | 15 | D | C×12, D×3 | What characteristic of a PIN diode makes it useful as an RF switch? |
| 340 | E6F | 20.0% | 15 | C | B×12, C×3 | What absorbs the energy from light falling on a photovoltaic cell? |
| 567 | E9F | 20.0% | 15 | D | C×12, D×3 | What impedance does a 1/4 -wavelength transmission line present to an RF generator when the line is open at the far end? |
| 14 | E1B | 20.0% | 15 | A | D×9, B×3, A×3 | Within what distance must an amateur station protect an FCC monitoring facility from harmful interference? |
| 249 | E5B | 20.0% | 15 | D | C×12, D×3 | What is the time constant of a circuit having two 220 -microfarad capacitors and two 1 -megohm resistors, all in parallel? |
| 390 | E7D | 20.0% | 15 | C | D×12, C×3 | What is the purpose of Q1 in the circuit shown in Figure E7 -2? |
| 89 | E2B | 20.0% | 15 | A | C×12, A×3 | What technique allows commercial analog TV receivers to be used for fast -scan TV operations on the 70centimeter band? |
| 204 | E4C | 20.0% | 15 | C | D×12, C×3 | What is the purpose of the receiver IF Shift control? |
| 267 | E5C | 20.0% | 15 | B | C×12, B×3 | Which point on Figure E5-1 best represents the impedance of a series circuit consisting of a 400-ohm resistor and a 38-picofarad capacitor at 14 MHz? |
Run log
Rows flagged red had a non-JSON parse, fewer answers than questions, a stop reason other than end_turn, or failed outright — check these before trusting their scores.
Show all runs
| trajectory | exam | configuration | served | score | answered | parse | stop | in tok | out tok | finished |
|---|---|---|---|---|---|---|---|---|---|---|
| exam_jobs_FirstTest_opus_r2 | FirstTest | claude-opus-4-8 | 48 | 50/50 | json | end_turn | 8832 | 782 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_opus_r3 | FirstTest | claude-opus-4-8 | 47 | 50/50 | json | end_turn | 8832 | 780 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_opus_r4 | FirstTest | claude-opus-4-8 | 48 | 50/50 | json | end_turn | 8832 | 755 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_opus_r5 | FirstTest | claude-opus-4-8 | 48 | 50/50 | json | end_turn | 8832 | 755 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r1 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1784 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r10 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1804 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r2 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1891 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r3 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1783 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r5 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1626 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r6 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1863 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r7 | FirstTest | claude-sonnet-4-6 | 50 | 50/50 | json | end_turn | 7228 | 1933 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r8 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 2323 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_r9 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1807 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r1 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 8856 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r2 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 8262 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r4 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 12080 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r5 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 11311 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r8 | FirstTest | claude-sonnet-4-6 · thinking:high | 2 | 2/50 | regex | max_tokens | 7228 | 16000 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_think_r9 | FirstTest | claude-sonnet-4-6 · thinking:high | 48 | 50/50 | json | end_turn | 7228 | 6745 | 2026-08-24T14:49:57 | |
| exam_jobs_FirstTest_opus_r1 | FirstTest | claude-opus-4-8 | 47 | 50/50 | json | end_turn | 8832 | 755 | 2026-08-24T14:49:58 | |
| exam_jobs_FirstTest_r4 | FirstTest | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7228 | 1784 | 2026-08-24T14:49:58 | |
| exam_jobs_FirstTest_think_r10 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 10669 | 2026-08-24T14:49:58 | |
| exam_jobs_FirstTest_think_r3 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 10727 | 2026-08-24T14:49:58 | |
| exam_jobs_FirstTest_think_r6 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 7167 | 2026-08-24T14:49:58 | |
| exam_jobs_FirstTest_think_r7 | FirstTest | claude-sonnet-4-6 · thinking:high | 49 | 50/50 | json | end_turn | 7228 | 8210 | 2026-08-24T14:49:58 | |
| cover_jobs_Test01_haiku_r1 | Test01 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8867 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test01_haiku_r2 | Test01 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8867 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test01_haiku_r3 | Test01 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8867 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test01_r1 | Test01 | claude-sonnet-4-6 | 50 | 50/50 | json | end_turn | 7233 | 1963 | 2026-08-24T16:00:53 | |
| cover_jobs_Test01_r2 | Test01 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7233 | 1912 | 2026-08-24T16:00:53 | |
| cover_jobs_Test01_r3 | Test01 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7233 | 1929 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_haiku_r1 | Test02 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9169 | 511 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_haiku_r2 | Test02 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9169 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_haiku_r3 | Test02 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9169 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_r1 | Test02 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7535 | 2069 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_r2 | Test02 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7535 | 1993 | 2026-08-24T16:00:53 | |
| cover_jobs_Test02_r3 | Test02 | claude-sonnet-4-6 | 46 | 50/50 | json | end_turn | 7535 | 2045 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_haiku_r1 | Test03 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8836 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_haiku_r2 | Test03 | claude-haiku-4-5-20251001 | 40 | 50/50 | json | end_turn | 8836 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_haiku_r3 | Test03 | claude-haiku-4-5-20251001 | 40 | 50/50 | json | end_turn | 8836 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_r1 | Test03 | claude-sonnet-4-6 | 50 | 50/50 | json | end_turn | 7202 | 1842 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_r2 | Test03 | claude-sonnet-4-6 | 50 | 50/50 | json | end_turn | 7202 | 1819 | 2026-08-24T16:00:53 | |
| cover_jobs_Test03_r3 | Test03 | claude-sonnet-4-6 | 50 | 50/50 | json | end_turn | 7202 | 1835 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_haiku_r1 | Test04 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8545 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_haiku_r2 | Test04 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8545 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_haiku_r3 | Test04 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8545 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_r1 | Test04 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 6911 | 2017 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_r2 | Test04 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 6911 | 1866 | 2026-08-24T16:00:53 | |
| cover_jobs_Test04_r3 | Test04 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 6911 | 1931 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_haiku_r1 | Test05 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8722 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_haiku_r2 | Test05 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8722 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_haiku_r3 | Test05 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8722 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_r1 | Test05 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7088 | 1643 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_r2 | Test05 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7088 | 1635 | 2026-08-24T16:00:53 | |
| cover_jobs_Test05_r3 | Test05 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7088 | 1686 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_haiku_r1 | Test06 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8918 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_haiku_r2 | Test06 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8918 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_haiku_r3 | Test06 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8918 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_r1 | Test06 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7284 | 2257 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_r2 | Test06 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7284 | 2168 | 2026-08-24T16:00:53 | |
| cover_jobs_Test06_r3 | Test06 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7284 | 2090 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_haiku_r1 | Test07 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8806 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_haiku_r2 | Test07 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8806 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_haiku_r3 | Test07 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8806 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_r1 | Test07 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7172 | 2028 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_r2 | Test07 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7172 | 2099 | 2026-08-24T16:00:53 | |
| cover_jobs_Test07_r3 | Test07 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7172 | 2046 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_haiku_r1 | Test08 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8648 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_haiku_r2 | Test08 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8648 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_haiku_r3 | Test08 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8648 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_r1 | Test08 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7014 | 1776 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_r2 | Test08 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7014 | 1694 | 2026-08-24T16:00:53 | |
| cover_jobs_Test08_r3 | Test08 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7014 | 1708 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_haiku_r1 | Test09 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8822 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_haiku_r2 | Test09 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8822 | 561 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_haiku_r3 | Test09 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8822 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_r1 | Test09 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7188 | 1996 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_r2 | Test09 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7188 | 1894 | 2026-08-24T16:00:53 | |
| cover_jobs_Test09_r3 | Test09 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7188 | 1985 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_haiku_r1 | Test10 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_haiku_r2 | Test10 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_haiku_r3 | Test10 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_r1 | Test10 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7274 | 1835 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_r2 | Test10 | claude-sonnet-4-6 | 45 | 50/50 | json | end_turn | 7274 | 1795 | 2026-08-24T16:00:53 | |
| cover_jobs_Test10_r3 | Test10 | claude-sonnet-4-6 | 47 | 50/50 | json | end_turn | 7274 | 1773 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_haiku_r1 | Test11 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8698 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_haiku_r2 | Test11 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8698 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_haiku_r3 | Test11 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8698 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_r1 | Test11 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7064 | 1985 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_r2 | Test11 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7064 | 2075 | 2026-08-24T16:00:53 | |
| cover_jobs_Test11_r3 | Test11 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7064 | 2029 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_haiku_r1 | Test12 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9121 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_haiku_r2 | Test12 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9121 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_haiku_r3 | Test12 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9121 | 561 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_r1 | Test12 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7487 | 1969 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_r2 | Test12 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7487 | 1669 | 2026-08-24T16:00:53 | |
| cover_jobs_Test12_r3 | Test12 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7487 | 1949 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_haiku_r1 | Test13 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8783 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_haiku_r2 | Test13 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8783 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_haiku_r3 | Test13 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8783 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_r1 | Test13 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7149 | 1875 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_r2 | Test13 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7149 | 1844 | 2026-08-24T16:00:53 | |
| cover_jobs_Test13_r3 | Test13 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7149 | 1772 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_haiku_r1 | Test14 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8897 | 511 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_haiku_r2 | Test14 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8897 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_haiku_r3 | Test14 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8897 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_r1 | Test14 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7263 | 1975 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_r2 | Test14 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7263 | 1876 | 2026-08-24T16:00:53 | |
| cover_jobs_Test14_r3 | Test14 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7263 | 1926 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_haiku_r1 | Test15 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8750 | 561 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_haiku_r2 | Test15 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8750 | 711 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_haiku_r3 | Test15 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8750 | 561 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_r1 | Test15 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7116 | 1952 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_r2 | Test15 | claude-sonnet-4-6 | 48 | 50/50 | json | end_turn | 7116 | 1935 | 2026-08-24T16:00:53 | |
| cover_jobs_Test15_r3 | Test15 | claude-sonnet-4-6 | 49 | 50/50 | json | end_turn | 7116 | 1923 | 2026-08-24T16:00:53 | |
| first34_jobs_Test01_first34_r1 | Test01_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8865 | 511 | 2026-08-25T14:21:04 |
| first34_jobs_Test01_first34_r3 | Test01_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8865 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test02_first34_r1 | Test02_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9172 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test02_first34_r2 | Test02_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9172 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test02_first34_r3 | Test02_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9172 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test03_first34_r2 | Test03_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8833 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test04_first34_r1 | Test04_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8535 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test04_first34_r2 | Test04_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8535 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test04_first34_r3 | Test04_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8535 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test05_first34_r1 | Test05_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 40 | 50/50 | json | end_turn | 8683 | 561 | 2026-08-25T14:21:04 |
| first34_jobs_Test05_first34_r2 | Test05_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8683 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test05_first34_r3 | Test05_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8683 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test06_first34_r1 | Test06_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8877 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test06_first34_r2 | Test06_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8877 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test06_first34_r3 | Test06_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8877 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test08_first34_r1 | Test08_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8595 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test09_first34_r1 | Test09_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8813 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test09_first34_r2 | Test09_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8813 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test09_first34_r3 | Test09_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8813 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test10_first34_r1 | Test10_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8898 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test10_first34_r2 | Test10_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8898 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test11_first34_r1 | Test11_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8700 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test11_first34_r3 | Test11_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8700 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test12_first34_r1 | Test12_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9046 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test12_first34_r2 | Test12_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9046 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test12_first34_r3 | Test12_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9046 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test13_first34_r1 | Test13_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8781 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test13_first34_r2 | Test13_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8781 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test13_first34_r3 | Test13_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8781 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test14_first34_r1 | Test14_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 39 | 50/50 | json | end_turn | 8900 | 511 | 2026-08-25T14:21:04 |
| first34_jobs_Test14_first34_r2 | Test14_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8900 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test14_first34_r3 | Test14_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8900 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test15_first34_r1 | Test15_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8747 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test15_first34_r3 | Test15_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8747 | 711 | 2026-08-25T14:21:04 |
| first34_jobs_Test01_first34_r2 | Test01_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8865 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test03_first34_r1 | Test03_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8833 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test03_first34_r3 | Test03_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8833 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test07_first34_r1 | Test07_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8794 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test07_first34_r2 | Test07_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8794 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test07_first34_r3 | Test07_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8794 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test08_first34_r2 | Test08_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8595 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test08_first34_r3 | Test08_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8595 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test10_first34_r3 | Test10_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8898 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test11_first34_r2 | Test11_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8700 | 711 | 2026-08-25T14:21:05 |
| first34_jobs_Test15_first34_r2 | Test15_first34 | claude-haiku-4-5-20251001 · first34 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8747 | 711 | 2026-08-25T14:21:05 |
| first42_jobs_Test01_first42_r1 | Test01_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8864 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test01_first42_r2 | Test01_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8864 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test01_first42_r3 | Test01_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8864 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test02_first42_r1 | Test02_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9158 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test02_first42_r2 | Test02_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9158 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test02_first42_r3 | Test02_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9158 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test03_first42_r1 | Test03_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 40 | 50/50 | json | end_turn | 8846 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test03_first42_r2 | Test03_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8846 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test03_first42_r3 | Test03_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8846 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test04_first42_r1 | Test04_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8502 | 561 | 2026-08-25T20:22:36 |
| first42_jobs_Test04_first42_r2 | Test04_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8502 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test04_first42_r3 | Test04_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8502 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test05_first42_r1 | Test05_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8704 | 561 | 2026-08-25T20:22:36 |
| first42_jobs_Test05_first42_r2 | Test05_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8704 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test05_first42_r3 | Test05_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8704 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test06_first42_r1 | Test06_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test06_first42_r2 | Test06_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test06_first42_r3 | Test06_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test07_first42_r1 | Test07_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8827 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test07_first42_r2 | Test07_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8827 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test07_first42_r3 | Test07_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8827 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test08_first42_r1 | Test08_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test08_first42_r2 | Test08_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test08_first42_r3 | Test08_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test09_first42_r1 | Test09_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8827 | 561 | 2026-08-25T20:22:36 |
| first42_jobs_Test09_first42_r2 | Test09_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8827 | 561 | 2026-08-25T20:22:36 |
| first42_jobs_Test09_first42_r3 | Test09_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8827 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test10_first42_r1 | Test10_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test10_first42_r2 | Test10_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test10_first42_r3 | Test10_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8911 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test11_first42_r1 | Test11_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8686 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test11_first42_r2 | Test11_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8686 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test11_first42_r3 | Test11_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8686 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test12_first42_r1 | Test12_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9108 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test12_first42_r2 | Test12_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9108 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test12_first42_r3 | Test12_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 9108 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test13_first42_r1 | Test13_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8780 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test13_first42_r2 | Test13_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8780 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test13_first42_r3 | Test13_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8780 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test14_first42_r1 | Test14_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8886 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test14_first42_r2 | Test14_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8886 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test14_first42_r3 | Test14_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 40 | 50/50 | json | end_turn | 8886 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test15_first42_r1 | Test15_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8760 | 711 | 2026-08-25T20:22:36 |
| first42_jobs_Test15_first42_r2 | Test15_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8760 | 561 | 2026-08-25T20:22:36 |
| first42_jobs_Test15_first42_r3 | Test15_first42 | claude-haiku-4-5-20251001 · first42 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8760 | 711 | 2026-08-25T20:22:36 |
| first9_jobs_Test01_first9_r1 | Test01_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8856 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test01_first9_r2 | Test01_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8856 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test01_first9_r3 | Test01_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8856 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test02_first9_r1 | Test02_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9176 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test02_first9_r2 | Test02_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9176 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test02_first9_r3 | Test02_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9176 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test03_first9_r1 | Test03_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8809 | 561 | 2026-08-25T20:28:49 |
| first9_jobs_Test03_first9_r2 | Test03_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8809 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test03_first9_r3 | Test03_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8809 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test04_first9_r1 | Test04_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8566 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test04_first9_r2 | Test04_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8566 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test04_first9_r3 | Test04_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8566 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test05_first9_r1 | Test05_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8746 | 561 | 2026-08-25T20:28:49 |
| first9_jobs_Test05_first9_r2 | Test05_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8746 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test05_first9_r3 | Test05_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8746 | 511 | 2026-08-25T20:28:49 |
| first9_jobs_Test06_first9_r1 | Test06_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8907 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test06_first9_r2 | Test06_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8907 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test06_first9_r3 | Test06_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8907 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test07_first9_r1 | Test07_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8826 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test07_first9_r2 | Test07_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8826 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test07_first9_r3 | Test07_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8826 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test08_first9_r1 | Test08_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test08_first9_r2 | Test08_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test08_first9_r3 | Test08_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8655 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test09_first9_r1 | Test09_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8805 | 561 | 2026-08-25T20:28:49 |
| first9_jobs_Test09_first9_r2 | Test09_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8805 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test09_first9_r3 | Test09_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8805 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test10_first9_r1 | Test10_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test10_first9_r2 | Test10_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test10_first9_r3 | Test10_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8908 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test11_first9_r1 | Test11_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8701 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test11_first9_r2 | Test11_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 45 | 50/50 | json | end_turn | 8701 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test11_first9_r3 | Test11_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 44 | 50/50 | json | end_turn | 8701 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test12_first9_r1 | Test12_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 9110 | 561 | 2026-08-25T20:28:49 |
| first9_jobs_Test12_first9_r2 | Test12_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9110 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test12_first9_r3 | Test12_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 9110 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test13_first9_r1 | Test13_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 46 | 50/50 | json | end_turn | 8790 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test13_first9_r2 | Test13_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8790 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test13_first9_r3 | Test13_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8790 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test14_first9_r1 | Test14_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8870 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test14_first9_r2 | Test14_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8870 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test14_first9_r3 | Test14_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8870 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test15_first9_r1 | Test15_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 42 | 50/50 | json | end_turn | 8771 | 711 | 2026-08-25T20:28:49 |
| first9_jobs_Test15_first9_r2 | Test15_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 41 | 50/50 | json | end_turn | 8771 | 561 | 2026-08-25T20:28:49 |
| first9_jobs_Test15_first9_r3 | Test15_first9 | claude-haiku-4-5-20251001 · first9 | claude-haiku-4-5-20251001 | 43 | 50/50 | json | end_turn | 8771 | 711 | 2026-08-25T20:28:49 |