03RUNS

runsv2-smoke-20260425T215503Z

mistralcompletedv2 smoke

Mistral Nemo

mistralai/mistral-nemo
Headline
48.3/100
CI [31.1, 59.1]
Cost
$7.0063
899 judge calls
Cases
16/42≥ 70%
15 failing
Per-band breakdown
  • MEDIUM
    n=10 · ci [35.5, 84.2]
    61.4
  • HARD
    n=19 · ci [31.4, 59.0]
    45.3
  • EXPERT
    n=6 · ci [11.4, 50.8]
    29.6
  • TRIVIAL
    n=1 · ci [100.0, 100.0]
    100.0
  • EASY
    n=6 · ci [81.7, 97.4]
    90.7
Cluster radar
Latency & throughput
  • Total elapsed8919.52s
  • Avg judge latency9.53s
  • Judge calls899
  • Total spend$7.0063
  • CompletedSat, 25 Apr 2026 21:55:03 GMT