03RUNS

runsv2-eval-20260502T175124Z

mistralcompletedv2 smoke

Mistral Nemo

mistralai/mistral-nemo
Headline
49.8/100
CI [36.0, 59.6]
Cost
$4.6795
742 judge calls
Cases
17/42≥ 70%
15 failing
Per-band breakdown
  • MEDIUM
    n=10 · ci [37.4, 75.2]
    56.4
  • HARD
    n=19 · ci [39.2, 67.0]
    53.1
  • EXPERT
    n=6 · ci [15.6, 48.5]
    31.9
  • TRIVIAL
    n=1 · ci [100.0, 100.0]
    100.0
  • EASY
    n=6 · ci [54.3, 95.4]
    78.1
Cluster radar
Latency & throughput
  • Total elapsed1651.39s
  • Avg judge latency5.81s
  • Judge calls742
  • Total spend$4.6795
  • CompletedSat, 02 May 2026 17:51:24 GMT