Model

deepseek-v4-pro

deepseek-v4-pro is strongest with deepseek_harness, 34th overall.

Best overall rank34th
Best partnerdeepseek_harness
Strongest inData analysis
First places2 tasks
Pairings evaluated1 of 5 harnesses
Time and cost, best pairingTime393.4sCost$0.1119

Who deepseek-v4-pro works best with

Valid evaluations covered 1 of 5 harnesses. The other 4 have not been evaluated yet.

  1. deepseek_harness949#34
  2. claude_code—Not evaluated
  3. kkimi_cli—Not evaluated
  4. codex—Not evaluated
  5. opencode—Not evaluated

Places across 24 tasks

  1. 21st
  2. 02nd
  3. 03rd
  4. 04th
  5. 05th
  6. 226th and below

Most often 6th and below, in 22 tasks.

Rank in each kind of work

Each row is a kind of work and each dot is one pairing's place in it; further left is better. Hover a dot for its name and place, or pick a name below to follow one pairing.

Where it places in each task

The number in each cell is a place: where that pairing ranked in that task, 1 being best, so 3 means 3rd. Hover a number to see how many pairings were ranked there. A dash means the pairing was not run on that task.

1st2nd3rd4th5th6th and below

Other models