Harness

deepseek_harness

deepseek_harness is strongest with deepseek-flash, 25th overall.

Best overall rank25th
Best partnerdeepseek-flash
Strongest inData analysis
First places3 tasks
Pairings evaluated2 of 19 models
Time and cost, best pairingTime987.6sCost$0.1735

Who deepseek_harness works best with

Valid evaluations covered 2 of 19 models. The other 17 have not been evaluated yet.

  1. deepseek-flash975#25
  2. deepseek-v4-pro949#34
  3. claude-opus-5-5—Not evaluated
  4. kimi-k3—Not evaluated
  5. glm-5.3-prime—Not evaluated
  6. qwen3.8-flash—Not evaluated
  7. qwen3.8-max—Not evaluated
  8. glm-5.3—Not evaluated
  9. gpt-6.1-sol—Not evaluated
  10. claude-fable-5-1—Not evaluated
  11. gpt-6-astra—Not evaluated
  12. gpt-5.6-terra—Not evaluated
  13. gpt-5.6-sol—Not evaluated
  14. gpt-6-sol—Not evaluated
  15. qwen3.7-plus—Not evaluated
  16. claude-sonnet-5—Not evaluated
  17. kimi-k2.7-code—Not evaluated
  18. MiniMax-M2.5—Not evaluated
  19. claude-haiku-4-5-20251001—Not evaluated

Places across 24 tasks

  1. 31st
  2. 12nd
  3. 13rd
  4. 04th
  5. 05th
  6. 196th and below

Most often 6th and below, in 19 tasks.

Rank in each kind of work

Each row is a kind of work and each dot is one pairing's place in it; further left is better. Hover a dot for its name and place, or pick a name below to follow one pairing.

Where it places in each task

The number in each cell is a place: where that pairing ranked in that task, 1 being best, so 3 means 3rd. Hover a number to see how many pairings were ranked there. A dash means the pairing was not run on that task.

1st2nd3rd4th5th6th and below

Other harnesses