benchmark_20260308T003605.md 3.9 KB

Benchmark Results - 20260308T003605

Model Selection (6-slot / 2-socket)

Slot Socket Role Model Composite Score
1 Node 1 (port 11434) General (locked) llama3.2:3b 0.001
2 Node 1 (port 11434) General (locked) command-r:35b 0.0
5 Node 1 (port 11434) General (rotate) llama3.1:70b 0.0
3 Node 0 (port 11435) Coding (locked) codellama:34b 0.0
4 Node 0 (port 11435) Coding (locked) deepseek-coder-v2:16b 0.0
6 Node 0 (port 11435) Coding (rotate) qwen2.5-coder:14b 0.0

Detailed Metrics

codellama:34b

  • Category: coding
  • Coding Quality: 0
  • General Quality: 0.008
  • Avg Tokens/sec: 0.1
  • Latency (ms): 221414.9
  • Coding Composite: 0.0
  • General Composite: 0.004

deepseek-coder-v2:16b

  • Category: coding
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

qwen2.5-coder:14b

  • Category: coding
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 239690.0
  • Coding Composite: 0.0
  • General Composite: 0.0

deepseek-coder-v2:latest

  • Category: coding
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

command-r:35b

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.1
  • Latency (ms): 169971.8
  • Coding Composite: 0.0
  • General Composite: 0.0

llama3.1:70b

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

mistral-nemo:latest

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

mistral:latest

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

llama3.1:8b

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

qwen2.5-coder:7b

  • Category: coding
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

gemma3:12b-it-q4_K_M

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.0
  • Latency (ms): 9999
  • Coding Composite: 0.0
  • General Composite: 0.0

llama3.2:3b

  • Category: general
  • Coding Quality: 0
  • General Quality: 0
  • Avg Tokens/sec: 0.1
  • Latency (ms): 130127.2
  • Coding Composite: 0.001
  • General Composite: 0.001

Scoring Formula

  • Composite = quality * 0.45 + token_speed_normalized * 0.30 + latency_score * 0.25
  • Speed normalized against 40 tok/sec ceiling (hardware-observed max)
  • Coding quality (per-prompt): code_gen: has_def×0.20 + has_return×0.20 + has_docstring×0.15 + has_type_hint×0.15 + has_code_block×0.10 + has_assert×0.08 + has_test_def×0.07 + has_import×0.05 debug: has_def×0.30 + has_return×0.30 + has_code_block×0.25 + has_assert×0.15 refactor: has_def×0.25 + has_return×0.25 + has_code_block×0.20 + has_type_hint×0.15 + has_import×0.15
  • Category: override dict → quality delta (coding_avg - general_avg >= 0.1) → name pattern (coder/codestral/codellama/starcoder) → general