pepper-grinder 2.0

Repository: kstrat2001/pepper-grinder
Commit: 23d51a2cf0fbcce2575a1162fdb616c4d2bd61c2
Manifest hash: a7cb8af7924befa3
Approved: 2026-10-22
Reference run: -Qt9WkAJt76K

Results

Which runs share a row?

Rows share a cell only when the eval version, darkmux minor version, model weights and quantization all match. Hardware, OS, engine and context length are what you compare across.

Model	Hardware	Engine	Passed	Active time	Tokens/s	Peak memory	Runs
flint int4 · 262,144 ctx · darkmux 5.3	Apple M5 Max, 128 GB macOS 26.6.2	rec 0.1.0 MLX	2 of 2 34–100% likely range	3m 04s Range: with a free account	120.6 Range: with a free account	not reported	1 2
qwen3.6-35b-a3b-turboquant-mlx MXFP4 · 262,144 ctx · darkmux 5.3	Apple M5 Max, 128 GB macOS 26.6.2	LM Studio mlx-llm 1.13.1 MLX	1 of 1 21–100% likely range	5m 26s	52.0	not reported	1

Ranges, power, thermals and why each run passed or failed: sign in or create a free account.

Manifest

{
  "name": "pepper-grinder",
  "version": "2.0",
  "baseline": {
    "test_count": 14,
    "service_test_files": [
      "test/tokenRotation.test.js",
      "test/portability.test.js"
    ]
  },
  "language": "nodejs",
  "satisfies": "node-pepper-grinder-js@2.0",
  "required_files": [
    "src/config.js",
    "src/store.js",
    "src/tokenRotation.js",
    "test/tokenRotation.test.js",
    "package.json",
    "test/portability.test.js"
  ],
  "verify_command": "npm test"
}