Scale
Cost vs serving
| Position | System | × serving, log scale | Cost vs serving |
|---|---|---|---|
| 400BLlama 4 Maverick 17B-128E InstructMixture of experts, 17B activeServing2,669tokens/s per H200 | |||
| 1, only system run on this model | FlashProvePassed | 1,317× | |
| 8.03BLlama 3.1 8B InstructDenseServing11,876tokens/s per H200 | |||
| 1, only system run on this model | SASHPassed | 62,160× | |
| 124MGPT-2DenseServingnot run yet | |||
| no system run yet | |||
Proof size
| Position | System | MB/reply, log scale | Proof size |
|---|---|---|---|
| 400BLlama 4 Maverick 17B-128E InstructMixture of experts, 17B active | |||
| 1, only system run on this model | FlashProvePassed | 18.78MB/reply | |
| 8.03BLlama 3.1 8B InstructDense | |||
| 1, only system run on this model | SASHPassed | 3,909MB/reply | |
| 124MGPT-2Dense | |||
| no system run yet | |||
Verify time
| Position | System | s/reply, log scale | Verify time |
|---|---|---|---|
| 400BLlama 4 Maverick 17B-128E InstructMixture of experts, 17B active | |||
| 1, only system run on this model | FlashProvePassed | 17.83s/reply | |
| 8.03BLlama 3.1 8B InstructDense | |||
| 1, only system run on this model | SASHPassed | 1,078s/reply | |
| 124MGPT-2Dense | |||
| no system run yet | |||