Skip to content
Mock data. Run values, controls, targets and reproductions on this preview are invented for layout. Claim-card text, upstream figures, the reference price and the RFC list come from the repository.
Inference ProofsMenu

Workload, native division

sash-l31-8b-c1024

SASH zk-inference-prover's own model and shape: close to FlashProve's window length. A workload fixes what is proved: the model by content hash, the precision, the prompt set, the shape, the decoding rule and the phase.

Definition

RFC-0003 §v0.1 native workloads

Version
1
Division
native
System
sash
Model
Llama-3.1-8B
Precision
W8A8
Shape
1,024 prompt + 64 output tokens, greedy
Batch
1 requests per batch, 1 batches per session, 1 prompts per job
Phase
both
Model digest
not pinned yet: filled from the public model repository in the implementing issue; the schema rejects a workload without it (RFC-0003)
Prompt corpus digest
not pinned yet: filled from the public model repository in the implementing issue; the schema rejects a workload without it (RFC-0003)
Active parameters per token
not pinned yet: filled from the public model repository in the implementing issue; the schema rejects a workload without it (RFC-0003)

Configurations on this workload

Claim summary first, then rows.

relation:
not stated
security.notion:
not stated
coverage:
both, segment_grid
residual:
not stated

sash / default on sash-l31-8b-c1024

profile prover-h100tier reported
Measured

setup_seconds

40.83 s

scope setupgrade measuredtier reportedmock

mean 40.83, sd 0.3512, min 40.50, max 41.20, n 3, n_failed 0

mean 40.83 srepetition 1: 40.8 srepetition 2: 41.2 srepetition 3: 40.5 ssource: mock harness record

commit_seconds

63.93 s

scope commitgrade measuredtier reportedmock

mean 63.93, sd 0.4509, min 63.50, max 64.40, n 3, n_failed 0

mean 63.93 srepetition 1: 63.9 srepetition 2: 64.4 srepetition 3: 63.5 ssource: mock harness record

prove_session_seconds

1,318 s

scope prove.sessiongrade measuredtier reportedmock

mean 1,318, sd 13.85, min 1,304, max 1,332, n 3, n_failed 0

mean 1,318 srepetition 1: 1318.4 srepetition 2: 1304 srepetition 3: 1331.7 ssource: mock harness record

prove_steady_seconds

null (not_observable) s

scope prove.steadygrade measuredtier reportedmock
source: mock harness record

whole_wall_seconds

1,382 s

scope whole_wallgrade measuredtier reportedmock

mean 1,382, sd 13.40, min 1,368, max 1,395, n 3, n_failed 0

mean 1,382 srepetition 1: 1382.3000000000002 srepetition 2: 1368.4 srepetition 3: 1395.2 ssource: mock harness record

tokens_covered_total

1,088 token

grade measuredtier reportedmock

mean 1,088, sd 0, min 1,088, max 1,088, n 3, n_failed 0

source: mock harness record

requests_count

1 count

grade measuredtier reportedmock

mean 1, sd 0, min 1, max 1, n 3, n_failed 0

source: mock harness record

proofs_count

1 count

grade measuredtier reportedmock

mean 1, sd 0, min 1, max 1, n 3, n_failed 0

source: mock harness record

proof_bytes_total

4.870e9 B

grade measuredtier reportedmock

mean 4.870e9, sd 0, min 4.870e9, max 4.870e9, n 3, n_failed 0

source: mock harness record

verify_seconds

30.17 s

scope verifygrade measuredtier reportedmock

mean 30.17, sd 0.3512, min 29.80, max 30.50, n 3, n_failed 0

mean 30.17 srepetition 1: 30.2 srepetition 2: 29.8 srepetition 3: 30.5 ssource: mock harness record

verify_seconds_total

30.17 s

scope verifygrade measuredtier reportedmock

mean 30.17, sd 0.3512, min 29.80, max 30.50, n 3, n_failed 0

mean 30.17 srepetition 1: 30.2 srepetition 2: 29.8 srepetition 3: 30.5 ssource: mock harness record

verify_single_thread_seconds

198.4 s

scope verify.single_threadgrade measuredtier reportedmock

mean 198.4, sd 1.250, min 197.1, max 199.6, n 3, n_failed 0

mean 198.4 srepetition 1: 198.4 srepetition 2: 197.1 srepetition 3: 199.6 ssource: mock harness record
Derived (computed by the derivation code)

rate_whole_wall

0.7873 token/s

scope whole_wallgrade derivedtier reportedmock

mean 0.7873, sd 0.007639, min 0.7798, max 0.7951, n 3, n_failed 0

mean 0.7873 token/srepetition 1: 0.7870939738117629 token/srepetition 2: 0.7950891552177726 token/srepetition 3: 0.7798165137614679 token/ssource: mock derivation record

rate_prove.session

0.8255 token/s

scope prove.sessiongrade derivedtier reportedmock

mean 0.8255, sd 0.008681, min 0.8170, max 0.8344, n 3, n_failed 0

mean 0.8255 token/srepetition 1: 0.8252427184466019 token/srepetition 2: 0.8343558282208589 token/srepetition 3: 0.8170008260118645 token/ssource: mock derivation record

rate_prove.steady

null (not_observable) token/s

scope prove.steadygrade derivedtier reportedmock
source: mock derivation record

cost_per_1k_tokens_whole_wall

1.514 USD/1k_token

scope whole_wallgrade derivedtier reportedmock

mean 1.514, sd 0.01468, min 1.499, max 1.528, n 3, n_failed 0

mean 1.514 USD/1k_tokenrepetition 1: 1.5140081188725494 USD/1k_tokenrepetition 2: 1.4987837009803922 USD/1k_tokenrepetition 3: 1.528137254901961 USD/1k_tokensource: mock derivation record

proof_bytes_per_token

4,476,000 B/token

grade derivedtier reportedmock

mean 4,476,000, sd 0, min 4,476,000, max 4,476,000, n 3, n_failed 0

source: mock derivation record

verify_seconds_per_token

0.02773 s/token

scope verifygrade derivedtier reportedmock

mean 0.02773, sd 0.0003228, min 0.02739, max 0.02803, n 3, n_failed 0

mean 0.02773 s/tokenrepetition 1: 0.02775735294117647 s/tokenrepetition 2: 0.02738970588235294 s/tokenrepetition 3: 0.02803308823529412 s/tokensource: mock derivation record
Runs
  • mock-sash-c1024-r1completed
  • mock-sash-c1024-r2completed
  • mock-sash-c1024-r3completed
  • Superseded, failed and ineligible runs never contribute to statistics (RFC-0009 S7).