Performance
The benchmarks below should be viewed only as a rough guide for expected future performance. The reasons for this are twofold:
- Not all constraints have been implemented yet, and we expect that there will be some slowdown once constraint evaluation is completed.
- Many optimizations have not been applied yet, and we expect that there will be some speedup once we dedicate some time to performance optimizations.
Overall, we don't expect the benchmarks to change significantly, but there will definitely be some deviation from the below numbers in the future.
A few general notes on performance:
- Execution time is dominated by proof generation time. In fact, the time needed to run the program is usually under 1% of the time needed to generate the proof.
- Proof verification time is really fast. In most cases it is under 1 ms, but sometimes gets as high as 2 ms or 3 ms.
- Proof generation process is dynamically adjustable. In general, there is a trade-off between execution time, proof size, and security level (i.e. for a given security level, we can reduce proof size by increasing execution time, up to a point).
- Both proof generation and proof verification times are greatly influenced by the hash function used in the STARK protocol. In the benchmarks below, we use BLAKE3, which is a really fast hash function.
Single-core prover performance
When executed on a single CPU core, the current version of Miden VM operates at around 10 - 15 KHz. In the benchmarks below, the VM executes a Fibonacci calculator program on Apple M1 Pro CPU in a single thread. The generated proofs have a target security level of 96 bits.
VM cycles | Execution time | Proving time | RAM consumed | Proof size |
---|---|---|---|---|
210 | 1 ms | 80 ms | 20 MB | 47 KB |
212 | 2 ms | 260 ms | 52 MB | 57 KB |
214 | 8 ms | 0.9 sec | 240 MB | 66 KB |
216 | 28 ms | 4.6 sec | 950 MB | 77 KB |
218 | 85 ms | 15.5 sec | 3.7 GB | 89 KB |
220 | 310 ms | 67 sec | 14 GB | 100 KB |
As can be seen from the above, proving time roughly doubles with every doubling in the number of cycles, but proof size grows much slower.
We can also generate proofs at a higher security level. The cost of doing so is roughly doubling of proving time and roughly 40% increase in proof size. In the benchmarks below, the same Fibonacci calculator program was executed on Apple M1 Pro CPU at 128-bit target security level:
VM cycles | Execution time | Proving time | RAM consumed | Proof size |
---|---|---|---|---|
210 | 1 ms | 300 ms | 30 MB | 61 KB |
212 | 2 ms | 590 ms | 106 MB | 78 KB |
214 | 8 ms | 1.7 sec | 500 MB | 91 KB |
216 | 28 ms | 6.7 sec | 2.0 GB | 106 KB |
218 | 85 ms | 27.5 sec | 8.0 GB | 122 KB |
220 | 310 ms | 126 sec | 24.0 GB | 138 KB |
Multi-core prover performance
STARK proof generation is massively parallelizable. Thus, by taking advantage of multiple CPU cores we can dramatically reduce proof generation time. For example, when executed on an 8-core CPU (Apple M1 Pro), the current version of Miden VM operates at around 100 KHz. And when executed on a 64-core CPU (Amazon Graviton 3), the VM operates at around 250 KHz.
In the benchmarks below, the VM executes the same Fibonacci calculator program for 220 cycles at 96-bit target security level:
Machine | Execution time | Proving time | Execution % |
---|---|---|---|
Apple M1 Pro (8 threads) | 310 ms | 9.8 sec | 3.1% |
Apple M2 Max (16 threads) | 290 ms | 7.7 sec | 3.6% |
AMD Ryzen 9 5950X (16 threads) | 270 ms | 10.7 sec | 2.6% |
Amazon Graviton 3 (64 threads) | 330 ms | 3.7 sec | 9.0% |