fix/e2-checkpoint-unique-memory-access - Branch - openvm-org/openvm

fix: keep track of unique memory accesses since last checkpoint

#2332

Comparing

fix/e2-checkpoint-unique-memory-access

(

8743304

) with

main

(

a1bce3e

)

-95%

Regressions: 11

Untouched: 13

Skipped: 36

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

Skipped (36)

These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

735.2 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute_preflight[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

167.7 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute_metered[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

71.5 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

44.2 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute_preflight[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

1.9 s*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute_metered[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

995.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute_preflight[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

378.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute_metered[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

159.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

1.9 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute_metered[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

2.7 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute_preflight[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

4.8 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

89.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[revm_transfer]

benchmarks/execute/benches/execute.rs

Skipped

45.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

62.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[pairing]

benchmarks/execute/benches/execute.rs

Skipped

162.4 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

237 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[quicksort]

benchmarks/execute/benches/execute.rs

Skipped

25.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[bubblesort]

benchmarks/execute/benches/execute.rs

Skipped

9.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[pairing]

benchmarks/execute/benches/execute.rs

Skipped

179 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

156.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Skipped

8.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[keccak256]

benchmarks/execute/benches/execute.rs

Skipped

16.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[keccak256]

benchmarks/execute/benches/execute.rs

Skipped

33.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Skipped

18.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[revm_snailtracer]

benchmarks/execute/benches/execute.rs

Skipped

29.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[revm_transfer]

benchmarks/execute/benches/execute.rs

Skipped

33.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[revm_snailtracer]

benchmarks/execute/benches/execute.rs

Skipped

27.5 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

177.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Skipped

16.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[sha256]

benchmarks/execute/benches/execute.rs

Skipped

16 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[quicksort]

benchmarks/execute/benches/execute.rs

Skipped

9.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[bubblesort]

benchmarks/execute/benches/execute.rs

Skipped

23.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

201.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Skipped

47.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

308.5 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[sha256]

benchmarks/execute/benches/execute.rs

Skipped

39.4 ms*

Failed

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[pairing]

benchmarks/execute/benches/execute.rs

Regression

-73%

77.6 ms291.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Regression

-88%

73.3 ms604.1 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[keccak256_iter]

benchmarks/execute/benches/execute.rs

Regression

-80%

72.7 ms360.4 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[sha256_iter]

benchmarks/execute/benches/execute.rs

Regression

-82%

66.2 ms373.1 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Regression

-94%

16.8 ms283.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[keccak256]

benchmarks/execute/benches/execute.rs

Regression

-94%

11.2 ms175.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[quicksort]

benchmarks/execute/benches/execute.rs

Regression

-95%

9.1 ms193.1 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[bubblesort]

benchmarks/execute/benches/execute.rs

Regression

-94%

11.2 ms173.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[sha256]

benchmarks/execute/benches/execute.rs

Regression

-94%

9.5 ms172 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Regression

-93%

14.4 ms216.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[revm_transfer]

benchmarks/execute/benches/execute.rs

Regression

-82%

24.1 ms136.3 ms

Passed

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[sha256]

benchmarks/execute/benches/execute.rs

+3%

4.1 ms4 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[sha256_iter]

benchmarks/execute/benches/execute.rs

+1%

28 ms27.7 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[quicksort]

benchmarks/execute/benches/execute.rs

+1%

2.8 ms2.8 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

8.1 ms8.1 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[keccak256]

benchmarks/execute/benches/execute.rs

5.5 ms5.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[keccak256_iter]

benchmarks/execute/benches/execute.rs

52.3 ms52.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

29.4 ms29.4 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[pairing]

benchmarks/execute/benches/execute.rs

71.2 ms71.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[bubblesort]

benchmarks/execute/benches/execute.rs

-1%

5.8 ms5.8 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

-1%

2.5 ms2.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[revm_snailtracer]

benchmarks/execute/benches/execute.rs

-3%

7.1 ms7.4 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[revm_transfer]

benchmarks/execute/benches/execute.rs

-7%

9.3 ms10 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[revm_snailtracer]

benchmarks/execute/benches/execute.rs

-34%

7.2 ms11 ms

Commits

Click on a commit to change the comparison range

Base

main

a1bce3e

-99.22%

fix: visibility of memory ctx members

d755671

19 hours ago

by shuklaayush

+96.74%

chore: cleanup

b866a89

16 hours ago

by shuklaayush

-92.81%

fix: try with two bitsets

8743304

2 hours ago

by shuklaayush

Home Terms Privacy Docs