feat/aot-metered-cost - Branch - openvm-org/openvm

feat: aot metered cost

#2168Merged

Comparing

feat/aot-metered-cost

(

88db90d

) with

feat/aot

(

c2e376e

)

-89%

Regressions: 14

Untouched: 4

Skipped: 42

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

No successful run was found on feat/aot ( f804542) during the generation of this report, so main ( c2e376e) was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

Skipped (42)

These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

105.7 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

44 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute_metered[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

996.4 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute_preflight[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

173.5 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

735.5 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

70 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_leaf_verifier_execute_preflight[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

1.9 s*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

161.8 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_internal_verifier_execute_metered[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

71.6 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

173.3 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

97.7 ms*

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

230.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[revm_snailtracer]

benchmarks/execute/benches/execute.rs

Skipped

62.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

603.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute_preflight[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

379.5 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

309.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[keccak256]

benchmarks/execute/benches/execute.rs

Skipped

207 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[quicksort]

benchmarks/execute/benches/execute.rs

Skipped

199.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

523.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[keccak256]

benchmarks/execute/benches/execute.rs

Skipped

101 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[bubblesort]

benchmarks/execute/benches/execute.rs

Skipped

88.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[factorial_iterative_u256]

benchmarks/execute/benches/execute.rs

Skipped

676.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[keccak256_iter]

benchmarks/execute/benches/execute.rs

Skipped

323.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute_metered[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

159.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[pairing]

benchmarks/execute/benches/execute.rs

Skipped

397.4 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[revm_transfer]

benchmarks/execute/benches/execute.rs

Skipped

177.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

1.9 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Skipped

103.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Skipped

289.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_internal_verifier_execute[fibonacci]

benchmarks/execute/benches/execute.rs

Skipped

89.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Skipped

189 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute_metered[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

2.7 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_leaf_verifier_execute_preflight[kitchen-sink]

benchmarks/execute/benches/execute.rs

Skipped

4.9 s*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[revm_transfer]

benchmarks/execute/benches/execute.rs

Skipped

113.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[pairing]

benchmarks/execute/benches/execute.rs

Skipped

399.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[quicksort]

benchmarks/execute/benches/execute.rs

Skipped

103.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[revm_snailtracer]

benchmarks/execute/benches/execute.rs

Skipped

53.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Skipped

145.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[sha256]

benchmarks/execute/benches/execute.rs

Skipped

100.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[sha256]

benchmarks/execute/benches/execute.rs

Skipped

193.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute_metered[bubblesort]

benchmarks/execute/benches/execute.rs

Skipped

186.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

benchmark_execute[sha256_iter]

benchmarks/execute/benches/execute.rs

Skipped

343.9 ms*

Failed

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[sha256]

benchmarks/execute/benches/execute.rs

Regression

-88%

31.1 ms262.9 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[revm_transfer]

benchmarks/execute/benches/execute.rs

Regression

-76%

43.1 ms176.1 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[sha256]

benchmarks/execute/benches/execute.rs

Regression

-78%

67.1 ms307.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[quicksort]

benchmarks/execute/benches/execute.rs

Regression

-81%

60.3 ms321.7 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[bubblesort]

benchmarks/execute/benches/execute.rs

Regression

-89%

27.4 ms246.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[quicksort]

benchmarks/execute/benches/execute.rs

Regression

-89%

32 ms281.6 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Regression

-78%

101.4 ms465.6 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[keccak256]

benchmarks/execute/benches/execute.rs

Regression

-88%

33 ms264.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Regression

-78%

72.5 ms324.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[keccak256]

benchmarks/execute/benches/execute.rs

Regression

-78%

68.9 ms309.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[fibonacci_recursive]

benchmarks/execute/benches/execute.rs

Regression

-89%

45.1 ms396.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[revm_transfer]

benchmarks/execute/benches/execute.rs

Regression

-68%

64.1 ms201.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[bubblesort]

benchmarks/execute/benches/execute.rs

Regression

-81%

53 ms280.2 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[fibonacci_iterative]

benchmarks/execute/benches/execute.rs

Regression

-89%

31.4 ms291.8 ms

Passed

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[revm_snailtracer]

benchmarks/execute/benches/execute.rs

-21%

17.1 ms21.5 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[revm_snailtracer]

benchmarks/execute/benches/execute.rs

-21%

16.1 ms20.4 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute_metered[pairing]

benchmarks/execute/benches/execute.rs

-37%

156.1 ms249.3 ms

Uses the Wall Time instrument
to collect wall time performance metrics.

benchmark_execute[pairing]

benchmarks/execute/benches/execute.rs

-40%

137.8 ms229 ms

Commits

Click on a commit to change the comparison range

Base

main

c2e376e

-15.86%

chore: typo

9fcc6a3

1 month ago

by Maillew

+0.09%

chore: linta

87142eb

1 month ago

by Maillew

-1.14%

chore: refactor of extern_handlers for pure n metered

b75f7ad

1 month ago

by Maillew

+0.99%

chore: cargo fmt

5136562

1 month ago

by shuklaayush

-1.48%

chore: remove unused dep

f24f382

1 month ago

by shuklaayush

-71.85%

Merge remote-tracking branch 'origin/feat/aot' into feat/aot-metered-cost

88db90d

1 month ago

by Maillew

Home Terms Privacy Docs