bshastry:feat/spec-compliant-expected-exceptions - Branch - bluealloy/revm

feat(statetest): spec-compliant expected exception handling

#3198

Comparing

bshastry:feat/spec-compliant-expected-exceptions

(

7b68eda

) with

main

(

6cf44ef

)

Untouched: 173

Ignored: 6

Benchmarks

Passed

CALL_50

bins/revme/benches/evm.rs::benches::evm

+1%

110.6 µs109.6 µs

DUP4_50

bins/revme/benches/evm.rs::benches::evm

+1%

24.2 µs24.1 µs

PUSH26_50

bins/revme/benches/evm.rs::benches::evm

+1%

19.9 µs19.8 µs

SWAP10_50

bins/revme/benches/evm.rs::benches::evm

+1%

22.1 µs22 µs

CLZ_50

bins/revme/benches/evm.rs::benches::evm

24 µs23.9 µs

ecpairing precompile

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

4.8 ms4.7 ms

COINBASE_50

bins/revme/benches/evm.rs::benches::evm

19.5 µs19.4 µs

PUSH16_50

bins/revme/benches/evm.rs::benches::evm

19.5 µs19.4 µs

PUSH14_50

bins/revme/benches/evm.rs::benches::evm

19.6 µs19.5 µs

PUSH23_50

bins/revme/benches/evm.rs::benches::evm

19.9 µs19.8 µs

PUSH27_50

bins/revme/benches/evm.rs::benches::evm

20 µs19.9 µs

transact_1000tx_commit_inner_every_40

bins/revme/benches/evm.rs::benches::evm

2.9 ms2.9 ms

PUSH29_50

bins/revme/benches/evm.rs::benches::evm

20 µs19.9 µs

PUSH31_50

bins/revme/benches/evm.rs::benches::evm

20.1 µs20 µs

MUL_50

bins/revme/benches/evm.rs::benches::evm

25.4 µs25.3 µs

DUP14_50

bins/revme/benches/evm.rs::benches::evm

24.3 µs24.2 µs

DUP16_50

bins/revme/benches/evm.rs::benches::evm

24.6 µs24.5 µs

JUMPDEST_50

bins/revme/benches/evm.rs::benches::evm

16.4 µs16.4 µs

SLT_50

bins/revme/benches/evm.rs::benches::evm

25.2 µs25.1 µs

transfer_finalize

bins/revme/benches/evm.rs::benches::evm

17.6 µs17.5 µs

PUSH30_50

bins/revme/benches/evm.rs::benches::evm

20 µs20 µs

PUSH17_50

bins/revme/benches/evm.rs::benches::evm

19.6 µs19.5 µs

PUSH24_50

bins/revme/benches/evm.rs::benches::evm

19.8 µs19.7 µs

PUSH28_50

bins/revme/benches/evm.rs::benches::evm

19.9 µs19.9 µs

PUSH19_50

bins/revme/benches/evm.rs::benches::evm

19.7 µs19.6 µs

DUP12_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

MSTORE8_50

bins/revme/benches/evm.rs::benches::evm

56.1 µs56 µs

transfer

bins/revme/benches/evm.rs::benches::evm

14.2 µs14.2 µs

ecrecover precompile

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

202.9 µs202.5 µs

PUSH1_50

bins/revme/benches/evm.rs::benches::evm

19 µs19 µs

PUSH2_50

bins/revme/benches/evm.rs::benches::evm

19.1 µs19.1 µs

PUSH10_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.3 µs

PUSH32_50

bins/revme/benches/evm.rs::benches::evm

20 µs20 µs

BYTE_50

bins/revme/benches/evm.rs::benches::evm

24.5 µs24.5 µs

POP_50

bins/revme/benches/evm.rs::benches::evm

21.7 µs21.6 µs

SWAP14_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

MCOPY_50

bins/revme/benches/evm.rs::benches::evm

21.5 µs21.5 µs

SAR_50

bins/revme/benches/evm.rs::benches::evm

25.7 µs25.7 µs

NOT_50

bins/revme/benches/evm.rs::benches::evm

24.1 µs24.1 µs

DUP1_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP3_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP13_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP8_50

bins/revme/benches/evm.rs::benches::evm

24.3 µs24.3 µs

PUSH21_50

bins/revme/benches/evm.rs::benches::evm

19.7 µs19.7 µs

DUP7_50

bins/revme/benches/evm.rs::benches::evm

24.3 µs24.3 µs

SELFBALANCE_50

bins/revme/benches/evm.rs::benches::evm

26 µs25.9 µs

SMOD_50

bins/revme/benches/evm.rs::benches::evm

27.9 µs27.9 µs

g1_add

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

28 µs27.9 µs

transact_commit_1000txs

bins/revme/benches/evm.rs::benches::evm

3.8 ms3.8 ms

g2_add

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

43.1 µs43.1 µs

EXTCODESIZE_50

bins/revme/benches/evm.rs::benches::evm

42.9 µs42.9 µs

EXTCODEHASH_50

bins/revme/benches/evm.rs::benches::evm

43.4 µs43.4 µs

MLOAD_50

bins/revme/benches/evm.rs::benches::evm

58.7 µs58.7 µs

g1_msm (size 2)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

1.4 ms1.4 ms

STATICCALL_50

bins/revme/benches/evm.rs::benches::evm

108.8 µs108.8 µs

MCOPY_COLD_50

bins/revme/benches/evm.rs::benches::evm

25.6 µs25.6 µs

MULMOD_50

bins/revme/benches/evm.rs::benches::evm

28.9 µs28.9 µs

g1_msm (size 1)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

714 µs713.9 µs

map_fp2_to_g2

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

860.6 µs860.6 µs

g2_msm (size 1)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

1.3 ms1.3 ms

snailtracer

bins/revme/benches/evm.rs::benches::evm

192.5 ms192.5 ms

pairing (1 pairs)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

4.4 ms4.4 ms

g2_msm (size 256)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

162.3 ms162.3 ms

snailtracer-inspect

bins/revme/benches/evm.rs::benches::evm

201.6 ms201.6 ms

kzg precompile

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

7.5 ms7.5 ms

pairing (16 pairs)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

36.5 ms36.5 ms

pairing (8 pairs)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

19.4 ms19.4 ms

PUSH3_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.2 µs

ADD_50

bins/revme/benches/evm.rs::benches::evm

24.3 µs24.3 µs

PUSH8_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.2 µs

PUSH6_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

PUSH9_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

RETURNDATASIZE_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

GAS_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.2 µs

SWAP16_50

bins/revme/benches/evm.rs::benches::evm

22.1 µs22.1 µs

DUP15_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

GASLIMIT_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

GT_50

bins/revme/benches/evm.rs::benches::evm

24.6 µs24.6 µs

GASPRICE_50

bins/revme/benches/evm.rs::benches::evm

19.5 µs19.5 µs

SWAP9_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SWAP7_50

bins/revme/benches/evm.rs::benches::evm

22 µs22 µs

DUP5_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

XOR_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

blake2/100K_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

9.4 ms9.4 ms

blake2/10_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

4.4 µs4.4 µs

blake2/1024_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

100.2 µs100.2 µs

blake2/512_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

51.9 µs51.9 µs

blake2/12_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

4.6 µs4.6 µs

bn254 mul precompile

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

335 µs335 µs

blake2/64_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

9.6 µs9.6 µs

blake2/compress_12_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

3.3 µs3.3 µs

bn254 add precompile

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

21 µs21 µs

blake2/4_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

3.5 µs3.5 µs

NUMBER_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

blake2/200K_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

18.9 ms18.9 ms

blake2/2_rounds

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

3.2 µs3.2 µs

PUSH15_50

bins/revme/benches/evm.rs::benches::evm

19.6 µs19.6 µs

PUSH20_50

bins/revme/benches/evm.rs::benches::evm

19.7 µs19.7 µs

PC_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.4 µs

map_fp_to_g1

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

243.4 µs243.4 µs

pairing (2 pairs)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

6.5 ms6.5 ms

PUSH25_50

bins/revme/benches/evm.rs::benches::evm

19.8 µs19.8 µs

g1_msm (size 256)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

89.2 ms89.2 ms

burntpix

bins/revme/benches/evm.rs::benches::evm

487.3 ms487.3 ms

g2_msm (size 128)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

88.2 ms88.2 ms

g1_msm (size 128)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

47 ms47 ms

g2_msm (size 2)

crates/precompile/bench/main.rs::benches::benchmark_crypto_precompiles::Crypto Precompile benchmarks

2.7 ms2.7 ms

RETURNDATACOPY_50

bins/revme/benches/evm.rs::benches::evm

107.3 µs107.3 µs

KECCAK256_50

bins/revme/benches/evm.rs::benches::evm

145.2 µs145.3 µs

SDIV_50

bins/revme/benches/evm.rs::benches::evm

28 µs28 µs

MOD_50

bins/revme/benches/evm.rs::benches::evm

26.6 µs26.7 µs

SHR_50

bins/revme/benches/evm.rs::benches::evm

25.5 µs25.6 µs

SHL_50

bins/revme/benches/evm.rs::benches::evm

25.3 µs25.3 µs

ISZERO_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP2_50

bins/revme/benches/evm.rs::benches::evm

24.1 µs24.2 µs

SWAP12_50

bins/revme/benches/evm.rs::benches::evm

22 µs22 µs

SWAP13_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs22 µs

SWAP11_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SWAP2_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SWAP4_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SWAP1_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

DIFFICULTY_50

bins/revme/benches/evm.rs::benches::evm

19.7 µs19.8 µs

PUSH18_50

bins/revme/benches/evm.rs::benches::evm

19.6 µs19.6 µs

ORIGIN_50

bins/revme/benches/evm.rs::benches::evm

19.5 µs19.5 µs

PUSH13_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.5 µs

PUSH12_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.4 µs

PUSH11_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.4 µs

CALLVALUE_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

PUSH5_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.3 µs

PUSH22_50

bins/revme/benches/evm.rs::benches::evm

19.8 µs19.8 µs

CHAINID_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

REVERT_50

bins/revme/benches/evm.rs::benches::evm

124.8 µs125.1 µs

LT_50

bins/revme/benches/evm.rs::benches::evm

24.6 µs24.6 µs

EQ_50

bins/revme/benches/evm.rs::benches::evm

24.4 µs24.5 µs

DUP11_50

bins/revme/benches/evm.rs::benches::evm

24.4 µs24.5 µs

DUP9_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

JUMPI_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP10_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.2 µs

DUP6_50

bins/revme/benches/evm.rs::benches::evm

24.1 µs24.2 µs

CALLDATACOPY_50

bins/revme/benches/evm.rs::benches::evm

57.6 µs57.8 µs

SLOAD_50

bins/revme/benches/evm.rs::benches::evm

33.5 µs33.6 µs

CALLDATALOAD_50

bins/revme/benches/evm.rs::benches::evm

58.6 µs58.7 µs

SWAP3_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SWAP5_50

bins/revme/benches/evm.rs::benches::evm

21.8 µs21.9 µs

MSTORE_COLD_50

bins/revme/benches/evm.rs::benches::evm

23.6 µs23.7 µs

MSTORE_50

bins/revme/benches/evm.rs::benches::evm

19.7 µs19.7 µs

ADDRESS_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.5 µs

CALLER_50

bins/revme/benches/evm.rs::benches::evm

19.4 µs19.5 µs

PUSH7_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.4 µs

TIMESTAMP_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

PUSH0_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.3 µs

MSIZE_50

bins/revme/benches/evm.rs::benches::evm

19.2 µs19.3 µs

PUSH4_50

bins/revme/benches/evm.rs::benches::evm

19.1 µs19.2 µs

CALLDATASIZE_50

bins/revme/benches/evm.rs::benches::evm

19.3 µs19.3 µs

SWAP8_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs21.9 µs

SIGNEXTEND_50

bins/revme/benches/evm.rs::benches::evm

25.2 µs25.3 µs

SGT_50

bins/revme/benches/evm.rs::benches::evm

25 µs25.1 µs

RETURN_50

bins/revme/benches/evm.rs::benches::evm

123.5 µs124 µs

AND_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.3 µs

OR_50

bins/revme/benches/evm.rs::benches::evm

24.2 µs24.3 µs

EXP_50

bins/revme/benches/evm.rs::benches::evm

31.4 µs31.5 µs

SWAP6_50

bins/revme/benches/evm.rs::benches::evm

21.9 µs22 µs

SWAP15_50

bins/revme/benches/evm.rs::benches::evm

22.2 µs22.3 µs

SSTORE_50

bins/revme/benches/evm.rs::benches::evm

49.2 µs49.4 µs

ADDMOD_50

bins/revme/benches/evm.rs::benches::evm

28.4 µs28.5 µs

SUB_50

bins/revme/benches/evm.rs::benches::evm

24.3 µs24.4 µs

DIV_50

bins/revme/benches/evm.rs::benches::evm

-1%

26.6 µs26.7 µs

DELEGATECALL_50

bins/revme/benches/evm.rs::benches::evm

-1%

101.5 µs102.1 µs

JUMP_50

bins/revme/benches/evm.rs::benches::evm

-1%

18.6 µs18.7 µs

analysis

bins/revme/benches/evm.rs::benches::evm

-1%

46.6 µs47 µs

CODESIZE_50

bins/revme/benches/evm.rs::benches::evm

-1%

19.2 µs19.4 µs

CREATE_50

bins/revme/benches/evm.rs::benches::evm

-1%

426.5 µs430.9 µs

EXTCODECOPY_50

bins/revme/benches/evm.rs::benches::evm

-1%

52.9 µs53.5 µs

Ignored

evm-build

bins/revme/benches/evm.rs::benches::evm

Ignored

22.2 µs22.2 µs

LOG1_50

bins/revme/benches/evm.rs::benches::evm

Ignored

-15%

38 µs44.5 µs

LOG0_50

bins/revme/benches/evm.rs::benches::evm

Ignored

-4%

35 µs36.5 µs

LOG4_50

bins/revme/benches/evm.rs::benches::evm

Ignored

-4%

54 µs56.1 µs

LOG3_50

bins/revme/benches/evm.rs::benches::evm

Ignored

+18%

52 µs44.2 µs

LOG2_50

bins/revme/benches/evm.rs::benches::evm

Ignored

+19%

48.8 µs41.2 µs

Commits

Click on a commit to change the comparison range

Base

main

6cf44ef

+0.8%

fix(statetest): fix CI failures in exception_map module - Use U256::from() instead of .into() for test values (compilation fix) - Add unprefixed "SenderNotEOA" variant to exception mapping - Apply rustfmt formatting fixes 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>

22d559d

1 month ago

by bshastry

-0.54%

fix(statetest): fix docs and add TR_TypeNotSupported mapping - Wrap URL in angle brackets to fix rustdoc bare-urls warning - Add TR_TypeNotSupported as alias for TYPE_NOT_SUPPORTED exception 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>

aeba4cf

1 month ago

by bshastry

-0.5%

fix: add legacy exception mappings for state tests Add support for legacy TR_* exception names used in ethereum/legacytests: - TR_FeeCapLessThanBlocks -> GasPriceLessThanBasefee - TR_GasLimitReached -> CallerGasLimitMoreThanBlock - TR_NoFunds -> LackOfFundForMaxFee - TR_IntrinsicGas, TR_NoFundsOrGas, IntrinsicGas -> CallGasCostMoreThanGasLimit - TR_TipGtFeeCap -> PriorityFeeGreaterThanMaxFee - TR_NoFundsX -> OverflowPaymentInTransaction - TR_InitCodeLimitExceeded -> CreateInitCodeSizeLimit - TR_BLOBCREATE -> BlobCreateTransaction - TR_EMPTYBLOB -> EmptyBlobs - TR_BLOBLIST_OVERSIZE -> TooManyBlobs - TR_BLOBVERSION_INVALID -> BlobVersionNotSupported These mappings enable the state test runner to correctly match expected exceptions from the legacy test suite.

ba6a950

1 month ago

by claude

+0.21%

fmt fix

7b68eda

1 month ago

by bshastry

Home Terms Privacy Docs