yk/worker_pool_storage_2 - Branch - paradigmxyz/reth

perf(tree): worker pooling for storage in multiproof generation

#18887Merged

Comparing

yk/worker_pool_storage_2

(

8e64738

) with

main

(

d2070f4

)

Untouched: 77

Benchmarks

77 total

size 100000 | updated 0.1% | depth 5

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+3%

1.1 ms1 ms

size 100000 | updated 0.1% | depth 2

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+3%

3.5 ms3.4 ms

size 100000 | updated 0.1% | depth 1

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+3%

3.7 ms3.6 ms

size 100000 | updated 0.1% | depth 0

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+3%

3.7 ms3.6 ms

size 100000 | updated 0.1% | depth 3

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+3%

2.5 ms2.4 ms

hash builder[init size 10000 | update size 100 | num updates 5]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-3%

42.7 ms43.8 ms

hash builder[init size 10000 | update size 100 | num updates 3]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-2%

26.2 ms26.8 ms

hash builder[init size 10000 | update size 1000 | num updates 5]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-2%

123.4 ms126.2 ms

prefix set | size: 10 | `Vec` with custom cursor lookup

crates/trie/common/benches/prefix_set.rs::prefix_set::prefix_set_lookups::Prefix Set Lookups

+2%

3.1 µs3.1 µs

hash builder[init size 10000 | update size 1000 | num updates 1]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-2%

25 ms25.4 ms

hash builder[init size 10000 | update size 1000 | num updates 10]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-1%

246.2 ms249.9 ms

hash builder[init size 10000 | update size 100 | num updates 10]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

+1%

86.6 ms85.7 ms

hash builder[init size 1000 | update size 1000 | num updates 1]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-1%

5.6 ms5.6 ms

prefix set | size: 10 | `BTreeSet` with `Iterator:any` lookup

crates/trie/common/benches/prefix_set.rs::prefix_set::prefix_set_lookups::Prefix Set Lookups

-1%

3.8 µs3.9 µs

hash builder[init size 1000 | update size 1000 | num updates 3]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-1%

16.7 ms16.8 ms

size 100000 | updated 0.1% | depth 4

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+1%

1.4 ms1.4 ms

prefix set | size: 10 | `BTreeSet` with `BTreeSet:range` lookup

crates/trie/common/benches/prefix_set.rs::prefix_set::prefix_set_lookups::Prefix Set Lookups

+1%

5.1 µs5.1 µs

hash builder[init size 1000 | update size 100 | num updates 10]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

-1%

23.9 ms24.1 ms

size 100000 | updated 1% | depth 3

crates/trie/sparse/benches/rlp_node.rs::rlp_node::update_rlp_node_level::update rlp node level

+1%

21.9 ms21.8 ms

hash builder[init size 1000 | update size 100 | num updates 3]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

+1%

7.2 ms7.2 ms

hash builder[init size 1000 | update size 1000 | num updates 5]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

27.8 ms27.9 ms

sparse trie[init size 1000 | update size 100 | num updates 1]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

1.1 ms1.1 ms

hash builder[init size 10000 | update size 1000 | num updates 3]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

75.9 ms75.6 ms

sparse trie[init size 1000 | update size 1000 | num updates 1]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

5.2 ms5.2 ms

hash builder[init size 1000 | update size 100 | num updates 1]

crates/trie/sparse/benches/root.rs::root::calculate_root_from_leaves_repeated::calculate root from leaves repeated

2.4 ms2.4 ms

Commits

Click on a commit to change the comparison range

Base

main

d2070f4

+0.04%

fmt, clippy

fbeec50

10 months ago

by yongkangc

-0.13%

fix comments

13891ad

10 months ago

by yongkangc

+0.13%

refactor(proof_task): improve documentation and rename variables for clarity

2957afa

10 months ago

by yongkangc

-0.23%

refactor(config): remove storage proof worker configuration

29d48d4

10 months ago

by yongkangc

-0.07%

refactor(proof_task): enhance comments and adjust queue capacity logic

3fb97c6

10 months ago

by yongkangc

-0.08%

disable max concurrency

5779b86

10 months ago

by yongkangc

+0.17%

nits

0e33837

10 months ago

by yongkangc

-0.13%

Update crates/trie/parallel/src/proof_task.rs

3bcbc71

10 months ago

by yongkangc

+0.14%

Update crates/trie/parallel/src/proof_task.rs

4a67076

10 months ago

by yongkangc

+0.15%

using unbounded queue

b2d5bcc

10 months ago

by yongkangc

+0.3%

refactor(proof_task): optimize storage proof computation by reusing cursor factories

b4bf193

10 months ago

by yongkangc

-0.36%

fmt, clippy

5897945

10 months ago

by yongkangc

+0.01%

refactor(proof_task): consolidate blinded storage node with storage proof

05e0eb8

10 months ago

by yongkangc

+0.4%

rm comment

4829de9

10 months ago

by yongkangc

-0.5%

simplify worker concurrency

6472cfe

10 months ago

by yongkangc

+0.18%

bump to error!

61ecc9a

10 months ago

by yongkangc

+0.12%

Update crates/engine/tree/src/tree/payload_processor/mod.rs

30f6fda

10 months ago

by yongkangc

-0.05%

handle sending error back

4680336

10 months ago

by yongkangc

-0.19%

update message

1954502

10 months ago

by yongkangc

-0.35%

make spawning falliable

1902b43

10 months ago

by yongkangc

+0.27%

remove error log, as we propogate up

8fb0dd1

10 months ago

by yongkangc

-0.06%

Apply suggestion from @Copilot

e0010d7

10 months ago

by yongkangc

-0.16%

use expect instead of unwrap

53cd4ba

10 months ago

by yongkangc

+0.25%

Update crates/trie/parallel/src/proof_task.rs

e854628

10 months ago

by yongkangc

-0.03%

Update crates/trie/parallel/src/proof_task.rs

3b17cc7

10 months ago

by yongkangc

+0.18%

consolidate

6c89cf4

10 months ago

by yongkangc

-0.39%

removed the unnecessary remaining_concurrency variable allocation

c5f6eb9

10 months ago

by yongkangc

+0.01%

clippy

af73c7a

10 months ago

by yongkangc

+0.28%

Apply suggestion from @yongkangc

a8e52bc

10 months ago

by yongkangc

-0.4%

address brian's pr

c48b328

10 months ago

by yongkangc

+0.23%

Merge branch 'main' into yk/worker_pool_storage_2

3eff3e2

10 months ago

by yongkangc

+0.09%

Update crates/trie/parallel/src/proof_task.rs

7efff3d

10 months ago

by yongkangc

Update crates/trie/parallel/src/proof_task.rs

f7cd93f

10 months ago

by yongkangc

-0.27%

Refactor error handling in StorageWorkerJob to use a consistent error message format

f823c6b

10 months ago

by yongkangc

+0.44%

fix

6d41352

10 months ago

by yongkangc

+0.1%

bump up workers

4ca404e

10 months ago

by yongkangc

+0.3%

cli flag for storage

d66ed61

10 months ago

by yongkangc

docs: update CLI reference for storage-worker-count flag

4aba3de

10 months ago

by yongkangc

-0.25%

docs: clarify storage-worker-count uses Tokio blocking pool

8e64738

10 months ago

by yongkangc

Home Terms Privacy Docs