211-refactor-logical-planner--perfmon - Branch - jzombie/rust-llkv

211-refactor-logical-planner -- perf monitor

#224Merged

Comparing

211-refactor-logical-planner--perfmon

(

d5dd513

) with

211-refactor-logical-planner

(

8977772

)

-58%

Improvements: 6

Regressions: 12

Untouched: 57

Skipped: 2

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

No successful run was found on 211-refactor-logical-planner ( e250088) during the generation of this report, so main ( 8977772) was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

Skipped (2)

Failed

hash_join_anti_join[1000]

criterion::hash_join_anti_join::1000

Regression

-55%

35 µs76.9 µs

hash_join_anti_join[10000]

criterion::hash_join_anti_join::10000

Regression

-38%

271.2 µs436.9 µs

scan_unsorted_multiset

criterion::random_probe_u64

Regression

-19%

1.4 ms1.8 ms

hash_join_inner_join[10000]

criterion::hash_join_inner_join::10000

Regression

-28%

605.3 µs840.6 µs

hash_join_semi_join[1000]

criterion::hash_join_semi_join::1000

Regression

-58%

30.4 µs72.9 µs

unsorted_sum_u64

criterion::scan_builder_1M

Regression

-10%

961.6 µs1,072.4 µs

hash_join_semi_join[10000]

criterion::hash_join_semi_join::10000

Regression

-34%

219.4 µs331.3 µs

hash_join_anti_join[100000]

criterion::hash_join_anti_join::100000

Regression

-11%

3.7 ms4.1 ms

hash_join_semi_join[100000]

criterion::hash_join_semi_join::100000

Regression

-12%

3.1 ms3.5 ms

hash_join_left_join[10000]

criterion::hash_join_left_join::10000

Regression

-22%

508.8 µs652.3 µs

hash_join_semi_join[1000000]

criterion::hash_join_semi_join::1000000

Regression

-16%

36.7 ms43.6 ms

highfrag/range/with_index

criterion::index_matrix_1M::highfrag_range_with_index

Regression

-11%

2.8 ms3.1 ms

Improved

hash_join_no_matches[1000]

criterion::hash_join_no_matches::1000

+73%

114.1 µs65.9 µs

hash_join_many_to_many[1000]

criterion::hash_join_many_to_many::1000

+68%

129.9 µs77.2 µs

hash_join_left_join[1000]

criterion::hash_join_left_join::1000

+57%

149.9 µs95.2 µs

select4_full

criterion::slturl_cases

+34%

7.6 s5.7 s

table_layer_sum

criterion::table_layer_overhead_analysis

+14%

2.4 ms2.1 ms

storage_sequential_both_case_sensitive

criterion::string_substring_storage_only

+12%

54.9 ms49 ms

Passed

ingest_mixed_1M[batches=16]

criterion::ingest_mixed_1M::batches=16

+10%

346.3 ms315.6 ms

storage_sequential_contains_case_insensitive

criterion::string_substring_storage_only

+10%

116.4 ms106.1 ms

hash_join_many_to_many[100]

criterion::hash_join_many_to_many::100

+9%

26.4 µs24.2 µs

hash_join_inner_join[1000]

criterion::hash_join_inner_join::1000

+9%

75.5 µs69.2 µs

storage_sequential_starts_case_insensitive

criterion::string_substring_storage_only

+9%

94.6 ms86.8 ms

delete1000_full

criterion::slturl_cases

+8%

375.6 ms346.2 ms

scan_stream_expr_subtract_one

criterion::llkv_table_math_1M

+8%

3.1 ms2.9 ms

hash_join_many_to_many[100000]

criterion::hash_join_many_to_many::100000

+8%

12.7 ms11.8 ms

scan_stream_expr_add_one

criterion::llkv_table_math_1M

+7%

3.5 ms3.3 ms

scan_stream_expr_divide_two

criterion::llkv_table_math_1M

+6%

4.3 ms4 ms

scan_stream_expr_multiply_two

criterion::llkv_table_math_1M

+5%

3.1 ms2.9 ms

store_sequential_starts_case_insensitive

criterion::string_substring_fused_vs_sequential

+5%

90.4 ms86.3 ms

scan_contains_needle_case_sensitive

criterion::string_substring_search

+4%

46.4 ms44.4 ms

scan_stream_sum_u64

criterion::llkv_table_math_1M

+4%

2.2 ms2.1 ms

storage_fused_contains_case_insensitive

criterion::string_substring_storage_only

+4%

88.6 ms85.4 ms

ingest_mixed_1M[batches=4]

criterion::ingest_mixed_1M::batches=4

+3%

316.5 ms306.3 ms

store_sequential_both_case_sensitive

criterion::string_substring_fused_vs_sequential

+2%

49.9 ms48.9 ms

store_sequential_both_case_insensitive

criterion::string_substring_fused_vs_sequential

+1%

146 ms144.7 ms

direct_columnstore_sum

criterion::table_layer_overhead_analysis

+1%

102.2 µs101.3 µs

ingest_mixed_1M[batches=1]

criterion::ingest_mixed_1M::batches=1

+1%

241 ms239.3 ms

storage_fused_starts_case_insensitive

criterion::string_substring_storage_only

+1%

8.4 ms8.4 ms

storage_fused_both_case_insensitive

criterion::string_substring_storage_only

+1%

86.4 ms85.9 ms

planner_fused_starts_case_insensitive

criterion::string_substring_fused_vs_sequential

+1%

111.5 ms110.9 ms

storage_sequential_both_case_insensitive

criterion::string_substring_storage_only

146 ms145.3 ms

sum_i32_scan_only

criterion::column_store_sum_1M

49.1 µs48.9 µs

store_sequential_contains_case_insensitive

criterion::string_substring_fused_vs_sequential

110.4 ms110 ms

multi_column_batched

criterion::gather_rows

2 ms2 ms

multi_column_sequential

criterion::gather_rows

2 ms2 ms

single_column

criterion::gather_rows

667.6 µs667.5 µs

multi_column_batched_with_nulls

criterion::gather_rows

770.7 µs771.2 µs

planner_fused_both_case_insensitive

criterion::string_substring_fused_vs_sequential

167.9 ms168.1 ms

ingest_mixed_1M[batches=64]

criterion::ingest_mixed_1M::batches=64

340.9 ms341.9 ms

scan_contains_needle_case_insensitive

criterion::string_substring_search

102.9 ms103.4 ms

hash_join_no_matches[100000]

criterion::hash_join_no_matches::100000

-1%

10.4 ms10.5 ms

planner_fused_contains_case_insensitive

criterion::string_substring_fused_vs_sequential

-1%

130 ms131.9 ms

hash_join_no_matches[10000]

criterion::hash_join_no_matches::10000

-2%

632.8 µs648.2 µs

lowfrag/full/with_index

criterion::index_matrix_1M::lowfrag_full_with_index

-3%

20 ms20.5 ms

lowfrag/full/without_index

criterion::index_matrix_1M::lowfrag_full_without_index

-3%

14.5 ms14.9 ms

hash_join_inner_join[1000000]

criterion::hash_join_inner_join::1000000

-3%

276.3 ms285.5 ms

planner_fused_both_case_sensitive

criterion::string_substring_fused_vs_sequential

-3%

73.7 ms76.2 ms

sum_u64_fragmented_scan_only

criterion::column_store_fragmented_1M

-4%

88 µs91.2 µs

lowfrag/range/without_index

criterion::index_matrix_1M::lowfrag_range_without_index

-4%

3.9 ms4.1 ms

hash_join_left_join[1000000]

criterion::hash_join_left_join::1000000

-4%

142.6 ms148.3 ms

hash_join_left_join[100000]

criterion::hash_join_left_join::100000

-4%

7.6 ms7.9 ms

highfrag/full/with_index

criterion::index_matrix_1M::highfrag_full_with_index

-4%

41.1 ms42.9 ms

sorted_range_u64

criterion::scan_builder_1M

-5%

22.7 ms23.9 ms

scan_sorted_stream_join

criterion::random_probe_u64

-5%

20.5 ms21.6 ms

hash_join_many_to_many[10000]

criterion::hash_join_many_to_many::10000

-6%

752.4 µs797.3 µs

sorted_with_row_ids_u64

criterion::scan_builder_1M

-6%

19.7 ms20.9 ms

highfrag/range/without_index

criterion::index_matrix_1M::highfrag_range_without_index

-6%

5.2 ms5.5 ms

sum_u64_scan_only

criterion::column_store_sum_1M

-7%

103.1 µs110.4 µs

hash_join_no_matches[1000000]

criterion::hash_join_no_matches::1000000

-8%

246.6 ms267.5 ms

highfrag/full/without_index

criterion::index_matrix_1M::highfrag_full_without_index

-8%

14 ms15.2 ms

hash_join_anti_join[1000000]

criterion::hash_join_anti_join::1000000

-8%

42.5 ms46.1 ms

hash_join_inner_join[100000]

criterion::hash_join_inner_join::100000

-9%

11.2 ms12.3 ms

lowfrag/range/with_index

criterion::index_matrix_1M::lowfrag_range_with_index

-9%

1.9 ms2.1 ms

storage_fused_both_case_sensitive

criterion::string_substring_storage_only

-10%

7.5 ms8.3 ms

Commits

Click on a commit to change the comparison range

Base

main

8977772

-60.59%

Fix bench compilation

c730e02

30 days ago

by jzombie

+31.72%

Lint deps

3b9dbc3

29 days ago

by jzombie

-29.06%

Add'l dep lint

8fecf86

29 days ago

by jzombie

+33%

Resolve Clippy warnings

0beefa1

29 days ago

by jzombie

-33.35%

`cargo fmt --all`

d5dd513

28 days ago

by jzombie

Home Terms Privacy Docs