ChrisDryden:fix-split-number-memory-issue - Branch - uutils/coreutils

split: stream data using copy to not overwhelm memory with large files

#10251

Comparing

ChrisDryden:fix-split-number-memory-issue

(

e4e9bdf

) with

main

(

ec7e81e

)

×4.9

Improvement: 1

Untouched: 283

Skipped: 38

Benchmarks

322 total

split_number_chunks

src/uu/split/benches/split_bench.rs

×4.9

1,127.9 KB231.9 KB

dd_copy_4k_blocks

src/uu/dd/benches/dd_bench.rs

+1%

1.3 ms1.3 ms

sort_reverse_locale[500000]

src/uu/sort/benches/sort_bench.rs

338.4 ms337 ms

sort_accented_data[500000]

src/uu/sort/benches/sort_bench.rs

338.8 ms338.1 ms

sort_general_numeric[200000]

src/uu/sort/benches/sort_bench.rs

660.8 ms659.5 ms

sort_unique_locale[500000]

src/uu/sort/benches/sort_bench.rs

470.4 ms469.6 ms

split_bytes

src/uu/split/benches/split_bench.rs

508.2 µs507.4 µs

cp_recursive_deep_tree[(120, 4)]

src/uu/cp/benches/cp_bench.rs

13.5 ms13.5 ms

shuf_input_range[1000000]

src/uu/shuf/benches/shuf_bench.rs

92.5 ms92.4 ms

cksum_sysv

src/uu/cksum/benches/cksum_bench.rs

48.2 ms48.2 ms

dd_copy_default

src/uu/dd/benches/dd_bench.rs

14.1 ms14.1 ms

single_date_now

src/uu/date/benches/date_bench.rs

192.7 µs192.6 µs

shuf_lines[100000]

src/uu/shuf/benches/shuf_bench.rs

27.6 ms27.5 ms

cp_recursive_balanced_tree[(5, 4, 10)]

src/uu/cp/benches/cp_bench.rs

71.8 ms71.8 ms

cp_recursive_wide_tree[(6000, 800)]

src/uu/cp/benches/cp_bench.rs

188.2 ms188.1 ms

sort_german_c_locale

src/uu/sort/benches/sort_locale_c_bench.rs

37.3 ms37.3 ms

dd_copy_1m_blocks

src/uu/dd/benches/dd_bench.rs

1.5 ms1.5 ms

complex_relative_date

src/uu/date/benches/date_bench.rs

244.8 µs244.8 µs

mv_single_file

src/uu/mv/benches/mv_bench.rs

138.3 ms138.3 ms

cksum_blake3

src/uu/cksum/benches/cksum_bench.rs

217 µs217 µs

ls_recursive_long_all_mixed_tree

src/uu/ls/benches/ls_bench.rs

2.8 ms2.8 ms

sort_long_line[160000]

src/uu/sort/benches/sort_bench.rs

1.4 ms1.4 ms

ls_recursive_deep_tree[(200, 2)]

src/uu/ls/benches/ls_bench.rs

2.1 ms2.1 ms

file_tz_abbreviations

src/uu/date/benches/date_bench.rs

15.9 ms15.9 ms

join_french_locale

src/uu/join/benches/join_bench.rs

12.9 ms12.9 ms

Commits

Click on a commit to change the comparison range

Base

main

ec7e81e

×4.9

Use 128 KiB buffer for streaming copy to fix performance regression

3d2d0ba

25 days ago

by ChrisDryden

Merge branch 'main' into fix-split-number-memory-issue

e4e9bdf

2 days ago

by sylvestre

Home Terms Privacy Docs