mattsu2020:sort/sort-merge-fdlimit.sh - Branch - uutils/coreutils

sort : gnu core utils test (sort-merge-fdlimit.sh)

#9849

Comparing

mattsu2020:sort/sort-merge-fdlimit.sh

(

9e9b311

) with

main

(

44e0bba

)

+16%

Improvements: 10

Untouched: 129

Skipped: 37

Benchmarks

Skipped (37)

Improved

sort_long_line[160000]

src/uu/sort/benches/sort_bench.rs

+16%

1.7 ms1.4 ms

sort_numeric_utf8_locale

src/uu/sort/benches/sort_locale_utf8_bench.rs

+13%

22.8 ms20.2 ms

sort_ascii_c_locale

src/uu/sort/benches/sort_locale_c_bench.rs

+10%

20.3 ms18.5 ms

sort_case_sensitive[500000]

src/uu/sort/benches/sort_bench.rs

+8%

163.1 ms151.4 ms

sort_ascii_utf8_locale

src/uu/sort/benches/sort_locale_utf8_bench.rs

+5%

20.1 ms19.2 ms

sort_mixed_data[500000]

src/uu/sort/benches/sort_bench.rs

+4%

317.5 ms303.9 ms

sort_reverse_locale[500000]

src/uu/sort/benches/sort_bench.rs

+4%

350.9 ms336.1 ms

sort_ascii_only[500000]

src/uu/sort/benches/sort_bench.rs

+4%

343 ms329.4 ms

sort_accented_data[500000]

src/uu/sort/benches/sort_bench.rs

+4%

351.8 ms338.1 ms

sort_case_insensitive[500000]

src/uu/sort/benches/sort_bench.rs

+4%

265.9 ms255.6 ms

Passed

sort_unique_locale[500000]

src/uu/sort/benches/sort_bench.rs

+3%

483.2 ms469.7 ms

sort_mixed_utf8_locale

src/uu/sort/benches/sort_locale_utf8_bench.rs

+2%

37.4 ms36.7 ms

tsort_input_parsing_heavy[5000]

src/uu/tsort/benches/tsort_bench.rs

+2%

71.9 ms70.6 ms

sort_unique_utf8_locale

src/uu/sort/benches/sort_locale_utf8_bench.rs

+2%

37.7 ms37 ms

sort_reverse_utf8_locale

src/uu/sort/benches/sort_locale_utf8_bench.rs

+2%

37.6 ms37 ms

sort_german_c_locale

src/uu/sort/benches/sort_locale_c_bench.rs

+1%

37.9 ms37.4 ms

sort_numeric[500000]

src/uu/sort/benches/sort_bench.rs

+1%

1.2 s1.2 s

sort_german_de_locale

src/uu/sort/benches/sort_locale_de_bench.rs

+1%

37.9 ms37.4 ms

sort_mixed_c_locale

src/uu/sort/benches/sort_locale_c_bench.rs

+1%

37.2 ms36.7 ms

tsort_tree_dag[(10, 3)]

src/uu/tsort/benches/tsort_bench.rs

+1%

34.7 ms34.5 ms

dd_copy_8k_blocks

src/uu/dd/benches/dd_bench.rs

+1%

1 ms1 ms

dd_copy_64k_blocks

src/uu/dd/benches/dd_bench.rs

+1%

605.2 µs602 µs

tsort_wide_dag[100000]

src/uu/tsort/benches/tsort_bench.rs

131.7 ms131 ms

tsort_linear_chain[1000000]

src/uu/tsort/benches/tsort_bench.rs

1.6 s1.6 s

dd_copy_partial

src/uu/dd/benches/dd_bench.rs

551.2 µs548.9 µs

cksum_crc

src/uu/cksum/benches/cksum_bench.rs

17.1 ms17 ms

tsort_complex_dag[50000]

src/uu/tsort/benches/tsort_bench.rs

86.4 ms86.2 ms

cksum_crc32b

src/uu/cksum/benches/cksum_bench.rs

13.2 ms13.2 ms

ls_recursive_long_all_mixed_tree

src/uu/ls/benches/ls_bench.rs

2.8 ms2.8 ms

ls_recursive_deep_tree[(200, 2)]

src/uu/ls/benches/ls_bench.rs

2.2 ms2.2 ms

dd_copy_separate_blocks

src/uu/dd/benches/dd_bench.rs

44 ms43.9 ms

file_custom_format

src/uu/date/benches/date_bench.rs

13.4 ms13.4 ms

sort_dictionary_order[500000]

src/uu/sort/benches/sort_bench.rs

1.1 s1.1 s

ls_recursive_long_all_balanced_tree[(6, 4, 15)]

src/uu/ls/benches/ls_bench.rs

130 ms129.7 ms

file_tz_abbreviations

src/uu/date/benches/date_bench.rs

18.6 ms18.6 ms

ls_recursive_long_all_deep_tree[(100, 4)]

src/uu/ls/benches/ls_bench.rs

3.2 ms3.2 ms

cksum_raw_output

src/uu/cksum/benches/cksum_bench.rs

17 ms17 ms

ls_recursive_long_all_wide_tree[(15000, 1500)]

src/uu/ls/benches/ls_bench.rs

139.7 ms139.5 ms

cp_large_file[16]

src/uu/cp/benches/cp_bench.rs

363 µs362.4 µs

dd_copy_4k_blocks

src/uu/dd/benches/dd_bench.rs

1.3 ms1.3 ms

ls_recursive_mixed_tree

src/uu/ls/benches/ls_bench.rs

1.4 ms1.4 ms

ls_recursive_balanced_tree[(6, 4, 15)]

src/uu/ls/benches/ls_bench.rs

55.3 ms55.2 ms

dd_copy_with_skip

src/uu/dd/benches/dd_bench.rs

2.2 ms2.2 ms

dd_copy_1m_blocks

src/uu/dd/benches/dd_bench.rs

1.5 ms1.5 ms

ls_recursive_wide_tree[(10000, 1000)]

src/uu/ls/benches/ls_bench.rs

51.5 ms51.5 ms

shuf_lines[100000]

src/uu/shuf/benches/shuf_bench.rs

31.6 ms31.6 ms

wc_bytes_synthetic[500]

src/uu/wc/benches/wc_bench.rs

185.5 µs185.4 µs

shuf_repeat_sampling[50000]

src/uu/shuf/benches/shuf_bench.rs

5.1 ms5.1 ms

cksum_blake3

src/uu/cksum/benches/cksum_bench.rs

210.2 µs210.1 µs

dd_copy_default

src/uu/dd/benches/dd_bench.rs

14 ms14 ms

cksum_blake2b

src/uu/cksum/benches/cksum_bench.rs

192.8 ms192.7 ms

shuf_input_range[1000000]

src/uu/shuf/benches/shuf_bench.rs

163.5 ms163.5 ms

uniq_heavy_duplicates[10000]

src/uu/uniq/benches/uniq_bench.rs

1.9 ms1.9 ms

cksum_sha3

src/uu/cksum/benches/cksum_bench.rs

1.8 s1.8 s

cksum_default

src/uu/cksum/benches/cksum_bench.rs

17 ms17 ms

numfmt_large_numbers_si[10000]

src/uu/numfmt/benches/numfmt_bench.rs

32.5 ms32.5 ms

wc_lines_large_line_count[500000]

src/uu/wc/benches/wc_bench.rs

2.9 ms2.9 ms

cut_fields_custom_delim

src/uu/cut/benches/cut_bench.rs

40.8 ms40.8 ms

numfmt_round_modes[("down", 10000)]

src/uu/numfmt/benches/numfmt_bench.rs

34.3 ms34.3 ms

cksum_sysv

src/uu/cksum/benches/cksum_bench.rs

48.3 ms48.3 ms

nl_many_lines[100000]

src/uu/nl/benches/nl_bench.rs

44.9 ms44.9 ms

numfmt_to_si_precision[10000]

src/uu/numfmt/benches/numfmt_bench.rs

35.3 ms35.3 ms

seq_with_step

src/uu/seq/benches/seq_bench.rs

13.3 ms13.3 ms

wc_words_large_line_count[100000]

src/uu/wc/benches/wc_bench.rs

48 ms48 ms

cksum_bsd

src/uu/cksum/benches/cksum_bench.rs

128.4 ms128.4 ms

numfmt_to_iec[10000]

src/uu/numfmt/benches/numfmt_bench.rs

33.8 ms33.8 ms

numfmt_round_modes[("up", 10000)]

src/uu/numfmt/benches/numfmt_bench.rs

34.3 ms34.3 ms

numfmt_to_si[10000]

src/uu/numfmt/benches/numfmt_bench.rs

33.8 ms33.8 ms

cksum_md5

src/uu/cksum/benches/cksum_bench.rs

318 ms318 ms

wc_default_large_line_count[100000]

src/uu/wc/benches/wc_bench.rs

50.4 ms50.4 ms

cksum_sha1

src/uu/cksum/benches/cksum_bench.rs

723.1 ms723.1 ms

seq_formatted

src/uu/seq/benches/seq_bench.rs

96.1 ms96.1 ms

wc_words_synthetic[2000]

src/uu/wc/benches/wc_bench.rs

11.4 s11.4 s

cksum_shake128

src/uu/cksum/benches/cksum_bench.rs

1.5 s1.5 s

cksum_shake256

src/uu/cksum/benches/cksum_bench.rs

1.9 s1.9 s

wc_bytes_lines_synthetic[2000]

src/uu/wc/benches/wc_bench.rs

120.2 ms120.2 ms

expand_custom_tabstops[50000]

src/uu/expand/benches/expand_bench.rs

36.9 ms36.9 ms

numfmt_from_si[10000]

src/uu/numfmt/benches/numfmt_bench.rs

32.7 ms32.7 ms

unexpand_large_file[10]

src/uu/unexpand/benches/unexpand_bench.rs

529 ms529 ms

unexpand_many_lines[100000]

src/uu/unexpand/benches/unexpand_bench.rs

252.3 ms252.3 ms

cut_fields_tab

src/uu/cut/benches/cut_bench.rs

34.1 ms34.1 ms

expand_many_lines[100000]

src/uu/expand/benches/expand_bench.rs

148.6 ms148.6 ms

numfmt_round_modes[("towards-zero", 10000)]

src/uu/numfmt/benches/numfmt_bench.rs

34.3 ms34.3 ms

seq_integers

src/uu/seq/benches/seq_bench.rs

26.1 ms26.1 ms

fold_custom_width[50000]

src/uu/fold/benches/fold_bench.rs

33 ms33 ms

fold_many_lines[100000]

src/uu/fold/benches/fold_bench.rs

80.4 ms80.4 ms

seq_custom_separator

src/uu/seq/benches/seq_bench.rs

28.7 ms28.7 ms

nl_large_file[10]

src/uu/nl/benches/nl_bench.rs

57.1 ms57.1 ms

cksum_sha256

src/uu/cksum/benches/cksum_bench.rs

1.7 s1.7 s

cksum_sha224

src/uu/cksum/benches/cksum_bench.rs

1.7 s1.7 s

numfmt_padding[(10000, 50)]

src/uu/numfmt/benches/numfmt_bench.rs

48 ms48 ms

wc_lines_variable_length[(50, 500)]

src/uu/wc/benches/wc_bench.rs

3.4 ms3.4 ms

cksum_sha384

src/uu/cksum/benches/cksum_bench.rs

1.1 s1.1 s

cksum_sha2

src/uu/cksum/benches/cksum_bench.rs

1.7 s1.7 s

cksum_sm3

src/uu/cksum/benches/cksum_bench.rs

1.6 s1.6 s

cut_bytes

src/uu/cut/benches/cut_bench.rs

8.4 ms8.4 ms

seq_large_integers

src/uu/seq/benches/seq_bench.rs

2.2 ms2.2 ms

cksum_sha512

src/uu/cksum/benches/cksum_bench.rs

1.1 s1.1 s

rm_multiple_files

src/uu/rm/benches/rm_bench.rs

2.2 ms2.2 ms

join_french_locale

src/uu/join/benches/join_bench.rs

12.8 ms12.8 ms

cut_characters

src/uu/cut/benches/cut_bench.rs

7.4 ms7.4 ms

rm_force_files

src/uu/rm/benches/rm_bench.rs

2 ms2 ms

join_custom_separator

src/uu/join/benches/join_bench.rs

12.1 ms12.1 ms

join_partial_overlap

src/uu/join/benches/join_bench.rs

10.5 ms10.5 ms

wc_lines_extreme_line_lengths[(100000, 200)]

src/uu/wc/benches/wc_bench.rs

1.6 ms1.6 ms

wc_chars_large_line_count[100000]

src/uu/wc/benches/wc_bench.rs

1 ms1 ms

split_lines

src/uu/split/benches/split_bench.rs

5.7 ms5.7 ms

split_numeric_suffix

src/uu/split/benches/split_bench.rs

5.9 ms5.9 ms

join_full_match

src/uu/join/benches/join_bench.rs

12.8 ms12.8 ms

file_iso_dates

src/uu/date/benches/date_bench.rs

14 ms14 ms

mv_directory

src/uu/mv/benches/mv_bench.rs

3.5 ms3.5 ms

uniq_case_insensitive[10000]

src/uu/uniq/benches/uniq_bench.rs

1.6 ms1.6 ms

uniq_with_count[10000]

src/uu/uniq/benches/uniq_bench.rs

1.8 ms1.8 ms

cp_preserve_metadata[(5, 4, 10)]

src/uu/cp/benches/cp_bench.rs

74.8 ms74.9 ms

mv_multiple_to_dir

src/uu/mv/benches/mv_bench.rs

12.9 ms12.9 ms

rm_recursive_tree

src/uu/rm/benches/rm_bench.rs

11.7 ms11.8 ms

du_deep_tree[(100, 3)]

src/uu/du/benches/du_bench.rs

1.2 ms1.2 ms

split_bytes

src/uu/split/benches/split_bench.rs

507.9 µs508.7 µs

dd_copy_with_seek

src/uu/dd/benches/dd_bench.rs

2.3 ms2.3 ms

du_max_depth_balanced_tree[(6, 4, 10)]

src/uu/du/benches/du_bench.rs

33 ms33.1 ms

cksum_multiple_files

src/uu/cksum/benches/cksum_bench.rs

25.4 ms25.5 ms

cp_archive_balanced_tree[(5, 4, 10)]

src/uu/cp/benches/cp_bench.rs

77.8 ms78 ms

cp_recursive_deep_tree[(120, 4)]

src/uu/cp/benches/cp_bench.rs

13.6 ms13.7 ms

b64_encode_synthetic

src/uu/base64/benches/base64_bench.rs

161.4 µs161.8 µs

b64_decode_synthetic

src/uu/base64/benches/base64_bench.rs

165.9 µs166.4 µs

complex_relative_date

src/uu/date/benches/date_bench.rs

243.2 µs243.9 µs

split_number_chunks

src/uu/split/benches/split_bench.rs

293.6 µs294.5 µs

b64_decode_ignore_garbage_synthetic

src/uu/base64/benches/base64_bench.rs

162.9 µs163.4 µs

cp_recursive_balanced_tree[(5, 4, 10)]

src/uu/cp/benches/cp_bench.rs

72.2 ms72.4 ms

cp_recursive_wide_tree[(6000, 800)]

src/uu/cp/benches/cp_bench.rs

189.3 ms189.9 ms

sort_key_field[500000]

src/uu/sort/benches/sort_bench.rs

690.6 ms693.3 ms

mv_force_overwrite

src/uu/mv/benches/mv_bench.rs

143.8 ms144.4 ms

mv_single_file

src/uu/mv/benches/mv_bench.rs

135.1 ms135.7 ms

rm_single_file

src/uu/rm/benches/rm_bench.rs

118.9 ms119.4 ms

du_summarize_balanced_tree[(5, 4, 10)]

src/uu/du/benches/du_bench.rs

8.5 ms8.5 ms

single_date_now

src/uu/date/benches/date_bench.rs

-1%

184.2 µs185.3 µs

factor_multiple_u64s[2]

src/uu/factor/benches/factor_bench.rs

-1%

211 ms212.4 ms

du_all_wide_tree[(5000, 500)]

src/uu/du/benches/du_bench.rs

-1%

18.1 ms18.2 ms

du_wide_tree[(5000, 500)]

src/uu/du/benches/du_bench.rs

-1%

11.2 ms11.4 ms

Commits

Click on a commit to change the comparison range

Base

main

44e0bba

-3.45%

chore(deps): update Rust dependencies - Bumped versions of multiple crates (e.g., aho-corasick 1.1.3→1.1.4, anstream 0.6.19→0.6.21, windows-sys 0.59.0→0.61.2) for bug fixes, security patches, and performance improvements. - Removed libc dependency from a package and renamed wasi to wasip2 as part of upstream changes.

1a1eabd

12 days ago

by mattsu2020

-7.39%

chore: update Rust dependencies to latest versions - Updated jiff from 0.2.17 to 0.2.18 - Updated jiff-static from 0.2.17 to 0.2.18 - Updated libc from 0.2.178 to 0.2.179 - Updated proc-macro2 from 1.0.104 to 1.0.105 - Updated quote from 1.0.42 to 1.0.43 - Updated hashbrown from 0.15.4 to 0.15.5 - Updated syn from 2.0.111 to 2.0.113 - Updated zmij from 1.0.2 to 1.0.12 These updates bring bug fixes, security patches, and performance improvements.

aef49e7

4 days ago

by mattsu2020

+7.79%

fix: update FreeBSD CI prepare steps to force package repo update Remove stale package repository SQLite file and force update before installing packages in FreeBSD CI workflows. This prevents installation failures due to outdated package databases, improving reliability in automated builds.

09a6003

4 days ago

by mattsu2020

+6.66%

ci: configure FreeBSD pkg repo in GitHub Actions workflows Updated the prepare steps in both FreeBSD CI jobs to write the repository configuration to /usr/local/etc/pkg/repos/FreeBSD.conf before updating and installing packages. This ensures the correct pkg repository is used, preventing potential update failures or outdated package sources.

67f23a4

4 days ago

by mattsu2020

-14.45%

chore(ci): ensure pkg repos directory exists in FreeBSD workflow Add mkdir -p /usr/local/etc/pkg/repos to prepare steps in both jobs to prevent configuration failures if the directory is missing.

6f0b1c8

4 days ago

by mattsu2020

+10.98%

perf(sort): compute line_count only when needed to optimize performance Refactor parse_lines to conditionally calculate line_count based on whether selections, num_infos, floats, or numeric mode require reservations, avoiding unnecessary computation when line_count is not used.

cce6eaa

4 days ago

by mattsu2020

-14.83%

Merge branch 'main' into sort/sort-merge-fdlimit.sh

7d41a89

4 days ago

by mattsu2020

+3.85%

refactor(sort): simplify line count calculation in parse_lines Always compute line count and reserve vector capacities, removing the conditional 'needs_line_count' check for cleaner code and consistent behavior.

259f6c9

4 days ago

by mattsu2020

-3.72%

feat(sort): optimize line parsing by precomputing line breaks Add `line_breaks` field to `ChunkContents` and `RecycledChunk` structs to store separator indices. Modify `parse_lines` function to collect all line break positions in a single pass, avoiding redundant iterations over input data. This improves performance by reducing the number of times the input is scanned for separators.

56c2566

4 days ago

by mattsu2020

-2.99%

refactor(sort): replace line_breaks Vec with line_count_hint for memory efficiency Replace the `line_breaks` vector, which stored all line separator indices, with a `line_count_hint` usize field. This change estimates the number of lines using the hint (or a default calculation) instead of pre-computing and storing all break positions, reducing memory allocations and improving performance in the sort utility's chunk parsing logic. The hint defaults to a calculated estimate based on buffer size if not provided.

15df4aa

4 days ago

by mattsu2020

+33.74%

perf(sort): optimize line parsing and tokenization for small chunks and unused features - Compute exact line count for chunks <= 64KB or when hint is 0 to improve accuracy - Skip tokenization and data extraction in Line::create when not required by settings, enhancing performance for simple sorts or small inputs

9e9b311

4 days ago

by mattsu2020

Home Terms Privacy Docs