refactor(arrow2): remove parquet2 read pipeline, make arrow-rs the default reader
#6335Comparing
phase7/remove-parquet2-read-pipeline
(cf2ded3
) withmain
(2539547
)+1%
- Untouched
- 36
- Ignored
- 4
No successful run was found on main ( 309657b) during the generation of this report, so 2539547 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
40 total
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py+5%
35.7 ms34 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py+2%
12.5 ms12.2 ms
test_read_jsonl_float64
tests/benchmarks/test_json_reads.py+2%
285.2 ms278.4 ms
test_read_jsonl_boolean
tests/benchmarks/test_json_reads.py+2%
361.7 ms354.6 ms
test_tpch[1-in-memory-9]
tests/benchmarks/test_local_tpch.py+2%
259 ms254.1 ms
test_tpch[1-in-memory-5]
tests/benchmarks/test_local_tpch.py+1%
117.9 ms116.2 ms
test_tpch_sql[1-in-memory-2]
tests/benchmarks/test_local_tpch.py+1%
151.7 ms149.7 ms
test_read_jsonl_int64
tests/benchmarks/test_json_reads.py+1%
284.4 ms280.7 ms
test_tpch_sql[1-in-memory-10]
tests/benchmarks/test_local_tpch.py+1%
171.2 ms169.2 ms
test_tpch_sql[1-in-memory-9]
tests/benchmarks/test_local_tpch.py+1%
253.8 ms250.9 ms
test_tpch_sql[1-in-memory-3]
tests/benchmarks/test_local_tpch.py+1%
122.5 ms121.2 ms
test_tpch_sql[1-in-memory-1]
tests/benchmarks/test_local_tpch.py+1%
549.6 ms544.4 ms
test_tpch_sql[1-in-memory-4]
tests/benchmarks/test_local_tpch.py+1%
85.1 ms84.3 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py+1%
12.3 ms12.2 ms
test_read_jsonl_nested_struct
tests/benchmarks/test_json_reads.py+1%
500.9 ms496.7 ms
test_tpch[1-in-memory-8]
tests/benchmarks/test_local_tpch.py+1%
130.7 ms129.7 ms
test_read_jsonl_high_nulls
tests/benchmarks/test_json_reads.py+1%
405.3 ms403.1 ms
test_tpch_sql[1-in-memory-5]
tests/benchmarks/test_local_tpch.py0%
117.1 ms116.7 ms
test_tpch[1-in-memory-7]
tests/benchmarks/test_local_tpch.py0%
116 ms115.6 ms
test_tpch_sql[1-in-memory-6]
tests/benchmarks/test_local_tpch.py0%
32.9 ms32.8 ms
test_read_jsonl_with_column_projection
tests/benchmarks/test_json_reads.py0%
1.3 s1.3 s
test_read_jsonl_with_limit
tests/benchmarks/test_json_reads.py0%
68.4 ms68.1 ms
test_read_jsonl_nested_list
tests/benchmarks/test_json_reads.py0%
443.9 ms442.6 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py0%
56.6 ms56.5 ms
test_tpch[1-in-memory-6]
tests/benchmarks/test_local_tpch.py0%
32.2 ms32.2 ms
Commits
Click on a commit to change the comparison rangeBase
main
2539547
+0.14%
address greptile
9510d02
18 hours ago
by desmondcheongzx+0.36%
fix
7145ac5
17 hours ago
by desmondcheongzx+0.18%
fix(parquet): strip dictionary types from arrow-rs schema inference
135357b
16 hours ago
by desmondcheongzx+0.01%
fix
02e0eab
15 hours ago
by desmondcheongzx-0.41%
fix
47c67c3
9 hours ago
by desmondcheongzx+0.33%
fix
cf2ded3
8 hours ago
by desmondcheongzx