BlogDocs

[FEAT] Include file paths as column from read_parquet/csv/json(#2953)

Merging
colin/include-path-in-read
(
945cfc7
) into
main
(
c5a6d88
)
-1%
IMPROVEMENTS
0
REGRESSIONS
0
UNTOUCHED
17
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Passed

test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
+2%
335.1 ms
328.5 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
+1%
143.5 ms
142.7 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
29 ms
29 ms
test_iter_rows_first_row[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
0%
8.9 s
8.9 s
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
0%
127.3 ms
127.6 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
-1%
95.9 ms
96.5 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
-1%
380.8 ms
383.8 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
-1%
441 ms
444.9 ms
test_show[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
-1%
16.2 ms
16.4 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
-1%
191 ms
193.7 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
-2%
363.2 ms
368.8 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-2%
12.9 ms
13.1 ms
test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
-2%
4.1 ms
4.1 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
-2%
129.9 ms
132.7 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
-3%
94.4 ms
97.4 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
-3%
136.9 ms
141.8 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
-5%
6.8 ms
7.2 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
+2%
1.8 ms
1.8 ms

Commits

Click on a commit to change the comparison range
base
main
c5a6d88
0%
include path in read
6d7a87d
2 days ago
0%
test if column name exists
3321272
2 days ago
0%
fix typo and reduce 1 alloc
355c05d
2 days ago
-1%
Merge branch main into colin/include-path-in-read
c889112
19 hours ago
-1%
oops
945cfc7
19 hours ago
ResourcesHomePricingDocsBlogGitHubChangelog
Getting StartedSample repositoryExplore repositoriesSupport
AboutCareersTwitterDiscordContact UsTerms of ServicePrivacy Policy
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.