Pandas VS Polars benchmark PR (don't merge)
#179Comparing
dev_polars
(0139174
) withdev_pandas
(62da224
)+48%
- Improvement
- 13
Benchmarks
13 total
test_benchmark_get_consecutive_no_transactions_out_big
tests/benchmarks/test_bench_transf_features.py×10
609.7 ms61.2 ms
test_benchmark_get_consecutive_no_transactions_out
tests/benchmarks/test_bench_transf_features.py×9.6
19.5 ms2 ms
test_benchmark_transf_json_to_df
tests/benchmarks/test_bench_transf_json_to_df.py×6.6
159.4 ms24.1 ms
test_benchmark_get_transaction_all
tests/benchmarks/test_bench_transf_features.py×4.8
7.5 ms1.6 ms
test_benchmark_pipepline_transform
tests/benchmarks/test_bench_transf_json_to_df.py×4.8
834.6 ms175 ms
test_benchmark_get_transaction_in
tests/benchmarks/test_bench_transf_features.py×4.7
8.7 ms1.9 ms
test_benchmark_get_transaction_out
tests/benchmarks/test_bench_transf_features.py×4.5
8.5 ms1.9 ms
test_benchmark_pipepline_transform_big
tests/benchmarks/test_bench_transf_json_to_df.py×4.2
8.4 s2 s
test_benchmark_get_transaction_all_big
tests/benchmarks/test_bench_transf_features.py×3.7
192.6 ms52 ms
test_benchmark_get_transaction_in_big
tests/benchmarks/test_bench_transf_features.py×3.5
186.2 ms53.6 ms
test_benchmark_get_transaction_out_big
tests/benchmarks/test_bench_transf_features.py×3.4
176.9 ms52.5 ms
test_benchmark_process_data_cluster
tests/benchmarks/test_bench_transf_features.py×3.1
12.9 ms4.1 ms
test_benchmark_process_data_cluster_big
tests/benchmarks/test_bench_transf_features.py+48%
356.7 ms240.8 ms
Commits
Click on a commit to change the comparison rangeBase
dev_pandas
62da224
+0.08%
dev version 1.2.2a (#114)
fb7abd0
1 year ago
by armgilles+0.85%
Polars read activity data (#119)
bcb86ef
1 year ago
by armgilles×4.6
Polars get transaction out (#120)
26dcd2a
1 year ago
by armgilles+2.51%
Polars transactions in (#123)
8270a28
1 year ago
by armgilles+2.58%
Polars get transactions all (#125)
c440832
1 year ago
by armgilles×2.5
Polars transform json api bdx station data to df (#128)
efccc3e
1 year ago
by armgillesPolars get encoding time (#131)
4e81203
1 year ago
by armgillesPolars bigger dataset bench (#135)
03d9839
1 year ago
by armgilles-11.81%
Polars get consecutive no transactions out (#132)
5841367
1 year ago
by armgilles+39%
Polars read station profile (#138)
e2aefaf
1 year ago
by armgilles-32.52%
Merge branch 'dev_polars' of github.com:armgilles/vcub_keeper into dev_polars
cfc2f27
1 year ago
by armgilles-2.3%
Polars read station profile (#140)
d24fba4
1 year ago
by armgilles-3.58%
Polars read time serie activity (#142)
e8ba1eb
1 year ago
by armgilles+6.48%
Polars read time serie activity (#143)
03fd370
1 year ago
by armgilles+3.16%
Using custum breakpoint calcul, no more pandas cut and add unit test #144 (#145)
f15c810
1 year ago
by armgilles-0.81%
Polars bench pipeline (#157)
c247257
1 year ago
by armgilles+47.66%
merging from dev_polars to have bench pipeline tests
25bc431
1 year ago
by armgilles-1.48%
Try lazy + expression fonction to check perf bench #146 (#147)
15687d4
1 year ago
by armgilles-49.29%
Update ML pipeple to Polars #162 (#163)
47ef206
1 year ago
by armgilles+48.81%
Fix new value status from API Bordeaux, improve mapping and test #165 (#166)
614f2f4
1 year ago
by armgilles-49.48%
Polars viz (#167)
60afa5f
1 year ago
by armgilles+2.61%
Change date type into Bdx pipeline (unset time zone) #168) (#169)
3fee3a1
1 year ago
by armgilles-0.24%
Fix available bikes consecutive feat (#171)
ab1fa8c
1 year ago
by armgilles-2%
try to fix problem with old lfs notebook error #172
7378bf3
1 year ago
by armgilles+3.32%
Bump pyproject and add dep to polars to read from cloud (#175)
983311c
1 year ago
by armgilles+1.12%
Add manifest for notebook (#176)
b7eaeeb
1 year ago
by armgilles-7.1%
Fix lfs (#177)
d08b5f9
1 year ago
by armgilles+62.41%
Merge branch 'dev_polars' of https://github.com/armgilles/vcub_keeper into dev_polars
0139174
1 year ago
by armgilles