feat/stddev - Branch - Eventual-Inc/Daft

[FEAT] Implement standard deviation

#3005Merged

Comparing

feat/stddev

(

1874f43

) with

main

(

3f37a69

)

+1%

Untouched: 14

Ignored: 4

Benchmarks

Passed

test_count[100 Small Files]

tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]

+2%

128.6 ms126.2 ms

test_tpch[1-in-memory-native-2]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]

+1%

98.4 ms97 ms

test_explain[100 Small Files]

tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]

+1%

6.9 ms6.8 ms

test_tpch[1-in-memory-native-3]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]

141 ms140.4 ms

test_tpch[1-in-memory-native-5]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]

386.1 ms384.7 ms

test_tpch[1-in-memory-native-10]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]

194.2 ms193.7 ms

test_tpch[1-in-memory-native-9]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]

367.3 ms366.4 ms

test_tpch[1-in-memory-native-1]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]

440 ms440 ms

test_tpch[1-in-memory-native-6]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]

29.5 ms29.6 ms

test_iter_rows_first_row[1 Small File]

tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]

96.2 ms96.3 ms

test_tpch[1-in-memory-native-7]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]

131.5 ms131.9 ms

test_show[1 Small File]

tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]

-1%

12.9 ms13 ms

test_tpch[1-in-memory-native-4]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]

-1%

142.9 ms144.6 ms

test_tpch[1-in-memory-native-8]

tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]

-1%

331 ms335.8 ms

Ignored

test_count[1 Small File]

tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]

Ignored

+7%

4.3 ms4 ms

test_iter_rows_first_row[100 Small Files]

tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]

Ignored

8.9 s8.9 s

test_show[100 Small Files]

tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]

Ignored

+1%

16.1 ms15.9 ms

test_explain[1 Small File]

tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]

Ignored

-2%

1.8 ms1.8 ms

Commits

Click on a commit to change the comparison range

Base

main

3f37a69

+0.38%

Clean up code - move all test mods into their own separate files - if `blah.rs` had a submodule `tests`, then `blah/mod.rs` would contain the original code and `blah/tests.rs` would contain the tests - removed all enum imports - ran `cargo clippy --fix ...`

818c076

11 months ago

by raunakab

-0.22%

Add all structure for stddev

a53dfaa

11 months ago

by raunakab

-0.36%

Implement structure for local and distributed stddev

2ae9d08

11 months ago

by raunakab

+0.06%

Implement non-grouped stddev - factored out some common logic into a util::stats module - refactored mean to use the new module

c7f189c

11 months ago

by raunakab

+0.47%

Implement grouped standard deviation - some additional refactors to `utils::stats` module

797358f

11 months ago

by raunakab

-0.37%

Merge branch 'main' into feat/stddev

db48aa7

11 months ago

by raunakab

+0.38%

Merge branch 'main' into feat/stddev

81d7f75

11 months ago

by raunakab

+11.42%

Edit data-type of `square_sum` field in `to_field` impl

d825a21

11 months ago

by raunakab

-11.24%

Fix errors in multi-partition aggregation planning

9b94626

11 months ago

by raunakab

+12%

Add some tests for stddev (single- and multi- partitioned)

70577ab

11 months ago

by raunakab

-11.77%

Finish tests for stddev feature

265a7a7

11 months ago

by raunakab

+0.1%

Explicitly import typing module; fix lints

a76fade

11 months ago

by raunakab

-0.69%

Remove `SquareSum` since it can just be implemented as `AggExpr::Sum(Expr::Agg(AggExpr::BinaryOp { .. }))`

7a5a36a

11 months ago

by raunakab

-0.06%

Update grouped-mean impl to use stats

65e443a

11 months ago

by raunakab

+0.77%

Merge branch 'main' into feat/stddev

04dcb04

11 months ago

by raunakab

-0.23%

Add to docs

1874f43

11 months ago

by raunakab

Home Terms Privacy Docs