Eventual-Inc/Daft - CodSpeed

Daft

Blog Docs Changelog

Performance History

Latest Results

Merge remote-tracking branch 'origin/main' into fix/doris-connectorx-fallback # Conflicts: # daft/datasets/lerobot.py

jiangxt2:fix/doris-connectorx-fallback

17 minutes ago

Merge remote-tracking branch 'origin/main' into fix/sql-engine-caching # Conflicts: # daft/datasets/lerobot.py

jiangxt2:fix/sql-engine-caching

21 minutes ago

fix(sql): use quantileExact for ClickHouse partition percentile computation ClickHouse does not support the standard SQL PERCENTILE_DISC function. Use quantileExact() instead for exact percentile computation when calculating partition boundaries in read_sql(). quantileExact is preferred over quantile() (which uses reservoir sampling) because quantile(0)/quantile(1) are not guaranteed to equal the true min/max — this would cause silent row loss at partition boundaries (col >= bound_0 AND col <= bound_last). Other dialects continue to use the standard PERCENTILE_DISC WITHIN GROUP syntax. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:fix/clickhouse-percentile

1 hour ago

feat(iceberg): inject DataFile column statistics into ScanTask Pass PyIceberg DataFile.lower_bounds/upper_bounds into ScanTask.catalog_scan_task(stats=...) as a 2-row Arrow RecordBatch (row 0=min, row 1=max), matching the format used by Delta Lake and Hudi. This enables MicroPartition.filter() to short-circuit on TruthValue::False after a file has been loaded. Implementation details: - Decode binary-encoded bounds via pyiceberg.conversions.from_bytes() - Map field_id to column name via SchemaFieldIdMappingVisitor - Limit to top-level primitive fields; nested fields out of scope - Precompute top_level_primitive_ids in __init__ to avoid per-file overhead - Handle missing bounds, schema evolution, and decode failures gracefully Tests: 19 Python unit tests (all types + edge cases), 7 integration tests (stats injection, value correctness, query consistency), 5 Rust tests (TableStatistics eval + MicroPartition.filter short-circuit). Closes #7299 Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:feat/iceberg-scan-stats

2 hours ago

fix: add cffi dependency

hfutatzhanghb:agent/add-cffi-dependency

2 hours ago

style: remove trailing blank line for cargo fmt Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:fix/sql-literal-translation

2 hours ago

feat(iceberg): inject DataFile column statistics into ScanTask Pass PyIceberg DataFile.lower_bounds/upper_bounds into ScanTask.catalog_scan_task(stats=...) as a 2-row Arrow RecordBatch (row 0=min, row 1=max), matching the format used by Delta Lake and Hudi. This enables MicroPartition.filter() to short-circuit on TruthValue::False after a file has been loaded. Implementation details: - Decode binary-encoded bounds via pyiceberg.conversions.from_bytes() - Map field_id to column name via SchemaFieldIdMappingVisitor - Limit to top-level primitive fields; nested fields out of scope - Precompute top_level_primitive_ids in __init__ to avoid per-file overhead - Handle missing bounds, schema evolution, and decode failures gracefully Tests: 19 Python unit tests (all types + edge cases), 7 integration tests (stats injection, value correctness, query consistency), 5 Rust tests (TableStatistics eval + MicroPartition.filter short-circuit). Closes #7299

jiangxt2:feat/iceberg-scan-stats

4 hours ago

fix: IsIn/Decimal/UnresolvedColumn expressions fail to translate to SQL - Implement Expr::IsIn SQL generation with empty-list (1=0) guard - Add Decimal literal display via existing display_decimal128 helper - Add negative scale guard for Decimal to prevent display_decimal128 panic - Support Column::Unresolved in to_sql() alongside ResolvedColumn - Quote all column identifiers (handles spaces, reserved words, special chars) - Add Uuid display_sql arm for Arrow/Iceberg UUID columns - Add doc comment explaining sqlglot dialect re-rendering contract Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>

jiangxt2:fix/sql-literal-translation

4 hours ago

Latest Branches

0%

fix(sql): fall back to SQLAlchemy on ConnectorX COM_STMT_PREPARE failure#7303

44 minutes ago

ff92adf

jiangxt2:fix/doris-connectorx-fallback

-1%

perf(sql): cache SQLAlchemy engine with thread-safe double-checked locking#7305

43 minutes ago

564c2ad

jiangxt2:fix/sql-engine-caching

0%

fix(sql): use quantileExact for ClickHouse partition percentile computation#7304

4 hours ago

61f9488

jiangxt2:fix/clickhouse-percentile

© 2026 CodSpeed Technology

Home Terms Privacy Docs