Eventual-Inc
Daft
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Performance History
Latest Results
Merge remote-tracking branch 'origin/main' into fix/doris-connectorx-fallback # Conflicts: # daft/datasets/lerobot.py
jiangxt2:fix/doris-connectorx-fallback
17 minutes ago
Merge remote-tracking branch 'origin/main' into fix/sql-engine-caching # Conflicts: # daft/datasets/lerobot.py
jiangxt2:fix/sql-engine-caching
21 minutes ago
fix(sql): use quantileExact for ClickHouse partition percentile computation ClickHouse does not support the standard SQL PERCENTILE_DISC function. Use quantileExact() instead for exact percentile computation when calculating partition boundaries in read_sql(). quantileExact is preferred over quantile() (which uses reservoir sampling) because quantile(0)/quantile(1) are not guaranteed to equal the true min/max — this would cause silent row loss at partition boundaries (col >= bound_0 AND col <= bound_last). Other dialects continue to use the standard PERCENTILE_DISC WITHIN GROUP syntax. Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>
jiangxt2:fix/clickhouse-percentile
1 hour ago
feat(iceberg): inject DataFile column statistics into ScanTask Pass PyIceberg DataFile.lower_bounds/upper_bounds into ScanTask.catalog_scan_task(stats=...) as a 2-row Arrow RecordBatch (row 0=min, row 1=max), matching the format used by Delta Lake and Hudi. This enables MicroPartition.filter() to short-circuit on TruthValue::False after a file has been loaded. Implementation details: - Decode binary-encoded bounds via pyiceberg.conversions.from_bytes() - Map field_id to column name via SchemaFieldIdMappingVisitor - Limit to top-level primitive fields; nested fields out of scope - Precompute top_level_primitive_ids in __init__ to avoid per-file overhead - Handle missing bounds, schema evolution, and decode failures gracefully Tests: 19 Python unit tests (all types + edge cases), 7 integration tests (stats injection, value correctness, query consistency), 5 Rust tests (TableStatistics eval + MicroPartition.filter short-circuit). Closes #7299 Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>
jiangxt2:feat/iceberg-scan-stats
2 hours ago
fix: add cffi dependency
hfutatzhanghb:agent/add-cffi-dependency
2 hours ago
style: remove trailing blank line for cargo fmt Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>
jiangxt2:fix/sql-literal-translation
2 hours ago
feat(iceberg): inject DataFile column statistics into ScanTask Pass PyIceberg DataFile.lower_bounds/upper_bounds into ScanTask.catalog_scan_task(stats=...) as a 2-row Arrow RecordBatch (row 0=min, row 1=max), matching the format used by Delta Lake and Hudi. This enables MicroPartition.filter() to short-circuit on TruthValue::False after a file has been loaded. Implementation details: - Decode binary-encoded bounds via pyiceberg.conversions.from_bytes() - Map field_id to column name via SchemaFieldIdMappingVisitor - Limit to top-level primitive fields; nested fields out of scope - Precompute top_level_primitive_ids in __init__ to avoid per-file overhead - Handle missing bounds, schema evolution, and decode failures gracefully Tests: 19 Python unit tests (all types + edge cases), 7 integration tests (stats injection, value correctness, query consistency), 5 Rust tests (TableStatistics eval + MicroPartition.filter short-circuit). Closes #7299
jiangxt2:feat/iceberg-scan-stats
4 hours ago
fix: IsIn/Decimal/UnresolvedColumn expressions fail to translate to SQL - Implement Expr::IsIn SQL generation with empty-list (1=0) guard - Add Decimal literal display via existing display_decimal128 helper - Add negative scale guard for Decimal to prevent display_decimal128 panic - Support Column::Unresolved in to_sql() alongside ResolvedColumn - Quote all column identifiers (handles spaces, reserved words, special chars) - Add Uuid display_sql arm for Arrow/Iceberg UUID columns - Add doc comment explaining sqlglot dialect re-rendering contract Signed-off-by: jiangxt2 <jiangxt2@vip.qq.com>
jiangxt2:fix/sql-literal-translation
4 hours ago
Latest Branches
CodSpeed Performance Gauge
0%
fix(sql): fall back to SQLAlchemy on ConnectorX COM_STMT_PREPARE failure
#7303
44 minutes ago
ff92adf
jiangxt2:fix/doris-connectorx-fallback
CodSpeed Performance Gauge
-1%
perf(sql): cache SQLAlchemy engine with thread-safe double-checked locking
#7305
43 minutes ago
564c2ad
jiangxt2:fix/sql-engine-caching
CodSpeed Performance Gauge
0%
fix(sql): use quantileExact for ClickHouse partition percentile computation
#7304
4 hours ago
61f9488
jiangxt2:fix/clickhouse-percentile
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs