Avatar for the vortex-data user
vortex-data
vortex
BlogDocsChangelog

Performance History

Latest Results

feat(duckdb): report per-file column statistics from the vortex COPY writer Implement DuckDB's copy_to_get_written_statistics hook for the vortex COPY function, mirroring the parquet writer, so callers that request WRITTEN_FILE_STATISTICS (e.g. DuckLake) receive per-file, per-column stats instead of only a changed-row count. The stats are read from the WriteSummary that copy_to_finalize previously dropped - no file is re-opened. Per column we report min/max (from the footer FileStatistics, converted via the existing column_statistics bridge), null_count, num_values, and column_size_bytes (the on-disk compressed size via WriteSummary::compressed_column_sizes, the same quantity parquet reports). The hook is opt-in: when the caller does not request statistics the finalize path is unchanged. Includes a unit test that writes an int/varchar/nullable-double struct and asserts the derived row/column counts, null counts, min/max presence, and a non-zero on-disk column size. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Signed-off-by: Mosha (RTDL) <moshap@firebolt.io>
feat/rtdl-written-statistics-upstream
1 hour ago

Latest Branches

CodSpeed Performance Gauge
-4%
feat(duckdb): report per-file column statistics from the vortex COPY writer#9471
21 hours ago
6fd42b6
feat/rtdl-written-statistics-upstream
CodSpeed Performance Gauge
+14%
6 hours ago
8fe824a
ct/row-fn-batch
CodSpeed Performance Gauge
+7%
4 days ago
94180e3
ct/row-fn-spatial-predicates
© 2026 CodSpeed Technology
Home Terms Privacy Docs