Performance History
Latest Results
fix(distributed): preserve cleanup on background failure
zhouwenjiajia:bugfix/joinable-stream-background-error
13 hours ago
fix(sql): use the default io config in SQL readers
read_parquet, read_csv, read_json and read_deltalake built their io_config
from the named argument only, so an absent argument became None and the
context default_io_config was dropped. The Python readers fall back to it.
read_iceberg keeps None on purpose so the scan can fall back to the table's
own FileIO properties.
Closes #7448
jackylee-ch:sql-reader-default-io-config
1 day ago
test(iceberg): read the timestamptz table back through pyiceberg
jackylee-ch:iceberg-partition-repr-parity
1 day ago
fix(parquet): error instead of nulling columns when field ids are absent
apply_field_ids_to_arrowrs_parquet_metadata drops fields whose id is missing
from the mapping. A file with no field ids at all lost every column, so the
reader returned all-null data with no warning. Raise MissingParquetFieldIds
instead; partially annotated files keep the existing behavior.
Closes #7445
jackylee-ch:parquet-field-id-mapping-error
1 day ago
fix(parquet): account for deleted rows in limit pushdown
prune_row_groups subtracted each row group's pre-delete num_rows() from the
limit budget, so a heavily-deleted row group exhausted it and later row groups
with matching rows were never decoded. Subtract the deletes falling in each
row group's visible range instead.
Adds a test module to helpers.rs, which had none.
jackylee-ch:parquet-limit-deleted-rows
1 day ago
fix(iceberg): support timezone-aware identity partition writes
to_partition_representation subtracted a naive epoch from every datetime, so
writing to a table partitioned by identity(timestamptz) raised TypeError.
Pick the epoch to match the value's awareness, as pyiceberg's own
datetime_to_micros does.
jackylee-ch:iceberg-partition-repr-parity
1 day ago
Merge branch 'main' into bugfix/joinable-stream-background-error
zhouwenjiajia:bugfix/joinable-stream-background-error
1 day ago
Latest Branches
0%
1 day ago
72b5de5
zhouwenjiajia:bugfix/joinable-stream-background-error
0%
21 hours ago
d31f4a5
claude/ray-ui-url-investigation-Q9HBW
0%
1 day ago
313fee7
jackylee-ch:sql-reader-default-io-config