vortex-data/vortex

vortex-data

vortex

Blog Docs Changelog

Performance History

Latest Results

Merge branch 'develop' into nemo/geo-bounding-rect

nemo/geo-bounding-rect

2 minutes ago

feat(vortex-geo): per-row bounding-box scalar function (vortex.geo.envelope) `GeoEnvelope` computes the per-row 2-D axis-aligned bounding box of a native geometry column, returned as a native geoarrow.box (`Rect`) column — the per-row counterpart of the `GeometryAabb` aggregate (whole-column). Intended for row-oriented consumers such as bulk-loading an in-memory R-tree in a spatial-join operator, which read the resulting box column back row by row. Computed directly over the native coordinate storage — no `geo_types` decode and no Arrow round-trip: walk the nested `ListView` storage down to the leaf x/y buffers, tracking which top-level row owns each coordinate, then min/max per row. A `Rect` input is the identity; a null row or an empty geometry yields a null box, so the output is always nullable. Hoist the shared `f64_field` coordinate-column accessor into `extension::coordinate`, used by both this function and the aggregate. Signed-off-by: Nemo Yu <zyu379@wisc.edu>

nemo/geo-bounding-rect

5 minutes ago

Lazily untranspose DeltaArray validity and depend on fastlanes bit transpose code (#8725) Delta array unnecessarily untraposes whole validity whenever it's queried. This pr avoids this by laziliy wrapping it in a TransposedBool array that does untranspose when necessary. While we're at it we remove the bit transpose logic that has been moved to fastlanes repo --------- Signed-off-by: Robert Kruszewski <github@robertk.io>

develop

10 minutes ago

assertions Signed-off-by: Robert Kruszewski <github@robertk.io>

renovate/pypi-pyarrow-vulnerability

14 minutes ago

Fix docs links and Python doctest golden sizes for edition-gated writer - Qualify the DEFAULT_WRITE_EDITIONS intra-doc link in the editions module docs: links in the module's inner docs resolve at the facade's `pub mod` site, so unqualified links break rustdoc under -D warnings. Also move the stray "Logical Vortex data types." doc line back onto the dtype module. - Update the file-size golden values in the Python write-options doctests: the writer's pre-populated ArrayContext is now seeded from the session's enabled editions, which changes the footer's encoding list and shrinks the written files by 40 bytes. Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CK2nCuXnyd2g3mNHQC8Lz2

claude/writer-editions-gating-8qy1fv

15 minutes ago

feat(xtask): auto-generate the edition registry docs from the Rust declarations Generate the edition registry pages from the edition declarations in `vortex/src/editions/`, in two stages: 1. A new `editions_manifest` example in the `vortex` crate validates the declarations and dumps them (with each edition's computed full encoding set) as a TOML manifest under `target/` — a build artifact, never committed. 2. A new `cargo xtask generate-editions-docs` subcommand runs the example, parses the manifest, and rewrites `docs/specs/editions/` wholesale: `index.md` with an editions table and a per-encoding index, plus one page per edition with its status, minimum Vortex reader, the encodings it adds, and its full encoding set. The static pages link into the registry: `docs/specs/editions.md` from its "Edition registry" section (previously a "Coming soon.." placeholder) and the unknown-encoding troubleshooting flow, and the docs landing page from a short static "Editions" section. The generated-files CI job now also runs `generate-editions-docs` before its "no files changed after regenerating" check, so a declaration change without a regen fails CI, including added or removed registry pages. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XKRaAHmFNvb7JoKTJVW8Pw Signed-off-by: Claude <noreply@anthropic.com>

claude/auto-gen-editions-docs-r9otqn

16 minutes ago

feat(vortex-file): gate the file writer behind editions The session is the source of truth for what a writer may emit: EditionSession now stores the set of enabled editions alongside the declarations — enable() (validated, at most one edition per family), enabled(), and enabled_encodings(), the resolved union of the enabled editions' encoding sets. register_default_editions declares the editions and enables the default write editions: core2026.07.0, plus the newest unstable draft under the `unstable_encodings` feature. The writer resolves its allow set from the session at write time: - The flat leaf writer's normalize-with-error validation fails the write for any encoding outside the session's enabled editions. - The writer's pre-populated ArrayContext is seeded from the same set. - Compression is gated at scheme-selection time: the new required Scheme::produced_encodings method declares the array encodings a scheme may emit (empty means only canonical arrays), and CascadingCompressor::with_enabled_editions_gating skips schemes whose outputs are not all within the enabled editions, resolved from the execution context per compression. Sessions with no enabled editions fall back to the static ALLOWED_ENCODINGS registry, and explicit with_allow_encodings sets still override everything. Experimental patches remain a runtime opt-out: Patched is only writable when the experimental environment variable is set, mirroring when compression produces it. Signed-off-by: Claude <noreply@anthropic.com> Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CK2nCuXnyd2g3mNHQC8Lz2

claude/writer-editions-gating-8qy1fv

24 minutes ago

refactor(docs): link the edition registry from the landing page statically Replace the generated per-edition link list on docs/index.md with a static sentence pointing at the generated registry index, and drop the now-unused marker-splicing machinery from the generator: it only writes docs/specs/editions/ now. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XKRaAHmFNvb7JoKTJVW8Pw Signed-off-by: Claude <noreply@anthropic.com>

claude/auto-gen-editions-docs-r9otqn

26 minutes ago

Latest Branches

feat(vortex-geo): per-row bounding-box scalar function (vortex.geo.envelope)#8831

6 minutes ago

72aa947

nemo/geo-bounding-rect

Update dependency pyarrow to v23 [SECURITY]#8795

15 minutes ago

a746d6d

renovate/pypi-pyarrow-vulnerability

feat(vortex-file): gate the file writer behind editions#8877

17 minutes ago

c84896c

claude/writer-editions-gating-8qy1fv

Home Terms Privacy Docs