vortex-data/vortex - CodSpeed

vortex

Blog Docs Changelog

Performance History

Latest Results

feat(cuda): export FSST directly to Arrow varbin Decode FSST directly into device-resident Arrow offsets and values while retaining opt-in VarBinView export. Add session-level layout selection, coverage for both layouts, and CUDA benchmarks. Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>

ad/cuda-fsst-varbin-export

9 minutes ago

vortex-parallel-write Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc/reader-segment-id

25 minutes ago

Expose CUDA-compatible file sink through FFI (#8784) ## Rationale for this change cuda compatible vortex files currently can't be written over ffi ## What changes are included in this PR? ffi to allow writing with the cuda compatible strategy, which only includes encodings that we have gpu kernels for, and also uses the cuda flat layout that uses the array tree from the footer. Also exclude alp-rd and pco from the cuda compatible encoding allowlist for completeness Signed-off-by: Onur Satici <onur@spiraldb.com>

develop

27 minutes ago

vortex-parallel-write Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc/reader-segment-id

2 hours ago

vortex-parallel-write Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc/reader-segment-id

2 hours ago

test(spark): characterize SparkToArrowSchema Spark-to-Arrow conversion (#8782) ## Rationale for this change `SparkToArrowSchema` (`java/vortex-spark/src/main/java/dev/vortex/spark/write/SparkToArrowSchema.java`) converts Spark SQL schemas to Arrow schemas on the **write path**, and currently has no test coverage. It is the mirror image of `ArrowUtils` on the read path, which gained characterization tests in #8770. Like that mapping table, this conversion is exactly the kind of code that regresses quietly: a wrong bit width, a dropped timezone, or lost nullability would silently corrupt written files rather than fail loudly. ## What changes are included in this PR? A new `SparkToArrowSchemaTest` that characterizes the conversion: - **Primitive mappings**: `Boolean` → `Bool`; `Byte/Short/Integer/Long` → signed `Int` 8/16/32/64; `Float/Double` → `SINGLE/DOUBLE` floating point; `String` → `Utf8`; `Binary` → `Binary`; `Decimal` → 128-bit Arrow `Decimal` preserving precision and scale; `Date` → `Date(DAY)`; `Timestamp` → `Timestamp(MICROSECOND, "UTC")` and `TimestampNTZ` → `Timestamp(MICROSECOND, null)`. - **Schema structure**: field names and ordering are preserved; field-level nullability is carried over to the Arrow field. - **Nested types**: `StructType` converts to a `Struct` field with recursively converted children (including per-child nullability); `ArrayType` converts to a `List` whose `element` child carries `containsNull`. - **Rejected types**: unsupported Spark types (e.g. `CalendarIntervalType`) raise `UnsupportedOperationException` naming the offending type. This is a **test-only** change; no production code is modified. 12 tests, all passing locally (`:vortex-spark_2.12:test --tests 'dev.vortex.spark.write.SparkToArrowSchemaTest'`). ## What APIs are changed? Are there any user-facing changes? None. No production code or public API is touched. Signed-off-by: jackylee <qcsd2011@gmail.com>

develop

2 hours ago

Expose CUDA-compatible file sink through FFI Signed-off-by: Onur Satici <onur@spiraldb.com>

os/ffi-cuda

2 hours ago

Expose CUDA-compatible file sink through FFI Signed-off-by: Onur Satici <onur@spiraldb.com>

os/ffi-cuda

2 hours ago

Latest Branches

0%

Writer's ordered_write()#8785

3 hours ago

feae687

myrrc/reader-segment-id

-13%

Expose CUDA-compatible file sink through FFI#8784

3 hours ago

9a15dd8

os/ffi-cuda

0%

Own SQL benchmark suite#8719

6 days ago

c4e8163

myrrc/sql-bench

© 2026 CodSpeed Technology

Home Terms Privacy Docs