repowiserepowise

Command-line tool

vortex-data / vortex

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

★ 3,319stars on GitHubRustApache-2.0

This connects Repowise to vortex-data/vortex's code. It does not install vortex.

Repowise maps public repos from their source. Not affiliated with vortex-data. What is Repowise?

github.com/vortex-data/vortexIndexed at a272f51

What is vortex?

vortex is a columnar file format and toolkit designed for high-performance data processing in data systems backed by object storage. It stores data as encoded columns and separates the logical schema from the physical layout, so encodings and compression strategies can be swapped in as plugins. Its main language is Rust, with Python, C++, Java and TypeScript code also in the repository. To install it, run git clone https://github.com/vortex-data/vortex.git and follow the steps below. Its code health is 7.6 out of 10 (Good), ranked #91 of 4,000+ indexed repos. The last commit to vortex was on Aug 13, 2026, and 33 people have contributed.

As of commit a272f51, indexed Aug 13, 2026. What it is comes from a model reading the README; the rest is measured from the source and git history, not from the maintainer.

For agentsvortex.md

Repo facts: type, license, health, rank, contributors
vortex facts
TypeCommand-line tool
LicenseApache-2.0
Code health7.6 / 10 (Good)
Health rank#91 of 4,000+ indexed repos
Last commitAug 13, 2026
Contributors33
Bus factor1
Size2,724 files, 421,152 lines

Install vortex

Commands copied from the README

  1. 1Clone the vortex repository.
    git clone https://github.com/vortex-data/vortex.git
  2. 2Move into the vortex folder.
    cd vortex
  3. 3Add the Rust crate to a Cargo project.
    cargo add vortex
  4. 4Install the Python package with uv.
    uv add vortex-data
  5. 5Install the vx command-line tool from a pre-built binary.
    cargo binstall vortex-tui

Releases on GitHub (latest 0.93.0, Nov 6, 2026)

Full install notes on GitHub

Explore vortex

Ask about this code in your agent

This connects Repowise to vortex's code. It does not install vortex. To install vortex, use the install steps.

Useful if you want to change or fork vortex: your agent can ask how it is put together and get answers that cite its files.

Ask about vortex

Answers come from vortex's README and source, with the files they cite. Two free answers a day without an account.

Want this for your own codebase? Map your repo free

About this page

Get a page like this for your own codebase

Repowise built this map of vortex-data/vortex from its source and git history. It parses every symbol, draws the dependency graph, scores each file's health from complexity, duplication, coverage and churn, finds hotspots and owners in the history, and writes documentation for every module. Your coding agent reads the same index over MCP, so its answers cite real files.

Free for 2 public repos, with a page like this one. No card. See how Repowise works

Prefer local? pip install repowise && repowise init indexes your own checkout, no account needed. Star Repowise on GitHub

vortex-data/vortex FAQ

What is vortex?

vortex is a columnar file format and toolkit for high-performance data processing. It is aimed at data systems backed by object storage. The project is a Linux Foundation (LF AI & Data) project under Apache-2.0.

How does vortex work?

vortex keeps the logical schema separate from the physical layout, so encodings can be plugged in without changing data types. Column data is stored in encoded form, and compute kernels operate on that encoded data directly.

How do I install vortex?

vortex can be added to a Rust project with cargo add vortex, or to a Python project with uv add vortex-data. The vx command-line tool can be installed with cargo binstall vortex-tui. See the install steps

What language is vortex written in?

vortex is written mainly in Rust. The repository also contains Python, C++, Java and TypeScript code.

How is the vortex code organized?

The vortex repository has 51 modules, including vortex-array, encodings, vortex-layout, vortex-python and vortex-duckdb. Rust crates sit alongside Python, Java and TypeScript packages.

Who is vortex for?

vortex is for building data systems that store data on object storage and need high-performance data processing. It integrates with Arrow, DataFusion, DuckDB, Spark, Pandas and Polars.

What license does vortex use?

vortex is licensed under Apache-2.0. The project is a Linux Foundation (LF AI & Data) project.

Code health

7.5out of 10Good

Hotspots average 6.1, the place fixes pay off most.

On the leaderboards:#6 of 23 Rust repos

Key features of vortex

  • Columnar file format built for data systems that store their data on object storage.
  • Logical types and schema are kept separate from the physical layout, with pluggable encodings and compression strategies.
  • Zero-copy conversion to and from Apache Arrow arrays.
  • Cascading compression that supports nested encoding schemes.
  • Lazy-loaded summary statistics that can be used for query optimization.
  • Integrations with DataFusion, DuckDB, Spark, Pandas and Polars.

How vortex-data/vortex works

Logical types and schema are defined separately from the physical layout, which handles encoding and storage. The encodings directory holds the encoding implementations, which are the pluggable physical layouts that compress column data. The vortex-layout module handles how encoded data is arranged and read, and the vortex-array module is the largest module, with 769 files. The vortex-python module provides the Python package, and vortex-duckdb connects vortex to DuckDB. Data read from a vortex file keeps its encoded form, and compute kernels operate on that encoded data directly.

The codebase has 2,724 files and 37,846 symbols in 51 modules, led by Rust, Python and C++. Code health is 7.5 out of 10, rated good.