Agent skill

vaex

Vaex out-of-core DataFrames. Use for big data exploration.

Stars 163
Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/other/other/vaex-g1joshi-agent-skills

SKILL.md

Vaex

Vaex is a hidden gem. It uses Memory Mapping to open 100GB files instantly on a laptop and visualize them.

When to Use

  • Visualization: Plotting 1 billion points via heatmaps.
  • Instant Opening: No "loading" time for HDF5/Arrow files.
  • String Processing: Very fast string operations.

Core Concepts

Out-of-Core

Data stays on disk. Virtual columns are computed on the fly.

Binning

Aggregating data into a grid for visualization (heatmap) rather than plotting individual points.

Best Practices (2025)

Do:

  • Convert to HDF5/Arrow: Vaex shines with these formats.
  • Use it for EDA: Rapidly exploring massive datasets locally.

Don't:

  • Don't use for complex unrelated logic: It's specialized for columnar aggregation.

References

Expand your agent's capabilities with these related and highly-rated skills.

Didn't find tool you were looking for?

Be as detailed as possible for better results