HyperArrow

HyperArrow is a collection of libraries in different langauges that gives users an easy way to convert Arrow tables to Tableau’s Hyper format. The core library is written in C++.

Currently support languages are C++ and Python. Contributions to add any other language would be very welcome. Please refer to each language’s section on installation and usage notes.

Why HyperArrow?

HyperArrow looks to build off of the advantages of the Apache Arrow library. While the current implementation is limited in scope to just a C++ and Python library dealing with singular arrow Table objects, in the future we envision:

• Reading / Writing Hyper files from a large variety of langauges

• Serializing and Deserializing data that is larger than memory (i.e. “out-of-core”)

• Support streaming data into Hyper files