Import data from Parquet files

Load columnar data from Parquet files into Pixeltable tables for processing and analysis.

Data Import/Export · Notebook · Updated

Colab runs it in your browser. If it calls a model provider, it asks for that provider's API key in a cell.

How it works

You use pxt.create_table() with a source parameter to create a table from a Parquet file. Pixeltable infers column types from the Parquet schema automatically.

What it covers

  • Import Parquet files directly into tables
  • Export tables to Parquet for external tools
  • Handle schema type overrides

What it uses

Install
terminal
pip install pixeltable pyarrow pandas
Pixeltable calls
pxt.create_table()add_computed_column()

A look at the code

data-import-parquet.ipynb
# Import Parquet file into a new table
products = pxt.create_table(
'parquet_demo/products', source=str(parquet_path)
)

One cell of the notebook, copied as it is. Open it in Colab for the rest.

Browse all 103