Storage
What is a data warehouse?
A data warehouse stores analytical tables for SQL over large scans. Unstructured files are usually paths or external tables, not typed media with model columns.
Updated · Part of What is lakehouse export?
How it works
- Analysts query columnar tables.
- Files may be registered, not decoded into frames.
- A media pipeline can export rows into the warehouse when analysis needs them.
What it is not
It is not the system that extracts frames or keeps an embedding index on those frames.
warehouse: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Query | SQL scans | Frame similarity |
| Files | Paths or external tables | Typed media columns |
| Models | Often elsewhere | Columns on the media row |
Where Pixeltable fits
Pixeltable keeps the media pipeline. A warehouse such as Snowflake or Databricks can receive an export. It does not replace the table the frames live on.
Questions
- How does warehouse work?
- Analysts query columnar tables. Files may be registered, not decoded into frames. A media pipeline can export rows into the warehouse when analysis needs them.
- What is warehouse often confused with?
- It is not the system that extracts frames or keeps an embedding index on those frames.