Multimodal data
What is a multimodal table?
A multimodal table is a row-and-column object that holds structured values and typed media together, with derived columns and history on that same object.
Updated · Part of What is a multimodal database?
How it works
- Each row can mix text, numbers, and a video, image, audio clip, or document.
- Derived columns run when the row changes and stay attached to that row.
- A later query can filter the structured fields and open the media the row points at.
What it is not
It is not a benchmark dataset used to score models, and it is not a warehouse table whose only media is a URL in a string column.
multimodal table: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Holds | Typed media and fields in one row | A path string, or a paper dataset |
| After an edit | Derived columns for that row update | A script you remember to rerun |
| History | Prior versions of the same row | A copied folder named v2 |
Where Pixeltable fits
Pixeltable’s table is that object: Image, Video, Audio, and Document columns plus computed columns on one class.
Questions
- How does multimodal table work?
- Each row can mix text, numbers, and a video, image, audio clip, or document. Derived columns run when the row changes and stay attached to that row. A later query can filter the structured fields and open the media the row points at.
- What is multimodal table often confused with?
- It is not a benchmark dataset used to score models, and it is not a warehouse table whose only media is a URL in a string column.