Multimodal data

What is an image column?

An image column stores a still picture as a first-class value a schema can caption, embed, or transform.

Updated · Part of What is a typed media column?

How it works

  • The row keeps the picture with its title, label, or product id.
  • A computed column can caption or edit that picture when the row changes.
  • An embedding index on the picture answers visual similarity.

What it is not

It is not a filename, and it is not a numeric array with no catalog row.

image column: this, and the thing it is confused with

image column: this, and the thing it is confused with
ThisNot this
StoredA still the schema understandsA path in a string
Typical next columnCaption, embedding, or editA one-off script
SearchBy similar picture or phraseBy filename

Where Pixeltable fits

Pixeltable declares that column as image: pxt.Image, then assigns caption or embedding columns on the same class.

Questions

How does image column work?
The row keeps the picture with its title, label, or product id. A computed column can caption or edit that picture when the row changes. An embedding index on the picture answers visual similarity.
What is image column often confused with?
It is not a filename, and it is not a numeric array with no catalog row.