Video
What is video RAG?
Video RAG retrieves a moment — a frame, a timestamp, and maybe a transcript line — and gives that evidence to the model.
Updated · Part of What is RAG?
How it works
- Sample frames, and optionally transcribe the soundtrack.
- Embed the frames or the transcript windows.
- The retrieved hit names the clip and the time, then the model answers from that.
What it is not
It is not a vector database of clip titles, and it is not captioning one video inside a chat window.
video RAG: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Evidence | A moment | A filename |
| Index | Frames and/or transcript windows | Titles only |
| Model input | The hit, not the whole library | The entire file on every question |
Where Pixeltable fits
Pixeltable builds the frame view and the index on the video table, then a query returns the moment a generator can read.
Questions
How does video RAG work?
Sample frames, and optionally transcribe the soundtrack. Embed the frames or the transcript windows. The retrieved hit names the clip and the time, then the model answers from that.
What is video RAG often confused with?
It is not a vector database of clip titles, and it is not captioning one video inside a chat window.
Next step
Install the Pixeltable skill, or sign up for Cloud and run the same file on a hosted database.