Audio
What is an audio embedding?
An audio embedding is a vector for a clip or a transcript window, used to find similar speech or sound rather than only exact words.
Updated · Part of What is an embedding?
How it works
- Embed the transcript window, or a model that reads the waveform.
- Index that vector.
- Query with a phrase or another clip.
What it is not
It is not a spectrogram you browse by eye.
audio embedding: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Represents | Sound or the words in a window | A picture of the spectrum |
| Search | Similar speech | Exact substring only |
| Still keep | The audio and the text | Only the vector |
Where Pixeltable fits
Pixeltable usually embeds the transcript text with an embedding index. A waveform model is the same pattern on the audio column.
Questions
- How does audio embedding work?
- Embed the transcript window, or a model that reads the waveform. Index that vector. Query with a phrase or another clip.
- What is audio embedding often confused with?
- It is not a spectrogram you browse by eye.