Transcribing and Indexing Audio and Video in Pixeltable
In this tutorial, we'll build an end-to-end workflow for creating and indexing audio transcriptions of video data.
Convert speech to text locally using OpenAI's open-source Whisper model—no API key needed.
Audio · Notebook · Updated
Colab runs it in your browser. If it calls a model provider, it asks for that provider's API key in a cell.
You create a view with audio_splitter to break long files into segments, then add a computed column for transcription. Whisper runs locally on your machine—no API calls needed.
pip install pixeltable openai-whisper
audio.audio_splitter()whisper.transcribe()pxt.create_table()pxt.create_view()insert()add_computed_column()# Add transcription column (runs locally - no API key needed)segments.add_computed_column(transcription=whisper.transcribe(audio=segments.audio_segment,model='base.en', # Options: tiny.en, base.en, small.en, medium.en, large))
One cell of the notebook, copied as it is. Open it in Colab for the rest.
In this tutorial, we'll build an end-to-end workflow for creating and indexing audio transcriptions of video data.
Transcribe audio files and generate summaries automatically using Whisper and LLMs.
Generate YouTube-style chapter timestamps for podcast episodes. WhisperX detects where speech starts and stops, then an LLM summarizes each segment into a chapter title.
Generate natural-sounding audio from text using OpenAI's text-to-speech models.