Working with RunwayML in Pixeltable

Pixeltable's RunwayML integration lets you generate and transform images and videos using RunwayML's Gen-4.5, Veo, and other models, directly from your Pixeltable tables.

Providers · Notebook · Updated

Colab runs it in your browser. If it calls a model provider, it asks for that provider's API key in a cell.

What it covers

  • What is RunwayML?
  • Text-to-Video Generation
  • Image-to-Video Generation
  • Text-to-Image Generation
  • Video-to-Video Transformation
  • Using model_kwargs for Advanced Parameters
  • Learn More

What it uses

Install
terminal
pip install pixeltable runwayml
Environment variables it names
RUNWAYML_API_SECRET
Pixeltable calls
runwayml.text_to_video()runwayml.image_to_video()runwayml.text_to_image()runwayml.video_to_video()pxt.create_table()add_computed_column()insert()

A look at the code

working-with-runwayml.ipynb
t2v = pxt.create_table(
'runwayml_demo.text_to_video', {'prompt': pxt.String}
)
t2v.add_computed_column(
response=runwayml.text_to_video(
t2v.prompt, model='gen4.5', ratio='1280:720', duration=5
)
)
# Extract the video URL from the response
t2v.add_computed_column(video=t2v.response['output'][0].astype(pxt.Video))

One cell of the notebook, copied as it is. Open it in Colab for the rest.

Browse all 103