Generate captions for images
Automatically create descriptive captions for images using AI vision models.
Updated Open in Colab
Promptable segmentation with SAM 3
Segment every object matching a concept (a short text phrase or a bounding box) using Meta's Segment Anything Model 3.
Images · Notebook · Updated
Colab runs it in your browser. If it calls a model provider, it asks for that provider's API key in a cell.
What it covers
- Segment a single object from a text prompt
- Segment many instances of a concept at once
- Segment a specific region with a bounding box
- Segment objects across the frames of a video
- Apply SAM 3 to three customer use cases: satellite imagery, medical scans, and solar inspection
What it uses
- Install
- terminalpip install pixeltable torch torchvision transformers
- Pixeltable calls
huggingface.()vision.overlay_segmentation()video.clip()huggingface.sam3_for_video_segmentation()video.make_video()vision.bboxes_draw()image.tile_iterator()image.stitch_tiles()pxt.create_table()pxt.create_view()
More in Images
Browse all 103Transform images with AI-powered editing
You have a batch of images that need AI-powered transformations—like turning photos into paintings, adding stylistic effects, or modifying content based on text prompts.
Updated Open in ColabAnalyze images in batch with AI vision
Run the same AI prompt against multiple images automatically, without writing loops or managing API calls.
Updated Open in ColabExtract structured data from images
Use AI vision to extract JSON data from receipts, forms, documents, and other images.
Updated Open in Colab