Cognition
Devin + Pixeltable
Autonomous AI software engineer. Plans, codes, debugs, and deploys independently. Give it a multimodal backend: one app.py declares tables, computed columns, indexes, and HTTP routes.
What is Devin?
Devin is Cognition's autonomous AI software engineer. It plans, codes, debugs, and deploys entire projects from a full development environment with a browser and terminal, which makes it capable of a complete Pixeltable setup end to end: install the CLI, add the Skill, connect MCP, scaffold app.py, and verify the served routes.
Quick start
Four steps. The agent can run all of them when you hand it the setup playbook.
- 01
Access Devin
Get access to Devin from Cognition. Devin on the web and the Devin CLI both work.
texthttps://devin.ai
- 02
Install Pixeltable
Python 3.11+ required. `pxt init` marks the project root; schema and service commands refuse an app without one.
bashpip install -U 'pixeltable[serve]' pxt init
- 03
Add the Pixeltable Skill
The Skill teaches the agent table/schema patterns, provider integrations, and anti-patterns. Skip this step if the full Pixeltable plugin is already installed. Source: https://github.com/pixeltable/pixeltable-skill
bashnpx skills add pixeltable/pixeltable-skill npx skills list
- 04
Ship a first app
Declare the tables, start the HTTP routes, then try them in the dashboard. For Cloud, the agent runs `pxt new` for a free database with no account and gives you its claim link, or runs `pxt login` for your account while you confirm its code. Then `pxt db update pxt://<org>:main --add-config-entry`, `pxt schema update`, and `pxt service update`, in that order. The flag writes the hosted entry. An API key is optional for CLI automation.
bashpxt service example --out app.py pxt schema update app.py my_app pxt service update app.py my_app pxt dashboard
MCP configuration
Pixeltable has three MCP servers. Connect the one the job needs.
| Server | Transport | What it can do |
|---|---|---|
| pixeltable-web | HTTP | Read-only docs search and integration listing. No table mutations. |
| pixeltable-cloud | HTTP + AuthKit | Read and operate the signed-in Cloud organization: databases, services, catalog, schemas, bounded table rows, failed cells, and logs. Starts a database or a service at once; stops or restarts either, or sets a secret, after a preview (confirm: true). ?read_only=true leaves only the read tools. |
| pixeltable-developer | stdio | Inspect schemas, query tables, run a REPL against a local or Cloud catalog. |
Connect Pixeltable Cloud (read and operate, AuthKit sign-in)
Optional, for Pixeltable Cloud users. In Devin on the web, an admin adds a custom MCP with this URL, HTTP transport, OAuth authentication, and Personal access, so each member signs in as themselves; each member then chooses Connect under Customize > MCPs and completes the AuthKit browser sign-in. In the Devin CLI, add it, then `devin mcp login` opens the browser sign-in. Read-only mode and disconnecting are on /developers/mcp-cloud.
devin mcp add pixeltable-cloud --url https://www.pixeltable.com/mcp/cloud devin mcp login pixeltable-cloud
Connect the WebMCP (docs search, no auth)
In Devin on the web, open Customize > MCPs, choose Add a custom MCP, pick HTTP transport, and set the Server URL. In the Devin CLI, add it directly:
devin mcp add pixeltable-web --url https://www.pixeltable.com/mcp
Connect the developer MCP (tables + REPL)
Install the server once per machine (step below), then register it. Trailing args imply stdio:
devin mcp add pixeltable-developer mcp-server-pixeltable-developer
Install the developer MCP server
Stdio server that inspects schemas, queries tables, and runs a REPL against a local or Cloud catalog. Repository: https://github.com/pixeltable/mcp-server-pixeltable-developer
uv tool install mcp-server-pixeltable-developer # if uv is missing: # curl -LsSf https://astral.sh/uv/install.sh | sh
Example prompts
What to ask Devin once Pixeltable is set up.
Install Pixeltable and set up a table that embeds every image I insert.
Build a RAG pipeline over the PDFs in ./docs and expose a FastAPI route that answers questions.
Transcribe every video in ./media with Whisper, index the transcript, and serve semantic search over HTTP.
Add a computed column that captions each uploaded image with a vision model.
Scaffold app.py with pxt service example, declare the schema, and start the service.
Take app.py and deploy it to my Pixeltable Cloud database pxt://myorg:main.
Build a background-remover API: image in, background removed, POST endpoint.
Common workflows
Set up a Pixeltable app
- 1.Hand the agent https://www.pixeltable.com/get-started.md and let it run the playbook
- 2.It installs the pxt CLI and the Pixeltable Skill
- 3.It scaffolds app.py, declares the schema, starts the service
- 4.It verifies the endpoint with a curl request
Build a multimodal pipeline
- 1.Describe the pipeline: ingest media, run models, index results
- 2.The agent declares the table and computed columns in app.py
- 3.It adds an embedding index and an HTTP route that serves results
- 4.Insert a row; computed columns run and indexes stay current
Deploy to Pixeltable Cloud
- 1.Ask the agent to deploy app.py to Cloud
- 2.With no account, the agent runs pxt new and sends you a claim link; with one, it runs pxt login and you confirm the code
- 3.It uses the organization’s main database or the database you specify
- 4.It runs pxt db update, pxt schema update, pxt service update in order
- 5.It finds the hosted endpoint with pxt service list; direct HTTP calls use an API key
Inspect a catalog over MCP
- 1.Connect the pixeltable-developer MCP server
- 2.The agent lists tables and views in the catalog
- 3.It runs read queries and reports schema and row counts
- 4.Keep human confirmation on: the developer server can change local catalog state
Tips for success
Troubleshooting
The Pixeltable Skill is not visible after install
Reload or restart the agent. Confirm the install path with `npx skills list` and that the skill targets the current agent.
The agent does not list the MCP server
Validate the config file JSON. pixeltable-web is a remote HTTP server at https://www.pixeltable.com/mcp; pixeltable-cloud is an AuthKit-protected remote server at https://www.pixeltable.com/mcp/cloud; pixeltable-developer is a stdio command, `mcp-server-pixeltable-developer`. Verify the local server is installed with `mcp-server-pixeltable-developer --help`.
`pxt service check` fails: modifies catalog while imported
app.py must declare TableModel tables and FastAPIRouter routes, not run pxt.create_table() at import. Scaffold with `pxt service example`.
Cloud deploy fails with 404: UDF not found
Order is required: `pxt db update pxt://myorg:main`, then `pxt schema update app.py pxt://myorg:main`, then `pxt service update app.py pxt://myorg:main`. Replace `myorg` with your organization slug.
Frequently asked questions
Can Devin set up Pixeltable on its own?
Which Pixeltable MCP server should I connect?
Can Devin deploy to Pixeltable Cloud?
Does the Pixeltable Skill work with Devin?
Related agents
Agentic coding in your terminal. Understands your codebase, runs commands, and edits files.
The AI-first IDE. Agent mode edits across files, runs commands, and iterates on errors.
OpenAI's coding agent for the terminal and cloud. Reads and writes files, executes commands.
Give Devin a multimodal backend
One app.py declares tables, computed columns, indexes, and HTTP routes. Insert a row; the pipeline runs.