Orchestration
What is an LLM framework?
An LLM framework is a library for chaining model calls, tools, and prompts in application code.
Updated
How it works
- You compose calls in code.
- State lives wherever you put it.
- A table can sit underneath so outputs are rows, not variables.
What it is not
It is not the store those calls read, and it does not by itself keep embeddings in sync with files.
LLM framework: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Writes | Control flow | The system of record |
| State | Your problem | Rows, if you add a store |
| Media | Usually passed through | Typed columns |
Where Pixeltable fits
Pixeltable can be the store and the computed columns under a framework, or replace the chain when the chain was only glue around tables. The LangChain comparison is that boundary.
Questions
- How does LLM framework work?
- You compose calls in code. State lives wherever you put it. A table can sit underneath so outputs are rows, not variables.
- What is LLM framework often confused with?
- It is not the store those calls read, and it does not by itself keep embeddings in sync with files.