Working with llama.cpp in Pixeltable
This tutorial demonstrates how to use Pixeltable's built-in llama.cpp integration to run local LLMs efficiently.
Pixeltable's Jina AI integration enables you to access state-of-the-art embedding and reranker models via the Jina AI API.
Providers · Notebook · Updated
Colab runs it in your browser. If it calls a model provider, it asks for that provider's API key in a cell.
pip install pixeltable
JINA_API_KEYjina.embeddings()jina.rerank()pxt.create_table()add_computed_column()insert()add_embedding_index()similarity()from pixeltable.functions import jina# Create a table for document embeddingsdocs_t = pxt.create_table('jina_demo.documents', {'text': pxt.String})# Add computed column with Jina embeddings# task='retrieval.passage' optimizes embeddings for documents to be searcheddocs_t.add_computed_column(embedding=jina.embeddings(docs_t.text, model='jina-embeddings-v3', task='retrieval.passage'))
One cell of the notebook, copied as it is. Open it in Colab for the rest.
This tutorial demonstrates how to use Pixeltable's built-in llama.cpp integration to run local LLMs efficiently.
Pixeltable's Mistral AI integration enables you to access Mistral's LLM and other models via the Mistral AI API.
Pixeltable's Nebius Token Factory integration enables you to access Nebius language and embedding models via an OpenAI-compatible API.
Ollama is a popular platform for local serving of LLMs. In this tutorial, we'll show how to integrate Ollama models into a Pixeltable workflow.