Skip to content
Back to all work

personal ·

Private Mind

A local RAG assistant: upload your documents, ask questions, get answers from Llama 3.2 with their sources.

Overview

Private Mind is a local retrieval-augmented assistant. You upload PDF, DOCX or TXT documents and ask questions about them; answers are generated by Llama 3.2 running through Ollama, and the sources used are shown with every answer.

Retrieval uses BM25: no embeddings and no vector database.

Solution

BM25 retrieval selects the relevant passages from the uploaded documents, which are passed to Llama 3.2 (via Ollama) to answer. Data is stored in SQLite. The back end is FastAPI + Pydantic; the front end is React + TypeScript (Vite).

Features

  • Upload PDF, DOCX and TXT documents
  • Questions answered by Llama 3.2 via Ollama
  • Sources shown with every answer
  • BM25 retrieval: no embeddings, no vector database
  • SQLite storage

Next project

FraudGuard Bank