Framework

FastAPI

Python API layer for inference and RAG microservices.

Directory projects (4)

Dify
Visual builder for RAG apps and agents with deployable API endpoints.
LocalAI
Self-hosted OpenAI-compatible API for text, audio, and vision models.
LiteLLM
OpenAI-compatible proxy that unifies dozens of model providers behind one key.
Khoj
Personal research assistant indexing notes, files, and web saves.