System Architecture

The key priority of this architecture is developer velocity.

  • Vercel + Railway + Supabase + Beam has been a fantastic combo.

User-defined Custom Tool Use by LLM

Using N8N for a user-friendly GUI to define custom tools. This way, any user can give their chatbot custom tools that will be automatically invoked when appropriate, as decided by the LLM.

More coming soon (May-June 2024).

Self-hostable version (coming July 2024)

Simplify to a single Docker-compose script.

  • : Main or "top level" storage, contains pointers to all other DBs and additional metadata.

  • MinIO: File storage (pdf/docx/mp4)

  • Redis/ValKey: User and project metadata, fast retrieval needed for page load.

  • Qdrant: Vector DB for document embeddings.

Last updated