Skip to content

Docker Deployment

FluidRAG runs as a set of Docker containers managed by Docker Compose. The stack includes an API server, background workers, a configuration store, and an admin dashboard — all connected through an nginx gateway.

11 Services

etcd, Redis, API, 2 RQ workers, scheduler, dashboard, config API, admin UI, gateway, and a one-time bootstrap job.

Hot-Reload Config

All runtime configuration (LLM models, feature flags, search tuning) lives in etcd. Changes via Admin UI take effect instantly.

Scalable Workers

Two RQ workers handle ingestion, extraction, and ontology jobs. Add more by duplicating the worker service.

Multi-Platform Builds

Docker Bake builds for native (dev) or linux/amd64 (prod). Images publish to GitHub Container Registry.

┌─────────────┐
│ Gateway │ :80/:443 (nginx)
└──────┬──────┘
┌──────────────┼──────────────┐
│ │ │
/config-ui/ /config-api/ /backend-api/
│ │ │
┌──────┴──────┐ ┌────┴────┐ ┌──────┴──────┐
│ Admin UI │ │Config API│ │ API Server │ :8000
└─────────────┘ └────┬────┘ └──────┬──────┘
│ │
┌──────┴──────────────┴──────┐
│ │
┌─────┴─────┐ ┌──────┴──────┐
│ etcd │ :2379 │ Redis │ :6379
│ (config) │ │ (queues) │
└───────────┘ └──────┬──────┘
┌───────┼───────┐
│ │ │
Worker 1 Worker 2 Scheduler

The API server also connects to your external FalkorDB instance (not shown) for knowledge graph operations.

ServiceImagePortPurpose
etcdcoreos/etcd:v3.6.82379, 2380Configuration store (source of truth)
etcd-bootstrapfluidrag:0.4.1One-time etcd initialization (exits after)
redisredis:7-alpine6379Job queue, caching, session storage
apifluidrag:0.4.18000FastAPI backend (OpenAI-compatible API)
rq-worker-1fluidrag:0.4.1Background job processor
rq-worker-2fluidrag:0.4.1Background job processor
rq-schedulerfluidrag:0.4.1Scheduled job enqueuer (60s interval)
rq-dashboardfluidrag:0.4.19181Job monitoring UI
config-apifluidrag-admin-api:0.4.1Admin backend (settings, secrets, prompts)
admin-uifluidrag-admin-ui:0.4.1Admin dashboard (React)
gatewayfluidrag-gateway:0.4.180, 443Nginx reverse proxy
TopicDescription
InstallationStep-by-step guide to deploy FluidRAG with Docker Compose
ConfigurationEnvironment variables, etcd-managed settings, volume mounts
Building ImagesDocker Bake, Makefile targets, local vs production builds
TroubleshootingCommon issues and solutions for Docker deployments