EasyAI 是一个可本地运行的统一 LLM 网关平台,包含:
- OneAPI Gateway(统一
/v1/*入口、鉴权、限流、缓存、审计) - LiteLLM Service(模型别名与上游适配)
- Batch Worker(异步批处理消费)
- Dashboard / Chat UI
docker compose up -d --build
curl -sS http://localhost:3004/healthz
docker compose exec -T ollama ollama pull qwen2.5:0.5b发起一次请求(默认开发 key: dev-key):
curl -sS http://localhost:3004/v1/chat/completions \
-H "Authorization: Bearer dev-key" \
-H "Content-Type: application/json" \
-d '{"model":"chat","messages":[{"role":"user","content":"hello"}],"temperature":0}'cp config/easyai.production.example.yaml config/easyai.production.local.yaml
# 编辑并替换所有 REPLACE_WITH_*
python3 scripts/render-local-compose.py config/easyai.production.local.yaml > docker-compose.local.yml
docker compose -f docker-compose.yml -f docker-compose.local.yml up -d --build
docker compose -f docker-compose.yml -f docker-compose.local.yml exec -T ollama ollama pull qwen2.5:0.5b生产环境对外服务验收(smoke):
BASE_URL=http://localhost:3003 CONFIG_FILE=config/easyai.production.local.yaml ./scripts/smoke-compose.sh- 开发网关:
http://localhost:3004 - 生产网关(override):
http://localhost:3003 - 首页:
/ - API 文档:
/docs - OpenAPI JSON:
/openapi.json - Dashboard:
/dashboard - Chat:
/chat