Module Overview
Chat Runtime
Purpose: Primary user interfaceSDK-Web
Purpose: Browser-server communication- 40+ service functions
- Type-safe with Zod validation
- Auto-reconnect with exponential backoff
- Real-time streaming support
Durable Object WebSocket
Purpose: Serverless WebSocket infrastructureSDK-Node
Purpose: Core intelligence engine- Multi-LLM support (Anthropic, OpenAI, Gemini, Groq)
- Model strategy selection (Best, Fast, Balanced)
- Query caching (5-minute TTL)
- Collection registry for data handlers
Backend Application
Purpose: Business logic and tools- 21 specialized tools
- 8 AI prompt categories
- Custom integrations
- Database connections