AI system design
Design production LLM systems (bridges to AGT).
Practice rooms
- Design: RAG-based support assistantwhiteboard + follow-ups
- Design: LLM gateway / platform for a companywhiteboard + follow-ups
- Design: agentic workflow system (e.g. support agent that takes actions)whiteboard + follow-ups
- Design: AI features at scale (search, moderation, summarisation pipeline)whiteboard + follow-ups
- Design: LLM chat serving at scalewhiteboard + follow-ups
- Design: a coding or computer-use agentwhiteboard + follow-ups
Interview questions in this module
- Design a customer-support assistant that answers from the company's documentation.
- How would you evaluate a RAG system before and after launch?
- Design an internal LLM gateway for many teams.
- Design an agent that can issue refunds. What safeguards do you add?
- How do you control the cost and latency of an LLM feature at scale?