Layer 6 — Modern systems

Series: Modern System Design

Layer 6 is putting it together: product architectures (chat, search, payments) and the extra machinery modern AI systems need.

Posts

1. Designing a Notification System

2. Designing a Real-Time Chat System

3. Designing a Search System

4. Designing a Recommendation System

5. Designing a Feature Flag System

6. Designing a Distributed Scheduler

7. Designing a Payment System

8. Designing a Metrics Pipeline

9. Designing a Log Aggregation System

10. Designing a File Storage System

11. What Is an LLM Inference Server?

12. Streaming LLM Responses

13. Token Streaming

14. LLM Request Queues

15. GPU Scheduling

16. Model Routing

17. AI Rate Limiting

18. Semantic Caching

19. Vector Databases

20. RAG Architecture

21. Building an AI Agent

22. Agent Memory

23. Tool Calling

24. Multi-Agent Systems

25. AI Observability

26. LLM Cost Management

← Previous layer: Layer 5 — Modern infrastructure → Next layer: Layer 7 — Patterns and problems

← Back to Modern System Design