System Design Tutorial Functional and Non Functional Design Patterns System Design Interview Guide Software Engineering High-level design or HLD is an initial step in the development of applications where the overall structure of a system is planned. Mainly focuses on how different components of the system work together without getting to know about internal coding and implementation. Helps everyone involved in the project to understand the goals and ensures good communication during development. Crucial for developers, architects, and product managers because it allows them to make sure that all stakeholders are aligned with the project objectives. That's why it is also known as macro-level design. The common request flow most applications follow from user to data and back. Users - Edge/Gateway: CDN/Edge handles cache, TLS, basic DDoS; LB/API Gateway routes. Gateway - Services: App layer runs auth/logic and fans out to deps. Services - Data: Read/write to SQL/NoSQL/object/storage/search; cache hot reads; persist writes. Services - Async: Offload emails/webhooks/reindex/heavy jobs to queues; workers update later. Auth & Observability: Auth at gateway/services; emit logs, metrics, traces for monitoring/alerts. Response - User: Reply goes back via gateway/edge; update caches for faster next hits. Components of High-Level Design Understanding the components of high-level design is very important for creating effective systems that meet user needs and technical requirements. Below are the main components of high-level design: System Architecture: System architecture is an overview of the entire system that represents the structure and the relationships between various components. It helps to visually represent how different parts interact and function. Modules and Components : High-level design breaks down the systems into modules or components, each with specific roles and responsibilities, and has a distinct function that contributes to the entire system, helping in developing an efficient system. Data Flow Diagrams (DFDs) : Data Flow Diagrams demonstrate the data movement within the system. They help to understand how information is processed and pass from one end to another. Interface Design : It includes the design of application programming interfaces (APIs) for system integration and user interfaces (UIs) for user interaction, ensuring seamless functionality and communication between components. Technology Stack : The technology stack is various technologies and tools that will be used in the development of the system. This includes programming languages, frameworks, and databases. Deployment Architecture : It includes how the system will be hosted and accessed. It includes server configurations, cloud infrastructure, and network considerations. High-Level Design Document The HLD document consists of data flows, flowcharts, and data structures to help developers understand and implement how the current system is being designed intentionally to function. This document is responsible for explaining the connections between system components and operations, which depict the logic. The architecture design needed (for the system's functionality and flow) for each and every module of the system as per the functional requirements. Purpose and Characteristics of High-Level Design HLD provides a structured technical view by translating functional requirements into an overall system design model, helping visualize how components interact and how data flows. A diagram representing each design aspect is included in the HLD (which is based on business requirements and anticipated results). Description of hardware, software interfaces, and also user interfaces. The workflow of the user's typical process is detailed, along with performance specifications. Difference of HLD from LLD High-level design, or HLD, is a general system design where we do tradeoffs between different frameworks, components, and different databases, and we choose the best considering what the business needs and how the system should work. Whereas LLD (low-level design) translates the HLD into smaller and more specific details, it includes class diagrams, methods, data structures, and algorithms, focusing on how each part will be implemented. Further Read: Differences between High-Level Design (HLD) and Low-Level Design (LLD) After having an adequate understanding of HLD and how it is different from LLD. Let us now discuss the HLD roadmap, which is shown below as an infographic: Designing Scalable High-Level Design (HLD) Systems Now, in order to design any high-level system, certain terms are listed in a sequential manner so as to connect the dots in order to understand. Roadmaps are very important for working professionals because these help us to get a complete, binding understanding of how services in real-time are getting scaled at a high level. 1. Capacity Estimation Capacity estimation in system design involves predicting the resources (such as processing power, memory, and bandwidth) required to meet the expected workload. It ensures that a system can handle current and future demands efficiently, helping in the proper allocation of resources and preventing performance bottlenecks. Example : Twitter, which is recently in newsfeeds these days, here at high-level designing, we need to make sure tweets of popular influencers are reaching out to millions of people, so how do we need to scale our system so service should not be hampered? We have also shown below the characteristic behavior of a server, which is measured across throughput and latency within the system. 2. HTTP and HTTPS and Their Methods HTTP (HyperText Transfer Protocol) is used to transfer the data over the web, which enables the communication between clients and servers that helps users to request resources like HTML pages, messages, videos, or images, while HTTPS (HyperText Transfer Protocol Secure) is an extension of HTTP that adds an extra layer of security through SSL/TLS encryption. Methods of HTTP include GET, PUT, and POST. Tip: These are also important as per interview perspective as constraint bounds in interviews in API over when to use what is very important. Tip: There are many ways to send data from server to client some are: Using Websockets There are two ways to send data from server to clients, which are websockets and polling. In a client-server architecture , we are sending a request to the server, and the server sends it back, and so in this way communication takes place. But in designing the system, the biggest problem we face is whether we can implement the client-server model or peer-to-peer model . Here WebSockets play a crucial role in solving problems and enabling us to have real-time communication. WebSocket is a full-duplex protocol as it allows the application to send and receive data at the same time. They are more or less used in every system to be designed because we cannot let our system wait for a response. They are very useful in real-time web applications, gaming applications, and chat applications. Another way of sending and receiving data from a server, just like we do with the above case of web sockets, is polling. There are mainly 2 types of polling: In short polling , the client sends a request to the server at fixed intervals, and the server immediately sends data, whether the data is updated or not. In long polling , the server waits for the client's request to respond and responds only and only if some new data is available or if some data is being updated. Tip: Long polling is preferredover short polling because lesser number of requests are sent in a system. 5. Server-Sent Events(SSE) It is purposely built as one-way communication from servers to clients in specific design systems. SSE is a technology that helps to push real-time updates from the server to the clients over HTTP connections. SSE enables the server to send data automatically as it becomes available. Examples of SSE include real-time streaming. 6. Rate limiting A rate limiter restricts the number of events that can be done in a timeframe by restricting the number of requests a sender can send in a given period of time. Here, once the threshold limit is reached, it now further blocks the incoming requests, as can be seen below in the media as follows: No matter how great a system we design, there is always a chance of faults and failure, which could be because of hardware issues or software issues (such as running low on memory), or there can be some human error. In such cases we need to provide resiliency through replication, redundancy, and availability. Note: System design interviews start with open-ended designing of a specific system, which later is bounded with constraints at multiple levels. In order to clear dealing with these bounds, in layman's language, it is known as resiliency via implementing common tradeoffs in the system. Hence, providing resiliency is very crucial in designing complex system designs and also in clearing interviews. Paging in high-level design (HLD) refers to the method of dividing large datasets or content into smaller, manageable pages. This approach improves user experience by allowing users to load data incrementally, reducing initial load times and enhancing performance. A log file records events in an application, including details like transactions, service actions, and system flow. Logging is essential for monitoring behavior, tracking system health and performance, and debugging issues in distributed systems. Using a centralized logging service Using a distributed logging system

Using a cloud-based logging service Introduction 7 min read SDLC 6 min read Components 10 min read Goals & Objectives 5 min read Importance of System Design 6 min read Key Concepts and Terminologies 9 min read Advantages 2 min read Monolithic vs Distributed Systems 8 min read Requirements Gathering 6 min read System Analysis vs System Design 4 min read Scaling 6 min read Capacity Estimation 7 min read Answering System Design Problems 5 min read Functional vs Non Functional Requirements 5 min read Web Server and Proxies 7 min read Scalability 5 min read Choosing Scalability Approach 4 min read Scalability Bottlenecks 5 min read Database Design 11 min read SQL vs NoSQL 5 min read File vs Database Storage Systems 4 min read Block, Object and File Storage 7 min read Database Sharding 8 min read Database Replication 6 min read Introduction 8 min read Availability 5 min read Consistency 8 min read Reliability 6 min read CAP Theorem 5 min read API Gateway 6 min read Content Delivery Network 7 min read Load Balancer 7 min read Caching 8 min read Communication Protocols 5 min read Activity Diagrams 5 min read Message Queues 12 min read Authentication vs Authorization 3 min read Optimization Techniques 5 min read OOAD 5 min read DSA for System Design 4 min read Containerization Architecture 10 min read Modularity and Interfaces 7 min read UML Diagrams 8 min read Data Partitioning Techniques 6 min read Prepare for LLD Interviews 4 min read Security Measures 7 min read Design Patterns 4 min read Creational Design Patterns 5 min read Structural Design Patterns 6 min read Behavioral Design Patterns 7 min read Cheat Sheet 4 min read Cracking System Design Interviews 6 min read Interview Q & A 15+ min read Concepts for Interview Preparation 6 min read Crack LLD Interviews 4 min read Commonly Asked Questions 3 min read Design Dropbox 14 min read Designing Twitter 15+ min read Designing Netflix 12 min read Uber App 14 min read Design BookMyShow 11 min read Designing Facebook Messenger 13 min read Roadmap 6 min read System Design Guide for Freshers 15+ min read System Design Course 2 min read DSA & System Design Course 2 min read Java Backend Development Course 2 min read