Limited Time Offer:Up to 20% off Hello Interview Premium
Up to 20% off Hello Interview Premium 🎉
Hello Interview
Your Dashboard
System Design
ML System Design
Low Level Design
Code
Behavioral
New
AI Coding
New
Salary Negotiation
Interview Guides
Blog
System Design
Low Level Design
AI Coding
Mock Interviews
1:1 Mentorship
Salary Negotiation
Interview Questions
Success Stories
Peer System Design Library
Ask The Community
Interview Experiences
Discord
Refer a Friend
PricingBecome a Coach
Sign in / Sign up
Search
⌘K
PricingBecome a Coach

Tutor

Design a Web Crawler with Limited Communication

Design a distributed web crawler using 10,000 machines to crawl 1 billion URLs without any centralized components (no master nodes, databases, queues, or cloud services). Focus on decentralized coordination, load distribution, and handling communication constraints between nodes.

Asked at:

Meta

Bloomberg

Bloomberg


Questions
Meta SWE Interview QuestionsAmazon SWE Interview QuestionsGoogle SWE Interview QuestionsOpenAI SWE Interview QuestionsEngineering Manager (EM) Interview Questions
Learn
Learn System DesignLearn DSALearn BehavioralLearn ML System DesignLearn Low Level DesignGuided Practice
Links
FAQPricingGift Mock InterviewsGift PremiumBecome a CoachOur CoachesHello Interview Premium
Legal
Terms and ConditionsPrivacy PolicySecurity
Contact
About UsProduct Support

7511 Greenwood Ave North Unit #4238 Seattle WA 98103


© 2026 Optick Labs Inc. All rights reserved.