Low Level Design: Web Crawl Scheduler
What Is a Web Crawl Scheduler? A Web Crawl Scheduler manages the frontier of URLs to be fetched, decides the […]
What Is a Web Crawl Scheduler? A Web Crawl Scheduler manages the frontier of URLs to be fetched, decides the […]
What Is a Search Index Builder? A Search Index Builder is the offline pipeline responsible for transforming raw document corpora
What Is a Wide-Column Store? A wide-column store (also called a column-family store) organizes data in tables where rows can
What Is a Link Analytics Service? A Link Analytics Service tracks every interaction with a shortened URL or QR code
What Is a QR Code Generator Service? A QR Code Generator Service accepts arbitrary data (URLs, vCards, plain text) and
What Is an Ad Delivery Service? The Ad Delivery Service is the final stage in the ad pipeline. Once the
What Is an Ad Auction System? An Ad Auction System determines which advertiser wins a given ad slot and how
What Is an Ad Targeting Service? An Ad Targeting Service is responsible for selecting the most relevant advertisements to show
What Is a Trust and Safety Platform? A Trust and Safety (T&S) platform is the umbrella system that governs user
What Is a Message Delivery Receipts Service? A message delivery receipts service tracks the lifecycle of every message from send
What Is a Real-Time Messaging Service? A real-time messaging service is the transport layer that moves data from one endpoint
What Is a Usage Metering Service? A Usage Metering Service measures how much of a resource a customer consumes, aggregates
What Is a Plan Management Service? A Plan Management Service owns the catalog of subscription plans and the logic for
What Is a Semantic Search Service? A Semantic Search Service finds documents that are conceptually relevant to a query even
What Is a Scoring Service? A scoring service is the write-side component responsible for receiving raw score events, applying business