Write-Ahead Log Storage Low-Level Design: Log Format, Checkpoint, Recovery, and Log Shipping
10 min read What Is a Write-Ahead Log and Why Does It Exist? A write-ahead log (WAL) is the foundation of durability in […] Read article
10 min read What Is a Write-Ahead Log and Why Does It Exist? A write-ahead log (WAL) is the foundation of durability in […] Read article
9 min read MVCC (Multi-Version Concurrency Control) is the foundation of concurrent transaction processing in PostgreSQL, MySQL InnoDB, Oracle, and most modern distributed Read article
9 min read Snapshot isolation (SI) is the transaction isolation level used by PostgreSQL (as its default), Oracle, SQL Server, and many distributed Read article
9 min read Raft is the consensus algorithm designed to be understandable. It powers etcd (Kubernetes backbone), CockroachDB, TiKV, and many other systems Read article
9 min read The gossip protocol is the distributed systems equivalent of rumor spreading: each node periodically shares information with a small random Read article
7 min read Counting the number of distinct elements in a large stream — cardinality estimation — seems to require storing every unique Read article
8 min read A bloom filter is a space-efficient probabilistic data structure that answers membership queries with certainty about absence and high confidence Read article
9 min read LSM-tree (Log-Structured Merge-tree) is the storage engine architecture behind RocksDB, LevelDB, Cassandra, and HBase. It trades read amplification for dramatically Read article
8 min read A TLS certificate manager automates the full lifecycle of digital certificates: issuance via ACME protocol, storage with encrypted private keys, Read article
7 min read A service registry is the backbone of dynamic service discovery in microservice architectures. Rather than hardcoding service endpoints, every instance Read article
10 min read An event bus is a pub/sub messaging system designed for event-driven architectures: services publish domain events, and multiple subscribers react Read article
8 min read A message broker decouples producers from consumers by providing a durable, ordered, partitioned log. Producers append messages to topics; consumers Read article
9 min read A distributed file system (DFS) provides a POSIX-like file interface over a cluster of machines, storing file data reliably across Read article
9 min read A block storage system exposes raw storage as fixed-size blocks (typically 4 KB or 512 bytes) arranged into logical volumes. Read article
9 min read An object storage system provides a flat, scalable store for arbitrary binary data (objects) addressed by a bucket name and Read article