technologybriefs
9:48in productionCh. 1 · Origin: A startup’s stopgap/ 9:48 · ceiling 15 min
Software · Systems

Redis

Redis trades durability for speed—and forces you to choose which seconds you can afford to lose.

Redis is an in-memory key-value database introduced in 2009 by Salvatore Sanfilippo to solve scalability issues at his startup LLOOGG. It delivers low-latency operations by holding all data in memory and using the fork system call to enable concurrent client service and disk persistence. It supports two persistence methods—RDB snapshotting and AOF journaling—with journaling introduced in version 1.1 and considered safer. Default configuration limits data loss to a few seconds upon full system failure. Redis supports master-replica replication with hierarchical trees and introduced clustering in April 2015 with version 3.0. It grew into one of the world’s most popular databases for caching, message brokering, and primary storage. In December 2024, Sanfilippo returned to Redis and implemented the Vector Set data structure for vector similarity search.

Chapters & takeaways5
  1. 1:15
    Origin: A startup’s stopgap

    Redis began as a 2009 prototype to fix real-time log analysis at LLOOGG—not as a general-purpose database.

  2. 2:33
    Mechanism: Fork, serve, write

    It runs in memory and forks to persist—so clients stay responsive while data hits disk asynchronously.

  3. 3:38
    Evolution: Safety then scale

    Journaling (v1.1) reduced data loss to seconds; clustering (v3.0, April 2015) came six years later.

  4. 4:48
    Adoption: Where it stuck

    It succeeded not as a replacement for SQL, but as a fast layer for caching, brokering, and niche primary storage.

  5. 6:20
    Stewardship: BDFL and comeback

    Sanfilippo led it for 11 years, stepped away, then returned in December 2024 to add the Vector Set.

Worth your time?

Yes. Study the whole thing.

4/ 5
What works
  • low-latency reads and writes
  • master–replica replication with hierarchical trees
  • AOF journaling for safer persistence
  • widespread adoption for caching and brokering
What does not
  • guarantees durability by default
  • eliminates memory overhead during persistence
  • makes clustering simple to operate
  • proves the Vector Set at production scale
Study it if
  • developers building real-time caches
  • teams operating message brokers where sub-millisecond latency matters
  • engineers willing to configure persistence explicitly
Skip it if
  • applications requiring strict transactional consistency
  • workloads where even two-second data loss is unacceptable
  • teams without capacity to tune replication or clustering
The written brief2 min read

What it is and the problem it solves

Redis is an in-memory key-value database prototyped in 2009 by Salvatore Sanfilippo to solve scalability bottlenecks in his startup LLOOGG’s real-time web log analyzer. It addresses slow disk-bound databases by keeping everything in RAM and serving low-latency operations.

How it works

Redis holds all data in memory and uses the fork system call to duplicate the process: the parent serves clients while the child persists data to disk. It offers two persistence methods: RDB snapshotting and AOF journaling. Journaling was added in version 1.1 and is considered safer. By default, Redis writes to disk every two seconds, limiting data loss to a few seconds on full system failure. Replication supports hierarchical master–replica trees. Clustering arrived in April 2015 with version 3.0.

What works

Low-latency reads and writes work reliably due to in-memory operation and efficient single-threaded event loop. Master–replica replication works with hierarchical trees. AOF journaling provides safer persistence than RDB snapshots. Redis is widely adopted for distributed caching and message brokering because these patterns align with its strengths.

What does not

Redis does not guarantee durability by default. Its fork-based persistence creates memory overhead and can stall under large datasets. Journaling avoids some risks but adds latency and disk I/O pressure. Clustering is complex to operate and was not part of the original 2009 design. The Vector Set—added in December 2024—is new and unproven at scale.

What it changes

Redis changed how developers think about database roles: it blurred the line between cache and primary store. It made in-memory data structures viable for production messaging and real-time analytics. It shifted persistence expectations from ACID guarantees to ‘a few seconds of loss’ as acceptable for many use cases.

Is it worth your time

Yes—if you need low-latency reads and writes for caching, message brokering, or primary storage, and can accept the trade-offs of in-memory operation and persistence gaps. It demands careful configuration to avoid data loss; default settings are not production-safe for critical workloads.

Same field · Software4 of 109
9:36
Apache ActiveMQ2006ActiveMQ is a Java-based open source message broker implementing JMS 1.1. It enables asynchronous communication across Java and cross-language clients. It supports clustering, multiple persistence options, and several protocols. It originated in 2004 at LogicBlaze, moved to Apache in 2007, and later expanded to include Artemis—a next-generation broker donated in 2015. It is used in enterprise service buses and SOA infrastructure.
9:25
RabbitMQRabbitMQ is an Erlang-based open-source message broker that implements AMQP and extends to STOMP, MQTT, and HTTP via plug-ins. It uses OTP for clustering and failover. Client libraries exist for all major languages. Licensed under MPL. Commercial versions launched November 2020. Developed in 2007 by Rabbit Technologies Ltd., a joint venture between LShift and CohesiveFT.
10:49
RESTRoy FieldingREST is Roy Fielding’s 2000 architectural style for the Web. It defines constraints—not rules—to diagnose scalability failures in distributed hypermedia systems. Its power lies in exposing gaps between promise and practice, especially around statelessness and HATEOAS. Most so-called RESTful APIs ignore its core mechanism: hypermedia-driven state transitions.
9:54
Terraform (software)HashiCorpTerraform is infrastructure-as-code software developed by HashiCorp in 2014. It uses declarative configuration (HCL or JSON) and provider plugins to manage infrastructure across clouds and on-prem systems. It shifted from MPL 2.0 to BUSL on 10 August 2023, restricting commercial use by competitors and prompting the OpenTofu fork. It supports automation in large-scale service-oriented development but requires strict state management and does not enforce security or runtime behaviour.
Up next in Technology

Regenerative braking

· 9:06

Regenerative braking recaptures energy—but only because friction brakes still do the final, vital work.

9:06