Saved
Software · Systems

Apache HBase

2006

HBase delivers Bigtable’s speed on Hadoop’s bones—but only if your data is sparse, your consistency needs are strict, and your tolerance for operational complexity is high.

Worth your time?3.5/5Yes.Study the whole thing.What works, what does not, who it is for ↓
9:14in productionCh. 1 · Not SQL. Not relational./ 9:14 · ceiling 15 min
4 chapters · 9:14Ceiling 15:00

The brief is written and checked. The video joins this page when it is cut.4 chapters · 1 min read · 9:14 planned

Read the brief

HBase is a wide-column, non-relational, distributed database modelled after Google's Bigtable. It runs on HDFS or Alluxio. It provides fault-tolerant storage for large sparse datasets with fast read/write operations, high throughput, low I/O latency, and CP consistency per the CAP Theorem. It features compression, in-memory operation, and Bloom filters on a per-column basis. Tables can serve as input and output for MapReduce jobs and are accessible via Java API, REST, Avro, or Thrift.

Chapters & takeaways4
  1. 1:12
    Not SQL. Not relational.

    HBase is a wide-column store, not a relational database—and its lineage to Bigtable defines its structure and limits.

  2. 2:32
    Built on Hadoop’s foundation

    It runs on HDFS or Alluxio, and that dependency shapes its performance: fast random access, but only atop a batch-optimised file system.

  3. 4:12
    Optimised for sparsity

    Compression, Bloom filters, and in-memory operation make sparse-data lookups efficient—but they do not fix write amplification or compaction overhead.

  4. 5:59
    CP, not AP

    It supports MapReduce and multiple APIs—but sacrifices availability to guarantee consistency, making it unsuitable for highly partitioned environments.

1 more chapterFewer chapters
Worth your time?

Yes. Study the whole thing.

3.5/ 5
What works
  • fast random reads/writes on sparse data
  • MapReduce integration
  • per-column optimisations
  • CP consistency
What does not
  • multi-row transactions
  • SQL
  • ACID
  • schema enforcement
Study it if
  • engineers managing sparse, high-volume time-series or log data in Hadoop environments
Skip it if
  • teams needing ad-hoc SQL analytics, strong consistency across regions, or simple operational models
Who should study it, and who should skipHide who it is for
The written brief1 min read

What it is and the problem it solves

HBase is a non-relational, wide-column distributed database modelled after Google’s Bigtable. It solves the problem of fast random read/write access to sparse, massive datasets—like finding rare non-zero values in billions of mostly empty records.

How it works

HBase stores data in wide-column tables across distributed nodes. It runs on HDFS or Alluxio. It uses compression, in-memory operation, and per-column Bloom filters. It provides CP consistency under the CAP Theorem.

What works

Fast read/write operations on large datasets. High throughput and low I/O latency. Fault-tolerant storage of sparse data. Integration with MapReduce. Access via Java API, REST, Avro, and Thrift.

What does not

HBase does not support multi-row transactions or relational joins. It does not guarantee availability during network partitions. It does not offer native SQL or schema enforcement.

What it changes

HBase changes how large-scale sparse data is accessed in batch-adjacent systems. It enables real-time querying atop Hadoop’s batch infrastructure—but only for specific access patterns.

Is it worth your time

Yes—if you need fault-tolerant, low-latency random reads/writes on sparse, massive datasets within a Hadoop ecosystem. No—if you require ACID transactions, SQL, or eventual consistency.

Same field · Software4 of 114
9:47
TypeScriptAnders Hejlsberg · 2012TypeScript is a compiler-layered static typing system for JavaScript. It solves scalability problems in large codebases by enabling early error detection and better tooling — without breaking compatibility. Its mechanism is transpilation, not runtime enforcement. Its biggest win is developer velocity in complex projects — proven by the 8–12× speedup in TypeScript 7.0. Its cost is added complexity and no runtime guarantees.
10:18
PostgreSQLUniversity of California Berkeley · 1996PostgreSQL is a free and open-source RDBMS that solves the problem of building reliable, scalable, and standards-compliant relational data systems without vendor lock-in. It emerged from Berkeley’s POSTGRES project in 1985 to address limitations in contemporary databases, especially Ingres’ lack of SQL support and type extensibility.
9:34
GitLab Inc.2011GitLab Inc. is a US-based open-core DevOps company founded in 2011 as an open-source project by Dmytro Zaporozhets and Sytse Sijbrandij. It evolved from a Ukrainian code-sharing platform into a global, all-remote corporation after incorporating in the US in June 2015 and completing YCombinator Winter 2015. Its freemium model bundles Git-based version control with access control, bug tracking, task management, and wikis—but key security and compliance capabilities remain paywalled. It reduces tool fragmentation but increases configuration burden and vendor dependence.
8:56
Jenkins (software)2011Jenkins is an open-source automation server that helps automate building, testing, and deploying software, enabling continuous integration and delivery. It originated as Hudson and was renamed in 2011 following a naming dispute with Oracle. The rename followed a community vote on January 29, 2011. Jenkins runs as a server-based system, either in servlet containers like Apache Tomcat or as a stand-alone web application using Eclipse Jetty. It supports multiple version control tools and build systems. The Pipeline plugin, which enables pipeline-as-code using Groovy, was not enabled by default until version 2 in 2016. Jenkins replaced Hudson in Eclipse in 2017.
Up next in Technology

Apache Kafka

LinkedIn · 2010 · 10:43

Kafka isn’t a streaming database—it’s a durable log you have to build everything else on top of.

10:43