Saved
Semiconductors · AI

Graphics processing unit

The GPU didn’t accelerate graphics—it relocated computation, and in doing so, rewrote the rules of what a chip could be used for.

Worth your time?4.5/5Yes.Study the whole thing.What works, what does not, who it is for ↓
9:41in productionCh. 1 · Offloading the obvious/ 9:41 · ceiling 15 min
4 chapters · 9:41Ceiling 15:00

The brief is written and checked. The video joins this page when it is cut.4 chapters · 1 min read · 9:41 planned

Read the brief

The GPU is a specialised electronic circuit for digital image processing and computer graphics acceleration. It emerged in the 1990s with internal calculation capabilities—unlike earlier video display controllers and blitters—and evolved to support shaders, 3D functionality, and massively parallel computation. Its parallel architecture enabled adoption beyond graphics, notably in AI and scientific computing. The term 'GPU' was coined by Sony in 1994 for the PlayStation's Toshiba-designed chip.

Chapters & takeaways4
  1. 0:53
    Offloading the obvious

    The GPU emerged in the 1990s as a dedicated circuit to accelerate graphics—freeing the CPU from drawing lines, text, and later 3D scenes.

  2. 2:42
    Calculation, not copying

    Unlike earlier controllers, modern GPUs calculate internally—rotating 3D images, running shaders, and handling tasks that video display controllers and blitters could not.

  3. 3:56
    Many small engines

    Graphics tasks are independent by nature—so GPUs pack hundreds or thousands of simple calculation units to exploit that parallelism.

  4. 5:16
    From pixels to parameters

    That parallel structure made GPUs useful beyond graphics—especially in AI, where they handle data-intensive, embarrassingly parallel workloads.

1 more chapterFewer chapters
Worth your time?

Yes. Study the whole thing.

4.5/ 5
What works
  • offloading independent graphical calculations from the CPU
  • executing embarrassingly parallel workloads at high throughput
  • enabling real-time 3D rendering and AI model training on commodity hardware
What does not
  • replace general-purpose processors
  • handle serial or latency-sensitive tasks efficiently
  • simplify software development
Study it if
  • AI researchers
  • scientific computing teams
  • real-time 3D application developers
Skip it if
  • developers working primarily with event-driven web applications
  • embedded systems engineers with strict power budgets
  • teams maintaining legacy CPU-bound codebases without parallelisation capacity
Who should study it, and who should skipHide who it is for
The written brief1 min read

What it is and the problem it solves

A GPU is a specialised electronic circuit for digital image processing and computer graphics acceleration. It solves the problem of offloading independent, repetitive graphical calculations from the CPU—freeing it for system tasks while enabling richer visual output.

How it works

Modern GPUs contain hundreds or thousands of calculation units. They perform graphics tasks—like rotating and scaling 3D images—internally, without CPU help. They run custom shader programs. Unlike earlier video display controllers or blitters, they do more than move memory: they calculate.

What works

Graphics functions are independent—and thus suited to separate calculation engines. That independence enables massive parallelism. GPUs excel at embarrassingly parallel problems: matrix operations, pixel shading, neural network inference. Their adoption in AI stems directly from this trait—not from marketing or inevitability.

What does not

GPUs do not replace general-purpose processors. They cannot efficiently handle serial, branching, or latency-sensitive tasks. Their power comes at the cost of programming complexity, memory bandwidth asymmetry, and energy draw that scales with core count—not utility.

What it changes

GPUs changed where computation happens. They shifted massive parallel workloads from CPU clusters to single chips. They enabled real-time 3D rendering, accelerated AI model training, and turned consumer hardware into scientific instruments—without requiring new physics or materials.

Is it worth your time

Yes—if your work involves parallel computation on large datasets, especially in AI or scientific computing. The GPU’s architecture delivers throughput where CPUs stall. But it demands rethinking software design for parallelism, not just swapping hardware.

Same field · Semiconductors4 of 53
9:30
Mellanox Technologies1999Mellanox Technologies was an Israeli-American fabless semiconductor company founded in May 1999 in Yokneam Illit, with financial offices in Santa Clara. It specialised in high-speed, low-latency interconnects—primarily InfiniBand and Ethernet—delivering adapters, switches, software, cables and silicon for HPC, data centres, cloud, storage and financial services. Its products enabled RDMA and RDMA over Converged Ethernet. By 2011, its InfiniBand solutions were embedded in many TOP500 supercomputers. It expanded into Ethernet-based storage area networks from 2011. A $64 million venture round in 2002—backed by Intel, IBM, Sequoia Capital and U.S. Venture Partners—confirmed early market confidence. Nvidia acquired Mellanox for $6.9 billion in March 2019; the deal closed in April 2020 after antitrust approvals. Mellanox was integrated into Nvidia’s networking division, and the brand was discontinued for new products.
9:46
Application-specific integrated circuitASICs are custom silicon built for fixed tasks. They deliver unmatched efficiency but zero runtime adaptability. Their evolution—from 1974 CMOS gate arrays to modern SoCs—is defined by scale, not flexibility.
11:19
DDR5 SDRAMDDR5 delivers higher capacity, lower voltage, and scalable bandwidth—but not lower latency. Its gains depend on supporting infrastructure, not just the standard itself.
9:26
DDR4 SDRAM2012DDR4 SDRAM is a JEDEC-standardized memory technology finalised in September 2012 and released in 2014. It increases per-DIMM capacity to 64 GB, reduces voltage to 1.2 V, and introduces bank grouping to improve bandwidth concurrency—all while breaking full compatibility with DDR2 and DDR3. Its launch was phased: ECC-only in Q2 2014, non-ECC in Q3 2014. It does not use deeper prefetch; it relies on higher command rates and bank group isolation instead. Its value lies in capacity and efficiency scaling—not raw speed leaps or plug-and-play upgrade paths.
Up next in Technology

ASIMO

Honda · 12:34

ASIMO proved bipedal stair navigation was possible — then proved it wasn’t repeatable.

12:34