Saved
AI

Machine learning

Machine learning is not intelligence — it is applied statistics with memory.

Worth your time?4.5/5Yes.Study the whole thing.What works, what does not, who it is for ↓
9:09in productionCh. 1 · A name before the discipline/ 9:09 · ceiling 15 min
4 chapters · 9:09Ceiling 15:00

The brief is written and checked. The video joins this page when it is cut.4 chapters · 1 min read · 9:09 planned

Read the brief

Machine learning is statistical inference made operational. It works by minimising empirical risk over data, grounded in Hebbian plasticity and PAC theory. It succeeded first in games and signal analysis — not language or vision. Its cost is not compute, but representativeness: garbage in, bounded-error out.

Chapters & takeaways4
  1. 0:53
    A name before the discipline

    The term 'machine learning' was coined in 1959, but working programs existed in the 1950s — long before the field had a name.

  2. 2:39
    The maths is the machine

    Hebbian theory (1949) and mathematical optimisation are not inspirations — they are the operating system.

  3. 4:26
    Learning is approximate

    PAC learning defines what 'learning' means here: not perfection, but bounded error under uncertainty.

  4. 5:46
    Real-world signals, not just boards

    Cybertron (early 1960s) proved reinforcement learning could handle real-world signals — not just games.

1 more chapterFewer chapters
Worth your time?

Yes. Study the whole thing.

4.5/ 5
What works
  • pattern detection in structured signals (sonar, ECG, speech)
  • self-improving game play (checkers, 1950s)
  • modelling synaptic plasticity as weight updates
What does not
  • replace causal reasoning
  • guarantee generalisation outside the data distribution
  • eliminate need for domain knowledge
Study it if
  • data engineers
  • statisticians
  • software teams building adaptive systems
Skip it if
  • teams needing deterministic guarantees
  • those without access to clean, representative data
Who should study it, and who should skipHide who it is for
The written brief1 min read

What it is and the problem it solves

Machine learning is a field within AI focused on statistical algorithms that perform tasks without explicit programming. It solves the problem of automating decisions where rules are too complex, incomplete, or unknown to encode directly.

How it works

Machine learning uses statistical algorithms that learn from data and generalise to unseen data. It rests on statistics and mathematical optimisation. Most algorithms implement empirical risk minimisation. The PAC learning framework formalises generalisation.

What works

Algorithms trained on representative data reliably detect patterns in sonar, ECG, and speech. Checkers-playing programs from the 1950s demonstrated task performance via self-improvement. Hebbian theory (1949) correctly modelled how connection strength changes with data — a mechanism still used.

What does not

It does not eliminate the need for domain knowledge or careful problem framing. It does not guarantee generalisation outside the data distribution. It does not replace causal reasoning.

What it changes

It shifts AI from hand-coded logic to data-driven inference. It reorients software engineering toward data pipelines, evaluation metrics, and statistical validation instead of deterministic specification.

Is it worth your time

Yes — if your work involves pattern recognition in data, and you need tools grounded in probability and optimisation rather than symbolic rules. It demands fluency in data curation, not just coding.

Same field · AI4 of 20
10:06
Convolutional neural network1988CNNs solve image recognition by learning local, shared filters—cutting parameters, stabilising training, and replacing hand-crafted features. They work reliably on digit classification and scaled contest tasks—but demand data, compute, and architectural discipline. Not a universal solution. A specific, effective scaffold.
10:27
Backpropagation1970Backpropagation is a precise, narrow, and mechanically elegant solution to one computational bottleneck: gradient calculation in feedforward networks. It is neither AI nor learning—but the indispensable arithmetic that made both possible.
9:14
Vector databaseA vector database is a purpose-built system for storing and retrieving precomputed vector embeddings using approximate nearest neighbour search. It enables semantic similarity queries across text, images and audio — but only after those modalities have been independently vectorized. It does not generate meaning, infer intent or replace exact-match logic. Its value emerges only in hybrid retrieval stacks that combine it with metadata filters, lexical search or graph traversal. It is a tool — not an intelligence.
11:45
RobotaxiRobotaxis are operational SAE Level 4 or 5 autonomous vehicles deployed in ridesharing contexts since 2016. They have not achieved safety parity with humans, have incurred financial losses through 2025, and face severe public trust deficits. Their mechanism relies on real-time perception and AI decision-making — but their failure modes include road blocking, failure to yield, and fatal collisions. They represent a systems-level test of AI in public infrastructure — not a product ready for scale.
Up next in Technology

Magnetic tape

Fritz Pfleumer · 10:21

Magnetic tape didn’t invent audio fidelity—it invented audio logistics.

10:21