technologybriefs
9:12in productionCh. 1 · File names only/ 9:12 · ceiling 15 min
Internet culture · Tech history

Search engine

Search engines don’t find truth — they map attention, then sell the map.

Search engines automate discovery across public web text. They work via crawling, indexing, and searching — a triad first unified by JumpStation in December 1993. Archie (1990) started with file names only. RankDex (1996) introduced hyperlink-based ranking. Google (1998) added paid search from goto.com. The mechanism delivers speed and scale, but obscures how relevance is defined — and increasingly ties visibility to advertising spend.

Internet cultureTech historyAlgorithmsComputingInformationAlgorithms across the network →
Chapters & takeaways4
  1. 0:58
    File names only

    Archie (1990) was the first tool to search content — not users — on the Internet, but only indexed FTP file names, not contents.

  2. 2:52
    The triad begins

    JumpStation (December 1993) was the first to combine crawling, indexing, and searching for the WWW — establishing the essential triad.

  3. 4:22
    Links as votes

    RankDex (1996) was the first algorithm to use hyperlinks to measure website quality — making links proxies for authority.

  4. 6:01
    Search becomes rent

    Google adopted paid search advertising in 1998 from goto.com — turning search results into a revenue channel.

Worth your time?

Yes. Study the whole thing.

4/ 5
What works
  • crawling
  • indexing
  • retrieval
What does not
  • index full web
  • understand meaning
  • guarantee relevance
Study it if
  • developers building discovery tools
  • researchers assessing digital archives
  • marketers optimising visibility
Skip it if
  • users seeking verifiable truth
  • archivists preserving unindexed material
  • regulators auditing ranking fairness
The written brief1 min read

What it is and the problem it solves

A search engine is a tool that locates publicly accessible web content by crawling, indexing, and retrieving it. It solves the problem of information scarcity in a growing, unstructured network — but only for content that is crawlable, indexable, and not blocked.

How it works

It works in three stages: crawling pages, indexing their content into inverted lists, and searching those indexes using ranking algorithms. Archie (1990) crawled FTP file names only. JumpStation (December 1993) was the first to combine all three stages for the WWW. RankDex (1996) introduced hyperlink-based ranking. Google (1998) added paid search advertising sourced from goto.com.

What works

The triad works: crawling discovers pages, indexing maps terms to locations, and searching retrieves matches. JumpStation (December 1993) proved the triad could operate on the WWW. WebCrawler (1994) confirmed full-text search was usable at scale. RankDex (1996) showed hyperlinks could improve ranking over keyword frequency alone.

What does not

It does not index the full web. It does not understand meaning. It does not guarantee relevance. Archie indexed file names only, not contents. Modern engines still omit large swathes — private databases, password-locked sites, dynamic pages — and treat all links as equal signals unless weighted by proprietary, undisclosed rules.

What it changes

It changes how authority is assigned online. RankDex (1996) made hyperlinks a proxy for quality. Google’s adoption of paid search (1998) made visibility a function of budget as well as link structure. The engine shifted from a discovery tool to an attention marketplace.

Is it worth your time

Yes — if you rely on finding information across distributed, unstructured public text. Its core triad remains necessary infrastructure. But its commercial evolution has prioritised ad revenue over precision, and its ranking logic is opaque, not neutral.

Same field · Internet culture4 of 23
9:22
Domain Name SystemPaul MockapetrisDNS is the distributed name-resolution system invented by Paul Mockapetris in 1983. It replaced the ARPAnet’s central hosts file. It uses a hierarchical zone model and originally ran over UDP. Later concerns about reliability, security, and privacy drove TCP use and protocol extensions. RFCs 882, 883, 973, 1034, and 1035 define its evolution. Mockapetris implemented the first version, 'Jeeves', for TOPS-20 the same year.
9:34
PeeringPeering is the voluntary, settlement-free exchange of downstream traffic between autonomous systems — instantiated by physical links and BGP, not contracts. It cuts transit costs and improves performance where traffic is reciprocal. But it offers no guarantees, scales poorly without coordination, and collapses instantly when mutual benefit ends. Its power lies in its simplicity — and its fragility.
10:26
Social mediaSocial media is not a product. It is a lineage: PLATO’s access-controlled forums (1960), ARPANET’s non-governmental traffic (late 1970s), Usenet’s open newsgroups (1980), BBS dial-up communities (1973–1978), the Web’s universal linking (1991), and SixDegrees.com’s real-name constraint (mid-1990s). Each layer solved part of the problem—persistent, searchable, identity-linked exchange—without solving the whole. The gap between PLATO’s design and SixDegrees.com’s execution reveals what social media actually is: a slow migration of control from institutions to corporations, with no resolution of moderation, privacy, or governance along the way.
10:55
MetaverseThe metaverse is a failed architectural ambition. Defined in 1992 as a single, universal, immersive virtual world enabled by VR/AR, it never materialised as promised. Second Life (2003) demonstrated a functional persistent 3D avatar world. Microsoft added VR avatars to Teams in 2017. Facebook launched Horizon Worlds in 2019. Meta committed publicly in 2021 — then pivoted to AI in February 2023. No interoperable standard dominates. Hardware remains costly and limiting. Engagement is low. The gap between vision and execution is total.
Up next in Technology

Wafer (electronics)

· 10:02

The wafer is not a component—it is the ground upon which computation is built, and its limits define what chips can do.

Play nextBack to Internet culture
10:02