startshere.si Subscribe

Guide

Superintelligence, explained.

A plain introduction for people who are new to the subject. Ten minutes, no mathematics, sources at the end.

The short version

Superintelligence means an artificial system that performs far better than the most capable humans at virtually every intellectual task, including scientific research, planning and persuasion. No such system exists today. Whether one can be built, and when, is the most consequential open question in technology.

Three rungs on a ladder

  • Narrow AI does one kind of task, sometimes far better than people. A chess engine and a protein structure predictor are narrow systems.
  • Artificial general intelligence (AGI) would handle most intellectual work at the level of a capable person, across fields.
  • Superintelligence would go well past the human level across the board.

The difference between the last two is covered in AGI and superintelligence are two different claims.

How it could happen

Three routes are discussed seriously. The first is scale: today's methods keep improving as they are given more computing power, more data and better algorithms. The second is self-improvement: AI systems start doing AI research and speed up their own progress. The third is a new idea that nobody has had yet. The first two are explained in The three inputs and The intelligence explosion, six decades on.

When

Nobody knows. Informed forecasts range from a few years to many decades, and some researchers doubt it will happen at all. The spread is the finding. A reader should distrust any source that gives a single confident date.

Why it matters

A system that outperforms people at research could speed up medicine, energy and science by amounts that are hard to picture. The same capability, pointed at the wrong goal or controlled by too few people, could cause harm on the same scale. The field that works on making such systems do what is intended is called alignment. Start with Alignment is an engineering problem first.

Where to go next

Read the journal in order, keep the glossary open in another tab, and see the timeline for how the idea developed. Our own position is set out in the manifesto.

Questions people ask

Frequently asked

What is superintelligence in simple terms?

An artificial system that is much better than the best humans at practically every kind of thinking, from science to strategy. It is a hypothesis about the future. No system today meets the definition.

What is the difference between AI, AGI and superintelligence?

AI is the general field and includes narrow systems that do one task. AGI would match a capable person across most intellectual work. Superintelligence would greatly exceed the best people across the board.

Does superintelligence exist today?

No. Current systems are superhuman at some narrow tasks and uneven at others. They do not outperform the best humans across virtually all domains, which is what the term requires.

When will superintelligence arrive?

There is no agreed answer. Forecasts by informed people range from a few years to many decades, and some expect it never to happen. Treat any single confident date with caution.

What is an intelligence explosion?

The idea, first described by I. J. Good in 1965, that a machine able to design better machines would start a self-reinforcing cycle of improvement. It is also called recursive self-improvement.

Is superintelligence dangerous?

It could be. A very capable system pursuing a goal that differs slightly from what people intended could cause serious harm, and its capability would make mistakes harder to correct. Alignment research exists to reduce that risk.

What does .si stand for?

.si is the country-code top-level domain of Slovenia. On this site the two letters are read as Super Intelligence.