Generative AI
Generative AI simulators
How models learn the shape of data and generate new samples from it.
The Data Manifold
Every 28 × 28 image is a point in a 784-dimensional space, yet real images of one kind lie on a thin curved sheet inside it. Walk the sheet, average two images, add noise and pull it back.
Open simulator→
Byte Pair Encoding
Glue the commonest pair of neighbouring symbols into one, over and over, and watch a vocabulary grow from bare letters into whole words.
Open simulator→
Autoregressive Models
A 40-word vocabulary with a probability for every word at every step, and temperature, top-k and top-p deciding which of them survive to be sampled.
Open simulator→