Category: Pre-transformer systems

This category contains 6 pages.

• AlexNet · Krizhevsky, Sutskever, and Hinton's 2012 GPU-trained deep convolutional network whose runaway ILSVRC win (15.3 percent top-5 error) launched the deep learning era in computer vision.
• AlphaGo · DeepMind's Go system: deep policy and value networks guiding tree search, the first program to beat a Go professional (2015) and 4-1 winner over Lee Sedol in March 2016.
• AlphaZero · DeepMind's general self-play algorithm (2017) that mastered chess, shogi, and Go from the rules alone, defeating Stockfish, Elmo, and AlphaGo Zero without human data.
• ImageNet · The 14-million-image, WordNet-organized labeled dataset (2009) whose ILSVRC challenge (2010-2017) was the benchmark of the deep learning revolution, from AlexNet to ResNet.
• NETtalk · Sejnowski and Rosenberg's 1986 network that learned to pronounce English text by backpropagation, the parallel distributed processing era's most public demonstration that multi-layer networks could learn a realistic cognitive task.
• TD-Gammon · Gerald Tesauro's IBM backgammon program that taught itself master-level play by temporal-difference self-play, the first landmark success of reinforcement learning on a complex task.