Early ML & symbolic AI
Was there machine learning before the deep-learning era?
A second, quieter tradition let programs learn from data instead of from hand-written rules. It started in the 1950s but spent decades in the shadow of symbolic AI.
Alongside the rule-writing tradition ran a different idea: let the program learn from experience rather than be told every rule in advance. Arthur Samuel, working at IBM, is the clearest early example. He “coined the term machine learning in 1959,” and is “most known within the AI community for his groundbreaking work in computer checkers in 1959.”[1] His program got better by playing “thousands of games against itself,” which is recognizably the same idea behind modern learning systems.[1]
The other early learning thread was the perceptron, a simple model loosely inspired by a brain cell that adjusts itself from examples. This is where the two traditions collided. In 1969 Marvin Minsky and Seymour Papert published a book, Perceptrons: An Introduction to Computational Geometry, that proved sharp mathematical limits on what a single-layer perceptron could compute.[2]
The book’s reputation outran its math. It “is often thought to have caused a decline in neural net research in the 1970s and early 1980s.”[2] During that stretch, Wikipedia notes, “neural net researchers continued smaller projects outside the mainstream, while symbolic AI research saw explosive growth.”[2] The learning approach did not die; it waited. Its revival is the story of the next topic, the deep-learning revolution.
References
- Arthur Samuel (computer scientist) — Wikipedia
- Perceptrons (book) — Wikipedia