In 1969, Minsky and others demonstrated that the sensor had limited capabilities in solving basic logical problems such as XOR. Government agencies gradually stopped funding, which directly caused the "cooling-off period" of the neural network for the next 10 years.
It wasn't until the 1980s that neural networks finally came to life. Hopfield, a physicist, published two papers on the study of artificial neural networks in 1982 and 1984, which proposed a new neural network that can solve a large class of pattern recognition problems and give an approximate solution to a class of combinatorial optimization problems. His research has caused a huge response, people re-acquainted with the power of neural networks and the practicality of putting them into practice. In 1985, many neural network scholars, such as Rumelhart and Hinton, successfully implemented the use of the "back propagation" BP algorithm to train the neural network[8], and used the BP as a dedicated algorithm for neural network training for a long time.
In 1995, Yann LeCun et al., inspired by the biovisual model, improved the Convolution Neural Network (CNN), which simulates a small number of cells in the visual cortex that are sensitive to specific areas of the visual field, individual nerve cells can respond only when the edges in a specific direction exist.) In a similar way, the computer can perform the image classification task (by searching for simple features at a lower level, such as edges and curves, and then using a series of convolutional layer to establish a more abstract concept). The best results are obtained at that time on small-scale issues such as handwriting recognition.
The third wave of artificial intelligence is distinctly different from the first two. Machine learning algorithms based on big data and powerful computing capabilities have made breakthroughs in a series of fields such as computer vision, voice recognition, and natural language processing, and applications based on artificial intelligence technologies have started to mature. At the same time, the impact of this round of AI development has gone far beyond the academic community.
Governments, enterprises, and non-profit organizations have started to embrace AI technologies. AlphaGo's victory over Li Shishi has made the public realize and understand AI. The third wave of artificial intelligence that we're on is just the beginning. Today, after the concept of artificial intelligence is put forward, the high-speed development of artificial intelligence has opened a curtain of a new era for us.
Ref : [1]