
Overfitting can be addressed with a range of techniques. Deep learning models can learn their training data really well, essentially they memorise the answers to questions and so when they are faced with questions they have not seen before they perform badly. A recurring theme is the problem of overfitting.

Machine learning is the process of un-crumpling the ball.Īs an introduction to the field Deep Learning in Python runs through some examples of deep learning applied to various classes of problem, including movie review sentiment analysis, classifying newswire articles and predicting house prices before going back to discuss some issues these problems raise. Imagine taking two pieces of coloured paper, placing them one on top of the other and then crumpling them into a ball. I liked Chollet’s description of machine learning (deep learning included) being about finding a representation of data which makes the problem at hand trivial to solve.

The book starts with some nice background to machine learning. This is a roundabout way of saying we should expect Chollet to be expert and authoritative in this area. Google is also the home of Tensorflow, a lower level library which is often used as a backend to Keras. Neural networks have been used in production since the 1990s – by the US postal service for reading handwritten zip codes.Ĭhollet works on artificial intelligence at Google and is the author of the Keras deep learning library. The area has boomed in the last few years with the availability of massive datasets on which to train, improvements in numerical algorithms for training neural networks and the use of GPUs to further accelerate deep learning. This is where the “deep” comes in – it refers to the numbers of layers in the networks. The biggest innovations I see from this book are in the use of pre-trained networks, and the dominance of the Keras/Tensorflow/Python ecosystem in doing deep learning.ĭeep learning is a type of artificial intelligence based on many-layered neural networks.

Despite these reviews only spanning a couple of years it feels like the area is moving on rapidly.

Deep learning with Python by Francois Chollet is the third book I have reviewed on deep learning neural networks.
