Deep Learning – important resources for learning and understanding

New and fundamental resources for learning about Deep Learning - the hottest machine learning method, which is approaching human performance level.

By Gregory Piatetsky, @kdnuggets, Aug 21, 2014.

Deep Learning is the hottest machine learning method and it is very much in the news for achieving remarkable results. In the recent Large Scale Visual Recognition Challenge (results, NYTimes article), the accuracy has almost doubled (to 43.9% from 22.5%) and the error rate fell to only 6.6% from 11.7%.

ConNet filters - Deep Learning Significantly, almost all of the entrants used a variant of an approach known as a convolutional neural network (ConvNet), an approach first refined in 1998 by Yann LeCun, NYU professor, recently hired to head Facebook AI Research Center.

Here are additional resources to learn more about Deep Learning and convolutional neural network
Book draft on DEEP LEARNING, by Yoshua Bengio, Ian Goodfellow and Aaron Courville

Yann LeCun talks, including
  • Learning Feature Hierarchies for Vision
  • Building Artificial Vision Systems with Machine Learning
  • 5 lectures at PCMI Summer school: Introduction, Energy-Based Learning, Multi-Stage Learning, Convolutional Networks, Unsupervised Deep Learning and more

Fundamental papers on Deep Learning - from Quora answer by Yoshua Bengio.

Here are selected papers:
Excellent Introduction to Deep Learning: From Perceptrons to Deep Networks, by Ivan Vasilev at Toptal

Another excellent presentation Introduction to Parallel Iterative Deep Learning on Hadoop Next​-Generation YARN Framework, by Adam Gibson and Josh Patterson.