Deep Learning – important resources for learning and understanding
New and fundamental resources for learning about Deep Learning  the hottest machine learning method, which is approaching human performance level.
By Gregory Piatetsky,
@kdnuggets, Aug 21, 2014.
Deep Learning is the hottest machine learning method and it is very much in the news for achieving remarkable results. In the recent Large Scale Visual Recognition Challenge (results, NYTimes article), the accuracy has almost doubled (to 43.9% from 22.5%) and the error rate fell to only 6.6% from 11.7%.
Significantly, almost all of the entrants used a variant of an approach known as a convolutional neural network (ConvNet), an approach first refined in 1998 by Yann LeCun, NYU professor, recently hired to head Facebook AI Research Center.
Here are additional resources to learn more about Deep Learning and convolutional neural network
Book draft on DEEP LEARNING, by Yoshua Bengio, Ian Goodfellow and Aaron Courville
Software:
Yann LeCun talks, including
Fundamental papers on Deep Learning  from Quora answer by Yoshua Bengio.
Here are selected papers:
Excellent Introduction to Deep Learning: From Perceptrons to Deep Networks, by Ivan Vasilev at Toptal
Another excellent presentation Introduction to Parallel Iterative Deep Learning on Hadoop NextGeneration YARN Framework, by Adam Gibson and Josh Patterson.
Related:
Deep Learning is the hottest machine learning method and it is very much in the news for achieving remarkable results. In the recent Large Scale Visual Recognition Challenge (results, NYTimes article), the accuracy has almost doubled (to 43.9% from 22.5%) and the error rate fell to only 6.6% from 11.7%.
Significantly, almost all of the entrants used a variant of an approach known as a convolutional neural network (ConvNet), an approach first refined in 1998 by Yann LeCun, NYU professor, recently hired to head Facebook AI Research Center.
Here are additional resources to learn more about Deep Learning and convolutional neural network
 My post Where to Learn Deep Learning  Courses, Tutorials, Software
 KDnuggets Exclusive Interview with Yann LeCun, part 1, and Part 2
Book draft on DEEP LEARNING, by Yoshua Bengio, Ian Goodfellow and Aaron Courville
Software:
 cudaconvnet, a fast C++ implementation of convolutional (or more generally, feedforward) neural networks
 Matlab/Octave toolbox for deep learning.
 pylearn2 page on GitHub, a machine learning library in Python which has maxout code for Deep Learning
Yann LeCun talks, including
 Learning Feature Hierarchies for Vision
 Building Artificial Vision Systems with Machine Learning
 5 lectures at PCMI Summer school: Introduction, EnergyBased Learning, MultiStage Learning, Convolutional Networks, Unsupervised Deep Learning and more
Fundamental papers on Deep Learning  from Quora answer by Yoshua Bengio.
Here are selected papers:
 A fast learning algorithm for deep belief nets, by Geoff Hinton et al
 Training a deep autoencoder or a classifier on MNIST digits, code by Ruslan Salakhutdinov and Geoff Hinton
 Deep Boltzmann Machines, by by Ruslan Salakhutdinov and Geoff Hinton
 Learning Deep Boltzmann Machines , code by Ruslan Salakhutdinov
 Maxout Networks, by Ian Goodfellow et al
Excellent Introduction to Deep Learning: From Perceptrons to Deep Networks, by Ivan Vasilev at Toptal
Another excellent presentation Introduction to Parallel Iterative Deep Learning on Hadoop NextGeneration YARN Framework, by Adam Gibson and Josh Patterson.
Related:
Top Stories Past 30 Days

