Neural Networks (463)

• An Overview of 3 Popular Courses on Deep Learning - Oct 13, 2017.
  
  After completing the 3 most popular MOOCS in deep learning from Fast.ai, deeplearning.ai/Coursera (which is not completely released) and Udacity, I believe a post about what you can expect from these 3 courses will be useful for future Deep learning enthusiasts.

  Andrew Ng, Coursera, Deep Learning, deeplearning.ai, fast.ai, Jeremy Howard, Neural Networks

• How I started with learning AI in the last 2 months - Oct 9, 2017.
  
  The relevance of a full stack developer will not be enough in the changing scenario of things. In the next two years, full stack will not be full stack without AI skills.

  AI, Chatbot, Gradient Descent, Neural Networks, Python

• Deep Learning for Object Detection: A Comprehensive Review - Oct 6, 2017.
  
  By the end of this post, we will hopefully have gained an understanding of how deep learning is applied to object detection, and how these object detection models both inspire and diverge from one another.

  Pages: 1 2

  Convolutional Neural Networks, Deep Learning, Image Recognition, Neural Networks

• A Guide For Time Series Prediction Using Recurrent Neural Networks (LSTMs) - Oct 5, 2017.
  
  Looking at the strengths of a neural network, especially a recurrent neural network, I came up with the idea of predicting the exchange rate between the USD and the INR.

  Pages: 1 2

  Finance, LSTM, Neural Networks, Recurrent Neural Networks, Statsbot

• Neural Networks: Innumerable Architectures, One Fundamental Idea - Oct 4, 2017.
  
  At the end of this post, you’ll be able to implement a neural network to identify handwritten digits using the MNIST dataset and have a rough time idea about how to build your own neural networks.

  Pages: 1 2

  AI, Machine Learning, Neural Networks, Python, TensorFlow

• Understanding Machine Learning Algorithms - Oct 3, 2017.
  
  Machine learning algorithms aren’t difficult to grasp if you understand the basic concepts. Here, a SAS data scientist describes the foundations for some of today’s popular algorithms.

  Algorithms, Ensemble Methods, Gradient Boosting, Machine Learning, Neural Networks, Predictive Analytics, random forests algorithm, SVM

• Key Takeaways from AI Conference in San Francisco 2017 – Day 2 - Oct 2, 2017.
  
  Highlights and key takeaways from day 2 of AI Conference San Francisco 2017, including current state review, future trends, and top recommendations for AI initiatives.

  Pages: 1 2

  AI, CA, Conference, Deep Learning, Genomics, Michael Jordan, Microsoft, Neural Networks, O'Reilly, San Francisco

• Keras Cheat Sheet: Deep Learning in Python - Sep 27, 2017.
  
  Keras is a Python deep learning library for Theano and TensorFlow. The package is easy to use and powerful, as it provides users with a high-level neural networks API to develop and evaluate deep learning models.

  Pages: 1 2

  Cheat Sheet, DataCamp, Deep Learning, Keras, Neural Networks, Python

• The Search for the Fastest Keras Deep Learning Backend - Sep 26, 2017.
  
  This is an overview of the performance comparison for the popular Deep Learning frameworks supported by Keras – TensorFlow, CNTK, MXNet and Theano.

  Pages: 1 2

  CNTK, Deep Learning, Keras, Machine Learning, MXNet, Neural Networks, TensorFlow, Theano

• 30 Essential Data Science, Machine Learning & Deep Learning Cheat Sheets - Sep 22, 2017.
  
  This collection of data science cheat sheets is not a cheat sheet dump, but a curated list of reference materials spanning a number of disciplines and tools.

  Pages: 1 2 3

  Cheat Sheet, Data Science, Deep Learning, Machine Learning, Neural Networks, Probability, Python, R, SQL, Statistics

• Tensorflow Tutorial: Part 1 – Introduction - Sep 21, 2017.
  
  Everyone is talking about Tensorflow these days. In this multipart series, we explain Tensorflow in detail, including it’s architecture and industry applications.

  Deep Learning, Deep Neural Network, Machine Learning, Neural Networks, TensorFlow

• 5 Ways to Get Started with Reinforcement Learning - Sep 20, 2017.
  
  We give an accessible overview of reinforcement learning, including Deep Q Learning, and provide useful links for implementing RL.

  Deep Learning, Machine Learning, Neural Networks, Reinforcement Learning

• Keras Tutorial: Recognizing Tic-Tac-Toe Winners with Neural Networks - Sep 18, 2017.
  
  In this tutorial, we will build a neural network with Keras to determine whether or not tic-tac-toe games have been won by player X for given endgame board configurations. Introductory neural network concerns are covered.

  Games, Keras, Neural Networks, Python

• Neural Network Foundations, Explained: Activation Function - Sep 13, 2017.
  
  This is a very basic overview of activation functions in neural networks, intended to provide a very high level overview which can be read in a couple of minutes. This won't make you an expert, but it will give you a starting point toward actual understanding.

  Explained, Neural Networks

• Object Detection: An Overview in the Age of Deep Learning - Sep 13, 2017.
  
  Like many other computer vision problems, there still isn’t an obvious or even “best” way to approach the problem of object recognition, meaning there’s still much room for improvement.

  Pages: 1 2

  Computer Vision, Convolutional Neural Networks, Deep Learning, Image Recognition, Neural Networks, Object Detection, YOLO

• New Breakthroughs from DeepMind – Relational Networks and Visual Interaction Networks - Sep 12, 2017.
  
  Such relational intelligence separates artificial intelligence systems with human cognition. DeepMind, the creators of AlphaGo, quietly published two groundbreaking research papers into this area, demonstrating a way to train relational reasoning using deep neural networks.

  Deep Learning, DeepMind, Neural Networks

• Top /r/MachineLearning Posts, August: Andrew Ng is back at it; Reinforcement Learning makes a splash; Fixing your ANN - Sep 8, 2017.
  
  Andrew Ng announces new Deep Learning specialization on Coursera; DeepMind and Blizzard open StarCraft II as an AI research environment; OpenAI bot beat best Dota 2 players in 1v1 at The International 2017; My Neural Network isn't working! What should I do?; Deep Learning Neural Networks Play Path of Exile

  Andrew Ng, Coursera, Deep Learning, deeplearning.ai, DeepMind, Neural Networks, OpenAI, Reddit, Reinforcement Learning

• Detecting Facial Features Using Deep Learning - Sep 4, 2017.
  
  A challenging task in the past was detection of faces and their features like eyes, nose, mouth and even deriving emotions from their shapes. This task can be now “magically” solved by deep learning and any talented teenager can do it in a few hours.

  Convolutional Neural Networks, Deep Learning, Image Recognition, Neural Networks

• Top KDnuggets tweets, Aug 23-29: Python overtakes R, becomes the leader in #DataScience, #MachineLearning; I built a #chatbot in 2 hours - Aug 30, 2017.
  
  Also: Recommendation System Algorithms Overview; The Connection Between #DataScience, #MachineLearning and #AI; The Ultimate Guide to Basic Data Cleaning.

  Chatbot, Neural Networks, Python vs R, Recommender Systems, Top tweets

• PyTorch or TensorFlow? - Aug 29, 2017.
  
  PyTorch is better for rapid prototyping in research, for hobbyists and for small scale projects. TensorFlow is better for large-scale deployments, especially when cross-platform and embedded deployment is a consideration.

  Deep Learning, Neural Networks, PyTorch, TensorFlow

• An Intuitive Guide to Deep Network Architectures - Aug 28, 2017.
  
  How and why do different Deep Learning models work? We provide an intuitive explanation for 3 very popular DL models: Resnet, Inception, and Xception.

  Pages: 1 2

  Deep Learning, Keras, Neural Networks

• 37 Reasons why your Neural Network is not working - Aug 22, 2017.
  
  Over the course of many debugging sessions, I’ve compiled my experience along with the best ideas around in this handy list. I hope they would be useful to you.

  Pages: 1 2

  Data Engineering, Data Preparation, Gradient Descent, Neural Networks

• Deep Learning and Neural Networks Primer: Basic Concepts for Beginners - Aug 18, 2017.
  
  This is a collection of introductory posts which present a basic overview of neural networks and deep learning. Start by learning some key terminology and gaining an understanding through some curated resources. Then look at summarized important research in the field before looking at a pair of concise case studies.

  Deep Learning, Neural Networks

• First Steps of Learning Deep Learning: Image Classification in Keras - Aug 16, 2017.
  
  Whether you want to start learning deep learning for you career, to have a nice adventure (e.g. with detecting huggable objects) or to get insight into machines before they take over, this post is for you!

  Pages: 1 2

  Deep Learning, Image Recognition, Keras, Neural Networks

• Explore The Future of Deep Learning with @teamrework - Aug 15, 2017.
  
  Until recently, deep learning alluded to the big names in tech such as Amazon, Facebook, and Google as having a clear use for these tools. Whilst these are some of the key players in AI and DL implementation, there are also huge advantages for their applications in businesses and everyday enterprises.

  AI, Deep Learning, London, Neural Networks, RE.WORK, UK, Virtual Assistant

• DeepMind Relational Reasoning Networks  Demystified - Aug 15, 2017.
  
  Every time DeepMind publishes a new paper, there is frenzied media coverage around it. We examine what is and is not real in recent work described as “DeepMind Neural Network Can Make Sense of Objects Around It”.

  AI, Deep Learning, DeepMind, LSTM, Neural Networks

• Top /r/MachineLearning Posts, July: Friendly Suggestions re: Coding Practices; Racist AI How-To Without Really Trying - Aug 10, 2017.
  
  Why can't you guys comment your f*cking code?; Train Chrome's Trex character to play independently; How to make a racist AI without really trying; Is training a NN to mimic a closed-source library legal?; 37 Reasons why your NN is not working

  AI, Machine Learning, Neural Networks, Programming, Reddit

• How Convolutional Neural Networks Accomplish Image Recognition? - Aug 9, 2017.
  
  Image recognition is very interesting and challenging field of study. Here we explain concepts, applications and techniques of image recognition using Convolutional Neural Networks.

  Clarifai, Convolutional Neural Networks, IBM Watson, Image Recognition, Neural Networks

• Mind Reading: Using Artificial Neural Nets to Predict Viewed Image Categories From EEG Readings - Aug 9, 2017.
  
  This post outlines the approach taken at a recent deep learning hackathon, hosted by YCombinator-backed startup DeepGram. The dataset: EEG readings from a Stanford research project that predicted which category of images their test subjects were viewing using linear discriminant analysis.

  Brain, Convolutional Neural Networks, Deep Learning, Neural Networks, SVDS

• Train your Deep Learning Faster: FreezeOut - Aug 3, 2017.
  
  We explain another novel method for much faster training of Deep Learning models by freezing the intermediate layers, and show that it has little or no effect on accuracy.

  Deep Learning, Machine Learning, Model Performance, Modeling, Neural Networks

• Top KDnuggets tweets, Jul 26 – Aug 01: 37 Reasons why your #NeuralNetwork is not working; Machine Learning Exercises in Python - Aug 2, 2017.
  
  Also Hill criteria for #causality vs #correlation via #xkcd cartoons; #MachineLearning Workflows in #Python from Scratch Part 2: k-means Clustering

  Causation, Machine Learning, Neural Networks, Python, TensorFlow, Top tweets

• Visualizing Convolutional Neural Networks with Open-source Picasso - Aug 1, 2017.
  
  Toolkits for standard neural network visualizations exist, along with tools for monitoring the training process, but are often tied to the deep learning framework. Could a general, easy-to-setup tool for generating standard visualizations provide a sanity check on the learning process?

  Convolutional Neural Networks, Neural Networks, Open Source, Visualization

• Introduction to Neural Networks, Advantages and Applications - Jul 25, 2017.
  
  Artificial Neural Network (ANN) algorithm mimic the human brain to process information. Here we explain how human brain and ANN works.

  Pages: 1 2

  Applications, Beginners, Brain, Neural Networks

• Summary of Unintuitive Properties of Neural Networks - Jul 24, 2017.
  
  Neural networks work really well on many problems, including language, image and speech recognition. However understanding how they work is not simple, and here is a summary of unusual and counter intuitive properties they have.

  AI, Deep Learning, Hugo Larochelle, Neural Networks

• Picking an Optimizer for Style Transfer - Jul 21, 2017.
  
  Gradient Descent, Adam or Limited-memory Broyden–Fletcher–Goldfarb–Shanno? Which will optimize your style transfer neural network faster and better? Read this post for a data-backed discussion.

  Art, Convolutional Neural Networks, Deep Learning, Neural Networks

• Deep Learning, AI Assistant Summits London feature DeepMind and much more, Sep 21-22 – KDnuggets Offer - Jul 20, 2017.
  
  The Deep Learning Summit London and the AI Assistant Summit London will be continuing the RE•WORK Global Summit Series this September 21 & 22. Early Bird discount is ending on July 28th. Register now to guarantee a spot at the Summit and use the discount code KDNUGGETS to save 20% on all tickets.

  AI, Chatbot, Deep Learning, Machine Learning, Neural Networks, RE.WORK, Virtual Assistant

• Design by Evolution: How to evolve your neural network with AutoML - Jul 20, 2017.
  
  The gist ( tl;dr): Time to evolve! I’m gonna give a basic example (in PyTorch) of using evolutionary algorithms to tune the hyper-parameters of a DNN.

  Pages: 1 2 3

  Algorithms, Architecture, Automated Machine Learning, AutoML, Genetic Algorithm, Neural Networks, PyTorch

• 5 Free Resources for Getting Started with Deep Learning for Natural Language Processing - Jul 19, 2017.
  
  This is a collection of 5 deep learning for natural language processing resources for the uninitiated, intended to open eyes to what is possible and to the current state of the art at the intersection of NLP and deep learning. It should also provide some idea of where to go next.

  Deep Learning, Natural Language Processing, Neural Networks, NLP

• Are Most Machine Learning Experts Turning to Deep Learning? - Jul 18, 2017.
  
  Read a short opinion on what the impact of machine learning researchers focusing on deep learning will be.

  Deep Learning, Machine Learning, Neural Networks

• Top KDnuggets tweets, Jul 05-11: 10 Free Must-Read Books for #MachineLearning and #DataScience; Why AI and Machine Learning? - Jul 12, 2017.
  
  Also great overview: Unintuitive properties of #NeuralNetworks; #Apache #Flink vs #Spark: The Strange Loop in #DeepLearning - the coolest idea in #MachineLearning in 20 yrs;

  Deep Learning, Flink, Free ebook, Machine Learning, Neural Networks, Top tweets

• Medical Image Analysis with Deep Learning , Part 4 - Jul 11, 2017.
  
  This is the fourth installment of this series, and covers medical images and their components, medical image formats and their format conversions. The goal is to develop knowledge to help us with our ultimate goal — medical image analysis with deep learning.

  Deep Learning, Image Recognition, Medical, Neural Networks

• The Strange Loop in Deep Learning - Jul 11, 2017.
  
  This ‘strange loop’ is in fact is the fundamental reason for what Yann LeCun describes as “the coolest idea in machine learning in the last twenty years.”

  Deep Learning, Neural Networks, Yann LeCun

• Applying Deep Learning to Real-world Problems - Jun 30, 2017.
  
  In this blog post I shared three learnings that are important to us at Merantix when applying deep learning to real-world problems. I hope that these ideas are helpful for other people who plan to use deep learning in their business.

  Balancing Classes, Deep Learning, Neural Networks, Training, Unbalanced

• Using the TensorFlow API: An Introductory Tutorial Series - Jun 28, 2017.
  
  This post summarizes and links to a great multi-part tutorial series on learning the TensorFlow API for building a variety of neural networks, as well as a bonus tutorial on backpropagation from the beginning.

  API, Deep Learning, LSTM, Neural Networks, Recurrent Neural Networks, TensorFlow

• Deep Learning with R + Keras - Jun 27, 2017.
  
  Keras has grown in popularity and supported on a wide set of platforms including Tensorflow, CNTK, Apple’s CoreML, and Theano. It is becoming the de factor language for deep learning.

  Deep Learning, Keras, Neural Networks, R

• Taxonomy of Methods for Deep Meta Learning - Jun 22, 2017.
  
  This post discusses a variety of contemporary Deep Meta Learning methods, in which meta-data is manipulated to generate simulated architectures. Current meta-learning capabilities involve either support for search for architectures or networks inside networks.

  Architecture, Deep Learning, Neural Networks

• Understanding Deep Learning Requires Re-thinking Generalization - Jun 16, 2017.
  
  What is it that distinguishes neural networks that generalize well from those that don’t? A satisfying answer to this question would not only help to make neural networks more interpretable, but it might also lead to more principled and reliable model architecture design.

  Deep Learning, Machine Learning, Neural Networks

• Medical Image Analysis with Deep Learning , Part 3 - Jun 15, 2017.
  
  In this article we will focus — basic deep learning using Keras and Theano. We will do 2 examples one using keras for basic predictive analytics and other a simple example of image analysis using VGG.

  Deep Learning, Image Recognition, Medical, Neural Networks

• Deep Learning Papers Reading Roadmap - Jun 13, 2017.
  
  The roadmap is constructed in accordance with the following four guidelines: from outline to detail; from old to state-of-the-art; from generic to specific areas; focus on state-of-the-art.

  Deep Learning, Neural Networks

• Top /r/MachineLearning Posts, May: Deep Image Analogy; Stylized Facial Animations; Google Open Sources Sketch-RNN - Jun 9, 2017.
  
  Deep Image Analogy; Example-Based Synthesis of Stylized Facial Animations; Google releases dataset of 50M vector drawings, open sources Sketch-RNN implementation; New massive medical image dataset coming from Stanford; Everything that Works Works Because it's Bayesian: Why Deep Nets Generalize?

  Deep Learning, Google, Machine Learning, Neural Networks, Reddit

• Why Does Deep Learning Not Have a Local Minimum? - Jun 2, 2017.
  
  "As I understand, the chance of having a derivative zero in each of the thousands of direction is low. Is there some other reason besides this?"

  Deep Learning, Neural Networks

• An Introduction to the MXNet Python API  - May 26, 2017.
  
  This post outlines an entire 6-part tutorial series on the MXNet deep learning library and its Python API. In-depth and descriptive, this is a great guide for anyone looking to start leveraging this powerful neural network library.

  API, AWS, Deep Learning, Neural Networks, Python

• The Two Phases of Gradient Descent in Deep Learning - May 12, 2017.
  
  In short, you reach different resting placing with different SGD algorithms. That is, different SGDs just give you differing convergence rates due to different strategies, but we do expect that they all end up at the same results!

  Deep Learning, ICLR, Neural Networks

• Top 10 Recent AI videos on YouTube - May 10, 2017.
  
  Top viewed videos on artificial intelligence since 2016 include great talks and lecture series from MIT and Caltech, Google Tech Talks on AI.

  AI, Google, Machine Learning, MIT, Neural Networks, NVIDIA, Robots, Youtube

• Using Deep Learning To Extract Knowledge From Job Descriptions - May 9, 2017.
  
  We present a deep learning approach to extract knowledge from a large amount of data from the recruitment space. A learning to rank approach is followed to train a convolutional neural network to generate job title and job description embeddings.

  Convolutional Neural Networks, Deep Learning, Natural Language Processing, Neural Networks, NLP, Text Mining

• Building, Training, and Improving on Existing Recurrent Neural Networks - May 8, 2017.
  
  In this post, we’ll provide a short tutorial for training a RNN for speech recognition, including code snippets throughout.

  Deep Learning, Neural Networks, Recurrent Neural Networks, SVDS

• Top 10 Machine Learning Videos on YouTube, updated - May 3, 2017.
  
  The top machine learning videos on YouTube include lecture series from Stanford and Caltech, Google Tech Talks on deep learning, using machine learning to play Mario and Hearthstone, and detecting NHL goals from live streams.

  Andrew Ng, Computer Vision, Deep Learning, Geoff Hinton, Google, Machine Learning, Neural Networks, Robots, Video Games, Yaser Abu-Mostafa, Youtube

• KDnuggets™ News 17:n17, May 3: Learn Machine Learning… in 10 Days?!? Gradient Descent, Simplified - May 3, 2017.
  
  How to Learn Machine Learning in 10 Days; Keep it simple! How to understand Gradient Descent algorithm; The Guerrilla Guide to Machine Learning with Python; What Data You Analyzed - KDnuggets Poll Results and Trends; Cartoon: Machine Learning - What They Think I Do

  Gradient Descent, Machine Learning, Neural Networks, Poll, Python, TensorFlow

• Deep Learning – Past, Present, and Future - May 2, 2017.
  
  There is a lot of buzz around deep learning technology. First developed in the 1940s, deep learning was meant to simulate neural networks found in brains, but in the last decade 3 key developments have unleashed its potential.

  Pages: 1 2

  Andrew Ng, Big Data, Deep Learning, Geoff Hinton, Google, GPU, History, Neural Networks, NVIDIA

• One Deep Learning Virtual Machine to Rule Them All - Apr 28, 2017.
  
  The frontend code of programming languages only needs to parse and translate source code to an intermediate representation (IR). Deep Learning frameworks will eventually need their own “IR.”

  Deep Learning, Neural Networks

• How to Build a Recurrent Neural Network in TensorFlow - Apr 26, 2017.
  
  This is a no-nonsense overview of implementing a recurrent neural network (RNN) in TensorFlow. Both theory and practice are covered concisely, and the end result is running TensorFlow RNN code.

  Deep Learning, Neural Networks, Recurrent Neural Networks, TensorFlow

• Awesome Deep Learning: Most Cited Deep Learning Papers - Apr 21, 2017.
  
  This post introduces a curated list of the most cited deep learning papers (since 2012), provides the inclusion criteria, shares a few entry examples, and points to the full listing for those interested in investigating further.

  Deep Learning, Neural Networks, Research

• Negative Results on Negative Images: Major Flaw in Deep Learning? - Apr 20, 2017.
  
  This is an overview of recent research outlining the limitations of the capabilities of image recognition using deep neural networks. But should this really be considered a "limitation?"

  Deep Learning, Image Recognition, Neural Networks

• Medical Image Analysis with Deep Learning , Part 2 - Apr 13, 2017.
  
  In this article we will talk about basics of deep learning from the lens of Convolutional Neural Nets. We plan to use this knowledge to build CNNs in the next post and use Keras to develop a model to predict lung cancer.

  Convolutional Neural Networks, Deep Learning, Image Recognition, Medical, Neural Networks

• 5 Machine Learning Projects You Can No Longer Overlook, April - Apr 13, 2017.
  
  It's about that time again... 5 more machine learning or machine learning-related projects you may not yet have heard of, but may want to consider checking out. Find tools for data exploration, topic modeling, high-level APIs, and feature selection herein.

  Data Exploration, Deep Learning, Java, Machine Learning, Neural Networks, Overlook, Python, Scala, scikit-learn, Topic Modeling

• Medical Image Analysis with Deep Learning  - Apr 6, 2017.
  
  In this article, I start with basics of image processing, basics of medical image format data and visualize some medical data.

  Deep Learning, Image Recognition, Medical, Neural Networks

• Deep Learning, Generative Adversarial Networks  & Boxing – Toward a Fundamental Understanding - Mar 28, 2017.
  
  In this post we will see why GANs have so much potential, and frame GANs as a boxing match between two opponents.

  Deep Learning, Generative Adversarial Network, Neural Networks

• Cooperative Trust Among Neural Networks Drives Deeper Learning - Feb 28, 2017.
  
  Machine learning developers need to model a growing range of multi-partner scenarios where many learning agents and data sources interact under varying degrees of trustworthiness. This IBM site helps to take next step towards continuous intelligence.

  IBM, Machine Learning, Neural Networks, Trust

• An Overview of Python Deep Learning Frameworks - Feb 27, 2017.
  
  Read this concise overview of leading Python deep learning frameworks, including Theano, Lasagne, Blocks, TensorFlow, Keras, MXNet, and PyTorch.

  Deep Learning, Keras, Neural Networks, Python, TensorFlow, Theano, Torch

• The Anatomy of Deep Learning Frameworks - Feb 24, 2017.
  
  This post sketches out some common principles which would help you better understand deep learning frameworks, and provides a guide on how to implement your own deep learning framework as well.
   

  Deep Learning, Neural Networks

• The Gentlest Introduction to Tensorflow – Part 4 - Feb 22, 2017.
  
  This post is the fourth entry in a series dedicated to introducing newcomers to TensorFlow in the gentlest possible manner, and focuses on logistic regression for classifying the digits of 0-9.

  Beginners, Deep Learning, Machine Learning, Neural Networks, TensorFlow

• The Gentlest Introduction to Tensorflow – Part 3 - Feb 21, 2017.
  
  This post is the third entry in a series dedicated to introducing newcomers to TensorFlow in the gentlest possible manner. This entry progresses to multi-feature linear regression.

  Beginners, Deep Learning, Machine Learning, Neural Networks, Regression, TensorFlow

• Turbo Charge Agile Processes with Deep Learning - Feb 7, 2017.
  
  The key to leveraging Deep Learning, or more broadly AI, in the workplace is to understand where it fits within an agile development environment.

  Agile, Deep Learning, Neural Networks, Software Engineering

• Top arXiv Papers, January: ConvNets Advances, Wide Instead of Deep, Adversarial Networks Win, Learning to Reinforcement Learn - Feb 3, 2017.
  
  Check out the top arXiv Papers from January, covering convolutional neural network advances, why wide may trump deep, generative adversarial networks, learning to reinforcement learn, and more.

  Adversarial, arXiv, Convolutional Neural Networks, Deep Learning, GANs, Neural Networks, Reinforcement Learning

• Deep Learning Research Review: Natural Language Processing - Jan 31, 2017.
  
  This edition of Deep Learning Research Review explains recent research papers in Natural Language Processing (NLP). If you don't have the time to read the top papers yourself, or need an overview of NLP with Deep Learning, this post is for you.

  Pages: 1 2 3

  Deep Learning, Natural Language Processing, Neural Networks, NLP

• Creating Curious Machines: Building Information-seeking Agents - Jan 24, 2017.
  
  Researchers at Maluuba are developing ways to teach artificial agents how to seek information actively, by asking questions. This includes a deep neural agent that learns to accomplish these tasks through efficient information-seeking behaviour, a vital step towards Artificial General Intelligence.

  Agents, AI, Deep Learning, Machine Intelligence, Maluuba, Neural Networks

• Deep Learning Can be Applied to Natural Language Processing - Jan 16, 2017.
  
  This post is a rebuttal to a recent article suggesting that neural networks cannot be applied to natural language given that language is not a produced as a result of continuous function. The post delves into some additional points on deep learning as well.

  Deep Learning, Natural Language Processing, Neural Networks, NLP

• The Major Advancements in Deep Learning in 2016 - Jan 5, 2017.
  
  Get a concise overview of the major advancements observed in deep learning over the past year.

  Deep Learning, Generative Adversarial Network, Neural Networks

• Generative Adversarial Networks – Hot Topic in Machine Learning - Jan 3, 2017.
  
  What is Generative Adversarial Networks (GAN) ? A very illustrative explanation of GAN is presented here with simple examples like predicting next frame in video sequence or predicting next word while typing in google search.

  Deep Learning, Generative Adversarial Network, Machine Learning, Neural Networks, NIPS

• 5 Machine Learning Projects You Can No Longer Overlook, January - Jan 2, 2017.
  
  There are a lot of popular machine learning projects out there, but many more that are not. Which of these are actively developed and worth checking out? Here is an offering of 5 such projects, the most recent in an ongoing series.
   
   

  Boosting, C++, Data Preparation, Decision Trees, Machine Learning, Neural Networks, Optimization, Overlook, Pandas, Python, scikit-learn

• ResNets, HighwayNets, and DenseNets, Oh My! - Dec 19, 2016.
  
  This post walks through the logic behind three recent deep learning architectures: ResNet, HighwayNet, and DenseNet. Each make it more possible to successfully trainable deep networks by overcoming the limitations of traditional network design.

  Convolutional Neural Networks, Deep Learning, Neural Networks

• Deep Learning Works Great Because the Universe, Physics and the Game of Go are Vastly Simpler than Prior Models and Have Exploitable Patterns - Dec 16, 2016.
  
  How is Deep Learning experiencing such success solving complex problems? Deep Learning is useful and powerful but it is also that the problems were not as big or as hard as researchers feared when they were unsolved.

  Deep Learning, DeepMind, Neural Networks, Physics

• KDnuggets™ News 16:n44, Dec 14: Key Data Science 2016 Events, 2017 Trends; Where Data Science was applied; Bayesian Basics - Dec 14, 2016.
  
  Data Science, Predictive Analytics Main Developments in 2016, Key Trends in 2017; Where Analytics, Data Mining, Data Science were applied in 2016; Bayesian Basics, Explained; Data Science Trends To Look Out For In 2017; Artificial Neural Networks (ANN) Introduction

  2017 Predictions, Bayesian, Big Data, Data Science, Neural Networks, Poll

• Artificial Neural Networks (ANN) Introduction, Part 2 - Dec 9, 2016.
  
  Matching the performance of a human brain is a difficult feat, but techniques have been developed to improve the performance of neural network algorithms, 3 of which are discussed in this post: Distortion, mini-batch gradient descent, and dropout.

  Algobeans, Deep Learning, Neural Networks

• Artificial Neural Networks (ANN) Introduction, Part 1 - Dec 8, 2016.
  
  This intro to ANNs will look at how we can train an algorithm to recognize images of handwritten digits. We will be using the images from the famous MNIST (Mixed National Institute of Standards and Technology) database.

  Algobeans, Image Recognition, MNIST, Neural Networks

• Top KDnuggets tweets, Nov 30 – Dec 06: A great and useful collection of minimal and clean implementations of #MachineLearning algorithms - Dec 7, 2016.
  
  Also: #MachineLearning Yearning book draft, Free Download, by Andrew Ng; A short guide to learn #NeuralNets, and maybe get famous and rich with #DeepLearning; Free Book: Foundations of Computer Science, Aho & Ullman.

  Andrew Ng, Free ebook, Machine Learning, Neural Networks, Top tweets

• The hard thing about deep learning - Dec 1, 2016.
  
  It’s easy to optimize simple neural networks, let’s say single layer perceptron. But, as network becomes deeper, the optmization problem becomes crucial. This article discusses about such optimization problems with deep neural networks.

  CA, Deep Learning, Neural Networks, NP-hard, Optimization, San Jose, Strata

• Deep Learning Reading Group: Skip-Thought Vectors - Nov 17, 2016.
  
  Skip-thought vectors take inspiration from Word2Vec skip-gram and attempt to extend it to sentences, and are created using an encoder-decoder model. Read on for an overview of the paper.

  Deep Learning, Lab41, Natural Language Processing, Neural Networks, word2vec

• An Intuitive Explanation of Convolutional Neural Networks - Nov 11, 2016.
  
  This article provides a easy to understand introduction to what convolutional neural networks are and how they work.

  Pages: 1 2 3

  Convolutional Neural Networks, Deep Learning, Explanation, Machine Learning, Neural Networks

• A Quick Introduction to Neural Networks - Nov 9, 2016.
  
  This article provides a beginner level introduction to multilayer perceptron and backpropagation.

  Pages: 1 2 3

  Backpropagation, Deep Learning, Machine Learning, Neural Networks

• Deep Learning cleans podcast episodes from ‘ahem’ sounds - Nov 8, 2016.
  
  “3.5 mm audio jack… Ahem!!” where did you hear that? ;) Well, this post is not about Google Pixel vs iPhone 7, but how to remove ugly “Ahem” sound from a speech using deep convolutional neural network. I must say, very interesting read.

  Convolutional Neural Networks, Deep Learning, Deep Neural Network, Neural Networks, Podcast, Speech

• Top /r/MachineLearning Posts, October: NSFW Image Recognition, Differentiable Neural Computers, Hinton on Coursera - Nov 4, 2016.
  
  NSFW Image Recognition, Differentiable Neural Computers, Hinton's Neural Networks for Machine Learning Coursera course; Introducing the AI Open Network; Making a Self-driving RC Car

  DeepMind, Geoff Hinton, Image Recognition, Machine Learning, Neural Networks, Reddit, Self-Driving Car

• KDnuggets™ News 16:n38, Oct 26: Free Machine Learning EBooks; Neural Networks in Python with Scikit-learn - Oct 26, 2016.
  
  5 EBooks to Read Before Getting into A Machine Learning Career; A Beginner's Guide to Neural Networks with Python and Scikit-learn 0.18!; New Poll: What was the largest dataset you analyzed / data mined?; Jupyter Notebook Best Practices for Data Science

  Free ebook, Machine Learning, Neural Networks, Poll, Python, scikit-learn

• A Beginner’s Guide to Neural Networks with Python and SciKit Learn 0.18! - Oct 20, 2016.
  
  This post outlines setting up a neural network in Python using Scikit-learn, the latest version of which now has built in support for Neural Network models.

  Pages: 1 2

  Beginners, Machine Learning, Neural Networks, Python, scikit-learn

• KDnuggets™ News 16:n37, Oct 19: Top Data Science Videos; 12 Interesting Big Data Careers; Deep Learning Key Terms - Oct 19, 2016.
  
  Top 10 Data Science Videos on YouTube; Top 12 Interesting Careers to Explore in Big Data; Deep Learning Key Terms, Explained; Artificial Intelligence, Deep Learning, and Neural Networks, Explained; MLDB: The Machine Learning Database

  AI, Big Data, Career, Data Science, Deep Learning, Neural Networks

• Artificial Intelligence, Deep Learning, and Neural Networks, Explained - Oct 14, 2016.
  
  This article is meant to explain the concepts of AI, deep learning, and neural networks at a level that can be understood by most non-practitioners, and can also serve as a reference or review for technical folks as well.

  AI, Artificial Intelligence, Deep Learning, Explained, Neural Networks

• Deep Learning Reading Group: SqueezeNet - Sep 29, 2016.
  
  This paper introduces a small CNN architecture called “SqueezeNet” that achieves AlexNet-level accuracy on ImageNet with 50x fewer parameters.

  Compression, Deep Learning, Lab41, Machine Learning, Neural Networks

• Neural Designer: Predictive Analytics Software - Sep 26, 2016.
  
  Neural Designer advanced neural network algorithms, combined with a simple user interface and fast performance, make it a great tool for data scientists. Download free 15-day trial version.

  Classification, CUDA, Forecasting, GPU, Neural Networks, Predictive Analytics

• Up to Speed on Deep Learning: August Update, Part 2 - Sep 23, 2016.
  
  This is the second part of an overview of deep learning stories that made news in August. Look to see if you have missed anything.

  Convolutional Neural Networks, Deep Learning, Google, Image Recognition, Machine Learning, Neural Networks, NIPS

• Deep Learning Reading Group: Deep Residual Learning for Image Recognition - Sep 22, 2016.
  
  Published in 2015, today's paper offers a new architecture for Convolution Networks, one which has since become a staple in neural network implementation. Read all about it here.

  Academics, Convolutional Neural Networks, Deep Learning, Image Recognition, Lab41, Machine Learning, Neural Networks

• Top KDnuggets tweets, Sep 14-20: Why we need #DataScience: brain wont let us see 12 black dots at intersection - Sep 21, 2016.
  
  Why we need #DataScience: brain won't let us see 12 black dots at intersections; #Blurring sensitive info no longer safe! #MachineLearning can recover originals ;Pokemon Go Data; The #NeuralNetwork Zoo - Great chart of different configurations.

  Big Data Privacy, Brain, Data Science, Neural Networks, Programming Languages, Top tweets

• Up to Speed on Deep Learning: August Update - Sep 21, 2016.
  
  Check out this thorough roundup of deep learning stories that made news in August, and see if there are any items of note that you missed.

  Art, Convolutional Neural Networks, Deep Learning, Image Recognition, Machine Learning, Neural Networks

• 9 Key Deep Learning Papers, Explained - Sep 20, 2016.
  
  If you are interested in understanding the current state of deep learning, this post outlines and thoroughly summarizes 9 of the most influential contemporary papers in the field.

  Pages: 1 2 3

  Academics, Deep Learning, Explained, Neural Networks

• Deep Learning Reading Group: Deep Compression - Sep 15, 2016.
  
  An concise overview of a paper covering three methods of compressing a neural network in order to reduce the size of the network on disk, improve performance, and decrease run time.

  Academics, Compression, Deep Learning, Lab41, Neural Networks

• Urban Sound Classification with Neural Networks in Tensorflow - Sep 12, 2016.
  
  This post discuss techniques of feature extraction from sound in Python using open source library Librosa and implements a Neural Network in Tensorflow to categories urban sounds, including car horns, children playing, dogs bark, and more.

  Pages: 1 2

  Deep Learning, Feature Extraction, Machine Learning, Neural Networks, TensorFlow

• Deep Learning Reading Group: Deep Networks with Stochastic Depth - Sep 8, 2016.
  
  An concise overview of a recent paper which introduces a new way to perturb networks during training in order to improve their performance, stochastic depth networks.

  Academics, Deep Learning, Lab41, Neural Networks

• A Beginner’s Guide To Understanding Convolutional Neural Networks Part 2 - Sep 8, 2016.
  
  This is the second part of a thorough introductory treatment of convolutional neural networks. Have a look after reading the first part.

  Pages: 1 2

  Beginners, Convolutional Neural Networks, Deep Learning, Neural Networks

• Up to Speed on Deep Learning: July Update, Part 2 - Sep 7, 2016.
  
  Check out this second installation of deep learning stories that made news in July. See if there are any items of note you missed.

  Convolutional Neural Networks, Coursera, Deep Learning, Geoff Hinton, Machine Learning, Neural Networks, OpenAI

• KDnuggets™ News 16:n32, Sep 7: Cartoon: Data Scientist was sexiest job until…; Up to Speed on Deep Learning - Sep 7, 2016.
  
  Cartoon: Data Scientist - the sexiest job of the 21st century until...; Up to Speed on Deep Learning: July Update; How Convolutional Neural Networks Work; Learning from Imbalanced Classes; What is the Role of the Activation Function in a Neural Network?

  Balancing Classes, Convolutional Neural Networks, Data Scientist, Deep Learning, Neural Networks

• A Beginner’s Guide To Understanding Convolutional Neural Networks Part 1 - Sep 6, 2016.
  
  Interested in better understanding convolutional neural networks? Check out this first part of a very comprehensive overview of the topic.

  Pages: 1 2

  Beginners, Convolutional Neural Networks, Deep Learning, Neural Networks

• Top KDnuggets tweets, Aug 24-30: #DataScientist – sexiest job of the 21st century until …; Activation Function in #NeuralNetworks. - Aug 31, 2016.
  
  Cartoon: #DataScientist - sexiest job of the 21st century until ...; What is the Role of the Activation Function in Neural Networks?; LinkedIn Machine Learning team tutorial on building #Recommender system; Create a #Chatbot for #Telegram in #Python to Summarize Text.

  AI, LinkedIn, Mathematics, Neural Networks, Recommender Systems, Top tweets

• How Convolutional Neural Networks Work - Aug 31, 2016.
  
  Get an overview of what is going on inside convolutional neural networks, and what it is that makes them so effective.

  Pages: 1 2

  Brandon Rohrer, Convolutional Neural Networks, Image Recognition, Neural Networks

• What is the Role of the Activation Function in a Neural Network? - Aug 30, 2016.
  
  Confused as to exactly what the activation function in a neural network does? Read this overview, and check out the handy cheat sheet at the end.

  Linear Regression, Logistic Regression, Neural Networks

• KDnuggets™ News 16:n30, Aug 17: Why Deep Learning Works; Neural Networks with R; Central Limit Theorem for Data Science - Aug 17, 2016.
  
  3 Thoughts on Why Deep Learning Works So Well; A Beginner's Guide to Neural Networks with R!; Central Limit Theorem for Data Science; Cartoon: Make Data Great Again

  Centrality, Data Science, Deep Learning, Neural Networks, R

• Making Data Science Accessible – Neural Networks - Aug 11, 2016.
  
  This post attempts to make the underlying concepts of neural networks more accessible to everyone. Gain a high level view of their working here.

  Data Science, Neural Networks

• A Beginner’s Guide to Neural Networks with R! - Aug 11, 2016.
  
  In this article we will learn how Neural Networks work and how to implement them with the R programming language! We will see how we can easily create Neural Networks with R and even visualize them. Basic understanding of R is necessary to understand this article.

  Pages: 1 2

  Beginners, Neural Networks, R, Udemy

• 3 Thoughts on Why Deep Learning Works So Well - Aug 10, 2016.
  
  While answering a posed question in his recent Quora Session, Yann LeCun also shared 3 high-level thoughts on why deep learning works so well.

  Convolutional Neural Networks, Deep Learning, Deep Neural Network, Neural Networks, Quora, Yann LeCun

• 7 Steps to Understanding Computer Vision - Aug 9, 2016.
  
  A starting point for Computer Vision and how to get going deeper. Dive into this post for some overview of the right resources and a little bit of advice.

  7 Steps, Computer Vision, Deep Learning, Neural Networks, Python

• Top KDnuggets tweets, Jul 27 – Aug 2: Understanding neural networks with Google TensorFlow Playground; Getting Started with Data Science in Python - Aug 3, 2016.
  
  Understanding neural networks with Google TensorFlow Playground; The 100 Best-Funded #Analytics #DataScience #Startups; Great tutorial: Getting Started with #DataScience - #Python; #MachineLearning over 1M hotel reviews: interesting insights.

  Data Science Tutorial, Neural Networks, Programming Languages, Python, Startups, TensorFlow, Top tweets

• Why Do Deep Learning Networks Scale? - Jul 25, 2016.
  
  A discussion of what about deep learning architectures allows them to scale, and addresses some assumptions that often inhibit an understanding of this topic.

  Architecture, Deep Learning, Neural Networks

• Multi-Task Learning in Tensorflow: Part 1 - Jul 20, 2016.
  
  A discussion and step-by-step tutorial on how to use Tensorflow graphs for multi-task learning.

  Pages: 1 2

  Machine Learning, Neural Networks, TensorFlow

• In Deep Learning, Architecture Engineering is the New Feature Engineering - Jul 19, 2016.
  
  A discussion of architecture engineering in deep neural networks, and its relationship with feature engineering.

  Architecture, Deep Learning, Feature Engineering, Neural Networks

• How to Start Learning Deep Learning - Jul 14, 2016.
  
  Want to get started learning deep learning? Sure you do! Check out this great overview, advice, and list of resources.

  Andrej Karpathy, Coursera, Deep Learning, edX, Geoff Hinton, Neural Networks

• 5 Deep Learning Projects You Can No Longer Overlook - Jul 12, 2016.
  
  There are a number of "mainstream" deep learning projects out there, but many more niche projects flying under the radar. Have a look at 5 such projects worth checking out.

  C++, Deep Learning, Javascript, Machine Learning, Neural Networks, Overlook, Python

• Deep Residual Networks for Image Classification with Python + NumPy - Jul 7, 2016.
  
  This post outlines the results of an innovative Deep Residual Network implementation for Image Classification using Python and NumPy.

  Deep Learning, Neural Networks, numpy, Python

• Three Impactful Machine Learning Topics at ICML 2016 - Jul 1, 2016.
  
  This post discusses 3 particular tutorial sessions of impact from the recent ICML 2016 conference held in New York. Check out some innovative ideas on Deep Residual Networks, Memory Networks for Language Understanding, and Non-Convex Optimization.

  Pages: 1 2

  Deep Learning, ICML, Machine Learning, Natural Language Processing, Neural Networks, Optimization

• Recursive (not Recurrent!) Neural Networks in TensorFlow - Jun 30, 2016.
  
  Learn how to implement recursive neural networks in TensorFlow, which can be used to learn tree-like structures, or directed acyclic graphs.

  Neural Networks, TensorFlow

• Peeking Inside Convolutional Neural Networks - Jun 29, 2016.
  
  This post discusses using some tricks to peek inside of the neural network, and to visualize what the individual units in a layer detect.

  Pages: 1 2

  Convolutional Neural Networks, Deep Learning, Neural Networks

• Top Machine Learning Libraries for Javascript - Jun 24, 2016.
  
  Javascript may not be the conventional choice for machine learning, but there is no reason it cannot be used for such tasks. Here are the top libraries to facilitate machine learning in Javascript.

  Andrej Karpathy, Convolutional Neural Networks, Deep Learning, Javascript, Machine Learning, Neural Networks

• KDnuggets™ News 16:n22, Jun 22: Data Science Blog Contest; Free Machine Learning Ebook; Master SQL for Data Science - Jun 22, 2016.
  
  Data Science Blog Contest; New Free Andrew Ng Machine Learning Book Under Construction; 7 Steps to Mastering SQL for Data Science; A Visual Explanation of the Back Propagation Algorithm; Mining Twitter Data with Python Part 1: Collecting Data

  Backpropagation, Data Science, Free ebook, Neural Networks, SQL