- What to do when your training and testing data come from different distributions - Jan 4, 2019.
However, sometimes only a limited amount of data from the target distribution can be collected. It may not be sufficient to build the needed train/dev/test sets. What to do in such a case? Let us discuss some ideas!
Tags: Distribution, Machine Learning, Training Data
- Key Takeaways from AI Conference SF, Day 2: AI and Security, Adversarial Examples, Innovation - Oct 30, 2018.
Highlights and key takeaways from selected keynote sessions on day 2 of AI Conference San Francisco 2018.
Tags: Adversarial, AI, Architecture, GPU, O'Reilly, Privacy, San Francisco, TPU, Training Data
- KDnuggets™ News 18:n23, Jun 13: Did Python declare victory over R?; Master the Netflix Interview; Deep Learning Projects DIY Style - Jun 13, 2018.
Also: Command Line Tricks For Data Scientists; How (dis)similar are my train and test data?; 5 Machine Learning Projects You Should Not Overlook, June 2018; Introduction to Game Theory; Human Interpretable Machine Learning
Tags: Data Science, Deep Learning, Interview questions, Machine Learning, Netflix, Python, R, Training Data
- Why you need to improve your training data, and how to do it - Jun 11, 2018.
This article examines the way you need to improve your training data and how it can be accomplished, including speech commands, choosing the right data, picking a model fast and more.
Pages: 1 2
Tags: AI, Andrej Karpathy, Machine Learning, Training Data
- How (dis)similar are my train and test data? - Jun 7, 2018.
This articles examines a scenario where your machine learning model can fail.
Tags: Data Science, Datasets, Feature Selection, Machine Learning, Training Data
- How to Organize Data Labeling for Machine Learning: Approaches and Tools - May 16, 2018.
The main challenge for a data science team is to decide who will be responsible for labeling, estimate how much time it will take, and what tools are better to use.
Pages: 1 2
Tags: Altexsoft, Crowdsourcing, Data Preparation, Image Recognition, Machine Learning, Training Data
- Learning Curves for Machine Learning - Jan 17, 2018.
But how do we diagnose bias and variance in the first place? And what actions should we take once we've detected something? In this post, we'll learn how to answer both these questions using learning curves.
Pages: 1 2
Tags: Bias, Machine Learning, Metrics, Training Data, Variance
- How (and Why) to Create a Good Validation Set - Nov 24, 2017.
The definitions of training, validation, and test sets can be fairly nuanced, and the terms are sometimes inconsistently used. In the deep learning community, “test-time inference” is often used to refer to evaluating on data in production, which is not the technical definition of a test set.
Tags: Cross-validation, Datasets, Training Data, Validation
- How to squeeze the most from your training data - Jul 27, 2017.
In many cases, getting enough well-labelled training data is a huge hurdle for developing accurate prediction systems. Here is an innovative approach which uses SVM to get the most from training data.
Tags: Data Analysis, Data Preparation, Machine Learning, Support Vector Machines, SVM, Training Data
- 7 Ways to Get High-Quality Labeled Training Data at Low Cost - Jun 13, 2017.
Having labeled training data is needed for machine learning, but getting such data is not simple or cheap. We review 7 approaches including repurposing, harvesting free sources, retrain models on progressively higher quality data, and more.
Tags: Crowdsourcing, Data Preparation, Gamification, Machine Learning, Training Data
- Do We Need More Training Data or More Complex Models? - Mar 23, 2015.
Do we need more training data? Which models will suffer from performance saturation as data grows large? Do we need larger models or more complicated models, and what is the difference?
Tags: Big Data, convnet, Generalized Linear Models, K-nearest neighbors, Training Data, Zachary Lipton
Learn How to Listen: One of the hardest parts of being a data scientist