- 10 Must-Know Statistical Concepts for Data Scientists - Apr 21, 2021.
Statistics is a building block of data science. If you are working or plan to work in this field, then you will encounter the fundamental concepts reviewed for you here. Certainly, there is much more to learn in statistics, but once you understand these basics, then you can steadily build your way up to advanced topics.
Bayes Theorem, Correlation, Normal Distribution, P-value, Sampling, Statistics, Variance
- 10 Statistical Concepts You Should Know For Data Science Interviews - Feb 23, 2021.
Data Science is founded on time-honored concepts from statistics and probability theory. Having a strong understanding of the ten ideas and techniques highlighted here is key to your career in the field, and also a favorite topic for concept checks during interviews.
Bayes Theorem, Interview Questions, Linear Regression, Logistic Regression, P-value, Sampling, Statistics
- Null Hypothesis Significance Testing is Still Useful - Jan 25, 2021.
Even in the aftermath of the replication crisis, statistical significance lingers as an important concept for Data Scientists to understand.
Hypothesis Testing, P-value, Statistical Significance, Statistics
- 5 Must-Read Data Science Papers (and How to Use Them) - Oct 20, 2020.
Keeping ahead of the latest developments in a field is key to advancing your skills and your career. Five foundational ideas from recent data science papers are highlighted here with tips on how to leverage these advancements in your work, and keep you on top of the machine learning game.
Data Science, Machine Learning, P-value, Research, Software, Technical Debt, Transformer
- Hypothesis Test for Real Problems - Aug 14, 2020.
Hypothesis tests are significant for evaluating answers to questions concerning samples of data.
Hypothesis Testing, P-value, Statistics
- Demystifying Statistical Significance - Jul 17, 2020.
With more professionals from a wide range of less technical fields diving into statistical analysis and data modeling, these experimental techniques can seem daunting. To help with these hurdles, this article clarifies some misconceptions around p-values, hypothesis testing, and statistical significance.
P-value, Statistical Significance, Statistics
- P-values Explained By Data Scientist - Jul 30, 2019.
This article is designed to give you a full picture from constructing a hypothesis testing to understanding p-value and using that to guide our decision making process.
Data Science, Data Scientist, Hypothesis Testing, P-value, Statistics
- Comparing Machine Learning Models: Statistical vs. Practical Significance - Jan 18, 2019.
Is model A or B more accurate? Hmm… In this blog post, I’d love to share my recent findings on model comparison.
Machine Learning, Model Performance, P-value, Statistical Modeling, Statistical Significance
Data Scientist Interviews Demystified - Aug 2, 2018.
We look at typical questions in a data science interview, examine the rationale for such questions, and hope to demystify the interview process for recent graduates and aspiring data scientists.
Data Science Skills, Hiring, Interview Questions, P-value, random forests algorithm, XGBoost
- How to Compare Apples and Oranges ? : Part III - Jul 6, 2016.
In the previous article, look at techniques to compare categorical variables with the help of an example. In this article, we shall look at techniques to compare mixed type of variables i.e. numerical and categorical variables together.
CleverTap, P-value, Statistics
- How to Compare Apples and Oranges, Part 2 – Categorical Variables - Jun 21, 2016.
In the previous article, we looked at some of the ways to compare different numerical variables. In this article, we shall look at techniques to compare categorical variables with the help of an example.
Pages: 1 2
CleverTap, P-value, Statistics
- Do You Need Big Data or Smart Data? Part 1 - Jun 1, 2016.
Analyzing Big Data without paying attention to its characteristics and objective can be detrimental, the fix for which can be correct and effective sampling. Read on to transform your Big Data to Smart Data.
Big Data, CleverTap, P-value, Probability, Sampling
- The “Thinking” Part of “Thinking Like A Data Scientist” - Apr 26, 2016.
People have a tendency to blindly trust claims from any source that they deem credible, whether or not it conflicts with their own experiences or common sense. Basic stats - common sense = dangerous conclusions viewed as fact.
Data Scientist, Overfitting, P-value
- Top KDnuggets tweets, Mar 16-21: After 150 Years, ASA Says “NO” to p-values; Free Resources to Learn #MachineLearning - Mar 22, 2016.
After 150 Years, ASA Says "NO" to p-values; Using Deep Q-Network to Learn Play Flappy Bird; Why we work so hard: The problems is overworked professionals are NOT miserable; Free Resources to Learn #MachineLearning.
Deep Learning, Online Education, P-value, Statistics, Video Games
- After 150 Years, the ASA Says No to p-values - Mar 15, 2016.
The ASA has recently taken a position against p-values. Read the overview and opinion of a well-respected statistician to gain additional insight.
ASA, P-value, Statistics
- When Good Advice Goes Bad - Mar 14, 2016.
Consider these 4 examples of good statistical advice which, when misused, can go bad.
Andrew Gelman, Bayesian, Overfitting, P-value, Statistics
- OpenText Data Driven Digest Aug 21: College Majors, Hacking Glory, Innovation Performance - Aug 25, 2015.
The simple beauty of X-Y coordinates belies the power they hold; indeed, many of the best data visualizations created today rely on, and build upon, on the Cartesian plane concept to show complex data sets. Here are three examples.
Data Visualization, OpenText, P-value
- Big Idea To Avoid Overfitting: Reusable Holdout to Preserve Validity in Adaptive Data Analysis - Aug 17, 2015.
Big Data makes it all too easy find spurious "patterns" in data. A new approach helps avoid overfitting by using 2 key ideas: validation should not reveal any information about the holdout data, and adding of a small amount of noise to any validation result.
Pages: 1 2
Holdout, Model Performance, Overfitting, P-value, Vitaly Feldman
- Overcoming Overfitting with the reusable holdout: Preserving validity in adaptive data analysis - Aug 12, 2015.
Misapplication of statistical data analysis is a common cause of spurious discoveries in scientific research. We demonstrate a new approach for addressing the challenges of adaptivity based on insights from privacy-preserving data analysis.
Holdout, Model Performance, Moritz Hardt, Overfitting, P-value, Vitaly Feldman
- Top KDnuggets tweets, Jan 26-27: Sample Machine Learning solutions with R on Azure ML Marketplace - Jan 28, 2015.
Sample #MachineLearning solutions with R on #Azure ML Marketplace; xkcd explains P-Values: from Highly Significant to cr*p; Why you should learn R first for #datascience; Useful: 14 Data #Visualization Tools to Tell Better Stories.
Azure ML, Cartoon, Data Visualization, Marketplace, P-value, R, xkcd
- Year in Review: Top KDnuggets tweets in November - Dec 27, 2014.
P-values, the "gold standards" of statistical validity, are not as reliable; Nate Silver on 3 Keys to Great Information Design; Keep this #Python Cheat Sheet handy when learning to code; 8 Steps to Becoming a #DataScientist.
Cheat Sheet, Data Science Education, Nate Silver, P-value, Python
- Top KDnuggets tweets last week: P-values, the “gold standards” of statistical validity, are not as reliable - Nov 10, 2014.
P-values, the "gold standards" of statistical validity, are not as reliable; He Tweeted, She Tweeted: A Study on Romantic Breakups; A population density map of France from phone calls; Demystifying #DataScience.
Breakup, Data Science, France, P-value, Twitter
- Top KDnuggets tweets, Apr 7-8: Beware of P values – they are not reliable; The Data Scientist Toolbox online course - Apr 9, 2014.
Data scientists beware: P values are not reliable; The Data Scientist Toolbox course - online at Coursera; Beyond the Science of Data Science; EU recommends changing copyright law to enable scientific text data mining.
Copyright Law, Coursera, European Commission, P-value