- Dark Data: Why What You Don’t Know Matters - Dec 7, 2020.
In his latest book, a leading statistician Dr. David Hand explores how we can be blind to missing or unseen data and how, in our rush to be a data-driven society, we might be missing things that matter, leading to dangerous decisions that can sometimes have disastrous consequences. Download this free chapter now.
Data Analysis, David J. Hand, Free ebook, JMP, John Ioannidis, Overfitting
- Are Scientists Doing Too Much Research? - Nov 24, 2017.
At the heart of this reproducibility problem is the statistical inference methods used to validate research findings—specifically the concept of “statistical significance.”
Galit Shmueli, John Ioannidis, Overfitting, Research
- The Cardinal Sin of Data Mining and Data Science: Overfitting - Jun 14, 2014.
Overfitting leads to public losing trust in research findings, many of which turn out to be false. We examine some famous examples, "the decline effect", Miss America age, and suggest approaches for avoiding overfitting.
Dean Abbott, John Ioannidis, Kirk D. Borne, Overfitting, S&P 500