KDnuggets Home » News :: 2013 :: Nov :: Publications :: Data Science not just for Big Data: Video and Slides ( 13:n28 )

Data Science not just for Big Data: Video and Slides

          


While big data certainly brings changes to data science, major data science principles remain unchanged regardless of the data size. Watch leading experts David Smith from Revolution Analytics and Gregory Piatetsky from KDnuggets discuss key data science principles.

By Gregory Piatetsky, Nov 19, 2013.

Data Science vs Big DataLast month I joined David Smith from Revolution Analytics for an interesting webinar, hosted by Kalido CTO Darren Peirce, on Data Science not just for Big Data (Oct 16, 2013).

While big data certainly brings changes to data science, some key data science principles remain unchanged regardless of the data size.

Among these principles are:

  • Focus on actionable patterns
  • Build predictive models - supervised learning (train, test, x-validate)
  • Avoid overfitting
  • Avoid information leakers
  • Calculating similarity of objects for data-driven clustering, unsupervised learning
  • Select important variables/features
  • Model accuracy vs lift: how much more prevalent a pattern is than would be expected by chance
  • Estimate probability and cost/gain of actions
  • Help optimize decisions

Here are my slides from the webinar

and check the amazing story of Ignaz Semmelweis, one of the first "data scientists".

Here are David Smith slides: Data Science - not just for Big Data from the webinar.

Watch the webinar below.









Most popular last 30 days


 

Most viewed last 30 days

  1. The Grammar of Data Science: Python vs R - Mar 28, 2015.
  2. More Free Data Mining, Data Science Books and Resources - Mar 25, 2015.
  3. Deep Learning, The Curse of Dimensionality, and Autoencoders - Mar 12, 2015. 4, up3
  4. Awesome Public Datasets on GitHub - Apr 6, 2015.
  5. Deep Learning for Text Understanding from Scratch - Mar 13, 2015.
  6. PredictionIO (Open Source Version) vs Microsoft Azure Machine Learning - Mar 26, 2015.
  7. 10 things statistics taught us about big data analysis - Feb 10, 2015.
  8. Top 10 Data Analysis Tools for Business - Jun 13, 2014.
  9. Forrester Wave(tm) Big Data Predictive Analytics 2015: Gainers and Losers - Apr 3, 2015.

 
 

Most shared last 30 days

  1. The Grammar of Data Science: Python vs R - Mar 28, 2015.
  2. Forrester Wave(tm) Big Data Predictive Analytics 2015: Gainers and Losers - Apr 3, 2015.
  3. Awesome Public Datasets on GitHub - Apr 6, 2015.
  4. PredictionIO (Open Source Version) vs Microsoft Azure Machine Learning - Mar 26, 2015.
  5. Data Science as a profession - time is now - Mar 30, 2015.
  6. Cloud Machine Learning Wars: Amazon vs IBM Watson vs Microsoft Azure - Apr 16, 2015.
  7. Top LinkedIn Groups for Analytics, Big Data, Data Mining, and Data Science - from "Big Bang" to Now - Apr 19, 2015.
  8. Computing Platforms for Analytics, Data Mining, Data Science - Apr 1, 2015.
  9. How Big Data Can Improve the Lives of the Poor - Mar 31, 2015.
  10. Gold Mine or Blind Alley? Functional Programming for Big Data & Machine Learning - Apr 1, 2015.

KDnuggets Home » News :: 2013 :: Nov :: Publications :: Data Science not just for Big Data: Video and Slides ( 13:n28 )