Rexer Analytics has released the 37 page summary report for its 2011 Data Miner Survey.
Over 1,300 data miners from 60+ countries responded to a 52 question survey. Participation was 40% Corporate, 27% Consultants, 18% Academics, 7% NGO/Gov't, and 8% Vendors.
Some of the key findings:
FIELDS & GOALS: Data miners work in a diverse set of fields. CRM / Marketing has been the #1 field in each of the past five years. Fittingly, "improving the understanding of customers," "retaining customers," and other CRM goals continue to be the goals identified by the most data miners.
Decision trees, regression, and cluster analysis continue to form a triad of core
algorithms for most data miners. However, a wide variety of algorithms are being used. A third of data miners currently use text mining and another third plan to in the future. Text mining is most often used to analyze customer surveys and blogs/social media.
TECHNOLOGY: Data Mining most often occurs on a desktop or laptop computer, and frequently the data is stored locally. Model scoring typically happens using the same software used to develop models.
ANALYTIC CAPABILITY AND SUCCESS: Only 12% of corporate respondents rate their company as having very high analytic sophistication. However, companies with better analytic capabilities are outperforming their peers. Respondents report analyzing analytic success via Return on Investment (ROI), and analyzing the predictive validity or accuracy of their models. Challenges to measuring analytic success include client or user cooperation and data availability/quality.
- In the 2010 Survey data miners shared best practices in overcoming the key challenges data miners face.
- In the 2011 Survey data miners shared their best practices for measuring analytic success and
- examples of the positive impact that data mining can have to benefit society, health, and the world.
- In addition, 225 R users shared information about how and why they are using R
See survey highlights at