News / Blog
November: All | Courses, Education | Meetings | News | Opinions | Top Stories, Tweets | Tutorials, Overviews | Webcasts & Webinars
Top stories: Most viewed and Most shared
KDnuggets News: 2018 News | Schedule | Submissions | Archive
Top stories: Most viewed and Most shared
KDnuggets News: 2018 News | Schedule | Submissions | Archive
Latest:
Metadata Enrichment is Essential to Realize the Value of Open Datasets - Nov 14, 2018.
The last few years have seen great advancement in AI technologies for data science and analytics. With analytics engines capable of ingesting and analyzing almost any amount and type of data, the bottleneck has shifted from the technology to the data itself.- What is the Best Python IDE for Data Science? - Nov 14, 2018.
Before you start learning Python, choose the IDE that suits you the best. We examine many available tools, their pros and cons, and suggest how to choose the best Python IDE for you. - KDnuggets™ News 18:n43, Nov 14: To get hired as a data scientist, don’t follow the herd; LinkedIn Top Voices in Data Science & Analytics - Nov 14, 2018.
Also: What does a data scientist REALLY look like? 10 Free Must-See Courses for Machine Learning and Data Science. 
LinkedIn Top Voices 2018: Data Science & Analytics - Nov 13, 2018.
Meet 10 must-know writers and creators discussing everything from the prominence of Python to the ethical implications of artificial intelligence. Hint - you already know no. 1.
Help us understand your Data Science goals! - Nov 13, 2018.
If you are currently enrolled in or completed either short, online courses in data science or intensive, paid online bootcamps in data science, please complete this short survey for chance to win one of twenty $50 Amazon gift cards, and help improve Data Science education.- [Download] Real-Life ML Examples + Notebooks - Nov 13, 2018.
In this eBook, we will walk you through four Machine Learning use cases on Databricks: Loan Risk Use Case; Advertising Analytics & Prediction Use Case; Market Basket Analysis Problem at Scale; Suspicious Behavior Identification in Video Use Case. Get your copy now! 
The Evolution of Build Engineering in Managing Open Source [Webinar Replay] - Nov 13, 2018.
Explore how the role of build engineering is evolving to reconcile two key trends: massive wide-scale adoption of open source; the most devastating cyber-attacks in recent history tied to unpatched dependencies and other vulnerabilities.- The ultimate guide to starting AI - Nov 13, 2018.
A step-by-step overview of how to begin your project, including advice on how to craft a wise performance metric, setting up testing criteria to overcome human bias, and more. 
The 5 Basic Statistics Concepts Data Scientists Need to Know - Nov 13, 2018.
Today, we’re going to look at 5 basic statistics concepts that data scientists need to know and how they can be applied most effectively!
Top Stories, Nov 5-11: The Most in Demand Skills for Data Scientists; 10 Free Must-See Courses for Machine Learning and Data Science - Nov 12, 2018.
Also: What does a data scientist REALLY look like? Introduction to PyTorch for Deep Learning
Machine Learning Toronto Summit
Nov 20-21 – Special KDnuggets discount - Nov 12, 2018.
The Toronto Machine Learning Summit takes place Nov 20-21. Register to celebrate Canada's top AI Research, and enjoy a 30% off -Special Discount with code KDNUGGETS. Register now!- Self-Service Analytics and Operationalization – Why You Need Both - Nov 12, 2018.
Get the guidebook / whitepaper for a look at how today's top data-driven companies scale their advanced analytics & machine learning efforts. - Healthcare Analytics Made Simple - Nov 12, 2018.
Finally, a book on Python healthcare machine learning techniques is here! Healthcare Analytics Made Simple does just what the title says: it makes healthcare data science simple and approachable for everyone. - To get hired as a data scientist, don’t follow the herd - Nov 12, 2018.
Key tips, including advice on how to step out of your comfort zone and sometimes overlooked important skills that will impress employers. Check also the audio version with additional advice. - The Long Tail of Medical Data - Nov 12, 2018.
This article discusses some issues related to medical data, relating specifically to power law distributions and computer aided diagnosis. Read on to see machine learning's place in the puzzle. - Dr. Data Show Video: What the Hell Does “Data Science” Really Mean? - Nov 10, 2018.
The latest episode of the Dr. Data Show answers the question, "What the hell is data science?" - Stanford online Data Science / Data Mining courses & certificates - Nov 9, 2018.
With Stanford online graduate courses and certificates, you can earn a higher education credential while still maintaining your career. Apply now! -
What does a data scientist REALLY look like? - Nov 9, 2018.
Using the responses from Stack Overflow's 2018 Annual Developer Survey, we attempt to build a portrait of data scientists today, including a look at gender, skills, job satisfaction, and more. - Top October Stories: 9 Must-have skills you need to become a Data Scientist, updated; 10 Best Mobile Apps for Data Scientist / Data Analysts - Nov 9, 2018.
Also: How To Learn Data Science If You're Broke; Graphs Are The Next Frontier In Data Science; BIG, small or Right Data: Which is the proper focus? - Multi-Class Text Classification with Doc2Vec & Logistic Regression - Nov 9, 2018.
Doc2vec is an NLP tool for representing documents as a vector and is a generalizing of the word2vec method. In order to understand doc2vec, it is advisable to understand word2vec approach. - Hilary Mason and Gilad Lotan to Keynote at MADS 2019 - Nov 8, 2018.
The 2019 Marketing Analytics and Data Science conference, Apr 8-10 in San Francisco, will empower you with practical applications to achieve better bottom line results in a data-driven future. Save 20% with VIP Code MADS19KDN. Register now and save! - Deep Learning Performance Cheat Sheet - Nov 8, 2018.
We outline a variety of simple and complex tricks that can help you boost your deep learning models accuracy, from basic optimization, to open source labeling software. - Best Practices for Using Notebooks for Data Science - Nov 8, 2018.
Are you interested in implementing notebooks for data science? Check out these 5 things to consider as you begin the process. -
10 Free Must-See Courses for Machine Learning and Data Science - Nov 8, 2018.
Check out a collection of free machine learning and data science courses to kick off your winter learning season. - Top KDnuggets tweets, Oct 31 – Nov 6: 10 More Free Must-Read Books for Machine Learning and Data Science - Nov 7, 2018.
Also: #DataScientist Personas: What Skills Do They Have and How Much Do They Make?; Cartoon: Halloween Costume for Big Data; Stop Installing Tensorflow Using pip for Performance Sake!; How Machines Understand Our Language: An Introduction to NLP - 7 Best Practices for Machine Learning on a Data Lake - Nov 7, 2018.
Download this report to learn about the data requirements for advanced analytics on a data lake, and best practices such analytics with a focus on machine learning. - Latest Trends in Computer Vision Technology and Applications - Nov 7, 2018.
We investigate the advancements in deep learning, the rise of edge computing, object recognition with point cloud, VR and AR enhanced merged reality, semantic instance segmentation and more. - Introduction to PyTorch for Deep Learning - Nov 7, 2018.
In this tutorial, you’ll get an introduction to deep learning using the PyTorch framework, and by its conclusion, you’ll be comfortable applying it to your deep learning models. 
DePaul University: Professor of Practice position in Data Science [Chicago, IL] - Nov 7, 2018.
DePaul University's School of Computing invites applications for a Professor of Practice to begin in Fall 2019. We are particularly interested in candidates who demonstrate outstanding teaching and a strong interest in data science education.- DePaul University: Two tenure-track/tenured positions in Data Science/Computer Science [Chicago, IL] - Nov 7, 2018.
DePaul University's School of Computing invites applications for two tenure-track faculty positions, beginning in Fall 2019. We will consider applicants at all ranks (i.e. Assistant, Associate and Full Professor) whose work is focused on data science, machine learning, and artificial intelligence. - KDnuggets™ News 18:n42, Nov 7: The Most in Demand Skills for Data Scientists; How Machines Understand Our Language: Intro to NLP - Nov 7, 2018.
Also: Machine Learning Classification: A Dataset-based Pictorial; Quantum Machine Learning: A look at myths, realities, and future projections; Multi-Class Text Classification Model Comparison and Selection; Top 13 Python Deep Learning Libraries - Turn data into revenue. Wharton can show you how. - Nov 6, 2018.
Customer Analytics from Wharton Executive Education gives you an actionable plan to analyze your customer data by delving into specific collection methodologies and patterns for predictive behavior. Find out more about the Feb 25-Mar 1 session in Philadelphia. - Turbocharge Tech Transformation: Integrate AI Across Insurance - Nov 6, 2018.
This Webinar from Insurance Nexus will give you insights into integrating analytics in real-time, turning your vision into reality, satisfying budgetary constraints with incremental technological improvement, and more. - Text Preprocessing in Python: Steps, Tools, and Examples - Nov 6, 2018.
We outline the basic steps of text preprocessing, which are needed for transferring text from human language to machine-readable format for further processing. We will also discuss text preprocessing tools. - Building Surveillance System Using USB Camera and Wireless-Connected Raspberry Pi - Nov 6, 2018.
Read this post to learn how to build a surveillance system using a USB camera plugged into Raspberry Pi (RPi) which is connected a PC using its wireless interface. - Mastering the Learning Rate to Speed Up Deep Learning - Nov 6, 2018.
Figuring out the optimal set of hyperparameters can be one of the most time consuming portions of creating a machine learning model, and that’s particularly true in deep learning. - Top Stories, Oct 29 – Nov 4: The Most in Demand Skills for Data Scientists; How Machines Understand Our Language - Nov 5, 2018.
Also: Introduction to Deep Learning with Keras; How Data Science Is Improving Higher Education; 9 Must-have skills you need to become a Data Scientist, updated; Data Representation for Natural Language Processing Tasks; Top 13 Python Deep Learning Libraries - Get ahead of your peers with a Certificate in Business Analytics - Nov 5, 2018.
The program equips you with the skills to interpret data, formulate insights, and communicate your findings effectively. Courses are focused on the strategic use of data, providing a foundation that can be applied to diverse fields. - Quantum Machine Learning: A look at myths, realities, and future projections - Nov 5, 2018.
An overview of quantum computing and quantum algorithm design, including current state of the hardware and algorithm design within the existing systems. - Machine Learning Classification: A Dataset-based Pictorial - Nov 5, 2018.
In order to relate machine learning classification to the practical, let's see how this concept plays out, step by step (and with images), specifically in direct relation to a dataset. - Vanderbilt University’s Peabody College: Sr. Lecturer in Data and Analytics [Nashville, TN] - Nov 5, 2018.
Vanderbilt University is seeking a Senior Lecturer in Data and Analytics in Nashville, TN. The Senior Lecturer should have a strong background in the area of data science and analytics. The role for this senior lecturer position is primarily instructional. - Vanderbilt University’s Peabody College: Lecturer in Data and Analytics [Online Teaching] - Nov 5, 2018.
Vanderbilt University’s Peabody College is seeking a Lecturer in Data and Analytics for the online program in Leadership and Learning in Organizations. Candidates are sought to teach multiple sections in the Data and Analytics strand of the program, which includes Strategy and Analytics, Data Science, Research Design and Applied Statistics. - Data Mining Book – Chapter Download - Nov 2, 2018.
Download this immediately useful book chapter, and learn how to create derived variables, which allow the statistical and Data Science modeling to incorporate human insights. - Learn how machine learning is transforming business, Nov 12 Webinar - Nov 2, 2018.
In this webinar on Nov 12, titled How to Transform Your Business with Automated Machine Learning, learn the difference between AI, machine learning, and deep learning, the challenges of implementing traditional data science solutions, and how automated machine learning enables more employees to take part in AI initiatives. - Top 13 Python Deep Learning Libraries - Nov 2, 2018.
Part 2 of a new series investigating the top Python Libraries across Machine Learning, AI, Deep Learning and Data Science. - The Most in Demand Skills for Data Scientists - Nov 2, 2018.
Data scientists are expected to know a lot — machine learning, computer science, statistics, mathematics, data visualization, communication, and deep learning. How should data scientists who want to be in demand by employers spend their learning budget? - Data Representation for Natural Language Processing Tasks - Nov 2, 2018.
In NLP we must find a way to represent our data (a series of texts) to our systems (e.g. a text classifier). As Yoav Goldberg asks, "How can we encode such categorical data in a way which is amenable for us by a statistical classifier?" Enter the word vector. - Data Science “Paint by the Numbers” with the Hypothesis Development Canvas - Nov 2, 2018.
Now you are ready to take the next step from a Big Data MBA perspective by building off of the Business Model Canvas to flesh out the business use cases – or hypothesis – which is where we can become more effective at leveraging data and analytics to optimize our the business. - Upcoming Meetings in AI, Analytics, Big Data, Data Science, Deep Learning, Machine Learning: November and Beyond - Nov 1, 2018.
Coming soon: PASS Summit Seattle, TDWI Orlando, IEEE Conf on Data Mining Singapore, AI & Big Data Innovation Summit 2018 Beijing, Deep Learning World Berlin, PAW Business Berlin, Big Data LDN London, NIPS, and many more. - Join AI experts from Google Brain, Open AI & Uber AI Labs in San Francisco - Nov 1, 2018.
Join us at the Deep Learning Summit, San Francisco, 24 - 25 Jan 2019. Learn from industry experts in speech & pattern recognition, neural networks, image analysis and NLP, and explore how deep learning will impact all industries. - Tomorrow, Nov 8 Webinar: Transform Your Stagnant Data Swamp into a Pristine Data Lake - Nov 1, 2018.
We explore how to implement an Enterprise Data Management strategy that will unleash your data to power decisions, examine a real-world digital-transformation use case from a Tier-1 bank, and see a demo of Trifacta Wrangler. - Why AI will not replace radiologists - Nov 1, 2018.
We investigate some of the reasons why radiologists will be safe from AI, including the fact that humans will always maintain ultimate responsibility, how productivity gains will drive demand, and more. - How Data Science Is Improving Higher Education - Nov 1, 2018.
Increasingly, colleges and universities, as well as governments, are using data science to improve the ways educational institutions do everything from recruiting to engaging with students to budgeting. - Multi-Class Text Classification Model Comparison and Selection - Nov 1, 2018.
This is what we are going to do today: use everything that we have presented about text classification in the previous articles (and more) and comparing between the text classification models we trained in order to choose the most accurate one for our problem. - Top KDnuggets tweets, Oct 24-30: Building a Question-Answering System from Scratch - Oct 31, 2018.
Also: Implementing Automated Machine Learning Systems with Open Source Tools; New Book: #LinearAlgebra – what you need for Machine Learning and Data Science now; A General Approach to Preprocessing Text Data; Using Deep Learning To Extract Knowledge From Job Descriptions - Webinar – Integrate AI Across Insurance Operations to Turbocharge Tech Transformation, Nov 14 - Oct 31, 2018.
This Webinar from Insurance Nexus will give you insights into integrating analytics in real-time, turning your vision into reality, satisfying budgetary constraints with incremental technological improvement, and more. - Labeling Unstructured Text for Meaning to Achieve Predictive Lift - Oct 31, 2018.
In this post, we examine several advance NLP techniques, including: labeling nouns and noun phrases for meaning, labeling (most often) adverbs and adjectives for sentiment, and labeling verbs for intent. - Cartoon: Halloween Costume for Big Data. - Oct 31, 2018.
We revisit KDnuggets cartoon looking at the appropriate Halloween costume for Big Data and its companion, No Privacy. -
How Machines Understand Our Language: An Introduction to Natural Language Processing - Oct 31, 2018.
The applications of NLP are endless. This is how a machine classifies whether an email is spam or not, if a review is positive or negative, and how a search engine recognizes what type of person you are based on the content of your query to customize the response accordingly. - KDnuggets™ News 18:n41, Oct 31: Introduction to Deep Learning with Keras; Easy Named Entity Recognition with Scikit-Learn - Oct 31, 2018.
Also: Generative Adversarial Networks - Paper Reading Road Map; How I Learned to Stop Worrying and Love Uncertainty; Implementing Automated Machine Learning Systems with Open Source Tools; Notes on Feature Preprocessing: The What, the Why, and the How - In-Depth Training for the Future of Data, Orlando, Nov 11-16 – Save with code KD30 - Oct 30, 2018.
Planning and implementing new data and analytics initiatives can be overwhelming. Join us in Orlando for in-depth training that will give you the needed skills and use code KD30 thru Nov 7 to save. - New Poll: How Important is Understanding Machine Learning Models? - Oct 30, 2018.
New KDnuggets poll is asking: When building Machine Learning / Data Science models in 2018, how often was it important that the model be humanly understandable/explainable? Please vote - How to Mitigate Open Source License Risks - Oct 30, 2018.
This whitepaper from ActiveState investigates the various types of OSS licenses, common myths and risks, DIY risk management, the importance of enterprise legal indemnification, and more. - Key Takeaways from AI Conference SF, Day 2: AI and Security, Adversarial Examples, Innovation - Oct 30, 2018.
Highlights and key takeaways from selected keynote sessions on day 2 of AI Conference San Francisco 2018. - Moody’s Analytics: Machine Learning / NLP – Research Scientist / Engineer [New York, NY] - Oct 30, 2018.
Moody's Analytics is seeking a Machine Learning / NLP - Research Scientist / Engineer in New York, NY, to drive algorithmic improvements by enabling new automation capabilities, and improving efficiency and performance across multiple business lines. - Stop Installing Tensorflow Using pip for Performance Sake! - Oct 30, 2018.
If you aren’t already using conda, I recommend that you start as it makes managing your data science tools much more enjoyable. - Lehigh University: Tenure Track Positions in Foundations of Data Science [Bethlehem, PA] - Oct 30, 2018.
Successful candidates will have primary appointment in one of the departments of Industrial and Systems Engineering, Electrical and Computer Engineering, or Computer Science and Engineering. - Amazing consistency: Largest Dataset Analyzed / Data Mined – Poll Results and Trends - Oct 29, 2018.
The poll results show amazing consistency to past years, with median answers still in 10-100 gigabytes range. Really Big Data Scientists (100 Petabytes and more) continue to stand apart, but remain small segment where Asian data scientists lead for the first time in this poll. - [ebook] Manipulating Data in Apache Spark - Oct 29, 2018.
In this ebook from Databricks, learn how DataFrames leverage the power of distributed processing through Spark, how to make big data processing easier for a wider audience, and more. - Top Obstacles to Overcome when Implementing Predictive Maintenance - Oct 29, 2018.
We investigate how to create a systematic approach to predictive maintenance, ensuring there's enough data to create accurate systems. This post also explains how to identify a failure source and knowing how to predict it. - Key Takeaways from AI Conference SF, Day 1: Domain Specific Architectures, Emerging China, AI Risks - Oct 29, 2018.
Highlights and key takeaways include Domain Specific Architectures – the next big thing, Emerging China – evolving from copying ideas to true innovation, and Addressing Risks in AI – Security, Privacy, and Ethics. - Introduction to Deep Learning with Keras - Oct 29, 2018.
In this article, we’ll build a simple neural network using Keras. Now let’s proceed to solve a real business problem: an insurance company wants you to develop a model to help them predict which claims look fraudulent. - American Association of Colleges of Osteopathic Medicine: Data Analyst [Bethesda, Maryland] - Oct 29, 2018.
American Association of Colleges of Osteopathic Medicine is seeking a Data Analyst in Bethesda, Maryland, to analyze, organize, and manage AACOM’s data infrastructure. - Bank of Canada: Data Scientist [Ottawa, Canada] - Oct 29, 2018.
Are you passionate about advanced analytics and Big Data? Do you know how to ask the right questions? Are you proficient in technical/scientific computing? Take a central role. - NAIC: Analyst I (Capital Markets) [New York, NY] - Oct 29, 2018.
The NAIC is seeking a Analyst I (Capital Markets) in New York, NY. The NAIC strives every day to support the public good and make a difference. This is a full-time position in a flexible environment. - Top Stories, Oct 22-28: 9 Must-have skills you need to become a Data Scientist, updated; Named Entity Recognition and Classification with Scikit-Learn - Oct 29, 2018.
Also: SQL, Python, & R in One Platform; Generative Adversarial Networks – Paper Reading Road Map; Notes on Feature Preprocessing: The What, the Why, and the How; Graphs Are The Next Frontier In Data Science; 10 Best Mobile Apps for Data Scientist / Data Analysts - AI Masterpieces: But is it Art? - Oct 27, 2018.
While there’s no doubt that the quality of the results in style transfer is outstanding, many were left with feelings that the technique left little room for the concept of art itself, even calling it “… more of a parlor trick than the next revolution in fine art.” - SQL, Python, & R in One Platform - Oct 26, 2018.
No more jumping between applications. Mode Studio combines a SQL editor, Python and R notebooks, and a visualization builder in one platform. - Are you buying an apartment? How to hack competition in the real estate market - Oct 26, 2018.
Many real estate developers use online systems for sales. Things become interesting when all available data is monitored on a weekly basis, and sales progress is analysed. - Notes on Feature Preprocessing: The What, the Why, and the How - Oct 26, 2018.
This article covers a few important points related to the preprocessing of numeric data, focusing on the scaling of feature values, and the broad question of dealing with outliers. - Learn how to create data-driven marketing team - Oct 25, 2018.
Check out this upcoming webinar, What Happens When a Marketing Team Turns Data-driven, Nov 26, 2018 at 2:00pm EST, and find the answer to: When your distribution channel is primarily face-to-face, how important is data-driven marketing, when the sale happens offline? - Naive Bayes from Scratch using Python only – No Fancy Frameworks - Oct 25, 2018.
We provide a complete step by step pythonic implementation of naive bayes, and by keeping in mind the mathematical & probabilistic difficulties we usually face when trying to dive deep in to the algorithmic insights of ML algorithms, this post should be ideal for beginners. -
Named Entity Recognition and Classification with Scikit-Learn - Oct 25, 2018.
Named Entity Recognition and Classification is a process of recognizing information units like names, including person, organization and location names, and numeric expressions from unstructured text. The goal is to develop practical and domain-independent techniques in order to detect named entities with high accuracy automatically. - Monash University: Academic Opportunities in Dialogue Research [Melbourne, Australia] - Oct 25, 2018.
Monash University is seeking to fill multiple academic opportunities in Dialogue Research in Melbourne, Australia: Level B Lecturer (equivalent to Assistant Professor in North America), Level C Senior Lecturer (equivalent to Associate Professor in North America). - Implementing Automated Machine Learning Systems with Open Source Tools - Oct 25, 2018.
What if you want to implement an automated machine learning pipeline of your very own, or automate particular aspects of a machine learning pipeline? Rest assured that there is no need to reinvent any wheels. - Top KDnuggets tweets, Oct 17-23: Machine Learning Cheat Sheets - Oct 24, 2018.
Also 5 "Clean Code" Tips That Will Dramatically Improve Your Productivity; Data Science Cheat Sheet. - New Book: Linear Algebra – what you need for Machine Learning and Data Science now - Oct 24, 2018.
From machine learning and data science to engineering and finance, linear algebra is an important prerequisite for the careers of today and of the future. Learn the math you need with this book. - How I Learned to Stop Worrying and Love Uncertainty - Oct 24, 2018.
This is a written version of Data Scientist Adolfo Martínez’s talk at Software Guru’s DataDay 2017. There is a link to the original slides (in Spanish) at the top of this post. - Generative Adversarial Networks – Paper Reading Road Map - Oct 24, 2018.
To help the others who want to learn more about the technical sides of GANs, I wanted to share some papers I have read in the order that I read them. - U. of Zurich: Assistant Professorship in AI and Machine Learning (Non-tenure Track) [Zurich, Switzerland] - Oct 24, 2018.
Candidates should hold a Ph.D. degree in Computer Science with specialization in Machine Learning and/or Data Mining including Deep Learning, lnteractive/ Cooperative Learning, statistical learning or privacy preserving modeling, and have an excellent record of academic achievements in the relevant fields.