- Data Science Process Lifecycle - Sep 29, 2021.
How would it feel to know that without a doubt, the data projects you were working on would create TRUE ROI for your organization? Stick around until the end to get my data science process lifecycle framework so that each data project you run is a smashing success.
Analytics, Data Science, Data Scientist, Workflow
- Adventures in MLOps with Github Actions, Iterative.ai, Label Studio and NBDEV - Sep 16, 2021.
This article documents the authors' experience building their custom MLOps approach.
GitHub, Machine Learning, MLOps, Pipeline, Python, Workflow
- Writing Your First Distributed Python Application with Ray - Aug 16, 2021.
Using Ray, you can take Python code that runs sequentially and transform it into a distributed application with minimal code changes. Read on to find out why you should use Ray, and how to get started.
Distributed Computing, Parallelism, Python, Workflow
- Workflow Orchestration with Prefect and Coiled - Jun 23, 2021.
Coiled helps data scientists use Python for ambitious problems, scaling to the cloud for computing power, ease, and speed—all tuned for the needs of teams and enterprises. In this demo example, see how to spin up a Coiled cluster to execute Prefect jobs during runtime.
Coiled.io, Modern Data Stack, Orchestration, Prefect, Python, Workflow
- How to build a DAG Factory on Airflow - Mar 19, 2021.
A guide to building efficient DAGs with half of the code.
Data Engineering, Data Workflow, Graphs, Python, Workflow
- Kedro-Airflow: Orchestrating Kedro Pipelines with Airflow - Mar 12, 2021.
The Kedro team and Astronomer have released Kedro-Airflow 0.4.0 to help you develop modular, maintainable & reproducible code with orchestration superpowers!
Data Science, Interview, Pipeline, Python, Workflow
- How to Speed Up Pandas with Modin - Mar 10, 2021.
The Modin library has the ability to scale your pandas workflows by changing one line of code and integration with the Python ecosystem and Ray clusters. This tutorial goes over how to get started with Modin and how it can speed up your pandas workflows.
Data Science, Distributed Systems, Modin, Pandas, Python, Workflow
- AI Is More Than a Model: Four Steps to Complete Workflow Success - Nov 17, 2020.
The key element for success in practical AI implementation is uncovering any issues early on and knowing what aspects of the workflow to focus time and resources on for the best results—and it’s not always the most obvious steps.
AI, Data Preparation, Data Science Process, Deployment, MathWorks, Simulation, Workflow
- How to be a 10x data scientist - Oct 12, 2020.
If you are a Data Scientist looking to make it to the next level, then there are many opportunities to up your game and your efficiency to stand out from the others. Some of these recommendations that you can follow are straightforward, and others are rarely followed, but they will all pay back in dividends of time and effectiveness for your career.
Advice, Data Scientist, IDE, Jupyter, Uncertainty, Workflow
- Machine Learning Model Deployment - Sep 30, 2020.
Read this article on machine learning model deployment using serverless deployment. Serverless compute abstracts away provisioning, managing severs and configuring software, simplifying model deployment.
Cloud, Deployment, Machine Learning, Modeling, Workflow
- Implementing MLOps on an Edge Device - Aug 4, 2020.
This article introduces developers to MLOps and strategies for implementing MLOps on edge devices.
Edge Analytics, Machine Learning, MLOps, Speech Recognition, Workflow
- A Tour of End-to-End Machine Learning Platforms - Jul 29, 2020.
An end-to-end machine learning platform needs a holistic approach. If you’re interested in learning more about a few well-known ML platforms, you’ve come to the right place!
AirBnB, Data Science Platform, Google, Machine Learning, MLOps, Netflix, Pipeline, Uber, Workflow
- KDnuggets™ News 20:n26, Jul 8: Speed up Your Numpy and Pandas; A Layman’s Guide to Data Science; Getting Started with TensorFlow 2 - Jul 8, 2020.
Speed up your Numpy and Pandas with NumExpr Package; A Layman's Guide to Data Science. Part 3: Data Science Workflow; Getting Started with TensorFlow 2; Feature Engineering in SQL and Python: A Hybrid Approach; Deploy Machine Learning Pipeline on AWS Fargate
AWS, Data Science, Deep Learning, numpy, Pandas, Python, TensorFlow, Workflow
A Layman’s Guide to Data Science. Part 3: Data Science Workflow - Jul 6, 2020.
Learn and appreciate the typical workflow for a data science project, including data preparation (extraction, cleaning, and understanding), analysis (modeling), reflection (finding new paths), and communication of the results to others.
Beginners, Data Science, Data Workflow, Sciforce, Workflow
- How to Extend Scikit-learn and Bring Sanity to Your Machine Learning Workflow - Oct 29, 2019.
In this post, learn how to extend Scikit-learn code to make your experiments easier to maintain and reproduce.
Machine Learning, Python, scikit-learn, Software Engineering, Workflow
- 5 Step Guide to Scalable Deep Learning Pipelines with d6tflow - Sep 16, 2019.
How to turn a typical pytorch script into a scalable d6tflow DAG for faster research & development.
Deep Learning, Pipeline, Python, PyTorch, Workflow
- How to better manage your data science team’s workflow - Aug 5, 2019.
This workshop, Aug 14 @ 12 PM ET, will give you the proper tools and tactics to manage the entire lifecycle of your machine learning projects, from research to exploration to development and production.
cnvrg.io, Data Science Team, Workflow
Data Science with Optimus Part 2: Setting your DataOps Environment - Apr 16, 2019.
Breaking down data science with Python, Spark and Optimus. Today: Data Operations for Data Science. Here we’ll learn to set-up Git, Travis CI and DVC for our project.
Apache Spark, Data Operations, Data Science, Python, Workflow
- Data Science with Optimus Part 1: Intro - Apr 15, 2019.
With Optimus you can clean your data, prepare it, analyze it, create profilers and plots, and perform machine learning and deep learning, all in a distributed fashion, because on the back-end we have Spark, TensorFlow, Sparkling Water and Keras. It’s super easy to use.
Apache Spark, Data Science, Python, Workflow
- Data Pipelines, Luigi, Airflow: Everything you need to know - Mar 27, 2019.
This post focuses on the workflow management system (WMS) Airflow: what it is, what can you do with it, and how it differs from Luigi.
Data Workflow, Pipeline, Python, Workflow
- [Webinar] Managing the Complete Machine Learning Lifecycle - Feb 28, 2019.
Join Databricks Mar 7, 2019, to learn how using MLflow can help you keep track of experiment runs and results across frameworks, execute projects remotely on to a Databricks cluster, and quickly reproduce your runs, and more. Sign up for this webinar now.
Databricks, Life Cycle, Machine Learning, Workflow
4 Reasons Why Your Machine Learning Code is Probably Bad - Feb 26, 2019.
Your current ML workflow probably chains together several functions executed linearly. Instead of linearly chaining functions, data science code is better written as a set of tasks with dependencies between them. That is your data science workflow should be a DAG.
Data Science, Machine Learning, Programming, Python, Workflow
- KDnuggets™ News 19:n05, Jan 30: Your AI skills are worth less than you think; 7 Steps to Mastering Basic Machine Learning - Jan 30, 2019.
Also: Logistic Regression: A Concise Technical Overview; AI is a Big Fat Lie; How To Fine Tune Your Machine Learning Models To Improve Forecasting Accuracy; Airbnb Rental Listings Dataset Mining; Data Science Project Flow for Startups
AI, Hype, Logistic Regression, Machine Learning, Modeling, Python, Skills, Workflow
- Data Science Project Flow for Startups - Jan 24, 2019.
The aim of this post, then, is to present the characteristic project flow that I have identified in the working process of both my colleagues and myself in recent years. Hopefully, this can help both data scientists and the people working with them to structure data science projects in a way that reflects their uniqueness.
Data Science, Startups, Workflow
End To End Guide For Machine Learning Projects - Jan 14, 2019.
Let’s imagine you are attempting to work on a machine learning project. This article will provide you with the step to step guide on the process that you can follow to implement a successful project.
Machine Learning, Workflow
The Machine Learning Project Checklist - Dec 7, 2018.
In an effort to further refine our internal models, this post will present an overview of Aurélien Géron's Machine Learning Project Checklist, as seen in his bestselling book, "Hands-On Machine Learning with Scikit-Learn & TensorFlow."
Checklist, Machine Learning, Process, Workflow
- Webinar: How Google BigQuery and Looker Can Accelerate Your Data Science Workflow, Sep 19. - Sep 17, 2018.
Join Looker for this webcast, Sep 19, 2 PM EST, where you will learn how you can leverage Looker with the power of BigQuery Machine Learning (BQML) to build machine learning (ML) models directly where your data lives.
BigQuery, Data Science, Looker, Machine Learning, Workflow
- Webinar: How Google BigQuery and Looker Can Accelerate Your Data Science Workflow, Sep 19 - Sep 10, 2018.
Join Looker for this webcast, Sep 19, 2 PM EST, where you will learn how you can leverage Looker with the power of BigQuery Machine Learning (BQML) to build machine learning (ML) models directly where your data lives.
BigQuery, Data Science, Looker, Machine Learning, Workflow
- Emotion and Sentiment Analysis: A Practitioner’s Guide to NLP - Aug 24, 2018.
Sentiment analysis is widely used, especially as a part of social media analysis for any domain, be it a business, a recent movie, or a product launch, to understand its reception by the people and what they think of it based on their opinions or, you guessed it, sentiment!
NLP, Text Analytics, Workflow
- Named Entity Recognition: A Practitioner’s Guide to NLP - Aug 17, 2018.
Named entity recognition (NER) , also known as entity chunking/extraction , is a popular technique used in information extraction to identify and segment the named entities and classify or categorize them under various predefined classes.
NLP, Text Analytics, Workflow
Understanding Language Syntax and Structure: A Practitioner’s Guide to NLP - Aug 10, 2018.
Knowledge about the structure and syntax of language is helpful in many areas like text processing, annotation, and parsing for further operations such as text classification or summarization.
NLP, Text Analytics, Workflow
GitHub Python Data Science Spotlight: AutoML, NLP, Visualization, ML Workflows - Aug 8, 2018.
This post includes a wide spectrum of data science projects, all of which are open source and are present on GitHub repositories.
Automated Machine Learning, Data Science, Data Visualization, GitHub, Keras, Machine Learning, MLflow, NLP, Python, Workflow
- Text Wrangling & Pre-processing: A Practitioner’s Guide to NLP - Aug 3, 2018.
I will highlight some of the most important steps which are used heavily in Natural Language Processing (NLP) pipelines and I frequently use them in my NLP projects.
Data Preprocessing, Data Wrangling, NLP, Text Analytics, Workflow
- Data Retrieval with Web Scraping: A Practitioner’s Guide to NLP - Jul 26, 2018.
Proven and tested hands-on strategies to tackle NLP tasks.
Data Preprocessing, NLP, Text Analytics, Workflow
- Manage your Machine Learning Lifecycle with MLflow – Part 1 - Jul 5, 2018.
Reproducibility, good management and tracking experiments is necessary for making easy to test other’s work and analysis. In this first part we will start learning with simple examples how to record and query experiments, packaging Machine Learning models so they can be reproducible and ran on any platform using MLflow.
Databricks, Life Cycle, MLflow, Pipeline, Python, Workflow
The Keras 4 Step Workflow - Jun 4, 2018.
In his book "Deep Learning with Python," Francois Chollet outlines a process for developing neural networks with Keras in 4 steps. Let's take a look at this process with a simple example.
Francois Chollet, Keras, Neural Networks, Python, Workflow
- Modern Data Science Workflows, May 24 - May 16, 2018.
Learn how data scientists across have influenced and changed analysis behaviors across their companies, and get helpful tips for integrating data science findings into your organization decision making process.
Data Science, Looker, Workflow
- Principles of Guided Analytics - Mar 27, 2018.
KNIME outline their guided analytics system and explain how this can assist data scientists to predict future outcomes.
Analytics, Data Preparation, Knime, Michael Berthold, Workflow
- How to do Machine Learning Efficiently - Mar 13, 2018.
I now believe that there is an art, or craftsmanship, to structuring machine learning work and none of the math heavy books I tended to binge on seem to mention this.
Architecture, fast.ai, Machine Learning, Validation, Workflow
- Using AutoML to Generate Machine Learning Pipelines with TPOT - Jan 29, 2018.
This post will take a different approach to constructing pipelines. Certainly the title gives away this difference: instead of hand-crafting pipelines and hyperparameter optimization, and performing model selection ourselves, we will instead automate these processes.
Automated Machine Learning, Hyperparameter, Optimization, Pipeline, Python, scikit-learn, Workflow
- Managing Machine Learning Workflows with Scikit-learn Pipelines Part 3: Multiple Models, Pipelines, and Grid Searches - Jan 24, 2018.
In this post, we will be using grid search to optimize models built from a number of different types estimators, which we will then compare and properly evaluate the best hyperparameters that each model has to offer.
Data Preprocessing, Hyperparameter, Optimization, Pipeline, Python, scikit-learn, Workflow
- KDnuggets™ News 18:n04, Jan 24: TensorFlow vs XGBoost; Machine Learning Pipelines in Python; Semi-Supervised Machine Learning - Jan 24, 2018.
Gradient Boosting in TensorFlow vs XGBoost; Managing Machine Learning Workflows with Scikit-learn Pipelines Part 2; Using Genetic Algorithm for Optimizing Recurrent Neural Networks; The Value of Semi-Supervised Machine Learning; Comparing Machine Learning as a Service: Amazon, Microsoft Azure, Google Cloud AI
Gradient Boosting, Machine Learning, MLaaS, Pipeline, TensorFlow, Workflow, XGBoost
- Managing Machine Learning Workflows with Scikit-learn Pipelines Part 2: Integrating Grid Search - Jan 19, 2018.
Another simple yet powerful technique we can pair with pipelines to improve performance is grid search, which attempts to optimize model hyperparameter combinations.
Data Preprocessing, Hyperparameter, Optimization, Pipeline, Python, scikit-learn, Workflow
- Managing Machine Learning Workflows with Scikit-learn Pipelines Part 1: A Gentle Introduction - Dec 7, 2017.
Scikit-learn's Pipeline class is designed as a manageable way to apply a series of data transformations followed by the application of an estimator.
Data Preprocessing, Pipeline, Python, scikit-learn, Workflow
- Machine Learning with Optimus on Apache Spark - Nov 30, 2017.
The way most Machine Learning models work on Spark are not straightforward, and they need lots of feature engineering to work. That’s why we created the feature engineering section inside the Optimus Data Frame Transformer.
Pages: 1 2
Apache Spark, Data Science, Feature Engineering, Machine Learning, MLlib, Python, Workflow
- Machine Learning Workflows in Python from Scratch Part 2: k-means Clustering - Jun 7, 2017.
The second post in this series of tutorials for implementing machine learning workflows in Python from scratch covers implementing the k-means clustering algorithm.
Clustering, K-means, Machine Learning, Python, Workflow
Machine Learning Workflows in Python from Scratch Part 1: Data Preparation - May 29, 2017.
This post is the first in a series of tutorials for implementing machine learning workflows in Python from scratch, covering the coding of algorithms and related tools from the ground up. The end result will be a handcrafted ML toolkit. This post starts things off with data preparation.
Data Preparation, Machine Learning, Python, Workflow
- The steps in the machine learning workflow - Jul 28, 2016.
We outline preprocessing steps for finding, removing, and cleaning data to prepare it for machine learning and how tools like MATLAB can help with data exploration, identification of key traits, and communicating the findings.
Machine Learning, MathWorks, MATLAB, Workflow
- Data Mining Process/Workflow Reproducibility and KNIME - May 1, 2015.
What happens with analytics and data mining workflows when different components change? KNIME approach of keeping the old versions as part of the platform guarantees reproducibility.
Data Processing, Knime, Michael Berthold, Reproducibility, Workflow
- Webinar, Apr 3: Best Decision Trees just got better with Angoss KnowledgeSEEKER 9.0 - Mar 23, 2014.
This Apr 3 webinar will show how KnowledgeSEEKER 9.0 will make your modeling faster with automated workflow for building, refreshing, and reusing workflows - all with the click of a button.
Angoss, Decision Trees, KnowledgeSEEKER 9.0, Workflow
- Alpine Data expects faster, easier Data Science with Spark - Mar 18, 2014.
Alpine Data Labs becomes one of the first companies to be certified on Apache Spark, reported up to 100x faster than Hadoop. Alpine answers 3 questions from KDnuggets.
Alpine, Apache Spark, Collaborative, Databricks, Hadoop, Workflow
- Webinar: Best Decision Trees just got better with Angoss KnowledgeSEEKER 9.0, Apr 3 - Mar 14, 2014.
New KnowledgeSEEKER 9.0 makes your modeling faster with automated workflow for building, refreshing, and reusing workflows - all with the click of a button. Learn more on Apr 3.
Angoss, Decision Trees, KnowledgeSEEKER 9.0, Webinar, Workflow
