Tag: BERT (7)

• Deconstructing BERT, Part 2: Visualizing the Inner Workings of Attention - Mar 6, 2019.
  
  In this post, the author shows how BERT can mimic a Bag-of-Words model. The visualization tool from Part 1 is extended to probe deeper into the mind of BERT, to expose the neurons that give BERT its shape-shifting superpowers.

  Tags: Attention, BERT, NLP, Word Embeddings

• Deconstructing BERT: Distilling 6 Patterns from 100 Million Parameters - Feb 27, 2019.
  
  Google’s BERT algorithm has emerged as a sort of “one model to rule them all.” BERT builds on two key ideas that have been responsible for many of the recent advances in NLP: (1) the transformer architecture and (2) unsupervised pre-training.

  Tags: Attention, BERT, NLP, Word Embeddings

• KDnuggets™ News 19:n08, Feb 20: The Gold Standard of Python Machine Learning; The Analytics Engineer – new role in the data team - Feb 20, 2019.
  
  Intro to scikit-learn; how to set up a Python ML environment; why there should be a new role in the Data Science team; how to learn one of the hardest parts of being a Data Scientist; and how explainable is BERT?

  Tags: BERT, Python, scikit-learn

• Are BERT Features InterBERTible? - Feb 19, 2019.
  
  This is a short analysis of the interpretability of BERT contextual word representations. Does BERT learn a semantic vector representation like Word2Vec?

  Tags: BERT, Interpretability, NLP, Word Embeddings

• Artificial Intelligence and Data Science Advances in 2018 and Trends for 2019 - Feb 18, 2019.
  
  We recap some of the major highlights in data science and AI throughout 2018, before looking at the some of the potential newest trends and technological advances for the year ahead.

  Pages: 1 2

  Tags: 2019 Predictions, AI, AutoML, BERT, Data Science, Interpretability, Predictions, Trends

• What were the most significant machine learning/AI advances in 2018? - Jan 22, 2019.
  
  2018 was an exciting year for Machine Learning and AI. We saw “smarter” AI, real-world applications, improvements in underlying algorithms and a greater discussion on the impact of AI on human civilization. In this post, we discuss some of the highlights.

  Tags: 2019 Predictions, AI, AlphaZero, BERT, Deep Learning, Machine Learning, NLP, Trends

• 10 Exciting Ideas of 2018 in NLP - Jan 16, 2019.
  
  We outline a selection of exciting developments in NLP from the last year, and include useful recent papers and images to help further assist with your learning.

  Tags: BERT, Bias, ICLR, Machine Translation, NLP, Unsupervised Learning