About Yoel Zeldes

Algorithm Engineer at AI21 Labs, in the mission of building AI systems with the capacity to understand and generate natural language.

Yoel Zeldes Posts (7)

• GPT-3, a giant step for Deep Learning and NLP? - 09 Jun 2020
  
  Recently, OpenAI announced a new successor to their language model, GPT-3, that is now the largest model trained so far with 175 billion parameters. Training a language model this large has its merits and limitations, so this article covers some of its most interesting and important aspects.
• Preparing for the Unexpected - 28 Feb 2019
  
  In some domains, new values appear all the time, so it's crucial to handle them in a good way. Using deep learning, one can learn a special Out-of-Vocabulary embedding for these new values. But how can you train this embedding to generalize well to any unseen value? We explain one of the methods employed at Taboola.
• Variational Autoencoders Explained in Detail - 30 Nov 2018
  
  We explain how to implement VAE - including simple to understand tensorflow code using MNIST and a cool trick of how you can generate an image of a digit conditioned on the digit.
• How to Engineer Your Way Out of Slow Models - 27 Nov 2018
  
  We describe how we handle performance issues with our deep learning models, including how to find subgraphs that take a lot of calculation time and how to extract these into a caching mechanism.
• Word Morphing – an original idea - 20 Nov 2018
  
  In this post, we describe how to utilise word2vec's embeddings and A* search algorithm to morph between words.
• Using Uncertainty to Interpret your Model - 16 Nov 2018
  
  We outline why you should care about uncertainty and discuss the different types, including model, data and measurement uncertainty and what different purposes these all serve.
• Linear Regression in the Wild - 03 Oct 2018
  
  We take a look at how to use linear regression when the dependent variables have measurement errors.