About Yoel Zeldes
Algorithm Engineer at AI21 Labs, in the mission of building AI systems with the capacity to understand and generate natural language.
Yoel Zeldes Posts (7)

GPT3, a giant step for Deep Learning and NLP?  09 Jun 2020
Recently, OpenAI announced a new successor to their language model, GPT3, that is now the largest model trained so far with 175 billion parameters. Training a language model this large has its merits and limitations, so this article covers some of its most interesting and important aspects.

Preparing for the Unexpected  28 Feb 2019
In some domains, new values appear all the time, so it's crucial to handle them in a good way. Using deep learning, one can learn a special OutofVocabulary embedding for these new values. But how can you train this embedding to generalize well to any unseen value? We explain one of the methods employed at Taboola.

Variational Autoencoders Explained in Detail  30 Nov 2018
We explain how to implement VAE  including simple to understand tensorflow code using MNIST and a cool trick of how you can generate an image of a digit conditioned on the digit.

How to Engineer Your Way Out of Slow Models  27 Nov 2018
We describe how we handle performance issues with our deep learning models, including how to find subgraphs that take a lot of calculation time and how to extract these into a caching mechanism.

Word Morphing – an original idea  20 Nov 2018
In this post, we describe how to utilise word2vec's embeddings and A* search algorithm to morph between words.

Using Uncertainty to Interpret your Model  16 Nov 2018
We outline why you should care about uncertainty and discuss the different types, including model, data and measurement uncertainty and what different purposes these all serve.

Linear Regression in the Wild  03 Oct 2018
We take a look at how to use linear regression when the dependent variables have measurement errors.