Yoel Zeldes

AI21 Labs

Algorithm Engineer at AI21 Labs, in the mission of building AI systems with the capacity to understand and generate natural language.

GPT-3, a giant step for Deep Learning and NLP?

By Yoel Zeldes, AI21 Labs on June 9, 2020 in AI, Deep Learning, GPT-2, GPT-3, NLP, OpenAI
Recently, OpenAI announced a new successor to their language model, GPT-3, that is now the largest model trained so far with 175 billion parameters. Training a language model this large has its merits and limitations, so this article covers some of its most interesting and important aspects.
Variational Autoencoders Explained in Detail

By Yoel Zeldes, AI21 Labs on November 30, 2018 in Autoencoder, Deep Learning, Machine Learning, MNIST, TensorFlow
We explain how to implement VAE - including simple to understand tensorflow code using MNIST and a cool trick of how you can generate an image of a digit conditioned on the digit.
How to Engineer Your Way Out of Slow Models

By Yoel Zeldes, AI21 Labs on November 27, 2018 in Deep Learning, Scalability
We describe how we handle performance issues with our deep learning models, including how to find subgraphs that take a lot of calculation time and how to extract these into a caching mechanism.
Word Morphing – an original idea

By Yoel Zeldes, AI21 Labs on November 20, 2018 in NLP, Python, Text Classification
In this post, we describe how to utilise word2vec's embeddings and A* search algorithm to morph between words.
Using Uncertainty to Interpret your Model

By Yoel Zeldes, AI21 Labs on November 16, 2018 in Explainable AI, Interpretability, Taboola, Uncertainty
We outline why you should care about uncertainty and discuss the different types, including model, data and measurement uncertainty and what different purposes these all serve.
Linear Regression in the Wild

By Yoel Zeldes, AI21 Labs on October 3, 2018 in Algorithms, Linear Regression, Python
We take a look at how to use linear regression when the dependent variables have measurement errors.

Yoel Zeldes

Latest Posts

Top Posts