PyTorch in 2019 and where in Europe you can learn about PyTorch in 2020
The Reinforce AI Conference is coming to Budapest again. Join us Apr 6-7 for the conference days, and optionally Apr 8 for workshops. Stefan Otte returns as a speaker, while Francois Chollet joins this time as well.
2019 was another big year for PyTorch, one of the most popular Deep Learning libraries out there. PyTorch has become the de facto deep learning library used for research thanks to its dynamic graph model which allows fast model experimentation. It’s also became production ready, with support for mobile and infrastructure tooling such as Tensorboard. Google Trends shows increasing interest as measured by searches for PyTorch in 2019:
PyTorch version 1.0 was released in late December, 2018. Since then, we’ve seen numerous minor releases, and it’s already up to version 1.3.1. Significant new features include:
- Tensorboard support: visualization and tooling needed for ML experimentation, for example tracking metrics such as loss and accuracy.
- Mobile support: run any TorchScript model directly on Android/iOS, without conversion.
- Extended ONNX support: ONNX is an open format to represent deep learning models. With ONNX, AI developers can more easily move models between state-of-the-art tools and choose the combination that is best for them.
- and 100s of other improvements...
A number of PyTorch books came out in 2019 to help programmers and data scientists get started. There is Programming PyTorch for Deep Learning by Ian Pointer, and Natural Language Processing with PyTorch by Delip Rao, both published by O’Reilly. Coming out soon is Deep Learning with PyTorch by Eli Stevens (Manning).
Thanks to the community, milestone Deep Learning results have implementations in PyTorch:
- AlphaGo Zero (Reinforcement Learning) in PyTorch:
- GPT natural language model in PyTorch:
- GAN models:
- NVIDIA style transfer model:
- Standard vision models:
In 2019 we had another PyTorch developer conference in San Francisco, where Tesla’s Andrej Karpathy shared how the automaker uses PyTorch to power their deep learning based self-driving architecture that relies solely on cameras.
In Europe, the best place to learn about Pytorch in 2019 was at the Reinforce Conference in Budapest! We had Stefan Otte doing a great tutorial style presentation, voted one of the best talks of the conference. Reinforce is returning in 2020, as is Stefan Otte, speaking about PyTorch once again. And to see the whole picture Francois Chollet will talk about Keras while others on Tensor flow. Join us April 6-7 for the conference days, and optionally April 8 for workshops, in Budapest again!