- Inside the Architecture Powering Data Quality Management at Uber - Feb 22, 2021.
Data Quality Monitor implements novel statistical methods for anomaly detection and quality management in large data infrastructures.
Architecture, Data Quality, Uber
- Working With The Lambda Layer in Keras - Jan 28, 2021.
In this tutorial we'll cover how to use the Lambda layer in Keras to build, save, and load models which perform custom operations on your data.
Architecture, Keras, Neural Networks, Python
- Math and Architectures of Deep Learning! - Jul 15, 2020.
This hands-on book bridges the gap between theory and practice, showing you the math of deep learning algorithms side by side with an implementation in PyTorch. Save 50% with code kdarch50.
Architecture, Deep Learning, Manning, Mathematics, PyTorch
- Using Neural Networks to Design Neural Networks: The Definitive Guide to Understand Neural Architecture Search - Oct 14, 2019.
A recent survey outlined the main neural architecture search methods used to automate the design of deep learning systems.
Architecture, Automated Machine Learning, Neural Networks
Activation maps for deep learning models in a few lines of code - Oct 10, 2019.
We illustrate how to show the activation maps of various layers in a deep CNN model with just a couple of lines of code.
Architecture, Deep Learning, Neural Networks, Python
- Multi-Task Learning – ERNIE 2.0: State-of-the-Art NLP Architecture Intuitively Explained - Oct 2, 2019.
The tech giant Baidu unveiled its state-of-the-art NLP architecture ERNIE 2.0 earlier this year, which scored significantly higher than XLNet and BERT on all tasks in the GLUE benchmark. This major breakthrough in NLP takes advantage of a new innovation called “Continual Incremental Multi-Task Learning”.
AISC, Architecture, Multitask Learning, NLP
- Examining the Transformer Architecture: The OpenAI GPT-2 Controversy - Jun 20, 2019.
GPT-2 is a generative model, created by OpenAI, trained on 40GB of Internet to predict the next word. And OpenAI found this model to be SO good that they did not release the fully trained model due to their concerns about malicious applications of the technology.
AI, Architecture, GPT-2, NLP, OpenAI, Transformer
- Evolving Deep Neural Networks - Jun 18, 2019.
This article reviews how evolutionary algorithms have been proposed and tested as a competitive alternative to address a number of issues related to neural network design.
Architecture, Automated Machine Learning, Evolutionary Algorithm, Neural Networks
Beginners Ask “How Many Hidden Layers/Neurons to Use in Artificial Neural Networks?” - Jul 16, 2018.
By the end of this article, you could at least get the idea of how these questions are answered and be able to test yourself based on simple examples.
Architecture, Deep Learning, Hyperparameter, Neural Networks
- Is ReLU After Sigmoid Bad? - Mar 23, 2018.
Recently [we] were analyzing how different activation functions interact among themselves, and we found that using relu after sigmoid in the last two layers worsens the performance of the model.
Architecture, Neural Networks
- How to do Machine Learning Efficiently - Mar 13, 2018.
I now believe that there is an art, or craftsmanship, to structuring machine learning work and none of the math heavy books I tended to binge on seem to mention this.
Architecture, fast.ai, Machine Learning, Validation, Workflow
The 8 Neural Network Architectures Machine Learning Researchers Need to Learn - Jan 31, 2018.
In this blog post, I want to share the 8 neural network architectures from the course that I believe any machine learning researchers should be familiar with to advance their work.
Pages: 1 2
Architecture, Deep Learning, Machine Learning, Neural Networks
Game Theory Reveals the Future of Deep Learning - Dec 29, 2016.
This post covers the emergence of Game Theoretic concepts in the design of newer deep learning architectures. Deep learning systems need to be adaptive to imperfect knowledge and coordinating systems, 2 areas with which game theory can help.
Architecture, Deep Learning, Optimization
- A Reference Architecture for Self-Service Analytics - Nov 10, 2016.
The keys to self-service analytics success are organizational. In addition to a governed self-service architecture, companies need to establish governance committees and gateways, create federated organizations with co-located BI developers, and provide continuous education, training, and support. Learn how to do this in this report.
Analytics, Architecture, Self-service
- In Deep Learning, Architecture Engineering is the New Feature Engineering - Jul 19, 2016.
A discussion of architecture engineering in deep neural networks, and its relationship with feature engineering.
Architecture, Deep Learning, Feature Engineering, Neural Networks
- Interview: Thanigai Vellore, Art.com on Delivering Contextually Relevant Search Experience - Jul 23, 2015.
We discuss the role of Analytics at Art.com, the polyglot data architecture at Art.com, the use cases for Hadoop, vendor selection, supporting semantic search and experience with Avro.
Architecture, Art.com, Avro, Hadoop, HBase, Interview, Semantic Analysis, Solr, Thanigai Vellore
- Interview: Sastry Malladi, StubHub on Designing Big Data Architecture for the Unknown Future - Jul 28, 2014.
We discuss the Big Data architecture at StubHub, important factors in architecture design, hybrid approach of using Big Data along with traditional data warehouses, challenges, importance of meta-data and more.
Architecture, Challenges, Design, Hadoop, Interview, Metadata, Personalization, Recommendation, Sastry Malladi, StubHub
