Artificial Intelligence

Artificial intelligence, sub-disciplines of artificial intelligence, and methodologies used in artificial intelligence and machine learning.

Blog
Artificial Intelligence
Chuong Ngo
April 29, 2021
Artificial Intelligence

Neural Network Compositionality: A Sum of Its Parts

Machine learning means that a computer can learn from experience without being specifically programmed. But, is the computer learning the right things?
Chuong Ngo
April 15, 2021
Artificial Intelligence

Transformers: The Nuts and Bolts

Gears, servos, and circuits, oh my! So, many things go into a Transformer! So many things to examine! Oh...wait...that’s the wrong Transformer.
Chuong Ngo
April 8, 2021
Artificial Intelligence

Transformers: An Unexpected NLP Revolution

When you need to go faster, but RNNs cannot keep up. Whom do you call? Transformers, of course.
Chuong Ngo
April 1, 2021
Artificial Intelligence

Convolutional Neural Networks: Machine Learning's Eye

Let’s take a step back and examine a machine learning architecture that has become the go-to for image recognition and computer vision.
Chuong Ngo
March 25, 2021
Artificial Intelligence

NTM: Memories Under the Hood

Memory is essential to NTMs. So, understanding NTMs’ memory addressing system is a must.
Chuong Ngo
March 18, 2021
Artificial Intelligence

Neural Turing Machine: The Power of Memory

We have added attention and gates to our neural networks. Now, let’s revolutionize machine learning with memory.
Chuong Ngo
March 11, 2021
Artificial Intelligence

Gated Recurrent Unit: The Other White Meat

LSTMs fix vanishing and exploding gradients, but LSTMs are not the only architectures that do that.
Chuong Ngo
March 4, 2021
Artificial Intelligence

The Long Short-Term Memory Network

LSTMs are widely used in machine learning now. What are they? How do they work?
Chuong Ngo
February 25, 2021
Artificial Intelligence

Backpropagation: Training Neural Networks

Backpropagation is so commonplace in neural network training that it is easy to take it for granted. But what is it?
Chuong Ngo
February 4, 2021
Artificial Intelligence

Generalizable Variations of the Attention Mechanism

Applying the attention principle to more tasks meant that the attention mechanism had to be modified.
Chuong Ngo
December 1, 2020
Artificial Intelligence

The Attention Mechanism for Neural NLP Models

The attention mechanism has become widespread in neural NLP modeling, but where did it come from?