Similar Posts
Transformers (how LLMs work) explained visually | DL5
If you’re interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from…
Jeff Dean (Google): Exciting Trends in Machine Learning
Abstract: In this talk I’ll highlight several exciting trends in the field of AI and machine learning. Through a combination of improved algorithms and major efficiency improvements in ML-specialized hardware, we are now able to build much more capable, general purpose machine learning systems than ever before. As one example of this, I’ll give an…
But what is a neural network? | Deep learning chapter 1
What are the neurons, why are there layers, and what is the math underlying it? Typo correction: At 14 minutes 45 seconds, the last index on the bias vector is n, when it’s supposed to in fact be a k. Thanks for the sharp eyes that caught that! There are two neat things about this…
What are Transformer Models and how do they work?
This is the last of a series of 3 videos where we demystify Transformer models and explain them with visuals and friendly examples. 00:00 Introduction01:50 What is a transformer?04:35 Generating one word at a time08:59 Sentiment Analysis13:05 Neural Networks18:18 Tokenization19:12 Embeddings25:06 Positional encoding27:54 Attention32:29 Softmax35:48 Architecture of a Transformer39:00 Fine-tuning42:20 Conclusion
Introduction to Generative AI
What is generative AI? Not sure where to begin? Check out this short course! We’ll take you through the basics of generative AI including common applications, model types, and the fundamentals of how you can use it. Discover the power behind this technology and see how it’s changing the way we solve problems, and tell…
LangChain vs LangGraph: A Tale of Two Frameworks
Get ready for a showdown between LangChain and LangGraph, two powerful frameworks for building applications with large language models (LLMs.) Master Inventor Martin Keen compares the two, taking a look at their unique features, use cases, and how they can help you create innovative, context-aware solutions.
