Neural language models, and an explanation of recurrent neural networks
Chapters
0:00 Introduction
1:54 Neural N-Gram Models
6:03 Recurrent Neural Networks
11:47 LSTM Cells
12:22 Outro
Similar Posts
Reliable, fully local RAG agents with LLaMA3.2-3b
Byn0cadminLLaMA3.2 has released a new set of compact models designed for on-device use cases, such as locally running assistants. Here, we show how LangGraph can enable these types of local assistant by building a multi-step RAG agent – this combines ideas from 3 advanced RAG papers (Adaptive RAG, Corrective RAG, and Self-RAG) into a single…
Backpropagation calculus | DL4
Byn0cadminThis one is a bit more symbol-heavy, and that’s actually the point. The goal here is to represent in somewhat more formal terms the intuition for how backpropagation works in part 3 of the series, hopefully providing some connection between that video and other texts/code that you come across later. For more on backpropagation:http://neuralnetworksanddeeplearning….https://github.com/mnielsen/neural-ne…http://colah.github.io/posts/2015-08-… https://colah.github.io/posts/2015-08-Backprop
What does it mean for computers to understand language? | LM1
Byn0cadminAn introduction to language modeling, followed by an explanation of the N-Gram language model! Sources (includes the entire series): https://docs.google.com/document/d/1e… Chapters0:00 Introduction1:39 What is NLP?2:45 What is a Language Model?4:38 N-Gram Language Model7:20 Inference9:18 Outro
Stanford CS229 Machine Learning I Introduction I 2022 I Lecture 1
Byn0cadminFor more information about Stanford’s Artificial Intelligence programs visit: https://stanford.io/ai https://www.youtube.com/watch?v=Bl4Feh_Mjvo To follow along with the course, visit:https://cs229.stanford.edu/syllabus-s… Tengyu MaAssistant Professor of Computer Sciencehttps://ai.stanford.edu/~tengyuma/ Christopher RéAssociate Professor of Computer Sciencehttps://cs.stanford.edu/~chrismre/
The math behind Attention: Keys, Queries, and Values matrices
Byn0cadminThis is the second of a series of 3 videos where we demystify Transformer models and explain them with visuals and friendly examples. 00:00 Introduction01:18 Recap: Embeddings and Context04:46 Similarity11:09 Attention20:46 The Keys and Queries Matrices25:02 The Values Matrix28:41 Self and Multi-head attention33:54: Conclusion
Introduction to Generative AI
Byn0cadminWhat is generative AI? Not sure where to begin? Check out this short course! We’ll take you through the basics of generative AI including common applications, model types, and the fundamentals of how you can use it. Discover the power behind this technology and see how it’s changing the way we solve problems, and tell…