Neural language models, and an explanation of recurrent neural networks
Chapters
0:00 Introduction
1:54 Neural N-Gram Models
6:03 Recurrent Neural Networks
11:47 LSTM Cells
12:22 Outro
Publications similaires
How might LLMs store facts | DL7
Parn0cadminhttps://www.youtube.com/watch?v=9-Jl0dxWQs8 AI Alignment forum post from the Deepmind researchers referenced at the video’s start:https://www.alignmentforum.org/posts/… Anthropic posts about superposition referenced near the end:https://transformer-circuits.pub/2022…https://transformer-circuits.pub/2023… Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading listhttps://www.alignmentforum.org/posts/… Getting started in mechanistic interpretabilityhttps://www.neelnanda.io/mechanistic-… An interactive demo of sparse autoencoders (made…
The Most Important Algorithm in Machine Learning
Parn0cadminIn this video we will talk about backpropagation – an algorithm powering the entire field of machine learning and try to derive it from first principles. OUTLINE:00:00 Introduction01:28 Historical background02:50 Curve Fitting problem06:26 Random vs guided adjustments09:43 Derivatives14:34 Gradient Descent16:23 Higher dimensions21:36 Chain Rule Intuition27:01 Computational Graph and Autodiff36:24 Summary38:16 Shortform39:20 Outro Jürgen Schmidhuber’s blog…
Artificial Intelligence Full Course 2024 | AI & Machine Learning Full Course
Parn0cadminThis video on the Artificial Intelligence full course video cover all the topics you need to know to become a master in AI and ML. It covers all the basics of Machine Learning, the different types of Machine Learning, and the various applications of Machine Learning used in different industries. This video will also help…
What does it mean for computers to understand language? | LM1
Parn0cadminAn introduction to language modeling, followed by an explanation of the N-Gram language model! Sources (includes the entire series): https://docs.google.com/document/d/1e… Chapters0:00 Introduction1:39 What is NLP?2:45 What is a Language Model?4:38 N-Gram Language Model7:20 Inference9:18 Outro
Artificial Intelligence Tutorial | Artificial Intelligence Full Course | AI Tutorial
Parn0cadminThis video on the Artificial Intelligence tutorial will make you learn in detail about the different concepts involved in AI. You will understand the basics of AI and get an idea about Machine Learning and Deep Learning with hands-on demo in this Artificial Intelligence full course. You will look at how to become an AI…
Stanford CS236: Deep Generative Models I 2023 I Lecture 1 – Introduction
Parn0cadminTo follow along with the course, visit the course website:https://deepgenerativemodels.github.io/ Stefano ErmonAssociate Professor of Computer Science, Stanford Universityhttps://cs.stanford.edu/~ermon/ https://www.youtube.com/watch?v=XZ0PMRWXBEU