Publications similaires
What is a Generative AI Agent?
Parn0cadminGenerative AI Agents represent the current frontier of LLM technology, enabling dynamic interactions and intelligent workflow automation. However, the complexities of architecting and deploying these agents can be daunting. In this live session, Patrick Marlow demystifies the process, guiding you through the critical decisions and trade-offs involved in building production-ready agents. Explore the full spectrum…
CS50x 2024 – Artificial Intelligence
Parn0cadminThis is CS50, Harvard University’s introduction to the intellectual enterprises of computer science and the art of programming. TABLE OF CONTENTS 00:00:00 – Welcome00:01:01 – Introduction00:03:13 – Image Generation00:08:23 – ChatGPT00:11:06 – Prompt Engineering00:12:40 – CS50.ai00:19:03 – Generative AI00:22:08 – Decision Trees00:26:33 – Minimax00:34:27 – Machine Learning00:42:56 – Deep Learning00:48:53 – Large Language Models00:53:36 –…
The math behind Attention: Keys, Queries, and Values matrices
Parn0cadminThis is the second of a series of 3 videos where we demystify Transformer models and explain them with visuals and friendly examples. 00:00 Introduction01:18 Recap: Embeddings and Context04:46 Similarity11:09 Attention20:46 The Keys and Queries Matrices25:02 The Values Matrix28:41 Self and Multi-head attention33:54: Conclusion
Transformers (how LLMs work) explained visually | DL5
Parn0cadminIf you’re interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from…
