RAG vs. Fine Tuning

Attention mechanisms are crucial to the huge boom LLMs have recently had.In this video you’ll see a friendly pictorial explanation of how attention mechanisms work in Large Language Models.This is the first of a series of three videos on Transformer models. https://www.youtube.com/watch?v=OxCpWwDCDFQ

Learn prompt engineering techniques to get better results from ChatGPT and other LLMs.

Dec 3, 2024One-day workshop on topics in Generative AI IISc-IBM AI Day is being jointly organized by the Centre for Networked Intelligence (with support from Cisco CSR) and IBM-IISc Hybrid Cloud Lab, in collaboration with IBM India Research Lab. The goal of this workshop would be to apprise the audience of Generative AI, a set…

If you’re interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from…

To learn more, I highly recommend the book by Michael Nielsenhttp://neuralnetworksanddeeplearning….The book walks through the code behind the example in these videos, which you can find here:https://github.com/mnielsen/neural-ne… MNIST database:http://yann.lecun.com/exdb/mnist/ Also check out Chris Olah’s blog:http://colah.github.io/His post on Neural networks and topology is particular beautiful, but honestly all of the stuff there is great. And if…

Generative AI Agents represent the current frontier of LLM technology, enabling dynamic interactions and intelligent workflow automation. However, the complexities of architecting and deploying these agents can be daunting. In this live session, Patrick Marlow demystifies the process, guiding you through the critical decisions and trade-offs involved in building production-ready agents. Explore the full spectrum…