Turning an eye towards LLMs
I’ve worked with the Nvidia Jetson family of products professionally to deploy software on the edge. But it’s been a while since I last had to set one up for development and deployment. Setting one of these devices up took more time and precision …
What is RAG (and why you might want it) Retrieval-Augmented Generation (RAG) is a lightweight pattern that lets an LLM “look things up” before it answers. Instead of hoping the model remembers everything, you index your own docs (PDFs, notes, …
With LoRA (Low-Rank Adaptation), we aim to fine-tune large language models efficiently without updating all the model’s parameters. Instead, we train small adapter weights that “steer” the model toward new tasks, styles, or voices—keeping costs low …
I wanted to start my journey into the LLM-verse by going back to the basics — revisiting the key ideas from Attention Is All You Need and Language Models are Unsupervised Multitask Learners. My plan for this first step was simple: Prepare a dataset …