Section
Llama
The latest Llama coverage from Bullquill: sourced, dated and explained.
2 POSTSUPDATED
IndexDate · Title · Reading time
No articles in this language here yet. Showing English.
-
How to Fine-Tune an LLM with LoRA and QLoRA on a Single GPU
A practical walkthrough of parameter-efficient fine-tuning: format a chat dataset, train 4-bit QLoRA adapters on Llama 3.1 8B with Hugging Face PEFT and TRL, check VRAM needs, evaluate against the base model, merge the adapter and decide when fine-tuning beats RAG or prompting.
-
How to run a local LLM with Ollama on macOS, Windows or Linux
A hands-on guide to running a private, offline AI model with Ollama: what hardware you need, how to install it, pick a quantized model, save a custom system prompt and call the local API from curl and Python.
