Large Language Model Foundation & Retrieval Augmented Generation
Large language models (LLMs) have taken the tech world by storm, and everyone is rushing to adapt them for their use cases. These adaptations can be in the form of directly using vanilla models, fine-tuning (using algorithms such as PEFT-LoRA), and Retrieval Augmented Generation (RAG). Consider LLMs as someone progressing through life’s educational and professional stages: Phase 1 — Childhood/Adolescence (Foundational Models) : Like a student through to high school, foundational models (e.g., GPT, Llama, Gemini, etc.) possess a broad, general knowledge base...