LLM Engineering Handbook
Intro
LLM Engineering ์ค์
0. Prologue - What is LLM
1. Transformer ์ํคํ ์ณ
2. Auto-regressive ๋ชจ๋ธ
3. DPO, RLHF
Template example
1. FM_Prompt Engineering
Benchmarking
Foundation Models
LLM์ ํ๋กฌํํธ ์์ง๋์ด๋ง ๊ธฐ๋ณธ
์ํ๋ง๊ณผ ๊ตฌ์กฐํ๋ ์์๋ผ์ธ
Template example
2. Vector DB in LLM
Embedding Models
Ingesting in LLM
Splitting in LLM
Vector DB in LLM
3. Orchestration, RAG
LLM ํ๊ฐ
๋ฉ๋ชจ๋ฆฌ(Memory) in LLM
Orchestrators
Retrievers in LLM
4. Advanced Prompt Engineering
Ask for Context in LLM
Least to most
Tree of Thoughts
5. Advanced RAG
LLM์ ํ์ฒ๋ฆฌ(Post-processing)
Query Construction in LLM
6. Deployment
Demo in LLM
Edge in LLM
Local in LLM
์๋ฒ
7. Inference Optimization
KV-Cache
Quantization in LLM
8. Security - Hacking & Guardrails in LLM
ํ๋กฌํํธ ๊ฐ๋๋ ์ผ(Prompt Guardrail)
ํ๋กฌํํธ ํดํน(Prompt Hacking)
9. Agents and Tools in LLM
์์ด์ ํธ(Agents) in LLM
Reflections in LLM
์ฌ์ฉ์ ๋๊ตฌ
10. Finetuning For Llms
Finetuning Basics
LoRA
11. Embedding And Model Combining
Combining Multiple Models (Ensemble) in LLM
Customize Embeddings & Model Architecture
12. Extra materials
์์ฆ ํ๋ก์ ํธ
Season 2
์ฌ์ํ - Semantle ์ผ๋ณธ์ด ๋ฒ์ ๊ฐ๋ฐ ๊ณผ์ ๊ณผ ์ผ๋ณธ์ด ์์ฐ์ด์ฒ๋ฆฌ์ ๋ํ ๊ณ ๋ฏผ
์์๋ฏผ - ์ง์๊ทธ๋ํ ๊ธฐ์ด
์๊ธฐํ - LLama + Lora ๋ฆฌ๋ทฐ
๋ฐ์ง์ฌ - Custom Sentimental NER Model
์ค์ฉ์ Paper Reading Assistant
NCWD - ์ฝ์งํ๋ ์ค๊ธฐ
๋ฐ์ง์ฌ CustomerNER
์๊ธฐํ - LLM for Daicon
์ฌ์ํ - Sementle Japanese, Play the Game with LLM
์ค์ฉ์ Paper Reading Assistant 2
์ดํ๊ท LLM์ ํ์ฉํ ํ๋กฌํํธ ๊ธฐ๋ฐ์ ๋ฏธ๋์ด์ํธ ์ ์ํด
์ดํ๊ท - ์ง๊ธ๊น์ง์ ๋ฉํ๋ฒ์ค๋ ์์ด๋ผ
๋ฐ์ง์ฌ - Project Moogeul
repository
open issue
Index