Ask for Context in LLM

Ask for Context in LLMยถ

Summaryยถ

LLM(๋Œ€ํ˜• ์–ธ์–ด ๋ชจ๋ธ)์—์„œ ์ปจํ…์ŠคํŠธ ์š”์ฒญ์€ ์‚ฌ์šฉ์ž ์งˆ์˜์— ๋Œ€ํ•œ ์ •ํ™•ํ•œ ์‘๋‹ต์„ ์ œ๊ณตํ•˜๊ธฐ ์œ„ํ•ด ๋ชจ๋ธ์ด ์ถ”๊ฐ€์ ์ธ ์ •๋ณด๋ฅผ ํ•„์š”๋กœ ํ•˜๋Š” ๊ฒฝ์šฐ๋ฅผ ๋งํ•ฉ๋‹ˆ๋‹ค. ์ด ๊ฒฝ์šฐ, ๋ชจ๋ธ์€ ์‚ฌ์šฉ์ž ์งˆ์˜์™€ ๊ด€๋ จ๋œ ์ถ”๊ฐ€ ์ •๋ณด๋ฅผ ์š”์ฒญํ•˜๊ฑฐ๋‚˜, ์‚ฌ์ „์— ์ •์˜๋œ ์ปจํ…์ŠคํŠธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์‘๋‹ต์„ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. ์ปจํ…์ŠคํŠธ ์š”์ฒญ์€ ๋ชจ๋ธ์˜ ์ •ํ™•์„ฑ๊ณผ ์‹ ๋ขฐ์„ฑ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๋ฐ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค.

Key Conceptsยถ

  • ์ปจํ…์ŠคํŠธ ์š”์ฒญ: ์‚ฌ์šฉ์ž ์งˆ์˜์— ๋Œ€ํ•œ ์ •ํ™•ํ•œ ์‘๋‹ต์„ ์ œ๊ณตํ•˜๊ธฐ ์œ„ํ•ด ๋ชจ๋ธ์ด ์ถ”๊ฐ€์ ์ธ ์ •๋ณด๋ฅผ ํ•„์š”๋กœ ํ•˜๋Š” ๊ฒฝ์šฐ๋ฅผ ๋งํ•ฉ๋‹ˆ๋‹ค.

  • ์ปจํ…์ŠคํŠธ ์ œ๊ณต ๋ฐฉ๋ฒ•: ๋ชจ๋ธ์ด ์ปจํ…์ŠคํŠธ๋ฅผ ์ œ๊ณต๋ฐ›๋Š” ๋ฐฉ๋ฒ•์œผ๋กœ, RAG(retrieve-augment-generate)์™€ ๊ฐ™์€ ๊ธฐ๋ฒ•์„ ์‚ฌ์šฉํ•˜์—ฌ ๊ด€๋ จ๋œ ์ •๋ณด๋ฅผ ๊ฒ€์ƒ‰ํ•˜๊ณ  ๋ชจ๋ธ์— ์ œ๊ณตํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • ์ปจํ…์ŠคํŠธ์˜ ์ค‘์š”์„ฑ: ๋ชจ๋ธ์˜ ์ •ํ™•์„ฑ๊ณผ ์‹ ๋ขฐ์„ฑ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๋ฐ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค.

Referencesยถ

URL Name

URL

Reddit - How to know when to give context to LLM using RAG

https://www.reddit.com/r/LocalLLaMA/comments/17jcr5a/how_to_know_when_to_give_context_to_llm_using_rag/

Stack Overflow - LLMโ€™s answering out of context (trained on user data)

https://stackoverflow.com/questions/76751579/llms-answering-out-of-context-trained-on-user-data

Symbl.ai - Guide to Context in LLMs

https://symbl.ai/developers/blog/guide-to-context-in-llms/

Microsoft Learn - Getting started with LLM prompt engineering

https://learn.microsoft.com/en-us/ai/playbook/technology-guidance/generative-ai/working-with-llms/prompt-engineering

Chariot Solutions - From RAGs to Riches - Adding Context to Your LLM

https://chariotsolutions.com/blog/post/from-rags-to-riches-adding-context-to-your-llm/