Vector DB in LLM

Vector DB in LLMยถ

Summaryยถ

Vector DB๋Š” LLM(๋Œ€ํ˜• ์–ธ์–ด ๋ชจ๋ธ)์˜ ํ•ต์‹ฌ ๊ตฌ์„ฑ ์š”์†Œ๋กœ, ๊ณ ์ฐจ์› ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฅผ ํšจ์œจ์ ์œผ๋กœ ์ €์žฅํ•˜๊ณ  ๊ฒ€์ƒ‰ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ, ์ถ”์ฒœ ์‹œ์Šคํ…œ, ์ปดํ“จํ„ฐ ๋น„์ „ ๋“ฑ ๋‹ค์–‘ํ•œ AI ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์—์„œ ์‚ฌ์šฉ๋˜๋ฉฐ, ํŠนํžˆ LLM์—์„œ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค. ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋Š” ๋ฌธ์„œ์˜ ์˜๋ฏธ์  ๋‚ด์šฉ์„ ์ดํ•ดํ•˜๊ณ , ๊ด€๋ จ๋œ ๋ฌธ์„œ๋ฅผ ๊ฒ€์ƒ‰ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋˜๋ฉฐ, LLM์ด ๋” ์ •ํ™•ํ•˜๊ณ  ์œ ์šฉํ•œ ์‘๋‹ต์„ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ๋„๋ก ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.

Key Conceptsยถ

  • Vector DB์˜ ์ •์˜ : ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋Š” ๊ณ ์ฐจ์› ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฅผ ์ €์žฅํ•˜๊ณ  ๊ฒ€์ƒ‰ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋˜๋Š” ํŠน์ˆ˜ํ•œ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค์ž…๋‹ˆ๋‹ค.

  • LLM์—์„œ์˜ ์—ญํ•  : ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋Š” LLM์ด ๋ฌธ์„œ์˜ ์˜๋ฏธ์  ๋‚ด์šฉ์„ ์ดํ•ดํ•˜๊ณ , ๊ด€๋ จ๋œ ๋ฌธ์„œ๋ฅผ ๊ฒ€์ƒ‰ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค.

  • ๋ฒกํ„ฐ ์ž„๋ฒ ๋”ฉ : ๋ฒกํ„ฐ ์ž„๋ฒ ๋”ฉ์€ ๋ฌธ์„œ์˜ ์˜๋ฏธ์  ๋‚ด์šฉ์„ ๋ฒกํ„ฐ๋กœ ํ‘œํ˜„ํ•˜๋Š” ๋ฐฉ๋ฒ•์œผ๋กœ, ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค์—์„œ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค.

  • ์œ ์‚ฌ์„ฑ ๊ฒ€์ƒ‰ : ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋Š” ์œ ์‚ฌ์„ฑ ๊ฒ€์ƒ‰์„ ์ง€์›ํ•˜์—ฌ, LLM์ด ๊ด€๋ จ๋œ ๋ฌธ์„œ๋ฅผ ๊ฒ€์ƒ‰ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

Referencesยถ

URL ์ด๋ฆ„

URL

Reddit - Generating useful context for llm

https://www.reddit.com/r/vectordatabase/comments/1cm7xcn/generating_useful_context_for_llm/

Reddit - Is LLM necessary for RAG if we can retreive answer from vectorโ€ฆ

https://www.reddit.com/r/LocalLLaMA/comments/1avayel/is_llm_necessary_for_rag_if_we_can_retreive/

CrateDB - LLM Vector Database: What is a Vector Databases for LLM

https://cratedb.com/blog/llm-vector-database-what-is-a-vector-databases-for-llm

Qwak - Integrating Vector Databases with LLMs: A Hands-On Guide

https://www.qwak.com/post/utilizing-llms-with-embedding-stores

Stack Overflow - use embeddings stored in vector db to reduce work for LLM

https://stackoverflow.com/questions/78023750/use-embeddings-stored-in-vector-db-to-reduce-work-for-llm-generating-response