1. FM_Prompt Engineering

1. FM_Prompt Engineeringยถ

Summaryยถ

Prompt engineering์€ LLM์˜ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ค๊ธฐ ์œ„ํ•ด ์ž…๋ ฅ ์ฟผ๋ฆฌ๋‚˜ ์ง€์นจ์„ ์กฐ์ž‘ํ•˜๋Š” ๊ธฐ์ˆ ์ž…๋‹ˆ๋‹ค. ์ด๋Š” LLM์ด ์›ํ•˜๋Š” ์ถœ๋ ฅ์„ ์ƒ์„ฑํ•˜๋„๋ก ์œ ๋„ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. ํšจ๊ณผ์ ์ธ ํ”„๋กฌํ”„ํŠธ ์—”์ง€๋‹ˆ์–ด๋ง์€ LLM์˜ ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ์™€ ๊ตฌ์กฐ๋ฅผ ์ดํ•ดํ•˜๊ณ , ์–ธ์–ด ํ•ด์„์˜ ๋ฏธ๋ฌ˜ํ•œ ๋ถ€๋ถ„์„ ๊ณ ๋ คํ•˜๋ฉฐ, ์ง€์†์ ์ธ ํ…Œ์ŠคํŠธ์™€ ํ‰๊ฐ€๋ฅผ ํ†ตํ•ด ํ”„๋กฌํ”„ํŠธ๋ฅผ ๊ฐœ์„ ํ•˜๋Š” ๊ฒƒ์„ ํฌํ•จํ•ฉ๋‹ˆ๋‹ค.

Key Conceptsยถ

  • Prompt Engineering : LLM์˜ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ค๊ธฐ ์œ„ํ•ด ์ž…๋ ฅ ์ฟผ๋ฆฌ๋‚˜ ์ง€์นจ์„ ์กฐ์ž‘ํ•˜๋Š” ๊ธฐ์ˆ .

  • Transparency of Prompts : ํ”„๋กฌํ”„ํŠธ์˜ ํˆฌ๋ช…์„ฑ์ด LLM์˜ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๋ฐ ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.

  • Hyperparameters Tuning : LLM์˜ ์„ฑ๋Šฅ์„ ์กฐ์ •ํ•˜๊ธฐ ์œ„ํ•ด hyperparameters(์˜ˆ: temperature, top-K tokens, embeddings, architecture)๋ฅผ ์กฐ์ •ํ•˜๋Š” ๊ธฐ์ˆ .

  • Iterative Process : ํ”„๋กฌํ”„ํŠธ ์—”์ง€๋‹ˆ์–ด๋ง์€ ์ง€์†์ ์ธ ํ…Œ์ŠคํŠธ์™€ ํ‰๊ฐ€๋ฅผ ํ†ตํ•ด ํ”„๋กฌํ”„ํŠธ๋ฅผ ๊ฐœ์„ ํ•˜๋Š” ๋ฐ˜๋ณต์ ์ธ ํ”„๋กœ์„ธ์Šค์ž…๋‹ˆ๋‹ค.

Referencesยถ

URL Name

URL

Prompt-Engineering for Open-Source LLMs - YouTube

https://www.youtube.com/watch?v=f32dc5M2Mn0

Applying Prompt Engineering To leverage LLMs Like ChatGPT & Bard

https://techpearl.com/blog/applying-prompt-engineering-to-leverage-llms-like-chatgpt-bard/

Prompt engineering: A guide to improving LLM performance - CircleCI

https://circleci.com/blog/prompt-engineering/

Beginnerโ€™s Guide to Engineering Prompts for LLMs - Oracle Blogs

https://blogs.oracle.com/ai-and-datascience/post/beginners-guide-engineering-prompts-llm

Prompt Engineering Guide

https://www.promptingguide.ai