Tree of Thoughts

Tree of Thoughtsยถ

Summaryยถ

Tree of Thoughts (ToT)๋Š” ๋Œ€ํ˜• ์–ธ์–ด ๋ชจ๋ธ(Large Language Model, LLM)์˜ ๋ฌธ์ œ ํ•ด๊ฒฐ ๋Šฅ๋ ฅ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ํ”„๋ ˆ์ž„์›Œํฌ์ž…๋‹ˆ๋‹ค. ์ด ์ ‘๊ทผ ๋ฐฉ์‹์€ ์ธ๊ฐ„์˜ ์‚ฌ๊ณ  ์ „๋žต์„ ๋ชจ๋ฐฉํ•˜์—ฌ LLM์ด ์—ฌ๋Ÿฌ ๊ฐ€์ง€ ์ž ์žฌ์  ์†”๋ฃจ์…˜์„ ์ฒด๊ณ„์ ์œผ๋กœ ํƒ์ƒ‰ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ฉ๋‹ˆ๋‹ค. ToT๋Š” ์‚ฌ๊ณ ๋ฅผ ํŠธ๋ฆฌ ๊ตฌ์กฐ๋กœ ํ‘œํ˜„ํ•˜์—ฌ, ๊ฐ ๋…ธ๋“œ๊ฐ€ ์ค‘๊ฐ„ ๋‹จ๊ณ„์˜ ์‚ฌ๊ณ ๋ฅผ ๋‚˜ํƒ€๋‚ด๊ณ , ์ด ์‚ฌ๊ณ ๋ฅผ ํ‰๊ฐ€ํ•˜๊ณ  ์ˆ˜์ •ํ•˜๋Š” ๊ณผ์ •์„ ํ†ตํ•ด ์ตœ์ข… ์†”๋ฃจ์…˜์— ๋„๋‹ฌํ•ฉ๋‹ˆ๋‹ค. ์ด ํ”„๋ ˆ์ž„์›Œํฌ๋Š” LLM์ด ๋ณต์žกํ•œ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•  ๋•Œ, ํŠนํžˆ ์ˆ˜ํ•™์ , ์ƒ์ง•์ , ์ƒ์‹์ , ์ง€์‹์  ์ถ”๋ก ์ด ํ•„์š”ํ•œ ๊ฒฝ์šฐ์— ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค.

Key Conceptsยถ

  • Tree of Thoughts (ToT) : LLM์ด ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•  ๋•Œ, ์—ฌ๋Ÿฌ ๊ฐ€์ง€ ์ž ์žฌ์  ์†”๋ฃจ์…˜์„ ์ฒด๊ณ„์ ์œผ๋กœ ํƒ์ƒ‰ํ•˜๋Š” ํ”„๋ ˆ์ž„์›Œํฌ์ž…๋‹ˆ๋‹ค.

  • Thought Decomposer : ํฐ ๋ฌธ์ œ๋ฅผ ์ž‘์€ ๋‹จ๊ณ„๋กœ ๋‚˜๋ˆ„๋Š” ๋ชจ๋“ˆ์ž…๋‹ˆ๋‹ค.

  • Thought Generator : ํ˜„์žฌ ์‚ฌ๊ณ ์—์„œ ๋‹ค์Œ ๋‹จ๊ณ„์˜ ํ›„๋ณด๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋ชจ๋“ˆ์ž…๋‹ˆ๋‹ค.

  • State Evaluator : ํ›„๋ณด ์‚ฌ๊ณ ์˜ ๊ฐ€์น˜๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ๋ชจ๋“ˆ์ž…๋‹ˆ๋‹ค.

  • Search Algorithm : ํŠธ๋ฆฌ ๊ตฌ์กฐ๋ฅผ ํƒ์ƒ‰ํ•˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜์œผ๋กœ, Breadth-First Search (BFS)์™€ Depth-First Search (DFS)๊ฐ€ ํฌํ•จ๋ฉ๋‹ˆ๋‹ค.