[Pinecone] llama-index with Pinecone
ยท
๐Ÿ—ฃ๏ธ Natural Language Processing
Llama-Index with Pinecone ์ด ๋…ธํŠธ๋ถ์—์„œ๋Š” semantic-search๋ฅผ ์œ„ํ•ด Pinecone๊ณผ llama-index(์ด์ „์˜ GPT-index) ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ๋ณด์—ฌ์ค€๋‹ค. ์ด ๋…ธํŠธ๋ถ์€ llama-index์˜ ์˜ˆ์‹œ์ด๋ฉฐ ํ–ฅํ›„ ๋ฆด๋ฆฌ์Šค์—์„œ๋Š” Pinecone ์˜ˆ์ œ ์ €์žฅ์†Œ์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. 1) install packages !pip install -qU llama-index datasets pinecone-client openai transformers 2) SQuAD dataset Load Wikipedia(context-title) from datasets import load_dataset data = load_dataset('squad', split='train') d..
๋‹คํ–ˆ๋‹ค
'llama-index' ํƒœ๊ทธ์˜ ๊ธ€ ๋ชฉ๋ก