[NotesOllama] Mac Default Memo Application + OpenLLM(Custom)
ยท
๐Ÿ› ๏ธ Tools
NotesOllama๋กœ Mac ๋ฉ”๋ชจ์žฅ์—์„œ ์ž๋™ ํ•œ๊ธ€ ๋ฒˆ์—ญ์„ ์‚ฌ์šฉํ•ด๋ณด์ž! NotesOllama๋Š” ๋ฉ”๋ชจ์žฅ์—์„œ OpenLLM ๊ตฌ๋™ํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•ด์ฃผ๋Š” Application์ด๋‹ค. Obsidia Ollama์—์„œ ์˜๊ฐ์„ ๋ฐ›์•„ ๋งŒ๋“ค์—ˆ๋‹ค๊ณ  ํ•œ๋‹ค. Good~ ์‚ฌ์šฉ ์š”๊ตฌ์‚ฌํ•ญ์€ Ollama๊ฐ€ ๊ตฌ๋™ ๋˜์–ด์•ผํ•œ๋‹ค. ๊ฐ์„ค ์ œ์™ธ~ ํ•˜๊ณ  ๋ฐ”๋กœ Go~ 1) Ollama ์„ค์น˜ https://ollama.com/download Download Ollama on macOS Download Ollama on macOS ollama.com 2) NotesOllama ์„ค์น˜ https://smallest.app/notesollama/ NotesOllama NotesCmdr Slash commands, markdown and templates for ..
[Pinecone] llama-index with Pinecone
ยท
๐Ÿ—ฃ๏ธ Natural Language Processing
Llama-Index with Pinecone ์ด ๋…ธํŠธ๋ถ์—์„œ๋Š” semantic-search๋ฅผ ์œ„ํ•ด Pinecone๊ณผ llama-index(์ด์ „์˜ GPT-index) ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ๋ณด์—ฌ์ค€๋‹ค. ์ด ๋…ธํŠธ๋ถ์€ llama-index์˜ ์˜ˆ์‹œ์ด๋ฉฐ ํ–ฅํ›„ ๋ฆด๋ฆฌ์Šค์—์„œ๋Š” Pinecone ์˜ˆ์ œ ์ €์žฅ์†Œ์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. 1) install packages !pip install -qU llama-index datasets pinecone-client openai transformers 2) SQuAD dataset Load Wikipedia(context-title) from datasets import load_dataset data = load_dataset('squad', split='train') d..
The Path to Achieve Ultra-Low Inference Latency With LLaMA 65B on PyTorch/XLA
ยท
๐Ÿ—ฃ๏ธ Natural Language Processing
BACKGROUND & STATE OF THE ART ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ(NLP) ์˜์—ญ์—์„œ ์–ธ์–ด ๋ชจ๋ธ์€ ๊ณผ๊ฑฐ ์ž…๋ ฅ ํ† ํฐ์˜ ์‹œํ€€์Šค๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ† ํฐ(์˜ˆ: ๋‹จ์–ด)์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. ๋Œ€์šฉ๋Ÿ‰ ์–ธ์–ด ๋ชจ๋ธ(Large Language Models, LLMs)์€ ์ด ๊ณต๊ฐ„์—์„œ์˜ ์ตœ์‹  ๋”ฅ๋Ÿฌ๋‹ ํ˜์‹ ์œผ๋กœ, ์ธ๊ฐ„๊ณผ ์œ ์‚ฌํ•œ ๋ฐฉ์‹์œผ๋กœ ํ…์ŠคํŠธ๋ฅผ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•ด ์„ค๊ณ„๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ๋ชจ๋ธ์€ ์ผ๋ฐ˜์ ์œผ๋กœ ์ž…๋ ฅ ํ† ํฐ์˜ ํฐ ์‹œํ€€์Šค์— ๋Œ€ํ•œ ์ฃผ์˜๋ฅผ ๊ฐœ์„ ํ•˜๊ธฐ ์œ„ํ•ด transformer๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. LLaMA๋Š” 1์กฐ ๊ฐœ ์ด์ƒ์˜ ํ† ํฐ์œผ๋กœ ํ›ˆ๋ จ๋œ ๊ฐ•๋ ฅํ•œ ๊ธฐ๋ฐ˜ LLM์œผ๋กœ, Meta AI์—์„œ ์˜คํ”ˆ ์†Œ์Šค๋กœ ์ œ๊ณต๋ฉ๋‹ˆ๋‹ค. LLaMA๋Š” GPT-3, Chinchilla, PaLM๊ณผ ๊ฐ™์€ ๋งŽ์€ ์ตœ๊ณ ์˜ ๋ชจ๋ธ๊ณผ ๊ฒฝ์Ÿ๋ ฅ์„ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. LLaMA (13B)๋Š” GPT..
๋‹คํ–ˆ๋‹ค
'Llama' ํƒœ๊ทธ์˜ ๊ธ€ ๋ชฉ๋ก