[2023-4] 우리는 각자의 세계가 된다
·
📚 Book
David Eagleman
[M1] Installing lxml for Python on an M1/M2 Mac
·
💻 Mac
Error1 ) python 버전 issue https://til.simonwillison.net/python/lxml-m1-mac Installing lxml for Python on an M1/M2 Mac I ran into this error while trying to run pip install lxml on an M2 Mac, inside a virtual environment I had intitially created using pipenv shell : til.simonwillison.net Error2 ) error: command '/Library/Developer/CommandLineTools/usr/bin/clang++' failed with exit code 1 mujoco ..
[LangChain] Sentence-Transformer
·
🗣️ Natural Language Processing
https://www.sbert.net/docs/pretrained_models.html Pretrained Models — Sentence-Transformers documentation We provide various pre-trained models. Using these models is easy: Multi-Lingual Models The following models generate aligned vector spaces, i.e., similar inputs in different languages are mapped close in vector space. You do not need to specify the input www.sbert.net LangChain과 같이 사용할 수 있는..
[OpenAI API] OpenAI Token
·
🗣️ Natural Language Processing
https://github.com/seohyunjun/openAI_API_token GitHub - seohyunjun/openAI_API_token: openAI API token information openAI API token information. Contribute to seohyunjun/openAI_API_token development by creating an account on GitHub. github.com
[LangChain] No using OpenAI API RetrievalQA
·
🗣️ Natural Language Processing
LangChain No using OpenAI API (1) QA를 위한 Document 불러오기 # Load and process the text files # loader = TextLoader("./data/texts") loader = DirectoryLoader('./pdf/', glob="./*.pdf", loader_cls=PyPDFLoader) documents = loader.load() # Document 분절 text_splitter = RecursiveCharacterTextSplitter(chunk_size=1000, chunk_overlap=200) texts = text_splitter.split_documents(documents) (2) Embedding # HuggingF..
[Mac] Transformer model downloaded path
·
🗣️ Natural Language Processing
https://discuss.huggingface.co/t/where-is-the-model-path-on-macos/21376 macOS의 모델 경로는 어디에 있습니까?AutoModelxxx를 사용하여 모델을 다운로드했지만 모델이 저장된 경로를 찾을 수 없습니다. 어디에 있습니까, os 코드로 어떻게 찾을 수 있습니까? discuss.huggingface.co Transformer 다운로드 모델 경로 ~/.cache/huggingface/hub/ ~/.cache/huggingface/hub/ 안쓰는 모델 제거 rm -rf [model]
[LangChain] Retrieval PDF
·
🗣️ Natural Language Processing
Retrieval PDF PDF 문서 embedding - vectorize db와 비교 - similar score - retreival document (1) Pagkage Import from langchain.vectorstores import Chroma from langchain.text_splitter import RecursiveCharacterTextSplitter from langchain.llms import OpenAI from langchain.chains import RetrievalQA from langchain.document_loaders import TextLoader from langchain.document_loaders import PyPDFLoader from la..
[LangChain] Building Custom Tool
·
🗣️ Natural Language Processing
Default import os os.environ['OPENAI_API_KEY'] = 'sk-...' Building Custom Tools 1) Package Import from langchain import OpenAI from langchain.chat_models import ChatOpenAI from langchain.chains.conversation.memory import ConversationBufferWindowMemory # callback cost from langchain.callbacks import get_openai_callback 2) llm model 설정 turbo_llm = ChatOpenAI( temperature = 0, model_name = 'gpt-3.5..
다했다
'분류 전체보기' 카테고리의 글 목록 (20 Page)