CM3leon(.Meta)
ยท
๐Ÿ‘พ Deep Learning
CM3leon: Multi-modal Generative AI ์ตœ๊ทผ ๋ช‡ ๋‹ฌ ๋™์•ˆ ์ƒ์„ฑ AI ๋ชจ๋ธ ๋ถ„์•ผ์—์„œ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ์™€ ์ด๋ฏธ์ง€ ์ƒ์„ฑ์„ ์ค‘์‹ฌ์œผ๋กœ ์ƒ๋‹นํ•œ ๋ฐœ์ „์ด ์ด๋ฃจ์–ด์กŒ์Šต๋‹ˆ๋‹ค. ๊ทธ ์ค‘ ํ•˜๋‚˜์ธ CM3leon์€ ์ด๋ฏธ์ง€์—์„œ ํ…์ŠคํŠธ๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ํ…์ŠคํŠธ์—์„œ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ๋Š” ๋‹ค์ค‘ ๋ชจ๋‹ฌ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. CM3leon์— ๋Œ€ํ•œ 3๊ฐ€์ง€ ์ฃผ์š” ์ธ์‚ฌ์ดํŠธ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค: CM3leon์€ ๋‹ค์ค‘ ๋ชจ๋‹ฌ ๋ชจ๋ธ๋กœ์„œ ํ…์ŠคํŠธ-์ด๋ฏธ์ง€ ์ƒ์„ฑ์—์„œ ์ตœ์ฒจ๋‹จ ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜๋Š” ๋‹ค์žฌ๋‹ค๋Šฅํ•˜๊ณ  ํšจ์œจ์ ์ธ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์ด์ „์˜ ํŠธ๋žœ์Šคํฌ๋จธ ๊ธฐ๋ฐ˜ ๋ชจ๋ธ๋ณด๋‹ค ์ ์€ ์ปดํ“จํŒ… ํŒŒ์›Œ๋กœ ํ›ˆ๋ จ๋˜์—ˆ์Œ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ , CM3leon์€ ํ’ˆ์งˆ๊ณผ ํšจ์œจ์„ฑ ์ธก๋ฉด์—์„œ ๋Šฅ๊ฐ€ํ•ฉ๋‹ˆ๋‹ค. CM3leon์€ ๋งˆ์Šคํฌ๋œ ํ˜ผํ•ฉ ๋ชจ๋‹ฌ(CM3) ๋ชจ๋ธ๋กœ, ๋‹ค๋ฅธ ์ด๋ฏธ์ง€์™€ ํ…์ŠคํŠธ ์ฝ˜ํ…์ธ ์˜ ์ž„์˜์˜ ์‹œํ€€์Šค์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ํ…..
[2023-13] ํ•˜๋ฒ„๋“œ 100๋…„ ์ „ํ†ต ๋งํ•˜๊ธฐ ์ˆ˜์—…
ยท
๐Ÿ“š Book
์ œ๋ชฉ: ํ•˜๋ฒ„๋“œ 100๋…„ ์ „ํ†ต ๋งํ•˜๊ธฐ ์ˆ˜์—… ์ €์ž: ๋ฅ˜๋ฆฌ๋‚˜ keyword ๊ฐ๋™, ๋Œ€ํ™”, ์ž…์žฅ, ์ „๋‹ฌ, ๊ฐ์ •, ํ™”, ์Šค์œ„์Šค, ๋ง์ปจ ์—ฐ์„ค, 7๋ถ„ ๊ด€๋ จ ์ž๋ฃŒ ๊ฒŒํ‹ฐ์ฆˆ ๋ฒ„๊ทธ ์—ฐ์„ค - ๊ฐ€์žฅ ์งง์€ ์—ฐ์„ค์ด์ž ๊ฐ€์žฅ ์˜ค๋ž˜ ๊ธฐ์–ต๋  ์—ฐ์„ค https://youtu.be/pPZd-HsSDrE ์Šค์œ„์Šค์˜ ๊ตฐ๋Œ€ - https://www.youtube.com/watch?v=aYI1mmU4Wiw ๋งˆํฌ ํŠธ์›จ์ธ ์ผํ™” - https://blog.naver.com/stgstg/220394964708 ๋งˆํฌ ํŠธ์›จ์ธ์ด ํ—Œ๊ธˆ ๋ฐ”๊ตฌ๋‹ˆ์—์„œ 2๋‹ฌ๋Ÿฌ๋ฅผ ๊บผ๋‚ด๊ฐ„ ์ด์•ผ๊ธฐ --- ์‚ผ์„ฑํ…Œํฌ๋…ธ๊ธ€๋ผ์Šค ์‚ผ์„ฑํ…Œํฌ๋…ธ๊ธ€๋ผ์Šค(http://stgstg.blog.me )(http://stg7.koreasme.com ) ๋Œ€ํ‘œ ์ด๋™์—ด์ž…๋‹ˆ๋‹ค. ์˜ค๋Š˜ ์‚ผ์„ฑ์ „์ž... blog.naver.com
[PEP 703] Making the Global Interpreter Lock Optional in CPython
ยท
๐Ÿ Python
https://peps.python.org/pep-0703/ [PEP 703 – Making the Global Interpreter Lock Optional in CPython | peps.python.org In CPython, the global interpreter lock protects against corruption of internal interpreter states when multiple threads concurrently access or modify Python objects. For example, if multiple threads concurrently modify the same list, the GIL ensures that peps.python.org](https:/..
Browser templates for Browser In The Browser (BITB) attack
ยท
๐Ÿƒ Routine
https://github.com/mrd0x/BITB GitHub - mrd0x/BITB: Browser In The Browser (BITB) Templates Browser In The Browser (BITB) Templates. Contribute to mrd0x/BITB development by creating an account on GitHub. github.com Browser in the Browser Attack = ๋ธŒ๋ผ์šฐ์ € ์•ˆ ๋ธŒ๋ผ์šฐ์ € ๋ง ๊ทธ๋Œ€๋กœ ๋ธŒ๋ผ์šฐ์ € ์•ˆ์— ๋ธŒ๋ผ์šฐ์ €๋ฅผ ๋งŒ๋“ค์–ด ๊ฐ€์งœ ๋กœ๊ทธ์ธ ์ฐฝ์ด๋‚˜ ์ง„์งœ ํ™ˆํŽ˜์ด์ง€ ์ฒ˜๋Ÿผ ์†์—ฌ ๋กœ๊ทธ์ธ ์ •๋ณด๋ฅผ ํƒˆ์ทจํ•˜๋Š” ๊ธฐ๋ฒ•์ด๋‹ค. ์‚ฌ์šฉ์ž๋Š” ์œ ์‚ฌ ๋กœ๊ทธ์ธ ์ฐฝ์„ ์˜์‹ฌ ์—†์ด ๋กœ๊ทธ์ธ ์ฐฝ์œผ๋กœ ๋ณด๊ณ  ๋กœ๊ทธ์ธ์„ ํ•˜๊ฒŒ ๋œ๋‹ค. ์™œ๋ƒ? ์œ ์‚ฌ ๋กœ๊ทธ์ธ ์ฐฝ์˜ ๋„๋ฉ”์ธ ๋˜ํ•œ ์ง„์งœ doma..
The Path to Achieve Ultra-Low Inference Latency With LLaMA 65B on PyTorch/XLA
ยท
๐Ÿ—ฃ๏ธ Natural Language Processing
BACKGROUND & STATE OF THE ART ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ(NLP) ์˜์—ญ์—์„œ ์–ธ์–ด ๋ชจ๋ธ์€ ๊ณผ๊ฑฐ ์ž…๋ ฅ ํ† ํฐ์˜ ์‹œํ€€์Šค๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ† ํฐ(์˜ˆ: ๋‹จ์–ด)์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. ๋Œ€์šฉ๋Ÿ‰ ์–ธ์–ด ๋ชจ๋ธ(Large Language Models, LLMs)์€ ์ด ๊ณต๊ฐ„์—์„œ์˜ ์ตœ์‹  ๋”ฅ๋Ÿฌ๋‹ ํ˜์‹ ์œผ๋กœ, ์ธ๊ฐ„๊ณผ ์œ ์‚ฌํ•œ ๋ฐฉ์‹์œผ๋กœ ํ…์ŠคํŠธ๋ฅผ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•ด ์„ค๊ณ„๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ๋ชจ๋ธ์€ ์ผ๋ฐ˜์ ์œผ๋กœ ์ž…๋ ฅ ํ† ํฐ์˜ ํฐ ์‹œํ€€์Šค์— ๋Œ€ํ•œ ์ฃผ์˜๋ฅผ ๊ฐœ์„ ํ•˜๊ธฐ ์œ„ํ•ด transformer๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. LLaMA๋Š” 1์กฐ ๊ฐœ ์ด์ƒ์˜ ํ† ํฐ์œผ๋กœ ํ›ˆ๋ จ๋œ ๊ฐ•๋ ฅํ•œ ๊ธฐ๋ฐ˜ LLM์œผ๋กœ, Meta AI์—์„œ ์˜คํ”ˆ ์†Œ์Šค๋กœ ์ œ๊ณต๋ฉ๋‹ˆ๋‹ค. LLaMA๋Š” GPT-3, Chinchilla, PaLM๊ณผ ๊ฐ™์€ ๋งŽ์€ ์ตœ๊ณ ์˜ ๋ชจ๋ธ๊ณผ ๊ฒฝ์Ÿ๋ ฅ์„ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. LLaMA (13B)๋Š” GPT..
[2023-12] ๋ฏธ๋ฃจ๊ธฐ์˜ ๊ธฐ์ˆ 
ยท
๐Ÿ“š Book
์ œ๋ชฉ: "๋ฏธ๋ฃจ๊ธฐ์˜ ๊ธฐ์ˆ " ์ €์ž: ์กด ํŽ˜๋ฆฌ keyword To-do list ์ž‘์„ฑ, ๋ฏธ๋ฃจ์—ˆ์„ ๋•Œ ์ด๋ฃจ์–ด์ง€๋Š” ๊ฒฐ๊ณผ๋ฅผ ์ƒ์ƒํ•˜๊ธฐ, ๋ฏธ๋ฃจ๊ณ  ์žˆ๋Š” ์ž์‹ ์„ ์ธ์ง€ํ•˜๊ณ  ํ•ด๊ฒฐ ๋ฐฉ๋ฒ• ๋– ์˜ฌ๋ฆฌ๊ธฐ, ์ฒด๊ณ„์ ์ธ ๋ฏธ๋ฃจ๊ธฐ, ์•„์นจ ์Œ์•… ๊ด€๋ จ ์ž๋ฃŒ http://philosophytalk.org/ Philosophy Talk The program that questions everything...except your intelligence. www.philosophytalk.org https://www.youtube.com/watch?v=iZGdEafl4sg
๋‹คํ–ˆ๋‹ค
B's