[NVIDIA RIVA ASR] ์„ค์น˜ ๊ฐ€์ด๋“œ (feat.nvidia-riva-sdk)
ยท
๐Ÿ‘พ Deep Learning
Step-1 Service-maker ๋ชจ๋ธ ์ƒ์„ฑ ngc ๋“ฑ๋ก 1. ngc ๊ฐ€์ž… 2. nvcr.io์— API ๋“ฑ๋ก docker login nvcr.io # Username: $oauthtoken # Password: [ngc API KEY] service-maker๋กœ ์›ํ•˜๋Š” ๋ชจ๋ธ ์ƒ์„ฑ (STT) 1. git clone riva demo 2. ngc pull riva_quickstart ngc registry resource download-version "nvidia/riva/riva_quickstart:2.8.1" 3. riva network set docker network create riva-speech 4. config ํŒŒ์ผ ์ˆ˜์ • asr_acoustic_model=citrinet_1024 5. ํ•œ..
[from numba.np.ufunc import _internalSystemError: initialization of _internal failed without raising an exception] numpy version Error
ยท
๐Ÿ‘พ Deep Learning
nunmba ์‚ฌ์šฉ์‹œ Vectorize, GUVectorize, vectorize, guvectoriz์—์„œ numpy==1.24 ํ˜ธํ™˜์„ฑ ์—๋Ÿฌ File "/home/ai/.local/lib/python3.8/site-packages/numba/__init__.py", line 42, in from numba.np.ufunc import (vectorize, guvectorize, threading_layer, File "/home/ai/.local/lib/python3.8/site-packages/numba/np/ufunc/__init__.py", line 3, in from numba.np.ufunc.decorators import Vectorize, GUVectorize, vectorize, guvect..
[ASR, ] Deepspeech2
ยท
๐Ÿ‘พ Deep Learning
Model Info ์ค‘๊ตญ Baidu์—์„œ ๊ณต๊ฐœํ•œ End-to-End ์Œ์„ฑ์ธ์‹ ๋ชจ๋ธ(2015.12) ์Œ์„ฑ๋ฐ์ดํ„ฐ์— Melspectrograms์„ ์ ์šฉ Fourier Transform์‹œ ๋ฐœ์ƒํ•˜๋Š” ๊ฐ ์Œ์„ฑ feature์˜ ์œ„์น˜๋ฅผ ํŒŒ์•…ํ•  ์ˆ˜ ์—†๋‹ค. STFT(short time fourier transform)์„ ์ ์šฉ, ์Œ์„ฑ feature๋ฅผ ์ข์€ ๋‹จ์œ„๋กœ FT๋ฅผ ์ ์šฉํ•ด feature์˜ ์œ„์น˜๋ฅผ ๋ฐ˜์˜ ์‚ฌ๋žŒ์€ ์ €์ฃผํŒŒ์ˆ˜์— ๋Œ€ํ•ด ๋ฏผ๊ฐํžˆ ์ž˜ ํŒŒ์•…ํ•œ๋‹ค. ๊ณ ์ฃผํŒŒ์ˆ˜์— ๋Œ€ํ•œ ์Œ์„ฑ์€ ์ž˜ ์ธ์‹ํ•˜์ง€ ๋ชปํ•œ๋‹ค. ์ฃผํŒŒ์ˆ˜๋ฅผ ์‚ฌ๋žŒ์˜ ์ธ์‹๋‹จ์œ„๋กœ mel scale ๋ณ€ํ™˜ Mel(f) = 2595 * log(1+ f / 700) Mel feature๋ฅผ CNN๊ณผ RNN์„ ๊ฑฐ์นœ ๋’ค CTC(Connectionist Temporal Classification)์„ ..
[2023Langcon] ํ›„๊ธฐ
ยท
๐Ÿƒ Routine
https://festa.io/events/3097 2023Langcon | Festa! Festa์—์„œ ๋‹น์‹ ์ด ์ฐพ๋Š” ์ด๋ฒคํŠธ๋ฅผ ๋งŒ๋‚˜๋ณด์„ธ์š”. festa.io ์ด๋ฒˆ์— LangCon์— ์ฒ˜์Œ์œผ๋กœ ์ฐธ์—ฌํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค. 2๋…„์ „๋งŒ ํ•ด๋„ BERT ๋ชจ๋ธ๋ง์€ ๊ฟˆ๋„ ๋ชป๊พธ๋Š” ์‹œ์ ˆ์ด ์žˆ์—ˆ๋‹ค. ์ด ์‹œ๊ธฐ์— LangCon์„ ์•Œ๊ณ  ์žˆ์—ˆ์ง€๋งŒ NLP ์ž…๋ฌธ ๊ณผ์ •์ด๋ผ ์ฐธ์—ฌํ•˜์ง€ ๋ชปํ–ˆ๋‹ค. ์‚ฌ์‹ค ์ด๋ฒˆ LangCon์€ KoELECTRA, KLUE BERT๋กœ ์œ ๋ช…ํ•˜์‹  monologg(์žฅ์›ํŒ)๋‹˜์˜ ๋ฐœํ‘œ ์„ธ์…˜์ด ์žˆ์–ด ์ฐธ์—ฌํ•˜๊ฒŒ๋˜์—ˆ๋‹ค. BERT๋ฅผ ์ ‘ํ–ˆ๋‹ค๋ฉด KoBERT-Transformers๋ฅผ ํ•œ๋ฒˆ ์ฏค ๋ณด์•˜์„ ๊ฒƒ์ด๋‹ค. BERT์žฅ์ธ์œผ๋กœ Vocab ๋งŒ๋“ค๊ธฐ ๋ถ€ํ„ฐ Fine-Tuning๊นŒ์ง€ NLP ๋ณ‘์•„๋ฆฌ๋“ค์—๊ฒŒ๋Š” ์ •๋ง ์ข‹์€ ๊ฐ€์ด๋“œ๋ผ์ธ์„ ๋งŒ๋“ค์–ด ์ฃผ์…จ๋‹ค. 1) ์šฐ๋ฆฐ ๋จธ์‹ ๊ณผ ์–ด๋–ป..
[Naver Cloud Server] ํ™ˆํŽ˜์ด์ง€ ์ œ์ž‘ - (2) ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ ๊ฐ€์ƒ์„œ๋ฒ„ ๊ธฐ๋ฐ˜ ์›น์‚ฌ์ดํŠธ ๋ฐ ๊ฐœ์ธ๋„์„œ๊ด€ ์„œ๋น„์Šค ๊ตฌ์ถ•ํ•˜๊ธฐ
ยท
๐Ÿƒ Routine
์ด๋ฒˆ 2ํšŒ์ฐจ๋Š” ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ ์„œ๋ฒ„๋ฅผ ํ†ตํ•ด ํฌํŠธํด๋ฆฌ์˜ค ์›น ํŽ˜์ด์ง€ ๋งŒ๋“œ๋Š” ๋ฒ•์„ ๋ฐฐ์› ๋‹ค. ** ์„œ๋ฒ„ ์‚ฌ์šฉ์‹œ ์ฃผ์˜ ์‚ฌํ•ญ(๊บผ์ง„ ๋ถˆ๋„ ๋‹ค์‹œ๋ณด๊ธฐ) ๋ฆฌ์†Œ์Šค ์ฒดํฌ ํ•ญ์ƒํ•˜๊ธฐ Web Securiy Checker (400,000โ‚ฉ , ์‹ค์‹œ๊ฐ„ ์„œ๋ฒ„ ๋ชจ๋‹ˆํ„ฐ๋ง, notification ์ง€์›) ์š”๊ธˆ ๊ณ„์‚ฐ๊ธฐ, ์‚ฌ์šฉ๋‚ด์šฉ ์ฒดํฌ(https://www.ncloud.com/mypage/status/usage) ์›น ํŽ˜์ด์ง€ ๋ฌด๋ฃŒ ํ…œํ”Œ๋ฆฟ ๋ฐฐํฌ ์‚ฌ์ดํŠธ kogma (๋ฌด๋ฃŒ ๋„์„œ ๋ฐฐํฌ) https://komga.org/guides/#komga-supports-these-media-file-types https://github.com/gotson/komga https://github.com/gotson/komga/releases What is Komga?..
[Naver Cloud Server] ํ™ˆํŽ˜์ด์ง€ ์ œ์ž‘ - (1) ํด๋ผ์šฐ๋“œ ์ปดํ“จํŒ…๊ณผ ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ ๊ฐ€์ƒ์„œ๋ฒ„ ๊ตฌ์ถ•ํ•ด๋ณด๊ธฐ
ยท
๐Ÿƒ Routine
https://festa.io/events/3103 ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ ์„œ๋น„์Šค๋กœ ์›น์‚ฌ์ดํŠธ ๊ตฌ์ถ• ๋ฐ ์‹œ๊ฐํ™” ์„œ๋น„์Šค ๊ตฌํ˜„ํ•ด ๋ณด๊ธฐ (์ž…๋ฌธ) | Festa! Festa์—์„œ ๋‹น์‹ ์ด ์ฐพ๋Š” ์ด๋ฒคํŠธ๋ฅผ ๋งŒ๋‚˜๋ณด์„ธ์š”. festa.io ์ด๋ฒˆ festa ๋ชจ์ง‘์—์„œ ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ๋ฅผ ์ด์šฉํ•ด AWS์™€ ๊ฐ™์ด ์„œ๋ฒ„๋ฅผ ํ˜ธ์ŠคํŒ…ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ๋ฐฐ์šฐ๊ฒŒ ๋˜์—ˆ๋‹ค. 1ํšŒ์ฐจ๋Š” ์ „๋ฐ˜์ ์ธ ํด๋ผ์šฐ๋“œ ํ™˜๊ฒฝ์— ๋Œ€ํ•œ ๊ฐ„๋‹จํ•œ ์„ค๋ช…์œผ๋กœ ์‹œ์ž‘๋˜์—ˆ๋‹ค. ๋„ค์ด๋ฒ„ ํด๋ผ์šฐ๋“œ ์„œ๋ฒ„ ๊ตฌ์ถ• NAVER CLOUD ๊ฐ€์ž… ํ˜„์žฌ (23/2/19 ๊ธฐ์ค€) ์‹ ๊ทœ ๊ฐ€์ž…์‹œ 10๋งŒ์› Credit ์ œ๊ณต (๋งŒ๋ฃŒ 3m) AWS, Azure์™€ ๊ฐ™์ด ์‚ฌ์šฉ์ž์˜ ์นด๋“œ๋ฅผ id๋กœ ๋ถ€์—ฌํ•ด ์นด๋“œ ๋“ฑ๋ก ํ•„์ˆ˜ CODE : ######## (๊ต์œก ์ฝ”๋“œ ํฌ๋ ˆ๋”ง ์ œ๊ณต, festa์—์„œ 23๋…„ ๋งค๋‹ฌ ํด๋ผ์šฐ๋“œ ๊ด€๋ จ ๊ฐ•์˜ ์ง„ํ–‰ ์˜ˆ์ •) ํด๋ผ..
๋‹คํ–ˆ๋‹ค
B's