17. LLM Development
Pretraining Text $\rightarrow$ Text model 1~3% unstructured data Transformer 사용방법 ↳ Encoder ↳ Decoder ↳...
Pretraining Text $\rightarrow$ Text model 1~3% unstructured data Transformer 사용방법 ↳ Encoder ↳ Decoder ↳...
Foundation Model ↳ Trained on vast data (by self-supervised learning) Adaptable to downstream task Ex) CLIP Text encoder $\rightarrow$ [ ] $\leftarrow$ Imag...
Controlling the Generation Process Can we control the generation process? $P(x)$ $\downarrow$ Inverse distribution: $P(x y)$ ...
Main NCSN! Key challenge for building complex gen-models $x \rightarrow \prod_{A}f_{\theta}(x) \rightarrow O \rightarrow e^{f_{\theta}(x)} \rightarrow O = \frac{e^{f_{\theta}(x)}}{Z_\thet...
Recall: Deep Generative Models Likelihood-based ① Autoregressive model ② VAE ③ Flow based model Diffusion model (score-based) Likelihood free GAN ...
1. Introduction Deep generative models $\hookrightarrow$ Likelihood-based Autoregre...
1. Introduction Encoder & Decoder Efficient representation of input. Encoder: Input $\rightarrow$ Summarizer ($W_{enc}$) $\rightarrow$ $h$. ...
1. Introduction Discriminative vs. Generative models Goal: Learn function $f$ to map $x \rightarrow y$. Di...
Definition The science of analytical reasoning faciliated by interactive. visual interfaces. Visual Analysis The procedure in which analysts make reasonings Visual Analytics The system,...
Web Technology & JavaScript HTML: structure of web page CSS: style Javascript: functionalities DOM Programming interface of HTML document document as node and object ...