Friday, May 31, 2024

AI weekly

 Synthetic data: phi models, newest stable diffusion. 

MoEs: megablocks, llava-moe. 

PEFT: eg DoRA,  vera - Vector-based Random Matrix Adaptation

Instruction tuning: alpaca,moe+IT paper from Google.

 VLMs: Apple and HF papers,

 LLM embeddings: eg llm2vec,

No comments: