Synthetic data: phi models, newest stable diffusion.
MoEs: megablocks, llava-moe.
PEFT: eg DoRA, vera - Vector-based Random Matrix Adaptation
Instruction tuning: alpaca,moe+IT paper from Google.
VLMs: Apple and HF papers,
LLM embeddings: eg llm2vec,
Post a Comment
No comments:
Post a Comment