https://x.com/jeremyphoward/status/1881264223646576786
Mishig Davaadorj
mishig
AI & ML interests
NP-completeness, grammars, universality
Recent Activity
upvoted
an
article
about 3 hours ago
Training Design for Text-to-Image Models: Lessons from Ablations
updated
a dataset
about 13 hours ago
huggingchat/papers-content
upvoted
a
paper
3 days ago
Understanding self-supervised Learning Dynamics without Contrastive
Pairs
Organizations
Resources mentioned by @thomwolf in https://x.com/Thom_Wolf/status/1773340316835131757
-
Yi: Open Foundation Models by 01.AI
Paper • 2403.04652 • Published • 65 -
A Survey on Data Selection for Language Models
Paper • 2402.16827 • Published • 4 -
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Paper • 2402.00159 • Published • 65 -
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
Paper • 2306.01116 • Published • 42
sources mentioned by hf.co/thomwolf tweet: x.com/Thom_Wolf/status/1720503998518640703
-
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Paper • 2404.05892 • Published • 40 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 149 -
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
Paper • 2404.07839 • Published • 48 -
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Paper • 2404.07143 • Published • 111
https://x.com/jeremyphoward/status/1881264223646576786
sources mentioned by hf.co/thomwolf tweet: x.com/Thom_Wolf/status/1720503998518640703
Resources mentioned by @thomwolf in https://x.com/Thom_Wolf/status/1773340316835131757
-
Yi: Open Foundation Models by 01.AI
Paper • 2403.04652 • Published • 65 -
A Survey on Data Selection for Language Models
Paper • 2402.16827 • Published • 4 -
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Paper • 2402.00159 • Published • 65 -
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
Paper • 2306.01116 • Published • 42
-
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Paper • 2404.05892 • Published • 40 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 149 -
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
Paper • 2404.07839 • Published • 48 -
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Paper • 2404.07143 • Published • 111