Article
Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity
•
13
Thierry Herrmann
thierryh
AI & ML interests
deep learning, machine learning
Organizations
None yet
upvoted
2
articles
4 months ago
Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
•
111
upvoted
3
articles
8 months ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
•
222
Article
Training and Finetuning Embedding Models with Sentence Transformers v3
•
262
Article
Training and Finetuning Reranker Models with Sentence Transformers v4
•
177
upvoted
2
articles
9 months ago
Article
Faster Text Generation with Self-Speculative Decoding
- +2
•
63
Article
Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo
•
51
upvoted
2
articles
10 months ago
Article
Visualize and understand GPU memory in PyTorch
•
256
Article
From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease
•
42