[ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang
-
Updated
Feb 28, 2023 - Python
[ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang
Add a description, image, and links to the self-slimmable topic page so that developers can more easily learn about it.
To associate your repository with the self-slimmable topic, visit your repo's landing page and select "manage topics."