MegaBlocks: Efficient Sparse Training with Mixture-of-Experts - Tenstorrent

Excited about the future of AI hardware? Apply to be a part of the Tenstorrent team >

Products

IP

Accelerated Compute IP solutions scale from MW to mW and from the Data Center to the Edge.
Learn More >

Cards

Our first fast performance AI computer with PCIe Gen4.
Learn More >

Software

Run any model right away or get open access for full customization.
Learn More >

Systems

Discover Galaxy, the world’s densest AI/ML data center solution.
Learn More >
Careers
FAQ
Thinking

11/13/23

MegaBlocks: Efficient Sparse Training with Mixture-of-Experts

by howleradmin

Share

Tags