Mixture of Experts
We implemented the MoE Transformer in physical form on a Raspberry Pi.
COMPONENTS
Hardware components
WIZnet - W5500-EVB-Pico
x 3
Raspberrypi5 - RaspberryPI5
x 1
RaspberryPI 5
PROJECT DESCRIPTION
https://huggingface.co/blog/moe
A project inspired by the idea of creating a physical representation of the MoE.
Documents
Comments
Write
