Mixture of Experts
We implemented the MoE Transformer in physical form on a Raspberry Pi.
0
Components
Hardware componentsRaspberrypi5 - RaspberryPI5
x 1
RaspberryPI 5
Project description
https://huggingface.co/blog/moe

A project inspired by the idea of creating a physical representation of the MoE.
