Skip to content

Mixture of Experts

We implemented the MoE Transformer in physical form on a Raspberry Pi.

simons

Published March 20, 2024 · © Apache License 2.0 (Apache-2.0)

Original author: simon

Mixture of Experts

Components

Hardware components

x 1

RaspberryPI 5


Project description

https://huggingface.co/blog/moe

Mixture of Experts

A project inspired by the idea of creating a physical representation of the MoE.

Comments

Similar projects you might like

Comments