---
title: "Mixture of Experts"
url: "https://maker.wiznet.io/simons/projects/mixture-of-experts/"
markdown_url: "https://maker.wiznet.io/simons/projects/mixture-of-experts/md"
type: "WCC: WIZnet Created Content"
author: "simon"
editor: "WIZnet"
editor_url: "https://maker.wiznet.io/"
original_author: "simon"
license: "Apache License 2.0 (Apache-2.0)"
published: "2024-03-20"
language: "en"
tags: ["Raspberry Pi"]
hardware: ["WIZnet W5500-EVB-Pico", "RaspberryPI5"]
likes: 0
views: 320
comments: 0
source: "WIZnet Makers (https://maker.wiznet.io/)"
---

# Mixture of Experts

> We implemented the MoE Transformer in physical form on a Raspberry Pi.

Original author: simon

## Components

- **WIZnet W5500-EVB-Pico** x 3 ([docs](https://docs.wiznet.io/Product/Chip/Ethernet/W5500/w5500-evb-pico))
- **RaspberryPI5** x 1: RaspberryPI 5

## Article

<https://huggingface.co/blog/moe>

![](https://maker.wiznet.io/upload/ckeditor5/230981471%5F1710947162%2Epng)

A project inspired by the idea of creating a physical representation of the MoE.

---

Source: https://maker.wiznet.io/simons/projects/mixture-of-experts/