Mixture of Experts

We implemented the MoE Transformer in physical form on a Raspberry Pi.

WIZnet

Published March 20, 2024 · © Apache License 2.0 (Apache-2.0)

Original author: simon

Components

Hardware components

WIZnet - W5500-EVB-Pico

x 3

Raspberrypi5 - RaspberryPI5

x 1

RaspberryPI 5

Project description

https://huggingface.co/blog/moe A project inspired by the idea of creating a physical representation of the MoE.

Keep reading with a free account

Guests can read 15 projects per visit. Log in or create a free account to read the full description, open the documents and join the comments.

Similar projects you might like

Learn how to flash official MicroPython v1.23.0 firmware onto the W5500-EVB-PICO board. This enables full TCP/IP stack (TCP, UDP, DHCP, DNS) support

W5500-EVB-PICO with MicroPython: Firmware Flashing and Ethernet Setup on RP2040

ronpang

Views 601
Comments 0

Open-source KiCad PCB acting as a power distribution and SPI hub motherboard for W5100S/W5500-EVB-Pico, driving six LED lamp units in a university building-scal

Powering 57,000 LEDs: A Custom Motherboard for W5500-EVB-Pico

Benjamin

Views 465
Comments 0

UDP-based relay controller for a university rover—receives JSON commands over Ethernet and switches power to rover subsystems via W5500 EVB Pico.

METU ROVER Power Control: UDP Relay Switching with W5500 EVB Pico

Benjamin

Views 450
Comments 0

A Local Stratum-1 Time Infrastructure Powered by W5500

W5500-EVB-Pico+M5Stack用GPSユニット+TM1637でGPSNTPサーバを構築

scott

Views 434
Comments 0

A MicroPython-based NTP server that uses a GPS receiver as an accurate time source, serves time over Ethernet via the WIZNET5K (W5500).

How to Build a GPS-Synchronized NTP Time Server with W5500-EVB-Pico and MicroPython

Benjamin

Views 2302
Comments 1

WIZnet W5500-EVB-Pico 보드에서 ESPHome을 유선 이더넷으로 구동해 Home Assistant에 연결하는 예제 프로젝트

W5500-EVB-Pico + ESPHome: RP2040 유선 이더넷 스마트 노드( Home Assistant 연동 )

sophia

Views 415
Comments 0

Implements a Protocol Break Relay—a security pattern from the Cross Domain Solution (CDS) domain—using Rust on the W5500-EVB-Pico board.

How Does Rust Enable Protocol Break Security on W5500-EVB-Pico?

Benjamin

Views 814
Comments 0