Skip to content

MQTT Kafka Raspberry Pi ElasticSearch Cluster

Grabs sensor data via arduino uno and wt100, send the data with mqtt to artik, and send it to kafka broker and logstash, monitors via grafana

josephsr

Published December 05, 2023

144 UCC

15 WCC

11 VAR

Original author: rdiot · South KoreaOriginal source (new tab)

MQTT Kafka Raspberry Pi ElasticSearch Cluster

Components

Hardware components
Raspberry Pi 3 B+ Starter Kit

SparkFun - Raspberry Pi 3 B+ Starter Kit

x 7

3B

Arduino UNO

Arduino - Arduino UNO

x 1

Standard LCD - 16x2 White on Blue

Adafruit - Standard LCD - 16x2 White on Blue

x 1

LCD1602

DHT22 temperature-humidity sensor

Adafruit - DHT22 temperature-humidity sensor

x 1

W5100 ethernet shield

WIZnet - W5100 ethernet shield

x 1

Photo cell (CdS photoresistor)

Adafruit - Photo cell (CdS photoresistor)

x 1

KY-018

Software Apps and online services
MQTT

mqtt - MQTT

x 1

Project description

MQTT + Kafka + Raspberry Pi ElasticSearch Cluster by RDIoT https://www.youtube.com/watch?v=coKGRMDqAJk * GitHub : https://github.com/rdiot/rdiot-p016 * Parts - Arduino UNO - Ethernet W5100 Shield (W5100) [B004] - LCD1602 I2C (LCD1602) [D016] - Photo Resistor Module (KY-018) [S002] - Temperature and humidity DHT22 (DHT22) [S063] - TPM-300 Air Quality Module (TPM-300) [S092] - Samsung ARTIK 5 (ARTIK5-V0.5) [B023] - Raspberry Pi 3 B Model (RASPBERRY-PI-3-B) [B088] x 3ea : for Kafka Cluster - Raspberry Pi 3 B Model (RASPBERRY-PI-3-B) [B088] x 4ea : for ElasicSearch Cluster - USB Power Supply…

Keep reading with a free account

Guests can read 15 projects per visit. Log in or create a free account to read the full description, open the documents and join the comments.