A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard.

[ Role ]

Hardware & full-stack engineer

[ Categories ]
  • AI & Automation
  • IoT & Hardware
[ Stack ]
  • Python
  • Flask + Socket.IO
  • MediaPipe Hands
  • OpenCV
  • Vue 3 + Tailwind CSS
  • ESP32-CAM (Arduino C++)
  • ESP8266 (Arduino C++)
  • mDNS + HTTP over Wi-Fi

I built a way to control real devices with nothing but hand motion, covering the full loop from camera to switch. An ESP32-CAM streams video over Wi-Fi to a Python server, where MediaPipe tracks the hand and OpenCV turns it into finger counts and rotation angles. The server drives an ESP8266 that switches LEDs and a buzzer and sets motor speed with PWM, all in real time. To keep it fast, I held one warm HTTP connection open and grouped commands into a single batch request. A Vue dashboard shows the live feed and device states.

  1. 01Two ways to control. Finger counts switch devices on and off, while pinch and wrist angles from MediaPipe Hands set motor speed live through PWM.
  2. 02No accidental triggers. A gesture must hold steady for 5 frames and pass a debounce timer before anything switches, so a passing hand does nothing.
  3. 03Fast device response. A kept-alive urllib3 connection and a batch endpoint on the ESP8266 switch several devices in one Wi-Fi request, not four.
  4. 04Zero-config networking. Both boards announce themselves over mDNS, and the ESP32-CAM saves Wi-Fi details in EEPROM with an access point fallback.

Want something like this built?