Engineering & Innovation03 / 08
Engineering & Innovation / Physical Computing / DTU / 2024
A physical interface for controlling computer volume and video playback through hand gestures.
The recording shows media controls, the breadboard prototype and sensor/status screens. It contains music and system sound, with no spoken narration. The three gesture controls are explained below.
01 / The idea
I developed a gesture-controlled interface for everyday media functions without touching the keyboard or mouse.
Two VL53L0X Time-of-Flight sensors were positioned on the left and right sides of the monitor. An Arduino/ESP32-based setup read the sensors, while a Python script connected their input to the computer’s media controls.
The project brought sensing, programming and physical prototyping into one working system.
02 / Interaction
The position of the hand determines the action. Each sensor has a volume function; using both together controls video playback.
A hand in front of the sensor on the right increases the computer’s volume.
A hand in front of the sensor on the left decreases the computer’s volume.
Hands in front of both sensors toggle video playback between play and pause.
03 / How it works
The interaction depends on a complete path from the physical input to a software action. Python forms the bridge between the microcontroller readings and the computer.
Hands enter the areas in front of the sensors.
One sensor sits on each side of the monitor.
The microcontroller reads the sensor input.
The script reads input from the microcontroller.
Sensor input is translated into media-control key presses.
The computer adjusts volume or toggles playback.
04 / The technical challenge
Reading the sensors did not yet give the prototype control over the computer.
The microcontroller setup could read the sensors, but could not directly trigger the computer functions needed for the interface.
I developed a Python script that read sensor input from the microcontroller and translated it into virtual keyboard presses. This connected the physical interaction to the computer’s volume and playback functions.
Resolving that connection was the central hardware–software integration challenge.
05 / Result & reflection
The result was a functional course prototype for gesture-based volume and video control.
The project gave me practical experience with microcontrollers, sensors, programming, physical prototyping and troubleshooting. It showed how a usable interaction depends on connecting each part of a technical system.
Keep exploring / Fashion & Visual Design