A Machine That Plays With You

Gizmo is an IDE  project blending physical computing and mechatronics. 

Our project explores the synergy between human gestures, advanced robotics, and artificial intelligence to produce harmonious melodies through a custom-designed conductive capacitor keyboard.

Key Features

• Gesture Recognition: Wekinator is used to interpret and map hand movement to musical parameters, translating broad gestures and subtle shifts into dynamic control.

• Robotic Arm Precision: The arm is engineered for accuracy and smooth movement so that gestures convert cleanly into individual keystrokes and rhythmic patterns.

• Conductive Capacitive Keyboard: Each key contains a capacitive sensor, creating a sensitive, touch-responsive surface. The robotic arm can play it with nuance, and humans can also join in to play alongside it.

• Real-time Musical Output: The system plays live. Movement influences sound instantly, creating an interactive performance that feels more like conducting than operating.