soundgo

Overview

soundgo is a browser-based musical instrument that turns webcam hand movement into real-time melody and chord control. After the user grants camera permission, the app tracks one or two hands, maps gestures to notes, chords, volume, and chord quality, and produces sound directly in the browser. The product is a compact creative experiment rather than a traditional DAW. It gives non-musicians and musicians a playful way to perform melodies, harmonies, and atmospheric covers by moving their hands in front of a camera. It includes selectable modes, scales, waveforms, octave ranges, snap-to-scale behavior, and simple note naming for easier improvisation.

What It Does

soundgo uses the webcam to detect hand landmarks and converts those positions into musical output. The interface exposes two modes: Two-hand Chord and Melody + Chord. It also includes toggles for Snap and Simple note naming, scale choices such as Major, Pentatonic, Minor, Blues, and Chromatic, waveform choices such as Sine, Triangle, Saw, and Square, and range choices from two to four octaves. In the implementation, MediaPipe Hands detects up to two hands, Tone.js synthesizes oscillators and filters, and hand position drives pitch, volume, chord root, and chord quality. The app can show live HUD values for melody frequency, volume, right-hand pinch state, chord, and detected hand count. On mobile, it asks users to rotate to landscape before playing.

Built With

VercelOther

Maker

Basic Information

Category

Fun Tools

Built With

VercelOther

Pricing

Free

Maker

Allen Alston

Launch date

Jun 17, 2026

Tags

music, webcam, hand-tracking, instrument, chords, melody, tonejs, mediapipe