Talk & Gesture

Multimodal interaction workspace

PROTOTYPE v2.1.1

INPUT 01 / GESTURE

Webcam tracking

LIVE FEED
Off

Enable your webcam to start tracking

1.0
LEFT HANDNot detected
RIGHT HANDNot detected
LEFT FISTnone
RIGHT GESTUREnone
PINCH RATIO—
FRAME RATE—
No hands detected—
✋
Right handPinch to grab and move
✊
Left handFist + movement to rotate

WORKSPACE 02 / 3D EDITOR

3D scene

INTEGRATION PENDING

Your Three.js scene goes here

This area is intentionally reserved for your colleague's 3D editor. No placeholder model is controlling the real scene.

#threejs-mount
↗
Ready for integration

Commands are broadcast via editor:command. Shape and selection state is available via editor:scene-state.

WORKSPACE 03 / 2D TEST

Gesture test area

2 / 3 shapes
Selected: squarePointer Not visible

Choose a shape or try a command.

Scene objects

ONE OF EACH

INPUT 02 / SPEECH

Voice commands

Microphone: Not started

LIVE TRANSCRIPT

 

FINAL TRANSCRIPT

 

RESULT

Ready for your command.

REFERENCE / VOCABULARY

Things you can say

TAP TO TRY

Circle = sphere · box / cube = square · triangle = triangle. Only three unique shapes are allowed.

Select

Create & delete

Transform & recover

Developer console Command events and troubleshooting

Last dispatched command

(none yet)

Event log