SIGNAL — Visual Gesture & Gaze Automation Workbench

Camera WorkspaceVISION: NOT LOADED

CAMERA OFFStart the camera to begin local visual sensing.
Use Test Lab to inject events without a camera.

LOCAL / IDLE

0 FPS · 0 ms

CURRENT GESTURE

—

APPROXIMATE GAZE

—

Camera

Analyze

Mirror

Target inference

Min confidence

Overlays

Gestures

Built-in static gestures, motion events, and locally taught trajectory templates.

Built-in recognition

Motion recognizer

Motion events are derived from hand landmark history instead of individual frames.

Taught gestures

Gaze

Approximate screen-gaze estimation, calibration, blink detection, and gaze zones.

Calibration

Look at each target and capture the current eye geometry. Samples remain local.

Quality:NOT CALIBRATED

Gaze zones

9 zones

Rules

Turn semantic visual events into controlled actions with confidence, hold, debounce, and cooldown.

Action Lab

Reusable internal, browser, and connector actions. Network execution only occurs in LIVE mode.

Browser boundary: ordinary webpages cannot synthesize arbitrary operating-system keyboard input or silently send SMS. SIGNAL exposes internal commands and network connectors, and leaves OS-level control to an explicit companion integration.

Tool Builder

Bundle camera configuration, gestures, zones, variables, rules, actions, and scripts into reusable visual-interface tools.

Tool structure

TOOL\n ├─ Camera\n ├─ Inputs\n │ ├─ Hands\n │ ├─ Eyes\n │ ├─ Gaze\n │ └─ Head\n ├─ Gestures\n ├─ Zones\n ├─ Variables\n ├─ Rules\n ├─ Actions\n ├─ Scripts\n └─ Interface

Variables

TOOLS

Test Lab

Inject events, inspect rule traces, and validate behavior without repeatedly performing physical gestures.

Event injection

Injected events use the same EventEngine path as camera detections.

Execution state

Run modeSIMULATERules enabled0Last action—Event queue0

Rule trace

No rule has been evaluated yet.

Developer

SIGNAL API concepts, diagnostics, and an experimental user-script workspace.

Script editor

signal.on("gesture.thumbs_up.enter", event => {\n  signal.log("Thumbs up: " + event.confidence);\n});

Console

API reference

signal.on(eventName, callback)\nsignal.state.get(name)\nsignal.state.set(name, value)\nsignal.rules.enable(name)\nsignal.rules.disable(name)\nsignal.actions.run(name, payload)\nsignal.log(message)

Detection monitor

Camera FPS0Inference FPS0Average inference0 msActive landmarks0Rules evaluated0

Project

Local-first storage, portable JSON projects, starter tools, and permission-aware sharing.

Current project

Name

Version

Storage

Description

Project safety

Camera frames uploadedNOVideo recording defaultOFFTelemetryNONEExternal actionsOPT-IN

Credentials: do not embed sensitive long-lived API secrets in shareable browser projects. Prefer a relay, short-lived token, or local companion.

Starter content

Reload the useful examples without replacing the entire application.

Fresh Start

Create a completely empty project while keeping application preferences.