Back to projects

03 · Sep 2026 to present · Independent project

Amber.personal AI assistant

An offline personal assistant that lives on your Mac. Ask it to do things, point and pinch to click, swipe through slides from across a conference table, or have it explain what’s on screen, all processed on-device, and verified before Amber says it’s done.

Tauri · TypeScript · Swift · on-device · verification

Amber · personal AI assistant

Amber logo
VOICEHANDSSLIDESBAT MODESCREENMEMORY

What it does

Voice

Commands

Native transcription, local speech feedback, cancellation and live activity.

Camera

Hand tracking

Landmarks drive the cursor: pinch to click and drag, scroll, zoom, open palm to cancel.

Screen

Screen tutor

Select part of the screen; local OCR and vision explain it with overlays and speech.

Memory

Learns corrections

Stores corrections and verified experiences locally.

Presentation mode

Swipe an open hand along the table, or two fingers in the air, to change slides in Keynote, PowerPoint, Safari, Chrome, Edge, Firefox or Preview. A shared cooldown stops double-skips, and stale, weak, vertical or multi-person strokes are rejected.

Bat Mode & Tap Anywhere

Amber plays a tone through the laptop speaker and listens to the Doppler shift of the reflection, so it can sense push/pull motion even when your hand is outside the camera. Tap Anywhere learns two spots on the table (eight taps each) for next and previous.

Built to be trusted

  • Camera frames never stored
  • Raw audio never leaves the mic pipeline
  • Explicit permissions
  • Gesture cancelled when tracking is lost
  • No success claimed without verification

Verification

9Point calibration
13Calibration stages tested
4Validation targets
100%Local processing

Gesture, acoustic and presentation test suites, a TypeScript + Vite build, Vitest unit tests, the Swift native helper and the signed Tauri app all pass. Next: real-room testing at conference-table distance.