💡

Key Points

Key Takeaways

  • 1

    The Neural Link

  • 2

    Mudra Band: Just by exchanging band of Apple Watch, reads nerve signal (SNC) of wrist. Can detect 'Tried to move' signal without moving finger.

  • 3

    Doublepoint (WowMouse): App that turns finger snap (Pinch) into mouse input using accelerometer of existing smart watch (Galaxy Watch etc.). No additional hardware required.

  • 4

    Use Case: Send slide during presentation. Typing in air while using AR glasses. Operate iPad with dirty hands (during cooking etc.)

  • 5

    Future: Input device 'disappears'. Your body itself becomes interface

Introduction: To World of Minority Report

Scene where Tom Cruise operates screen in air in movie “Minority Report”. That was SF for long time, but realized with combination of Vision Pro and Apple Watch.

However, same magic can be used outside of Apple ecosystem.

1. The Neural Interface: Mudra Band

Mudra reads electrical signal of nerve passing through wrist (SNC: Surface Nerve Conductance). Because it intercepts “Command” before muscle moves, latency is extremely low.

Mudra Band for Apple Watch

Sensor built into band part of Apple Watch. Detects gestures such as matching thumb and index finger (Tap), snapping fingers, clenching fist, and can operate iPhone and Mac as Bluetooth mouse.

Zero Touch

No need to touch screen. Can operate with hands in pockets. Even if wearing gloves on cold day, nerve signals can be read.

2. The Software Magic: Doublepoint

Doublepoint does not sell hardware. It is app that hacks “accelerometer” of Galaxy Watch or Pixel Watch on your wrist.

  • WowMouse : Just by installing app, watch becomes Bluetooth mouse.
  • Pinch : Match thumb and index finger to “Click”.
  • Look & Pinch : By combining with line of sight (AR glasses), improves pointing accuracy.

3. Comparison: Difference in Mechanism

項目 Mudra Band Doublepoint
Technology Nerve Signal (SNC) Acceleration/Machine Learning
Hardware Dedicated Band Needed ($349) Existing Watch (Free)
Accuracy Very High High (False Detection Exists)
Battery Own Battery Consumes Watch Battery

4. Why Now?

Why gesture input now? It is because it is set with spread of AR glasses (XREAL, Vision Pro).

It is tiring to touch screen floating in space (Gorilla Arm Problem). Correct answer is to operate with minute movements at hand. There is no need to even carry mouse. Because hands are always attached.

Conclusion: Magic Wand is Your Finger

Keyboard is invention of 150 years ago (Typewriter). Mouse is invention of 60 years ago.

It is time for us to stop matching machines and make machines match humans. Let’s move world with one fingertip.