Redefining Human-Computer Interaction

FingerGuns represents a breakthrough in natural user interfaces, bringing intuitive gesture-based controls to competitive gaming through advanced computer vision technology.

Our Mission

We believe that human-computer interaction should be as natural as possible. Traditional input devices like keyboards and mice create an artificial barrier between players and their games.

FingerGuns eliminates this barrier by leveraging computer vision and machine learning to recognize natural human movements, translating them into precise game controls without any specialized hardware.

“Steve Jobs believed the best precision device is your finger. We took that philosophy further—why not eliminate the mouse entirely?”

— FingerGuns Development Team

Advanced Technology Stack

Built on MediaPipe with optimization techniques inspired by NVIDIA's frame generation technology.

MediaPipe Integration

Multi-model computer vision pipeline processing hands, pose, and facial landmarks in parallel at 30 FPS.

  • Dual 21-point hand tracking
  • 468-point face mesh for head pose
  • 33-point pose estimation for body lean

NVIDIA-Inspired Interpolation

Vision pipeline produces movement deltas at 30 FPS. A 120 Hz cursor thread drains the delta backlog, applying micro-steps to fill gaps between frames.

  • Delta backlog accumulation (30 FPS input)
  • Fractional drain per tick (120 Hz output)
  • ~8-10ms latency, no jumps or overshoot

Gradient Descent Analogy

Each 30 FPS vision frame adds a movement delta to the backlog. The 120 Hz cursor thread exponentially drains this backlog by applying a fraction each tick:

backlogt+1 = backlogt + new_delta // 30 FPS
movement = α · backlogt // 120 Hz
backlogt+1 = backlogt - movement
where α = 0.15 (drain rate per tick)

Like gradient descent exponentially reduces error, the cursor thread exponentially drains the backlog vector. Each tick subtracts a fraction of the remaining distance, creating micro-steps that transform discrete 30 FPS motion into continuous 120 Hz smoothness.

Inspired by NVIDIA DLSS 3's frame generation philosophy: decouple input rate (30 FPS vision) from output rate (120 Hz cursor). The result is near-instant responsiveness with buttery-smooth motion—no prediction, just intelligent backlog management.

What Sets Us Apart

No Special Hardware

Works with any standard webcam—no need for expensive motion tracking equipment.

Low Latency

Optimized processing pipeline ensures responsive controls suitable for competitive play.

Customizable

Adjust sensitivity, thresholds, and gesture mappings to match your playstyle.

Built by Engineers

FingerGuns was developed by a team of computer vision engineers and gaming enthusiasts who wanted to push the boundaries of what's possible with modern machine learning frameworks.

What started as a hackathon thought experiment has evolved into a fully-featured control system that demonstrates the potential of gesture-based interfaces in gaming.