VisionClaw
VisionClaw is an open-source iOS and Android app that turns Meta Ray-Ban smart glasses into a real-time AI assistant powered by the Gemini Live API, with optional integration into an OpenClaw gateway
About
VisionClaw is an open-source iOS and Android app that turns Meta Ray-Ban smart glasses into a real-time AI assistant powered by the Gemini Live API, with optional integration into an OpenClaw gateway for executing actions in the real world. Frames from the glasses camera stream at roughly one frame per second to Gemini for visual context, while voice flows bidirectionally in real-time — no push-to-talk, no separate speech-to-text step. When connected to OpenClaw, Gemini can delegate tasks like sending messages, searching the web, or adding items to lists through the gateway's 56+ available skills. The project has 1.7k GitHub stars and 308 forks, suggesting meaningful traction in the developer community.
Developers with Meta Ray-Ban glasses who want to experiment with wearable AI assistants, particularly those already running an OpenClaw gateway and looking to extend it into the physical world through voice and vision.
Pros & Cons
Pros
- check Hands-free, always-on AI assistant that uses what you are actually looking at as context — not just what you type
- check Works without glasses using your phone's back camera, so you can test the full pipeline without special hardware
- check OpenClaw integration turns a voice + vision assistant into an agent that can take real-world actions across connected apps
- check Open source under a permissive license with active contribution from the community
- check WebRTC live streaming mode lets you share your glasses POV to a browser in real-time as a separate feature
Cons
- close Requires Gemini API key (and optionally OpenClaw) to function — not self-contained out of the box
- close Meta Ray-Ban glasses and a recent iPhone or Android device are needed for the full experience; the hardware cost is significant
- close Setup requires Xcode or Android Studio and some comfort with secrets configuration files
- close Audio device conflicts mean you cannot run Gemini Live and the WebRTC streaming feature simultaneously
- close Android setup requires a GitHub Personal Access Token with package read access for the Meta DAT SDK
More Infrastructure
Other tools in the same category.
