ai that can see my screen
AI That Can See Your Screen
Ask about anything on screen. GuideLayer captures context on demand and points at the exact control, not an approximate region.
You've tried pasting a screenshot into ChatGPT. It works until you need the next click, and then you're pasting again.
AI that can see your screen should mean more than one image upload. It should mean the assistant knows what's on screen when you ask, points at the right control, and doesn't make you re-describe the layout every turn.
GuideLayer captures context on demand, combines it with the accessibility tree, and drives a visible guide cursor to the element you need.
What actually works
On-demand, not always-on
Screen capture triggers when you ask. Not a continuous stream. Privacy Center controls when it's allowed.
Points, not just describes
A reticle lands on the button. You don't interpret a paragraph about "the upper right area."
Any visible app
Figma, Excel, Safari, native Mac apps. If it's on your screen, GuideLayer can read it.
Voice trigger
Ask out loud from the menu bar. Hands stay on the keyboard.
Workflow examples
"Where is this setting?"
You can see the app. You can't find the one toggle you need.
- 01Say what you're trying to change.
- 02GuideLayer captures the screen and searches the accessibility tree.
- 03Reticle lands on the control. Click and done.
Error dialog you don't understand
A modal appeared. The message is vague.
- 01Ask what it means and what to do next.
- 02Answer grounded in the actual dialog on screen.
- 03If there's a button to fix it, the cursor shows you which one.
Teaching someone remotely
You're on a call. They share screen. You still can't point at their UI.
- 01They run GuideLayer on their Mac.
- 02Voice guidance finds the control on their screen, not yours.
- 03Save the steps so they don't need you on the next call.
Seeing your screen is table stakes. Pointing at the right thing on your screen is what makes it useful.
Related guides
Try GuideLayer on your Mac
Screen-aware, private, local-first. Download for Apple Silicon with Claude Code and Codex already signed in.