Skip to content

Built-in skill

Screen assist

Device

Summon your agent over another app and ask about the screen in front of you: a summary, an explanation, a translation, or a reply you can send.

  • Android — supported
  • iPhone — not available
  • Mac — not available

The one that arrives on top of whatever you were already reading. Its four starters are the four things people ask about a screen: summarize it, explain it, translate it, reply to it.

Grant model

How granting works

A skill is a permission you hand to an agent, not a silent preload.

  1. Find it in Skills Screen assist is built in, so there is nothing separate to install.
  2. Choose who can use it Give the skill only to the agents that need this job, and change that choice whenever you want.
  3. Review its access This skill does not ask for additional access.

Prompts

Try it with

The quick actions this skill puts in front of you in the app.

  • Summarize this screen Summarize what's on my screen.
  • Explain this screen Explain what I'm looking at and what matters on it.
  • Translate this screen Translate what's on my screen into Hindi.
  • Draft a reply Draft a reply to the message on my screen.

Access summary

What it may use

It declares no access of its own. A summon captures the screen and keeps that capture on your phone; it reaches a model only on a question you send with Ask about screen selected.

Network
No network access
Files
No file access
Memory
No saved-memory access
Credentials
No connected-account access
Media
No media access
Browser
No browser access

Related

Works with

The apps, skills and tools Screen assist sits next to.

More Device

Get Screen assist

It is built into OpenAlly on the clients shown above, no separate skill download.

Get OpenAlly