kilolonion / agent-vscreen

What it does

• Drives apps in the background. launch apps, tap, swipe, type, press keys and wait for the screen to change on the virtual display, verifying every step.
• Reports the screen back. after each action it returns the current screen, visible text and tappable elements, plus a screenshot. Built-in offline OCR (PaddleOCR, on device). The app calls no LLM itself; your agent's own model decides what t
• Watches. keep an eye on the background screen for a condition (say, some text appearing) and notify the agent when it is met.
• Leaves your agent's own access alone. it does not take adb, touch wireless debugging or restart adbd. One-tap setup only adds this app and never changes other apps' settings.