argent-device-interact
argent-device-interact enables developers to script and automate user interface interactions across multiple platforms—iOS simulators, Android emulators, and Chromium-based applications. Built by Software Mansion, this tool provides programmatic control over device interactions, making it ideal for testing workflows, UI automation, and cross-platform application validation.
argent-device-interact enables automation across iOS simulators, Android emulators, and Chromium-based applications. Built by Software Mansion, it provides programmatic control over device interactions, making it ideal for testing workflows, UI automation, and cross-platform application validation.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-27
argent-device-interact enables automation across iOS simulators, Android emulators, and Chromium-based applications. Built by Software Mansion, it provides programmatic control over device interactions, making it ideal for testing workflows, UI automation, and cross-platform application validation.
Use it when
- Yes, argent-device-interact supports complex gestures including swipe, pinch, rotate, and drag-and-drop interactions.
- argent-device-interact discovers UI elements via accessibility trees and DOM inspection.
Verify before relying
Read SKILL.md below before installing (2 files). Open directory: indexed for reading, not audited.
Install
software-mansion/argent/argent-device-interact · repository language: TypeScript
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
What platforms does argent-device-interact support for automation?
argent-device-interact enables automation across iOS simulators, Android emulators, and Chromium-based applications. Built by Software Mansion, it provides programmatic control over device interactions, making it ideal for testing workflows, UI automation, and cross-platform application validation.
Can argent-device-interact automate mobile app testing gestures?
Yes, argent-device-interact supports complex gestures including swipe, pinch, rotate, and drag-and-drop interactions. It also handles long press for context menus, hardware button presses, and device orientation rotation, enabling comprehensive gesture-based testing on both iOS and Android platforms.
How does argent-device-interact discover and inspect UI elements?
argent-device-interact discovers UI elements via accessibility trees and DOM inspection. It can inspect component trees in React Native debuggers and provide detailed element descriptions, allowing developers to locate and interact with specific UI components programmatically.
Does argent-device-interact support screenshot and element discovery on mobile?
Yes, argent-device-interact provides screenshot capabilities and element discovery features for mobile platforms. It enables developers to capture device state and inspect UI hierarchies, supporting both accessibility tree analysis and DOM-based element location.
What browser automation features does argent-device-interact offer?
argent-device-interact manages Chromium tabs, cookies, and web storage for browser automation via Chrome DevTools Protocol (CDP). It supports multi-tab browser control and web storage management, enabling comprehensive Chromium-based application testing.
Can argent-device-interact batch multiple device actions into single calls?
Yes, argent-device-interact supports batching multiple device actions into single sequenced calls. This capability allows developers to group related interactions—such as typing text into app fields, scrolling, launching apps, and waiting for UI elements—into efficient, coordinated sequences.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Unified tool surface
All interaction tools below accept a udid parameter and auto-dispatch iOS vs Android based on its shape (UUID → iOS simulator, chromium-cdp-<port> → Chromium (CDP) app, anything else → Android adb serial). You use the same tool names on every platform.
Chromium (CDP) app = any Chromium runtime exposing a Chrome DevTools Protocol endpoint: an Electron app (boot it with boot-device + electronAppPath), or any Chromium-family browser (Chrome/Brave/Edge) launched with --remote-debugging-port. The latter is auto-discovered by list-devices on port 9222 plus anything in ARGENT_CHROMIUM_PORTS. The same describe/tap/swipe/keyboard/screenshot surface drives all of them.
Multi-tab / windows (Chromium only): a Chromium device may have several tabs
(truncated - see the full file via the links below)
File tree — 2 files
packages/skills/skills/argent-device-interact/SKILL.md
packages/skills/skills/argent-device-interact/references/gesture-examples.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Automate UI interactions on iOS simulators, Android emulators, and Chromium apps”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
Argent's flow creation tool lets you capture device interactions and convert them into automatable sequences. Record user actions once, then replay them across multiple scenarios to eliminate manual repetition and streamline your workflow.
This skill lets you configure and pre-authorize application permissions upfront, eliminating runtime permission dialogs that interrupt user experience. Built for Argent, it simplifies permission management by establishing consent rules before your app starts, reducing friction in the onboarding flow.
This skill enables automated UI testing by orchestrating interact-screenshot-verify cycles, letting you capture application state and validate outcomes programmatically. Build reliable test workflows that reduce manual verification overhead and accelerate quality assurance cycles.
This skill handles the complete setup and boot sequence for iOS simulators, whether you're preparing a fresh environment or starting a new session. It streamlines the configuration process so you can begin testing immediately without manual initialization steps.
This skill automates the initialization and startup of Android emulator instances for development and testing pipelines. It handles the configuration steps needed to get a fresh emulator running, reducing manual setup overhead and enabling faster iteration cycles for mobile app projects.
argent-lens helps you explore multiple design directions for UI components by generating and comparing visual variants in parallel. Rather than settling on a single approach, you can evaluate competing options side-by-side to make more informed design choices. This workflow accelerates iteration and helps teams align on the strongest visual direction before committing to implementation.
More skills Ios Mcp Routing (unlicensed) · argent-native-profiler (Apache-2.0) · argent-metro-debugger (Apache-2.0) · argent-screenshot-diff (Apache-2.0) · argent-react-native-profiler (Apache-2.0)