The Device panel displays different screens depending on whether the user selects Device or UIObject Selector on the right side.
In the Device tab, you can interact directly with the screen, while in the UIObject Selector tab, you can choose the entity to perform actions required for scenario creation.
Device Tab #
① Displays the name and status of the connected device.
② Add devices to connect to Stego.
③ Shows the real-time screen of the selected device.
④ Contains buttons for controlling the device.
⑤ Switches to the Device/UIObject Selector screen.
⑥ Displays the outputs when the test is executed.
Supported Device Control Features #
In Device Tab mode, the following features are supported:
: Screen Analysis Button
: Home Button
: Recently Used Apps Button
: Back Button
: Lock/Unlock Screen Button
: Volume Up Button
: Volume Down Button
: Toggle Landscape/Portrait Mode Button
: Send Text to Device Button from Stego
: Capture Device Screen and Save Image Button from Stego
: Copy Package Name/Bundle ID of Active App Button
: Install/Uninstall Binary App on Active Device Button
: Refresh Button (Retries the connection between Stego and the device)
Note) Some features may not be supported depending on the device type (Android / iOS).
Screen Analysis Tools #
When you click the Screen Analysis Tool , you are redirected to the UIObject Selector screen, which shows a list of objects available for action.
① Displays the name and status of the connected device.
② Add devices to connect to Stego.
③ Displays the real-time screen of the connected device.
④ Displays the buttons to control the device.
⑤ Switches to the Device/UIObject Selector screen.
Starting Screen Analysis #
There are two ways to extract objects from a screen or image:
- Click the to extract objects from the screen of the connected device.
- Click the
to extract objects from an image URL provided.
First, using the , click it while the device is connected.
(Screen Analysis in Progress Screen)
Captures the mirrored device screen in Stego and displays the selectable candidates through AI analysis.
This button allows you to switch to the current device screen when AI screen analysis is in progress and the device is manually operated.
Use 
to analyze the screen of the image loaded via the image URL.
(Screen Analysis using Image URL)
When analyzing the screen with an image URL, you can easily modify the scenario if changes are detected in the test execution results, without the need to connect a device.
Security Screen Analysis (Special Case) #
In Android OS Version 12 and above, some screens that require security may have ‘FLAG_SECURE’ applied. In such cases, the screen displayed on the device will appear as a black screen, making screen analysis through Vision impossible.
However, we provide the ability to select UI elements using Accessibility even when secure screens are present.
(Example of a Secure Screen)
No Keyboard Visible in iOS Password Field #
Due to iOS security policies, the keyboard that appears when clicking on the password input field does not show up in screenshots.
Refer to this when authoring scenarios.
Keyboard Input #
To support manual testing via the mirroring screen, Stego allows you to input values that are then entered directly into the device.
① Click the keyboard UI.
② Entered the desired value and click the Send button.
Note) Input is only possible when the keyboard is displayed.
How to Find the App ID #
You can easily find the App ID for the active app on the currently selected device screen.
① After launching the app, click the UI labeled App.
② The App ID will be displayed at the bottom of the screen and copied to the clipboard.
Installing a Binary App on the Active App #
You can quickly install a binary app under development on the device by clicking the 
button.
① When you select the gear icon, the Install and Uninstall buttons will appear.
– Install : Select an .apk or .ipa file stored on your PC, and the app will be automatically installed.
– Uninstall : Enter the App ID of the installed app on the device to remove it.
② When you choose Install, select the appropriate file extension (.apk, .ipa, etc.) for your device, and the app will be installed automatically.