Visual automation
Android image matching automation
ImgFind, SmartTap, PixelFind, and Visual Trigger let ScriptTap react to visible buttons, icons, status graphics, saved assets, and pixel states using captured screen evidence.
Choose the visual command
- ImgFind
- Find one or many instances of selected saved assets. Standard mode saves found/count and center results, Classify identifies the matching selected asset, and Boolean Array writes one result per selected positive asset.
- SmartTap
- Watch up to ten ordered asset-state rows and tap according to Switch Only, First Seen, Every Change, or Every Match.
- PixelFind
- Find one or many selected colors in an area, optionally classify the matching color or group connected matching pixels into Midpoints.
- Visual Trigger
- Combine exactly two enabled trigger slots from a fixed three-slot panel, with Pixel Line or Asset available on every slot.
ImgFind output modes
Standard Find 1st can save Found and the match center. Standard Find All can save Count and one-based X/Y arrays. Classify Find 1st saves the asset name, its one-based selected position, Found, center X/Y, and measured 0–100 similarity; no match produces Unknown, 0, False, 0, 0, and 0. Classify Find All saves Count plus one-based asset-index and X/Y arrays. Boolean Array writes one Boolean slot per selected positive asset.
Selected positive-asset order is the classification identity: the lowest-numbered approved match wins. There are no custom classification labels or ambiguous/no-match policies. Find All accepts 1–4096 results and defaults to 255.
SmartTap rows and trigger rules
Each SmartTap row has Enabled, Label, and optional Confidence from 0–100. At least two rows must be enabled. Global Confidence is 1–100; a blank or 0 row confidence uses the global value. Negative Assets accepts up to ten saved images.
Every trigger rule accepts the run's first approved match. First Seen stops there, Every Match taps on every approved match, and Switch Only or Every Change taps again only after the approved asset changes. Matched Center and Fixed are the two tap targets. Changed becomes True only after a tap is successfully sent; X/Y update on an approved match and otherwise stay unchanged.
PixelFind and Visual Trigger limits
PixelFind offers Standard or Classify output, not Boolean Array. Find All accepts 1–4096 results and defaults to 255. Ignore Radius is non-negative and defaults to 64 pixels. Midpoints groups connected matching pixels first, then applies Ignore Radius to those grouped centers.
Visual Trigger always has three one-based slots with exactly two enabled. Every slot offers Pixel Line or Asset, Sample Count and Hit Radius from 0–4096, and Each Frame or Once on Start sampling. Stable Frames is 1–4096. Fixed Tap uses the configured point; Trigger Slot taps Trigger 2.
Saved choices and mode changes
Turning an ordinary output or negative-asset toggle off keeps its configured destinations or selections for later. Deliberately changing a Find mode, output mode, or matched-center/fixed target removes settings that belong only to the outgoing mode when the edit is saved.
Reliable visual matching
Use tight areas, current assets, clear contrast, and explicit waits to keep visual matches stable across animation, theme, font-scale, crop, and timing changes. ImgFind ignores transparent asset pixels and matches only the visible part of the image; a fully transparent asset cannot match.
Privacy and safety
Image matching reads visible screen content after the user grants screen capture for that session. Capture remains user-controlled and follows the current Privacy Policy disclosure.
Mini-workflow example
Capture two small state images, add them as ordered SmartTap rows, choose Every Change, limit the search area, and tap the matched center whenever the approved state changes.