Visible text
Android OCR automation
ScriptTap OCR reads selected visible text or finds one or every matching line or word in Latin, Chinese, Devanagari, Japanese, or Korean. Scripts can tap recognized matches and use OCR results in typed workflow logic.
What it does
OCR has two focused modes. Read recognizes the selected area's visible text into a String. Find compares a literal or prior String variable with recognized lines or words using Contains, Exact, or Regex matching and an optional case-sensitive comparison.
Find one or find all
Find 1st can scan left-to-right or right-to-left, top-to-bottom or bottom-to-top, and select a numbered matching result. Find All evaluates every matching line or word from the same current capture in stable screen order. Tap Target can tap the selected match in Find 1st or each matched center in Find All.
Use OCR results
Find can save whether text was found and its selected or first-match X/Y coordinates. Read writes the recognized selected-area text and can also save success and error results. Those values can feed ScriptTap conditions, variables, arrays, Text Transform, translation, files, HTTP, PromptMe, or Display commands.
The OCR command's Test action evaluates the current selected area and reports elapsed time, recognized line and word counts, the matching summary, and the selected center or recognized text.
How ScriptTap handles it
Each OCR command captures only its selected screen area and evaluates it on-device with the chosen text script. All five OCR models ship with ScriptTap, are immediately available after installation, work offline, and create the selected recognizer lazily only when OCR runs. Startup performs no OCR work, and OCR does not add a Play readiness step.
Good uses
- Visible captions or labels that change over time.
- Codes, prompts, warnings, or repeated text-driven workflows.
- Finding and tapping one or every repeated text match in a selected area.
- Text that needs cleanup, comparison, translation, or overlay display.
Recognition guidance
Select a tight area with readable contrast, stable text, and minimal motion for the clearest recognition. ScriptTap returns the recognized visible text directly to the configured workflow.
Privacy and safety
OCR reads selected visible screen areas on the device. Do not build workflows that collect passwords, payment details, or unrelated private information. See Privacy for current permission disclosures.
Mini-workflow example
Select a caption area, read the visible text, clean spacing, compare it with the previous value, translate it if it changed, and show the translated result in a ScriptTap display overlay.