Stackness
Sign up
typesafe-computer-use

typesafe-computer-use

Drives a Mac toward a plain-English goal, with a Jev choice picking each action from the screen's OCR and accessibility tree, and an LLM called only for free text.

0 members list typesafe-computer-use, unchanged over the last 12 weeks, data as of 7 November 2026

Usage on Stackness
0membersunchanged over the last 12 weeks

Members who list typesafe-computer-use in their Stack, by week.

Members who list typesafe-computer-use

010Aug 22Nov 7
Source: Stackness stacks, week of Nov 7, 2026

Be the first to add typesafe-computer-use

Nobody on Stackness runs typesafe-computer-use yet. Add it to your stack and you're the first member running it.

Sign up and add it

About typesafe-computer-use

Typesafe-computer-use is a tool for automating tasks on macOS by directing the system toward plain-English goals. It works by capturing the screen with optical character recognition and accessibility tree data, then using a choice mechanism to select the next action based on what appears on screen. An large language model is called only when free text input is needed, keeping costs low. The tool was developed by awlevin and is released under the MIT license. It combines computer vision and accessibility information to enable automated interactions with macOS applications, reducing reliance on expensive language model calls by handling action selection through structured classification instead of requiring the model to generate every decision.

The approach focuses on cost efficiency by performing optical character recognition and analyzing interface elements locally before deciding on actions. Users can specify goals in plain language and let the system work through the steps needed to complete them. The automation runs on macOS and includes capabilities for clicking and interacting with screen elements based on the captured visual and accessibility data.

Developer
awlevin
GitHub
License
MIT
GitHub
Language
Python
GitHub
GitHub stars
1.2k
GitHub
Repository since
September 2026
GitHub

Checked 2 November 2026.

Nobody on Stackness runs typesafe-computer-use yet.

Sign up and add it

Posts about typesafe-computer-use