louis030195/screen-pipe: Turn your screen into actions (using LLMs). Inspired by adept.ai, rewind.ai, Apple Shortcut. Rust + WASM.

ScreenPipe is a tool that streams data from your screen and leverages Large Language Models (LLMs) to process text and images. Inspired by adept.ai, rewind.ai, and Apple Shortcut, the project uses Rust and WASM technologies. The current prototype can capture your screen and extract text using OCR, which can then be processed Show more