Claude's new computer use feature turned my old laptop into a machine I control from my phone
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
A hands-on experience using Claude's Computer Use feature to manage a Debian-based homelab server remotely from a phone. By letting Claude take screenshots of a Mac, interpret the screen, and act on plain-English instructions, the author was able to check Portainer dashboards, inspect Nextcloud and Cloudflared logs, and diagnose a Docker network isolation issue — all without sitting at a desk. The setup required granting macOS accessibility and screen recording permissions and switching to Chrome, as Terminal was click-only, Safari was read-only, and Brave was undetectable. Despite early limitations, the workflow reduced friction for routine homelab management tasks.
Table of contents
What "computer use" actually means in practiceMy setup: Mac as control hub, Debian as the actual homelabWhat I can now do from my phone (real homelab tasks)Where it still falls shortSort: