Skip to main content

Codex's Game-Changing Update Lets Mac Users Share Screens Directly with AI

OpenAI Supercharges Mac Productivity with Direct AI Screen Sharing

Mac users just gained a powerful new productivity ally. OpenAI has rolled out a significant update to its Codex desktop application, headlined by a groundbreaking feature called Appshots that allows AI to directly interpret what's happening on your screen.

See What Your AI Sees

The magic happens with a simple Command key press. macOS users can now instantly share their active application window with Codex - no more fussing with screenshots or manual text copying. This seamless integration represents a quantum leap in how we interact with desktop AI assistants.

But Appshots isn't just taking pictures of your screen. It's reading between the pixels. The feature can extract text content from application windows, including portions currently hidden from view due to scrolling. Imagine debugging a webpage and being able to share the entire DOM structure instantly, or getting design feedback without manually stitching together multiple screenshots.

"We built this to solve real pain points," explains an OpenAI spokesperson. "When you're knee-deep in code or design work, the last thing you need is friction between you and your tools."

Your New AI Task Manager

The update also brings previously experimental task management features out of beta. Users can now define complex, multi-stage projects directly within Codex - whether through the main application, IDE extensions, or command line interface.

Set a goal, and Codex becomes your persistent digital assistant. It will steadily work toward your objectives over hours or days, hitting milestones while allowing you to check progress, adjust course, or pause as needed. It's like having a tireless teammate who never sleeps (but thankfully doesn't drink your coffee).

Key Points:

  • Instant Screen Sharing: Command-key shortcut sends app windows to Codex
  • Deep Content Capture: Reads visible and hidden text within applications
  • Workflow Revolution: Eliminates manual screenshot and text extraction steps
  • Persistent Tasks: Set multi-day goals that Codex autonomously progresses
  • Full Control: Monitor and adjust ongoing AI-assisted tasks at any time