ChatGPT will soon be able to see everything happening on your screen

Yesterday, in its spring update, OpenAI released a native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o . The demos generated a lot of excitement, especially among Apple users who were looking forward to the Apple-OpenAI partnership that is rumored to be coming to iOS 18 .

One important thing in the full event video was that the upcoming ChatGPT app feature was demoed but no real details were shared. That is, ChatGPT's ability to see everything that's happening on the user's device screen.

Are you ready to trust ChatGPT and share your screen content?

At launch, the ChatGPT Mac app supports taking a screenshot manually or uploading a file to then query ChatGPT for it. But in the future, as seen in the video below, you'll be able to click a button to give the app access to everything on your screen.

This feature apparently won't be limited to Macs, as iOS and iPadOS apps have demonstrated the same technology in the example below.

It’s unclear when these screen-viewing features will arrive in ChatGPT. However, the change could make for a more seamless, interactive experience. Apple even provides an API for developers to tap into the device’s screen content—with user consent, of course. So OpenAI isn’t doing anything nefarious by adding these features.

Having ChatGPT access to the entire content of your screen can be a bit scary, but it can also be extremely useful.

There will likely be a time limit on how long an app can access a user's screen, requiring a button to be pressed each time you want to grant access. But in theory, it makes sense that one day AI tools will have permanent access to everything you can see, allowing for more seamless assistance with minimal friction.

An AI assistant that can see everything you see on your devices seems like something Apple is aiming for at a system level across its platforms. If Siri gets a new AI boost, with deep system integration, it could prove to be a real asset for iOS 18 and later users.

Leave a Comment

What Young Riders Should Know About Moving Their Motorcycles Across Cities

What Young Riders Should Know About Moving Their Motorcycles Across Cities

Long-distance travel can involve heavy traffic, changing weather conditions, and rider fatigue. If you are also dealing with the responsibilities of moving home, such as packing belongings or coordinating accommodation, a long ride may add unnecessary pressure to an already busy schedule.

Solving Microsoft Teams Shortcut Error Not Opening

Solving Microsoft Teams Shortcut Error Not Opening

Tired of Microsoft Teams shortcut error preventing you from opening the app? Follow our expert, step-by-step guide with the latest fixes for instant resolution. Works on Windows, Mac & web – no tech skills needed!

Solving Microsoft Teams Task Management Sync Error

Solving Microsoft Teams Task Management Sync Error

Tired of Microsoft Teams Task Management Sync Error halting your workflow? Follow our proven, step-by-step fixes to resolve sync issues fast and restore seamless task collaboration. No tech expertise needed!

Troubleshooting Microsoft Teams Wiki Error Formatting

Troubleshooting Microsoft Teams Wiki Error Formatting

Struggling with Microsoft Teams Wiki Error Formatting? This step-by-step guide reveals proven fixes for common wiki tab issues, ensuring smooth editing and collaboration in Teams. Get back to productive wikis fast!

How to Fix Microsoft Teams Installation Error for Linux

How to Fix Microsoft Teams Installation Error for Linux

Struggling with Microsoft Teams installation error on Linux? Discover step-by-step fixes for Ubuntu, Fedora & more. Resolve dependency issues, crashes, and errors quickly with our ultimate guide. Get Teams running smoothly today!

Solving Microsoft Teams Error Page Not Loading

Solving Microsoft Teams Error Page Not Loading

Struggling with Microsoft Teams "Error Page" not loading? Get step-by-step fixes for desktop, web, and mobile. Solve Microsoft Teams Error Page issues quickly and resume seamless teamwork today.

Solving Microsoft Teams Error Screenshot Issues

Solving Microsoft Teams Error Screenshot Issues

Tired of Microsoft Teams "Error Screenshot" blocking your workflow? Get proven, step-by-step solutions to resolve screenshot errors in Teams instantly and boost productivity. No tech skills needed!

How to Fix Microsoft Teams Error U User

How to Fix Microsoft Teams Error U User

Tired of Microsoft Teams "Error U" User blocking your chats? Get proven, step-by-step fixes to clear cache, reset, and restore seamless collaboration instantly.

Where are Microsoft Teams Registry Keys Located on Windows 11?

Where are Microsoft Teams Registry Keys Located on Windows 11?

Unlock the precise locations of Microsoft Teams registry keys on Windows 11. Step-by-step guide to find, access, and safely tweak them for optimal performance and troubleshooting. Essential for IT pros and Teams enthusiasts.

How to Fix Microsoft Teams Training Error Video Lag

How to Fix Microsoft Teams Training Error Video Lag

Tired of Microsoft Teams "Training Error" Video Lag ruining your meetings? Follow our step-by-step guide with the latest fixes for smooth video calls—no more frustration!