ChatGPT will soon be able to see everything happening on your screen

Yesterday, in its spring update, OpenAI released a native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o . The demos generated a lot of excitement, especially among Apple users who were looking forward to the Apple-OpenAI partnership that is rumored to be coming to iOS 18 .

One important thing in the full event video was that the upcoming ChatGPT app feature was demoed but no real details were shared. That is, ChatGPT's ability to see everything that's happening on the user's device screen.

Are you ready to trust ChatGPT and share your screen content?

At launch, the ChatGPT Mac app supports taking a screenshot manually or uploading a file to then query ChatGPT for it. But in the future, as seen in the video below, you'll be able to click a button to give the app access to everything on your screen.

This feature apparently won't be limited to Macs, as iOS and iPadOS apps have demonstrated the same technology in the example below.

It’s unclear when these screen-viewing features will arrive in ChatGPT. However, the change could make for a more seamless, interactive experience. Apple even provides an API for developers to tap into the device’s screen content—with user consent, of course. So OpenAI isn’t doing anything nefarious by adding these features.

Having ChatGPT access to the entire content of your screen can be a bit scary, but it can also be extremely useful.

There will likely be a time limit on how long an app can access a user's screen, requiring a button to be pressed each time you want to grant access. But in theory, it makes sense that one day AI tools will have permanent access to everything you can see, allowing for more seamless assistance with minimal friction.

An AI assistant that can see everything you see on your devices seems like something Apple is aiming for at a system level across its platforms. If Siri gets a new AI boost, with deep system integration, it could prove to be a real asset for iOS 18 and later users.

Leave a Comment

Why ChatGPT is better than DeepSeek

Why ChatGPT is better than DeepSeek

DeepSeek initially had high hopes. As an AI chatbot marketed as a strong competitor to ChatGPT, it promised intelligent conversational capabilities and experiences.

ChatGPT Starts Adding Google Drive Integration, But Not for Everyone

ChatGPT Starts Adding Google Drive Integration, But Not for Everyone

ChatGPT has started adding support for Google Drive integration but this feature is not available to all users.

Each ChatGPT reply consumes an average of 2.5 Wh of electricity.

Each ChatGPT reply consumes an average of 2.5 Wh of electricity.

OpenAI's ChatGPT chatbot uses more than half a million kWh of electricity every day, 17,241 times more than the average US household (about 29 kWh/day).

Why use Llama 3.2 instead of ChatGPT?

Why use Llama 3.2 instead of ChatGPT?

Amidst all the AI ​​hype, Llama 3.2 is a gentle option that pays attention to the finer details and it's time you switched to this tool.

5 AI Tools to Help You Write Your First Song

5 AI Tools to Help You Write Your First Song

The following tools will create a quick sketch to inspire or even help you create a complete track.

Apple: Siri Isnt Really Ready to Beat ChatGPT

Apple: Siri Isnt Really Ready to Beat ChatGPT

With the launch of the new generation iPad Mini, Apple has clearly affirmed that “AI-filled” software experiences are the way the company is heading in the future.

What makes ChatGPTs search feature superior to Perplexity?

What makes ChatGPTs search feature superior to Perplexity?

While Perplexity has been reliable for a long time, ChatGPT's new capabilities have users slowly returning to the original Generative AI chatbot.

15 Things You Can Do With ChatGPT

15 Things You Can Do With ChatGPT

Since its launch in November 2022, ChatGPT has received a lot of attention for its myriad uses. To help you get the most out of this tool, here are 15 ways you can use ChatGPT.

How to Use Canva and ChatGPT to Create Mass Content Designs

How to Use Canva and ChatGPT to Create Mass Content Designs

Along with ChatGPT, this tutorial will show you how the Bulk Create app works in Canva. You'll be amazed at how you can create a month's worth of content in just a few minutes.

ChatGPT May Be Running Silently on Your Phone and How to Fix It

ChatGPT May Be Running Silently on Your Phone and How to Fix It

Background Conversations keep a user's conversation with ChatGPT going while using other apps or when the screen is off. This means ChatGPT can listen or monitor a user's phone usage behavior 24/7.

4 Ways to Use ChatGPTs Canvas Mode

4 Ways to Use ChatGPTs Canvas Mode

ChatGPT's new Canvas mode adds a new dimension to writing and editing in the world's leading Generative AI engine.

ChatGPT Will Kill These 4 Types of Websites

ChatGPT Will Kill These 4 Types of Websites

AI chatbots are completely reshaping the way users interact with websites and making some types of websites obsolete in the process.

The first person to have ChatGPT implanted in the brain to help manipulate electronic devices

The first person to have ChatGPT implanted in the brain to help manipulate electronic devices

ChatGPT is being tested by Synchron, one of the pioneers of brain implant (BCI) chips to help patients manipulate electronic devices.

7 Ways ChatGPTs Image Import Function Helps You Solve Everyday Problems

7 Ways ChatGPTs Image Import Function Helps You Solve Everyday Problems

Did you know ChatGPT can see images? By using the image import function, it can analyze images and help you solve daily challenges seamlessly.

Step-by-Step: Uploading Custom Backgrounds to Microsoft Teams

Step-by-Step: Uploading Custom Backgrounds to Microsoft Teams

Master uploading custom backgrounds to Microsoft Teams with this easy step-by-step guide. Personalize your meetings effortlessly on desktop, web, or mobile for a professional edge.

Troubleshooting Microsoft Teams Error on Phone (iOS/Android)

Troubleshooting Microsoft Teams Error on Phone (iOS/Android)

Struggling with Microsoft Teams "Error on Phone" on iOS or Android? Discover step-by-step fixes for calls, permissions, network issues, and more. Get back to seamless teamwork fast!

How to Fix Microsoft Teams OneDrive Error During File Sharing

How to Fix Microsoft Teams OneDrive Error During File Sharing

Tired of Microsoft Teams OneDrive error blocking file sharing? Follow our expert step-by-step guide to fix sync issues, permissions errors, and more quickly. Get back to seamless collaboration today!

Solving Microsoft Teams Error Screen Flickering

Solving Microsoft Teams Error Screen Flickering

Struggling with Microsoft Teams screen flickering? Discover step-by-step solutions to fix this annoying error, from disabling hardware acceleration to driver updates. Get smooth video calls today!

Solving Microsoft Teams Network Error on Public Wi-Fi

Solving Microsoft Teams Network Error on Public Wi-Fi

Struggling with Microsoft Teams "Network Error" on public Wi-Fi? Get instant fixes like VPN tweaks, port checks, and cache clears to restore calls and meetings seamlessly. Step-by-step guide for quick relief.

How to Fix Microsoft Teams Wheres My Team Search Error

How to Fix Microsoft Teams Wheres My Team Search Error

Tired of the frustrating Microsoft Teams "Where\

Microsoft Teams for Students: How to Join Classes in 2026

Microsoft Teams for Students: How to Join Classes in 2026

Unlock seamless learning with Microsoft Teams for Students! Step-by-step guide to joining classes in 2026, troubleshooting tips, and pro hacks for ultimate success. Perfect for students everywhere.

Solving Microsoft Teams License Error 0x80048504

Solving Microsoft Teams License Error 0x80048504

Tired of Microsoft Teams License Error 0x80048504 blocking your meetings? Get instant fixes with proven steps to resolve it permanently. Clear cache, reset licenses, and more – works every time!

How to Fix Microsoft Teams Remove Account Error

How to Fix Microsoft Teams Remove Account Error

Struggling with Microsoft Teams "Remove Account" error? Discover step-by-step fixes to resolve it quickly. Clear cache, reset app, and more for seamless account management in the latest Teams version.

How to Fix Microsoft Edge Not Working with Teams Error

How to Fix Microsoft Edge Not Working with Teams Error

Tired of the frustrating Microsoft Edge "Not Working with Teams" error? Discover step-by-step fixes to get Microsoft Teams running smoothly in Edge. Quick, reliable solutions for seamless collaboration.

Troubleshooting Microsoft Teams Microsoft Error on Teams

Troubleshooting Microsoft Teams Microsoft Error on Teams

Tired of "Microsoft Error" crashing your Microsoft Teams? Discover step-by-step troubleshooting for Microsoft Teams errors, from cache clearing to advanced fixes. Get back to seamless collaboration today!

Troubleshooting Microsoft Teams Meeting Error 2026

Troubleshooting Microsoft Teams Meeting Error 2026

Stuck with Microsoft Teams Meeting Error 2026? Follow our proven troubleshooting Microsoft Teams "Meeting Error" 2026 steps for instant fixes. Get back to smooth meetings fast with the latest solutions.

Solving Microsoft Teams Installing Error on Windows Server

Solving Microsoft Teams Installing Error on Windows Server

Struggling with Microsoft Teams "Installing Error" on Windows Server? Discover proven, step-by-step fixes including MSI deployment, cache clearing, and PowerShell tweaks to resolve issues fast and get Teams running smoothly. Updated with latest methods.

Troubleshooting Microsoft Teams Voice and VOIP Errors

Troubleshooting Microsoft Teams Voice and VOIP Errors

Struggling with Microsoft Teams voice issues? Master troubleshooting Microsoft Teams voice and VOIP errors like no audio, echo, or choppy calls. Proven fixes for crystal-clear communication in Teams.

Fixing Microsoft Teams Download Failed Due to Unexpected Error

Fixing Microsoft Teams Download Failed Due to Unexpected Error

Tired of the frustrating Microsoft Teams download failed due to unexpected error? Discover quick, step-by-step fixes to resolve it fast and download Teams smoothly on Windows, Mac, or web. No tech skills needed!