ChatGPT will soon be able to see everything happening on your screen

Yesterday, in its spring update, OpenAI released a native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o . The demos generated a lot of excitement, especially among Apple users who were looking forward to the Apple-OpenAI partnership that is rumored to be coming to iOS 18 .

One important thing in the full event video was that the upcoming ChatGPT app feature was demoed but no real details were shared. That is, ChatGPT's ability to see everything that's happening on the user's device screen.

Are you ready to trust ChatGPT and share your screen content?

At launch, the ChatGPT Mac app supports taking a screenshot manually or uploading a file to then query ChatGPT for it. But in the future, as seen in the video below, you'll be able to click a button to give the app access to everything on your screen.

This feature apparently won't be limited to Macs, as iOS and iPadOS apps have demonstrated the same technology in the example below.

It’s unclear when these screen-viewing features will arrive in ChatGPT. However, the change could make for a more seamless, interactive experience. Apple even provides an API for developers to tap into the device’s screen content—with user consent, of course. So OpenAI isn’t doing anything nefarious by adding these features.

Having ChatGPT access to the entire content of your screen can be a bit scary, but it can also be extremely useful.

There will likely be a time limit on how long an app can access a user's screen, requiring a button to be pressed each time you want to grant access. But in theory, it makes sense that one day AI tools will have permanent access to everything you can see, allowing for more seamless assistance with minimal friction.

An AI assistant that can see everything you see on your devices seems like something Apple is aiming for at a system level across its platforms. If Siri gets a new AI boost, with deep system integration, it could prove to be a real asset for iOS 18 and later users.

Sign up and earn $1000 a day ⋙

Leave a Comment

7 Ways ChatGPTs Image Import Function Helps You Solve Everyday Problems

7 Ways ChatGPTs Image Import Function Helps You Solve Everyday Problems

Did you know ChatGPT can see images? By using the image import function, it can analyze images and help you solve daily challenges seamlessly.

3 Apple Visual Intelligence Alternatives for Older iPhones

3 Apple Visual Intelligence Alternatives for Older iPhones

If you have an older iPhone, don't worry — there are great Apple Visual Intelligence alternatives that offer similar features without requiring the latest hardware.

ChatGPT experienced widespread system outage

ChatGPT experienced widespread system outage

According to OpenAI's system status page, ChatGPT is currently down for a small group of users, many of whom are unable to use the Android mobile app or other services.

Custom GPT is the least noticed feature of ChatGPT

Custom GPT is the least noticed feature of ChatGPT

Custom GPT is a popular in-app feature and even without using any other ChatGPT tools, many people will still sign up just for this feature.

ChatGPT App for Windows Officially Launched

ChatGPT App for Windows Officially Launched

While there is no official Windows version yet, Microsoft Edge and Chrome let you use ChatGPT just like the native Windows app.

After ChatGPT, Apple Wants to Integrate Google Gemini into iOS

After ChatGPT, Apple Wants to Integrate Google Gemini into iOS

Apple hopes to bring more AI models like Gemini to iOS 18 so users can choose between different models.

Effective ways to use ChatGPT in Excel

Effective ways to use ChatGPT in Excel

Curious about how ChatGPT can enhance your Excel experience? Here are some tips for using ChatGPT in Excel.

Googles AI Mode can now view and search images

Googles AI Mode can now view and search images

Google is adding multimodal capabilities to its search-focused AI Mode chatbot, allowing it to view and answer questions about images, while expanding access to AI Mode to millions more users.

ChatGPT now has an image gallery: Heres what it does and how to use it!

ChatGPT now has an image gallery: Heres what it does and how to use it!

OpenAI has just launched a brand new Image Library for ChatGPT users — an overdue but welcome feature that finally gives you a way to view, manage, and review AI-generated images.

ChatGPT remembers everything about you: Heres how to stay in control!

ChatGPT remembers everything about you: Heres how to stay in control!

ChatGPT's memory is getting smarter - and that can be a problem. It's easy to forget what we've told it: goals, fears, frustrations. Unlike humans, it doesn't forget anything unless you actively do it.

4 ways to make ChatGPT read PDF files

4 ways to make ChatGPT read PDF files

If you are having trouble getting ChatGPT to read PDF files then here are some easy ways to do it.

Why not trust ChatGPT to summarize text?

Why not trust ChatGPT to summarize text?

There are limits to what ChatGPT knows, but it is bound to give you what you ask for, even if the results are incorrect. This means that ChatGPT can make mistakes, even some common ones, especially when summarizing information that you are not paying attention to.

Alibaba Launches AI Model That Can Read Human Emotions

Alibaba Launches AI Model That Can Read Human Emotions

Chinese e-commerce giant Alibaba has continued to make headlines by launching a new AI model that it claims is capable of reading human emotions.

ChatGPT increases users, Google slightly decreases

ChatGPT increases users, Google slightly decreases

The Internet search market is witnessing an interesting turning point, as ChatGPT gradually becomes a formidable “emerging competitor” to the giant Google.

Everything you need to replace your laptop with a phone

Everything you need to replace your laptop with a phone

Can you really replace your laptop with your phone? Yes, but you'll need the right accessories to turn your phone into a laptop.

ChatGPT will soon be able to see everything happening on your screen

ChatGPT will soon be able to see everything happening on your screen

One important thing in the full event video was that the upcoming ChatGPT app feature was demoed but no real details were shared. That is, ChatGPT's ability to see everything that's happening on the user's device screen.

AI is learning to fool humans despite being trained to be honest

AI is learning to fool humans despite being trained to be honest

Many top AIs, despite being trained to be honest, learn to deceive through training and systematically induce users into false beliefs, a new study finds.

How to change questions on ChatGPT

How to change questions on ChatGPT

ChatGPT now has a question change option so users can edit the question or content they are exchanging with ChatGPT.

How to spot fake QR codes and keep your data safe

How to spot fake QR codes and keep your data safe

QR codes seem pretty harmless until you scan a bad one and get something nasty thrown at you. If you want to keep your phone and data safe, there are a few ways you can spot a fake QR code.

Qualcomm Launches X85 5G Modem With a Series of Notable Improvements

Qualcomm Launches X85 5G Modem With a Series of Notable Improvements

On stage at MWC 2025, Qualcomm made a splash when it introduced its eighth generation of 5G modem called the X85, which is expected to be used in flagship smartphones launching later this year.

New technology allows phones to change color flexibly

New technology allows phones to change color flexibly

You have a trendy “Ultramarine” iPhone 16, but one fine day you suddenly feel bored with that color; what will you do?

Microsoft integrates DeepSeek into the PC Copilot+ platform

Microsoft integrates DeepSeek into the PC Copilot+ platform

In January, Microsoft announced plans to bring NPU-optimized versions of the DeepSeek-R1 model directly to Copilot+ computers running on Qualcomm Snapdragon X processors.

Difference between IF and Switch functions in Excel

Difference between IF and Switch functions in Excel

The IF statement is a common logical function in Excel. The SWITCH statement is less well known, but you can use it instead of the IF statement in some situations.

How to add a spotlight effect behind your subject using Adobe Camera Raw

How to add a spotlight effect behind your subject using Adobe Camera Raw

Adding a spotlight behind your subject is a great way to separate your subject from the background. A spotlight can add depth to your portraits.

How to increase Outlook attachment size limit

How to increase Outlook attachment size limit

Outlook and other email services have limits on the size of email attachments. Here's how to increase the Outlook attachment size limit.

Why is Lightroom better than every other photo editing app?

Why is Lightroom better than every other photo editing app?

Despite its many competitors, Adobe Lightroom remains the best photo editing app. Yes, you have to pay to access it, but Lightroom's feature set makes it worth it.

How to download Youtube videos simply and quickly

How to download Youtube videos simply and quickly

Downloading videos from Youtube is now very simple, you do not need to go through complicated steps to be able to download Youtube videos to your computer.

How to use Apple Invites to create events

How to use Apple Invites to create events

Apple has released its own event management app called Invites. This app lets you create events, send invites, and manage RSVPs.

Cheat Heroes 3, Heroes 3 codes all versions

Cheat Heroes 3, Heroes 3 codes all versions

Here are all Heroes 3 codes, Heroes 3 cheats for all versions like Heroes 3 WoG cheat, Heroes 3 SoD, Heroes 3 of Might and Magic