OpenAI's ChatGPT will soon be able to see everything happening on your screen
Yesterday in its spring update, OpenAI launched a fully-native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o. A forthcoming ChatGPT app feature will give ChatGPT the ability to see everything happening on your device’s screen. Ryan Christoffel for 9to5Mac:
At launch, the ChatGPT Mac app supports manually capturing a screenshot or uploading a file to then query ChatGPT about it. In the future, as seen in the video below, you’ll be able to click a button that gives the app access to anything and everything on your display.

Enhanced Features for iOS & iPadOS
This feature will apparently not be limited to the Mac, as the iOS & iPadOS app demonstrated the same technology in the tutoring example below.
There’s no release date yet for ChatGPT’s screen viewing features, but they’ll require the user’s consent to be activated when available.

When using such advanced features, it's important to consider privacy and security implications. It's recommended to exercise caution, especially when dealing with sensitive information like passwords, bank account numbers, and other critical private data.
Limiting the information and access granted to apps like ChatGPT can help ensure privacy and security. It's crucial for users to be aware of the permissions they are granting and to prioritize their data protection.
Concerns and Criticisms
While the idea of an AI-powered tool having access to screen content may raise concerns for some users, it's essential to understand the implications and potential risks associated with such technology.
It is important for users to remain vigilant and informed about the apps and services they use, especially when it comes to handling sensitive information.

Ultimately, the decision to utilize features like screen viewing on ChatGPT should be made thoughtfully, considering both the convenience it offers and the importance of maintaining data security.
For those interested in following updates on this topic, you can subscribe to our newsletter by entering your email below: