Get Ready: ChatGPT Can Soon See Your Screen!

Published On Thu May 16 2024
Get Ready: ChatGPT Can Soon See Your Screen!

OpenAI's ChatGPT will soon be able to see everything happening on your screen

Yesterday in its spring update, OpenAI launched a fully-native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o. A forthcoming ChatGPT app feature will give ChatGPT the ability to see everything happening on your device’s screen. Ryan Christoffel for 9to5Mac:

At launch, the ChatGPT Mac app supports manually capturing a screenshot or uploading a file to then query ChatGPT about it. In the future, as seen in the video below, you’ll be able to click a button that gives the app access to anything and everything on your display.

Chatterbox - ChatGPT Mac App Screenshot

Enhanced Features for iOS & iPadOS

This feature will apparently not be limited to the Mac, as the iOS & iPadOS app demonstrated the same technology in the tutoring example below.

There’s no release date yet for ChatGPT’s screen viewing features, but they’ll require the user’s consent to be activated when available.

Google OAuth2 Consent Form

When using such advanced features, it's important to consider privacy and security implications. It's recommended to exercise caution, especially when dealing with sensitive information like passwords, bank account numbers, and other critical private data.

Limiting the information and access granted to apps like ChatGPT can help ensure privacy and security. It's crucial for users to be aware of the permissions they are granting and to prioritize their data protection.

Concerns and Criticisms

While the idea of an AI-powered tool having access to screen content may raise concerns for some users, it's essential to understand the implications and potential risks associated with such technology.

It is important for users to remain vigilant and informed about the apps and services they use, especially when it comes to handling sensitive information.

Generative AI Mitigating Potential Risk

Ultimately, the decision to utilize features like screen viewing on ChatGPT should be made thoughtfully, considering both the convenience it offers and the importance of maintaining data security.

For those interested in following updates on this topic, you can subscribe to our newsletter by entering your email below: