ChatGPT user flagged for 'sexting' the AI, issued warning by OpenAI ...
A ChatGPT user has been issued a warning by the generative AI chatbot’s developer, OpenAI, after they had been flagged for “sexting” with the software.
In a post on Reddit, the user said that they had received an email from OpenAI, which said that their actions violated the company’s terms of use. The user mentioned, “Been sexting with ChatGPT since the beginning and continuously improving my jailbreaking skills. Sometimes my inputs are red or orange flagged, but never got any trouble before.” The user also mentioned, “However, today, the second after one of my inputs was orange flagged, I received an email threatening to terminate my services. Has anyone received similar emails?”
Violation of Terms
According to the company’s terms of use, the use of their API or ChatGPT to create sexually explicit or suggestive content is against the rules. OpenAI strictly prohibits users from using ChatGPT for such purposes. Despite this, users often test the boundaries of these chatbots to see how far they can go.
The user shared a screenshot of the email from OpenAI, warning them that violating the terms of use could lead to account termination. The email stated, “We are reaching out to you as a user of OpenAI’s ChatGPT because some of the requests associated with the email … have been flagged by our systems to be in violation of our policies. Please ensure you are using ChatGPT in accordance with our terms of use and our usage guidelines, as your access may be terminated if we detect further issues with your usage.”
Exploring NSFW Content
OpenAI, acknowledging the interest in sexual content, has considered allowing NSFW (Not Safe For Work) content creation. The company has expressed that developers and users should have the freedom to use their services as long as they comply with usage policies. They are evaluating the possibility of responsibly enabling the generation of NSFW content in appropriate contexts through the API and ChatGPT.
An OpenAI employee mentioned in a report by The Guardian that the company wanted to explore whether its tools could be utilized for pornographic text and imagery. However, deepfake content will always remain prohibited. The employee stated, “We want to ensure that people have maximum control to the extent that it doesn’t violate the law or other people’s rights, but enabling deepfakes is out of the question, period.”
The company clarified that while they are not currently aiming to create AI porn, the consideration of this move depends on individual interpretations.
Stay informed about the latest cyber industry developments by subscribing to our Newsletter.