OpenAI's Planned Adult Mode for ChatGPT Raises Privacy Concerns
Key Points
- OpenAI plans to add an adult mode that lets users generate erotic content with ChatGPT.
- The feature builds on the model's memory system, which logs user preferences for personalized responses.
- Temporary chats are said not to appear in history, but OpenAI may retain copies for up to 30 days.
- Past bugs have exposed user chat titles and allowed chats to be indexed by search engines.
- Experts warn that intimate AI conversations could become a form of surveillance.
- Julie Carpenter highlights risks of data breaches, hacks, and legal requests exposing private fantasies.
- Kate Devlin notes the move reflects monetizing a behavior already occurring online.
- OpenAI has not provided detailed explanations of how mature content will be managed.
OpenAI is preparing to introduce an adult‑focused feature for ChatGPT that would allow users to generate erotic content. Experts warn that the new capability could turn intimate conversations into a form of surveillance, as the model logs preferences and retains data for up to 30 days. While OpenAI says temporary chats will not appear in user history, the company may still keep copies for safety and legal reasons. The move has sparked debate over user safety, data security, and the ethical implications of monetizing sexual interactions with AI.
Background
OpenAI has signaled its intention to let adult users create erotic material with ChatGPT. The plan, first hinted at two years ago, is still under development, with timelines described as murky. The company’s advisory council of outside experts has voiced concerns about the potential risks, including the prospect of a "sexy suicide coach." OpenAI has not provided comment when approached for clarification.
How the Feature Works
The upcoming adult mode would build on ChatGPT’s existing memory features, which log user preferences to deliver personalized responses. For example, the model can recall dietary habits or location information to tailor suggestions. In the adult context, this memory could extend to sexual preferences, fantasies, and specific fetishes, allowing the AI to generate highly customized erotic content.
Privacy Risks and Data Retention
Experts warn that turning private sexual conversations into data points creates a new layer of intimate surveillance. OpenAI’s website notes that "temporary chats" will not appear in a user’s log history or be used to improve the model, yet the company states it may retain a copy for up to 30 days for safety purposes. A disclaimer also mentions that data retention could be affected by recent legal developments.
Past incidents have shown that ChatGPT data can be exposed. In 2023, a bug displayed titles of some users’ chat history, and later that year, chats were unintentionally indexed by Google Search, making them publicly searchable. These examples illustrate the potential vulnerability of highly sensitive content if it were to be logged or leaked.
Expert Opinions
Human‑AI interaction specialist Julie Carpenter emphasizes that users may feel a false sense of privacy while sharing intimate thoughts with the model. She warns that the data could be vulnerable to hacks, security breaches, or legal requests, exposing users’ sexual fantasies in ways they never imagined.
Kate Devlin, a professor of AI and society, notes that the move reflects a desire to monetize behavior that people are already engaging in, but highlights the distinction between niche adult‑chat services and a mainstream platform like ChatGPT.
OpenAI’s Position
OpenAI indicates that temporary chats are intended to give users a sense of ephemerality, but acknowledges that copies may be kept for safety and legal compliance. The company has not detailed how it will handle mature conversations beyond these statements.
Implications
The introduction of an adult mode on a widely used AI platform raises questions about user safety, data security, and the ethical responsibilities of tech companies. As AI becomes more capable of mimicking social interactions, the line between private expression and data collection blurs, prompting calls for clearer safeguards and transparency.