The platform makes visible content that many users likely assumed to be private. In certain cases, queries are linked to full names, profile pictures, or other identifying details. Examples include disclosures of ongoing medical issues, planned surgeries, residential addresses, or legal concerns—ranging from requests for lease termination templates to questions about potential tax fraud.
Some users go as far as sharing details about other individuals, such as family members or colleagues. In several instances, the chatbot was asked to help craft statements for court proceedings, revealing personally identifiable information both about the user and the subject of the inquiry.
Health-related concerns are a frequent topic—covering digestive problems, skin rashes, or post-surgical issues—often accompanied by the user’s age and profession. Many of these interactions are traceable to public social media profiles.
According to the company, chats are set to private by default unless users actively go through a multi-step process to publish them to the Discover feed. However, it remains unclear how well users understand this setting, or whether some posts are the result of intentional trolling following media attention.
Privacy experts have raised concerns about the volume of sensitive data being unintentionally exposed. Many believe that users still misunderstand how AI platforms work and the extent to which their inputs might be publicly accessible.
Despite warnings, the development of such AI tools continues at a rapid pace. Recently, the company reported that its AI assistant now has one billion users across its platforms, and it is reportedly building a new lab focused on developing advanced AI systems.
In the meantime, public queries are still appearing that question the risks of the platform itself. The AI system often responds by acknowledging the possibility of users unintentionally sharing private information and refers to available tools for managing privacy. Critics, however, question whether these measures are truly sufficient.
