Snapchat’s Snap AI Chatbot Raises Concerns About the Privacy of Children

Snapchat Faces UK Data Watchdog Scrutiny Over AI Chatbot’s Privacy Implications for Children

The UK’s data watchdog, the Information Commissioner’s Office (ICO), has raised concerns about Snapchat’s AI chatbot and its potential privacy risks for users, particularly children. In a preliminary investigation, the ICO warned that it might shut down the My AI feature in the UK. This tool enables users to interact with a computer that mimics human conversation, powered by ChatGPT, an AI tool that offers lifelike responses.

Snap, Snapchat’s parent company, was the first social media platform to introduce an AI-powered chat function. With 21 million UK users, including many children, the ICO is particularly concerned about the privacy risks faced by 13- to 17-year-old users. Snap has responded by stating its intent to cooperate with the ICO, emphasizing that it conducted a thorough legal and privacy review before launching the feature.

The ICO stressed that its findings are preliminary, and it has not yet determined if Snap breached any data protection laws. The preliminary notice serves as a signal to Snap to ensure My AI complies with data protection rules, including the Children’s Design Code. This code outlines 15 standards that online services must follow to safeguard children’s data online. If a final enforcement notice is issued, Snap may need to conduct a comprehensive risk assessment before offering the My AI function to UK users.

My AI is described by Snap as an experimental and friendly chatbot designed to be a personal assistant for Snapchat users. It can assist in planning day trips and creating menus, with over two million chats happening on the app daily. Snap launched the feature in April after initially offering it for a fee in February. However, the company acknowledges that My AI may provide incorrect or biased answers and caution users not to rely entirely on its advice.

Snap has also faced criticism regarding the chatbot’s access to private information like location data. The company clarified that it can only access location data with user consent. However, concerns persist about whether young Snapchat users fully understand the implications of data collection.

In response, Snap reiterated its commitment to user privacy, emphasizing its dedication to safeguarding users’ privacy rights. Information Commissioner John Edwards highlighted the need for organizations to assess both the benefits and risks associated with AI and expressed concern about Snap’s failure to adequately identify and evaluate privacy risks before launching My AI.

The ICO has the authority to impose fines of up to £17.5 million or 4% of a company’s annual worldwide turnover for serious breaches. Snap will have the opportunity to address the ICO’s concerns before a final decision is reached.