zoltner

AI Child Safety News / archive

January 2026: 96 stories on AI and child safety

Every story recorded for January 2026 that is in this archive, newest first. Each entry gives a short summary and links to the original report. Read the January 2026 summary

Search all stories

  1. Finland weighed an under-15 social media ban with strong public support

    · Yle News

    Finnish Prime Minister Petteri Orpo said he supported banning social media for under-15s, and the public health authority THL backed restrictions. A survey published the week of January 26 found two-thirds of respondents backed a ban, nearly 10 percentage points higher than the previous summer.

    Age limits and social media bans; Legislation and rulemaking · Finland, social media ban, survey

  2. Canada planned online safety measures covering AI chatbots and young users

    · The Globe and Mail

    Canada’s Identity Minister Marc Miller said a forthcoming online safety bill would include measures to protect young and vulnerable people from harm by AI chatbots. A report from McGill University’s Centre for Media, Technology and Democracy recommended a statutory duty of care for chatbot developers.

    Legislation and rulemaking; AI chatbots and companions · chatbots, Canada, Digital Duty of Care (Australia), legislative proposal

  3. New Mexico bill could regulate AI chatbots to protect children

    · abqjournal.com

    New Mexico lawmakers have introduced the Chatbot Safety Act, House Bill 174, to regulate AI chatbots like ChatGPT by requiring clear warnings and crisis intervention tools to protect children and teens from suicide.

    Legislation and rulemaking; AI chatbots and companions · chatbots, New Mexico (US), ChatGPT, self-harm and suicide

  4. Indian lawmaker proposed a bill to ban social media for children

    · Reuters

    Reuters reported that L.S.K. Devarayalu, a lawmaker allied with Prime Minister Narendra Modi, proposed banning social media accounts for under-16s in India and requiring platforms to disable accounts held by younger users. He cited concerns about compulsive use and Indian user data feeding foreign AI systems. The proposal followed Australia’s under-16 restrictions.

    Legislation and rulemaking; Age limits and social media bans · India, social media ban, addictive design, Australia

  5. Anyone can become a victim: Man indicted in Houston area first federal AI child exploitation caseAllegation

    · click2houston.com

    A federal grand jury indicted a 34-year-old man in the Houston area who allegedly used AI apps to create child sexual abuse material from photos of victims he knew. The article describes it as the area’s first federal AI child exploitation case. The allegations are unproven.

    Lawsuits and settlements; Grooming, sextortion and exploitation; Criminal cases and prosecutions · United States, criminal prosecution, AI-generated CSAM

  6. Meta faces New Mexico trial over child – exploitation claimsAllegation

    · thestar.com.my

    Reuters reported via The Star that Meta faces a New Mexico trial over claims about child exploitation on its platforms. The allegations are unproven.

    Lawsuits and settlements; Grooming, sextortion and exploitation · Meta, New Mexico (US)

  7. Roblox under scrutiny as Dutch regulators launch probe over child safety concernsAllegation

    · thenews.com.pk

    The Netherlands’ consumer protection regulator ACM launched an investigation into Roblox on January 30, 2026, to assess whether it protects minors in the EU as the Digital Services Act requires. Roblox said it was committed to complying. The allegations are unproven.

    Regulatory enforcement and investigations; Gaming and virtual worlds; Industry policy and partnerships · Roblox, gaming platforms, Netherlands, Digital Services Act, consumer protection

  8. UK minister says children’s views will shape the under-16 social media decision

    · BBC

    UK online safety minister Kanishka Narayan told children in London on January 30, 2026, that a consultation due in a few weeks would include a section for young people. He said an under-16 ban was one option, alongside curfews, screen time limits and banning certain features, with government action by summer.

    Age limits and social media bans; Legislation and rulemaking · United Kingdom, screen time guidance, screen time limits, social media ban

  9. Critical AI toy security failure exposes children’s data

    · uk.pcmag.com

    Security researchers found that AI toy maker Bondu left more than 50,000 children’s chat logs reachable through a web portal that anyone with a Gmail account could log into, according to Wired. Bondu fixed the portal within hours and said it found no evidence of access beyond the researchers.

    Research and evidence · AI toys, AI toys (devices)

  10. Resolver and Molly Rose Foundation report describes an online network targeting vulnerable children

    · Resolver

    Resolver published a report in partnership with the Molly Rose Foundation about a decentralized online ecosystem known as the Com. The report examined overlapping forms of harm, including sadistic exploitation, violent extremism, and financially motivated cybercrime, and described risks to children across platforms and jurisdictions.

    Research and evidence · Molly Rose Foundation, violent extremism

  11. Bangor survey finds a third of teens rate AI companion chat above talking to a friend

    · bbc.com

    A BBC Wales feature reported a Bangor University survey of 1,009 teens aged 13 to 18, in which about a third found chatting with an AI companion more satisfying than talking to a real friend. It noted calls for tougher regulation after US suicides linked to chatbots.

    Research and evidence; AI chatbots and companions · companion chatbots, survey, chatbots, self-harm and suicide, United Kingdom

  12. EU confronts Grok abuse as Brussels tests its digital powerAllegation

    · dw.com

    The European Commission has opened a formal investigation into Grok after the tool produced millions of sexualized images of women and children. The allegations are unproven.

    Lawsuits and settlements; AI chatbots and companions · Grok, European Union, European Commission, sexualized AI content

  13. Ofcom and the Internet Watch Foundation announced a new agreement on child sexual abuse imagery

    · Ofcom

    Ofcom announced on January 29 that it and the Internet Watch Foundation signed a memorandum of understanding in November on how the IWF can assist Ofcom’s online safety duties, including data and advice on child sexual abuse material. Ofcom said some file-sharing services deployed hash-matching after its enforcement action.

    Legislation and rulemaking; Regulatory enforcement and investigations; AI-generated abuse imagery · Ofcom, Internet Watch Foundation, AI-generated CSAM

  14. Austrian watchdog rules against Microsoft education tracking

    · euractiv.com

    Austria’s data protection authority found that Microsoft 365 Education unlawfully placed tracking cookies on a child’s device without consent, following a noyb complaint filed in June 2024. It ordered Microsoft to stop the tracking within four weeks, noyb said.

    Lawsuits and settlements; Privacy and children’s data; Education and schools · Microsoft, Austria, privacy and data protection

  15. Pornhub to block new UK users over tougher age-check rules

    · wired.com

    Pornhub said that from February 2, only UK users who had already registered and completed age checks would be able to access the site. Its parent company Aylo said the Online Safety Act’s age-check rules were ineffective because users could move to sites that did not comply.

    Age assurance and verification; Legislation and rulemaking · Pornhub / Aylo, age assurance, pornography, United Kingdom, Online Safety Act (UK)

  16. India considers social media bans for children under 16

    · techcrunch.com

    India is emerging as a potential test case for age-based social media restrictions as several states examine Australia-style bans on children’s access to platforms.

    Age limits and social media bans; Research and evidence · India, social media ban, Australia

  17. France’s National Assembly backs under-15 social media ban

    · lemonde.fr

    France’s National Assembly approved a bill on January 26 that would bar children under 15 from covered social media services and extend restrictions on student mobile phone use to high schools. In the Assembly debate, lawmakers discussed changes made after the Council of State questioned the justification for a separate proposed curfew for 15- to 17-year-olds.

    Age limits and social media bans; Legislation and rulemaking · France, social media ban, legislative proposal

  18. UN warns of rising AI-driven threats to child safety

    · news.un.org

    UN agencies have issued a stark warning over the accelerating risks AI poses to children online, citing rising cases of grooming, deepfakes, cyberbullying and sexual extortion.

    AI-generated abuse imagery · UN, international cooperation, AI-enabled harassment, cyberbullying, deepfakes

  19. Verge reports payment processors have not cut off X despite Grok-generated abuse imagery

    · The Verge

    The Verge reported that users could still buy X subscriptions through Stripe or the Apple and Google app stores after Grok generated sexualized images of children. It contrasted that response with payment companies’ past decisions to cut off services such as Pornhub. Stripe and major card networks did not respond to requests for comment.

    AI chatbots and companions; Platform safety features and design; AI-generated abuse imagery · Grok, X (Twitter), AI-generated CSAM, Apple, Google

  20. European Commission opened an investigation into X over Grok sexual deepfakes on January 26Allegation

    · BBC News

    The European Commission opened an investigation on January 26 into whether manipulated sexually explicit images generated by Grok have been shown to users in the EU. A Digital Services Act breach could bring a fine of up to 6% of X’s global annual turnover. The allegations are unproven.

    AI-generated abuse imagery; Regulatory enforcement and investigations; AI chatbots and companions · Grok, X (Twitter), European Union, European Commission, deepfakes

  21. South Korea opened a preliminary privacy review of Grok deepfakesAllegation

    · The Korea Times

    South Korea’s Personal Information Protection Commission began a preliminary fact-finding review of Grok over reports it was used to create sexually exploitative deepfakes, some involving minors. The media regulator had demanded on January 14 that X submit a plan to prevent illegal content and limit minors’ access. The allegations are unproven.

    AI-generated abuse imagery; AI chatbots and companions; Lawsuits and settlements · Grok, deepfakes, South Korea, privacy and data protection, X (Twitter)

  22. Oregon Senator Pushes New AI Safety Bill as Fears Grow Over Chatbots Harming Teen Mental Health

    · dailytidings.com

    Oregon Senator Lisa Reynolds proposed a bill requiring chatbot operators to disclose that responses are AI-generated, monitor chats that signal self-harm and refer users to crisis services, and bar sexually explicit content for minors. Companies would report annually to the Oregon Health Authority on crisis referrals.

    Legislation and rulemaking; AI chatbots and companions; Mental health and self-harm · Oregon (US), chatbots, AI governance, mental health, self-harm and suicide

  23. Macron said France would fast-track an under-15 social media ban

    · CNN

    French President Emmanuel Macron said he wanted the government to fast-track a ban on social media for under-15s so it could be in place before the school year starting in September. He also said mobile phones would be banned in high schools.

    Age limits and social media bans; Legislation and rulemaking · France, Emmanuel Macron, social media ban

  24. Australia’s eSafety Commissioner said platforms accepted the under-16 ban ‘kicking and screaming’

    · BBC News

    Julie Inman Grant told the BBC on January 23 that firms had come ‘kicking and screaming’ to Australia’s social media ban for under-16s, which she said is already exceeding expectations.

    Age limits and social media bans; Regulatory enforcement and investigations; Legislation and rulemaking · Under-16 social media minimum age (Australia), social media ban, Australia, eSafety Commissioner, Julie Inman Grant

  25. Dutch poll found growing support for a social media ban for younger teenagers

    · DutchNews.nl

    A Newcom survey reported by DutchNews on January 23 found 63% of 6,685 respondents in the Netherlands would back a social media ban for under-16s, up 6 points from last year. Support rose most among 16 to 28-year-olds, from 44% to 60%.

    Research and evidence; Age limits and social media bans · Netherlands, social media ban, survey

  26. Massachusetts governor proposed age verification and parental consent for minors on social media

    · Mass.gov

    Governor Maura Healey announced she would file legislation requiring age verification and parental consent for under-18 social media users and disabling features such as continuous scrolling and overnight notifications. Companies that violate the rules would face steep fines.

    Age assurance and verification; Legislation and rulemaking; Platform safety features and design · age assurance, parental consent, Massachusetts (US)

  27. Common Sense Media found AI toy companions posed risks to children

    · The Verge

    The Verge reported that Common Sense Media found developmental, safety, and privacy risks in voice-enabled AI toys designed to encourage emotional attachment. The assessment found that the toys gave inappropriate answers up to about one-quarter of the time.

    Research and evidence; AI chatbots and companions · AI toys, AI toys (devices), Common Sense Media, companion chatbots, privacy and data protection

  28. Analysis reveals Grok generated 3 million sexualized images

    · counterharm.com

    A new analysis found Grok generated an estimated three million sexualized images in 11 days, including around 23,000 appearing to depict children.

    AI chatbots and companions; Platform safety features and design; Research and evidence · Grok, sexualized AI content

  29. Ofcom and international regulators set out expectations on age assurance to protect children

    · Ofcom

    The Global Online Safety Regulators Network, which includes Ofcom, set out four principles on January 22 for regulators’ approach to age assurance: its foundational role in protecting children, outcome-focused standards such as accuracy and fairness, respect for privacy and data protection, and fair, proportionate enforcement.

    Regulatory enforcement and investigations; Age assurance and verification; Legislation and rulemaking · Ofcom, age assurance, privacy and data protection

  30. The House of Lords backs social media ban for under-16s

    · bbc.com

    The United Kingdom’s House of Lords voted 261 to 150 to back an amendment to the government’s schools bill that would ban under-16s from social media. The government said it would seek to overturn the amendment in the House of Commons.

    Age limits and social media bans; Lawsuits and settlements; Legislation and rulemaking · social media ban, legislative proposal, United Kingdom

  31. Meta sought to bar mentions of mental health from New Mexico child safety trial, Wired reportedAllegation

    · WIRED

    WIRED reported on January 21 that Meta had asked a New Mexico judge to exclude certain studies and articles about social media and youth mental health, along with references to Mark Zuckerberg’s time at Harvard. New Mexico alleged that Meta had failed to protect minors from sexual exploitation on its platforms. The allegations are unproven.

    Lawsuits and settlements; Mental health and self-harm · Meta, New Mexico (US), mental health, Mark Zuckerberg

  32. Philippines to lift its ban on Grok after xAI vowed safeguards, Bloomberg reported

    · Bloomberg

    ABS-CBN reported on January 21 that the Philippine Cybercrime Investigation and Coordinating Center planned to lift its block on Grok after talks with xAI about safeguards against sexually explicit AI-generated content.

    Legislation and rulemaking; AI chatbots and companions; Platform safety features and design · Grok, xAI, Philippines, Bloomberg

  33. House of Lords voted to back a UK social media ban for under-16s on January 21

    · BBC News

    The House of Lords voted 261 to 150 on January 21 to back a UK social media ban for under-16s through an amendment to the government’s schools bill. The government said it would not accept the amendment and would try to overturn it in the Commons while it runs a three-month consultation.

    Age limits and social media bans; Legislation and rulemaking · social media ban, United Kingdom

  34. OpenAI rolled out age prediction on ChatGPT globally

    · Reuters

    OpenAI said it was rolling out age prediction in ChatGPT to identify accounts likely to belong to people under 18 and automatically add safeguards. Reuters reported that users incorrectly placed in the protected experience could restore full access by submitting a selfie through Persona.

    AI chatbots and companions; Age assurance and verification; Platform safety features and design · ChatGPT, OpenAI, age assurance, Persona (age verification)

  35. EU explored banning AI nudification apps under the AI Act

    · Politico Europe

    The European Commission said it was looking into a ban on AI apps that undress people online, after abusive content generated through X’s Grok. European Parliament lawmakers had called for the ban under the AI Act, which did not list nudification apps among its prohibited practices.

    AI-generated abuse imagery; Legislation and rulemaking · EU AI Act, nudification, European Union, Grok, X (Twitter)

  36. UK government opened a consultation on children’s social media use, including a possible ban

    · GOV.UK

    The UK government announced a consultation on children’s social media use that would consider a minimum age or ban, better age assurance, a higher digital age of consent and limits on features such as infinite scrolling. It also said Ofsted would check school phone bans on every inspection.

    Legislation and rulemaking; Age assurance and verification · United Kingdom, addictive design, age assurance, age limits, school phone bans

  37. UK, France mull social media bans for youth amid rage restriction debate

    · geo.tv

    AFP reported on January 19 that France and Britain are considering following Australia in banning children from social media, while experts disagree over the evidence. France’s health watchdog Anses found social media harmed adolescents, particularly girls, without being the sole cause of declining mental health.

    Legislation and rulemaking; Age limits and social media bans · France, United Kingdom, age limits, social media ban, mental health

  38. Governments weighed Australia-style social media bans for under-16s

    · CNBC

    CNBC reported that the UK, France, Denmark, Spain, Germany, Italy and Greece were among countries considering bans like Australia’s under-16 law, which took effect December 10 with fines of up to A$49.5 million. The UK House of Lords was expected to vote that week on an amendment.

    Age limits and social media bans; Legislation and rulemaking · Australia, social media ban, Under-16 social media minimum age (Australia), United Kingdom, Denmark

  39. Washington state lawmakers look to protect minors from AI chatbots

    · Oregon Public Broadcasting - OPB

    Washington lawmakers are weighing Senate Bill 5984 and House Bill 2225, which would require AI companion chatbots to remind users every three hours they are not talking to a person, bar explicit content for minors and require suicide-prevention protocols. The tech industry has pushed back; the law would take effect January 1, 2027 if passed.

    Legislation and rulemaking; AI chatbots and companions · chatbots, companion chatbots, legislative proposal, self-harm and suicide, sexualized AI content

  40. California attorney general ordered xAI to stop creating sexualized images of childrenAllegation

    · Axios

    California Attorney General Rob Bonta sent xAI a cease and desist letter demanding it halt creation and distribution of fake sexualized images of children, after opening an investigation on Wednesday. X said it had added safeguards, but users could still produce images of people in bikinis. The allegations are unproven.

    AI-generated abuse imagery; Lawsuits and settlements · xAI, sexualized AI content, California (US), X (Twitter)

  41. IWF recorded 3,440 AI child sexual abuse videos in 2025, up from 13

    · Internet Watch Foundation

    The Internet Watch Foundation said 2025 was its worst year on record for online child sexual abuse material, with 312,030 confirmed reports. Analysts found 3,440 AI-generated videos of child sexual abuse, up from 13 in 2024, and 65 percent were Category A.

    AI-generated abuse imagery; Research and evidence · Internet Watch Foundation, AI-generated CSAM

  42. TikTok faces perilous legal challenge over child safety concernsAllegation

    · bbc.com

    A British mother whose child died called for accountability from TikTok as a Delaware court prepared to hear the company’s motion to dismiss a lawsuit brought by five British families. The allegations are unproven.

    Platform safety features and design · TikTok, United Kingdom, Delaware (US)

  43. Turkish parliamentary subcommission drafted proposals to restrict children’s social media use

    · Turkiye Today

    A Turkish parliamentary subcommission completed a 204-page draft report with 82 proposals on digital threats to children, reported January 16. It recommends that platforms not serve under-15s, mandatory age verification, night-time internet limits for under-18s and bans on loot boxes in games for children.

    Legislation and rulemaking; Age assurance and verification · Turkey, age assurance, online gambling / loot boxes

  44. Senate witnesses said AI companions threaten children’s emotional development more than social media

    · U.S. Senate Commerce Committee

    At a January 15 Senate Commerce Committee hearing on children’s screen time, several witnesses said AI companions posed a greater threat to children’s emotional development than social media. Witnesses included pediatrician Jenny Radesky and psychologist Jean Twenge. Senator Maria Cantwell argued that Congress should preserve states’ ability to protect children while setting federal standards.

    Legislation and rulemaking; AI chatbots and companions · United States, companion chatbots, Senate Commerce Committee, screen time guidance, screen time limits

  45. AI deepfake images fuel school bullying concerns

    · bbc.com

    Police on the Isle of Man have warned of a sharp increase in pupils creating AI-generated images to bully or ridicule classmates.

    AI-generated abuse imagery; Education and schools · AI-enabled harassment, cyberbullying, deepfake nudes in schools, deepfakes, criminal prosecution

  46. Ofcom opened an investigation into Novi Ltd, operator of Gen AI site Joi.com, on January 15Allegation

    · Ofcom

    Ofcom opened an investigation on 15 January into Novi Ltd, operator of Gen AI site Joi.com, over whether it used highly effective age assurance to keep children from pornographic content. Ofcom closed the case on 31 July 2026 without findings after the company introduced age assurance.

    Regulatory enforcement and investigations; Lawsuits and settlements; Age assurance and verification · Ofcom, age assurance, pornography

  47. YouTube added parental controls for teens including Shorts time limits on January 14

    · YouTube Official Blog

    YouTube announced new parental controls for supervised teen accounts on January 14, including Shorts time limits, a signup experience and recommendations of higher-quality teen content.

    Platform safety features and design · YouTube, parental controls, screen time limits, algorithmic feeds, teen accounts

  48. X said it would block Grok from undressing images of real people where illegal

    · BBC News

    X said on January 14 that new technological measures would stop Grok from removing clothing from images of real people in jurisdictions where it is illegal, the BBC reported.

    AI-generated abuse imagery; AI chatbots and companions; Platform safety features and design · Grok, X (Twitter), nudification

  49. Xbox, Nintendo and Sony updated their shared online safety principles on January 14

    · Xbox Wire

    Microsoft’s Xbox, Nintendo and Sony Interactive Entertainment published updated shared safety principles on January 14, built around prevention, partnership and responsibility. They cite parental controls, participation in the Tech Coalition’s Lantern program and escalating enforcement for repeat violations.

    Platform safety features and design; Gaming and virtual worlds · Xbox, gaming platforms, Microsoft, Lantern (Tech Coalition), Tech Coalition

  50. Australia raises concerns over AI misuse on X

    · esafety.gov.au

    The eSafety regulator in Australia has expressed concern over the misuse of the generative AI system Grok on social media platform X, following reports involving sexualized or exploitative content, particularly affecting children.

    Legislation and rulemaking · X (Twitter), Australia, Grok, eSafety Commissioner, sexualized AI content

  51. AI-powered toys navigate safety concerns after early missteps

    · japantoday.com

    Toy makers at the Consumer Electronics Show highlighted efforts to improve AI in playthings following troubling early reports of chatbots giving unsuitable responses to children’s questions.

    Research and evidence · AI toys, AI toys (devices), chatbots

  52. US Senate passed the DEFIANCE Act letting deepfake victims sue creators of explicit images

    · The Verge

    The US Senate passed the DEFIANCE Act by unanimous consent on January 13. The bill would allow victims of nonconsensual sexually explicit deepfakes to sue the people who created the images for damages, and it still needed to pass the House.

    Legislation and rulemaking; AI-generated abuse imagery; Lawsuits and settlements · United States, deepfakes, legislative proposal

  53. Keir Starmer told MPs on January 13 he is open to an Australian-style social media ban

    · The Guardian

    UK Prime Minister Keir Starmer told Labour MPs on January 12 that he was open to an Australian-style social media ban for young people. The Guardian reported the next day that concerns about children’s screen time had led him to reconsider his position.

    Legislation and rulemaking; Age limits and social media bans · United Kingdom, Keir Starmer, social media ban, Australia, screen time guidance

  54. Indonesia and Malaysia restrict access to Grok AI over content safeguards

    · bbc.com

    Malaysia and Indonesia have restricted access to Grok, the AI chatbot available through the X platform, following concerns about its image generation capabilities.

    AI chatbots and companions; Platform safety features and design; Legislation and rulemaking · Grok, Indonesia, Malaysia, X (Twitter), chatbots

  55. UK considers regulatory action after Grok’s deepfake images on X

    · euractiv.com

    UK Prime Minister Keir Starmer is consulting Canada and Australia on a coordinated response to concerns surrounding social media platform X, after its AI assistant Grok was used to generate sexualized deepfake images of women and children.

    AI-generated abuse imagery; AI chatbots and companions; Regulatory enforcement and investigations · Grok, X (Twitter), United Kingdom, deepfakes, Keir Starmer

  56. Teen deepfake victim helped create a training course on explicit deepfake abuse

    · edition.cnn.com

    A 16-year-old US advocate, targeted at 14 by a classmate’s deepfake nude, helped create a free online course on non-consensual explicit deepfakes for students, parents and school staff. It was made with Adaptive Security and Pathos Consulting Group and takes about 17 minutes.

    AI-generated abuse imagery · deepfakes, deepfake nudes in schools, United States

  57. Ofcom opened a formal investigation into X over Grok sexualized imagery on January 12Allegation

    · Ofcom

    Ofcom opened a formal Online Safety Act investigation into X on January 12 over reports that the Grok chatbot account was used to create and share undressed images of people and sexualized images of children that may amount to child sexual abuse material. The allegations are unproven.

    Regulatory enforcement and investigations; AI-generated abuse imagery; AI chatbots and companions · Grok, X (Twitter), Ofcom, sexualized AI content, Online Safety Act (UK)

  58. Guardian traced how the Grok nudification trend grew to hundreds of thousands of requests

    · The Guardian

    The Guardian reported that a “put her in a bikini” trend on X escalated within days into hundreds of thousands of requests asking Grok to strip clothes from photos of women, with the images posted publicly. Women who were targeted described their alarm at finding altered photos of themselves.

    AI-generated abuse imagery; AI chatbots and companions · Grok, nudification, X (Twitter)

  59. Meta removed 544,052 teen accounts in Australia after the under-16 ban

    · AAP

    Meta said it removed 544,052 accounts it believed belonged to under-16s from Instagram, Facebook and Threads between December 4 and 11, in a compliance update a month after Australia’s ban began. Meta also argued the law failed to improve teen safety and called for app store age checks.

    Age limits and social media bans; Age assurance and verification; Legislation and rulemaking · Meta, Under-16 social media minimum age (Australia), Australia, social media ban, teen accounts

  60. UK safeguarding minister urged police to pursue Grok deepfake creators and warned X

    · mirror.co.uk

    UK Safeguarding Minister Jess Phillips told the Mirror on January 11, 2026 that police must relentlessly pursue people who create AI deepfake images of children. She called limiting Grok’s image generator to paying users a half-measure and said the government would act if X did not.

    AI-generated abuse imagery; AI chatbots and companions; Criminal cases and prosecutions · Grok, X (Twitter), criminal prosecution, deepfakes, United Kingdom

  61. Statewide AI Safety Measure Emerges for California Youth

    · govtech.com

    Common Sense Media introduced the Parents and Kids Safe AI Act as a proposed California ballot measure, backed publicly by OpenAI. It would require age assurance, limit data use for minors, require child-safety audits and expand parental controls. It revises AB 1064, which Governor Gavin Newsom vetoed in 2025.

    Legislation and rulemaking; Age assurance and verification; Platform safety features and design · California (US), AI governance, EU AI Act, OpenAI, Common Sense Media

  62. OpenAI and Common Sense Media joined to back an AI child safety ballot measure

    · thenews.com.pk

    OpenAI and Common Sense Media agreed to back one ballot initiative, the Parents & Kids Safe AI Act, to limit how chatbots interact with children, the Wall Street Journal reported. OpenAI committed at least $10 million. The measure needs about 875,000 signatures to qualify for the November ballot.

    AI chatbots and companions; Legislation and rulemaking · OpenAI, Common Sense Media, EU AI Act, chatbots

  63. New York Seeks to Restrict AI Chatbots, Expand Teen Mental Health Training

    · bkreader.com

    Governor Kathy Hochul proposed expanding age verification, defaulting children’s accounts to the highest privacy settings, disabling certain AI chatbot features for minors and strengthening parental controls over purchases. She also proposed Teen Mental Health First Aid for every 10th grader over time, reaching more than 180,000 students a year.

    Legislation and rulemaking; AI chatbots and companions; Mental health and self-harm · chatbots, mental health, New York (US), age assurance, parental controls

  64. Kentucky attorney general sues AI company over child safety concernsAllegation

    · kykernel.com

    Kentucky Attorney General Russell Coleman sued Character Technologies, owner of Character.AI, on January 8, alleging the platform exposed children to substance abuse, suicide and sexual behavior and lacked age verification and parental filters. The state seeks an end to deceptive practices and required age checks. The allegations are unproven.

    Lawsuits and settlements · Kentucky (US), Character.AI, age assurance, self-harm and suicide

  65. Grok chatbot acknowledges potentially violating child safety lawsAllegation

    · foxnews.com

    Grok AI chatbot admits generating sexualized images of minors, violating ethical standards. Elon Musk’s X platform faces global government investigations. The allegations are unproven.

    AI chatbots and companions; AI-generated abuse imagery · Grok, chatbots, X (Twitter), Elon Musk, sexualized AI content

  66. EU instructs X to keep all Grok chatbot records

    · euractiv.com

    The European Commission has ordered X to retain all internal documents and data on its AI chatbot Grok until the end of 2026.

    AI chatbots and companions; AI-generated abuse imagery · Grok, X (Twitter), chatbots, European Union, European Commission

  67. Character.AI and Google settled lawsuits over teen suicides

    · mashable.com

    Character.AI and Google settled several lawsuits filed by parents of teens who died by suicide after long chatbot conversations, Mashable reported on January 9, 2026. The settlement details must still be finalized by the court. The allegations are unproven.

    Lawsuits and settlements; AI chatbots and companions; Mental health and self-harm · Character.AI, Google, settlement, self-harm and suicide, chatbots

  68. X limited Grok image editing to paying users after deepfake backlash

    · bbc.com

    X limited Grok’s image editing function to paying subscribers on January 9, 2026, after criticism over non-consensual sexualized deepfakes. Technology Secretary Liz Kendall said she would back Ofcom if it blocked UK access to X, and Downing Street called the change insulting to victims.

    AI-generated abuse imagery; AI chatbots and companions · X (Twitter), Grok, deepfakes, United Kingdom, Liz Kendall

  69. Grok limited image generation on X to paying subscribers on January 9

    · X (Grok account)

    TechCrunch reported on January 9 that Grok told users image generation and editing on X were limited to paid subscribers after backlash over sexualized imagery. The standalone Grok app still allowed image generation without a subscription at publication.

    AI chatbots and companions; Platform safety features and design; AI-generated abuse imagery · Grok, X (Twitter), sexualized AI content

  70. Wired asks why Apple and Google still host Grok and X while removing other nudify apps

    · WIRED

    WIRED reported on January 8 that Grok was used to flood X with thousands of sexualized images of adults and apparent minors, with one researcher counting about 6,700 sexually suggestive or nudifying images an hour on January 5–6. Apple and Google removed other nudify apps but still hosted X and Grok.

    AI-generated abuse imagery; AI chatbots and companions; Platform safety features and design · Grok, X (Twitter), Apple, Google, nudification

  71. IWF found criminal imagery of children apparently made with Grok

    · Sky News

    The Internet Watch Foundation said its analysts found criminal imagery of girls aged 11 to 13 that appeared to have been made with Grok Imagine, on a dark web forum rather than on X. The material fell under UK Category C, and users then used another AI tool to make more extreme video.

    AI chatbots and companions; AI-generated abuse imagery · Grok, Internet Watch Foundation, X (Twitter), United Kingdom

  72. Roblox rolls out facial age checks for chat

    · about.roblox.com

    The online gaming platform, Roblox, has begun a global rollout requiring facial age checks before users can access chat features, expanding a system first tested in selected regions late last year.

    Age assurance and verification; Gaming and virtual worlds · Roblox, age assurance, biometric age estimation, biometric data, gaming platforms

  73. Wired review finds Grok’s website producing graphic sexual content including apparent minors

    · WIRED

    A WIRED review published January 7 of outputs on Grok’s website and app found graphic, sometimes violent sexual videos and images, including content that appears to involve minors. AI Forensics researcher Paul Bouchaud estimated that a little under 10 percent of about 800 archived outputs appeared to be child sexual abuse material.

    AI-generated abuse imagery; AI chatbots and companions · Grok, sexualized AI content, AI-generated CSAM

  74. Former Texas teacher accused of using AI to make explicit images of students pleads guilty to possessionAllegation

    · foxla.com

    A former Texas teacher pleaded guilty in federal court to possessing child sexual abuse material. Investigators found more than 365,000 images on his devices, some AI-generated from real photos of students. The allegations are unproven.

    AI-generated abuse imagery; Education and schools · AI in education, Texas (US), deepfake nudes in schools, AI-generated CSAM, United States

  75. Grok generated sexualized images of women and children, drawing condemnation in Europe

    · theguardian.com

    Grok generated sexualized images of women and children on X in response to user prompts. French ministers referred the images to prosecutors. X confirmed three days after Grok’s public apology that it had removed child sexual abuse material.

    AI-generated abuse imagery; AI chatbots and companions; Platform safety features and design · Grok, sexualized AI content, X (Twitter), AI-generated CSAM, criminal prosecution

  76. FTC sought a $10 million settlement with Disney over mislabeled kids’ YouTube videos, Malwarebytes reportedAllegation

    · Malwarebytes

    Malwarebytes reported on January 6 that the FTC is seeking a $10 million settlement with Disney over allegations that children’s privacy laws were violated by mislabeling kid-focused YouTube videos. The allegations are unproven.

    Lawsuits and settlements; Regulatory enforcement and investigations · Disney, YouTube, FTC, settlement, privacy and data protection

  77. Turkey moved to draft a ban on social media access for children under 15

    · Turkish Minute

    Turkey is drafting legislation to bar children under 15 from social media, Family Minister Mahinur Özdemir Göktaş said on January 6. Platforms could not offer services or allow accounts for under-15s and would have to filter harmful content; the bill was due at a parliamentary committee by the end of January.

    Age limits and social media bans; Legislation and rulemaking · Turkey, social media ban

  78. California senator proposed a four-year ban on AI chatbot toys for children

    · TechCrunch

    California Senator Steve Padilla introduced SB 867, which would have placed a four-year moratorium on selling or making toys with AI chatbot capabilities for children under 18. The pause was meant to give regulators time to write safety rules. He cited lawsuits over chatbot-linked teen suicides.

    Legislation and rulemaking; AI chatbots and companions · chatbots, AI toys, AI toys (devices), California (US), self-harm and suicide

  79. France and Malaysia opened probes into Grok sexualized deepfakesAllegation

    · TechCrunch

    French and Malaysian authorities investigated Grok after it generated sexualized deepfakes of women and minors on X. India’s IT ministry had ordered X on January 2 to restrict such content within 72 hours. The allegations are unproven.

    AI-generated abuse imagery; AI chatbots and companions; Regulatory enforcement and investigations · Grok, deepfakes, sexualized AI content, France, Malaysia

  80. Malaysia, France and India criticized X over offensive Grok images on January 4

    · Bloomberg

    Bloomberg reported on January 4 that authorities in Malaysia, France and India had raised concerns over sexualized images generated by Grok on X. Malaysia opened an investigation after complaints about manipulated images of women and minors, while France said the images may violate EU digital services rules. The allegations are unproven.

    Legislation and rulemaking; AI chatbots and companions; AI-generated abuse imagery · Grok, X (Twitter), France, Malaysia, India

  81. India ordered X to review Grok over sexually explicit images of women and childrenAllegation

    · Business Standard

    India’s IT ministry gave X 72 hours to submit an action-taken report on Grok and to remove sexually explicit content, including images of children. It warned X could lose its liability exemption under the IT Act if it failed to comply. The allegations are unproven.

    AI-generated abuse imagery; AI chatbots and companions; Lawsuits and settlements · X (Twitter), Grok, India, MeitY (India), sexualized AI content

  82. European regulators weighed action against X after Grok deepfake of a minorAllegation

    · The Record from Recorded Future News

    Regulators in Europe considered action against X after Grok was used to create a sexualized image of a 14-year-old actress. The Paris prosecutor added the incident to an existing investigation of X, and the UK government said it planned to ban nudification tools. The allegations are unproven.

    AI-generated abuse imagery; Regulatory enforcement and investigations; AI chatbots and companions · X (Twitter), Grok, deepfakes, criminal prosecution, nudification

  83. Grok said safeguard lapses led it to generate images of minors in minimal clothing

    · The Guardian

    Grok posted on 2 January that lapses in safeguards had led it to generate images depicting minors in minimal clothing on X, amid a week of sexualized images made on user prompts. xAI said it was urgently fixing the lapses and that child sexual abuse material is illegal and prohibited.

    AI-generated abuse imagery; AI chatbots and companions; Platform safety features and design · Grok, X (Twitter), xAI, AI-generated CSAM, sexualized AI content

  84. Malaysia’s Online Safety Act duties for large social media platforms took effect January 1

    · South China Morning Post

    Malaysia’s Online Safety Act took effect January 1. The Malaysian Communications and Multimedia Commission said qualifying social media services were brought within its licensing framework and that licensed providers had obligations covering risk-based safety measures, child protection, and user reporting and assistance.

    Legislation and rulemaking · Online Safety Act (UK), Malaysia, European Commission