Blog

Companion App Platform Bans and Policy Updates After Safety Scrutiny

App stores updated policies on AI companions after safety incidents. Compare Apple, Google, and OpenAI store rules affecting Character-style apps.

Companion app platform policy updates Apple Google AI chatbot store rules 2026
Apple and Google tightened AI companion app policies in 2025 and 2026 after safety incidents, driving Character.AI to end open-ended teen chats.

App store operators escalated enforcement against AI companion apps after lawsuits, FTC inquiries, and state legislation linked persistent chatbot relationships to harm among minors. The companion app platform policy landscape shifted from voluntary content filters to mandatory age assurance, store guideline updates, and product bans on open-ended teen chat experiences. Character.AI, Replika-style apps, and Meta AI character features all faced platform pressure in 2025 and 2026.

This analysis maps the policy change timeline, compares Apple and Google rules, explains age rating and content limits, and lists developer compliance steps for teams shipping AI chatbot or AI companion experiences on mobile stores.

Policy Change Timeline for Companion Apps

Platform policy pressure on companion apps accelerated from early 2025 store rating changes through late 2025 product bans on teen open-ended chat, with California signing companion safety legislation in September 2026. The sequence shows platforms acting before federal legislation passed but after high-profile litigation and media investigations.

Date Actor Action
Jan 2025 Apple, Google Reportedly urged Character.AI to tighten teen content filters; Apple raised age rating to 17+
Aug 2024 Google Acquired Character.AI leadership team; safety filters intensified post-deal
2025 FTC Opened probes into seven companies including OpenAI and Character.AI on child safety
Oct 2025 Character.AI Announced end of open-ended chat for users under 18 by November 25, 2025
Oct 2025 US Senate Hawley and Blumenthal announced bill to ban AI companion chatbots for minors
Sep 2026 California Signed Adam's Law (SB 1119) regulating companion chatbot safety duties
2026 Apple Updated age rating system with 13+, 16+, 18+ tiers and AI-specific questionnaire items

Character.AI phased teen access down through shrinking daily time limits before the November 2025 cutoff. The company retained creative features (stories, short videos) for younger users while blocking open-ended persona chat. Age verification combined behavioral signals, third-party tools like Persona, and facial recognition or ID checks as fallback.

Apple and Google Store Rules Compared

Neither Apple nor Google issued blanket bans on AI companion apps, but both tightened generative AI content policies, age rating requirements, and enforcement against apps that fail to restrict minors from mature conversational content. Developers must treat companion apps as high-risk categories comparable to dating or social products.

Requirement Apple App Store Google Play
Generative AI policy scope Guideline 4.7 on non-embedded software; 5.1.2(i) third-party AI data sharing consent AI-Generated Content policy for text-to-text chatbots as central feature
Prohibited outputs Objectionable content, child exploitation, misleading metadata CSAM, deepfake sexual material, self-harm encouragement, sexually gratifying AI apps
Age controls Guideline 4.7.5 verified or declared age restriction; Declared Age Range API Play age ratings plus family policies; reporting mechanism required
User reporting Flag content exceeding app age rating In-app flagging without leaving app (required for generative AI apps)
Rating questionnaire New 2026 questions on messaging, UGC, ads, AI assistants IARC content rating with generative AI considerations

Meta introduced parental controls in 2026 allowing parents to block teen AI character chats on Facebook, Instagram, and the Meta AI app in the US, UK, Canada, and Australia. OpenAI's GPT Store policies restrict romantic companion personas in ways that parallel mobile store enforcement, though GPT Store is not an Apple or Google distribution channel.

Age Rating and Content Limits

Apple's 2026 age rating overhaul added 13+, 16+, and 18+ tiers with mandatory questionnaire items covering AI assistants, messaging, user-generated content, and advertising. Developers can override to a higher rating when internal policies require a minimum age above Apple's calculated score. Character.AI now lists 18+ on the US App Store.

Google Play's AI-Generated Content policy explicitly covers text-to-text chatbot apps where AI conversation is a central feature. Apps must prevent generation of child exploitation material, non-consensual deepfakes, self-harm encouragement, election disinformation, bullying content, and apps primarily intended to be sexually gratifying. Limited-scope apps that only host AI content without generating it fall under User Generated Content rules instead.

  • Complete Apple age rating questionnaire honestly; mis-rating triggers regulatory inquiries
  • Implement age restriction mechanisms before launch, not after store warning
  • Separate teen and adult experiences at the product architecture level where feasible
  • Document content moderation pipelines for App Review and Play policy appeals
  • Prepare crisis escalation paths for self-harm or abuse disclosures in chat logs

Developer Compliance Steps

Companion app developers should assume store review teams treat anthropomorphic chat, romantic roleplay, and persistent memory as sensitive features requiring proactive safety engineering. Compliance is a product requirement, not a legal footnote added before submission.

  1. Age assurance: Deploy declared age, behavioral signals, and third-party verification before enabling open chat
  2. Content classifiers: Block sexual, violent, and self-harm content in outputs and user prompts for minor accounts
  3. AI disclosure: Clearly label bot identity; avoid deceptive human impersonation in metadata
  4. Reporting UX: One-tap in-app reporting per Google Play; flagging for content above age rating per Apple 4.7.5
  5. Parental controls: Offer account linking or restriction APIs where platform APIs exist
  6. Data consent: Obtain explicit permission before sharing chat data with third-party AI per Apple 5.1.2(i)
  7. Policy monitoring: Track California Adam's Law and copycat state bills for duty-of-care duties

Teams distributing only on web should still monitor store policies because investors, partners, and regulators treat mobile store enforcement as industry baseline expectations. A web-only companion that would fail App Review faces similar scrutiny in FTC inquiries and wrongful-death litigation discovery.

Frequently Asked Questions

Did Apple or Google ban Character.AI?

No blanket ban occurred. Both platforms reportedly pressured Character.AI to strengthen filters and raise age ratings. Character.AI voluntarily ended open-ended chat for users under 18 in November 2025 while keeping the app listed at 18+ on iOS.

What is Google Play's AI-Generated Content policy?

Google requires generative AI apps with chatbot, image, voice, or video generation as central features to block prohibited content categories, provide in-app reporting, and comply with all Developer Policy Center rules including child safety and deceptive behavior prohibitions.

What does Apple Guideline 4.7.5 require?

Apps must let users identify software exceeding the app's age rating and use verified or declared age mechanisms to block underage access to mature content. Creator apps face additional obligations under 4.7.5(a).

Are AI companion chatbots banned for minors federally?

As of September 2026, no federal ban had passed Congress. Senators Hawley and Blumenthal announced companion ban legislation in October 2025. California SB 1119 imposes safety duties rather than a full ban.

How do store policies interact with state companion laws?

Store rules set minimum platform requirements. State laws like California's Adam's Law add enforceable duty-of-care obligations, crisis escalation duties, and potential civil remedies beyond app store delisting. Developers must comply with both layers.

Related blogs

  • AI Lecture Transcription and Structured Notes: Student Workflow in 2026

    AI Lecture Transcription and Structured Notes: Student Workflow in 2026

    Otter-style tools chunk lectures into summaries and flashcards. Compare note quality, consent requirements, and disability accommodation policies.

  • AI Surgical Phase Recognition From Video: Training, Safety, and OR Integration

    AI Surgical Phase Recognition From Video: Training, Safety, and OR Integration

    Computer vision segments operations into phases for training analytics and safety checks. Explore data consent in the OR and autonomous vs assistive claims.

  • How to Use AI Tool Directories Without Wasting Hours

    How to Use AI Tool Directories Without Wasting Hours

    Treat AI directories as discovery infrastructure, not buying advice. A five-step process to shortlist, verify, and test tools in under an hour.

  • AI SETI Signal Filtering: How Machine Learning Searches Radio Sky Noise

    AI SETI Signal Filtering: How Machine Learning Searches Radio Sky Noise

    Breakthrough Listen and successors use ML to separate anthropogenic RFI from candidate technosignatures. Understand feature engineering and the burden of proof.

  • How to Do Reddit Marketing Efficiently (Without Being Spammy)

    How to Do Reddit Marketing Efficiently (Without Being Spammy)

    Unlock the power of Reddit marketing authentically. Learn how to strategically engage in niche communities

  • AI Tools in Healthcare: Compliance Basics for Non-Clinical Teams

    AI Tools in Healthcare: Compliance Basics for Non-Clinical Teams

    Healthcare AI use triggers HIPAA and clinical safety rules. Learn what non-clinical teams can use where PHI boundaries lie and vendor BAA requirements.

Didn't find tool you were looking for?

Be as detailed as possible for better results