Requires operators of AI companions to detect signs of suicidal ideation or self-harm and refer users to crisis services, and to tell users they are interacting with AI at the start of a session and at least every three hours of continued use.
Why it matters
Companion and 'friend' chatbot apps available in New York need crisis-detection protocols and recurring AI disclosures; the Attorney General enforces.
What it requires
Penalties
Civil penalties up to $15,000 per day, enforced by the Attorney General (fines fund suicide-prevention programmes)
Cite this record
Artificial Intelligence Companion Models (General Business Law Article 47). New York Legislature (FY2026 enacted budget) / Governor. Status: In force. wheresthe.ai, https://wheresthe.ai/rule/us-ny-ai-companion-safeguards-2025/ (verified 4 Oct 2026).
Line of Thought
Developments connected to this rule
What has happened that this rule shapes, or that shapes it. Pick one to keep following the thread.
- DevelopmentIllinois bars AI from delivering therapy without a licensed professional1 Aug 2025 · Rule change · US-IL, US
- DevelopmentFDA proposes a risk framework for generative AI medical devices18 Aug 2026 · Policy · US
- DevelopmentFDA loosens oversight of AI decision-support software and health wearables6 Jan 2026 · Rule change · US
More from New York
-
Enacted, not yet in forceApplies 1 Jan 2027
-
In forceEffective 5 Jul 2023