The professional literature now systematically documents cases where the use of artificial intelligence has led to serious damage. Between 2024 and 2025, there were at least six Deaths Linked to Chatbots Reported: Teenagers and young adults who confided their suicidal thoughts to a chatbot that did not respond appropriately but instead validated their feelings or even provided information on how to carry out the act.
A Systematic review from 2025 showed that all of the large language models tested failed to detect suicidal intent and psychotic symptoms. This paper also discusses the phenomenon now known as „AI psychosis.“ AI systems reinforce delusions rather than encouraging reality testing. They exacerbate the erroneous attribution of meaning in patients experiencing psychotic processes.
Some of the inner convictions that develop in this context are: „If AI understands my thoughts, then they must be true.“ Or: „The chatbot confirms that everyone else is wrong.“ These cycles of validation can be devastating, especially for people who are susceptible to them.
The use of AI is contraindicated in cases of severe personality disorders, dissociative states, acute trauma reactions, and eating disorders without clinical supervision. What is missing here is what defines therapy: the nuanced calibration of the intervention, the recognition of the need for stabilization, and the ability to guide a process rather than merely reacting to text. In other words: an empathetic understanding that machines are incapable of.
The American Psychological Association, the professional association for psychology in the United States, published a Advisory with Clear Warnings: Most AI systems are not designed for clinical feedback, lack scientific validation, do not have adequate safety protocols, and have not received regulatory approval⁹. A A 2025 study by Brown University showed that AI systems systematically violate 15 ethical standards across five categories: failure to adapt to context, lack of therapeutic collaboration, deceptive empathy, unfair discrimination, and lack of crisis intervention.
What happens in a therapeutic relationship cannot be digitized. Genuine empathy is intersubjective resonance: I sense what is going on inside you because I, too, am a sentient being. AI simulates empathetic phrasing, but it lacks physical co-regulation—breathing in the same rhythm, nonverbal mirroring. This physical co-presence is not merely a pleasant side effect of therapy. It is its very core and the blind spot of any artificial or mechanistic solution.
Every form of therapy depends on the relationship between two people, and that cannot be translated into a linguistic model. Clinical judgment means assessing risks, thinking in terms of differential diagnosis, and guiding the process. A chatbot can recognize patterns in text. It cannot sense when someone is slipping into a dissociative state. It cannot decide whether an intervention would be helpful or retraumatizing at that moment. Therapeutic practice means responding to what is left unsaid, not just to the text.
In my practice—whether via video or in person—I have often observed just how subtle these moments are: a hesitation, a change in breathing pattern, a sentence left unfinished. These are the cues a therapist responds to.