I believe it is not the chatbots falut. They are just the symptoms of a broken system. And while we can harp on the unethically sourced materials they trained them on, LLM at the end of the day is only a tool.
These people turned to a tool (that they do not understand) - instead of human connection. Instead of talking to real people or professional help. And That is the real tragedy - not an arbitrary technology.
We need a strong social network, where people actually care and help each other. You know all the idealistic things that capitalism and social media is "destroying".
Blaming AI is just a smoke screen. Or a red cape to taunt the bull before it gets stabbed to death.
Again llm is a misused tool. They do not need llm they need psychological help.
The problem is that they go and use these flawed tools that were not designed to handle these kind of use cases. Shoulda been? Maybe. But it is not the AIs fault that we are failing to be a society.
You can't blame the bridges because some people jumped off them. They serve a different reason.
We are failing those people and forcing them to tirn to llms.
We are the reason they are desperate - llm didn't break up with them or make them loose their homes or became isolated from other humans.
It is the humans fault and if we can't recognize that - we might as well end it for all.