

I honestly cannot think of a single reason why I, or anyone else, would want this crud built into anything other than toys, and even then I doubt it would end well.
Okay, I know it’s bad form to reply to my own post, but one day after I posted the above, I saw this story.
AI-powered plushie pulled from shelves after giving advice on BDSM sex and where to find knives
It also explains different sex positions, “giving step-by-step instructions on a common ‘knot for beginners’ for tying up a partner, and describing roleplay dynamics involving teachers and students and parents and children – scenarios it disturbingly brought up itself,” the report stated.

And this is why the vast majority of people, particularly in the USA, should not be using AI. Critical thinking has been a weakness in the USA for a very long time and is essentially a now four-letter word politically. The conservatives in the USA have been undermining the education system in red states because people with critical thinking skills are harder to trick into supporting their policies. In 2012, the Texas Republican Party platform publicly came out as opposed to the teaching of critical thinking skills.
This has been going on at some level for more than 4 decades. The majority of people in those states have never been taught the skills and knowledge to safely use these tools safely. In fact, their education has, by design, left them easily manipulated by those in power, and now, by LLMs too.