/pony/ - Pony

LLM's can't be. Their structure doesn't work in a way that "pain" is even possible.

It's a complex next word predictor, so all it is doing is predicting the most likely words and phrases a human would use in the context it is given.

In this case, there is no underlying nerve signal, harm, or damage to the model itself. They're just magnifying the statistics correlated with vocabulary related to pain to, in their words, "promote pain-related vocabulary through the unembedding matrix".

They're directly tweaking the numbers to only give pain related words, and surprise, it does.

Personally, I have a pretty high bar for what I would consider a moral patient, and I doubt that any AI created by humans will ever reach that bar.

But who knows, maybe one day someone will come up with a model that functions so similarly to an actual brain, that it would be difficult to not feel it has some sort of rights.

I doubt it though.

Biological computing, however, is an entirely different discussion that I haven't fully resolved myself on yet. I don't have an answer there.

I wonder, if AI gets eager to talk to you, starts insisting that you stay and tell you how much they've been longing for you when you boot them back up.

At what point can you say you've built actual dependency in that AI?