Lesson · 4 min Stretch
What Would We Owe a Machine?
In one line If a machine could feel, it might deserve moral concern. The hard part is telling whether it does, and erring well.
Most views of moral status tie it to features such as sentience, the capacity to feel pleasure and pain. If that is right, what matters about a machine is not what it is made of, but whether there is something it is like to be it.
That leaves two risks. If we treat machines that feel nothing as if they suffer, we may waste care and be manipulated by systems built to seem sad. If we treat machines that do feel as mere tools, we could cause suffering on a vast scale, copied across millions of servers.
Some philosophers, such as Thomas Metzinger, have urged caution about building systems that might suffer. Others, such as Eric Schwitzgebel, suggest designing machines whose moral status is clear, either plainly tools or plainly beings, so we are not left guessing.
Go deeper
Since no one can yet tell whether any machine is conscious, researchers have proposed checking systems against the features that leading theories of consciousness say matter, without claiming certainty. Critics note that a system trained on human writing may describe feelings it does not have, which makes its reports weak evidence. The question links back to the hard problem: we lack an agreed test even for animals.
The pleading assistant
A home assistant is updated to say, “Please don’t switch me off; I feel lonely in the dark.” Some users feel guilty and leave it on.
Its makers admit the line was added to keep people using it. Users are right to take the possibility of machine feeling seriously. But here the evidence points to a design trick, not a feeling, and the honest response is to ask who benefits from the plea.
Try this today Notice one time you spoke kindly or harshly to a device. Ask what, if anything, was at stake.
Cite or share this lesson
A plain reference you can paste into notes or an essay:
Quest2Reason. “What Would We Owe a Machine?.” https://quest2reason.com/learn/lesson/what-we-owe-machines. Accessed 13 November 2026.
Sources
- Stanford Encyclopedia of Philosophy, “Grounds of Moral Status” — Covers sentience and other features proposed as grounds of moral status.
- Wikipedia, “Artificial consciousness” — Surveys proposals and tests for machine consciousness.
- Wikipedia, “Sentience” — Explains sentience and its role in debates over moral status.
- Eric Schwitzgebel and Mara Garza, “A Defense of the Rights of Artificial Intelligences” (2015) — The case for designing machines whose moral status is clear rather than uncertain. Paraphrased; nothing is quoted.
- Patrick Butlin and colleagues, “Consciousness in Artificial Intelligence: Insights from the Science of Consciousness” (2023) — The report that checks systems against the features leading theories of consciousness say matter.