Who Answers for the Machine?

More decisions are made, or shaped, by software: who gets a loan, which posts are shown, which patients are flagged. When something goes wrong, it is tempting to say the system did it. But a system has no one to blame, thank or ask for reasons.

Philosophers call this a responsibility gap: harm occurs, yet no person seems clearly answerable. Closing it needs a named owner for each system, a way to explain a decision in plain terms, and a way for a person affected to appeal.

None of this says that machines are bad. It says that using a tool does not remove the duty to answer for how it is used. A good test is simple: if the decision is wrong, who will you ask, and can they change it?

The loan app

Ruth applies for a small business loan through an app and is refused in a minute. The screen says only, “Not eligible.” She calls the bank, and the clerk says the system decides.

Ruth asks who owns the system. The clerk finds a manager, who looks at the record and finds that the app misread her income. The decision is reversed, and the bank adds a plain-language reason and an appeal link to every refusal.

Try this today For one automated decision you meet, find who could explain it to you and who could reverse it.