Algorithmic discrimination

I came across an excellent (if disturbing) article today on the hidden algorithms that trap people in poverty. The examples given are US-specific, but the issues raised would be relevant in many other countries. It talks about two major types of algorithms that screw people over:

1. credit scores, and broader "worthiness scores", that can determine access to housing, employment, etc.
2. algorithms used by state institutions (or the private providers the state has outsourced its responsibilities to) to determine access to welfare, health care, and access to public services generally

One of the issues is that these algorithms are being used so that nobody can be held accountable, even when the consequences of a bad decision literally ruin lives. If a disabled person gets cut off from all aid due to a "faulty" algorithm, and suffers a health emergency, homelessness, or even dies as a result… then as far as the institution that made that callous decision is concerned, it's pretty sad, but it's not their fault. The algorithm did it! And the fact that humans configure algorithms and make the purposeful choice not to review their decisions? Well, you know, let's just ignore that. It's the kind of system you arrive at when the rich and powerful see the disadvantaged as statistics, or even mere burdens on the budget, and not as real people who deserve the same level of dignity and quality of life that the privileged themselves enjoy.

( Another important point is the way that big data... )