We can't just throw something out there and assume it works just because it has math in it.
Cathy O'Neil Historian
We can't just throw something out there and assume it works just because it has math in it.
Cathy O'Neil Historian
Obviously the more transparency we have as auditors, the more we can get, but the main goal is to understand important characteristics about a black box algorithm without necessarily having to understand every single granular detail of the algorithm.
People are starting to be very skeptical of the Facebook algorithm and all kinds of data surveillance.
There's less of a connection for a lot of people between the technical decisions we make and the ethical ramifications we are responsible for.
We don't let a car company just throw out a car and start driving it around without checking that the wheels are fastened on. We know that would result in death; but for some reason we have no hesitation at throwing out some algorithms untested and unmonitored even when they're making very important life-and-death decisions.
I think what's happened is that the general public has become much more aware of the destructive power of Wall Street.
I think there's inherently an issue that models will literally never be able to handle, which is that when somebody comes along with a new way of doing something that's really excellent, the models will not recognize it. They only know how to recognize excellence when they can measure it somehow.