Menu

Sanspoint.

Essays on Technology and Culture

The Racists Have Gamed Google’s Algorithm

At The Guardian, Carole Cadwalladr has noticed something disturbing about Google search suggestions:

Neither Google or Facebook make their algorithms public. Why did my Google search return nine out of 10 search results that claim Jews are evil? We don’t know and we have no way of knowing. Their systems are what Frank Pasquale describes as “black boxes”. He calls Google and Facebook “a terrifying duopoly of power” and has been leading a growing movement of academics who are calling for “algorithmic accountability”. “We need to have regular audits of these systems,” he says. “We need people in these companies to be accountable. In the US, under the Digital Millennium Copyright Act, every company has to have a spokesman you can reach. And this is what needs to happen. They need to respond to complaints about hate speech, about bias.”

— Google, democracy and the truth about internet search

This is disturbing and terrifying. We know search algorithms can be gamed, but white nationalists and racists have taken it to a whole new level. That Google seems to not even think it’s a problem is even worse. It is Google’s responsibility to ensure its results are accurate, and linking to Daily Stormer and other hateful organizations when asking about the Holocaust, or stats on black crime is abdicating that responsibility. There is no neutrality when a system can be twisted to promote one group’s horrifying ideology.