August 2017

When the Government Rules by Software, Citizens are Left in the Dark

Governments increasingly rely on mathematical formulas to inform decisions about criminal justice, child welfare, education, and other arenas. Yet it’s often hard or impossible for citizens to see how these algorithms work and are being used.

San Francisco Superior Court began using PSA in 2016, after getting the tool for free from the John and Laura Arnold Foundation, a Texas nonprofit that works on criminal-justice reform. The initiative was intended to prevent poor people unable to afford bail from needlessly lingering in jail. But a memorandum of understanding with the foundation bars the court from disclosing “any information about the Tool, including any information about the development, operation and presentation of the Tool.” Many governments said they had no relevant records about the programs. Taken at face value, that would mean those agencies did not document how they chose, or how they use, the tools. Others said contracts prevented them from releasing some or all information. Goodman says this shows governments are neglecting to stand up for their own, and citizens’, interests. “You can really see who held the pen in the contracting process,” she says. The Arnold Foundation says it no longer requires confidentiality from municipal officials, and is happy to amend existing agreements, to allow officials to disclose information about PSA and how they use it. But a representative of San Francisco Superior Court said its contract with the foundation has not been updated to remove the gag clause.

AI Programs Are Learning to Exclude Some African-American Voices

Some artificial intelligence (AI) systems are learning to be prejudiced against some dialects. And as language-based AI systems become ever more common, some minorities may automatically be discriminated against by machines, warn researchers studying the issue.

Anyone with a strong or unusual accent may know what it’s like to have trouble being understood by Siri or Alexa. This is because voice-recognition systems use natural-language technology to parse the contents of speech, and it often relies on algorithms that have been trained with example data. If there aren’t enough examples of a particular accent or vernacular, then these systems may simply fail to understand you. The problem may be more widespread and pernicious than most people realize. Natural-language technology now powers automated interactions with customers, through automated phone systems or chatbots. It’s used to mine public opinion on the Web and social networks, and to comb through written documents for useful information. This means that services and products built on top of language systems may already be unfairly discriminating against certain groups.

This week should put the nail in the coffin for ‘both sides’ journalism

[Commentary] “The whole doctrine of objectivity in journalism has become part of the [media’s] problem,” Jay Rosen, a journalism professor at New York University, said in a talk at the Chautauqua Institution in Western New York. He believes that journalists must state their biases up front and not pretend to be magically free of the beliefs or assumptions that everyone has. If objectivity is a “view from nowhere,” it may be out of date. What’s never out of date, though, is clear truth-telling. Journalists should indeed stand for some things. They should stand for factual reality. For insistence on what actually happened, not revisionism. For getting answers to questions that politicians don’t want to answer. Can journalism be both impartial and forceful? That’s not only a possibility but, more than ever, a necessity. In dealing with the false-equivalency president they helped to get elected, the news media may have learned something. The best way to be fair is not to be falsely evenhanded, giving equal weight to unequal sides. It’s to push for the truth, and tell it both accurately and powerfully.