Bias peril seen in big-data use

White House review tries to predict trends, avert abuse

WASHINGTON - A White House review of how the government and private sector use large sets of data has found that such information can be used to discriminate against Americans on issues such as housing and employment even as it makes their lives easier in many ways.

“Big data” is everywhere.

It allows mapping apps to ping cellphones anonymously and determine, in real time, what roads are the most congested. But it also can be used to target economically vulnerable people.

The issue came up during a 90-day review ordered by President Barack Obama, White House counselor John Podesta said. Podesta did not discuss all the findings but said the potential for discrimination is an issue that warrants a closer look.

Federal laws have not kept up with the rapid development of technology in a way that would shield people from discrimination.

The review, expected tobe released within the next week, is the Obama administration’s first attempt at addressing the vast landscape of challenges, beyond national security and consumer privacy, posed by technological advancements.

Obama requested the review in January, when he called for changes to some of the National Security Agency’s surveillance programs that amass large amounts of data belonging to Americans and foreigners.

The technology that enabled those programs enables others used in the government and the private sector. The White House separately has reviewed the National Security Agency programs and proposed changes to rein in the bulk collection of Americans’ phone records and emails.

“It was a moment to step back and say, ‘Does this change our basic framework or our look at the way we’re dealing with records and privacy?’” Podesta said.

“With the rapidity of the way technology changes, it’s going to be hard to imagine what it’s going to look like a generation from now,” he said. “But at least we can look out over the horizon and say, ‘Here are the trends. What do we anticipate the likely policy issues that it raises?’”

Podesta led the review, along with some of Obama’s economic and science advisers. The goal, Podesta said,was to assess whether current laws and policies about privacy are sufficient.

Podesta would not discuss the specific recommendations he will make to Obama. He did mention an unexpected concern that emerged during White House officials’ meetings with business leaders and privacy advocates and that merits further examination: how big data could be used to target consumers and lead to discriminatory practices.

Civil-rights leaders, for example, raised in discussions with the White House the issue of employers that use data to map where job applicants live and then rate them based on that, particularly in low-paying service jobs.

“While big data is revolutionizing commerce and government for the better, it is also supercharging the potential for discrimination,” said Wade Henderson, president and chief executive officer of the Leadership Conference on Civil and Human Rights.

Some employers might worry that if an applicant lives far enough away from a job, he might not stay in the position for long. As more jobs move out of the city and into the suburbs, this could create a hiring system based on class.

“You’re essentially being dinged for a job for really arbitrary characteristics,” said Chris Calabrese, a lawyer with the American Civil Liberties Union. “Use of this data has a real impact on peoples’ lives.”

The civil-rights advocates could not offer specific examples of such injustices, but instead talked about how the data could be used in a discriminatory way.

Federal employment laws don’t address this nuanced tactic, Calabrese said. Similarly, anti-discrimination laws for housing make it illegal to target customers based on credit reports. But the laws don’t address the use of other data points that could group people into clusters based on information gleaned from social media.

For instance, companies sell data amassed from social media sites that puts people into categories. A bank could target people who posted something on social media about losing a job as a likely candidate for a high-interest loan. The idea is that a person who lost a job might be behind on mortgage payments and might be open to a high-interest loan to help get out of a bind, Calabrese said.

“You are individually targeted for a loan based on inclusion on one of these lists and get a high interest rate. That is in spite of the fact that if you walked in off the street you might qualify for a lower rate. You never know that you are being targeted individually since you just click on an ad on the side of a website,” Calabrese explained. “That is the discrimination.”

Jennifer Barrett Glasglow, chief privacy officer for data broker Acxiom, said the Little Rock company screens clients before selling them data to help ensure that the data will be used appropriately and not for discriminatory reasons.

But she said a discriminatory offer can be made without Acxiom data.

“We’ve got to be careful that we don’t go after the data itself,” she said.

Glasglow said categories can be very effective for reaching communities in need, such as for advertising a sale or an offer that provides more affordable services. Glasglow said consumers can report what they believe to be unfair practices to the federal Consumer Financial Protection Bureau.

“Let’s go after the people engaged in bad practices,” she said.

The concept of putting people into categories, or “segmenting,” for marketing purposes is not new, said Eric Siegel, an expert in predictive analytics, which is the art of determining what to do with data on behaviors such as shopping habits and criminal activity.

Few dispute that there are many good reasons to use big data.

“There’s been a push by the administration to say that these are important tools, and the ability to apply analytics to that data is important for a whole range of issues from health care to education to public safety,” Podesta said.

It also can help communities become more efficient.

A New York data-analysis operation under former Mayor Michael Bloomberg allowed the city to pinpoint properties with a higher risk of deadly fires by analyzing Fire Department data in conjunction with data on illegal housing complaints and foreclosures.

The federal government recently announced an initiative to provide private companies and local governments with better access to climate data. This data could help communities and developers decide where not to build based on predictions about sea levels.

Political campaigns, particularly the 2012 presidential campaign, rely on large data sets to target specific donors who might be able to deliver the most cash. Those kinds of analyses led to a multibillion-dollar haul in contributions.

Nuala O’Connor, president of the Center for Democracy and Technology, said there needs to be more transparency in how companies are using this data, and that means updating laws.

One is the Electronic Communications and Privacy Act of 1986. Podesta said he will recommend an update to that law, which governs how the government can access private communications for law enforcement purposes. It’s something privacy advocates and some members of Congress have long sought.

“There are certainly gaps in the law,” O’Connor said, speaking broadly. “The technology is outpacing regulatory and legislative change.” Information for this article was contributed by Jack Gillum of The Associated Press.

Front Section, Pages 1 on 04/27/2014

Upcoming Events