Google making app that would identify people's faces

Santa Monica, California (CNN) -- Google is working on a mobile application that would allow users to snap pictures of people's faces in order to access their personal information, a director for the project said this week.

In order to be identified by the software, people would have to check a box agreeing to give Google permission to access their pictures and profile information, said Hartmut Neven, the Google engineering director for image-recognition development.

Google's Profiles product includes a user's name, phone number and e-mail address. Google has not said what personal data might be displayed once a person is identified by its facial-recognition system.

"We recognize that Google has to be extra careful when it comes to these [privacy] issues," Neven told CNN in an exclusive interview. "Face recognition we will bring out once we have acceptable privacy models in place."

While Google has begun to establish how the privacy features would work, Neven did not say when the company intends to release the product, and a Google spokesman said there is not a release timeline.

The technology wouldn't necessarily be rolled out in a separate app, a Google spokesman said. Instead, facial recognition could be issued as an update to an existing Google tool, such as its image search engine.

Google has had the technical capabilities to implement this type of search engine for years.

Just as Google has crawled trillions of Web pages to deliver results for traditional search queries, the system could be programmed to associate pictures publicly available on Facebook, Flickr and other photo-sharing sites with a person's name, Neven said. "That we could do today," he said.

But those efforts had frequently stalled internally because of concerns within Google about how privacy advocates might receive the product, he said.

"People are asking for it all the time, but as an established company like Google, you have to be way more conservative than a little startup that has nothing to lose," said Neven, whose company Neven Vision was acquired by Google in 2006. "Technically, we can pretty much do all of these things."

Neven Vision specialized in object and facial recognition development. The object-related programs are reflected in an image search engine, called Goggles. The face-recognition technology was incorporated into Picasa, Google's photo-sharing service, helping the software recognize friends and family members in your computer's photo library.

In 2009, Google acquired a company called Like.com, which specialized in searching product images but also did work in interpreting pictures of people. Google has also filed for patents in the area of facial recognition.

Privacy concerns

As Google's size and clout grow, so does the chorus of critics who say the company frequently encroaches on people's privacy. Over the years, Google has made various missteps.

The company agreed to pay $8.5 million last year in a legal settlement over grievances that its Buzz social-networking service published the names of people with whom Gmail users regularly communicated. Google quickly fixed the problem, but its repercussions are still being felt: On Wednesday, Google announced it had reached an agreement with the U.S. Federal Trade Commission to receive an independent review of privacy procedures once every two years.

Google also faces numerous inquiries from governments regarding information collected by its Street View vans. Developers who report to Neven work on aspects of that street-level photography initiative -- mainly privacy-minded features such as the automatic blurring of faces and license plates, he said.

Google also is concerned about the legal implications of facial recognition. Even during trials among its own employees, Google has taken steps to ensure testers have explicitly agreed on record to try out the service.

The novelty of this sort of product may help attract early adopters. But policies would need to be uncomplicated and straightforward to keep users from abandoning it over privacy concerns, experts said.

"Online, people don't think about the privacy concerns; they think about the fun activities they're doing," said Karen North, director of a University of Southern California program that studies online privacy. "They're going to have to figure out a way where people who like the ease and fun of some of these technologies ... online don't feel burned at any given point. Because once they feel burned, they'll opt out."

North said she believes Google has a tendency to push boundaries in order to outdo competitors. The service could push too far by, say, aggregating every photo of a user it finds on the internet without giving that user an easy way to erase certain images, she said.

"Google, in all the best ways, has put itself in a very difficult position -- that no matter what they do, they have to do it biggest and best," North said. "They have trouble starting small and building up because they're Google."

A 'cautious route'

Google acknowledges the nefarious ways someone could leverage facial-recognition technology.

Many people "are rightfully scared of it," Neven said. "In particular, women say, 'Oh my God. Imagine this guy takes a picture of me in a bar, and then he knows my address just because somewhere on the Web there is an association of my address with my photo.' That's a scary thought. So I think there is merit in finding a good route that makes the power of this technology available in a good way."

Neven and a Google spokesman described the facial-recognition app concept as "conservative" in relation to privacy.

"I think we are taking a sort of cautious route with this," the spokesman said. "It's a sensitive area, and it's kind of a subjective call on how you would do it."

While the opt-in requirement limits the app's utility, Neven foresees many circumstances where people would agree to be found.

"If you're an actor in L.A., you want to have everyone recognizing you," he said, sitting outside in the sun at Google's beachside office some 12 miles from Hollywood.

A facial-recognition app could tie in to social-networking initiatives Google is said to be working on. For example, people looking to connect online could use their phones to snap each other's pictures and instantly navigate to that person's profile, rather than having to exchange business cards or remember a user name.

This month, Google redesigned its Profiles pages in a change that more closely resembles Facebook's site. On Wednesday the company announced a new social-search tool, called +1, that allows people to share helpful search links with their friends.

Google taking more cautious stance on privacy

Rancho Palos Verdes, California (CNN) -- Google, now an Internet giant, is learning that it needs to take more careful steps in regards to privacy.

Prompted by intensifying scrutiny from government regulators and privacy watchdogs, Google is striving to be more sensitive to data-collection issues that often make people uneasy.

It went so far as to spike a recent project Google engineers had developed because of fears of potential backlash, said Eric Schmidt, Google's executive chairman and former CEO.

The scrapped software would have let people include their head shot photos in a database so that they could be recognized by a mobile application when someone takes a picture of their faces.

"We built that technology, and we withheld it," Schmidt said in an onstage interview at the D: All Things Digital conference here on Tuesday. "As far as I know, it was the only technology that Google built, and we decided to stop."

That product was meant to be part of an app called Google Goggles, which is able to look at a picture taken from a phone and then translate text or recognize a building, advertisement or painting. (Facial recognition is, however, being used to power a feature in Google Maps's Street View that blurs the faces of bystanders caught on camera.)

As recently as March, Google still had plans to eventually release the facial-recognition version of the app, CNN reported. Schmidt was less supportive of the idea at a conference two weeks ago when he said it was "unlikely" that Google would release the software.

With facial-recognition technology, "an evil dictator could use that against you," Schmidt said on Tuesday. "We're so sensitive on the privacy issue now."

Since Schmidt handed over the CEO reigns to co-founder Larry Page in April, the goal was to create an organization that operates more autonomously, that works like a startup, Google managers say.

But to address privacy issues, Google has inserted a layer of oversight to reduce the recklessness that many fledgling companies get away with.

"Historically, we would just throw stuff over the wall," Schmidt said. "We now have a very, very thorough process."

Company lawyers and government-policy specialists now work with the development teams as they're building products and brainstorming ideas, Schmidt said. It's their job to wrangle expectations and ensure Google doesn't overstep "the creepy line" (to borrow a phrase from Schmidt).

Regulators say Google has crossed that line before, with its camera-taking vehicles and with Google Buzz. The latter attracted the ire of the U.S. government when the service published the e-mail contact lists for users. As a result, Google agreed to submit to reviews of its privacy policies as part of a Federal Trade Commission settlement.

Schmidt, an industry veteran, knows that a series of stumbles can scar a tech company. He said at the conference that software giant Microsoft is no longer a top player among tech brands.

"Microsoft is not driving the consumer revolution in the mind of consumers," Schmidt said. (However, it's worth noting that in an interview with the Wall Street Journal last year, Schmidt named Microsoft, with its Bing search engine, as Google's biggest competitor, ahead of Apple and Facebook.)

Schmidt's big four is Amazon.com, Apple, Facebook and (you guessed it) Google. Honorary mentions go to Twitter and PayPal. Coincidentally, the latter is suing Google over its new mobile-payments service, called Google Wallet, which launches in Portland on Wednesday and was demonstrated at the event.

Apple, which Google competes with on smartphones and soon laptops, was a recipient of much praise from Schmidt. He said Apple makes "beautiful products" and has just renewed a deal to use Google's search and maps services. He suggested people buy Mac computers over Microsoft's Windows PCs if they're concerned about getting viruses -- "speaking as a proud former board member of Apple," he said.

Besides including Facebook in his list of top companies, Schmidt had little else to laud the social network for. The site is about connecting with "every friend you've ever had, including the ones you can't quite remember," he said. Google has tried to partner with Facebook, but Microsoft usually wins those deals, he said.

Facebook, too, has had to walk a privacy tightrope when rolling out new features. Responding to a question about Facebook's growing presence, Schmidt said: "I think the industry would benefit from having an alternative."