Date:

This Website Shows What Google’s AI Can Glean From Your Photos

A Former Google Engineer’s Quest for a More Private Photo-Sharing Service

A Conscientious Decision

Software engineer Vishnu Mohandas decided to quit Google in more ways than one when he learned that the tech giant had briefly helped the US military develop AI to study drone footage. In 2020, he left his job working on Google Assistant and also stopped backing up all of his images to Google Photos. He feared that his content could be used to train AI systems, even if they weren’t specifically tied to the Pentagon project. "I don’t control any of the future outcomes that this will enable," Mohandas thought. "So now, shouldn’t I be more responsible?"

The Birth of Ente

Mohandas, who taught himself programming and is based in Bengaluru, India, decided he wanted to develop an alternative service for storing and sharing photos that is open source and end-to-end encrypted. Something "more private, wholesome, and trustworthy," he says. The paid service he designed, Ente, is profitable and says it has over 100,000 users, many of whom are already part of the privacy-obsessed crowd. But Mohandas struggled to articulate to wider audiences why they should reconsider relying on Google Photos, despite all the conveniences it offers.

A Marketing Stunt to Show the Power of Google’s AI

Then one weekend in May, an intern at Ente came up with an idea: Give people a sense of what some of Google’s AI models can learn from studying images. Last month, Ente launched https://Theyseeyourphotos.com, a website and marketing stunt designed to turn Google’s technology against itself. People can upload any photo they want to the website, which is then sent to a Google Cloud computer vision program that writes a startlingly thorough three-paragraph description of it.

A Stinging Demonstration of Google’s AI

One of the first photos Mohandas tried uploading was a selfie with his wife and daughter in front of a temple in Indonesia. Google’s analysis was exhaustive, even documenting the specific watch model that his wife was wearing, a Casio F-91W. But then, Mohandas says, the AI did something strange: It noted that Casio F-91W watches are commonly associated with Islamic extremists. "We had to tweak the prompts to make it slightly more wholesome but still spooky," Mohandas says. Ente started asking the model to produce short, objective outputs—nothing dark.

The Results: A More Limited, but Still Intrusive, Description

The same family photo uploaded to Theyseeyourphotos now returns a more generic result that includes the name of the temple and the "partly cloudy sky and lush greenery" surrounding it. But the AI still makes a number of assumptions about Mohandas and his family, like that their faces are expressing "joint contentment" and the "parents are likely of South Asian descent, middle class." It judges their clothing ("appropriate for sightseeing") and notes that "the woman’s watch displays a time as approximately 2 pm, which corroborates with the image metadata."

Google’s Response

Google spokesperson Colin Smith declined to comment directly on Ente’s project. He directed WIRED to support pages that state uploads to Google Photos are only used to train generative AI models that help people manage their image libraries, like those that analyze the age and location of photo subjects. The company says it doesn’t sell the content stored in Google Photos to third parties or use it for advertising purposes. Users can turn off some of the analysis features in Photos, but they can’t prevent Google from accessing their images entirely because the data are not end-to-end encrypted.

Conclusion

Ente’s project highlights the concerns surrounding Google’s use of user content to train its AI models. While Google claims to use this data for beneficial purposes, critics argue that the company’s lack of end-to-end encryption and its willingness to share user data with third parties pose significant risks to user privacy.

FAQs

Q: What is Ente?
A: Ente is a paid photo-sharing service that is open source and end-to-end encrypted.

Q: Why did Vishnu Mohandas leave Google?
A: Mohandas left Google after learning that the company had helped the US military develop AI to study drone footage.

Q: What is Theyseeyourphotos.com?
A: Theyseeyourphotos.com is a website that uses Google’s AI models to analyze uploaded images and provide a detailed description of them.

Q: Does Google sell user data to third parties?
A: According to Google, no, it does not sell user data to third parties. However, users can still turn off some analysis features in Photos, but they can’t prevent Google from accessing their images entirely because the data are not end-to-end encrypted.

Latest stories

Read More

LEAVE A REPLY

Please enter your comment!
Please enter your name here