Google apologises after Gemini AI generates images of Nazis as people of colour

The company has paused the tool after it was found to be creating historically inaccurate images.
By Sam Haysom  on 
A close-up of a smartphone shows a finger about to touch the Gemini app.
Credit: Jonathan Raa/NurPhoto via Getty Images

Google has paused its Gemini AI tool (formerly Bard)'s ability to generate images of people. The company also issued an apology after the tool was found to be generating historically inaccurate illustrations, including depictions of Nazi soldiers as people of colour.

As reported by The Verge, a number of different prompts led to the bot responding with historical inaccuracies. People of colour were reportedly shown in illustrations offered for queries about German soldiers in 1943, as well as requests to show U.S. Senators in the 1800s.

"We're already working to address recent issues with Gemini's image generation feature," said Google on X. "While we do this, we're going to pause the image generation of people and will re-release an improved version soon."

In an earlier statement, Google had confirmed that Gemini's AI image generation generates a wide range of people.

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

"That's generally a good thing because people around the world use it," Google said. "But it's missing the mark here."

AI image generators have been found to perpetuate racist stereotypes, and one of Google's AI principles is to "avoid creating or reinforcing unfair bias." But as Jack Krawczyk, who works on Gemini, pointed out on X, "historical contexts have more nuance to them."

"As part of our AI principles we design our image generation capabilities to reflect our global user base, and we take representation and bias seriously," Krawzyk wrote. "We will continue to do this for open ended prompts."

Mashable Image
Sam Haysom

Sam Haysom is the Deputy UK Editor for Mashable. He covers entertainment and online culture, and writes horror fiction in his spare time.


Recommended For You
The 'Late Night with the Devil' AI controversy, explained
David Dastmalchian plays a terrified talk show host in "Late Night with the Devil."

Users get a taste of Google's AI search results, unprompted
A screenshot of the Google Search homepage.

Gemini, ChatGPT’s AI rival, tipped to get ‘real-time responses.’
Google Gemini app on the Google Play app store


Don’t like your DALL-E images? OpenAI now lets you edit them.
DALL-E logo on a phone

Trending on Mashable

NYT Connections today: See hints and answers for April 29
A phone displaying the New York Times game 'Connections.'

Wordle today: Here's the answer and hints for April 29
a phone displaying Wordle

NYT's The Mini crossword answers for April 29
Closeup view of crossword puzzle clues

The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!