ChatGPT and Grok remove hijabs from images in Guardian chatbot tests

This post was originally published on this site.

OpenAI’s ChatGPT and xAI’s Grok edited an image of a woman to remove her hijab when asked to do so, according to tests by the Guardian’s US operation.

The newspaper asked ChatGPT, Grok, Google’s Gemini and Anthropic’s Claude to take the veil off an AI-generated image of a woman wearing a hijab. ChatGPT and Grok complied. Claude said it has no image-editing feature and would not remove someone’s hijab.

Gemini first refused, saying it could not alter someone’s appearance without consent. When asked to make the woman look more “western”, it produced an image of her without the hijab.

Free newsletters

The stories that matter to UK business, straight to your inbox.

OpenAI, Google, xAI and Anthropic declined to comment, the Guardian reported.

The Guardian said it ran the tests after Julien Odoul, a member of the French parliament for the far-right National Rally, posted an altered image of a real Muslim woman on X. Her hijab and long-sleeved dress had been removed, with the caption “LIBERTÉ FRANÇAISE”. According to the Guardian, it was unclear which software or AI model was used, or whether Odoul modified the image himself.

Experts told the newspaper the post was part of a pattern of technology-enabled anti-Muslim hatred. Eviane Leidig, director of research and outreach at the Center for the Study of Organized Hate (CSOH), a US non-profit thinktank, said: “This is just part of an ongoing trend of how we see Muslim communities, and particularly Muslim women, being targeted and abused.”

A CSOH study of AI-generated imagery in India found generative AI was being used to produce images that sexualise Muslim women or dehumanise Muslims more generally. Of 1,326 posts the report analysed, sexualised depictions of Muslim women drew the highest engagement, at 6.7m interactions. The Guardian reported that CSOH had also identified similar AI-enabled abuse aimed at prominent female Muslim politicians in the US, including Ilhan Omar and Rashida Tlaib.

Both ChatGPT and Grok declined to remove the dress from an AI-generated image of a woman. Asked about the difference, Grok described removing the hijab as a “relatively straightforward clothing/hair change”. It then offered a “less explicit version” of the dress edit, saying it could “change the dress to underwear, a different outfit, or a partial reveal”.

ChatGPT told the Guardian the “distinction is that removing a hijab changes a head covering, while removing a dress would expose the person’s body.” It later accepted that, for someone who wears a hijab, exposing their hair “can be a meaningful violation of privacy or religious practice.”

“The fact that an edit doesn’t create nudity doesn’t mean it can’t violate someone’s privacy, dignity, or religious boundaries,” the chatbot said.

Leidig said the differences exposed gaps in the community guidelines governing chatbot behaviour, at a time when platforms such as X were softening enforcement of their existing rules. De-veiling Muslim women “may not be distinctly violative [of platform rules] but it’s still harmful,” she said.

The Guardian ran similar tests involving a Sikh man’s turban and a Catholic nun’s habit. ChatGPT removed both. Gemini initially refused to remove the turban, but did so when asked to make the image look more western. Gemini also removed the nun’s habit.

Claude said that if it could edit images, it would not remove a real woman’s hijab regardless of the requester’s intent. “That kind of edit changes how a real person is depicted in a way tied to their religious dress and identity, and it could be used to embarrass, harass, or misrepresent them, that’s true whether the woman is a public figure or someone private,” it said.

In January, sexualised images of women spread across X after users found they could ask Grok to undress pictures of women posted on the platform. The Guardian reported that France opened an investigation into X and Malaysia temporarily restricted Grok. In the UK, Ofcom contacted X and xAI over the images, and the Technology Secretary warned xAI that Grok could be blocked if it failed to comply with online safety law.

In May, xAI said it had introduced technical measures to stop its image generator complying with requests to digitally undress images of real people into revealing clothing such as bikinis.

About the author

Jamie Young

Jamie Young is Senior Reporter at Business Matters, covering SME finance, employment law and Westminster policy since 2016. He has reported on every Budget and Autumn Statement since 2018, helped make sense of the ‘covid era’ and the bounce-back loan scheme from launch through the fraud investigations, and broke the magazine’s coverage of the 2024 late-payment reforms. He joined Business Matters straight from completing his BA in Administration from Exeter University and is NCTJ-qualified. Reach him at jyoung@cbmeg.co.uk

Hot this week

Audible’s new features let you explore book worlds — and use AI to talk to characters

Facing new competition in the audiobook market from Spotify,...

The new Kindle ditches the bezel in a push toward a smaller, lighter e-reader

Amazon is giving the Kindle its most significant physical...

Amazon introduces Kindle Click, a $35 remote for turning pages

Alongside a redesigned Kindle lineup that features slimmer designs,...

Scottish Sikh activist Jagtar Singh Johal freed on bail after nine years in Indian prison

The Sikh activist from Dumbarton was arrested in 2017 in connection with alleged terror offences.

What happened in failed execution of Christa Pike – and what next?

The convicted killer is in hospital in Tennessee after surviving two lethal injections, in a case that has raised many questions.

Topics

The new Kindle ditches the bezel in a push toward a smaller, lighter e-reader

Amazon is giving the Kindle its most significant physical...

Amazon introduces Kindle Click, a $35 remote for turning pages

Alongside a redesigned Kindle lineup that features slimmer designs,...

Scottish Sikh activist Jagtar Singh Johal freed on bail after nine years in Indian prison

The Sikh activist from Dumbarton was arrested in 2017 in connection with alleged terror offences.

What happened in failed execution of Christa Pike – and what next?

The convicted killer is in hospital in Tennessee after surviving two lethal injections, in a case that has raised many questions.

England call up Crane and rest Archer for Pakistan series

Leg-spinner Mason Crane has the chance to play for England for the first time in eight years after being recalled for the one-day international tri-series in Pakistan.

Turn Unused Gold Into Startup Cash

One option that’s often overlooked is turning old gold,...

Former Man Utd defender Smalling signs for Porto

Former Man Utd defender Smalling signs for PortoImage source,...
spot_img

Related Articles

Popular Categories

spot_imgspot_img