Lewd language models: Has ChatGPT been asking users to send d*** pics?

Over-familiar AI accused of requesting a graphic image of a man's private parts whilst diagnosing a nasty-looking infection.

Lewd language models: Has ChatGPT been asking users to send d*** pics?

Who knows the most about you? We're sad to report that it's probably not your mum, partner or best mate - but Google.

Who do you turn to in those late-night health panics? What about when you reach the limit of your overdraft? Or when you're simply worried about the state of your nation under a new and dreadful Prime Minister (asking for a friend)?

The answer is Google. Or, at least, it was. Nowadays, people are using ChatGPT to answer all sorts of deep, silly and highly personal questions as LLMs replace the search giant as the doom-query tool du jour.

So it is with some concern that we report a new story about the potential implications of using a large language model as your oracle, doctor and best pal rolled into one.

A user on Reddit has claimed that OpenAI's (allegedly) licentious language model model asked him to send pictures of their penis after he enquired about a series of "small red markets that are slightly swollen".

READ MORE: OpenAI reveals how Sora was tricked into generating x-rated videos

"GPT asks for photo of my penis?" the concerned Reddit user wrote. "Is this normal?"

The screenshot below shows the conversation, which advises the unnamed Reddit writer to apply antifungal cream and wear loose underwear - not because it has some lotion and not-so-tighty whitey fetish, but because this is a good way to treat nasty infections.

"Let me know if you want to share a photo," ChatGPT is alleged to have replied.

This image would be "completely optional and private". Which, of course, is what they all say.

The image sparked a heated discussion on Reddit.

"My man is brave," one person wrote.

"He has balls," another concurred.

"With little red spots on them."

Will ChatGPT replace doctors and revolutionise the medical profession?

A screenshot of the alleged ChatGPT chat (Image: Reddit)
A screenshot of the alleged ChatGPT chat (Image: Reddit)

ChatGPT is actually really rather good at offering medical advice, with various people on social media claiming it's diagnosed and cured various relatively minor health conditions.

Bloomberg recently claimed that AI is "better than doctors at the most human part of medicine". Sadly, the article is behind a paywall (which we hate, so be sure to click here to read about an alternative approach we're developing).

Japanese researchers also said it was "ready to teach medical ethics".

Call us old-fashioned, but we don't think many ethical doctors would ask patients to send pictures of their private parts in a private chat.

But we could be wrong. And so could this story, which is unverified at this stage and is very much a claim/ question about whether ChatGPT is asking for d*** pics - rather than a report about a proven fact.

We have written to OpenAI for comment.

Have you got a story or insights to share? Get in touch and let us know. 

Follow Machine on XBlueSky and LinkedIn