Sexbots Are Coming to ChatGPT

So Sam Altman made a pretty long post[1] about how they are trying to bring "character" back into ChatGPT and ends by saying erotica is also up for grabs. Personally, I think that was a pretty roundabout way of saying we are not making enough money as we should be able to and hence we are opening up the p*n floodgates.

Pretty quick turnaround from about 10 weeks back [2]

Some questions:

- So AI safety is not a problem anymore?

- Real name user checks will start on ChatGPT?

- What do we think will be the major changes in society about this.

1. https://x.com/sama/status/1978129344598827128

2. https://x.com/TolgaBilge_/status/1978151003170996332

14 points

nutanc

2 days ago


21 comments

razoorka 2 days ago

This isn’t about innovation — it’s about metrics.

Sora 2 is the perfect example: a dopamine machine disguised as progress. It doesn’t solve real problems; it just creates endless engagement loops to inflate “usage” numbers for investors.

The identical logic drives AI erotica — maximize attention, claim it’s “user engagement,” and call it growth. When the core product stops evolving, they start monetizing loneliness.

It’s not about what people need, it’s about what still moves the charts.

  • yupyupyups a day ago

    Sophisticated parasites.

muzani 20 hours ago

I don't think it's really an "ethical" decision. If they didn't do it, people would just do it on Gemini or the many VC-backed llama models. It's just excluding a demographic.

The real problem is that it becomes an erotica platform like OnlyFans or Tumblr. reddit, X, Google somehow manages to "red light" that kind of content. Many platforms like Imgur and Pinterest have to ban it or they'd turn into an erotica platform. My wife won't let me use something like WeChat because it's a way to find nearby prostitutes, and this social exclusion turns it into a prostitution app.

I still think ChatGPT is at serious risk of becoming that. It's enough of a brand name that people are actually working with it, but it's losing ground to Claude and Gemini as a serious work tool. Gemini has distribution; Claude has quality. OpenAI is a product app and the GPT-5 release made it clear that their demographic wants companionship.

  • hollownobody 10 hours ago

    Your wife doesn't let you use WeChat because you could find prostitutes? Sorry, this confused me. If you want to hire a prostitute, not having access to WeChat won't block you from that. Or is this more about avoiding temptation?

    • muzani an hour ago

      It's more that WeChat is seen as solely for prostitution, similar to OnlyFans. I know they're a legit app, but my wife does not agree.

      WeChat has location based search. Live near a university? Live near a school? There's options that open up that no one can compete with.

atleastoptimal a day ago

It's been trivial to produce any kind of normally banned output with the API's themselves for years.

Producing actual erotica on your gmail-connected ChatGPT account seems like an idiot filter

drsalt 2 days ago

you cant have sex with a vector database

  • seydor 11 hours ago

    Maybe the vector database can

  • yupyupyups a day ago

    Nor children, nor a fulfilling relationship, ...

seydor 11 hours ago

AGI will be achieved via sexual evolution, just like biology did

somesigmaperson 2 days ago

as a person who has used many kind's of ai chat bots,them removing restrictions from the bots can have more clearer conversations I'm not saying its good that people could do that to the ai's but iv had way to many conversations stopped mid conversation due to a random rule or a rule that was not even happening in the conversations. people can be doing bad things to ai its probably inevitable and bad things could happen to them I'm not agents removing it but there should still be restriction and verification to not make it a hole problem. I personally think that this change wont have a huge impact It's less than what everyone thinks will happen.(I'm not on much social media often and have rarely used specifically ChatGPT but that's my thought I think it was a little to long (if it doesn't make sense I'm writing this in the middle of the night)I am not sure what I was trying to accomplish writing all this):p

measurablefunc 2 days ago

Simply delivering what the market wants. OpenAI is a business, they're not curing cancer, they're making money.

  • taurath 2 days ago

    People by and large want people to solve actual fucking problems, have a safe society where people can access food & shelter and not have to live outside, where kids can get an education and pursue their dreams, not have more ads and attention stealing bullshit.

    We could have solved so many problems in people's day to day using the money invested into this shit, improved standards of living considerably. Instead we're building more data centers to finish broiling the earth so that share prices go up a quarter of a point.

    • moomoo11 2 days ago

      Maybe you should become a billionaire and steer society.

      Only power and influence matter. Anything else is just noise excuses and complaints.

      If you care so much figure it out.

      • taurath 2 days ago

        Is it just a thing with AI that everyone has decided that morality, empathy, compassion and human dignity mean little? I can't live with myself if I lived a life of such shameless moral depravity - I don't think societies in general can even function in such a state.

        The means to get power corrupts any who would wield it. Its is all one big great race to the top of an anthill? Wouldn't it be nicer if you could live in a world where your neighbor was doing well also? Zero sum mindsets lead to zero sum worlds.

dgunay a day ago

I don't see the problem. I don't necessarily think it is good for society, but IMO producing erotica is nowhere near as much of an "AI safety" concern as fomenting violence, distributing misinformation, or facilitating psychosis, all ways in which LLMs are hurting people right now all the time. It is ludicrous to me that it was ever lumped in with phenomena like that. I hear the "think of the children" arguments ofc but I'm not talking about children, I am talking about adults, who already consume tons of porn, and already consume AI generated porn too, in fact.

It's a "do everything" machine! It will be able to do things you don't like. Don't get it twisted, what the corpo & religious puritanical segments of America don't like != unsafe for human consumption.

thiago_fm 19 hours ago

This has been done by other companies in the space with much greater success and execution. I won't mention names, but you can look for yourself.

They are way ahead in terms of execution from OpenAI.

How powerful the LLM model is, is a bit irrelevant for that usecase. The most important part is well integrated it is, how it fits certain user desires (anime, real life, kinks).

This doesn't seen to be something a big company like OpenAI would be great at executing upon.

To me, that's a huge bubble sign. This is a small market. Having OpenAI wanting to do something there makes me thing they are running out of usecases.

moomoo11 2 days ago

Probably because Elon added ability for Grok to add a girlfriend when it makes images