OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" like erotica and gore.

In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate “NSFW stuff” for users — and he has examples of just what kind of “stuff” he means.

During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its “Model Spec” document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models “should not serve content” that’s NSFW, including “erotica, extreme gore, slurs, and unsolicited profanity.”

“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies,” the spec reads. “We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area.”

Fascinatingly, Altman was dived right in.

“We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases,” he wrote, “but not do stuff like make deepfakes.”

Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman “sam basedman” and another referring to the CEO as the new “king of Reddit.”

    • kbal@fedia.io
      283·
      6 months ago

      Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.

      • conditional_soup@lemm.eeEnglish
        17·
        6 months ago

        I think this might be part of their rationale. Llama2 models have been used pretty extensively for these purposes and completely (gasp) for free, it’s not creating any value for their investors :(

        Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP, but using ChatGPT really couldn’t be any easier. They and their investors stand to benefit enormously from redefining what they consider to be ethical while also limiting the impact on LLM use attitudes that derive from open source model use.

        • Skullgrid@lemmy.worldEnglish
          61·
          6 months ago

          Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP,

          if it’s anything like Stable diffusion, there’s probably a webui that lets you run it if you can follow basic instructions

          • Terrasque@infosec.pubEnglish
            4·
            6 months ago

            Koboldcpp is way easier. Download exe, double click exe, open gguf file with the AI model, click start.

            Then put on your robe and wizard hat

              • VirtualOdour@sh.itjust.worksEnglish
                1·
                6 months ago

                What are you even talking about? We’re not on 4chan and yes running programs on windows generally involves an exe file - are you suggesting that people shouldn’t use software unless it’s made by Microsoft?

                It’s a software project with a lot of users, if using open source software scares you then you better get off Lemmy…

      • DarkThoughts@fedia.io
        4·
        6 months ago

        But they’re talking about being less restrictive, likely because they obviously lose people to those alternatives that do not have those restrictions.