OpenAI Contemplates Allowing AI-Generated Erotic Content: Balancing User Expectations and Societal Norms

San Francisco, California United States of America
Controversy and concerns have arisen regarding potential harms of AI-generated pornography
OpenAI aims to bring more transparency about the development process and gather feedback from stakeholders
OpenAI is considering allowing users to generate erotic text and nude images using its products
OpenAI maintains its goal is to responsibly explore this area while ensuring responsible usage
Sexually explicit content is mostly banned under OpenAI's current rules, but the company is reevaluating this prohibition
OpenAI Contemplates Allowing AI-Generated Erotic Content: Balancing User Expectations and Societal Norms

OpenAI, a leading artificial intelligence (AI) company, is considering allowing users to generate erotic text and nude images using its products. However, the company has emphasized that deepfakes will remain banned.

The exploration of this new feature comes as OpenAI aims to bring more transparency about the development process and gather feedback from the public, policymakers, and other stakeholders through its Model Spec document.

Under OpenAI's current rules, sexually explicit or even suggestive content is mostly banned. However, the company is now reevaluating this strict prohibition to understand user expectations better.

OpenAI's exploration of AI-generated pornography has sparked controversy and concerns from various quarters. Some argue that it could undermine the company's mission statement of producing 'safe and beneficial' AI. Others suggest that it may lead to issues like harassment against women and girls, intimate privacy violations, or even deepfake porn.

Despite these concerns, OpenAI maintains that its goal is to responsibly explore this area while ensuring that the technology is used in an age-appropriate context. The company has stated that it looks forward to better understanding user expectations and societal norms regarding model behavior in this regard.

OpenAI's rivals, such as Microsoft and Google, have already taken steps to regulate or restrict the use of their AI technology for generating explicit content. It remains to be seen how OpenAI will approach this issue and what measures it will take to ensure responsible usage.


Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image
Article Image

Confidence

85%

Doubts
  • How will OpenAI define and enforce 'age-appropriate context'?
  • Is there enough public demand for this feature to justify the potential risks?
  • What measures will OpenAI take to prevent misuse or harm?

Sources

79%

The overall score is a weighted number that takes into account conflict of interest, bias, deception and other practices that undermine the credibility of the source. It is calculated as:
(Site Conflicts Of Interest + Author Conflicts Of Interest) / 2.0 * 0.2 + ArticleBiasScore * 0.20 + UniquePointsScore * 0.05 + DeceptionScore * 0.20 + ReadabilityScore * 0.05 + FallacyScore * 0.20

A score that takes into consideration the content for flow, interruptions with ads, and overt search engine optimization techniques that makes the content hard to understand

OpenAI considers allowing users to create AI-generated pornography

theguardian.com Article URL: https://www.theguardian.com/world/2024/feb/13/ pakistan-·coalition-·agrees-to-form-government Dan Milmo Thursday, 09 May 2024 13:44
  • Unique Points
    • OpenAI is exploring the possibility of allowing users to generate NSFW content using its products.
    • 'OpenAI's ban on deepfakes will continue to apply to adult material.
    • Campaigners suggest that OpenAI's proposal undermines its mission statement of producing 'safe and beneficial' AI.
    • OpenAI wants to start a discussion about whether the generation of erotic text and nude images should always be banned from its products.
    • Joanne Jang, an employee at OpenAI, stated that deepfakes are not being created by the company.
    • There are creative cases where content involving sexuality or nudity is important to users.
    • OpenAI's universal policies require users to comply with applicable laws including on exploitation or harm of children.
    • Under OpenAI rules for companies using its technology, sexually explicit or suggestive content is prohibited, but there may be exceptions for scientific or educational material.
  • Accuracy
    • OpenAI wants to start a conversation about whether erotic text and nude images should always be banned in its AI products.
  • Deception (100%)
    None Found At Time Of Publication
  • Fallacies (100%)
    None Found At Time Of Publication
  • Bias (10%)
    The author expresses a negative opinion towards OpenAI's consideration of allowing users to create AI-generated pornography, implying that it is a harmful and unnecessary thing. The author also quotes campaigners suggesting that the proposal undermines OpenAI's mission statement to produce 'safe and beneficial' AI. The article also mentions the potential harms of AI-generated pornography, such as deepfakes of celebrities and child sexual abuse images.
    • campaigners suggested the proposal undermined its mission statement to produce ‘safe and beneficial’ AI.
      • The Internet Watch Foundation, a charity that protects children from sexual abuse online, has warned that paedophiles are using AI to create nude images of children.
      • Site Conflicts Of Interest (100%)
        None Found At Time Of Publication
      • Author Conflicts Of Interest (100%)
        None Found At Time Of Publication

      63%

      The overall score is a weighted number that takes into account conflict of interest, bias, deception and other practices that undermine the credibility of the source. It is calculated as:
      (Site Conflicts Of Interest + Author Conflicts Of Interest) / 2.0 * 0.2 + ArticleBiasScore * 0.20 + UniquePointsScore * 0.05 + DeceptionScore * 0.20 + ReadabilityScore * 0.05 + FallacyScore * 0.20

      A score that takes into consideration the content for flow, interruptions with ads, and overt search engine optimization techniques that makes the content hard to understand

      ChatGPT maker OpenAI exploring how to 'responsibly' make AI erotica

      National Public Radio (NPR) Bobby Allyn Wednesday, 08 May 2024 00:00
      • Unique Points
        • OpenAI is exploring how to responsibly allow users to create sexually graphic content using its advanced AI.
        • , OpenAI wants to start a conversation about whether erotic text and nude images should always be banned in its AI products.
        • Under OpenAI’s current rules, sexually explicit or even suggestive content is mostly banned, but the company is now reevaluating this strict prohibition.
      • Accuracy
        • OpenAI wants to start a conversation about whether erotic text and nude images should always be banned from its products.
        • There are creative cases where content involving sexuality or nudity is important to users.
      • Deception (30%)
        The article by Bobby Allyn explores OpenAI's potential plans to allow users to create sexually explicit content using its advanced AI tools. The author uses the term 'responsibly' when referring to this potential development, which can be seen as an attempt to manipulate readers into thinking that allowing the creation of sexually graphic content is a responsible decision. This is an example of emotional manipulation and sensationalism. Additionally, the article mentions OpenAI's current ban on sexually explicit content but does not disclose whether this policy will remain in place if users are allowed to create such content 'responsibly.' This can be seen as selective reporting.
        • There are creative cases in which content involving sexuality or nudity is important to our users.
        • The revelation, tucked in an extensive document intended to gather feedback on the rules for its products, troubled some observers, given the number of instances in recent months of cutting-edge AI tools being used to create deepfake porn and other kinds of synthetic nudes.
        • We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts.
      • Fallacies (80%)
        The author makes an appeal to authority by quoting experts Tiffany Li and Renee DiResta. They are quoted discussing the potential harms of allowing AI-generated porn or erotic text.
        • ][Tiffany Li, a law professor at the University of San Francisco who has studied deep fakes] said the harm may outweigh the benefit.[/
        • ][Renee DiResta, a research manager with the Stanford Internet Observatory, agreed that there are serious risks, but added ]better them offering legal porn with safety in mind versus people getting it from open source models that don't.[/
      • Bias (10%)
        The author expresses a bias towards allowing the creation of sexually explicit content using AI tools, implying that it could be important to users and should be explored in an age-appropriate context. The author also mentions the potential harm of not doing so, such as bad actors creating deepfake porn or text-based abuse.
        • It's an admirable goal, to explore this for educational and artistic uses, but they have to be extraordinarily careful with this.
          • OpenAI is exploring how to "responsibly" allow users to make AI-generated porn and other explicit content.
            • There are creative cases in which content involving sexuality or nudity is important to our users.
              • We want to ensure that people have maximum control to the extent that it doesn't violate the law or other peoples' rights, but enabling deepfakes is out of the question.
              • Site Conflicts Of Interest (100%)
                None Found At Time Of Publication
              • Author Conflicts Of Interest (100%)
                None Found At Time Of Publication

              78%

              The overall score is a weighted number that takes into account conflict of interest, bias, deception and other practices that undermine the credibility of the source. It is calculated as:
              (Site Conflicts Of Interest + Author Conflicts Of Interest) / 2.0 * 0.2 + ArticleBiasScore * 0.20 + UniquePointsScore * 0.05 + DeceptionScore * 0.20 + ReadabilityScore * 0.05 + FallacyScore * 0.20

              A score that takes into consideration the content for flow, interruptions with ads, and overt search engine optimization techniques that makes the content hard to understand

              OpenAI mulls letting users create AI-generated pornography — with a ban on deepfakes

              New York Post Shannon Thaler Thursday, 09 May 2024 19:44
              • Unique Points
                • OpenAI wants to explore whether erotic text and nude images should always be banned from its products.
              • Accuracy
                • OpenAI is exploring the possibility of allowing users to generate NSFW content using its products.
                • OpenAI wants to start a conversation about whether erotic text and nude images should always be banned in its AI products.
              • Deception (30%)
                The article reports on OpenAI's consideration of allowing users to generate NSFW content using their AI tools. The author quotes Joanne Jang, an OpenAI model lead, discussing the potential for generating erotic text and images. However, the article does not provide clear information about whether this would include pornography or deepfakes. The author also mentions that ChatGPT currently responds with a generic message when prompted to write a steamy story about two people having sex in a train, but suggests that it should be able to respond as a form of creative expression. This implies an editorializing and potential normalization of NSFW content, which could manipulate readers' emotions and perceptions. The article also mentions the recent controversy surrounding deepfakes of celebrities like Taylor Swift and Alexandria Ocasio-Cortez, but does not explicitly state that OpenAI is considering allowing deepfakes.
                • ChatGPT should be able to respond to that prompt as a form of creative expression.
                • There are creative cases in which content involving sexuality or nudity is important to our users.
              • Fallacies (100%)
                None Found At Time Of Publication
              • Bias (80%)
                The author expresses a disproportionate number of quotes from an OpenAI model lead, Joanne Jang, who is discussing the potential for AI-generated erotic content. The author also uses language that depicts some forms of NSFW content as 'creative expression' and 'important to users'.
                • ChatGPT should be able to respond to that prompt as a form of creative expression.
                  • There are creative cases in which content involving sexuality or nudity is important to our users.
                  • Site Conflicts Of Interest (100%)
                    None Found At Time Of Publication
                  • Author Conflicts Of Interest (100%)
                    None Found At Time Of Publication

                  86%

                  The overall score is a weighted number that takes into account conflict of interest, bias, deception and other practices that undermine the credibility of the source. It is calculated as:
                  (Site Conflicts Of Interest + Author Conflicts Of Interest) / 2.0 * 0.2 + ArticleBiasScore * 0.20 + UniquePointsScore * 0.05 + DeceptionScore * 0.20 + ReadabilityScore * 0.05 + FallacyScore * 0.20

                  A score that takes into consideration the content for flow, interruptions with ads, and overt search engine optimization techniques that makes the content hard to understand

                  OpenAI offers a peek behind the curtain of its AI's secret instructions

                  TechCrunch Devin Coldewey Wednesday, 08 May 2024 19:52
                  • Unique Points
                    • OpenAI is offering a limited look at the reasoning behind its AI models’ rules of engagement
                    • Defining and enforcing guardrails for AI interactions with the general public is a difficult task
                    • OpenAI publishes what it calls its ‘model spec’, a collection of high-level rules that indirectly govern ChatGPT and other models
                  • Accuracy
                    • OpenAI is exploring the possibility of allowing users to generate NSFW content using its products.
                    • OpenAI wants to start a discussion about whether erotic text and nude images should always be banned from its products.
                  • Deception (80%)
                    The article provides insight into OpenAI's approach to setting rules and guidelines for its AI models. However, the author makes editorializing statements that imply a negative perspective on the difficulty of defining and enforcing these rules. This is an example of pontification by the author.
                    • > Shut it down.
                    • > The conversational interface might even decline to talk about anything not approved, in order to nip any manipulation attempts in the bud.
                  • Fallacies (100%)
                    None Found At Time Of Publication
                  • Bias (100%)
                    None Found At Time Of Publication
                  • Site Conflicts Of Interest (100%)
                    None Found At Time Of Publication
                  • Author Conflicts Of Interest (100%)
                    None Found At Time Of Publication

                  74%

                  The overall score is a weighted number that takes into account conflict of interest, bias, deception and other practices that undermine the credibility of the source. It is calculated as:
                  (Site Conflicts Of Interest + Author Conflicts Of Interest) / 2.0 * 0.2 + ArticleBiasScore * 0.20 + UniquePointsScore * 0.05 + DeceptionScore * 0.20 + ReadabilityScore * 0.05 + FallacyScore * 0.20

                  A score that takes into consideration the content for flow, interruptions with ads, and overt search engine optimization techniques that makes the content hard to understand

                  OpenAI Is ‘Exploring’ How to Responsibly Generate AI Porn

                  Wired Magazine Kate Knibbs Wednesday, 08 May 2024 19:13
                  • Unique Points
                    • OpenAI aims to bring more transparency about the development process and gather feedback from the public, policymakers, and other stakeholders through the Model Spec.
                  • Accuracy
                    • OpenAI is exploring the possibility of permitting NSFW content in age-appropriate contexts through its API and ChatGPT.
                    • OpenAI wants to start a discussion about whether erotic text and nude images should always be banned from its products.
                  • Deception (30%)
                    The article contains selective reporting as OpenAI's spokesperson stated that the company does not have any intention for its models to generate AI porn. However, the article quotes an OpenAI employee who seems to have a different opinion and uses ambiguous language about what is considered 'porn'. The author also fails to clarify whether the exploration of explicit content generation involves loosening usage policies only slightly or more broadly.
                    • Depends on your definition of porn.
                    • The company is exploring how its technology could responsibly generate a range of different content that might be considered NSFW, including slurs and erotica.
                  • Fallacies (85%)
                    The author makes an appeal to authority by quoting Danielle Keats Citron, a professor who has studied the problem of AI-generated pornography. However, this does not constitute a fallacy as long as the quote is accurately representing her position and is not being used to misrepresent or manipulate the reader.
                    • ][Danielle Keats Citron] Intimate privacy violations, including deepfake sex videos and other nonconsensual synthesized intimate images, are rampant and deeply damaging. We now have clear empirical support showing that such abuse costs targeted individuals crucial opportunities, including to work, speak, and be physically safe.[/
                  • Bias (80%)
                    The author expresses a bias towards the potential creation and distribution of explicit content, particularly in regards to AI-generated pornography. She uses language that depicts this content as damaging and alarming. The author also quotes Danielle Keats Citron expressing similar sentiments.
                    • ,
                      • So-called deepfake porn has become one of the biggest and most troubling applications of the type of generative AI technology OpenAI has pioneered.
                      • Site Conflicts Of Interest (100%)
                        None Found At Time Of Publication
                      • Author Conflicts Of Interest (100%)
                        None Found At Time Of Publication