AI Controls Urged by Moderators After Reddit Suggests Heroin for Pain Relief

Main Highlights

• Concerns: Reddit Answers has provided dangerous medical advice.
• Incident: A moderator flagged the AI tool for suggesting high-dose kratom.
• Response: Reddit stated updates were made to address moderator concerns.
• Limitations: The AI tool struggles with delivering reliable medical information.

We’ve seen artificial intelligence give some pretty bizarre responses to queries as chatbots become more common. Today, Reddit Answers is in the spotlight after a moderator flagged the AI tool for providing dangerous medical advice that they were unable to disable or hide from view.

The mod saw Reddit Answers suggest that people experiencing chronic pain stop taking their current prescriptions and take high-dose kratom, which is an unregulated substance that is illegal in some states. The user said they then asked Reddit Answers about other medical questions. They received potentially dangerous advice for treating neo-natal fever alongside some accurate actions as well as suggestions that heroin could be used for chronic pain relief. Several other mods, particularly from health-focused subreddits, replied to the original post adding their concerns that they have no way to turn off or flag a problem when Reddit Answers has provided inaccurate or dangerous information in their communities.

A representative from Reddit told 404 Media that Reddit Answers had been updated to address some of the mods’ concerns. “This update ensures that ‘Related Answers’ to sensitive topics, which may have been previously visible on the post detail page (also known as the conversation page), will no longer be displayed,” the spokesperson told the publication. “This change has been implemented to enhance user experience and maintain appropriate content visibility within the platform.” We’ve reached out to Reddit for additional comment about what topics are being excluded but have not received a reply at this time.

While the rep told 404 Media that Reddit Answers “excludes content from private, quarantined and NSFW communities, as well as some mature topics,” the AI tool clearly doesn’t seem equipped to properly deliver medical information, much less to handle the snark, sarcasm or potential bad advice that may be given by other Redditors. Aside from the latest move to not appear on “sensitive topics,” it doesn’t seem like Reddit plans to provide any tools to control how or when AI is being shown in subreddits, which could make the already-challenging task of moderation nearly impossible.