What I find as annoying than bots is real people copy/pasting their comments from ChatGPT prompts because they can’t be arsed to formulate/organize their own thoughts. It is just aggressively wasting both their and my time. Mindboggling.

Re: bots

If feasible, I think the best option would be an instance that functions similarly to how Reddit’s now defunct r/BotDefense operated and instances which want to filter out bots would federate with that. Essentially, if there is an account that is suspect of being a bot, users could submit that account to this bot defense server and an automated system would flag obvious bots whereas less obvious bots would have to be inspected manually by informed admins/mods of the server. This flagging would signal to the federated servers to ban these suspect/confirmed bot accounts. Edit 1: This instance would also be able to flag when a particular server is being overrun by bots and advise other servers to temporarily defederate.

If you are hosting a Lemmy instance, I suggest requiring new accounts to provide an email address and pass a captcha. I’m not informed enough with the security side of things to suggest more, but https://lemmy.world/c/selfhosted or the admins of large instances may be able to provide more insight for security.

Edit 2: If possible, an improved search function for Lemmy, or cross-media content in general, would be helpful. Since this medium still has a relatively small userbase, most bot and spam content is lifted from other sites. Being able to track where bots’ content is coming from is extremely helpful to conclude that there is no human curating their posts. This is why I’m wary of seemingly real users on Lemmy who do binge spam memes or other non-OC. Being able to search for a string of text, search for image sources/matching images, being able to search for strings of text within an image, and being able to find original texts that a bot has rephrased are on my wishlist.

Re: AI content

AFAIK, the best option is just to have instance/community rules against it if you’re concerned about it.

The best defense against both is education and critical examination of what you see online.

Just ask them to draw images of full glasses of wine.

What stops banned people from creating a new account and continuing?

I’ve noticed that a lot of ai slop exists in dedicated instances, so the first answer is to just block those. Dunno of blocking whole instances also blocks cross-posts from said instance but it’s the first step in the journey of 1000 miles.

Bots tend to have flair stating they’re bots, which makes them easier to block. And since lemmy preaches open-source like gospel, you can probably write some optional code for specific lemmy clients that auto blocks that stuff for you

While shadow banning is an option, it’s also a terrible idea because of how it will eventually get used.

Just look at how Reddit uses it today.

By not having a corporate owner who wants the site to appear more active

Keeping bots and AI-generated content off Lemmy (an open-source, federated social media platform) can be a challenge, but here are some effective strategies:

1. Enable CAPTCHA Verification: Require users to solve CAPTCHAs during account creation and posting. This helps filter out basic bots.

2. User Verification: Consider account age or karma-based posting restrictions. New users could be limited until they engage authentically.

3. Moderation Tools: Use Lemmy’s moderation features to block and report suspicious users. Regularly update blocklists.

4. Rate Limiting & Throttling: Limit post and comment frequency for new or unverified users. This makes spammy behavior harder.

5. AI Detection Tools: Implement tools that analyze post content for AI-generated patterns. Some models can flag or reject obvious bot posts.

6. Community Guidelines & Reporting: Establish clear rules against AI spam and encourage users to report suspicious content.

7. Manual Approvals: For smaller communities, manually approving new members or first posts can be effective.

8. Federation Controls: Choose which instances to federate with. Blocking or limiting interactions with known spammy instances helps.

9. Machine Learning Models: Deploy spam-detection models that can analyze behavior and content patterns over time.

10. Regular Audits: Periodically review community activity for trends and emerging threats.

Do you run a Lemmy instance, or are you just looking to keep your community clean from AI-generated spam?

I don’t think it really answers your question. But I have been blocking every AI comm that comes up on my feed. Except for c/fuckai

I was going to make a joke by posting an obviously stupid and AI generated answer, but I’m genuinely surprised by the insightfulness of Gemini’s answer:

Dealing with bots and AI-generated “slop” (low-quality, repetitive, or irrelevant content) is an ongoing challenge for any online platform, including Lemmy. Here’s a breakdown of strategies and considerations: Challenges:

• Federation Complexity:
  • Lemmy’s federated nature means content comes from various instances, making centralized control difficult.
  • Moderation efforts need to be distributed, which can lead to inconsistencies.
• AI Advancement:
  • AI-generated content is becoming increasingly sophisticated, making it harder to distinguish from human-created posts.
  • Bots can mimic human behavior, evading simple detection methods.
• Balancing Freedom and Control:
  • Lemmy values user autonomy and free speech, which can conflict with aggressive moderation.
  • Overly strict measures might stifle legitimate contributions. Strategies:
• Instance-Level Moderation:
  • Individual Lemmy instances play a crucial role in setting their own moderation policies.
  • Instance administrators can implement tools and rules to filter out unwanted content.
  • Blocking known bot-infested instances is a common practice.
• Community-Driven Moderation:
  • Empowering users to report suspicious activity and content.
  • Implementing robust reporting mechanisms and clear guidelines.
  • Utilizing community moderators to review and take action on reports.
• Technical Solutions:
  • Developing algorithms to detect patterns of bot behavior and AI-generated content.
  • Implementing CAPTCHAs or other verification methods to prevent automated accounts.
  • Enhancing Lemmy’s software to provide better moderation tools.
• User Filtering:
  • Lemmy itself has user level settings that allow for the hiding of bots. As shown in the search results, there are settings that can hide bot activity.
• Community Education:
  • Raising awareness about the dangers of bots and AI slop.
  • Educating users on how to identify and report suspicious content.
• Development of Lemmy Software:
  • As shown in the github issue, there is development discussion regarding excluding bot comments from sorting algorithms. This type of software development will be key to combating bot influence on the platform. Key Considerations:
• The fight against bots and AI slop is an ongoing process.
• A multi-faceted approach is necessary, combining technical solutions, community involvement, and responsible moderation.
• Maintaining a balance between control and freedom is essential for the long-term health of the Lemmy network.

deleted by creator