Yep, I generally agree, but manual moderation is unfortunately not feasible at the current scale. I have plans to improve the chat situation using AI (to detect trolls), but it is not a super easy task given that AI stuff is expensive, and it has to be economically efficient (since the comments plugin does not and will never require ads to power it). Banning VPNs from chat has helped a bit I think, because it’s harder for trolls to just switch IP address when they get blocked. For image generation, I have put a lot of work into it to patch loopholes for people generating illegal things, but it’s a constant cat and mouse game, so it’ll never be 100% unless I were to completely ban NSFW, which I will not do. Still, the situation here will improve over time.

Then there’s the problem of NSFW stuff coming up on the /generators page. For that, I have implemented some automated stuff to try to prevent it, but it’s not easy, because e.g. terms like “nude” can be used in anti-prompt of image generation, so it’s easy to accidentally flag SFW as NSFW. I also try to do a bit of manual moderation where I can, but it’s not really scalable. I will try to improve the situation here, and it will certainly become a lot easier to automate as AI detection stuff becomes cheaper and more robust, but it’s not something that I’ll be able to fix properly for probably at least a few of months.

The devs are doing the best they can do sometimes stuff slips thru the cracks and people are exploiting those cracks the me and a few other users are trying to help fill the crack by giving the ai context about what to ignore in a nsfw prompt if it works we will try to submit it as a plugin :) I just wish they would understand the law that perchance is hosted and go elsewhere whare its legal

This has been a serious problem with Perchance ever since long ago. I remember when I saw a very bad word ON the first comments section in the comments-plugin plugin page when I just started joining the community back in 2022, when the admin control, banning users, and the colorful tags feature hasn’t even made its way to the plugin yet. Probably has little moderation there, even to this day. But glad you’re reporting this issue, anyways!

Also @perchance@lemmy.world, I think there should be some features for the default generators page that could help prevent suspicious generators from being seen in the hub page even more, mainly:

• Generator tags (red is suspicious/limited, yellow is mildly suspicious, green is safe/PG, and gray is unrated). I know there’s already a “banned words” for generator names, but that’s not enough. Red-tagged generators should have the thumbnails blurred or even hidden completely.
• Blocklist (block generators from users’ view)
• User-defined filter words (same as blocklist, but with user-defined keyword filters)

I can only think of these features, but most of these are already on VioneT’s Generator with Blocklist page, which is really an improvement. As for the gallery, I think that also needs an improvement in moderation and safety, too.

Also, for some reason, I usually find it kind of firey to discuss something like this. 😅

@perchance if you can give us a nsfw and a sfw tag then I’m sure we can make a antiprompt made for nsfw that would reduce the chances of illagel content being generated since you need to be looking for it to get it me and allo are exploring on ways we can help