Content moderation serves as a crucial safeguard against harmful and offensive messages, ensuring the well-being of platform users. Businesses have a moral responsibility to shield their users from inappropriate content, maintain their brand's reputation as a secure environment, and adhere to relevant regulations that mandate the removal of offensive and illegal material.
However, content moderation poses challenges, particularly due to the sheer volume of messages continuously exchanged on collaboration platforms. Additionally, the potential risks of exposing human moderators to harmful content make manual moderation increasingly less desirable. Here are a few limitations associated with manual content moderation:
Typically, content moderation involves a two-step process. First, users report content that they find offensive or in violation of workplace guidelines. Then, a moderation team reviews and assesses these reported messages. The downside of relying solely on user reporting is the risk of harmful content going unnoticed, potentially damaging your platform's reputation and eroding user trust.
This is where automated content moderation comes into play. The Mod Assist App automatically detects and reports inappropriate content based on predefined moderation rules within a workspace.
This app offers numerous benefits, including speed, protection, and efficiency.
The specific types of content that can be moderated automatically vary depending on the individual platform's needs and available resources. The following categories of inappropriate content can be detected and reported using the app:
The Mod Assist app will only be available to workspaces running version 6.3.0 and higher. The Mod Assist app is available for all premium plans. Please refer to our technical documentation to get started with the app.
These Customer Terms do not apply to the on-premises installation of Rocket.Chat. Please read the Customer Terms carefully and note that these Customer Terms include auto-renewal provisions and may limit your rights and liabilities.