Learn the latest trends and solutions for safer gaming communities Read our report
Improve your detection and simplify moderation - in one AI-powered platform.
Stay ahead of novel risks and bad actors with proactive, on-demand insights.
Proactively stop safety gaps to produce safe, reliable, and compliant models.
Deploy generative AI in a safe and scalable way with active safety guardrails.
Online abuse has countless forms. Understand the types of risks Trust & Safety teams must keep users safe from on-platform.
Protect your most vulnerable users with a comprehensive set of child safety tools and services.
Our out-of-the-box solutions support platform transparency and compliance.
Keep up with T&S laws, from the Online Safety Bill to the Online Safety Act.
Over 70 elections will take place in 2024: don't let your platform be abused to harm election integrity.
Protect your brand integrity before the damage is done.
From privacy risks, to credential theft and malware, the cyber threats to users are continuously evolving.
Stay ahead of industry news in our exclusive T&S community.
Brave Software needed scalable solutions to protect users from harmful content across languages. ActiveFence helped automate detection and moderation, ensuring a safer browsing experience.
With high volumes of content in multiple languages, Brave Software faced a critical challenge: safeguarding users from harmful content like Child Sexual Abuse Material (CSAM) , adult content, and malicious domains. Working with the scale of all of the internet’s content, the detection challenge was further magnified by the aggressive tactics used by malicious actors to promote harmful content that could be picked up on search engines.
“We were facing a challenge moderating across many languages and regions,” says Javier Lopez, Search Quality Consultant at Brave Software, whose role includes assuring the quality of the search results are safe for its users.
With lean resources and no in-house linguistic experts, it became challenging to stay ahead of harmful queries and violative URLs in multiple languages. Brave Software did not want to risk exposing its users to harmful content and risking its brand reputation.
"We needed to ensure no CSAM or adult content would be present, especially to minors," says Lopez. This was specifically important for their safe-search settings, which help protect children from violative content online. As such, he looked for a partner that could detect this type of harmful content in multiple languages, and the necessary scale and speed.
Lopez turned to ActiveFence to enhance the safe browsing experience. “While our main goal is to provide relevant results to user queries, we also need to offer a safe searching and browsing experience,” says Lopez. “That’s where ActiveFence came into play.”
After a short integration process, ActiveFence implemented its intel-fueled, AI-powered detection models to scan search results and identify any violative CSAM or adult content across its URLs, images, or queries. This included multilingual coverage, including detection in English, Spanish, German, and French.
One of the models is ActiveFence’s novel CSAM model. Trained on over six years of in-house domain expertise, this model went beyond simple hash-matching to detect novel CSAM violations, as well as multilingual terms and specific keywords or emojis used to evade detection.
CSAM and other violative content is then sent to ActiveOS in real time, where it is filtered into customized moderator queues by priority, risk and language.
“The filters in ActiveOS provide all the criteria I need to give me a better control of the data I moderate,” says Lopez.
This includes creating custom fields to determine if the content is a URL, domain, or image. He also uses custom queues to tackle the highest risk violations swiftly, such as flagged content, or CSAM-related violations.
"Moderation has become easier since working with ActiveFence,” says Lopez, highlighting how straightforward the content review process is on the platform. This has helped him scale moderation efforts, without increasing his team size.
Since implementing ActiveFence, Brave Software has seen a reduction in high-risk harms across multiple languages. Lopez has also managed to scale moderation efforts, providing wider coverage, without spending more resources or time.
"One of the main advantages is actually saving time,” says Lopez. “Having an easy-to-use platform where I can easily check results, with fewer false positives to weed through, helps make my work more efficient.”
By continuously working with ActiveFence, Brave Software has been able to detect multilingual violative content faster, something they wouldn’t have been able to with their limited in-house linguistic capabilities.
“Over 95% of items are accurate,” says Lopez, who says the confidence of detection has helped improve moderation efficiency, and provide his users with a safe browsing experience.
Javier Paredes López
Search Quality Consultant
Read The Buyer's Guide to Trust and Safety 2.0 now.
Find out how ActiveFence helps major social media platforms fight harmful content and maintain community trust.
Learn how Cohere partnered with ActiveFence to enhance trust & safety across their platform.
Discover how Udemy uses ActiveFence’s solutions to safeguard learners and educators worldwide.