Your guide to selecting the best Trust and Safety tools Download the Buyer's Guide to Trust and Safety 2.0

How a New Social App Launched with Safety Features Built-in

This platform connects people through shared experiences and smart recommendations, helping users discover content that truly resonates with them. It also ensures a safe and engaging online environment.

Person interacting with smartphone surrounded by digital icons and social media symbols.
At a Glance When launching a new social app, you hope for user growth, but prepare for harmful content to spread as well. A newly launched social platform was in this very dilemma: looking to launch and grow its global user base from APAC to the USA, while also ensuring user safety. To do this, they reached out to ActiveFence during the product development stage to help implement Trust and Safety into their infrastructure to ensure their young users will be protected from day one, and throughout the product’s growth.

The Challenge

A newly launched social discovery application, focused on helping users find new friends through polls, was planning to launch their services with safety features built in, at the product level.

With a Gen-Z user base, the company aimed to enable full creative expression while keeping illegal and other violative content out. This required precise, automated detection of specific abuse areas, and minimal false positives.

“Safety is key for our young audience, but so is expression - we needed to maximize both.”

Before approaching ActiveFence, the company did not have a Trust & Safety solution in place. While they wanted to ensure Trust & Safety, they didn’t want to add work to their small development team, and wanted a solution they could easily implement and maintain.

Moreover, without automations, they were reliant on manual moderation to keep users safe, an unscalable solution for a growing platform.

They looked for a solution that would enable their users to feel safe from day one, maximizing moderator productivity with minimal development resources.

Company Info

PROFILE
A newly launched app that helps connect with like-minded individuals through anonymous polls and chats.
INDUSTRY
Social Media

The Solution

By implementing ActiveFence’s complete Trust & Safety solution, the company was able to launch and scale, with safety built in to many of their product features.

One of their biggest concerns was ensuring that no CSAM, adult content, weapons, drugs, or other illegal content would be present on their systems. This is why they began using ActiveScore’s contextual AI models. The key differentiator for them was our novel CSAM model, which offers wider protection, beyond hash matching, to identify new child safety risks across images and text. In addition to CSAM, they implemented 11 additional models including adult and illegal content.

50% of spam was removed by actioning just 0.5% of users

To support moderators, they also launched with ActiveOS as their first content moderation solution. Knowing that they would be dealing with a high volume of threats, they immediately focused on setting up automations using Codeless Workflows. Automations allowed them to minimize moderator effort by automatically actioning content and bundling violations at the user level, to identify problematic users, and not just moderate at the content level.

For example, they set up a workflow for a 3-strikes policy, where users who had accumulated 3 individual violations, across abuse areas, were automatically removed from the platform. This was especially helpful in spam and adult content, where just 0.5% of users were responsible for 50% of the content.

The Impact

Launching the product with safety built in enabled the company to safely grow its user base.

ActiveScore’s models ensure that their users are safe from high-priority violations, while automations minimize the number of items moderators have to review in order to do so. As a result, the team was able to remove hundreds of illegal posts before they reached users, and without moderator involvement.

By setting up the infrastructure and policies during the product development stage, the platform was able to focus on its own growth and to build features for scale, while ensuring a safe environment for their users.

“With ActiveFence, we’ve found a partner from day one to help safeguard our community.”

Navigate Trust & Safety solutions with this essential buyer's guide from ActiveFence.

Learn More

Related Case Studies

Redefining Modern Dating Experiences
CASE STUDY

Dating Platforms

See how dating platforms use ActiveFence to protect users and build safer, trusted communities.

Read More
Female gamer immersed in a virtual reality environment with multiple screens.
CASE STUDY

Niantic

See how Niantic boosts user safety and engagement with ActiveFence’s cutting-edge technologies.

Read More
Smiling couple learning online together on a laptop at home.
CASE STUDY

Udemy

Discover how Udemy uses ActiveFence’s solutions to safeguard learners and educators worldwide.

Read More