New! Learn about effective red teaming for GenAI Read Mastering GenAI Red Teaming

Media header image

Media, News & Awards

Latest from ActiveFence

TechCrunch

People are using AI music generators to create hateful songs

Malicious actors are abusing generative AI music tools to create homophobic, racist, and propagandistic songs — and publishing guides instructing others how to do so as well.

Read More

Russia Doubles Down on Blaming Concert Massacre on Ukraine and the West

The campaign to pin the latest incident on Ukraine and divert attention from Russia’s security failings targeted not just a domestic audience. According to research by ActiveFence, which has found tens of thousands of newly launched accounts, these accounts have been publishing posts that support the Russian narrative of Ukrainian and Western complicity in at least seven languages, including Arabic.

Read More

From Russia, Elaborate Tales of Fake Journalists

As the Ukraine war grinds on, the Kremlin has created increasingly complex fabrications online to discredit Ukraine’s leader and undercut aid. Some have a Hollywood-style plot twist.

Read More

Crunchbase News logo representing media coverage on disinformation-fighting startups

More Funding Goes To Startups Fighting Disinformation

Where are investors putting their money in 2024? A recent Crunchbase article points to a new focus: fighting disinformation, and highlights 16 promising startups in the space.

Read More

4 Leading Trust & Safety Tools form The Gaming Safety Coalition

Four leading gaming Trust and Safety companies are banding together to form The Gaming Safety Coalition. This strategic alliance between Modulate, Keywords Studios, ActiveFence and Take This represents the companies’ shared commitment to improving player and moderator well-being.

Read More

TechCrunch Exchange- Safety by Design

Online platforms face unavoidable responsibilities for Trust and Safety, particularly in maintaining election integrity by combating disinformation and other dangers. AI further complicates these challenges, not only through the creation of deepfakes but also by empowering more malicious entities.

Read More

Antisemitic and Anti-Muslim Hate Speech Surges Across the Internet

Amidst the conflict between Hamas and Israel, a disturbing surge in antisemitic and Islamophobic hate speech has swept across social media platforms. Extremist influences, fueled by the ongoing conflict between Israel and Gaza, have played a significant role in exacerbating this alarming rise in hate speech online.

Read More

Big Tech Ditched Trust and Safety. Now Startups Are Selling It Back As a Service

The shift away from in-house trust and safety teams has created an opportunity for consultancies and startups to introduce something novel: trust and safety as a service.

Read More

Rolling Stone logo representing media coverage

Hamas Attacked Israel With Paragliders. Nazis Made Them Into Antisemitic Memes

When the militant group Hamas launched a devastating surprise attack on Israel on Oct. 7, some fighters breached the country’s defenses in motorized paragliders. In the following days, photos and illustrations of Hamas forces coasting by wing became highly charged, controversial symbols: an emblem of Palestinian resistance to some, a glorification of terrorism to others.

Read More

Rolling Stone logo representing media coverage

An AI Nightmare Has Arrived for Twitter — And the FBI

The startup ActiveFence, a trust and safety provider for online platforms, is one company sounding the alarm about how predators are abusing generative AI, and helping others in the tech industry navigate the risks posed by these models.

Read More

Bloomberg logo

TikTok Footage Becomes World’s Window Into Israel Conflict

TikTok became the world’s window into the conflict in Israel. Clips from a music festival in southern Israel, where 260 attendees were killed and more taken hostage according to Israel rescue agency Zaka, broke through the algorithm’s regularly scheduled lighthearted programming. For the most part,Noam Schwartz thinks TikTok has played a positive role in the conflict. “People would not believe the magnitude of this event without it being amplified in social media,” he said.

Read More

ActiveFence snaps up Spectrum Labs, last valued at $137M, to help fight the harmful content creep

ActiveFence, one of the bigger startups building tech for trust and safety teams, has acquired Spectrum Labs, another key startup in the space building AI tools to track online toxicity.

Read More

Russia Takes Its Ukraine Information War Into Video Games

Russian propaganda is spreading into the world’s video games. Propaganda is appearing in Minecraft and other popular games and discussion groups as the Kremlin tries to win over new audiences.

Read More

AI-Generated Child Sex Images Spawn New Nightmare for the Web

The revolution in artificial intelligence has sparked an explosion of disturbingly lifelike images showing child sexual exploitation, fueling concerns among child-safety investigators that they will undermine efforts to find victims and combat real-world abuse.

Read More

Thousands of Realistic but Fake AI Child Sex Images Found Online

Child safety experts are growing increasingly powerless to stop thousands of "AI-generated child sex images" from being easily and rapidly created, then shared across dark web pedophile forums. This explosion of disturbingly realistic images could normalize child sexual exploitation, lure more children into harm's way, and make it harder for law enforcement to find actual children being harmed.

Read More

Bloomberg logo

Predators Exploit AI Tools to Generate Images of Child Abuse

Child predators are exploiting generative artificial intelligence technologies to share fake child sexual abuse material online and to trade tips on how to avoid detection, according to warnings from the National Center for Missing and Exploited Children and information seen by Bloomberg News.

Read More

How the US government can combat Russian disinformation on Ukraine

Noam Schwartz provides key strategies for the US government to counter Russian disinformation campaigns targeting Ukraine. By implementing a comprehensive approach, the US can effectively combat the spread of false narratives. This article offers valuable insights and recommendations for policymakers and those invested in countering disinformation.

Read More

Can Big Tech make livestreams safe?

Live content moderation is a well-known challenge to Trust & Safety teams. Read how combining AI and human expertise can be the solution.

Read More

Sympathy, and Job Offers, for Twitter’s Misinformation Experts

Seeing false and toxic information as a potentially expensive liability, companies in and outside the tech industry are angling to hire people who can keep it in check, ActiveFence being one of them.

Read More

Podcast interview with ActiveFence's VP of Data ,PHD Matar Haller

Online platforms and their users are susceptible to a barrage of threats – from disinformation to extremism to terror. Daniel and Chris chat with Matar Haller, who is using a combination of AI technology and leading subject matter experts to provide Trust & Safety teams with tools to protect users and ensure safe online experiences.

Read More

How midterm disinformation has washed over Pennsylvania?

Disinformation has long been a feature of politics. Yet wading through the muck ahead of this year’s midterm elections in one fiercely contested state, Pennsylvania, shows just how thoroughly it now warps the American democratic process.

Read More

Concerns over China's efforts to influence U.S. elections

Federal officials are warning that China is working to interfere in November's midterm elections. Rachael Levy, Director of Geopolitical Risk at ActiveFence, joined CBS News to discuss the Communist Party's tactics in attempting to influence U.S. politics.

Read More

Mother Jones logo in black text.

Mother Jones: Brazil’s Upcoming Presidential Elections Are the Most Hate-Filled in Recent Memory

On top of widespread disinformation around election fraud, ActiveFence has detected online discourse promoting military intervention and suggesting the military should play a more active role in the electoral process.

Read More

The Business of Trust and Safety with CEO & Co Founder Noam Schwartz

In this episode of Reckoning, Kathryn Kosmides speaks with Noam Schwartz about the history of trust and safety on the internet, why companies are investing millions of dollars into Trust & Safety, and proactive vs. reactive online harm prevention.

Read More

Brazil's Far Right Plots Its Own January 6 Insurrection

Dennis Kahn, research lead at ActiveFence, talks about extremist online content in Brazil, saying he is most concerned about calls for military intervention and a violent coup in favor of Bolsonaro, threats that have appeared on Telegram, Gettr, and local platform PatriaBook.

Read More

Over $2 Billion Stolen This Year In Blockchain Bridge Hacks Expose DeFi’s Achilles Heel

Amit Dar, senior director of strategy at ActiveFence, adds to the conversation about the vulnerabilities of cross-chain bridges.

Read More

The solution to online abuse? AI plus human intelligence

Inbal Goldberger, ActiveFence VP of Trust & Safety, shares how scaled detection of online abuse can reach near-perfect precision by combining the power of innovative technology, off-platform intelligence collection, and the prowess of subject-matter experts.

Read More

The dark side of the metaverse and how to fight it

Metaverse and Web3 have become terms that describe aspects of the future internet, these technologies are building immersive worlds that intersect digital and real life. As more people migrate to the metaverse, real-world complications are bound to arise.

Read More

Time magazine logo in red text on a white background.

Abortion Protests See Surge of Armed Demonstrators and Far-Right Groups

Armed demonstrators and extremist groups have increasingly gathered at abortion-related protests in the aftermath of the Supreme Court’s overturning of Roe v. Wade, causing analysts to warn of a rising threat of violence.

Read More

Ensuring safety of digital communities with next-gen AI and proactive care

An interview with CEO and Co-Founder Noam Schwartz on the importance of proactive content detection in preventing online harm.

Read More

How to raise $100M to keep the internet safe w/ ActiveFence's CEO, Noam Schwartz

Today’s guest is Noam Schwartz, the CEO and Co-Founder of ActiveFence, which raised $100M for the software that helps keep the internet safe.

Read More

5 services and tools helping companies with digital safety

We often hear and read about digital security, but digital safety concerns have also become a key issue for online platforms, creating a need for services and tools to address online integrity.

Read More

3 key things to know about the future of content moderation

In the early stages of the internet, moderators of small platforms may have been able to hire a few people to ensure the content users were sharing was both truthful and non-violent. Today, there’s so much information being shared every second, the field of content moderation requires constant innovation to keep up and continue doing its job.

Read More

Why you’re getting spam texts, according to a cybersecurity expert

You might want to change all your passwords after reading this.

Read More

ActiveFence comes out of the shadows with $100M in funding and tech that detects online harm, now valued at $500M+

Online abuse, disinformation, fraud and other malicious content are growing and getting more complex to track. Today, a startup called ActiveFence is coming out of the shadows to announce significant funding on the back of a surge of large organizations using its services.

Read More

De los QAnon a los antivacunas, una radiografía del conspiracionismo en Europa

"Even if all European QAnons support the standard narrative, that is to say they support Trump and far-right ideas, each group adapts these messages to local circumstances," said the director of strategy at the Israeli cybersecurity company ActiveFence, Nitzan Tamari.

Read More

The evolving standards for online accountability in 2022

The “metaverse” is no longer a far-off concept in Sci-Fi novels. With this new reality, here are four evolving areas to watch as online platforms grapple with new and growing abuse vectors and the new phase of accountability.

Read More

Mar
12
2024

The Gaming Safety Coalition: A United Front for Enhanced Safety and Well-being in the Gaming Community

Read More

Jan
10
2024

Bringing the Best in the Industry Together: ActiveFence and Modulate Partner to Create a Safer Experience for Online Users in Real-Time

Read More

Jan
10
2024

ActiveFence Forecast: Key Generative AI Threats For 2024

Read More

Sep
07
2023

ActiveFence Continues Expansion with Spectrum Labs Acquisition, Advancing AI-Driven Trust & Safety Solutions

Read More

Jul
19
2023

Agora Partners with ActiveFence for Content Moderation to Ensure Trust and Safety for Real-Time Engagement Apps

Read More

Jul
10
2023

ActiveFence Simplifies DSA Transparency Compliance Reporting

Read More

Jun
07
2023

ActiveFence Launches Industry’s First Free Complete Solution to Stop Online Harm

Read More

May
23
2023

Generative AI is the New Attack Vector for Platforms

Read More

Mar
08
2023

ActiveFence Acquires Rewire as it Builds the Next Generation of AI for Trust & Safety

Read More

Feb
27
2023

ActiveFence Launches Industry-First Trust & Safety Academy at New York University

Read More

Feb
15
2023

ActiveFence Annual State of Trust & Safety Report Reveals Pressing Threats Facing Online Organizations

Read More

Feb
01
2023

The Israeli start-up ActiveFence appoints Michael Parker as CMO and Assaf Ohana as CPO

Read More

Jan
26
2023

ActiveFence Launches Research & Development Blog

Read More

Nov
01
2022

ActiveFence Renews Partnership with World Economic Forum, Joining Global Innovators Unicorn Track

Read More

Sep
14
2022

The Trust & Safety Professional Association and ActiveFence Form Key New Partnership

Read More

Sep
01
2022

ActiveFence Launches New Online Harm Vertical Designed to Combat Content Around Suicide and Self-Harm

Read More

Aug
08
2022

ActiveFence appoints Nurit Cohen Inger and Shahar Tarshish to executive roles

Read More

Jun
23
2022

ActiveFence wins “AI Breakthrough” 2022 Awards for our proactive content detection technology

Read More

Jun
21
2022

ActiveFence makes its proactive content detection capabilities in over 70 languages- available to online platforms of all sizes

Read More

Jan
10
2022

INHOPE collaborates with ActiveFence in the fight against online abuse of minors

Read More

Dec
30
2021

ActiveFence appoints Itai Brezis as EVP of Corporate Development and Strategy

Read More

Jul
27
2021

ActiveFence announces $100 million in funding to keep the internet safe

Read More