The Dark Side of Social Media: How Violent and Disturbing Content is Targeting Teens
In 2022, Cai, a 16-year-old, found himself in a disturbing situation while scrolling through his social media feeds. What started with a cute dog video quickly turned into a series of violent and misogynistic content appearing “out of nowhere.” Cai was recommended videos of someone being hit by a car, monologues sharing misogynistic views, and clips of violent fights. He was left wondering, why him?
Andrew Kaung, a former analyst at TikTok, shed light on the issue of harmful content being recommended to teenagers. He discovered that teenage boys were being shown posts featuring violence and pornography, promoting misogynistic views, while teenage girls were recommended different content based on their interests. Despite AI tools being used to remove harmful content, they cannot catch everything.
Kaung raised concerns at both TikTok and Meta (owner of Instagram) about the harmful content being recommended to young users. He proposed updates to the moderation system, but his suggestions were initially rejected. Several former employees from social media companies confirmed Kaung’s concerns, stating that algorithms were recommending harmful content to children unintentionally.
Cai, now 18, continues to be pushed violent and misogynistic content on Instagram and TikTok. Despite his efforts to indicate his disinterest in such content, he found himself bombarded with more of it. He witnessed how his friend became influenced by controversial influencers, adopting misogynistic views.
The algorithms driving social media platforms prioritize engagement, regardless of whether it is positive or negative. They learn from user behavior and aim to maximize engagement by showing content they expect users to spend more time on. Kaung emphasized the need for social media companies to listen to users’ preferences and make tools for indicating preferences more effective.
In the UK, a new law will hold social media firms accountable for verifying children’s ages and preventing the recommendation of harmful content. While TikTok and Meta claim to have safety measures in place, concerns about the impact of harmful content on teenagers persist. Cai believes that social media companies need to respect users’ opinions and prioritize their safety over profit.
As the debate on social media regulation continues, the impact of violent and disturbing content on teenagers remains a pressing issue that requires immediate attention.
