During a recent hearing held by the Home Affairs Committee, concerns were raised about the insufficient efforts of social media companies in combatting fraudsters who exploit advanced AI technology. Anna Rowe, who experienced a deceptive three-month relationship with a “catfish” on the dating app Tinder, subsequently established the fraud center and think tank, LoveSaid, to assist others who have fallen victim to various scams, including financial ones. Rowe informed Members of Parliament that scammers have become adept at cloning voices to the point where the fakes are nearly indistinguishable from the real ones. Additionally, she highlighted the emergence of deep fakes, which are highly realistic videos or images generated using AI.
Rowe emphasized the increasing sophistication of these fraudulent techniques, stating, “We’ve moved to deepfakes, which are far more convincing. Now, I’m getting AI voice cloning. I’ve just had a victim send me the first one to listen to, and I was shocked at how good it was. I could pick up a few nuances because I knew what I was looking for, but for a victim who had no idea that this technology existed, it was enough for her to believe and send money. When it’s only online, the scammers go even further to back up the lies, ensuring that the victim becomes completely dependent on them. AI plays a significant role in these advancements.”
Conservative MP for Barrow and Furness, Simon Fell, revealed that approximately 70% of bank fraud cases originate from social media. Rowe further claimed that around half of the accounts on social networking sites like Facebook and X (formerly known as Twitter) are fake. LoveSaid, co-founded by Rowe and Cecilie Fjellhoy, a victim of the Tinder Swindler who was featured in the Netflix documentary on the convicted conman Simon Leviev, aims to shed light on the issue and assist victims.
When asked if social media companies are doing enough to combat fraud, Fjellhoy expressed her disappointment, stating, “If you ask (social media companies) a question about this, they say it’s so difficult, there’s new technology, (scammers are) so quick. It’s almost like they’re just giving up; they don’t have any financial losses for this. Then we turn to the banking industry, which experiences losses. They’re saying this is a big issue, and we need help. It feels like we’re banging our heads against them, and they say, ‘well, we’re doing everything,’ maybe they put up some posters on safe dating, but they have the wrong priorities. I feel they get ad revenue from the number of dating profiles, so why would they remove them?”
The testimonies of Rowe and Fjellhoy shed light on the urgent need for social media companies to take more proactive measures in preventing fraud. With the increasing use of AI technology by scammers, it is crucial that these platforms invest in robust detection systems and employ advanced algorithms capable of identifying and removing fake accounts and fraudulent activities.
While social media companies may argue that staying ahead of scammers is challenging due to the rapid evolution of technology, it is imperative that they prioritize the safety and security of their users. Collaborating with law enforcement agencies and sharing information about emerging fraud techniques can help in the fight against online scams.
Moreover, social media platforms must be held accountable for their role in facilitating fraudulent activities. Profiting from ad revenue generated by dating profiles should not take precedence over protecting users from harm. A more proactive approach, including stricter verification processes, regular audits, and continuous monitoring, is necessary to ensure the integrity of these platforms.
Ultimately, the responsibility lies with social media companies to prioritize the safety and well-being of their users. By investing in advanced technologies, collaborating with law enforcement, and implementing stricter measures, these platforms can play a significant role in combating fraud and protecting individuals from falling victim to deceptive schemes.
