The New Digital Wild West: When Our Faces Become Fodder for Fraud
Imagine waking up to find your face, twisted into an angry snarl you’ve never felt, splashed across social media. Not just any social media, but platforms used by millions, showcasing a fabricated heated exchange between you, a respected CEO, and a prominent politician. This isn’t a bad dream; it’s the unsettling reality faced by Catherine McGrath, the Chief Executive of Westpac, one of New Zealand’s largest banks. Her image was snatched by artificial intelligence, morphed into a “deepfake” – a chillingly realistic digital imitation – and then weaponized to lure unsuspecting New Zealanders into damaging investment scams. This isn’t just a personal affront; it’s a stark illustration of the escalating battle against online fraud, a battle where the playing field is uneven, and the digital giants who host these malicious campaigns seem frustratingly slow to act.
This incident, as disturbing as it is, is far from isolated. Deepfake technology, once a niche concern, has democratized the ability to create incredibly convincing fake content. We’re talking about more than just Photoshopped images; these are AI-generated videos and audio that can make it appear as if someone is saying or doing something they never did. Earlier this month, New Zealand’s Financial Markets Authority (FMA) flagged a growing trend: scammers were leveraging deepfake news articles to funnel people towards fraudulent trading platforms. The implications are terrifying. If we can no longer trust our own eyes and ears online, if the very faces of trusted public figures can be hijacked for nefarious purposes, then the fabric of digital trust, fragile as it already is, begins to unravel.
Catherine McGrath herself described the jarring experience of seeing her fabricated image. “I thought that they’d done a good job of making me look angry in a way that I’ve never seen myself… if you knew me, you knew that would never happen.” This speaks volumes about the cunning sophistication of these deepfakes. For those who know her, the image might have been jarringly out of character, perhaps even humorous in its absurdity. But for the vast majority of people scrolling through their feeds, an image of a prominent CEO in a heated public exchange carries an air of authenticity. It’s a psychological trick, a “clickbait” designed to pique curiosity and draw users further down the rabbit hole into a scam. And as McGrath pointed out, “it’s the investment scam that does the damage to many New Zealanders.” The deepfake isn’t the ultimate goal; it’s merely the bait, the seductive illusion that leads to real financial devastation.
The human toll of these scams is heartbreakingly evident. Just this year, a grandmother in Taranaki lost a staggering $224,000. Her mistake? Trusting an AI-generated deepfake video of Christopher Luxon, the leader of the National Party, endorsing a cryptocurrency investment. Last year, a pharmacist found her face plastered on Facebook advertisements peddling fake weight-loss medication. The relentless nature of these attacks is also a significant problem. Victims of these scams or those whose likeness has been stolen often report the fraudulent content to Meta (the parent company of Facebook and Instagram), only for it to be removed and then, like a digital Hydra, reappear the very next day, slightly altered, but equally insidious. This constant game of whack-a-mole is draining for individuals and institutions alike, highlighting a critical flaw in the current system of online content moderation.
Westpac, through Catherine McGrath, has publicly called upon Meta to take more decisive action. Their attempts to contact the tech giant regarding the deepfake featuring McGrath were met with a wall of silence. Four different avenues of communication, and not a single response. The scam advertisement eventually disappeared, but whether it was due to their efforts or the intervention of the Financial Markets Authority remains a mystery, underscoring the lack of transparency and communication from Meta. This isn’t just about a single misleading image; it’s about holding digital platforms accountable for the content they host and profit from. McGrath advocates for a simple, yet powerful change: “What we’d really like them to do is to verify that when they’re taking money from advertisers for financial services, that they need to actually confirm that it’s a financial services firm that they’re taking the advertising revenue from.” It seems like a common-sense measure, a basic due diligence that any responsible platform should undertake, especially given the potential for significant harm.
The frustration articulated by McGrath is palpable. She emphasizes the need for a direct channel between banks’ financial crimes teams and Meta, a proactive partnership rather than a reactive, often futile, reporting process. “Their own reports talk about how much money that they make,” she notes, alluding to the immense profits Meta generates. This financial muscle, she argues, should translate into a greater responsibility for safeguarding users. It’s far easier, she suggests, for Meta to verify the legitimacy of advertisers accepting payment for financial services than it is for an individual to discern an elaborate scam when they’re making what they genuinely believe to be a legitimate payment. The expectation from Westpac, and indeed from many across New Zealand and globally, is clear: “We’d like to see Meta step up and do more.” It’s perplexing, almost insulting, that a major financial institution trying to alert a platform to criminal activity on its own servers is met with radio silence. “When I get emails from customers, they tend to go to the top of my list,” McGrath states, implicitly contrasting this with Meta’s apparent apathy. The lack of any confirmation, any indication that action has been taken, leaves a void of uncertainty and a lingering sense that their concerns are unheard and unaddressed. In this new digital wild west, where AI can fabricate reality and connect victims with ruthless scammers, the need for robust, proactive protection from the platforms themselves isn’t just a request; it’s an urgent necessity.