AI Deepfake Scams: How Synthetic Faces and Voices Enable Fraud and What to Watch For

AI‑generated face‑swap videos have moved from obvious novelty clips featuring celebrities to highly realistic deepfakes, making it difficult for viewers to distinguish genuine footage from synthetic media.

Recent headlines reported an "AI fraud" case in which Mr. Guo, the legal representative of a technology company in Fuzhou, received a video call from someone claiming to be a trusted friend who needed a 4.3 million‑yuan deposit for a bidding project.

Trusting the visual and vocal cues, Mr. Guo transferred the full amount to the fraudster’s bank account within ten minutes, without confirming whether the money had actually arrived.

It later emerged that the "friend" on the video call was not a real person at all but a deepfake created with AI face‑swapping and voice‑synthesis technology, demonstrating that traditional video‑and‑audio verification can be easily bypassed.

This incident is part of a growing trend of scams that leverage publicly available deepfake tools such as DeepFaceLive and Avatarify, which allow anyone to generate convincing fake videos in real time with little technical skill.

In response, Chinese authorities have issued the "Internet Information Service Deep Synthesis Management Measures," requiring providers of facial or voice editing services to obtain explicit consent from the individuals whose biometric data is being altered.

Experts advise users to avoid sharing personal identification, bank details, verification codes, or biometric data, and to always verify suspicious requests through independent channels such as a phone call to the known contact or an in‑person meeting.

Overall, the rapid advancement of AI deepfake technology calls for heightened vigilance and stronger safeguards to prevent its misuse in fraud and other malicious activities.