AI Impersonation, Deepfakes & Voice Cloning
The technology that viral creators use to swap faces effortlessly on TikTok is the same technology being used by criminals to impersonate family members, groom children, and create abuse imagery. A parent's guide to what's happening — and what it means for your child.
The same technology. Very different uses.
If your child uses TikTok, there's a very good chance they've seen creators swapping faces, changing their voice in real time, or transforming into different people entirely — all using free AI tools in a matter of seconds. It looks playful and creative. It is.
But the same underlying technology — video face-swapping, AI voice cloning, real-time identity manipulation — is also being used by criminals to impersonate family members in emergency scam calls, by predators to deceive children about who they're speaking to, and by offenders to create sexual abuse imagery of children using nothing more than photographs from a school social media account.
The tools have become so accessible, so fast, and so convincing that a Fortune expert writing in late 2025 said deepfakes had crossed what he called the "indistinguishable threshold" — meaning synthetic media is now good enough to reliably fool ordinary people in the situations where it's most likely to be used. [4] This is not a future threat. It is happening right now.
What AI impersonation actually means
The term "deepfake" covers a family of related AI technologies. Understanding the difference helps parents know which scenarios are most relevant to their child.
Video face-swapping
AI replaces one person's face in a video with another's — in real time or on pre-recorded footage. The expression, lighting, and movement match so convincingly that the result is indistinguishable from genuine footage.
Very. Apps like CapCut, Reface, and dozens of free web tools require nothing more than uploading a single photo. Creators like kuba.creates.ai on TikTok use these tools to transform into other people effortlessly — and their tutorials have millions of views, making the technique available to anyone curious enough to search. [5]
AI voice cloning
AI replicates a person's voice from a short audio sample — just 3 seconds is now sufficient — and can then speak any words in that cloned voice. The result is a voice that sounds completely genuine, even to family members. [2]
Extremely. ElevenLabs, OpenAI's voice tools, and several free platforms allow voice cloning with minimal effort. A 2026 internal test found that family members could not reliably distinguish cloned voicemails from real ones at the audio quality of a typical mobile phone call. [6] A child's voice — captured from a school video, a TikTok, or a WhatsApp voice note — is enough source material.
AI image generation & "nudification"
AI generates realistic images of real people in situations that never happened — including sexually explicit scenarios. "Nudification" tools strip clothing from photographs. Both have been used to create abuse imagery of children.
Worryingly easy. Tools capable of generating realistic deepfakes of specific children from as few as 20 existing photos — taken from a school social media account, for example — in under 15 minutes now exist. [3] The Children's Commissioner called for an immediate ban on these apps in November 2025. [7]
From viral entertainment to serious risk
Why children face unique risks from AI impersonation
Adults and children face different risks from the same technology. These are the specific ways AI impersonation is being used to harm children — identified by the IWF, NSPCC, CEOP, the World Economic Forum, and the UK Children's Commissioner. [3][7][9][10]
Grooming via a cloned "child" voice — adults pretending to be peers
The World Economic Forum's April 2026 analysis of AI voice deepfakes and child safety documents a specific and growing threat: adults using real-time voice cloning to impersonate a child's voice in gaming and messaging platforms. An adult can pass a visual identity check and then use a synthetic child's voice for every interaction that follows — including voice chat in Roblox, Discord, or Fortnite. The platform's age verification system verifies a photo; it cannot verify a voice. [9] Children who believe they are talking to a peer are in fact talking to an adult who sounds exactly like one.
Deepfake abuse images created from a child's social media photos
The IWF confirmed in its 2026 report that AI tools can generate realistic deepfake child sexual abuse material using as few as 20 photographs of a specific child — photographs that may be entirely innocent and available on a school social media page, a parent's Facebook, or a child's own TikTok. The AI is then fine-tuned to produce images or videos of that specific child. In 2025, the IWF found 8,029 AI-generated images and videos showing realistic child sexual abuse — a number that is growing exponentially. Girls make up 97% of victims in identified AI-generated material. [3]
School deepfake incidents — targeting by peers
UK schools have seen a significant rise in incidents where students use AI nudification tools or face-swapping tools to create explicit images of classmates. These images are then shared in school group chats, on Discord servers, or via private messaging. The Children's Commissioner noted in November 2025 that children told her directly: "I'm so worried this could happen to me." This is not a theoretical risk — it is happening in UK schools. [7] Creating such images of anyone under 18 is already a criminal offence under existing UK law.
"Virtual kidnapping" — cloning a child's voice to scam parents
By 2026 this scam has become well-documented: criminals clone a child's voice from a TikTok, YouTube video, or voice note — requiring as little as 3 seconds of audio — and then call a parent with the child's voice, crying or screaming, claiming to have been in an accident or kidnapped, and demanding immediate money transfer. The FBI's 2025 Internet Crime Report specifically flagged voice cloning as a growing vector in these "virtual kidnapping" schemes, with ransoms typically demanded between £2,000 and £12,000. [11] Your child does not need to do anything wrong for their voice to be available online.
Sextortion using deepfaked images of the child
CEOP's 2024 threat assessment documented cases in which offenders create deepfake sexual images of a child and then use those images — which the child has never posed for — as the basis of blackmail. "Send me a real photo or I'll share this one." The child, who has done nothing wrong, is trapped in a blackmail scenario using fabricated evidence. This represents a significant evolution in sextortion tactics that existing awareness material does not yet adequately address. [10]
Trust in familiar voices — children are easier to deceive
A cloned voice of a parent, a teacher, or a family member is disproportionately effective against children. When a child receives what appears to be a phone call from their mother's voice asking them to share their location, open a link, or confirm personal details — the natural trust they have in that voice is a vulnerability. Children are developmentally less likely to pause and verify. The WEF analysis calls this "trust exploitation" and notes it is the least-regulated gap in current AI impersonation law. [9]
Scenarios parents should be aware of
The "friend" in the game who sounds like a child
Your 11-year-old has been talking to someone in Roblox for weeks. They have voice chatted many times. The person sounds their age, uses similar language, seems to know what it's like to be at school. Your child trusts them completely.
With a real-time voice cloning tool that runs on a laptop, an adult can enter that game sounding exactly like a child — same pitch, same cadence, same vocal warmth. The platform cannot tell the difference. Your child cannot tell the difference. [9]
The call that sounds exactly like you
Your teenager is home alone. They receive a phone call that sounds exactly like your voice. The caller says there has been an emergency and they need to immediately share their location, open a specific link, or confirm their name and school.
Your voice can be cloned from a birthday video on Facebook, a TikTok you appeared in, or even a voicemail your child has saved. Three seconds of audio is enough. [2][11]
Images of your child that were never taken
A classmate — or an unknown offender — takes publicly available photos of your child from Instagram or a school website and uses an AI nudification tool to generate explicit images. These are shared in a school WhatsApp group or posted online.
Your child has done nothing wrong. The images are not real. But the harm — to their reputation, their mental health, and their sense of safety — is entirely real. This is already happening in UK schools. [7][3]
Your child's voice, crying, asking for help
You receive a call. You hear your child's voice — unmistakably theirs — sounding panicked, saying they've been hurt and need money sent immediately. Another voice then comes on, claiming to be holding them.
This is a voice clone. Criminals harvest audio from your child's TikTok, YouTube channel, or a video you shared. The FBI has documented dozens of these cases across 2025–26. The emotional impact — even when the family realises the deception — can be severe. [11]
What UK law currently says
UK law on deepfakes has moved rapidly since 2023, though significant gaps remain — particularly around real-time voice cloning. Here is the current picture as of June 2026.
| Area | Current UK law | Source |
|---|---|---|
| Sharing intimate deepfakes without consent | Criminal offence. Sharing or threatening to share intimate images — including deepfakes — without consent is illegal under the Sexual Offences Act 2003 (as amended by the Online Safety Act 2023). Platforms must proactively prevent this content. | [12] |
| Creating explicit deepfakes of adults without consent | Criminal offence since 6 February 2026. Section 138 of the Data (Use and Access) Act 2025 (Section 66D of the Sexual Offences Act 2003) makes creating or requesting sexually explicit deepfakes without consent a criminal offence. Penalty includes fines and up to 2 years' imprisonment. [13] | [13] |
| Deepfake sexual images of children | Already illegal under existing law. Creating, possessing, or sharing computer-generated indecent images of anyone under 18 — including deepfakes — is a criminal offence under the Protection of Children Act 1978, Coroners and Justice Act 2009, and Criminal Justice Act 1988. | [14] |
| "Nudification" tools | The Crime and Policing Bill 2025 (currently before Parliament) will criminalise those who design and supply AI nudification tools — targeting the providers, not only the users. | [15] |
| Real-time voice cloning for impersonation | Not yet specifically addressed in UK law. Fraud committed using voice cloning falls under existing fraud legislation. The WEF notes this is the least-regulated and fastest-growing gap. The EU AI Act's Article 50 (from August 2026) requires disclosure when AI voices are used, but this does not apply in criminal contexts. | [9][16] |
| Ofcom enforcement | Ofcom has the power to fine platforms up to 10% of global revenue for failing to prevent intimate image abuse content. In early 2026, Ofcom opened a formal investigation into X (formerly Twitter) and Grok AI for facilitating the generation and distribution of deepfake sexual imagery. | [12] |
Practical steps to reduce the risks
You cannot prevent AI technology from existing. But you can reduce the surface area your child presents — and make sure they know exactly what to do if something happens.
-
Have the conversation using what they already know
Your child has almost certainly seen creators like Kuba doing face-swaps on TikTok. Start there: "You've seen those videos where someone transforms into a different person with AI — what do you think about that?" Then explain: "The same tool could be used to put your face on someone else's video without you knowing. How would that feel?" This is a conversation children can engage with because they already understand the technology.
-
Minimise the audio and video they share publicly
Voices can be cloned from 3 seconds of audio. Deepfake images can be built from 20 photos. Check that your child's social media accounts are private, that videos featuring them are not publicly visible, and that the school's social media policy covers image use. Our platform settings hub has step-by-step guides for every platform.
-
Create a family safe word for emergencies
Agree on a word or phrase that only your family knows — not a name, a word — that can be used to verify identity in an unexpected phone call. "If I ever call you and you're not sure it's really me, ask me for the safe word." This simple step defeats the virtual kidnapping scam entirely. Change it occasionally and keep it genuinely secret.
-
Teach your child how to verify identity before trusting
Explain that voices and faces online can now be faked — even familiar ones. Agree on a rule: if anyone contacts them claiming to be a family member and asking them to do something unusual, they should hang up and call the real person directly on a number they already have. Not the number that called them — a known number.
-
Explain that images can be fabricated — and it's not their fault
This is one of the most important conversations. If a deepfake image of your child ever appears, they need to know immediately: it is not real, they have done nothing wrong, and there are organisations (IWF, Childline, CEOP) who can get it removed. Fear of shame keeps children silent. Remove the shame in advance by having this conversation now, not after.
-
Be sceptical of voice in gaming — talk to your child about this specifically
Remind your child that anyone they meet online — even if they sound like a child their age — may not be who they appear to be. The technology to fake a voice convincingly on a gaming headset now exists and is accessible. "If someone you meet in a game asks to move to private voice chat, that's a warning sign regardless of how they sound." See our gaming safety guide for more.
-
Watch for distress related to something they've seen of themselves
Children who discover a deepfake image of themselves — or who are told one exists — may not tell a parent immediately due to shame or fear. Watch for sudden withdrawal, distress around devices, or reluctance to use social media. Our warning signs guide covers the behavioural changes worth noticing.
-
Know where to get help immediately if something has happened
IWF Report Remove: iwf.org.uk/report. CEOP: ceop.police.uk. Childline: 0800 1111. See our full get help now page for step-by-step guidance for six different scenarios.
Trusted resources on AI impersonation
Harm Without Limits: AI CSAM through the eyes of IWF analysts — the definitive report on AI-generated abuse imagery.
iwf.org.uk — AI CSAM report 2026Press notice calling for an immediate ban on AI apps that enable deepfake sexual abuse of children, November 2025.
childrenscommissioner.gov.ukReal-time deepfakes are rewriting the rules of child safety — April 2026 analysis on voice cloning in gaming platforms used by children.
weforum.org — deepfakes and child safetyGenerative AI and children's safety research — seven key risks including sexual grooming and image-based abuse via AI.
nspcc.org.uk — AI and children's safetyReport Remove — free tool for children and young people to report and remove AI-generated abuse images of themselves.
childline.org.uk — Report RemoveUK government's deepfake crackdown announcement — February 2026 action on creating and sharing explicit deepfakes.
gov.uk — deepfake crackdown 2026Sources & citations
- UK Government / GOV.UK. (February 2026). Government leads global fight against deepfake threats. "In 2025 alone, 8,000,000 deepfakes are estimated to have been shared, up from 500,000 in 2023." gov.uk
- sqmagazine.co.uk. (April 2026). AI Voice Cloning Fraud Statistics 2026. "Voice cloning can be created from as little as 3 seconds of audio." sqmagazine.co.uk
- Internet Watch Foundation. (May 2026). Harm Without Limits: AI child sexual abuse material through the eyes of our Analysts. 3,443 AI-generated child sexual abuse videos in 2025 — a 26,385% increase vs 2024. 20 images sufficient to generate a deepfake of a specific child. iwf.org.uk
- Fortune. (December 2025). 2026 will be the year you get fooled by a deepfake, researcher says. Voice cloning has crossed the 'indistinguishable threshold'. fortune.com
- TikTok search discovery pages — kuba.creates.ai search context. (June 2026). tiktok.com
- DILR.ai. (June 2026). Voice cloning and deepfake risk: enterprise controls 2026. "Family members could not reliably distinguish cloned voicemails from real ones at audio bitrates typical of mobile networks." dilr.ai
- Children's Commissioner for England. (November 2025). Press notice: Children's Commissioner calls for immediate ban of AI apps that enable 'deepfake' sexual abuse of children. childrenscommissioner.gov.uk
- NPR. (July 2025). This TikTok video is fake, but every word was taken from a real creator. AI-generated accounts stealing creator content using synthetic voices and faces. npr.org
- World Economic Forum. (April 2026). Real-time deepfakes are rewriting the rules of child safety. Adults using AI child voices in gaming platforms; platform age verification bypassed by real-time voice cloning. weforum.org
- CEOP. (2024). Child Sexual Exploitation and Abuse: Threat Assessment 2024. Sextortion using fabricated deepfake images as blackmail material. ceop.police.uk
- unboxfuture.com / FBI Internet Crime Report 2025 summary. (March 2026). The AI Voice Scam Epidemic. "Virtual kidnapping" voice clone scams; FBI 2025 warnings on AI voice scams targeting families. unboxfuture.com
- UK Parliament / Hansard. (January 2026). Social Media: Non-consensual Sexual Deepfakes debate. Online Safety Act 2023, priority offence designation. hansard.parliament.uk
- Lawtons Solicitors / lawtonslaw.co.uk. (February 2026). What is the Law on Explicit Deepfakes in the UK? Data (Use and Access) Act 2025, Section 138, in force 6 February 2026. lawtonslaw.co.uk
- Queen Mary University of London Law Blog. (March 2026). Deepfakes and Consent: The Law Finally Catches Up. Coroners and Justice Act 2009, Protection of Children Act 1978 — AI deepfakes of children already illegal. qmul.ac.uk
- GOV.UK. (January 2025). Government crackdown on explicit deepfakes. Crime and Policing Bill — nudification tool ban. gov.uk
- Harris Sliwoski LLP. (April 2026). Deepfakes, Voice Cloning, and AI Impersonation: The Global Rules Are Already Here. EU AI Act Article 50, disclosure obligations from August 2026. harris-sliwoski.com
Related guides
AI chatbots & companions
Character.AI, Replika, emotional dependency — the companion AI risks alongside impersonation risks.
Get help now
If a deepfake image of your child has appeared, or something else has happened — step-by-step guidance.
Conversation guide
Age-matched scripts for talking to your child about deepfakes using what they already know from TikTok.