SAG Strategic Advisory Group
✆
← Insights
Protective Intelligence · 6 min read

The Voice Sounds Like Family. Verify It Anyway.

How AI voice cloning is used against families, household staff and family offices, and the simple verification habits that stop it.

The call comes to the house manager on a Tuesday afternoon. It is the principal’s voice, slightly rushed, calling from what sounds like an airport. A vendor needs to be paid today, the usual approval can wait, and could she send the gate code to the driver who is on his way. Nothing about the voice is wrong. That is the problem.

Voice-cloning software can now imitate a specific person from short recordings: a podcast appearance, a conference talk, a wedding toast posted online, a voicemail greeting. The FBI has publicly warned that criminals are using AI-generated voice and video to impersonate people their targets trust. For families with public principals and household staff who act on instructions, that changes how every phone call should be treated.

How the calls usually go

  • The family emergency. A child or grandparent calls in distress: an accident, an arrest, a lost passport abroad. Money is needed now, and nobody else must know.
  • The principal’s instruction. Staff or the family office receive a call or voice note approving a wire, a new payee or a change to account details.
  • The access request. Someone who sounds like a family member asks for a gate code, an alarm change, a travel itinerary or the children’s schedule.
  • The live video call. A short video call with a familiar face, often with a poor connection that hides imperfections, used to confirm an earlier request.

Every version relies on the same three pressures: urgency, secrecy and authority. The caller sounds like someone the listener does not want to disappoint.

Why listening harder does not work

People are poor at detecting synthetic voices, and they are worst at it when they are stressed and the voice belongs to someone they know. Training staff to spot fakes by ear sets them up to fail. A verification habit works whether the voice is real or fake, so it does not depend on anyone’s judgment in the moment.

Four habits that stop it

  • Verification words. Family members and key staff agree on private challenge words in person. They are never written in email, text or a shared document.
  • Call back on a known number. Any request involving money, access or someone’s location is confirmed by hanging up and calling a number already on file. Never the number that called.
  • Two people for money and access. Wires, new payees, changed bank details, gate codes and alarm settings need approval from a second person through a separate channel.
  • Permission to slow down. Staff are told in writing that no one in the family will ever be upset by a verification step. This is the habit that makes the others work.

Reduce what can be cloned

Public audio and video of the principal and family make cloning easier, and public schedules make the story more convincing. An exposure review should cover recorded talks, interviews, social video, staff accounts and anything that shows where the family will be and when.

Practice it

A protocol that has never been tested is a document, not a habit. Brief everyone covered, run practice scenarios, then arrange an unannounced test call with the family’s consent. Most gaps show up the first time.