What happens when a regulator steps into the fast-moving world of generative AI with new legal tools and the intent to act? The Federal Trade Commission is preparing to enforce key parts of a new law aimed at sexual deepfakes and is also searching for ways to block AI-driven scamming that uses voice clones. That compact set of facts points to a broader dilemma: how to apply old remedies to new technologies while keeping pace with adversaries who exploit voice and image synthesis.
What the commission is doing now
According to a recent report, the Federal Trade Commission is preparing to use parts of a recently enacted statute to target sexual deepfakes. At the same time, the agency is looking into methods to disrupt scams that rely on AI-generated voice cloning. Those two moves — enforcement of provisions related to sexually explicit synthetic media and efforts to counter voice-cloning fraud — are the discrete actions described in the report.
Relevant background, in brief
The report presents the FTC’s activity as a combination of legal enforcement and technical intervention. On one hand, the commission plans to enforce statutory provisions against sexual deepfakes. On the other, it is searching for ways to block or otherwise impede AI-driven scams that use synthesized voices. The source frames these as the commission’s twin priorities within its growing AI portfolio.
Why this matters
- Enforcement signals: When a regulator prepares to enforce statutory language, it typically marks a shift from discussion to action. The report identifies the FTC’s move toward enforcement of anti-deepfake provisions as a concrete step.
- Technical countermeasures: Searching for ways to block voice-clone scams suggests the commission is considering not only legal remedies but also operational or technical approaches to disruption. The illustration in the report is specific to AI-driven voice cloning as a vector for fraud.
- Scope of responsibility: The actions described in the report expand the commission’s AI-related activities into areas that touch expression, privacy and fraud prevention, highlighting the multiplicity of legal and policy questions that follow technological changes.
Different perspectives, same facts
Technologists might read the report as an indication that regulators are moving from guidance to enforcement and technical intervention. Policymakers could see it as an example of statutory authority being used to address emergent harms. Users and potential victims are likely to welcome attention to abuses like sexual deepfakes and voice-clone scams. Adversaries exploiting synthetic media will likely treat enforcement and blocking efforts as new obstacles to adapt around. The report does not provide further detail on specific tools, process, or timelines for these efforts.
The commission’s actions, as described, leave open several practical questions — how enforcement priorities will be selected, what blocking techniques might look like, how claims will be adjudicated, and how any technical measures would be implemented without unintended consequences. The report limits itself to stating that the FTC is preparing enforcement of parts of a new law related to sexual deepfakes and is searching for ways to block AI-driven voice-cloning scams, without further elaboration.
As regulators and technologists grapple with the pace of change, the central challenge remains the same: can legal and technical tools be developed and deployed quickly enough to deter misuse without unduly constraining legitimate uses? The report makes clear that the commission is widening its AI portfolio to confront that question directly.
