In a chilling development, artificial intelligence (AI) is being weaponized to create hyper-realistic child sexual abuse material (CSAM), including deepfake imagery, posing unprecedented challenges for law enforcement in Malaysia and beyond. Senior Assistant Commissioner Siti Kamsiah Hassan, principal assistant director of the Sexual, Women and Child Investigation Division at Bukit Aman Criminal Investigations Department, has sounded the alarm over a sharp rise in synthetic content that is complicating detection and prosecution efforts.
AI Misuse and the Rise of Synthetic CSAM
The advent of AI technologies has opened new frontiers in digital crime, with offenders exploiting sophisticated tools to generate disturbingly realistic CSAM. According to SAC Siti Kamsiah, these deepfake images and videos are often indistinguishable from real footage, making it difficult for authorities to identify both the creators and the victims. “AI is increasingly being misused to generate hyper-realistic CSAM, including deepfake imagery, which is complicating detection and posing challenges for law enforcement in bringing those behind it to book” said SAC Siti Kamsiah in a recent interview.
This technological leap has not only fueled the production of synthetic abuse material but also contributed to a worrying trend of addiction among minors. SAC Siti Kamsiah revealed that investigations have uncovered a growing number of underage or teenage offenders who have developed dependencies on pornography, often storing CSAM in cloud storage or email accounts. The accessibility of such content through encrypted messaging apps and dark web forums further exacerbates the problem, allowing perpetrators to operate anonymously and share material with impunity. 
Sextortion and Its Devastating Impact
One of the most harrowing consequences of this trend is the surge in sextortion cases, particularly targeting minors via social media platforms. SAC Siti Kamsiah highlighted the severe trauma inflicted on victims, noting that many have been driven to despair or even suicide after receiving threats. “Many of these victims received threats that traumatized them severely and drove them to suicide” she said. The psychological toll of such exploitation underscores the urgent need for robust countermeasures to protect vulnerable individuals in cyberspace.
The use of AI in sextortion schemes often involves creating fabricated content to blackmail victims, leveraging the fear of public exposure. This predatory behavior is amplified by the anonymity provided by digital platforms, making it challenging for authorities to track down offenders. The intersection of technology and crime has created a perfect storm, where traditional policing methods struggle to keep pace with rapidly evolving threats.
International Collaboration to Combat CSAM
Recognizing the global nature of cybercrime, Malaysian authorities are stepping up efforts to collaborate with international partners. Earlier this month, SAC Siti Kamsiah led a delegation from her division, alongside other units of the Criminal Investigations Department, in a joint initiative with Dutch authorities. The collaboration focused on exchanging advanced strategies for combating CSAM and identifying perpetrators, addressing both technical and legislative challenges.
Key discussions centered on the use of CyberTipline Reports, channeled through the National Centre for Missing and Exploited Children (NCMEC), as potential court documents even in the absence of mutual legal assistance treaties (MLAT). “We can see how a CyberTipline Report could serve as a document for presentation in court, even in the absence of a mutual legal assistance treaty, or as evidence when none is available against an offender” SAC Siti Kamsiah explained. The meeting also explored the legality of using data obtained through hacking into offenders’ computers, a controversial but potentially critical tool in dismantling cybercrime networks.
The exchange of knowledge proved invaluable for Malaysia’s D11 division, which specializes in sexual and child-related investigations. SAC Siti Kamsiah emphasized the importance of such partnerships in building a united and responsive unit capable of countering sexual crimes against children in cyberspace. Representatives from the Netherlands, including police attaché Eddy Assens and program manager Jan van der Helm from the Transnational Sexual Child Abuse Expertise Centre, contributed expertise that could shape future operations.
Technical and Legislative Challenges
The rapid evolution of AI-driven crimes has exposed significant gaps in both technology and law. Detecting synthetic CSAM requires advanced forensic tools that can differentiate between real and fabricated content, a process that remains resource-intensive and technically complex. Moreover, the anonymity afforded by encrypted platforms and dark web forums hinders efforts to trace the origins of illicit material or identify those distributing it.
On the legislative front, questions remain about the admissibility of digital evidence and the ethical implications of invasive investigative techniques. The discussions with Dutch authorities highlighted the need for harmonized legal frameworks that can address cross-border cybercrimes effectively. Without international consensus on issues like data sharing and evidence collection, law enforcement agencies risk falling behind the sophisticated networks that exploit children online.
Broader Implications for Society
The proliferation of AI-generated CSAM is not merely a law enforcement issue; it reflects deeper societal challenges related to technology’s unchecked growth. The accessibility of AI tools, often available to anyone with basic technical knowledge, raises questions about regulation and oversight. Governments and tech companies must grapple with balancing innovation against the potential for harm, particularly when it comes to protecting the most vulnerable.
In Malaysia, the rise in underage offenders addicted to pornography signals a need for comprehensive education on digital literacy and online safety. Addressing the root causes of such behavior—whether through counseling, parental guidance, or school programs—could help mitigate the demand for CSAM. Public awareness campaigns are also critical to warn young people about the dangers of sextortion and the permanence of digital footprints.
In a disturbing example of how synthetic media is infiltrating civil society, a recent family court case in Sydney, Australia saw a woman submit AI-generated images of the father of her children, falsely portraying him in compromising situations. Believed to be deepfakes, the images were presented as legitimate evidence in a custody battle, raising alarm over how easily such content can be weaponized in emotionally charged legal disputes. The incident underscores a growing crisis of trust in digital evidence and highlights the urgent need for courts worldwide to develop forensic tools and legal safeguards to prevent miscarriages of justice driven by fabricated imagery. In evidence the father stated that he asked the mother for the original images for forensic evaluation but that the mother ignored his request. Police became involved but no charges were brought against the father and it still remains what judgement will be handed down as the matter is ongoing.
The Role of Technology Companies
As AI continues to reshape the landscape of crime, technology companies bear significant responsibility for preventing misuse of their platforms. Encrypted messaging apps and social media networks, while offering privacy benefits, have become conduits for illegal activities. Calls are growing for these companies to implement stricter monitoring mechanisms and collaborate with law enforcement to identify and remove harmful content swiftly.
However, such measures must be balanced against privacy concerns. Any move toward increased surveillance risks backlash from users and advocacy groups who argue that encryption is vital for protecting free expression, especially in regions with authoritarian governance. Finding a middle ground—where child safety is prioritized without eroding fundamental rights—remains a contentious issue for policymakers worldwide.
Looking Ahead: A Call for Action
The fight against AI-generated CSAM demands a multi-pronged approach, combining technological innovation, international cooperation, and legislative reform. For Malaysia, strengthening the capabilities of units like D11 is a critical step, but it must be accompanied by broader societal efforts to address the cultural and psychological factors driving demand for such content.
As SAC Siti Kamsiah and her team continue to adapt to the challenges posed by deepfake technology, the stakes could not be higher. The protection of children in the digital age hinges on the ability of authorities to stay one step ahead of those who exploit cutting-edge tools for nefarious purposes. Whether through enhanced collaboration with global partners or the development of new detection methods, the battle against synthetic abuse material is far from over—and its outcome will shape the safety of future generations.
