AI porn case: Critical need to enhance digital safety, says Teo Nie Ching

THE recent incident involving deepfake technology used to create and spread inappropriate images of school students highlights the critical need for enhanced digital safety measures in educational settings, said Teo Nie Ching.

The Deputy Communications Minister revealed that 38 individuals have been identified as victims, with the youngest being as young as 12 or 13 years old, reported The Star.

“The six individuals initially implicated had just completed their secondary education, but the extent of this situation is much broader and more alarming.

“This underscores the severity of the issue,” she stated during a press conference at the Kulai MP office in Taman Tropika today.

Teo emphasised that one of the most urgent matters to tackle is how schools handle such complaints.

“A significant concern is the response of schools. These issues must be taken seriously; schools need to act promptly and with gravity.

“This is a crucial message for all social media users and for the institutions responsible for safeguarding students,” she added.

Teo noted that in this particular case, the victim had reported the incident to the school before going to the police, but the situation was not addressed with the necessary seriousness.

“Last year, there were similar cases where schools were notified, yet we still observe a lack of decisive action.

“With the increasing prevalence of AI-generated deepfakes and explicit material, all educational institutions—regardless of their nature—must take proactive measures. There is no justification for private schools not to implement or strengthen their own standard operating procedures,” she stated.

It was also earlier reported that the 16-year-old boy, who is in police custody for allegedly using artificial intelligence (AI) to create pornographic images of his schoolmates and alumni, has been expelled from his school.

The school board issued a statement yesterday admitting that the school’s handling of the incident was not prompt enough.

It was also reported that the boy arrested in Johor has had his remand extended until next Tuesday.

Johor police chief M Kumar said the remand was extended to allow the boy to assist in the investigations, adding that police have received 22 police reports regarding the matter.

"The suspect’s motive is still under investigation,” he was quoted as saying.

The teen is believed to have sourced victims’ photos from social media before using AI tools to edit their faces onto nude bodies. He then sold them online for RM2 each. – April 12, 2025