Disinformation, Deepfake and Illegal Content Detection

Detects deepfake video, images and audio, hoaxes and illegal online content such as gambling sites, for verification or takedown.

vision audio classification LLMunverified

0named models

1082candidates

2deployments

2in Indonesia

Named Models

The research names no model for this use case.

Where this comes from

Models the research names for this use case. Research, with sources on each model record.

Who Runs It

production, 1pilot, 1

Kementerian Komunikasi dan Digital (Komdigi)Country: IndonesiaAI for crawling and verification of online gambling content (model not stated)Vendor: not statedproductionDate22 Jan 2025No AI-specific figures; ministry reports 5,707,952 gambling content items handled from 2017 to January 2025 with a 113-person teamEvidence: government statementConfidence: mediumSource: inet.detik.com

Komdigi with MafindoCountry: IndonesiaAI deepfake detector for video, image and audio, extending the CekFakta portal (name not given)Vendor: not statedpilotDate27 Jun 2025Soft launch; no resultsEvidence: government statementConfidence: mediumSource: suarasurabaya.net

Where this comes from

Documented uses by named organisations. The evidence column says who made the claim.

Candidate Models

COCO val

A general benchmark for this model class, not a test on this use case. Object detection and segmentation AP (mAP50-95). Higher is better. Showing 10 of 11.

RF-DETR 2XLRoboflow vendor-reported60.1

YOLO26xUltralytics vendor-reported57.5

YOLO26lUltralytics vendor-reported55

D-FINEUniversity of Science and Technology of China (USTC), Institute of Artificial Intelligence, Hefei Comprehensive National Science Center independent55

RF-DETR MRoboflow vendor-reported54.7

YOLO26mUltralytics vendor-reported53.1

RF-DETR SRoboflow vendor-reported52.9

YOLO26sUltralytics vendor-reported48.6

YOLO11Ultralytics independent48.3

RF-DETR NRoboflow vendor-reported48

050100

Nemotron-SEA-LION-v4.8-120B-A12BAI Singapore, LLMReleasedSep 2026open weightsIndonesian statedhas scoreslast 18 months

Nemotron-SEA-LION-v4.8-30B-A3BAI Singapore, LLMReleasedSep 2026open weightsIndonesian statedhas scoreslast 18 months

Qwen-SEA-LION-v4.5-27B-ITAI Singapore, LLMReleasedMay 2026open weightsIndonesian statedhas scoreslast 18 months

Qwen3.6-35B-A3BAlibaba (Qwen), LLMReleasedApr 2026open weightsruns on edgehas scoreslast 18 months

YOLO26lUltralytics, visionReleasedJan 2026open weightsruns on edgehas scoreslast 18 months

YOLO26mUltralytics, visionReleasedJan 2026open weightsruns on edgehas scoreslast 18 months

YOLO26nUltralytics, visionReleasedJan 2026open weightsruns on edgehas scoreslast 18 months

YOLO26sUltralytics, visionReleasedJan 2026open weightsruns on edgehas scoreslast 18 months

Nemotron 3 SuperNVIDIA, LLMReleased2026open weightsIndonesian statedhas scoreslast 18 months

Nemotron 3.5 Lightning 30B-A3BNVIDIA, LLMReleased2026open weightsIndonesian statedhas scoreslast 18 months

Showing 10 of 1082. All models of this class

Where this comes from

Derived, not researched: models in the directory whose class matches a class this use case uses, excluding family records and models shut down or deprecated. Ranked by how many fit facts they meet, then by release date. Each fit fact is read from the model record.

Use Case

Industry: public sector
Model classes: visionaudio classificationLLMunverified
Benchmarks or datasets: not in the notes
Regulatory notes: Surat Edaran Menkominfo 9/2023 Etika Kecerdasan Artifisial, Kementerian Komunikasi dan Informatika (now Kementerian Komunikasi dan Digital)Disinformation, deepfake and illegal content detection is an AI-based service run by an electronic system operator, and the circular asks such operators to build and use AI on the values of inclusivity, transparency, humanity and security.
UU 27/2022 Pelindungan Data Pribadi, DPR and President of the Republic of Indonesia (administered by Kementerian Komunikasi dan Digital)Disinformation, deepfake and illegal content detection processes personal data of citizens and residents, so the controller needs a lawful basis, must protect the data and must honour data subject rights.
UU 1/2024 Perubahan Kedua UU ITE, DPR and President of the Republic of Indonesia (administered by Kementerian Komunikasi dan Digital)Disinformation, deepfake and illegal content detection detects false information, deepfakes and illegal content, which this law prohibits from being distributed electronically.
UU 7/2017 Pemilihan Umum, DPR and President of the Republic of Indonesia (KPU and Bawaslu as election bodies)Disinformation, deepfake and illegal content detection is relevant to election campaigns, which this law governs, with KPU running elections and Bawaslu supervising campaign violations.
Permenkominfo 5/2020 Penyelenggara Sistem Elektronik Lingkup Privat, Kementerian Komunikasi dan Informatika (now Kementerian Komunikasi dan Digital)Disinformation, deepfake and illegal content detection supports the takedown of prohibited content, which private electronic system operators must act on under this regulation.

Where this comes from

From the industry tracks T08 to T10 of the research notes.

R&D Topics

Links to R&D topics are awaiting review.

Where this comes from

Which R&D topics would most change this use case. Drafted by Claude from the topic definitions and the use case; proposed until approved.

Incidents

Indonesia Demands Social Media Giants Address AI-Driven Disinformation After ProtestsIndonesia, 2025-08-27, misinformationIndonesia summoned Meta, TikTok, and other platforms after AI-generated disinformation, including deepfakes, spread on social media, fueling public outrage and protests.
Deepfake video falsely showed Finance Minister Sri Mulyani calling teachers a burden on the stateIndonesia, 2025-08-19, misinformationA viral video edited with deepfake techniques put words in the Finance Minister's mouth, and she and the Ministry of Finance publicly denied it.
Bias in AI Deepfake Detection Undermines Election Security in Global South2024-09-02, discriminationAI deepfake detection tools are reportedly failing voters in the Global South due to biases in their training data.

Where this comes from

Documented failures, harms or misuse in this kind of use, Indonesia first, then the region, then well-known cases elsewhere (AI Incident Database, OECD AI incidents monitor, reputable news). Not a claim about any deployment listed here.

In Neighbouring Countries

HTX (Home Team Science and Technology Agency)Singapore, state-owned, research, 2025-10-30AlchemiX deepfake detection digital forensic tool for investigators

Where this comes from

Documented deployments of this use case in Malaysia, Singapore, Thailand, Vietnam and the Philippines, each with its source.

Opportunities

Opportunities are awaiting review.

Where this comes from

Gaps found by rule in what the directory holds for this use case. Each is a proposal for review.

Links

IndustryPublic Sector31 use cases, 44 deployments

Use CaseDisinformation, Deepfake and Illegal Content DetectionPublic Sector

Modelsnone recorded

Who Runs It

Komdigi with MafindoPilot, 27 Jun 2025

Kementerian Komunikasi dan Digital (Komdigi)In production, 22 Jan 2025

Graph

Deployments 2

Kementerian Komunikasi dan Digital (Komdigi)AI for crawling and verification of online gambling content (model not stated), Indonesia Komdigi with MafindoAI deepfake detector for video, image and audio, extending the CekFakta portal (name not given), Indonesia

Sources

suarasurabaya.net/kelanakota/2025/komdigi-gandeng-mafindo-siapk... https://www.suarasurabaya.net/kelanakota/2025/komdigi-gandeng-mafindo-siapkan-alat-deteksi-deepfake-gunakan-ai/
katadata.co.id/digital/teknologi/69df0e8039515/dua-perpres-a... https://katadata.co.id/digital/teknologi/69df0e8039515/dua-perpres-ai-segera-terbit-atur-tiga-tingkatan-risiko-dan-mitigasi-kerugian
gov.uk/government/collections/algorithmic-transparen... https://www.gov.uk/government/collections/algorithmic-transparency-reports

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Disinformation, Deepfake and Illegal Content Detection", https://aurion.semai.id/usecases/pub-disinformation-content-detection/, records of October 2026.