IJCAI-ECAI 2026 · IJCAI-ECAI 2026 Special Track (Main Conference)
ICFD-31k: A Large-Scale Dataset and Benchmark for Real-Time Conversational Fraud Detection
†Department of Information Technology, Dr. B.R. Ambedkar National Institute of Technology Jalandhar
Presented at IJCAI-ECAI 2026 in Bremen. Now published in the IJCAI proceedings.
TL;DR
ICFD-31k introduces 31,000+ Indian English/Hinglish fraud-call transcripts with chunk-level streaming labels and slow-thinking rationales, plus RoBERTa baselines that reach 99.40 F1 in-domain and 92.97 F1 on unseen scam types.
Abstract
The proliferation of sophisticated telephone scams poses a significant societal and economic threat, impacting diverse linguistic contexts in a country like India. Furthermore, the lack of large-scale, publicly available datasets remains a critical barrier impacting research on robust, real-time countermeasures. In view of this, the proposed work introduces ICFD-31k, the first Indian Conversational Fraud Dataset, representing a new benchmark containing over 31,000 realistic conversational transcripts. ICFD-31k comprises systematically generated content, covering 10 distinct fraud umbrellas spanning from financial impersonation to job scams. ICFD-31k transcripts feature rich annotations comprising a final verdict, chunk-level streaming labels, and detailed slow-thinking rationales. In addition, the human-in-the-loop evaluation validates the ICFD-31k's quality, achieving a Cohen's Kappa of 0.534 that confirms annotation reliability. Furthermore, the proposed work introduces two fine-tuned models based on RoBERTa: M1 for non-streaming data and M2 for streaming data. The comprehensive experiments with strong baselines (M1, M2) further demonstrate the ICFD-31k's utility.
Cite
@inproceedings{ijcai2026p786,
title = {ICFD-31k: A Large-Scale Dataset and Benchmark for Real-Time Conversational Fraud Detection},
author = {Ahuja, Rishi and Prateek, Kumar and Singh, Simranjit},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {7065--7073},
year = {2026},
month = {8},
note = {AI and Social Good},
doi = {10.24963/ijcai.2026/786},
url = {https://doi.org/10.24963/ijcai.2026/786},
}