InterSpeech 2021

ROXANNE Research Platform: Automate criminal investigations and leverage multimodal fusion
(longer introduction)

Maël Fabien (Idiap Research Institute, Switzerland), Shantipriya Parida (Idiap Research Institute, Switzerland), Petr Motlicek (Idiap Research Institute, Switzerland), Dawei Zhu (Universität des Saarlandes, Germany), Aravind Krishnan (Universität des Saarlandes, Germany), Hoang H. Nguyen (Leibniz Universität Hannover, Germany)
Criminal investigations require manual intervention of several investigators and translators. However, the amount and the diversity of the data collected raises many challenges, and cross-border investigations against organized crime can quickly impossible to handle. We developed ROXANNE Research platform, an all-in-one platform which processes intercepted phone calls, runs state-of-the-art components such as speaker identification, automatic speech recognition or named entity detection, and builds a knowledge graph of the extracted information. Our aim for this work is to do a first step in the direction of an open research platform combining speech, text, and video processing algorithms with criminal network analysis for combating organized crime.