Interactive Digital Twin through Multimodal AI

Project owned by AI Sweden English
50d ago update

The project forms a successor to and expansion of the “Visual Crime Scene”  project that was funded by Visual Sweden, Region Östergötland, The Police and VisualiseringscenterC

The goal is to demonstrate a modular AI-based system, an interactive twin, allowing user interaction with complex outdoor scenarios and events. 

Funded by the Wallenberg WASP programme and Vinnova Avancerad Digitalisering for a 1 ½ year research- and  demonstrator-project together with parts from the industry, Swedish & Danish Academia, the Swedish Police Authority and @AI Sweden.

Project Partner: Polisen, Linköpings universitet, Lutra Interactive, Norrköping Visualisering, East Sweden Game, AI Sweden, Köpenhamns universitet, Intel Sweden & Santa Anna IT Research Institute.

Limited Crime Scene Visualization and Reconstruction
Without 3D technology, investigators must rely on photos, sketches, and written descriptions to recreate crime scenes. This can lead to incomplete visual understanding, missed spatial relationships, and difficulties when communicating complex scenarios to colleagues, legal teams, or juries.

Difficulties in Time Series Analysis
Analyzing timestamps alongside text data can be challenging without specialized tools. Manually aligning events in chronological order makes it difficult to see sequences clearly. Ideally, we would make this data scrollable to allow investigators to explore crime scenes as they unfolded over time, providing a more intuitive and comprehensive view of events.

Challenges in Public Communication and Education
In cases of complex crime scenes or unusual scenarios, explaining findings to the public or jury is often difficult. Without interactive 3D models, presenting evidence in a way that is both accurate and easily understood by non-experts is a challenge. This is a great commercial tool for Police authority to inform public about their daily work, as well as using it for educational platform for Police and Forensic Experts.

The project will create interactive, visualized crime scenes that turn several complex fictive crimes and investigations into immersive experiences.

It will form basis for  methodology development, new research and improvements supporting society in fight  against new crimes where  forensic work which can benefit from the new AI and  visualization technologies.

The project parties will use advanced gaming platforms and recent research results to  jointly develop an advanced multimodal AI system—an interactive digital twin — to  revolutionize forensic investigations by combining high-quality 3D models and  generative AI, and shaping the future of forensic science. 

At the same time researchers  will get the opportunity to validate ongoing research. 

This is a perfect example of where technology meets real-world needs, building the  methods of tomorrow!

Attributes

Competence & Expertise, Data, Technology
Authority & Agency, Education, Health, Information Technology, Research
Education, Innovation, Research & Development, Security
Better Quality, More Efficient, New Business, Smarter Product or Service
Hearing, Language, Prediction
Generative AI, NLP