A multimodal perception driven digital disaster site interactive display method

By integrating multimodal perception data and digital twin models, a fully closed-loop adaptive interactive display of digital disaster sites was achieved, solving the problems of single perception dimension and insufficient narrative, and enhancing the immersiveness and emotional resonance of the display.

CN122431528APending Publication Date: 2026-07-21MIANYANG TEACHERS COLLEGE
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
MIANYANG TEACHERS COLLEGE
Filing Date
2026-04-28
Publication Date
2026-07-21

AI Technical Summary

Technical Problem

Existing digital heritage displays suffer from limited perceptual dimensions, lack of interactive loops, and insufficient attention to the unique characteristics of disaster narratives, failing to achieve multi-layered immersion, personalization, and emotional resonance in digital disaster heritage displays.

Method used

By deploying multiple sensors to synchronously collect data on the site environment, user behavior, and emotional perception, a multimodal fusion model is constructed for spatiotemporal alignment and feature fusion to generate a comprehensive perception state vector. Based on a high-precision digital twin model, multi-layer narrative rendering and adaptive interactive display are performed to achieve perception-driven adaptive interaction.

Benefits of technology

It achieves a fully closed-loop multimodal perception-driven system, breaking through the limitations of a single perception dimension, supporting multi-layered narrative rendering and emotional feedback, enhancing the immersiveness and emotional resonance of digital disaster site displays, and possessing self-evolution capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122431528A_ABST
    Figure CN122431528A_ABST
Patent Text Reader

Abstract

The application discloses a kind of multimodal perception driven digital disaster site interactive display method, belong to cultural heritage digitization protection and interactive display technical field.Method includes: synchronous acquisition site environment, user behavior and three kinds of perception data of user emotion;Comprehensive perception state vector is generated by cross-modal attention fusion;Build the digital twin model of real-time linkage with site environment data;Execute four layers of disaster narrative rendering of destruction restoration layer, survival narrative layer, warning reflection layer and emotional comfort layer;According to comprehensive perception state vector, adaptively adjust display content and environment parameter;Generate user experience portrait and feedback optimization.The application constructs complete closed loop from multimodal perception to emotional feedback, realizes immersive, individualized, emotional interactive display for disaster site, and can be widely applied to digital museum, site protection and public science popularization scene.
Need to check novelty before this filing date? Find Prior Art