Digital Twin Multimedia Elements for Asynchronous Understanding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Asynchronous communications often face difficulties in understanding between interlocutors, particularly in complex situations, and video conferencing does not fully resolve these issues.
Innovation Solution
A method for obtaining a multimedia element by capturing an audiovisual stream, extracting parameters from a digital twin of an object of interest, and creating a multimedia element that includes these parameters, which can be rendered in a physical environment to enhance understanding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video conferencing is used to improve understanding between interlocutors, then communication clarity is improved, but it does not fully resolve understanding difficulties in complex situations and requires synchronous availability
Solution Approach 1:
The system captures audiovisual streams and extracts digital twin parameters in advance, creating a enriched message that can be sent asynchronously. The digital twin data (position, orientation, velocity) is captured at the source and transmitted with the message, allowing the recipient to understand complex situations without needing to be present during the original event.
Solution Approach 2:
The system creates a digital copy (digital twin) of the physical object's state and transmits this copy along with the audiovisual message. This digital twin contains precise parameters like position, orientation, and velocity that replicate the physical reality, enabling the recipient to understand the complex situation as if present, without requiring synchronous video conferencing.
2Adaptability or versatility
If asynchronous communication is used to improve communication flexibility, then availability constraints are overcome, but understanding difficulties arise in complex situations
Solution Approach 1:
The digital twin acts as an intermediary that bridges the gap between asynchronous communication and real-time understanding. It carries essential spatial and temporal parameters (position, orientation, velocity) that mediate the transmission of complex situational information, allowing asynchronous messages to convey rich contextual understanding without requiring synchronous interaction.
3Loss of information
If digital twin parameters are extracted and included in multimedia elements, then communication clarity is improved, but data processing complexity increases
Solution Approach 1:
The system extracts only the essential parameters from the digital twin (position, orientation, velocity) that are most relevant for understanding the physical situation. This selective extraction reduces data processing complexity while maintaining communication clarity, focusing on the key spatial and temporal characteristics needed for contextual understanding.
Solution Approach 2:
The system applies different levels of detail to different parts of the multimedia element. Essential digital twin parameters are integrated into the message structure where they are most needed for understanding specific objects or situations, rather than uniformly processing all data. This local quality approach optimizes processing by focusing computational resources on the most informative parameters.
Data Source
AI summary
A method for obtaining a multimedia element includes: obtaining an audiovisual stream representing a physical environment; and creating a multimedia element granting access to a value of a first parameter of a digital twin relating to a first object of interest of the audiovisual stream, the value being extracted from the digital twin when capturing the audiovisual stream. An enriched rendering method for rendering a first object of interest in a physical environment includes: obtaining a multimedia element, the multimedia element granting access to a first value of a first parameter of a digital twin relating to the first object of interest; obtaining a first audiovisual representation of a first portion of the digital twin taking into account the first acquired value; and rendering the first audiovisual representation in the physical environment. Also provided are corresponding electronic devices, computer program products and media.