Mapped Holographic Gestures for Clearer Screen Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual collaboration sessions, the synchronization of presenter's body language and gestures with the shared screen image is difficult due to the remote nature of the session, making it challenging for participants to understand the presenter's intent effectively.
Innovation Solution
A method and system that maps the presenter's body language and gestures to a holographic image displayed at the participant's device, synchronized with the shared screen image, using machine learning to identify and project gestures as holograms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If screen sharing is used to transmit presentation content to remote participants, then information transmission efficiency is improved, but the ability to convey presenter gestures and body language is lost
Solution Approach 1:
The patent creates a holographic copy of the presenter's gestures and body language that can be displayed alongside the screen sharing content. This allows participants to see both the shared screen and the presenter's physical movements simultaneously, preserving gesture information while maintaining efficient screen sharing transmission
Solution Approach 2:
The patent adds a spatial dimension to the presentation by projecting holographic gestures in 3D space above or beside the 2D screen content. This dimensional addition allows gesture information to coexist with screen content without interfering with the efficiency of screen sharing
2Loss of information
If a camera is added to capture presenter body movements, then gesture information is preserved, but system complexity increases
Solution Approach 1:
The patent integrates the camera functionality into the existing screen sharing system, allowing the same device to perform both screen sharing and gesture capture. This multi-functionality reduces overall system complexity while preserving gesture information
Solution Approach 2:
The patent combines the screen sharing stream and the gesture capture stream into a unified holographic display system. By merging these functions into a single integrated system rather than separate systems, the overall complexity is reduced while achieving both screen sharing and gesture preservation
3Loss of information
If holographic projection is displayed in front of the screen image, then gesture visibility is improved, but image clarity may be compromised
Solution Approach 1:
The patent applies different visual qualities to different regions of the display - the screen sharing content maintains its original clarity and resolution, while the holographic gestures are rendered with appropriate transparency and spatial positioning. This local differentiation ensures both gesture visibility and screen content clarity are optimized in their respective zones
Data Source
AI summary
A computer-implemented method, a computer system and a computer program product add a mapped holographic projection to a screen sharing session. The method includes transmitting a screen image from a presenter computing device to a participant computing device. The method also includes capturing a body movement image of the presenter using a camera. The method further includes identifying a gesture in the body movement image and mapping the gesture to the screen image. In addition, the method includes generating a holographic projection of a mapped gesture of the presenter. Lastly, the method includes displaying the holographic projection at the participant computing device in front of the screen image.