AR Contact Detection for Immersive Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The sudden superimposition of virtual world objects on real-world videos in augmented reality head-mounted displays can create a discontinuous and strange user experience due to the lack of physical interaction awareness.
Innovation Solution
An image generation apparatus and method that determine contact between a user's body parts and real-world objects, defining an augmented reality region based on this contact, and generate augmented reality images within this region to create a more immersive and connected experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual world objects are suddenly superimposed on real-world videos in augmented reality, then the entertainment property and immersion are enhanced, but the user experiences a discontinuous connection and feeling of strangeness
Solution Approach 1:
The system performs preliminary actions by detecting user contact with real-world objects before superimposing virtual objects. The contact detection section identifies when a user's body part contacts an object, and this contact information is used to trigger the superimposition of virtual objects at the appropriate moment, preventing sudden and disorienting appearances
Solution Approach 2:
The system implements feedback by continuously monitoring user contact with the real environment and using this information to dynamically control virtual object superimposition. The contact detection section provides real-time feedback about user interactions, which the augmented reality generation section uses to adjust the timing and location of virtual object appearance, ensuring continuity between real and virtual worlds
2Adaptability or versatility
If augmented reality images are generated throughout the entire field of view, then the virtual world presence is maximized, but the discontinuous connection between real and virtual worlds becomes more apparent
Solution Approach 1:
The system applies local quality by generating augmented reality images only in specific regions corresponding to contact points between the user's body and real-world objects, rather than uniformly across the entire field of view. The augmented reality region determination section identifies these localized regions, and the augmented reality generation section applies virtual objects only to these areas, creating a natural transition that reduces the feeling of strangeness
Data Source
AI summary
A contact determination section determines whether or not there is any contact between a body part of a user and an object in a real world. An AR region determination section determines, as an augmented reality region, a region that corresponds to a partial space including a portion of the object in the real world, the portion having been contacted by the body part, and that is viewed from a viewpoint of the user. An AR generation section generates an augmented reality image in the augmented reality region in a shot image of the real world.