Decoupled Virtual Object Interaction in AR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Augmented Reality (AR) systems lack interactivity as users cannot directly interact with virtual objects within the virtual scene, requiring the use of physical or virtual keys to control the entire virtual scene, limiting user engagement.
Innovation Solution
A terminal device and method that disassemble the virtual scene into independent virtual objects, allowing users to interact directly with specific objects by updating their object information in response to user input, while keeping other objects' information unchanged, enhancing interactivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the entire virtual scene is controlled as a whole using virtual keys, then the system structure is simple, but user interactivity with specific virtual objects is limited
Solution Approach 1:
The virtual scene is segmented into multiple independent virtual objects, each with its own object information that can be independently updated. This allows users to interact with specific virtual objects directly rather than controlling the entire scene through virtual keys, thereby improving ease of operation while maintaining manageable system structure through modular object management
2Adaptability or versatility
If virtual objects are disassembled and managed independently, then user interactivity improves, but system complexity increases
Solution Approach 1:
The virtual scene is divided into N independent virtual objects (N≥2), each with separable object information including position, scale, and rotation parameters. This segmentation enables selective interaction with individual objects while the system manages complexity through structured data organization and independent object updates
Solution Approach 2:
The system dynamically updates only the object information of the target virtual object being interacted with, while other virtual objects remain unchanged. This dynamic approach allows flexible interaction capabilities without requiring the entire scene to be reprocessed, balancing adaptability with management efficiency
3Measurement precision
If the entire virtual scene is updated in response to user input, then consistency is maintained, but interaction precision with specific objects decreases
Solution Approach 1:
The system applies local quality by updating only the specific object information (position, scale, rotation) of the target virtual object that the user is interacting with, while leaving other virtual objects unchanged. This localized update approach achieves precise interaction with specific objects while maintaining the overall consistency of the virtual scene through selective modification
Data Source
AI summary
An information processing method is provided for a terminal device. The method includes obtaining an image including an AR target; recognizing the AR target, and generating a virtual scene including N virtual objects (N being an integer greater than or equal to 2); disassembling the virtual scene to obtain the N virtual objects; and generating object information that separately corresponds to the N virtual objects, which include a target virtual object to be interacted with by a user. The method also includes keeping the object information of virtual objects other than the target virtual object in the N virtual objects unchanged and updating the object information of the target virtual object in response to receiving an operation instruction inputted by the user for the target virtual object, such that the target virtual object is interacted independently rather than the virtual scene as whole by the user.