AR Virtual Object Movable Part Interaction Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality technologies do not allow users to easily imagine the operation of movable parts of objects, even when virtual objects are displayed superimposed on captured images.
Innovation Solution
An information processing apparatus and method that combines a captured image with position identification information to display a virtual object, including both immovable and movable parts, and allows users to interact with the movable parts through an operation receiver and display controller, enabling dynamic display changes based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a virtual object is displayed superimposed on a captured image, then the user can imagine the appearance of an object, but the user cannot easily imagine the operation of movable parts of the object
Solution Approach 1:
The patent applies the dynamics principle by enabling the movable parts of the virtual object to actually move and change state in response to user input. When a user inputs operation information for a movable part, the system changes the state of that part (e.g., opening a door, extending an arm), allowing users to visually understand the operation dynamics rather than just seeing a static representation.
Solution Approach 2:
The patent implements feedback by providing real-time visual response when users interact with movable parts. The system receives operation information from the user and immediately reflects the operational state change in the displayed virtual object, creating a feedback loop that helps users understand how the movable parts function.
2Productivity
If a static virtual object is displayed, then the composite image can be generated quickly, but the user cannot understand how movable parts operate
Solution Approach 1:
The system maintains high productivity by using pre-generated three-dimensional model data for quick display while adding dynamic capabilities on demand. The virtual object is initially displayed in a static state for rapid rendering, and only when the user provides operation information does the system activate the movable parts, thus balancing speed with functional information delivery.
Solution Approach 2:
The patent applies preliminary action by pre-generating the three-dimensional model data and positioning the virtual object in the composite image in advance. This allows the static display to be generated quickly, and the movable part functionality is prepared but not activated until needed, optimizing both speed and information delivery.
3Manufacturing precision
If the virtual object includes both immovable and movable parts, then the representation becomes more accurate, but the display control becomes more complex
Solution Approach 1:
The patent applies segmentation by dividing the virtual object into distinct immovable parts and movable parts. The three-dimensional model data is structured to differentiate between these components, allowing the system to apply different control logic to each type. This segmentation enables accurate representation while managing complexity through modular organization of the display control system.
Solution Approach 2:
The patent implements universality by creating a display control system that handles both immovable and movable parts through a unified architecture. The same basic framework processes different types of object components, with specialized handling for movable parts when operation information is received, reducing overall system complexity through standardized processing paths.
Data Source
AI summary
An information processing apparatus according to an embodiment includes an imaging unit that obtains a captured image including position identification information identifying a position in which a virtual object represented by an image including an immovable part and a movable part is to be displayed; a generator that generates a composite image obtained by combining the virtual object with the captured image in the position thereof identified by the position identification information; a display unit that displays thereon the composite image; an operation receiver that receives an operation on the movable part included in the composite image displayed on the display unit; and a display controller that controls the display of the movable part, based on display setting information for displaying the virtual object, when the operation receiver has received the operation on the movable part.