XR Object Range Selection Using Gesture-Aware Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for selecting a desired range in objects within cross reality (XR) environments, such as VR and AR, are cumbersome and lack simplicity in designating the entire object or specific portions thereof.
Innovation Solution
An information processing device and method that utilize an object recognition unit, operation body recognition unit, and designated range setting unit to recognize the state of a target object and operation body, allowing for the setting of a designated range based on the state of either or both, facilitating easy and precise selection of desired ranges using sensors and user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional selection methods are used in XR environments, then object selection capability is achieved, but operational complexity increases and user ease of operation deteriorates
Solution Approach 1:
The system automatically recognizes the target object and operation body, and the designated range setting unit autonomously determines the designated range based on recognition results. The user simply needs to point the operation body at the object, and the system self-adjusts the designated range according to distance and orientation, eliminating the need for manual range parameter input.
Solution Approach 2:
The designated range is dynamically adjusted based on changes in parameters such as the distance between the operation body and target object, and the orientation of the operation body. As the user moves closer or farther from the object, or changes the angle of the operation body, the system automatically modifies the designated range parameters to match the user's intent.
2Measurement precision
If precise range designation is implemented, then measurement precision improves, but operational simplicity deteriorates
Solution Approach 1:
The system continuously monitors the state of the operation body (position, orientation, distance) and provides real-time feedback by adjusting the designated range accordingly. The designated range setting unit uses recognition results to dynamically update the designated range, creating a closed-loop system where the user's movements directly influence the range parameters with immediate visual or system feedback.
Solution Approach 2:
The patent replaces manual mechanical adjustment of range parameters with automated recognition and calculation systems. Instead of requiring users to manually adjust sliders or input coordinates, the system uses sensors and processing units to automatically calculate the designated range based on the recognized state of the operation body and target object.
3Productivity
If automated range setting is implemented, then productivity improves, but system complexity increases
Solution Approach 1:
The system divides the complex range designation task into separate functional modules: an object recognition unit that identifies the target object, an operation body recognition unit that tracks the user's operation body, and a designated range setting unit that calculates the final range. This segmentation allows each module to specialize in one aspect, improving overall efficiency while making the system more manageable.
Data Source
AI summary
There is provided an information processing device and an information processing method that facilitate designating a desired range in an object in XR. The information processing device includes: an object recognition unit that recognizes a state of a target object that is a real object or a virtual object that exists in a field of view of a user; an operation body recognition unit that recognizes a state of an operation body that is a real object or a virtual object used by the user for setting a designated range for the target object; and a designated range setting unit that sets the designated range on a basis of at least one of a state of the target object or a state of the operation body. The present technology can be applied to, for example, a head mount display (HMD).