Near Interaction Mode for Far Virtual Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
User interaction with distant virtual objects in AR or VR environments is challenging due to difficulty in fine control and potential muscle fatigue, as well as limitations in interactions such as scrolling or accessing context menus when virtual content is displayed beyond reach.
Innovation Solution
A computing system with a head-mounted display that invokes a far interaction mode for distant virtual objects, allowing limited interactions like selection, movement, and resizing, and transitions to a near interaction mode by displaying virtual affordances or handles within reach, using gaze detection, gesture recognition, and natural language processing to facilitate intuitive control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If virtual objects are displayed at a distance from the user, then the field of view is expanded and more objects can be viewed, but fine control of the objects becomes difficult and muscle fatigue increases
Solution Approach 1:
The patent introduces virtual affordances as intermediary elements that mediate between the user and distant virtual objects. These affordances (such as virtual hands, grasping points, or manipulation interfaces) are displayed within the user's reach zone and serve as proxies for direct manipulation of distant objects, enabling fine control without requiring the user to physically reach or extend arms to the objects
Solution Approach 2:
The interaction system is segmented into two distinct modes: far interaction mode for viewing and selecting distant objects, and near interaction mode for fine control through virtual affordances. This segmentation allows the system to optimize the interaction approach based on object distance, using appropriate control mechanisms for each scenario
2Area of stationary object
If virtual objects are displayed at a distance from the user, then more content can be displayed in the environment, but accessing context menus and scrolling mechanisms becomes impossible or difficult
Solution Approach 1:
Virtual affordances serve as intermediary control interfaces that bring context menus, scrolling mechanisms, and other control elements within the user's reach. Instead of requiring direct access to distant virtual objects for manipulation, the affordances provide proximal access points for all interaction types including menu access and scrolling
Solution Approach 2:
The system transitions control interactions from the distant spatial dimension to the near dimension by projecting virtual affordances into the user's immediate reach zone. This dimensional shift in control interface placement enables access to previously unreachable controls
3Measurement precision
If direct interaction with distant virtual objects is required, then interaction precision may be improved, but muscle fatigue increases due to extended hand and arm positions
Solution Approach 1:
Virtual affordances act as mediators that enable precise interaction control without requiring the user to maintain extended arm or hand positions. The affordances provide stable, proximal control points that eliminate the physical strain of reaching while maintaining or enhancing interaction precision through virtual manipulation interfaces
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computing system is provided. The computing system includes a head mounted display (HMD) device including a display, a processor configured to execute one or more programs, and associated memory. The processor is configured to display a virtual object at least partially within a field of view of a user on the display, identify a plurality of control points associated with the virtual object, and determine that one or more of the control points associated with the virtual object are further than a predetermined threshold distance from the user. The processor is configured to, based on the determination, invoke a far interaction mode for the virtual object and receive a trigger input from the user. In response to the trigger input in the far interaction mode, the processor is configured to invoke a near interaction mode and display a virtual interaction object within the predetermined threshold distance from the user.