Multi-device mixed interactivity system for virtual object selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual reality and augmented reality systems face challenges in selecting and annotating virtual objects due to cumbersome interfaces that impede user actions and inconsistency with traditional 2D data input paradigms, making it difficult for users to identify selections and provide notations in virtual experiences.
Innovation Solution
A multi-device mixed interactivity system that uses paired mixed-input devices with real and virtual inputs, sensors, and haptic feedback to integrate real device space tracker data and virtual device space tracker data for determining selection and annotation inputs, providing context-based interfaces and flexible interaction methods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional virtual reality interfaces are used for selecting and annotating virtual objects, then virtual object interaction is enabled, but the interface becomes cumbersome and impedes user actions
Solution Approach 1:
The patent copies familiar 2D touchscreen interaction paradigms into the 3D virtual environment. Users interact with virtual objects by making selections on their physical device display that correspond to the virtual object's position, rather than manipulating complex 3D interfaces directly in virtual space. This allows users to leverage known 2D interaction patterns for 3D object selection and annotation.
2Measurement precision
If complex 3D interaction interfaces are implemented for virtual object selection, then precise selection capability is improved, but inconsistency with traditional 2D data input paradigms increases
Solution Approach 1:
The physical device display acts as an intermediary between the user and the virtual object. Instead of directly manipulating 3D virtual interfaces, users make selections on the 2D display which then map to corresponding positions on the virtual object. This intermediary approach maintains consistency with traditional 2D input while enabling precise 3D object selection.
3Adaptability or versatility
If multiple input devices are integrated for mixed reality interaction, then interaction flexibility is improved, but system complexity increases
Solution Approach 1:
The system integrates multiple input capabilities (touchscreen, camera, sensors) into a single universal device that can handle both 2D display interactions and 3D virtual environment navigation. This multi-functional approach allows one device to perform multiple roles, reducing the need for separate specialized devices while maintaining interaction flexibility.
Data Source
AI summary
In various embodiments, methods and systems for implementing a multi-device mixed interactivity system are provided. The interactivity system includes paired mixed-input devices for interacting and controlling virtual objects. In operation, a selection input associated with a virtual object is accessed. The selection input is based on real input associated with a selection device and virtual input associated with a mixed-reality device. The selection device has a first display that displays the virtual object and the mixed-reality device has a second display that displays the virtual object. A selection profile is generated based on the selection input. The selection profile comprises one or more selection profile attributes for isolating a portion of the virtual object. A selected portion of the virtual object is determined based on the selection profile. The selected portion of the virtual reality object is caused to be displayed on the first display of the selection device.