Virtual Object Manipulation in Conversational Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital assistants in professional fields are limited to voice and text-based interactions, which can be insufficient for effectively communicating complex information, such as describing pain locations or technical issues with devices.
Innovation Solution
A method and system that allow users to interact with a digital assistant through virtual objects in augmented or virtual reality, enabling manipulation inputs like selection and rotation of three-dimensional virtual objects to perform corresponding functions during conversational sessions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If voice and text-based interactions are used for digital assistants, then the system is simple to operate, but the precision of communication for complex information is insufficient
Solution Approach 1:
The patent transitions from two-dimensional text/voice interfaces to three-dimensional virtual object manipulation in AR/VR environments. Users can physically interact with 3D representations of devices, allowing precise indication of components and issues through spatial manipulation rather than descriptive language.
Solution Approach 2:
The patent introduces virtual objects as intermediaries between the user and the actual physical device. These virtual representations serve as a mediator that allows users to manipulate and indicate specific components, translating physical gestures into digital commands with high precision.
2Measurement precision
If virtual objects in AR/VR are introduced for interaction, then communication precision for complex information is improved, but the device complexity increases
Solution Approach 1:
The patent creates a universal interaction framework where virtual objects can represent any device or component. The same AR/VR manipulation techniques work across different applications and device types, making the complex technology broadly applicable and justifying its integration.
Solution Approach 2:
The patent replaces traditional mechanical input methods (keyboards, mice, touchscreens) with spatial manipulation of virtual objects. This substitution uses optical and spatial tracking systems to capture hand movements and gestures, converting physical gestures directly into digital commands without intermediate input devices.
3Loss of information
If traditional voice and text inputs are used, then the interaction method is simple, but the ability to communicate complex information like pain locations or device issues is limited
Solution Approach 1:
The patent adds spatial and visual dimensions to information communication. Instead of relying solely on verbal or textual descriptions, users can point to, rotate, and manipulate 3D virtual representations, conveying spatial relationships and component locations that are difficult to describe in words.
Solution Approach 2:
The patent uses visual properties of virtual objects, including color changes and highlighting, to convey information about device states and issues. Different colors can indicate different problem types, severity levels, or component statuses, providing rich information feedback without requiring complex verbal communication.
Data Source
AI summary
One embodiment provides a method, including: receiving, at an information handling device, an indication to display a virtual object in association with a conversational session; receiving, during the conversational session, user manipulation input associated with the displayed virtual object; and performing, based upon the received user manipulation input, at least one function associated with the virtual object. Other aspects are described and claimed.