3D Annotation Placement Using Air Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for creating and editing digital scenes in virtual environments require inefficient input methods, such as joysticks and keyboards, and do not allow for spatially relevant annotations within the digital scenes.
Innovation Solution
An electronic device that displays a three-dimensional virtual environment, allowing users to insert annotations using air gestures, voice commands, body movements, and gaze, with the device determining the context of the user's interaction to accurately place and orient the annotations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional computing peripherals (joysticks, keyboards, mice) are used for annotation input, then device complexity is reduced, but user input efficiency and spatial relevance of annotations deteriorate
Solution Approach 1:
The patent replaces mechanical input devices (joysticks, keyboards, mice) with air gesture recognition and voice command systems. Users perform gestures in the air that are captured by sensors, and speak commands that are processed by speech recognition software, eliminating the need for physical peripherals while improving input efficiency and enabling spatially relevant annotations.
Solution Approach 2:
The system introduces an intermediary layer of gesture and voice recognition technology between the user and the digital scene. This intermediary translates physical gestures and spoken words into annotation commands, allowing users to interact with the virtual environment more naturally and efficiently without direct mechanical input devices.
2Ease of operation
If conventional computing peripherals are used for annotation input, then ease of operation is maintained, but spatial relevance of annotations to digital scenes deteriorates
Solution Approach 1:
The system transitions from two-dimensional screen-based interaction to three-dimensional spatial interaction. Users can gesture in three-dimensional space to place annotations at specific locations within the digital scene, preserving spatial context and enabling annotations to be positioned accurately relative to the content being annotated.
Solution Approach 2:
By replacing mechanical peripherals with gesture and voice recognition, the system enables users to operate more naturally while maintaining ease of use. The gesture-based interface allows intuitive spatial positioning of annotations without requiring complex device manipulation.
3Adaptability or versatility
If spatially relevant annotations are enabled in virtual environments, then collaboration and interaction quality improve, but system complexity increases
Solution Approach 1:
The system creates a universal annotation framework that works across multiple virtual environments and collaboration scenarios. The gesture and voice recognition system serves multiple functions including annotation placement, selection, modification, and deletion, providing a versatile interface that adapts to different collaboration needs without requiring separate control mechanisms for each function.
Data Source
AI summary
Some examples of the disclosure are directed to systems and methods for displaying an editing a virtual scene. In some examples, an electronic device can display an immersive virtual scene. In some examples, the immersive virtual scene is shared in a communication session with other electronic devices. In some examples, the electronic device can detect user input requesting insertion and display of an annotation into the virtual scene. In some examples, the electronic device can determine user context to determine placement and content associated with the inserted annotation, and display a representation of the annotation. In some examples, the electronic device can capture a virtual screenshot of the virtual scene. In some examples, the electronic device can display a user interface providing an overview of the annotations associated with the virtual scene.