Interactive 3D Display Hand Sensing Interface
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D content interaction methods, such as using a mouse and keyboard, lack intuitive operation and fail to simulate manipulating actual objects, limiting user interaction with virtual objects in three-dimensional environments.
Innovation Solution
An interactive 3D display apparatus and method that includes a hand sensing module to detect user hand movements, a user interaction module to generate virtual object adjustment parameters based on hand analysis, and a 3D display to render and display virtual objects with intended changes, allowing users to select and adjust virtual objects without separate keyboards or buttons, using hand-shaped cursors and boundary cursors to manage screen interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a mouse and keyboard are used to interact with 3D content, then the interface method is simple and familiar, but the operation lacks intuitiveness and cannot simulate manipulating actual objects
Solution Approach 1:
The patent introduces a hand sensing module as an intermediary that captures hand images and converts them into cursor positions and gestures. This mediator translates natural hand movements into digital commands, enabling intuitive interaction without requiring users to learn complex device operations. The hand image processing system acts as a bridge between the user's natural gestures and the 3D virtual environment.
Solution Approach 2:
The patent replaces the mechanical interaction system (mouse and keyboard) with an optical sensing system. Instead of using physical devices to navigate and manipulate 3D content, the system uses hand image recognition to detect gestures and translate them into virtual object manipulations. This substitution eliminates the need for separate input devices while providing more natural and intuitive control.
2Ease of operation
If hand sensing is implemented to enable intuitive interaction, then operation intuitiveness improves, but system complexity increases
Solution Approach 1:
The hand sensing module serves multiple functions: it captures hand images, determines cursor positions, recognizes gestures, and controls 3D object manipulation. By consolidating these functions into a single multi-functional system, the patent reduces overall complexity compared to having separate devices for each function. The same hand image data is used for multiple interaction purposes simultaneously.
Solution Approach 2:
The patent creates a virtual copy of the hand (hand-shaped cursor) that mirrors the user's actual hand position and gestures in the 3D environment. This visual feedback copy helps users understand the system's interpretation of their gestures and provides intuitive control without requiring complex processing. The hand-shaped cursor acts as a simplified representation that bridges the user's intent and the system's response.
3Ease of operation
If separate input devices like keyboards and buttons are eliminated, then ease of operation improves, but the ability to precisely control virtual objects may worsen
Solution Approach 1:
The patent implements visual feedback by displaying a hand-shaped cursor that reflects the user's hand position and gestures in real-time. This feedback loop allows users to see exactly where their hand is pointing and what gesture is being recognized, enabling precise control of virtual objects. The system continuously monitors hand position and provides visual confirmation, allowing users to make fine adjustments to object selection and manipulation with high precision.
Data Source
AI summary
An interactive 3D display apparatus and method are provided. The interactive 3D display apparatus includes a hand sensing module configured to acquire a hand image by detecting a hand of a user and a user interaction module configured to generate a virtual object adjustment parameter by analyzing user-intended information about the hand based on the hand image acquired by the hand sensing module and comparing an analysis result with predefined user scenarios, an image rendering module configured to set a scene according to the generated virtual object adjustment parameter, generate image data by rendering the set scene, and convert the generated image data into display data, and a 3D display configured to display a 3D image including a virtual object in which a change intended by the user has been reflected according to the display data.