Wearable Gestural Interface for 3D Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality systems are limited as they require users to obtain information from screens and rely on touch-based interactions, restricting freedom and flexibility in accessing and interacting with information in the physical environment.
Innovation Solution
A wearable apparatus comprising a camera, projector, mirror, and digital computer that captures visual data to recognize objects and hand gestures, allowing users to project information onto any surface and interact with it using free-hand gestures, enabling the augmentation of physical objects with digital information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional augmented reality systems use screens for information display, then information can be displayed clearly, but user freedom and flexibility are restricted
Solution Approach 1:
The patent transitions from 2D screen-based information display to 3D projection in the physical environment. Information is projected onto surfaces in the user's surroundings (walls, tables, objects) rather than confined to a flat screen, enabling users to access information from multiple angles and positions, thereby significantly enhancing user freedom and adaptability
Solution Approach 2:
The patent introduces a camera as an intermediary device to capture images of physical objects and surfaces. This captured visual data serves as the basis for projecting relevant information onto the same surfaces, creating a bridge between the physical environment and digital information without requiring traditional screen interfaces
2Adaptability or versatility
If conventional systems use touch-based interactions, then precise input can be achieved, but flexibility in interaction is limited
Solution Approach 1:
The patent replaces mechanical touch-based interaction with optical gesture recognition. Instead of requiring physical contact with screens, the system uses cameras to capture and analyze hand movements and gestures in three-dimensional space, substituting mechanical input methods with optical field-based detection
Solution Approach 2:
The patent extends interaction from 2D touch surfaces to 3D gesture space. Users can perform gestures in the air above surfaces, allowing for more natural and flexible interactions while the camera system tracks hand positions and movements with sufficient precision to recognize intended commands
3Ease of operation
If information is projected on physical objects, then accessibility is improved, but projection precision and alignment are challenging
Solution Approach 1:
The patent employs a feedback mechanism where the camera continuously captures images of the projected information and the underlying physical surface. This visual feedback is processed to determine the actual position, orientation, and shape of the surface, allowing the system to adjust and re-project the information to achieve proper alignment and registration with the physical object
Solution Approach 2:
The system performs preliminary actions by first capturing an image of the physical surface with the camera, analyzing the surface geometry and position, and calculating the appropriate projection parameters before actually projecting the information. This preliminary analysis ensures that the projected information will be properly aligned with the physical object
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides users with the ability to access and interact with information projected on objects in their environment, enhancing freedom and flexibility by allowing information to be projected directly on relevant objects and enabling interaction through free-hand gestures, rather than relying on screens or touch-based interfaces.
Implementation Method 1
The camera captures visual data
Implementation Method 2
The projector is used, along with a mirror to adjust the direction of the projected light, to project images on objects in the user's environment
Implementation Method 3
The projector is used, along with a mirror to adjust the direction of the projected light
Data Source
AI summary
This invention may be implemented as a wearable apparatus comprised of a camera, a projector, a mirror, a microphone and a digital computer. The camera captures visual data. This data is analyzed by the digital computer to recognize objects and hand gestures, using color tracking and edge detection techniques. The projector is used, along with a mirror to adjust the direction of the projected light, to project images on objects in the user's environment. For example, the images may be projected on surfaces such as a wall, table, or piece of paper. The projected images may contain information relevant to the object being augmented. Indeed, the information may include current data obtained from the Internet. Also, the projected images may comprise graphical interfaces, with which a user may interact by making hand gestures.