Sensor Fusion AR Eyewear for Wide Field of View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality head-mounted displays often provide a poor user experience due to limitations in field of view and integration of sensors, leading to suboptimal interaction with real-world environments.
Innovation Solution
A sensor fusion augmented reality eyewear device featuring a frame with a processor, sensor assembly, camera assembly, and user interface control, incorporating multiple IMU sensors, wide-angle cameras, and a SLAM system for seamless 3D content display, along with customizable camera placement and angle, and wireless communication for enhanced user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If conventional augmented reality head-mounted displays are used, then the device can provide augmented reality functionality, but the field of view is limited resulting in poor user experience
Solution Approach 1:
The patent employs multiple cameras positioned at different locations and orientations around the user's field of view. Each camera captures a specific segment of the environment, and these segmented views are then fused together to create a comprehensive augmented reality display that covers a wide field of view, resolving the limitation of single-camera systems
Solution Approach 2:
The patent merges data from multiple cameras, IMU sensors, and other sensors into a unified augmented reality representation. The sensor fusion algorithm combines these diverse data sources to create a cohesive spatial model that enables accurate overlay of virtual objects across the entire field of view, improving both field of view coverage and user experience
2Measurement precision
If multiple sensors are integrated for improved tracking and localization, then the accuracy of augmented reality overlays is improved, but the device complexity increases
Solution Approach 1:
The patent employs IMU sensors that serve multiple functions: they provide orientation data for camera calibration, enable motion tracking during video recording, and facilitate accurate spatial mapping. This multi-functionality reduces the need for separate dedicated sensors for each function, thereby managing device complexity while maintaining high measurement precision
Solution Approach 2:
The patent introduces a sensor fusion algorithm as an intermediary that processes and coordinates data from multiple sensors. This intermediary layer manages the complexity by providing a unified interface for integrating camera, IMU, and other sensor data, enabling accurate tracking and localization without requiring direct complex interconnections between all sensors
3Area of stationary object
If a wide angle camera system is used to increase field of view, then the coverage area is improved, but the manufacturing precision requirements increase
Solution Approach 1:
The patent employs IMU sensors to continuously track the position and orientation of each camera in real-time. This feedback information is fed into the sensor fusion algorithm, which dynamically adjusts the spatial transformation matrices to compensate for any deviations in camera placement. This active compensation allows the system to achieve high coverage area with relaxed manufacturing precision requirements
Solution Approach 2:
The patent uses sensor fusion to dynamically adjust the parameters of the augmented reality display based on real-time sensor data. By continuously updating the spatial transformation parameters according to IMU feedback, the system can maintain accurate overlay positioning even when camera placement varies within certain tolerances, thereby reducing the stringency of manufacturing precision requirements
Data Source
AI summary
An augmented reality eyewear device to operate augmented reality applications and provides a wide-angle field view, is disclosed. The eyewear device comprises a frame which is associated with a processor, a sensor assembly, a camera assembly, and a user interface control assembly coupled to the processor. The sensor assembly coupled to the processor comprises at least two inertial measurement unit (IMU) sensor to transmit raw IMU data of at least one IMU sensor and an android connected IMU data of at least one IMU sensor. The camera assembly coupled to the processor comprises at least two wide angle cameras synchronized with one another is configured to transmit camera feed data from the camera assembly to the processor. The processor is configured to dually synchronize raw IMU Data and android connected IMU data with the camera feed data providing a seamless display of 3D content of the augmented reality applications.