Dual-SoC AR Eyewear for Balanced Vision Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for wearable devices and augmented reality devices fail to provide a seamless integration of the wearable devices and augmented reality devices fail to provide a seamless integration of augmented reality with efficient power management and balanced processing workloads.
Innovation Solution
The eyewear device employs two separate system-on-chip (SoC) configurations, each responsible for different functionalities, where one system on a chip operates the main OS, color cameras, and displays, while the other handles computer vision algorithms and tracking hand gestures, and the other runs computer vision algorithms, visual odometry, and depth from stereo.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single system on chip is used to operate all functionalities, then device complexity is reduced, but processing workload balance and power consumption efficiency deteriorate
Solution Approach 1:
The patent divides the computing system into two separate system on chip units: a first SoC that operates the main operating system, color cameras, and displays, and a second SoC that handles computer vision algorithms, visual odometry, and depth from stereo processing. This segmentation allows each processor to be optimized for its specific workload, improving overall power consumption efficiency while managing device complexity through functional specialization.
2Device complexity
If a single system on chip is used to handle all processing, then device structure is simplified, but processing workload balance deteriorates
Solution Approach 1:
The patent segments processing responsibilities between two separate SoCs: the first SoC handles high-level operating system management and user interface operations, while the second SoC specializes in computationally intensive computer vision tasks including visual odometry and depth estimation from stereo images. This functional segmentation achieves balanced processing workload distribution, preventing any single processor from becoming a bottleneck.
3Use of energy by moving object
If separate system on chip configurations are used for different functionalities, then processing workload balance and power consumption efficiency are improved, but device complexity increases
Solution Approach 1:
While the patent employs two separate SoCs for specialized functions, each SoC is designed with multi-functional capabilities. The first SoC can handle both operating system operations and basic image processing, while the second SoC can perform computer vision algorithms and assist with display rendering. This universality within each specialized unit reduces overall system complexity by eliminating the need for additional dedicated processors for each function.
4Productivity
If separate system on chip configurations are used, then processing workload balance is improved, but device structure becomes more complex
Solution Approach 1:
The patent merges multiple functional components into each SoC unit. The first SoC combines the main operating system, color camera processing, and display control in one unit. The second SoC combines computer vision algorithms, visual odometry, and depth from stereo processing in another unit. This merging approach achieves balanced processing workload distribution while managing device structural complexity through integrated multi-functional processor units.
Data Source
AI summary
Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.