Image Aggregation Device for Multi-Camera AR/VR Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional monitoring systems require a central server with high calculation ability and large storage capacity, limiting their scalability and flexibility, and are unable to effectively aggregate images from multiple sources or improve frame rates for AR/VR applications, leading to user discomfort during rapid head movements.

Innovation Solution

An electronic system with an image aggregation device that controls multiple image pickup devices, allowing flexible selection and rearrangement of images, eliminating the need for a central server by using a trigger control unit, interface circuit, write circuit, and retiming circuit to manage and aggregate image data in a multi-input, multi-output manner.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Power

If a central server with high calculation ability and large storage capacity is used, then image processing capability is improved, but system cost and device complexity increase

Engineering Contradiction:
Improveimage processing capabilityVSAvoidsystem complexity
Core Design Contradiction:
PowerVSDevice complexity

Solution Approach 1:

The patent divides the image processing system into multiple independent image pickup devices, each with its own processing capabilities. Instead of one centralized server handling all processing, each device processes images locally and transmits only necessary data, distributing the computational burden and reducing central server requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts the essential image processing functions from a centralized server and implements them directly in the image pickup devices. By taking out the processing capability from the central server and embedding it in the edge devices, the system reduces dependency on high-power central servers while maintaining processing capability.

Inventive Principle:
Principle #2Taking out (Extraction)

2Quantity of substance

If the number of image pickup devices is increased, then monitoring coverage is improved, but system scalability is limited by central server channels

Engineering Contradiction:
Improvenumber of image pickup devicesVSAvoidsystem scalability
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent makes each image pickup device self-sufficient with universal processing capabilities. Each device can independently process, compress, and transmit images without requiring dedicated server channels. This multi-functionality at the device level allows the system to scale by simply adding more devices without being constrained by central server capacity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If conventional head mounted devices display external images directly, then AR/VR function is provided, but frame rate improvement and object tracking capability are limited

Engineering Contradiction:
ImproveAR/VR functionVSAvoidframe rate
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary image processing, aggregation, and trajectory calculation at the device level before transmission. By pre-processing images and calculating trajectories in advance at the image pickup devices, the system reduces the processing burden during real-time display in AR/VR headsets, enabling higher frame rates and better object tracking.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11910103B2Electronic system and image aggregation method thereof
Publication Date: 2024.02.20 EYS3D MICROELECTRONICS CO
  • US11910103B2 patent drawing
  • US11910103B2 patent drawing
  • US11910103B2 patent drawing

AI summary

The application provides an electronic system and an image aggregation method thereof. The electronic system includes a plurality of image pickup devices and an image aggregation device coupled to the image pickup devices. The image aggregation device controls trigger of the image pickup devices. When the image pickup devices are triggered, the image pickup devices pickup a plurality of images and send to the image aggregation device. The image aggregation device flexibly selects the images pickup by the image pickup devices to flexibly aggregate into an aggregated image.