Mid-span Video Processing Device for Panoramic Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile devices with single camera sensors face challenges in producing high-quality panoramic images and videos due to distortions and poor resolution, necessitating enhanced camera systems for increased field of view.

Innovation Solution

A video processing device configured as a peripheral that receives inputs from one or more cameras, processes video and audio streams, and outputs enhanced content through customizable interfaces, including composite views, active speaker tracking, and face recognition, while supporting H.264 conversion and passthrough, utilizing a mid-span intelligent vision box with an intelligent video engine for low latency and analytics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If a single camera sensor is rotated to capture panoramic images, then the field of view is increased, but the image quality deteriorates due to distortions and poor resolution

Engineering Contradiction:
Improvefield of viewVSAvoidimage quality
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The system divides the panoramic capture task into multiple segments by using multiple fixed camera sensors positioned at different locations, each capturing a specific portion of the scene. This segmentation allows each sensor to maintain optimal image quality while collectively providing a wide field of view, avoiding the distortions caused by rotating a single sensor.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges the outputs of multiple camera sensors through image stitching algorithms to create a single panoramic image. By combining data from multiple fixed sensors rather than rotating one sensor, the system achieves both wide field of view and high image quality, as each sensor captures its portion without rotational distortion.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If multiple camera sensors are used to increase field of view, then image quality improves, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidcamera system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system employs a universal processing unit that handles multiple functions including image capture from multiple sensors, image stitching, distortion correction, and panoramic image generation. This multi-functional approach consolidates complexity into a single processing system rather than requiring separate dedicated components for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces an intermediary processing layer between the multiple camera sensors and the final panoramic output. This intermediary layer manages the complexity by coordinating multiple sensor inputs, applying consistent processing algorithms, and generating unified panoramic images, thereby simplifying the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If video processing is performed in real-time, then responsiveness improves, but processing latency increases

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing latency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary processing actions by pre-configuring processing parameters, pre-loading necessary software modules, and establishing processing pipelines before actual video capture begins. This preliminary preparation enables faster real-time processing by avoiding delays in setup and configuration during actual video operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11122219B2Mid-span device and system
Publication Date: 2021.09.14 GN HEARING AS
  • US11122219B2 patent drawing
  • US11122219B2 patent drawing
  • US11122219B2 patent drawing

AI summary

A video processing device which can be implemented as a peripheral device is disclosed. The video processing device is configured to receive one or more videos and audio through a plurality interfaces. Further, the device receives one or more user input corresponding to one or more customization requests of the received video and the audio. The video processing device processes the video and the audio based on the received user input and outputs the processed video and audio via an output interface.