Ultra-High Resolution Camera Image Splicing via ISP Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ultra-high definition video camera systems face issues with image splicing, resulting in unclear and low-resolution images at joints due to non-coincident optical centers of cameras, leading to missing or repeated scenes and color differences.

Innovation Solution

A video signal processing method and camera device that split frames of images into sub-images and process them using multiple image sensor processor units, ensuring each unit processes a sub-image, which are then reassembled to improve resolution and clarity at joints, avoiding overlapping or missing images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple high-definition cameras are used to perform image splicing, then ultra-high resolution video source can be provided, but images at joints become unclear and have low resolution due to non-coincident optical centers

Engineering Contradiction:
Improveimage resolutionVSAvoidimage splicing accuracy
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent divides the image processing task into multiple segments by splitting each frame into multiple sub-images that are processed by separate ISP units. This segmentation allows each ISP to handle a specific portion independently, eliminating the need for optical center alignment between multiple cameras while maintaining overall ultra-high resolution and seamless splicing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple ISP processing units to work in parallel on different sub-images from a single camera. The processed sub-images are then merged back together to form the complete ultra-high resolution image, achieving the benefits of multiple processing channels without requiring multiple physical cameras with precisely aligned optical centers.

Inventive Principle:
Principle #5Merging (Combining)

2Area of stationary object

If multiple cameras are placed at specific angles for image splicing, then large ultra-high resolution image can be formed, but images may be missing or repeated at joints for scenes at different distances

Engineering Contradiction:
Improveimage coverage areaVSAvoidimage completeness
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent implements dynamic processing within the ISP units that can adapt to scenes at different distances. By performing processing operations such as noise reduction, sharpness enhancement, and color correction dynamically on each sub-image, the system ensures consistent image quality across the entire field of view without missing or repeated images at joints.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes processing parameters within the ISP units to optimize image quality for different scene conditions. By adjusting parameters such as gain, contrast, and sharpness based on the content of each sub-image, the system maintains reliable image completeness across varying distances while preserving the ultra-high resolution and wide coverage area.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple cameras are used for image splicing, then ultra-high resolution can be achieved, but color differences and synchronization problems occur at joints

Engineering Contradiction:
Improvevideo resolutionVSAvoidimage consistency
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent makes each ISP processing unit universal by enabling them to perform the same complete set of processing operations on their respective sub-images. This includes noise reduction, sharpness enhancement, color correction, and other image processing functions. By ensuring all ISPs perform identical processing universally, the system eliminates color differences and maintains image consistency across the entire ultra-high resolution output.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent ensures homogeneous processing across all sub-images by applying the same processing algorithms and parameters through each ISP unit. This homogeneity in processing approach guarantees that images at joints have consistent color, brightness, and quality characteristics, eliminating the color differences and synchronization problems that occur when multiple cameras with different processing characteristics are used.

Inventive Principle:
Principle #33Homogeneity

Data Source

PatentUS9369636B2Video signal processing method and camera device
Publication Date: 2016.06.14 HUAWEI TECH CO LTD
  • US9369636B2 patent drawing
  • US9369636B2 patent drawing
  • US9369636B2 patent drawing

AI summary

A video signal processing method and a camera device. The method includes obtaining a video signal, and splitting several frames of images in the video signal into two or more sub-images; performing first processing on the two or more sub-images of the several frames of images using two or more image sensor processor (ISP) processing units; and outputting the processed two or more sub-images of the several frames of images. The present invention can improve resolution of output images, make images at joints clear, and implement an ultra-high resolution camera, thereby avoiding deficiencies such as image overlapping or missing at a seam, color difference, and out of synchronization that occur because an existing ultra-high definition video camera system uses a plurality of cameras to perform image splicing.