Panoramic Video Stitching for Flexible Camera Placement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing videoconferencing systems require complex installation due to strict demands on camera placement and distance, leading to overlapping issues and limited viewing angles.

Innovation Solution

A method and apparatus that process multiple channels of video image data into a single panoramic channel, which is then recombined into multiple channels for display, eliminating overlapping and simplifying installation requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are placed at strict physical positions to achieve consecutive viewing experience, then the viewing angle coverage is improved, but the installation complexity and positioning precision requirements increase

Engineering Contradiction:
Improveviewing angle coverageVSAvoidcamera positioning precision
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent merges multiple video streams from cameras positioned at different angles into a single panoramic video stream through image processing and stitching algorithms. This combines the viewing coverage of multiple cameras while eliminating the need for precise physical positioning, as the software processing compensates for various camera placements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary processing system that receives video signals from multiple cameras, performs image stitching and panoramic rendering, and outputs a synthesized panoramic video stream. This intermediary processing layer decouples the relationship between camera physical position and final viewing coverage, allowing flexible installation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple cameras are arranged to provide wide viewing angle, then the viewing experience is improved, but the system complexity and installation difficulty increase

Engineering Contradiction:
Improveviewing angleVSAvoidsystem installation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical approach of precisely positioning multiple cameras to achieve wide viewing coverage with a software-based image processing system. The mechanical positioning system is substituted with digital image stitching and panoramic rendering algorithms that achieve the same viewing angle expansion without complex physical installation requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a universal panoramic video processing system that can accept video inputs from cameras in various positions and configurations. The system performs multiple functions including image alignment, stitching, blending, and panoramic rendering, making it adaptable to different installation scenarios without requiring precise camera placement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If cameras are positioned close to users for high definition capture, then the video quality is improved, but the overlapping phenomenon and positioning precision requirements increase

Engineering Contradiction:
Improvevideo image qualityVSAvoidcamera distance precision
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent converts the harmful overlapping phenomenon that occurs when cameras are positioned close together into a beneficial feature by using the overlapping regions for image blending and stitching. The overlap provides redundant information that improves stitching accuracy and creates seamless panoramic transitions, turning a problem into an advantage.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentEP2469853B1Method and device for processing video image data, system and terminal for video conference
Publication Date: 2016.08.10 HUAWEI DEVICE CO LTD
  • EP2469853B1 patent drawingFigure 1~2
  • EP2469853B1 patent drawingFigure 3~4
  • EP2469853B1 patent drawingFigure 5a~6

AI summary

A method and an apparatus for processing video image data are disclosed in the embodiments of the present invention. The method includes: obtaining multiple channels of correlative video image data and correlative information; combining the multiple channels of correlative video image data into a single channel of panoramic video image data by using the correlative information; and after recombining the panoramic video image data into multiple channels of video image data satisfying a display requirement of multiple display devices, respectively sending each channel of recombined video image data to each display device for display. Meanwhile, a videoconferencing system and a videoconferencing terminal are also disclosed in the embodiments of the present invention. Through a process of processing multiple channels of video image data into a single channel of panoramic video image data, an overlapping phenomenon existing between each channel of video image data can be eliminated. Therefore, an overlapping phenomenon existing in images shot by a camera may be allowed, so that requirements on a position where a camera is placed and a distance between a user and a camera set are lowered.