Image Synthesis Boundary Line Avoidance for Priority Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image stitching methods fail to smoothly join images at the boundary line in overlap regions, especially when priority regions such as AR or CGI images are involved, leading to poor blending and image quality.

Innovation Solution

An image synthesis device and method that calculates an overlap region and determines a boundary line avoiding the vicinity of priority regions, allowing for seamless blending based on specific blending methods, ensuring that the boundary line does not overlap with the blend region near priority areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional image stitching methods are used to combine images including priority regions, then the images can be processed automatically, but the boundary line in the overlap region overlaps with the priority region causing poor blending and image quality

Engineering Contradiction:
Improveimage synthesis qualityVSAvoidblending smoothness at boundary line
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the overlap region into multiple parts: a first overlap region that does not overlap with the priority region, and a second overlap region that overlaps with the priority region. Different blending operations are applied to each segment, allowing the boundary line to be positioned optimally in the first overlap region while avoiding disruption to the priority region display.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different blending methods to different regions within the overlap area. The first blend operation is applied to the first overlap region (away from priority region) while the second blend operation is applied to the second overlap region (containing priority region), ensuring each region receives appropriate processing quality.

Inventive Principle:
Principle #3Local quality

2Productivity

If the boundary line is determined without considering priority regions, then the processing is simple and fast, but the blend region overlaps with priority regions causing poor image quality

Engineering Contradiction:
Improveimage processing efficiencyVSAvoidboundary line positioning accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary identification of the priority region's position and size before determining the boundary line. The blend region is determined based on the blending method and the priority region information is used to adjust the boundary line position, ensuring accurate positioning without requiring complex post-processing adjustments.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the boundary line is positioned to avoid priority regions, then blending quality improves, but the complexity of boundary line determination increases

Engineering Contradiction:
Improveblending quality in overlap regionVSAvoidboundary line determination complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs a dynamic approach where the boundary line position is determined based on the relative positions of the priority region and the overlap region. The system adaptively adjusts the boundary line location according to the specific configuration of images and priority regions, rather than using a fixed rule, thereby managing complexity while maintaining high blending quality.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230325971A1Image synthesis device, image synthesis method, and storage medium storing program
Publication Date: 2023.10.12 MITSUBISHI ELECTRIC CORP
  • US20230325971A1 patent drawing
  • US20230325971A1 patent drawing
  • US20230325971A1 patent drawing

AI summary

An image synthesis device includes processing circuitry to acquire a plurality of images captured from different viewpoints and to select images adjoining each other from the plurality of images; to calculate an overlap region as a region where the adjoining images overlap with each other; to determine a boundary line between images in the overlap region; and to execute blending of images in the overlap region. When at least one of the adjoining images includes a priority region, the processing circuitry determines the boundary line that does not overlap with a blend region in a vicinity of the priority region as a region determined depending on a blending method used for blending of an image of the priority region, and the processing circuitry executes the blending of the images in the overlap region based on the boundary line.