Multi-Imager Image Stitching With Dynamic Trim Lines

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When merging two images, a subject may be distorted in the merged portion due to differences in shooting position or direction between the images.

Innovation Solution

An information processing method and apparatus that includes detecting feature points in overlapping areas of multiple images captured by multiple imagers, trimming images along a virtual line based on these points, and merging them to generate a composite image, thereby reducing distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple images are merged to create a composite image, then the coverage area and completeness of the subject is improved, but distortion of the subject in the merged portion occurs due to differences in shooting position or direction

Engineering Contradiction:
Improvecoverage areaVSAvoidsubject distortion
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent divides the composite image into multiple regions corresponding to different original images, and processes each region separately by detecting feature points and determining virtual lines. This segmentation allows precise control of the merging process in each region to minimize distortion while maintaining overall coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts parameters such as virtual line positions and trimming boundaries based on detected feature point locations. By changing these parameters adaptively according to the subject's position in each image, the system reduces distortion in merged portions while preserving the expanded coverage area.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If images are trimmed at fixed positions to reduce distortion, then subject distortion is reduced, but the ability to accommodate subject movement is limited

Engineering Contradiction:
Improvedistortion reductionVSAvoidsubject movement accommodation
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent makes the virtual line positions and trimming boundaries dynamic rather than fixed. By detecting feature points in each image and determining virtual lines based on these detected positions, the system automatically adapts to subject movement across different images, maintaining distortion reduction while accommodating varying subject positions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feature point detection as feedback to determine optimal virtual line positions for trimming. This feedback mechanism allows the system to adjust trimming parameters based on the actual subject position in each image, enabling both distortion reduction and adaptation to subject movement.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If feature point detection and virtual line determination are performed for each image, then distortion reduction precision is improved, but processing complexity increases

Engineering Contradiction:
Improvedistortion reduction precisionVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the processing task by detecting feature points and determining virtual lines for each image separately. This segmentation enables precise distortion control in each region while organizing the complexity into manageable, systematic steps that can be processed independently and then combined.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12462344B2Information processing method and information processing apparatus
Publication Date: 2025.11.04 TOYOTA JIDOSHA KK
  • US12462344B2 patent drawing
  • US12462344B2 patent drawing
  • US12462344B2 patent drawing

AI summary

An information processing method includes, for each of multiple images having an overlapping area, the multiple images being obtained by capturing a subject with respective multiple imagers whose shooting ranges overlap each other in part, detecting a position of a feature point of the subject in the overlapping area, trimming, at a position of a virtual line, an image of each of the multiple images in which the virtual line based on the position of the feature point is included in the overlapping area, and merging the multiple images to generate a single composite image.