Image Synthesis Using Position Difference Amounts for Moving Image Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to effectively synthesize moving images with important regions that appear at different times in multiple frames, as they are not adapted to handle positional changes of these regions across frames.
Innovation Solution
An information processing device that calculates indices for selecting important regions in images, calculates position difference amounts between frames, generates deformation images based on these differences, and synthesizes new images using both the original and deformation images to adapt to positional changes of important regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image synthesis is performed using important regions from multiple moving images, then the visibility and utility of the synthesized image is improved, but the complexity of handling positional changes of important regions across frames increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating position difference amounts between frames before performing image synthesis. The system calculates the displacement of important regions between consecutive frames in advance, stores this information, and uses it during the synthesis process to properly align and combine images with scattered important regions, thereby reducing the complexity of real-time positional adjustment.
Solution Approach 2:
The patent introduces an intermediary element - a position difference amount calculation mechanism - that mediates between the raw moving images and the final synthesized image. This intermediary calculates and compensates for positional changes, allowing the synthesis process to handle scattered important regions effectively without directly managing the complexity of positional variations across frames.
2Adaptability or versatility
If multiple moving images with different properties are used for monitoring, then the comprehensiveness of monitoring is improved, but the difficulty of simultaneous monitoring increases
Solution Approach 1:
The patent applies merging by combining multiple moving images with different properties (visible light, infrared, etc.) into a single synthesized image that contains important regions from all source images. This merging process allows comprehensive monitoring information to be integrated into one view, making it easy to monitor all targets simultaneously without the need to switch between multiple separate image streams.
Solution Approach 2:
The patent applies local quality by selectively extracting and combining important regions from different moving images based on their respective advantages. Each image source contributes its most suitable regions (e.g., visible light for daytime, infrared for nighttime) to the synthesized image, creating a composite that optimally utilizes the local strengths of each imaging modality.
3Measurement precision
If image synthesis adapts to positional changes of important regions across frames, then the accuracy of synthesized image is improved, but the processing time increases
Solution Approach 1:
The patent reduces processing time by performing preliminary calculations of position difference amounts between frames before the actual image synthesis. By pre-computing the displacement information and storing it for later use, the system avoids time-consuming real-time calculations during the synthesis process, thereby maintaining high accuracy while reducing overall processing time.
Solution Approach 2:
The patent applies dynamics by creating a dynamic adaptation mechanism that automatically adjusts for positional changes of important regions across frames. The system dynamically calculates position differences and uses this information to accurately align and synthesize images, maintaining high accuracy even as objects move between frames without requiring excessive processing time.
Data Source
AI summary
An information processing device according to the present invention includes: a memory; and a processor. The processor performs operations. The operations includes: calculating an index for selecting a predetermined region in a pixel of an image; calculating a position difference amount between a first image at a first time among moving images having different properties, and a first synthetic image at a second time being a time previous to the first time; generating a second synthetic image by deforming the first synthetic image, based on the position difference amount; generating first information indicating a first region where a first index in the first image satisfies a predetermined condition, and a second region where a second index in the second synthetic image satisfies a predetermined condition; and synthesizing a third synthetic image at the first time, based on the first image, the second synthetic image, and the first information.