Parallax Image Processing for Lens-Corrected Foreign Matter Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems fail to accurately remove foreign matter from captured images after switching left and right areas due to misalignment of foreign matter coordinates, and this issue is exacerbated by restrictions on processing order in cameras with interchangeable lenses.
Innovation Solution
An information processing apparatus and method that acquires lens information from multiple optical systems, corrects the positions of image areas based on this information, and adjusts foreign matter coordinates accordingly to ensure precise removal of foreign matter after image switching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If foreign matter removal processing is performed before switching left and right areas, then foreign matter can be removed, but processing order restrictions prevent this in some cases
Solution Approach 1:
The patent performs foreign matter detection and coordinate adjustment in advance, before area switching is completed. By detecting foreign matter in the original captured image and pre-adjusting its coordinates based on lens information, the system ensures foreign matter removal can proceed accurately regardless of subsequent area switching operations.
Solution Approach 2:
The patent changes the coordinate parameters of foreign matter information by adjusting them according to lens information. This parameter transformation allows the foreign matter coordinates to remain accurate even when the spatial relationship between optical systems and image areas changes during area switching.
2Reliability
If left and right areas are switched to match positional relationships, then VR content quality improves, but foreign matter coordinates become misaligned
Solution Approach 1:
The patent transforms the coordinate parameters of foreign matter information by multiplying them with lens information (such as focal length ratios). This parameter change compensates for the coordinate system transformation that occurs during area switching, maintaining foreign matter location accuracy in the switched image.
Solution Approach 2:
The patent uses lens information as feedback to adjust foreign matter coordinates. By referencing the known optical characteristics of the lens system, the system can predict and correct coordinate shifts that occur during area switching, ensuring accurate foreign matter removal.
3Ease of operation
If foreign matter removal processing is delayed until after area switching, then processing flexibility is maintained, but foreign matter coordinates are inaccurate
Solution Approach 1:
The patent performs coordinate adjustment of foreign matter information in advance, before area switching is finalized. This preliminary coordinate transformation ensures that when foreign matter removal processing occurs later, the coordinates are already accurate for the switched image configuration.
Solution Approach 2:
The patent pre-adjusts the coordinate parameters of foreign matter by applying lens information transformations. This parameter change prepares the foreign matter data for accurate removal even though the actual removal processing occurs after area switching.
Data Source
AI summary
An information processing apparatus includes: a processor; and a memory storing a program which, when executed by the processor, causes the information processing apparatus to acquire a captured image, acquire lens information on a first optical system and a second optical system in a case where the captured image includes a first area corresponding to a first optical image input via the first optical system, and a second area corresponding to a second optical image having a predetermined parallax with respect to the first optical image and input via the second optical system, acquire foreign matter information indicating one or a plurality of foreign matter areas in the captured image, correct a position of the first area and a position of the second area on a basis of the lens information, and adjust the foreign matter information on a basis of the lens information.