Image Processing for Subject Distance Metadata in CG Combining
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing technologies fail to provide accurate subject distance information necessary for combining real images with computer graphics (CG) during real-time video production, as the subject distance used in these technologies is different from the distance recognized by users and cannot be directly applied for CG integration.
Innovation Solution
An image capturing apparatus and processing method that generate first and second subject distance information based on entrance pupil position and focus position, allowing for accurate CG combining processing by calculating and associating metadata with captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If subject distance is defined as distance from entrance pupil position to in-focus subject, then focusing accuracy is improved, but usability for CG combining deteriorates
Solution Approach 1:
The patent introduces an intermediary conversion process that transforms the technical subject distance (from entrance pupil) into user-friendly subject distance (from imaging plane). The imaging plane serves as the mediator between the optical measurement point and the user's conceptual understanding, enabling both precise focusing and intuitive CG combining operations.
Solution Approach 2:
The patent changes the reference parameter for subject distance from entrance pupil position to imaging plane position. This parameter transformation maintains the optical accuracy needed for focusing while aligning with the user's mental model for CG combining, effectively resolving the contradiction between measurement precision and ease of operation.
2Extent of automation
If subject distance is measured by automatic focusing mechanism, then focusing automation is improved, but applicability for CG combining deteriorates
Solution Approach 1:
The imaging plane acts as an intermediary that bridges the automatic focusing mechanism's measurement (from entrance pupil) and the CG combining requirements (distance from imaging plane). This mediator enables automated focusing to remain automated while making its output applicable for CG combining through coordinate transformation.
Solution Approach 2:
The patent makes the subject distance measurement system universal by enabling it to serve dual purposes: automated focusing control and CG combining metadata generation. Through the imaging plane reference transformation, the same measurement system supports both automated operation and versatile application in post-production workflows.
3Productivity
If real-time CG combining is implemented, then video production efficiency is improved, but image combining accuracy deteriorates
Solution Approach 1:
The patent performs preliminary calculation of the subject distance from imaging plane based on entrance pupil distance and optical parameters before the CG combining process. By pre-computing the corrected distance metadata and embedding it in the video stream, the system enables real-time CG combining without sacrificing accuracy, as the transformation is already completed in advance.
Solution Approach 2:
The patent creates a copied and transformed version of the subject distance measurement that references the imaging plane instead of the entrance pupil. This copied distance metric maintains all the accuracy benefits of precise optical measurement while being in the correct coordinate system for real-time CG combining operations.
Data Source
AI summary
An image processing apparatus includes an acquisition unit for acquiring an image obtained by an image capturing apparatus including an image sensor for capturing a light beam from a subject through an optical lens, and a generation unit for generating first subject distance information indicating a distance from the image capturing apparatus to the subject based on information corresponding to an entrance pupil position of the optical lens used to capture the image, a focus position, and second subject distance information indicating a distance from the image sensor to the subject.