Projection Distortion Correction Using Any Camera

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies for correcting projection image distortion rely on specific camera models and calibrated devices, limiting their applicability to any image capturing device and position.

Innovation Solution

An information processing device and projection system that detect corresponding points on a projection image and captured images from multiple positions, estimate image capturing and projection parameters, generate correction data, and transmit it for geometric correction, allowing any image capturing device to correct distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a specific model of mobile phone or calibrated mobile phone is used to capture images for distortion correction, then the distortion correction can be performed with known camera parameters, but the applicability is limited to specific devices and positions

Engineering Contradiction:

Improvedistortion correction accuracyVSAvoiddevice compatibility

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent estimates camera parameters (focal length, principal point, image capturing position, and image capturing attitude) dynamically for each device and position rather than relying on fixed predetermined values. This allows any image capturing device to be used while maintaining correction accuracy by adapting parameters to the specific situation.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system performs self-calibration by automatically estimating its own camera parameters through capturing images at multiple positions and detecting corresponding points. This eliminates the need for external calibration equipment or predetermined camera parameters, enabling universal device compatibility.

Inventive Principle:

Principle #25Self-service

2Ease of operation

If camera parameters are predetermined for specific mobile phone models, then the correction process is simplified, but the system cannot accommodate any image capturing device or position

Engineering Contradiction:

Improvecorrection process simplicityVSAvoidimage capturing device flexibility

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system automatically estimates camera parameters through self-calibration procedures, eliminating the need for manual parameter input or device-specific configuration. The device performs its own calibration by capturing images at multiple positions and computing parameters algorithmically.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent creates a universal distortion correction system that works with any image capturing device by estimating parameters specific to each device and position. The same correction algorithm can be applied regardless of device type, making the system multi-functional and broadly applicable.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Productivity

If distortion correction is performed using a single image capturing position, then the process is faster and simpler, but the correction accuracy is insufficient for complex projection surfaces

Engineering Contradiction:

Improvecorrection processing speedVSAvoiddistortion correction accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent divides the calibration process into multiple stages by capturing images at multiple different positions. Each position provides complementary information about the projection surface and camera parameters, and the results are integrated to achieve comprehensive and accurate distortion correction.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system uses corresponding point detection between captured images and projected images to provide feedback on parameter estimation accuracy. This feedback loop allows the system to iteratively refine parameter estimates and improve correction accuracy based on actual observation results.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12167180B2Information processing device, information processing method, program, projection device, and information processing system

Publication Date: 2024.12.10 SONY GROUP CORP

AI summary

There is provided an information processing device, an information processing method, a program, a projection device, and an information processing system capable of correcting distortion of a projection image by use of any image capturing device. The information processing device detects corresponding points on a projection image and a plurality of captured images on the basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions, estimates image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on the basis of corresponding point information indicating a relationship between the corresponding points, generates correction data used for geometric correction of an input image on the basis of the corresponding point information, the image capturing parameters, and the projection parameters, and transmits the correction data. The present technology can be applied to an information processing device that controls projection of a projector.