Image Processing With Target Overlays for Camera Parameter Verification

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Camera parameters often fail to accurately represent the position and attitude of a camera, leading to errors in calculations, such as the height of individuals in monitored videos, due to input errors, lens distortion, and changes in camera position over time.

Innovation Solution

An image processing device that allows users to superimpose a target object with predetermined shape and size onto a captured image based on camera parameters, enabling verification of the accuracy of these parameters by comparing the superimposed image with the actual image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If camera parameters are obtained through calibration or previously estimated values, then the process is simple and quick, but the accuracy and reliability of position and attitude indication deteriorate due to input errors, lens distortion, and camera position changes over time

Engineering Contradiction:

Improvespeed of obtaining camera parametersVSAvoidaccuracy of camera parameters

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The system performs feedback by comparing the generated image (based on camera parameters) with the actual captured image to detect discrepancies. This feedback loop allows the system to identify when camera parameters have become inaccurate due to position changes or distortion, enabling corrective actions to be taken to restore parameter accuracy.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary verification process using generated images as a mediator between the camera parameters and the actual captured image. This intermediary allows indirect verification of parameter accuracy without requiring direct measurement, enabling detection of parameter degradation through comparison of the generated representation with the actual scene.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If camera parameters are not verified, then the system operates continuously without interruption, but calculation errors occur in derived measurements such as height of individuals in monitored videos

Engineering Contradiction:

Improvecontinuous operation of monitoring systemVSAvoidaccuracy of calculation results

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system performs preliminary verification by generating an image based on current camera parameters and comparing it with the actual captured image before proceeding with critical measurements. This preliminary check ensures that parameters are still accurate, preventing propagation of errors into subsequent calculations of object dimensions and positions.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The comparison between generated and actual images provides continuous feedback on parameter validity. When discrepancies are detected, the system can trigger parameter recalibration or correction, ensuring that subsequent measurements maintain high reliability even during continuous operation over extended periods.

Inventive Principle:

Principle #23Feedback

3Measurement precision

If calibration is performed frequently to maintain accuracy, then measurement precision improves, but loss of time and operational interruption increase

Engineering Contradiction:

Improveaccuracy of camera parametersVSAvoidtime lost to calibration operations

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system maintains continuous verification of camera parameter accuracy by performing rapid generation and comparison of images without requiring full calibration procedures. This continuous lightweight verification replaces periodic lengthy calibration operations, maintaining measurement precision while minimizing operational interruptions and time loss.

Inventive Principle:

Principle #20Continuity of useful action

Solution Approach 2:

Instead of performing complete calibration procedures frequently, the system applies partial verification through image generation and comparison. This partial action is sufficient to detect parameter degradation and trigger full calibration only when necessary, reducing the frequency and duration of calibration operations while maintaining adequate accuracy.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS12363255B2Image processing device, image processing method, and recording medium

Publication Date: 2025.07.15 NEC CORP

AI summary

An image processing device (3000) comprises an input unit (3020) and a presentation unit (3040). The input unit (3020) accepts an input of an operation for movement, on a captured image captured by a camera, of a first image which is superimposed on the captured image on the basis of a predetermined camera parameter indicating the position and attitude of the camera and which indicates a target object having a predetermined shape and a predetermined size set in a real space. The presentation unit (3040) presents the first image indicating the target object in a manner of view corresponding to a position on the captured image after the movement on the basis of the camera parameter.