3D Sensor-to-Screen Image Mapping for High-Definition Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies struggle to create high-definition images on screens by accurately integrating three-dimensional distance-measuring sensor data with imaging apparatus data, particularly when the sampling resolutions differ, leading to inconsistencies and reduced image quality.

Innovation Solution

An image processing device and method that utilizes a processor to convert three-dimensional coordinates from a distance-measuring sensor into two-dimensional coordinates of an imaging apparatus, allowing for precise pixel assignment on a screen through interpolation, using a positional relationship between the sensors to enhance image definition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If three-dimensional distance-measuring sensor data is integrated with imaging apparatus data having different sampling resolutions, then image quality and consistency are improved, but coordinate conversion accuracy and processing complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the coordinate conversion process into distinct modules: acquiring positional relationships between sensors, converting three-dimensional coordinates to two-dimensional coordinates, and assigning pixels to screen positions. This modular segmentation reduces processing complexity by making each step independent and manageable while maintaining overall image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary coordinate system as a bridge between the three-dimensional distance-measuring sensor data and the two-dimensional imaging apparatus data. This intermediary system facilitates accurate integration by providing a common reference frame, thereby improving image quality without excessively increasing processing complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If three-dimensional coordinates are converted into two-dimensional coordinates through interpolation, then image definition is enhanced, but processing time and computational load increase

Engineering Contradiction:
Improveimage definitionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary coordinate conversion by pre-establishing the positional relationships between sensors and pre-converting three-dimensional coordinates to two-dimensional coordinates before final image rendering. This preliminary action reduces processing time during actual operation while maintaining high image definition through accurate interpolation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter representation from three-dimensional coordinates to two-dimensional coordinates through interpolation. By transforming the coordinate system parameters and using efficient interpolation algorithms, the patent enhances image definition while controlling computational load and processing time.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12561892B2Image processing device, image processing method, and program, for high-definition creation of an image on a screen
Publication Date: 2026.02.24 FUJIFILM CORP
  • US12561892B2 patent drawing
  • US12561892B2 patent drawing
  • US12561892B2 patent drawing

AI summary

A processor of an image processing device is configured to: acquire three-dimensional coordinates of a three-dimensional distance-measuring sensor system defined in a three-dimensional coordinate system applied to a three-dimensional distance-measuring sensor, the three-dimensional coordinates of the three-dimensional distance-measuring sensor system being capable of specifying positions of a plurality of measurement points; acquire three-dimensional coordinates of an imaging apparatus system, on the basis of the three-dimensional coordinates of the three-dimensional distance-measuring sensor system; convert the three-dimensional coordinates of the imaging apparatus system into two-dimensional coordinates of the imaging apparatus system, which are capable of specifying a position in a captured image; convert the three-dimensional coordinates of the imaging apparatus system into two-dimensional coordinates of a display system, which are capable of specifying a position on a screen; and assign a pixel constituting the captured image to an interpolation position specified through an interpolating method using the two-dimensional coordinates of the imaging apparatus system and the two-dimensional coordinates of the display system, on the screen.