3D Image Size Visualization via Virtual Measurer Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to effectively allow users to understand the size of target objects in real space by accurately correlating three-dimensional images with real-world measurements.

Innovation Solution

An image processing apparatus and method that acquires three-dimensional coordinates and two-dimensional coordinates, generates unit length information based on the distance between imaging positions, and outputs a composite image showing the object and three-dimensional image in a comparable manner, enabling users to visualize the size of target objects in real space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional images are displayed without real-world measurement correlation, then the visualization is simple and quick, but users cannot accurately understand the size of target objects in real space

Engineering Contradiction:
Improvesize measurement accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a virtual measurer as an intermediary element superimposed on the three-dimensional image. This measurer includes scale indicators and measurement markings that bridge the gap between the abstract three-dimensional coordinates and real-world dimensions, enabling users to interpret object sizes without complex measurement tools or procedures

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a virtual copy of the measurer (with known real-world dimensions) and superimposes it onto the three-dimensional image at corresponding spatial positions. By comparing the virtual measurer's scale markings with the target object's appearance in the image, users can accurately determine real-world sizes without requiring direct physical measurement

Inventive Principle:
Principle #26Copying

2Measurement precision

If unit length information is generated based on distance between imaging positions, then real-world size correlation is achieved, but the processing time and computational load increase

Engineering Contradiction:
Improvereal-world measurement accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-calculates and stores unit length information that correlates three-dimensional coordinate distances with real-world distances before the actual measurement process. This pre-computed mapping relationship allows for rapid size determination during image analysis without performing complex real-time calculations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transforms the measurement problem by changing the parameter representation - instead of calculating real-world distances directly from complex geometric relationships, the system uses pre-established parameter mappings between three-dimensional coordinate systems and real-world measurement scales, significantly simplifying the computation

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If three-dimensional coordinates and two-dimensional coordinates are correlated to generate measurable objects, then size understanding is improved, but the device complexity and processing requirements increase

Engineering Contradiction:
Improvesize information completenessVSAvoidcoordinate processing system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the coordinate processing into distinct functional components: (1) acquisition of three-dimensional coordinates from depth information, (2) acquisition of two-dimensional coordinates from image positions, (3) generation of unit length information from spatial relationships, and (4) synthesis of measurable objects with scale indicators. This segmentation allows each component to be optimized independently and simplifies the overall system architecture

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240404183A1Image processing apparatus, image processing method, and program
Publication Date: 2024.12.05 FUJIFILM CORP
  • US20240404183A1 patent drawing
  • US20240404183A1 patent drawing
  • US20240404183A1 patent drawing

AI summary

An image processing apparatus includes a processor, in which the processor is configured to: acquire a plurality of three-dimensional coordinates for specifying positions of a plurality of pixels included in a three-dimensional image showing a target object in a real space, and a plurality of two-dimensional coordinates for specifying positions corresponding to the plurality of pixels in a screen on which the three-dimensional image is rendered; acquire unit length information indicating a relationship between a first unit length of a three-dimensional coordinate system defining the three-dimensional coordinates, and a second unit length of the real space; generate an object of which the second unit length is specifiable, based on the plurality of three-dimensional coordinates, the plurality of two-dimensional coordinates, and the unit length information; and output a first image in which the object and the three-dimensional image are shown in a comparable manner.