Multi-Camera 3D Model Restoration via Time-Synchronized Image Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional model restoration technologies face challenges in achieving high accuracy, particularly when dealing with moving subjects and non-synchronous imaging, as they struggle to correlate images effectively due to timing and spatial deviations between camera viewpoints.

Innovation Solution

The method involves acquiring images from multiple imaging devices, synchronizing their clock times to create an image set where exposure times overlap, allowing for the selection of images taken at identical or closely matched clock times, which are then used to calculate three-dimensional information and restore a high-accuracy three-dimensional model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If images are acquired from multiple imaging devices without strict time synchronization, then the quantity of images available for processing increases, but the measurement precision of the three-dimensional model restoration deteriorates due to timing deviations between camera viewpoints

Engineering Contradiction:
Improvequantity of imagesVSAvoidaccuracy of three-dimensional model
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing time synchronization calibration among multiple imaging devices before acquiring images for three-dimensional model restoration. The system pre-establishes clock time relationships between devices and selects images with substantially matched imaging clock times, ensuring that timing alignment is resolved in advance rather than during processing, thus maintaining both image quantity and restoration accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the time parameter by introducing imaging clock time information and selecting images based on time matching criteria. By filtering and selecting only those images where imaging clock times are substantially matched, the system transforms the parameter set to include time-synchronized images, thereby resolving the contradiction between using multiple images and maintaining measurement precision

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If images from non-synchronous imaging are used, then the adaptability of the system to different imaging scenarios increases, but the manufacturing precision of the three-dimensional model restoration deteriorates due to spatial deviations between camera viewpoints

Engineering Contradiction:
Improveadaptability to imaging scenariosVSAvoidaccuracy of three-dimensional model
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-calibrating and establishing time synchronization relationships among multiple imaging devices before actual image acquisition. This preliminary time alignment ensures that even when devices operate independently in different scenarios, their images can be properly correlated, thus maintaining manufacturing precision while preserving adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces imaging clock time information as an intermediary parameter to mediate between images from different imaging devices. By using this time stamp intermediary, the system can correlate images from various devices and scenarios, maintaining both adaptability and precision through the mediating time reference

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If feature point matching and SfM are used to restore three-dimensional models, then the ease of operation increases, but the measurement precision deteriorates because high-accuracy restoration cannot be achieved

Engineering Contradiction:
Improveease of model restorationVSAvoidaccuracy of three-dimensional model
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by pre-selecting images with substantially matched imaging clock times before performing feature point matching and SfM. This preliminary time-based filtering ensures that the input images are temporally aligned, which maintains the ease of operation of feature-based methods while significantly improving the measurement precision of the resulting three-dimensional model

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter set by adding time synchronization criteria to the image selection process. By filtering images based on matched imaging clock times before applying standard SfM algorithms, the system maintains operational simplicity while improving accuracy through parameter refinement

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10277832B2Image processing method and image processing system
Publication Date: 2019.04.30 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US10277832B2 patent drawing
  • US10277832B2 patent drawing
  • US10277832B2 patent drawing

AI summary

An image processing method for processing a plurality of images is provided. The image processing method includes: acquiring a plurality of first images, each of the plurality of first images taken with each of a plurality of imaging devices; acquiring first imaging clock times, each of the first imaging clock times corresponding to each of the plurality of first images; selecting a plurality of second images from the plurality of first images; and generating an image set constructed with the plurality of second images. Each of second imaging clock times correspond to each of the plurality of second images. The second imaging clock times are (i) substantially matched with each other and (ii) included in the first imaging clock times.