Image Pickup Device Local Model Extraction Reduces Communication Load

Solution Overview

Problem

Generating a three-dimensional shape of an object from multiple images taken by imaging devices requires transferring all images to a computer, leading to increased communication load between imaging devices and the computer.

Innovation Solution

The imaging device processes images locally to extract model information, including shape and texture data, and transmits only this processed information to the information processing device, reducing the need to transfer raw image data and thereby decreasing communication load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all images are transferred from imaging devices to computer, then complete image data is available for processing, but communication load increases

Engineering Contradiction:

Improveimage data completenessVSAvoidcommunication load

Core Design Contradiction:

Loss of informationVSLoss of energy

Solution Approach 1:

The patent extracts only the essential model information (shape and texture data) from the complete image data at the imaging device side, and transmits only this extracted information to the computer. This eliminates the need to transfer all raw image data while preserving the necessary information for three-dimensional shape generation, thereby reducing communication load.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The imaging device performs preliminary processing of the captured images to generate model information (shape and texture data) before transmission. By preprocessing the images locally to extract only the essential three-dimensional shape information, the system reduces the data volume that needs to be communicated while ensuring complete information for reconstruction.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If all images are transferred to computer, then accurate three-dimensional shape can be generated, but processing burden on computer increases

Engineering Contradiction:

Improvethree-dimensional shape accuracyVSAvoidprocessing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential model information (shape and texture data) from the complete image data at the imaging device side, and transmits only this extracted information to the computer. This eliminates the need to transfer all raw image data while preserving the necessary information for three-dimensional shape generation, thereby reducing communication load.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The imaging device performs preliminary processing of the captured images to generate model information (shape and texture data) before transmission. By preprocessing the images locally to extract only the essential three-dimensional shape information, the system reduces the data volume that needs to be communicated while ensuring complete information for reconstruction.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentEP3190380B1Image pickup device, information processing device, and image pickup system

Publication Date: 2022.03.23 NIKON CORP

Figure 1
Figure 2
Figure 3A

AI summary

[Problem] To provide an Image pickup device capable of reducing a load of processing. [Solution] This image pickup device is provided with: a main body unit; a detection unit that includes an image pickup unit that picks up an image of a subject, and a distance measuring unit that detects a distance from each point on the surface of the subject; an information calculation unit, which is provided in the main body unit, and calculates, using the detection results obtained from the detection unit, subject shape information and/or subject texture information; and a communication unit that transmits calculation results obtained from the information calculation unit.