Coordinate Transformation Data for 3D Reconstruction Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating three-dimensional data from two-dimensional image data and depth image data often require high-function processing units and struggle to achieve accurate coordinate alignment between different viewpoints, leading to inaccuracies in data generation.

Innovation Solution

An image processing apparatus and method that includes a coordinate transformation data generation unit to convert three-dimensional positions between different coordinate systems, allowing for accurate alignment and transmission of encoded data and coordinate transformation information to facilitate high-accuracy three-dimensional data generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If three-dimensional data is transmitted directly, then high-function processing units are required on the reception side, but this increases device complexity and processing requirements

Engineering Contradiction:
Improvethree-dimensional data accuracyVSAvoidprocessing unit function
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the coordinate transformation data from the three-dimensional data transmission process. Instead of transmitting raw three-dimensional data that requires complex processing, the system transmits two-dimensional image data, depth image data, and coordinate transformation data separately. This allows the reception side to reconstruct three-dimensional data with simpler processing units while maintaining accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the three-dimensional data transmission into multiple components: two-dimensional image data, depth image data, and coordinate transformation data. This segmentation allows each component to be processed and transmitted independently, reducing the complexity requirements for the reception side processing units while preserving the ability to generate accurate three-dimensional data.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If two-dimensional image data and depth image data from multiple cameras are transmitted, then processing on the reception side is facilitated, but three-dimensional coordinate systems at different viewpoints may differ, reducing data generation accuracy

Engineering Contradiction:
Improvereception side processingVSAvoidthree-dimensional data accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces coordinate transformation data as an intermediary element that mediates between the different coordinate systems of multiple cameras. This transformation data enables the reception side to easily process multi-camera data while maintaining three-dimensional accuracy by providing the necessary conversion information between different viewpoint coordinate systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by transmitting coordinate transformation data that describes the relationship between different coordinate systems. This allows the reception side to adjust and align coordinate parameters from multiple cameras, facilitating easy processing while preserving three-dimensional data generation accuracy through proper coordinate system transformation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11290698B2Image processing apparatus and image processing method
Publication Date: 2022.03.29 SONY GROUP CORP
  • US11290698B2 patent drawing
  • US11290698B2 patent drawing
  • US11290698B2 patent drawing

AI summary

There is provided an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data. A coordinate transformation data generation unit generates, on the basis of two-dimensional image data of a first viewpoint group and two-dimensional image data of a second viewpoint group, coordinate transformation data for converting a three-dimensional position in a first three-dimensional coordinate system of the first viewpoint group into a three-dimensional position in a second three-dimensional coordinate system of the second viewpoint group. A metadata addition unit transmits coordinate transformation information including encoded data of the two-dimensional image data of the first viewpoint group and depth image data, encoded data of the two-dimensional image data and depth image data of the second viewpoint group and coordinate transformation data generated by the coordinate transformation data generation unit.