Multi-Viewpoint Image Data Recording with Multidimensional Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques for storing image data from multi-viewpoint image capturing devices like camera arrays and plenoptic cameras are limited in their ability to utilize image data for various purposes, such as changing viewpoint positions and adjusting depth of field, as they lack an efficient format for managing and encoding data from different focus positions and viewpoints.

Innovation Solution

A data recording apparatus and method that encodes and stores multi-viewpoint image data in a multidimensional format, allowing for the association of image data from different focus positions and viewpoints with distance data and area division data, enabling more versatile use of captured images, including refocusing and adjusting the depth of field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image data from multiple focus positions and viewpoints is stored using conventional formats, then the file size increases, but the ability to utilize image data for various purposes (refocusing, viewpoint change) is limited

Engineering Contradiction:
Improveability to utilize image data for various purposesVSAvoidfile size
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent divides the image data into separate components: light field data representing multiple viewpoints and focus positions, and view angle mapping data. This segmentation allows the data to be organized in a structured way that enables various purposes (refocusing, viewpoint change) while managing file size through efficient encoding of only the necessary data components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional organization by storing light field data and view angle mapping data separately in a multidimensional structure. This allows the system to represent image data from multiple focus positions and viewpoints without simply creating multiple separate image files, thereby improving versatility while controlling file size growth.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If image data is encoded and compressed to an appropriate amount of information, then storage efficiency improves, but the complexity of managing and accessing data from different focus positions and viewpoints increases

Engineering Contradiction:
Improvestorage efficiencyVSAvoidcomplexity of managing and accessing data
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent creates a universal data structure that serves multiple functions: storing light field data, view angle mapping data, and enabling various processing purposes (refocusing, viewpoint change, depth information extraction). This multi-functional approach improves storage efficiency by consolidating data while managing complexity through a standardized organization scheme.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces view angle mapping data as an intermediary that connects the light field data to specific viewpoints and focus positions. This intermediary structure simplifies the management and access of data by providing a clear mapping relationship, reducing the complexity that would otherwise arise from managing raw multi-viewpoint data directly.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If a format is used to record a plurality of images in the same file, then storage space is saved, but the ability to process and access individual images for specific purposes becomes more difficult

Engineering Contradiction:
Improvestorage spaceVSAvoidease of processing and accessing individual images
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent segments the recorded data into distinct light field data and view angle mapping data sections within a single file. This segmentation maintains space efficiency while improving ease of operation by allowing selective access to specific focus positions and viewpoints through the structured organization, making it easier to process individual images for specific purposes without reading the entire file.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3391640B1Data recording apparatus, image capturing apparatus, data recording method, and storage medium
Publication Date: 2024.09.11 CANON KK
  • EP3391640B1 patent drawingFigure 1A~1B
  • EP3391640B1 patent drawingFigure 2A~2C
  • EP3391640B1 patent drawingFigure 2D~3

AI summary

An input unit configured to input an image data group including at least: image data obtained by performing image capturing at a first focus position from a first viewpoint; image data obtained by performing image capturing at a second focus position different from the first focus position from the first viewpoint; and image data obtained by performing image capturing at the first focus position from a second viewpoint different from the first viewpoint, and a recording unit configured to generate management information that associates each piece of image data of the image data group that is input by the input unit and to record the generated management information and the image data group in a storage medium in accordance with a predetermined format are included.