RAW Still Image Extraction from Moving Video with Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods fail to appropriately handle differences in properties between RAW still images extracted from RAW moving images and normally processed RAW still images, leading to redundant processing such as white balance application.

Innovation Solution

An image processing apparatus and method that records RAW data with applied image processing as a RAW moving image file and records extracted frames as RAW still image files without applying predetermined image processing, including information about applied processing in the file headers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If similar development processing is executed with respect to RAW still images extracted from RAW moving images and normal RAW still images, then processing consistency is maintained, but redundant processing occurs leading to wasted time and resources

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidredundant processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by recording metadata information about applied image processing (such as white balance) in the RAW file headers before extraction. This allows the extraction process to preemptively identify and skip redundant processing steps, avoiding the need to reapply white balance or other processing that has already been performed on the RAW moving image data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of applying development processing to all RAW still images uniformly and then checking for redundancy, the patent inverts the approach by first checking the file header metadata to determine what processing has already been applied, and only then deciding whether to perform additional development processing. This reversal eliminates redundant operations before they occur.

Inventive Principle:
Principle #13The other way round (Inversion)

2Manufacturing precision

If development processing is applied to RAW still images extracted from RAW moving images, then image quality is improved, but processing time increases due to redundant operations

Engineering Contradiction:
Improveimage processing qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the RAW file header metadata to determine what image processing has already been applied. This preliminary action enables the system to skip redundant processing steps while still applying necessary development processing, thereby maintaining image quality without the time penalty of redundant operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter of processing decision-making from a uniform approach (apply processing to all RAW still images) to a conditional approach (apply processing only when not already applied). This is achieved by reading and interpreting metadata parameters in the file header that indicate the processing state of the extracted frame.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If RAW data is recorded with predetermined image processing applied for RAW moving images, then handleability is improved, but properties differ from normal RAW still images causing processing inconsistencies

Engineering Contradiction:
Improvedata handleabilityVSAvoidprocessing adaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal RAW file format that can accommodate both RAW moving images with applied processing and normal RAW still images without processing. The file header metadata serves as a multi-functional element that indicates the processing state, allowing the same file structure to handle different types of RAW data appropriately.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses feedback from the file header metadata to adapt the processing workflow. By reading the metadata that indicates what processing has been applied, the system can adjust its behavior accordingly, ensuring consistent and appropriate processing for both RAW moving images and normal RAW still images.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11330140B2Image processing apparatus and image processing method
Publication Date: 2022.05.10 CANON KK
  • US11330140B2 patent drawing
  • US11330140B2 patent drawing
  • US11330140B2 patent drawing

AI summary

An image processing apparatus, comprises a recording control unit configured to perform control to, when extracting a frame from a RAW file in which RAW data of a plurality of frames is recorded and recording the extracted frame as a RAW still image file, record RAW data of the extracted frame and information indicating that predetermined image processing has been applied to the RAW data into the RAW still image file.