Video Tone Mapping via Pre-computed Color Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The disparity in visual quality between images and corresponding video frames due to incomplete post-capture processing during video capture leads to a less than desirable user experience when displaying both simultaneously.

Innovation Solution

Generating a color map that corrects for quality differences between images and video frames, allowing for independent color and tone correction of video frames, which can be stored or displayed later.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If post-capture processing is performed on images but not on video frames, then image visual quality is improved, but visual consistency between images and video frames deteriorates

Engineering Contradiction:
Improveimage visual qualityVSAvoidvisual consistency
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary action by generating a color map from the processed image before video playback, and storing it for later application. This allows the video frames to be corrected in advance using the pre-computed color map, ensuring visual consistency without requiring real-time processing during video capture or playback.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a color map as an intermediary element that bridges the processed image and the video frames. The color map contains color and tone correction data derived from the image, which is then applied to the video frames to achieve visual consistency. This intermediary allows the benefits of image processing to be transferred to video frames without requiring direct processing of the video data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If post-capture processing is performed on video frames, then visual quality is improved, but processing time and device complexity increase

Engineering Contradiction:
Improvevideo frame visual qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts the color and tone correction information from the processed image into a separate color map, which is then applied to video frames. This extraction approach allows the video frames to benefit from the image processing results without requiring the full computational overhead of performing the same complex post-capture processing on each video frame individually.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a copy of the correction data in the form of a color map generated from the processed image. This color map copy is then applied to multiple video frames, avoiding the need to re-process each frame individually. The correction parameters are copied and reused across frames, significantly reducing processing time while maintaining visual quality improvements.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If color and tone correction is applied to video frames, then visual quality is improved, but device complexity increases

Engineering Contradiction:
Improvevideo frame visual qualityVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The color map serves as an intermediary that simplifies the correction process. Instead of implementing complex real-time color and tone correction algorithms for each video frame, the system uses the pre-computed color map as a lookup table or reference, significantly reducing the computational complexity required during video playback while still achieving high visual quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11350068B2Video tone mapping using a sequence of still images
Publication Date: 2022.05.31 GOOGLE LLC
  • US11350068B2 patent drawing
  • US11350068B2 patent drawing
  • US11350068B2 patent drawing

AI summary

Techniques described herein include receiving a first video frame including a first color map, receiving at least one second video frame, receiving a third video frame including a second color map, generating at least one color map based on the first color map and the second color map, associating the at least one third color map with the at least one second frame, the associated at least one second frame being sequentially positioned between the first frame and the second frame, tone correcting the associated at least one second frame based on the at least one generated third color map and color correcting the at least one second frame based on the at least one generated third color map.