Blending QR Codes into Video Frames via Local Color Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

QR codes within static or video backgrounds often disrupt the visual experience due to contrast, making them attention-drawing and difficult to integrate seamlessly, especially in dynamic environments like videos.

Innovation Solution

A system and method for generating customized QR codes that blend with the pixels and patterns of video frames, allowing dynamic changes in appearance while maintaining scannability and encoding a user-defined message, by manipulating bits, masks, and error correction bits to match the visual properties of the surrounding image or video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a standard QR code is placed within a video frame, then the encoded message can be read and decoded, but the QR code creates visual disruption and draws attention away from the background image

Engineering Contradiction:
ImproveQR code scannabilityVSAvoidvisual disruption
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by making different parts of the QR code have different visual characteristics. The QR code modules are individually customized to match the local visual properties (color, brightness, texture) of the background image or video frame at each module's location, allowing the QR code to blend seamlessly with the background while maintaining its structured pattern for scannability

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the visual parameters (color, brightness, saturation, texture) of individual QR code modules to match the corresponding background pixels. This parameter customization allows the QR code to adapt its appearance to the background while preserving the underlying pattern structure needed for decoding, resolving the contradiction between visual blending and scannability

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If a static QR code is used in a video with changing scenes, then the QR code structure remains simple, but the QR code fails to blend seamlessly with changing visual backgrounds

Engineering Contradiction:
ImproveQR code structureVSAvoidvisual blending
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics by making the QR code visually adaptive to changing video frames. While the underlying module structure remains static for scannability, the visual parameters (color, brightness, texture) of each module are dynamically customized to match the corresponding background pixels in each video frame, allowing seamless blending with changing scenes

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies preliminary action by pre-customizing the visual parameters of QR code modules based on the background image or video frame before final rendering. The system analyzes the background pixels at each module location and adjusts the module's visual properties in advance, ensuring the QR code is ready to blend seamlessly with the background while maintaining its structured pattern

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11064149B1Blended integration of quick response codes into images and video
Publication Date: 2021.07.13 THE NAT INST FOR RES & DEV FOR BIOLOGICAL SCI
  • US11064149B1 patent drawing
  • US11064149B1 patent drawing
  • US11064149B1 patent drawing

AI summary

Provided are systems and methods for integrating encoded identifiers (e.g., Quick Response (“QR”) codes) with changing arrangements into different video frames of a video in a manner that blends the encoded identifiers with the pixels, coloring, and/or pattern of the video frames and that allows a particular message to be decoded from each encoded identifier. The blended integration of encoded identifiers may include clustering a first set of images from a video based on an amount of variation in the first set of images, determining visual properties for pixels at a particular location within the first set of images, generating an identifier as a two-dimensional pattern with different colored blocks that encode a particular message using coloring that is derived from the visual properties for the pixels at the particular location, and integrating the identifier into the first set of images at the particular location.