Coded Light Metadata for Image Privacy Blurring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing techniques for street viewing services are inefficient and error-prone in blurring license plates and faces, and manual processing is costly and non-compliant with regulations, while citizens demand greater privacy protection.

Innovation Solution

An image processing device that uses coded light to embed metadata in images, allowing for automatic detection and application of effects such as blurring or overlaying information in composite images, based on spatial relationships and metadata, reducing the need for additional sensors and improving user control and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated image processing tools are used to blur license plates and faces, then processing efficiency is improved, but accuracy and compliance with privacy regulations deteriorate due to false positives and negatives

Engineering Contradiction:
Improveimage processing efficiencyVSAvoidprivacy protection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces a light source with an embedded signal as an intermediary between the image capturing device and the processing system. This signal carries metadata that directly indicates which regions require privacy protection, eliminating the need for automated detection algorithms and their associated false positives/negatives. The intermediary signal provides ground-truth information that bridges the gap between efficiency and accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary action by embedding privacy protection instructions in light signals before the images are captured. The metadata is prepared in advance and attached to the light source, so when the image is taken, the processing device already knows exactly which regions need blurring without having to analyze or detect them during or after image capture.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If manual processing of user requests is performed to censor images, then privacy protection accuracy is improved, but processing cost and time increase significantly

Engineering Contradiction:
Improveprivacy protection accuracyVSAvoidprocessing throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system implements self-service by automatically processing images based on the embedded metadata signals. The light source carries instructions that enable the processing device to autonomously identify and blur appropriate regions without human intervention. This maintains the accuracy benefits of manual review while achieving the throughput of automated processing.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If additional sensors are used to detect metadata and spatial relationships, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvespatial relationship detection accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies universality by using a single image capturing device to perform multiple functions: capturing the image scene and detecting the embedded light signal metadata. The same sensor array that captures visual information also detects the modulated light signal containing privacy instructions, eliminating the need for separate dedicated sensors and reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the image capture function and the metadata detection function into a single integrated process. The image capturing device simultaneously records both the visual scene and the embedded light signal, combining what would traditionally require separate sensing systems into one unified operation.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances data processing efficiency, reduces errors, and provides greater user control over privacy settings, while minimizing RF pollution and image resolution requirements, allowing for more effective compliance with privacy regulations and user demands.

Implementation Method 1

detecting an embedded signal having been embedded in light illuminating a first region of the physical space upon capture of the first image, the embedded signal conveying metadata relating to at least part of the physical space

Methodology Applied
Scientific EffectCoded light:

Data Source

PatentEP3289572B1Metadata in multi image scenes
Publication Date: 2019.06.26 SIGNIFY HOLDING BV
  • EP3289572B1 patent drawingFigure 1
  • EP3289572B1 patent drawingFigure 2~3
  • EP3289572B1 patent drawingFigure 4~5

AI summary

A spatial relationship is determined between a first image of a first region of a physical space, and a second image of a second region of that space; and the first and second images are thereby stitched together into a composite image comprising first and second areas derived from the first and second images respectively. Further, there is detected an embedded signal having been embedded in light illuminating at least part of the first region of the physical space upon capture of the first image, the embedded signal conveying metadata relating to at least part of the physical space. An effect is applied to at least part of the first area of the composite image based on the detected metadata; and also, based on the detected metadata and on the determined spatial relationship between the first and second images, the effect is applied to at least part of the second area of the composite image that extends beyond the first area.