Rolling-Shutter Camera Coded Light Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Detecting coded light using a rolling-shutter camera is hindered by the need for a large number of frames to capture a complete message, especially when the camera's frame rate is synchronized with the message repetition rate, leading to non-rolling or slow rolling behavior, resulting in inefficient data retrieval.

Innovation Solution

Employing multiple cameras with different acquisition regimes, such as varying frame rates or orientations, to optimize the capture of coded light messages by selecting the camera that requires the fewest frames to acquire the complete message, thereby improving detection speed and robustness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single rolling-shutter camera is used to detect coded light, then the device complexity is low, but the number of frames required to capture the complete message increases significantly

Engineering Contradiction:
Improvecamera system complexityVSAvoidtime to capture complete message
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent divides the detection task across multiple cameras, where each camera captures a portion of the coded light message. By segmenting the message capture across parallel camera systems, the complete message can be assembled from multiple partial captures, significantly reducing the total time required compared to a single camera capturing the entire message sequentially.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines the output from multiple cameras to reconstruct the complete coded light message. By merging the partial message portions captured by each camera, the system achieves complete message detection faster than a single camera could, while managing the complexity through coordinated processing of multiple data streams.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If the camera frame rate is synchronized with the message repetition rate, then the synchronization is simplified, but the rolling behavior is lost and detection efficiency decreases

Engineering Contradiction:
Improvesynchronization simplicityVSAvoidmessage detection efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent introduces dynamic adjustment of camera frame rates to optimize message capture. Rather than fixed synchronization, the system dynamically varies frame rates across multiple cameras to achieve optimal rolling behavior, allowing each camera to capture different portions of the cyclic message while maintaining overall system coordination.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the frame rate parameter across multiple cameras to different values, creating diverse capture patterns. This parameter variation ensures that cameras operating at different frame rates capture different segments of the cyclic message, improving overall detection efficiency while maintaining synchronization through coordinated parameter selection.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multiple cameras with different acquisition regimes are used, then the detection speed and robustness improve, but the device complexity increases

Engineering Contradiction:
Improvemessage detection speedVSAvoidmulti-camera system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent makes each camera in the multi-camera system perform multiple functions: capturing coded light messages, operating at different frame rates, and contributing to robust message reconstruction. This multi-functionality justifies the increased device complexity by maximizing the utility of each camera component in the system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements feedback mechanisms to coordinate the multiple cameras with different acquisition regimes. By monitoring message capture progress and adjusting camera operations based on detected message portions, the system manages the complexity of multiple cameras through intelligent feedback-driven coordination, optimizing detection speed while controlling system complexity.

Inventive Principle:
Principle #23Feedback

4Reliability

If a larger number of frames are captured to ensure complete message acquisition, then the message capture reliability increases, but the energy consumption increases

Engineering Contradiction:
Improvemessage capture reliabilityVSAvoidcamera energy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent uses multiple cameras to capture partial portions of the message simultaneously, rather than having a single camera capture excessive frames sequentially. This partial action approach by multiple cameras achieves complete message acquisition with fewer total frames captured, reducing the cumulative energy consumption while maintaining reliability.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent maintains continuous useful action across multiple cameras operating in parallel, ensuring that message capture is ongoing simultaneously from multiple perspectives. This continuous parallel operation achieves reliable message capture more efficiently than sequential frame capture by a single camera, reducing the total time and energy required for reliable detection.

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the speed and reliability of coded light detection by selecting the camera with the best rolling behavior or largest message fragments, reducing the number of frames needed to capture the entire message and improving energy efficiency.

Implementation Method 1

The signal can be detected using any suitable light sensor. This can be either a dedicated photocell (point detector), or a camera comprising an array of photocells (pixels)

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11284011B2Detecting coded light with rolling-shutter cameras
Publication Date: 2022.03.22 SIGNIFY HOLDING BV
  • US11284011B2 patent drawing
  • US11284011B2 patent drawing
  • US11284011B2 patent drawing

AI summary

A method, program and apparatus for detecting a repeating coded light message embedded in light emitted by a light source, based on images captured from rolling-shutter cameras which capture their frame areas line-but-line. Images of the light source are captured simultaneously using a plurality of different rolling-shutter cameras having different acquisition regimes in order to improve the robustness and/or speed of coded light detection. The different acquisition regimes may comprise different frame rates, different physical orientations, or different line-readout directions.