Image Sensor Bright Line Demodulation for Low-Performance Device Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for communication between devices, especially those with low computational performance, are limited to devices with three color light sources, restricting their ability to communicate effectively.

Innovation Solution

An information communication method that uses an image sensor to capture bright line images by setting exposure times such that multiple bright lines appear based on luminance changes, allowing data demodulation from the pattern of these lines, with exposure starting sequentially for each line after a predetermined blank time from the previous line's exposure end.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional communication methods are used with limited optical spatial transmission devices, then communication is restricted to devices with three color light sources, but this limits adaptability to various devices including those with low computational performance

Engineering Contradiction:
Improvedevice compatibilityVSAvoidlight source requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent changes the parameter of light source configuration from requiring three specific color light sources to using a single white light source with temporal modulation. By varying the exposure time parameters and creating sequential bright lines through temporal changes rather than spatial color differentiation, the system achieves broad device compatibility without complex light source requirements

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent transitions from spatial differentiation (three color light sources) to temporal differentiation (sequential exposure lines in time). By encoding information in the temporal dimension through sequential exposure lines captured in a single image, the system eliminates the need for multiple color light sources while maintaining communication capability across diverse devices

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If exposure time is set to capture multiple bright lines corresponding to luminance changes, then data can be demodulated from the pattern of bright lines, but exposure must start sequentially for each line after a predetermined blank time

Engineering Contradiction:
Improvedata transmission accuracyVSAvoidexposure time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent employs periodic action by creating sequential exposure lines through repeated exposure cycles with predetermined blank times between them. Each exposure line corresponds to a specific time period of luminance change, and the periodic repetition of exposure and blank intervals enables reliable temporal encoding of data while maintaining continuous image capture

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies preliminary action by pre-setting the exposure time parameters and blank time intervals before capturing the image. The exposure lines are predetermined in their temporal positions, allowing the image sensor to capture multiple time-stamped luminance states in a single exposure frame without requiring real-time processing decisions

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables communication between various devices, including those with low computational performance, by effectively demodulating data from the pattern of bright lines in the captured images, facilitating efficient information transfer.

Implementation Method 1

setting a first exposure time of an image sensor so that, in an image obtained by capturing the subject by the image sensor, a plurality of bright lines corresponding to a plurality of exposure lines included in the image sensor appear according to a change in luminance of the subject

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10334177B2Information communication apparatus, method, and recording medium using switchable normal mode and visible light communication mode
Publication Date: 2019.06.25 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US10334177B2 patent drawing
  • US10334177B2 patent drawing
  • US10334177B2 patent drawing

AI summary

A method is provided that includes obtaining a first image by image capture with a first exposure time, and obtaining a second image, including a plurality of bright lines, by capturing a subject changing in luminance with a second exposure. The method also includes obtaining information by demodulating data specified by a pattern of the plurality of bright lines included in the obtained second image, and sending the information to a server. The method further includes obtaining augmented reality information related to the information from the server, and displaying the first image of the display a second time, instead of displaying the second image, when the image sensor receives the first image followed by the second image, wherein the augmented reality information is superposed in both (i) the first image that is displayed at a first time, and (ii) the first image that is displayed at a second time.