Rolling Shutter Camera Image Correction for Optical Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Rolling shutter cameras capture moving LEDs, resulting in step-shaped distorted images due to on/off image capture on a row basis, necessitating a method to correct the rolling shutter phenomenon and reduce bit error rate (BER) in optical communication systems.

Innovation Solution

An optical communication-based image processing system that uses a rolling shutter camera to capture images of light emitting elements, encodes and transmits data, and applies a pre-trained image correction model to correct distortion areas, allowing for flicker-free data transmission and reduced BER.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a rolling shutter camera is used to capture light emitting elements, then the camera can capture images row by row, but step-shaped distorted images are created when moving LEDs are captured

Engineering Contradiction:
Improverow-based image capture capabilityVSAvoidimage distortion
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-training an image correction model that learns the characteristic distortions of rolling shutter camera captures. The model is trained on distorted images and their corresponding corrected versions, enabling it to automatically correct step-shaped distortions in moving LED captures without requiring complex real-time computational correction algorithms.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If rolling shutter camera captures moving LEDs, then image capture is enabled, but bit error rate increases due to distortion

Engineering Contradiction:
Improveimage capture capabilityVSAvoidbit error rate
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback by using the image correction model to continuously refine the captured images before data decoding. The model receives distorted images from the rolling shutter camera and outputs corrected images that maintain the original spatial relationships, thereby reducing bit error rates during subsequent optical communication data recovery without sacrificing capture productivity.

Inventive Principle:
Principle #23Feedback

3Device complexity

If rolling shutter camera is used, then the system is simpler, but flicker-free environment cannot be provided

Engineering Contradiction:
Improvecamera system simplicityVSAvoidflicker distortion
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent applies copying by creating a corrected image representation that copies the essential information from the distorted rolling shutter capture while eliminating flicker artifacts. The image correction model generates a new image output that preserves the LED on/off state information but removes the step-shaped distortions and flicker effects, effectively providing a flicker-free environment while maintaining system simplicity.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively corrects rolling shutter distortions and provides a flicker-free environment, reducing bit error rates by decoding encoded data based on corrected images, even when the camera moves relative to the light emitting elements.

Implementation Method 1

a rolling shutter camera configured to capture an image of at least one light emitting element, when sensing data collected from at least one measurement sensor is encoded and transmitted through the at least one light emitting element

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11700461B2Method and apparatus for processing image based on optical communication, and computer-readable recording medium with program therefor
Publication Date: 2023.07.11 KOOKMIN UNIV IND ACAD COOP FOUND
  • US11700461B2 patent drawing
  • US11700461B2 patent drawing
  • US11700461B2 patent drawing

AI summary

An optical communication-based image processing system is disclosed. The system may include a transmitter having at least one light emitting element and a receiver having a rolling shutter camera. As the system is provided, a rolling shutter effect may be improved.