Video Frame Correction for Retinal Degeneration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for improving binocular vision in individuals with degenerative retinal diseases are limited by the risk of double images, dynamic effects like flicker, and the need for costly hardware, as they rely on the brain's ability to compensate for misalignment and require significant image processing resources, which can lead to loss of fluidity in video streams.

Innovation Solution

A method and system that modify digital video streams by generating distinct streams for each eye, using correction schemes applied to specific portions of video frames based on the eye's reference system, to compensate for visual defects caused by retinal degeneration, thereby improving binocular vision without altering the underlying disease state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image processing is applied to compensate for retinal defects, then visual perception is improved, but video stream fluidity is degraded due to processing resources consumption

Engineering Contradiction:
Improvevisual perception accuracyVSAvoidvideo stream fluidity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent pre-calculates and stores correction maps for different retinal defect conditions before video playback. During video streaming, these pre-computed correction maps are applied through simple lookup and transformation operations rather than performing complex real-time image processing, thus maintaining video fluidity while achieving defect compensation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent divides the video processing into separate correction stages for left and right eyes, applying specific correction maps to each eye's video stream independently. This segmentation allows parallel processing and optimizes resource utilization, preventing fluidity loss while maintaining perception accuracy

Inventive Principle:
Principle #1Segmentation

2Reliability

If correction schemes are applied to video frames, then binocular vision is improved, but device complexity increases due to hardware requirements

Engineering Contradiction:
Improvebinocular vision qualityVSAvoidhardware complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces complex optical correction hardware with software-based digital correction schemes. Correction maps are generated computationally and applied through image processing algorithms, eliminating the need for specialized optical devices while achieving binocular vision improvement

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a universal correction system that can handle multiple types of retinal defects through a single platform. The same hardware infrastructure supports various correction schemes for different defect patterns, reducing overall device complexity while maintaining reliable binocular vision correction

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If real-time image processing is performed to correct visual defects, then visual perception is improved, but double images and flicker effects occur

Engineering Contradiction:
Improvevisual defect correction accuracyVSAvoidimage stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent pre-computes correction maps offline and stores them for runtime application. This eliminates real-time processing delays and variations that cause flicker and double images, ensuring stable and consistent visual correction across the video stream

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses pre-generated correction maps as templates that are applied consistently across video frames. These static correction patterns are copied and applied rather than regenerated for each frame, ensuring image stability while maintaining correction accuracy

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3448346B1Method for modifying at least one frame video of a digital video stream to be displayed on a displaying area and related system
Publication Date: 2020.11.04 CONSIGLIO NAT DELLE RICERCHE
  • EP3448346B1 patent drawingFigure 1
  • EP3448346B1 patent drawingFigure 2
  • EP3448346B1 patent drawingFigure 3

AI summary

The present invention relates to a method for modifying at least one video frame of a digital video stream to be displayed on a display area. Each correction scheme has one or more specific digital filters based on visual defects perceived by a person with respect to a video frame portion, is configured when predetermined conditions are met and reconfigured whenever the origin position of an eye reference system associated with a respective eye is different from the position of the same origin in said predetermined conditions and/ or the orientation of said eye reference system is different from the orientation of the same eye reference system in said predetermined conditions. The generation of a multiview digital video stream, subsequent to the application of the first correction scheme and/or the second correction scheme, and the displaying of said digital video stream by a multiview stereoscopic or stereoscopic video system allow to the two eyes of a person to observe a respective succession of video frames, wherein the content of the video frames of each sequence of video frames has been modified on the basis of visual defects of a respective eye of said subject suffering from a degenerative disease of the retina, so that said subject has a visual perception, in binocular vision, improved or corrected.