Psycho-signal Processing for Retinal Prosthesis Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The limited number of electrodes in retinal prostheses restricts image resolution for patients with photoreceptor degenerative diseases, as each electrode can only produce a single spot of light, resulting in convoluted vision, and increasing electrode density is not viable due to spatial limitations.

Innovation Solution

A software-based psycho-signal processing method that enhances image resolution by applying structured motion operations and super-resolution decomposition processes, utilizing the brain's inherent image-fusion abilities to improve visual perception without the need for hardware modifications, such as the Kalman Filter dynamic super-resolution algorithm to generate composite low-resolution video sequences for mental fusion into high-resolution images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of implanted electrodes is increased to improve image resolution, then the visual acuity is improved, but the device complexity and surgical difficulty increase due to limited space on the prosthesis and patient's eye

Engineering Contradiction:
Improveimage resolutionVSAvoidelectrode array complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates multiple virtual copies of electrode stimulation patterns through temporal modulation and motion-based techniques. By presenting sequences of low-resolution images that are temporally modulated and processed through super-resolution algorithms, the system generates high-resolution visual perception without physically increasing electrode count. The brain fuses these temporal copies to reconstruct detailed images.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from spatial resolution enhancement (adding more electrodes in the spatial domain) to temporal resolution enhancement (adding frames in the temporal domain). By modulating images across time and using the brain's temporal integration capabilities, the system achieves super-resolution without increasing spatial electrode density.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If more electrodes are implanted to improve visual resolution, then the image quality improves, but the surgery time and procedural difficulty increase

Engineering Contradiction:
Improvevisual resolutionVSAvoidsurgery time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system uses temporal copying and repetition of stimulation patterns across multiple frames to achieve high-resolution perception. Instead of implanting more electrodes during surgery, the system presents multiple temporally-modulated versions of the same electrode patterns, allowing the brain to reconstruct detailed images through temporal integration.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the temporal parameters of image presentation (frame rate, modulation frequency, exposure timing) to optimize super-resolution effects. By adjusting these temporal parameters, the system achieves enhanced visual resolution without any surgical modification, thereby avoiding additional surgery time.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the electrode density is increased to improve image resolution, then the visual acuity improves, but the cost and manufacturing complexity increase

Engineering Contradiction:
Improveimage resolutionVSAvoidprosthesis manufacturing
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system generates high-resolution visual output by creating temporal copies and combinations of low-resolution electrode stimulation patterns. Through motion-based super-resolution and temporal modulation, multiple frames are processed to reconstruct detailed images, eliminating the need for expensive high-density electrode arrays.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical approach of increasing physical electrode density with a computational approach using software-based super-resolution algorithms. The system substitutes hardware complexity with processing complexity, using algorithms to generate high-resolution perception from low-resolution physical inputs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If low-resolution images are presented to patients with retinal prostheses, then the device can function with limited electrodes, but the visual perception remains convoluted and low-quality

Engineering Contradiction:
Improvedevice operabilityVSAvoidvisual quality
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies dynamic temporal modulation to static or low-resolution images, creating motion-based sequences that the brain can fuse into high-resolution perceptions. By introducing controlled temporal dynamics and motion patterns, the system transforms low-quality static images into high-quality dynamic visual experiences.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses periodic temporal modulation of image frames, presenting sequences of low-resolution images at specific frequencies that exploit the brain's temporal integration properties. This periodic presentation allows the brain to accumulate and fuse information across cycles, reconstructing high-resolution images from low-resolution inputs.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11399930B2Systems and methods for psycho-signal processing
Publication Date: 2022.08.02 DUKE UNIV
  • US11399930B2 patent drawing
  • US11399930B2 patent drawing
  • US11399930B2 patent drawing

AI summary

Systems and methods for psycho-signal processing. According to an aspect, a method includes receiving a visual representation of a subject. The method also includes performing a structured motion operation on the received visual representation to generate a modified visual representation of the subject. The method further includes presenting, via a user interface, the modified visual representation.