Pupil Tracking Image Processing for Retinoscopy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing pupil tracking methods in retinoscopy optometry face challenges in accurately tracking pupils, especially in infants and individuals with poor coordination, due to issues like image smearing and blurred edges caused by pupil movement, which affect the accuracy of refractive state determination.

Innovation Solution

A method involving the acquisition of multiple eye images, processing each to identify and track the pupil using Blob analysis, gray normalization, multi-scale binarization, and a support vector machine (SVM) to determine the pupil boundaries, followed by a weighted least square method to fit a circle, enhancing image processing efficiency and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional pupil tracking methods are used, then the system is simple to operate, but the measurement precision deteriorates due to image smearing and blurred edges caused by pupil movement

Engineering Contradiction:
Improvepupil positioning accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The pupil detection process is divided into multiple sequential steps: initial bright spot detection, Blob analysis for potential pupil area identification, gray normalization, multi-scale binarization, and final circle fitting. This segmentation allows each step to focus on specific features, improving overall measurement precision while managing complexity through modular processing

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method performs preliminary actions by first detecting bright spots and performing Blob analysis to identify potential pupil areas before conducting the main circle fitting operation. Gray normalization and multi-scale binarization are applied in advance to enhance image quality, making the final pupil edge detection more accurate and robust against motion blur

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple image processing steps are applied, then the measurement precision improves, but the productivity deteriorates due to increased processing time

Engineering Contradiction:
Improvepupil edge detection accuracyVSAvoidimage processing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The method applies multi-scale binarization with different threshold levels to process the image at multiple resolutions. This partial action approach allows the system to focus computational resources on critical regions and scales, achieving high precision pupil edge detection without processing the entire image at maximum detail level, thus balancing accuracy and processing speed

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The processing pipeline dynamically adjusts parameters such as binarization thresholds, circle fitting weights, and detection sensitivity based on image characteristics. By changing these parameters adaptively, the system optimizes the balance between measurement precision and processing efficiency for different imaging conditions and pupil movement scenarios

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If traditional circle fitting methods are used, then the device complexity is low, but the measurement precision deteriorates due to inaccurate pupil boundary determination

Engineering Contradiction:
Improvepupil boundary accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The method introduces intermediary processing steps between image acquisition and final circle fitting, including gray normalization to standardize intensity values, multi-scale binarization to enhance edge contrast, and Blob analysis to identify potential pupil regions. These intermediaries prepare the data for more accurate circle fitting by eliminating noise and enhancing relevant features

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces simple geometric circle fitting with a weighted least squares circle fitting algorithm that incorporates multiple image features and processing results. This substitution of the mechanical fitting process with a more sophisticated algorithmic approach significantly improves pupil boundary accuracy by considering various factors such as image intensity gradients, detected edge points, and potential pupil area constraints

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves image processing efficiency, accurately positions the pupil edge, and provides reliable data for refractive parameter analysis, enabling real-time tracking and analysis even under complex backgrounds.

Implementation Method 1

The instrument uses infrared light source for projecting to the retina, light reflected by the retina presents different patterns under different refraction states, and a camera records the patterns

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a light source array is formed by a near-infrared light-emitting diode, rays of light are emitted to an examined pupil from a certain distance at a specific angle to enter the retina and are reflected by the retina, and during the period, the light rays are emitted from the pupil area after being refracted twice by an eyeball refraction system

Methodology Applied
Scientific EffectLight refraction: Refraction

Data Source

PatentUS11026571B2Method for processing pupil tracking image
Publication Date: 2021.06.08 WENZHOU MEDICAL UNIV
  • US11026571B2 patent drawing
  • US11026571B2 patent drawing
  • US11026571B2 patent drawing

AI summary

A method for processing pupil tracking images, comprising the steps of: 1) acquiring eye images multiple times; 2) processing each acquired eye image, and determining whether a pupil can be positioned in the acquired image; and 3) determining that pupil tracking is completed when the pupil can be positioned in consecutive n pieces of eye images. Image processing efficiency is improved by searching a potential bright spot area and carrying out Blob analysis smearing images caused by pupil movement can be eliminated, the pupil edge is accurately positioned by adopting a line drawing method in collaboration with a support vector machine when determining the pupil edge, and finally a weighted least square method is adopted to fit a circle/ellipse (pupil). Therefore, real-time tracking and analysis of the pupil under a complex background are realized, and reliable data are provided for subsequent steps to obtain the refractive parameters of the eye.