Motion Parallax Object Recognition in Prosthetic Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current prosthetic visual devices struggle to provide reliable depth cues for object recognition in cluttered environments due to low resolution and lack of vestibular-ocular reflex-like mechanisms, limiting their utility for visually impaired individuals.
Innovation Solution
The system uses motion parallax to stabilize objects of interest at the center of the visual field by dynamically cropping camera images and adjusting the field of view, mimicking natural eye movement to separate objects from background clutter, utilizing depth cameras and processors to guide user head movements and transmit electrical signals to visual prostheses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a head-mounted video camera is used to acquire high-resolution images for prosthetic vision, then image quality is improved, but depth cues and object recognition in cluttered environments deteriorate due to low resolution and lack of motion parallax
Solution Approach 1:
The system dynamically adjusts the field of view and crops images based on detected object motion during head movement. By making the field of view adjustable and responsive to motion parallax cues, the system adapts to different depths and separates foreground objects from background clutter, resolving the contradiction between maintaining high resolution and providing reliable depth information.
Solution Approach 2:
The system segments the image into different depth planes by detecting motion parallax during head movement. Objects at different distances exhibit different motion patterns, allowing the system to separate them into distinct depth layers. This segmentation enables the system to provide reliable depth cues while maintaining high-resolution imaging capability for each segmented plane.
2Ease of operation
If the field of view is fixed to maintain simple device operation, then ease of operation is improved, but object recognition in cluttered environments deteriorates due to inability to stabilize objects of interest
Solution Approach 1:
The system automatically detects head movement and dynamically adjusts the field of view to track and stabilize objects of interest without requiring manual user input. The motion detection and automatic field adjustment occur autonomously, maintaining ease of operation while significantly improving object recognition accuracy through stable viewing of selected objects.
Solution Approach 2:
The system uses motion detection to create feedback that automatically adjusts the field of view. By continuously monitoring head movement and responding with corresponding field adjustments, the system maintains stable viewing of objects of interest. This feedback mechanism preserves operational simplicity while dramatically improving object recognition reliability.
3Reliability
If multiple images are processed to provide depth information, then object recognition is improved, but processing time and system complexity increase
Solution Approach 1:
The system performs preliminary motion detection during head movement to identify objects of interest before requiring detailed processing. By pre-segmenting objects based on motion parallax cues, the system reduces the complexity of subsequent image processing, as only the segmented objects require detailed analysis rather than processing the entire image.
Solution Approach 2:
The system extracts motion parallax information from the images to identify and separate objects of interest from background clutter. By taking out the motion-based depth information, the system simplifies the remaining processing tasks, as the extraction step handles the complex depth separation while subsequent processing can focus on the already-identified objects.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves object recognition by stabilizing objects at the center of the visual field while moving background clutter, enhancing interaction with the environment and reducing interpretation times for visually impaired users.
Implementation Method 1
The imaging system uses motion parallax to provide reliable depth cues for rendering images with a cluttered background for artificial vision
Data Source
AI summary
A system for providing information about an environment to a user within the environment is featured. An electronic processor is configured to receive input including a user selection of an object of interest from among potential objects of interest. The electronic processor is further configured to provide output to guide the user to move the detection apparatus to position the object of interest near a reference point on a field of view of the detection apparatus, obtain multiple images of the object of interest during the user's movement of the detection apparatus, and crop each of the images to keep the object of interest near a reference point on each of the images.