Video Magnification for Visually Impaired via ROI Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Visually impaired individuals do not fully benefit from audiovisual media like television broadcasts, as current audio descriptions do not assist in viewing the video content effectively.
Innovation Solution
A vision enhancement system that automatically tracks and magnifies a region of interest (ROI) in video streams, allowing visually impaired viewers to better perceive the video content by combining the magnified ROI with the original video frame, and optionally applying additional visual enhancements such as increased brightness and contrast.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If audio description channel is selected, then visually impaired viewers receive audio description of video content, but they cannot effectively view the actual video content
Solution Approach 1:
The video stream is segmented into multiple regions, with a region of interest (ROI) being extracted and magnified separately from the rest of the video content. This allows the system to focus visual enhancement on specific important areas while maintaining the overall video context, enabling visually impaired viewers to see enhanced details of key elements.
Solution Approach 2:
Instead of enhancing the entire video uniformly, the system applies magnification and visual enhancement only to the region of interest (ROI) that is most relevant to the audio description. This local enhancement approach optimizes visual information delivery by concentrating processing resources on the most important visual elements for the visually impaired viewer.
2Loss of information
If the entire video stream is magnified, then visually impaired viewers can see more detail, but the processing complexity and computational load increase significantly
Solution Approach 1:
The system extracts only the region of interest (ROI) from the full video stream for magnification and enhancement. By isolating and processing only the relevant portion of the video content rather than the entire stream, the computational complexity is dramatically reduced while still providing the necessary visual detail enhancement for visually impaired viewers.
Solution Approach 2:
Instead of applying full magnification to the entire video stream, the system applies magnification only to the necessary extent - specifically to the region of interest. This partial action approach provides sufficient visual enhancement for the critical areas without the excessive computational burden of processing the complete video frame at high magnification.
3Loss of information
If region of interest is tracked and magnified in real-time, then visually impaired viewers can follow key elements, but the system requires sophisticated tracking and processing algorithms
Solution Approach 1:
The system performs preliminary identification and tracking of the region of interest (ROI) before applying magnification. By pre-processing the video stream to identify and track the ROI in advance, the system prepares the enhanced region ready for magnification, reducing the real-time processing burden during actual playback while maintaining accurate tracking of key visual elements.
Data Source
AI summary
A method for modifying a video stream for display includes receiving a request to display a video stream in a display mode that facilitates viewing by visually impaired viewers. An unmodified region of interest (ROI) is identified in a current video frame of the video stream. A location of the unmodified ROI is tracked in each of the subsequent video frames. The unmodified ROI is magnified by a prescribed amount in at least some of the video frames in which the unmodified ROI is being tracked to produce a magnified ROI. For each of the video frames in which the unmodified ROI is being tracked and magnified, the magnified ROI is combined with at least a portion of the video frame in which the ROI is located to thereby produce a modified video stream.