Semantic Video Enhancement for Interactive Low-Vision Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video display technologies for visually-impaired individuals primarily focus on full-screen adjustments, leading to image clutter and loss of information, and do not allow active interaction or additional detail acquisition.
Innovation Solution
A method and apparatus, such as the 'video blind cane', utilize semantic segmentation to identify and enhance specific semantic objects in a video, allowing visually-impaired users to remotely control and interact with video content for enhanced information access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If full-screen image adjustments are applied, then visual assistance functions are provided, but image clutter occurs and information recognition becomes difficult
Solution Approach 1:
The patent segments the video image into multiple semantic objects (e.g., person, vehicle, animal, plant, building, sky, water, ground) and allows users to select and enhance specific objects of interest. This segmentation approach avoids applying full-screen adjustments that cause clutter, while still providing visual assistance by highlighting relevant information in a structured manner.
Solution Approach 2:
The patent applies enhancement strategies locally to selected semantic objects rather than uniformly across the entire image. Users can choose specific objects to enhance with different strategies (e.g., edge enhancement, contrast adjustment, brightness adjustment), which prevents information loss in other areas while providing assistance where needed.
2Measurement precision
If image enlargement is applied, then visual detail is improved, but certain parts are lost and complete information acquisition becomes difficult
Solution Approach 1:
The patent divides the image into multiple semantic object segments, allowing users to examine each segment individually with enhanced detail while maintaining awareness of the complete scene through the segmented structure. This prevents information loss by organizing content into manageable, searchable segments rather than requiring full enlargement.
Solution Approach 2:
The patent adds an interactive dimension where users can actively select and explore specific semantic objects. This transforms the passive full-screen display into an active exploration interface, allowing detailed examination of selected areas without sacrificing the contextual information of the complete image.
3Device complexity
If fixed mode output is applied after OSD configuration, then display simplicity is maintained, but active exploration and additional detail acquisition are prevented
Solution Approach 1:
The patent transforms the static fixed-mode display into a dynamic interactive system. Users can actively select semantic objects of interest and apply enhancement strategies in real-time during video playback. The system adapts to user preferences by learning from selection patterns and automatically applying appropriate enhancement strategies, providing both simplicity and versatility.
Solution Approach 2:
The patent implements automatic enhancement strategy selection based on user behavior patterns. The system learns from user interactions with semantic objects and automatically applies appropriate enhancement strategies without requiring manual configuration, enabling active exploration while maintaining operational simplicity.
Data Source
AI summary
According to an embodiment of the disclosure, the method may include segmenting, using a semantic segmentation technology, an original image into a plurality of semantic objects. According to an embodiment of the disclosure, the method may include identifying a first semantic object from the plurality of semantic object. According to an embodiment of the disclosure, the method may include identifying a first image area corresponding to the first semantic object as a first enhancement area. According to an embodiment of the disclosure, the method may include performing image enhancement on the first enhancement area according to a configured enhancement strategy. According to an embodiment of the disclosure, the method may include providing an enhanced image to a display based on the image enhancement.