Display Device Voice Content Selection via DOM Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face inconvenience in selecting desired content on web application screens, especially when there is overlapping text, as they need to directly click on the content using a remote control, which can be time-consuming and error-prone.
Innovation Solution
A display device that performs primary and secondary classification of nodes on a document object model (DOM) to identify clickable content, allowing voice-activated selection by monitoring DOM changes and prioritizing text selection based on screen presence and change detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users directly select content using a remote control, then content selection can be performed, but user convenience deteriorates and operation time increases
Solution Approach 1:
The patent replaces the mechanical remote control operation with a voice recognition system. The voice recognition unit captures user speech, the voice recognizer converts it to text, and the web voice matcher identifies matching content on the web screen, eliminating the need for manual remote control navigation and clicking.
Solution Approach 2:
The patent introduces a voice recognition system as an intermediary between the user and the content selection process. Instead of direct manual interaction, the voice command serves as a mediator that translates user intent into automated content selection actions.
2Measurement precision
If all text on web screen is treated as clickable, then voice matching can be performed, but accuracy deteriorates due to overlapping text
Solution Approach 1:
The patent segments the web screen content into individual text elements and processes each through DOM node classification. It performs primary classification on all DOM nodes and secondary classification to determine screen presence, separating clickable from non-clickable text elements systematically.
Solution Approach 2:
The patent implements feedback through DOM change monitoring. When a text element is clicked or selected, the system monitors for DOM changes to verify the action was successful, and uses this feedback to adjust the matching process and avoid selecting overlapping non-clickable text.
Data Source
AI summary
Disclosed is a display device capable of classifying clickable content in a web application screen, and the display device can perform primary classification on all nodes existing in a document object model (DOM) and perform secondary classification for determining whether a node exists in the screen.