Textual Overlay for Graphics Command Text Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network content browsing systems that use hardware-independent graphics commands struggle to enable user interactions such as copying, pasting, and searching text, as these systems do not provide direct knowledge of the text data type or structure, limiting interactions with graphical representations of text.
Innovation Solution
A distributed browsing system architecture where a server-side browser generates both hardware-independent graphics commands and a textual overlay, allowing the client-side browser to identify and interact with text by mapping user interactions to corresponding textual characters, facilitating operations like copying and highlighting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hardware-independent graphics commands are used to display text, then device compatibility and rendering flexibility are improved, but text interaction capabilities (copying, pasting, searching) are lost
Solution Approach 1:
The patent introduces an intermediary text layer that sits between the graphics rendering system and the text interaction system. This text layer contains the actual text data and serves as a mediator that enables text operations without requiring the graphics command system to understand text semantics. The text layer translates user interactions on graphical elements into text operations.
Solution Approach 2:
The patent segments the text display system into separate functional layers: the graphics rendering layer (which handles visual display and device compatibility) and the text interaction layer (which handles text operations). This segmentation allows each layer to operate independently with its own optimized capabilities, resolving the contradiction between compatibility and interaction.
2Ease of operation
If servers provide content searching by highlighting terms in updated images, then text searchability is improved, but processing time and server load increase
Solution Approach 1:
The patent performs preliminary extraction of text content from the content page during the initial rendering phase. The text is extracted and stored in the text layer before any user search operations occur. This preliminary action ensures that text data is readily available for immediate search operations without requiring time-consuming image processing or highlighting operations on the server side.
Solution Approach 2:
The patent extracts text data from the graphical content and separates it into a dedicated text layer. This extraction moves text data out of the image rendering pipeline and into a separate, efficiently queryable structure. Search operations can then directly query the extracted text without needing to process images or perform visual pattern matching, dramatically reducing server processing time.
Data Source
AI summary
Server systems are disclosed that receive content requests and respond with hardware-independent graphics commands instead of, or in addition to, unprocessed content items. The server systems can also generate text information regarding text in the requested content items, and provide the text information to user devices so that the user devices can have knowledge of the text in the content item. The user device can use the text information to handle user interactions with the content item, including copy, paste and search commands and other similar commands. Accordingly, the hardware-independent graphics commands-based representation may provide text interactivity and effects not otherwise available to content representations based on graphics commands or images of content.