Screen Copy Text Extraction and Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen copy technologies do not allow for easy modification of captured screen images, making it inefficient to remove or replace sensitive information and translate text for users with different languages.
Innovation Solution
A system and method that captures screen copies with modifiable textual data, using a translator module to replace text with translations based on user selections or settings, and provides options for removing or replacing data text and user interface component text, allowing for manual or automatic translation and modification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional screen copy functionality is used to capture screen images, then the screen copy can be obtained quickly, but the textual data in the screen copy is not readily modifiable and requires pixel editing to remove or replace sensitive information
Solution Approach 1:
The patent segments the screen copy into two distinct components: graphical data (bitmap image) and textual data (extracted text strings). This segmentation allows text to be modified independently without affecting the graphical background, enabling easy text replacement and sensitive information removal through simple text editing operations rather than complex pixel-level manipulation.
Solution Approach 2:
The patent extracts textual data from the captured screen image by recognizing and isolating text elements. This extraction transforms the text from being embedded within the image pixels to being separable data that can be easily manipulated, replaced, or removed while preserving the graphical components of the screen copy.
2Adaptability or versatility
If screen copy is used to share data between users, then information exchange is facilitated, but sensitive information within the screen copy cannot be easily removed or replaced
Solution Approach 1:
By segmenting the screen copy into graphical and textual components, the system enables selective modification of text content while preserving the visual context. Users can easily create modified copies by editing only the text portions through standard text editing tools, making the process of creating customized shares simple and efficient.
Solution Approach 2:
The patent creates a copy of the screen that preserves both graphical and textual elements as separable components. This copy can then be selectively modified by replacing or removing text while maintaining the original graphical structure, enabling versatile adaptation for different sharing scenarios without recreating the entire screen image.
3Adaptability or versatility
If screen copy is used for collaboration between users speaking different languages, then information can be exchanged, but translation of text in the screen copy is not easily achievable
Solution Approach 1:
The patent extracts text from the screen copy as separable data elements, making them accessible for translation processing. This extraction enables automated translation of text content while preserving the graphical context, allowing users to quickly adapt screen copies for different languages without manual re-creation or time-consuming pixel-level editing.
Solution Approach 2:
The patent changes the state of textual data from being embedded image pixels to being structured text objects that can be processed by translation systems. This parameter change enables automated translation of screen copy text, significantly reducing the time required for language adaptation compared to manual methods.
4Productivity
If traditional bitmap screen copies are used, then the entire screen image can be captured, but any modification requires editing pixels directly which is complex and time-consuming
Solution Approach 1:
The patent divides the screen copy into graphical and textual segments, allowing text modifications to be performed independently and efficiently. This segmentation enables users to quickly edit only the text portions using standard text editing operations rather than performing time-consuming pixel-level manipulation across the entire image, thereby maintaining high productivity in information exchange.
Solution Approach 2:
By extracting text from the bitmap image as separate data objects, the patent enables rapid modification of text content without processing the entire image. This extraction allows users to quickly replace or remove text elements, significantly reducing modification time while preserving the ability to capture complete screen information.
Data Source
AI summary
A computer implemented system and method provides for responding to an instruction to a print screen instruction by generating and storing an image of user interface components that had been displayed in a display area when the instruction was received; and storing in association with the image original text that had been displayed in the display area and on the user interface components when the instruction was received, where the first image does not include a representation of the original text. Output of the screen copy includes, for example, overlaying some or all of the text, or which some or all can be in modified form, over the image.