Automatic Scrolling Screenshot Translation on Electronic Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current text translation methods on electronic devices require cumbersome operations such as taking screenshots and switching between applications, leading to poor user experience and low efficiency, especially when translating long content.
Innovation Solution
A machine translation method that allows for automatic scrolling screenshot translation, where the device detects user operations to take screenshots of content and translate it seamlessly, displaying translation results without the need for manual switching between interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users take screenshots and switch between applications to translate content, then translation functionality is achieved, but user experience deteriorates and operational complexity increases
Solution Approach 1:
The patent merges the screenshot capture function and translation function into a single integrated system. The terminal device captures screenshots of content displayed on its screen and automatically translates them, eliminating the need for users to manually switch between different applications. This integration directly reduces operational complexity while improving ease of operation.
Solution Approach 2:
The terminal device performs self-service by automatically capturing screenshots and initiating translation processes without requiring user intervention to switch applications. The system detects when content needs translation and autonomously executes the capture and translation sequence, reducing the burden on users and simplifying the overall operation.
2Productivity
If users repeatedly take screenshots and switch applications for long content translation, then complete translation is achieved, but time consumption increases and efficiency decreases
Solution Approach 1:
The patent implements continuous translation by capturing multiple screenshots in sequence as users scroll through long content, rather than requiring repeated manual intervention. The system continuously monitors screen content and automatically translates new portions as they appear, maintaining continuous productive action and eliminating time losses from repeated switching operations.
Solution Approach 2:
The system performs preliminary actions by proactively capturing screenshots and initiating translation before users need to read the content. By detecting scrolling actions and automatically triggering the translation process in advance, the system eliminates waiting time and ensures translation is ready when needed, significantly improving efficiency for long content.
3Ease of operation
If manual screenshot and translation processes are used, then translation accuracy is maintained, but operational simplicity is reduced and user experience deteriorates
Solution Approach 1:
The terminal device executes self-service operations by automatically detecting when content requires translation, capturing screenshots without user intervention, and initiating the translation process autonomously. This high degree of automation maintains translation accuracy while dramatically simplifying user interaction, as users simply need to scroll through content rather than manually triggering translation.
Solution Approach 2:
The system incorporates feedback mechanisms where it monitors user scrolling actions and automatically adjusts the translation process accordingly. When users scroll through content, the system detects this feedback and continuously captures and translates new portions, creating an adaptive automated system that maintains accuracy while requiring minimal user input.
Data Source
Figure 1
Figure 2
Figure 3(a)
AI summary
This application provides a machine translation method and an electronic device, and relates to fields such as artificial intelligence (artificial intelligence, AI), natural language processing, and machine translation. The method includes: An electronic device displays a first user interface, where source text content is displayed in the first user interface; after detecting an operation of triggering scrolling screenshot taking by a user, the electronic device automatically starts to take a scrolling screenshot; the electronic device obtains a first picture through scrolling screenshot taking; the electronic device obtains translation content corresponding to the source text content displayed on the first picture; and the electronic device automatically displays a second user interface, where a part or all of the translation content is displayed in the second user interface. According to embodiments of this application, intelligence of the electronic device (for example, an intelligent terminal device such as a mobile phone) is improved, and user experience of viewing a translation by the user can also be improved.