Text Translation Offloading for Image Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices face limitations in providing an efficient translation service for text within images captured by a camera, due to performance constraints and memory consumption when running optical character recognition (OCR) and translation engines locally.
Innovation Solution
An electronic device comprising a camera, display, transceiver, memory, and processor, which identifies text in images, transmits partial images to an external device for translation, and compensates for motion to accurately display the translated text on the original image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If OCR and translation engine are driven locally in the electronic device, then translation service can be provided, but performance is limited
Solution Approach 1:
The patent extracts the OCR and translation engine from the electronic device and relocates them to an external device (server). The electronic device only retains the function of capturing images and displaying results, while the heavy processing tasks are performed externally. This resolves the contradiction by maintaining translation service functionality while eliminating the need for complex local processing capabilities.
Solution Approach 2:
The patent introduces an external device (server) as an intermediary between the electronic device and the translation service. The server acts as a mediator that performs OCR and translation operations, receiving image data from the electronic device and returning translated text. This intermediary approach allows the electronic device to provide translation services without requiring complex local processing infrastructure.
2Productivity
If database and translation engine are downloaded and stored in the electronic device, then translation service performance is enhanced, but memory consumption increases
Solution Approach 1:
The patent extracts the database and translation engine from the electronic device's internal storage and relocates them to the external device (server). This eliminates the need to store large amounts of translation data and engine files in the electronic device's memory, thereby resolving the contradiction between enhancing translation performance and reducing memory consumption.
Solution Approach 2:
The external device (server) serves multiple functions: it stores the translation database, runs the translation engine, and processes OCR operations. By consolidating these multiple functions in a single external system, the patent eliminates the need for the electronic device to locally store and manage these resources, thereby reducing memory consumption while maintaining service performance.
3Ease of operation
If text is displayed on the original image, then user convenience is improved, but motion compensation is required for accurate text placement
Solution Approach 1:
The patent performs preliminary action by capturing motion information during the image transmission period and using it to pre-calculate the compensation needed for text placement. The system identifies motion of the electronic device or external objects between capturing the first image and receiving the translated text, then applies this motion information to adjust the display position of the translated text. This preliminary motion compensation ensures accurate text placement while maintaining the convenience of overlaying text on the original image.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Certain embodiments of the disclosure relate to an apparatus and a method for translating a text included in an image by using an external electronic device in an electronic device. One method comprises displaying a picture comprising an object bearing text at a location within the picture on a display, extracting the text, generating another text from the extracted text, and automatically overlaying the another text on the object in another picture comprising the object at another location within the another picture on the display.