Mobile Text Overlay Translation via OCR and Superimposition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Communications devices, such as cellular telephones, lack the ability to effectively translate and display text from images captured, limiting their functionality in multilingual environments.
Innovation Solution
A method and system that involves receiving an image, performing optical character recognition (OCR) to extract text, translating the text into another language, and superimposing the translated text over the original image for display, with user-selectable language options and prominent display of the translated text.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If camera functions are added to cellular telephones to capture digital images, then the versatility of the device is improved, but the device complexity increases
Solution Approach 1:
The camera system is integrated into the existing cellular telephone, allowing the device to perform multiple functions including image capture, text recognition, and translation. The camera module works in conjunction with the telephone's processing capabilities to provide a multi-functional device without requiring separate standalone equipment.
2Adaptability or versatility
If text translation and OCR processing are implemented in the cellular telephone, then the functionality in multilingual environments is improved, but the device complexity increases
Solution Approach 1:
The system employs an intermediary processing approach where the camera captures the image and extracts text, then the extracted text is passed to translation software for language conversion. This intermediary text extraction step simplifies the overall process by breaking down the complex task of real-time image translation into manageable sequential operations.
Solution Approach 2:
The system performs preliminary text extraction through OCR processing before the translation step. By pre-processing the image to extract text content, the system prepares the data in a format suitable for translation, reducing the computational complexity of the subsequent translation operation.
3Ease of operation
If the translated text is displayed in a prominent manner, then the readability is improved, but the information from the original image is lost
Solution Approach 1:
The translated text is overlaid on the original image in a different spatial dimension (text layer above image layer). This allows both the original visual information and the translated text to coexist without completely obscuring each other, maintaining both readability and access to original image content.
Solution Approach 2:
The system applies different visual qualities to different parts of the display: the original image maintains its visual characteristics while the translated text is rendered with enhanced prominence. This local differentiation allows users to selectively focus on either the original image or the translation as needed.
Data Source
AI summary
A method performed by a mobile terminal may include receiving an image that includes text, translating the text into another language and superimposing and displaying the translated text over the received image.