Method for real-time text recognition and translation of video streams for head-mounted smart devices
A smart device and text recognition technology, applied in the field of video processing, can solve problems such as the lack of mature solutions or typical cases of head-mounted smart devices, and achieve the effect of convenient interaction, avoiding inconvenience, and natural and intuitive presentation forms
Active Publication Date: 2020-07-14
幻视互动(北京)科技有限公司
View PDF10 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, the real-time text recognition and translation technology through video streams is currently not yet a mature solution or typical case for application on head-mounted smart devices
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0035] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.
[0036] The invention proposes a method for real-time text recognition and translation of a video stream of a head-mounted smart device, which belongs to an application in the field of text detection, character recognition technology (OCR), text translation, and augmented reality technology in natural scenes. The technology of the present invention for real-time text recognition and translation through video streams is applied to head-mounted smart devices, and video stream data is obtained by using binocular cameras, wh...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention proposes a method for real-time text recognition and translation of video streams for head-mounted smart devices, including: acquiring video stream data and dynamic data of user head movement; analyzing dynamic data based on video stream data and user head movement User operation, perceive the environment in the user's viewing area, obtain the sensing results, and use the sensing results to use the binocular video 3D reconstruction algorithm to perform 3D reconstruction of the environment; perform text detection, text recognition, and text translation on the video stream data according to the user's viewpoint area ; According to the 3D position information obtained from text detection and 3D reconstruction and the image information of the target text, the position tracking of the target text is carried out; using augmented reality technology, the drawn translation results are superimposed on the user's perspective in a way of fitting, indicating or covering at the target text. The invention applies the text recognition and translation technology to the head-mounted smart device, avoiding the inconvenience of the user holding the mobile terminal device.
Description
technical field [0001] The invention relates to the technical field of video processing, in particular to a method for real-time text recognition and translation of video streams of head-mounted smart devices. Background technique [0002] Translating text technology is mainly used on desktop computers and mobile phones. Usually, users need to use a keyboard or mouse to input the text to be translated into the device. The device queries the translation result offline or online, and then displays it to the user on the screen. Later, there was an interactive way to get words on the screen, which added text recognition technology on the basis of the original translation text technology. On the desktop computer side, the user uses the mouse to specify the text area on the screen, and the device automatically frames the text at the mouse position and translates the text; on the mobile phone side, the user turns on the camera to shoot the text area, and the device recognizes the t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/32G06K9/62G06F40/58G06F3/01
CPCG06F3/012G06F40/58G06V10/243G06V20/62G06F18/214
Inventor 范懿文杜晶陈清甫
Owner 幻视互动(北京)科技有限公司