Unlock instant, AI-driven research and patent intelligence for your innovation.

An AR translation device and method

A technology of translation device and coordinate position, which is applied in the field of AR translation device, can solve the problems of not being satisfied with various needs, being unable to use for a long time, troublesome, etc.

Active Publication Date: 2019-04-09
深圳市传智科技有限公司
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Speech translation devices are developing rapidly, but there are few or no devices for text translation, especially wearable devices that facilitate translation at any time.
There is a strong demand for various forms of translation in cross-border tourism and international business activities. The current voice translators on the market can no longer meet the needs, such as text to voice, voice to text, and text to text. These diverse needs are not very good. is satisfied
The launch of the mobile phone AR translation function has solved some of the needs, but it needs to hold the mobile phone for translation, which is still cumbersome, unable to free hands and cannot be used for a long time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An AR translation device and method
  • An AR translation device and method
  • An AR translation device and method

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0054]First, the information captured in the camera frame and the information displayed by the AR optical display lens are adjusted to be consistent. Specifically, the camera is connected to the AR optical display lens, and the information captured by the camera is uploaded to the AR optical display lens for display. When the user watches the external environment, use the camera of this device to recognize the scene in the user's front field of vision, and when the text is recognized, the coordinates will be marked on the text; specifically, when the text is recognized, the coordinates will be marked on the text, That is, the length and width of the display screen are used as the coordinate axes, and the center of the text is used as a point, record the coordinate value of the horizontal width of the point, record the coordinate value of the vertical length of the point, and determine the coordinates of the text with these two values. Record the coordinates of these texts in t...

specific Embodiment 2

[0055] First, the information captured in the camera frame and the information displayed by the AR optical display lens are adjusted to be consistent. Specifically, the camera is connected to the AR optical display lens, and the information captured by the camera is uploaded to the AR optical display lens for display. When the user watches the external environment, use the camera of this device to recognize the scenery in front of the user's field of view offline or online. When the text is recognized, it often appears that there are many texts and they are distributed in multiple areas. At this time, The displayed text is small, and it is difficult for users to see clearly through the screen. At this time, you can mark each paragraph of text such as 1, 2, 3, 4, and record these marks and the corresponding text content, and also record the text of each mark. The coordinates are recorded, and at the same time, the text information is processed through local translation, or uplo...

specific Embodiment 3

[0062] First, the information captured in the camera frame and the information displayed by the AR optical display lens are adjusted to be consistent; when the user watches the external environment, use the camera of this device to scan and identify the scene in the user's front field of view offline or online, and identify the When it comes to real objects, the text information is processed locally, or uploaded to the server through the network for recognition processing, and the name of the object is translated into the language and text content required by the user and displayed on the AR optical display lens display screen; then, through the earphone Play the pronunciation of the real object to the user to realize the function of AR recognition. The real object includes a static object such as a cup, and also includes information such as animals, flowers and plants, landscapes, and human organs that can be recognized by image recognition technology.

[0063] Figure 4 It i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an AR translation device and method. The device comprises a glasses main body, a camera, an AR display screen, an earphone, a microphone, a host and a handheld device, The AR display screen is positioned at the spectacle lens mounting position of the spectacle main body; The camera is located between the two AR display screens. The microphones and the earphones are positioned at positions where the glasses main body is in contact with ears of a user; The host is respectively connected with the camera and the AR display screen, and is used for receiving the camera shooting information collected by the camera, storing, calculating and translating the camera shooting information to obtain translated information, and sending the translated information to the AR displayscreen; the host is connected with the handheld device through a connecting line and a hanging rope, a loudspeaker is arranged on the handheld device, and the microphone is connected with the loudspeaker; And the host is respectively connected with the earphone and the loudspeaker, and is used for sending the translation information to a user in a voice form through the earphone and the loudspeaker. By the adoption of the method and device, the seen area can be translated in real time.

Description

technical field [0001] The present invention relates to the field of speech translation, in particular to an AR translation device and method. Background technique [0002] With the integration of the world, the strengthening of economic, trade and cultural exchanges between countries, and the increasing exchanges between countries with different languages, the demand for translation is increasing year by year. Speech translation devices are developing rapidly, but there are few or no devices for text translation, especially wearable devices that facilitate translation at any time. There is a strong demand for various forms of translation in cross-border tourism and international business activities. The current voice translators on the market can no longer meet the needs, such as text to voice, voice to text, and text to text. These diverse needs are not very good. is satisfied. The introduction of the mobile phone AR translation function has solved some of the needs, but...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/28
CPCG06F40/58
Inventor 张纯娟
Owner 深圳市传智科技有限公司