Translation glasses

Abstract

The utility model relates to the technical field of electronic equipment, and provides a pair of translation glasses, which comprises a processor, a microphone assembly, a first display screen and a second display screen, and is characterized in that the microphone assembly is electrically connected with the processor; the first display screen and the second display screen are electrically connected with the processor, the display surface of the first display screen faces the inner side of the translation glasses, and the display surface of the second display screen faces the front side of the translation glasses; the microphone assembly is used for picking up voice information of a user and voice information of a dialogue person; and the processor is used for processing the voice information of the dialogue person, translating the voice information into first text information, outputting the first text information to the first display screen for displaying, processing the voice information of the user, translating the voice information of the user into second text information, and outputting the second text information to the second display screen for displaying. The translation glasses can realize two-way language interaction only by being worn by a user unilaterally, so that the interaction experience between a dialogue person and the user is improved.

Description

Technical Field

[0001] The utility model relates to the technical field of electronic equipment, in particular to a pair of translation glasses. Background Art

[0002] Translating glasses are smart glasses with integrated translation capabilities. They use a microphone to pick up the speaker's voice, which is then recognized and translated into target text by a built-in processor. The translated text is then displayed through the lenses, allowing the user to see what the speaker is saying. However, these glasses can only help the user understand what the speaker is saying, not enable two-way language interaction, resulting in a poor interaction experience between the user and the speaker. Utility Model Content

[0003] The utility model provides translation glasses, which are used to solve the problem that the translation glasses in the prior art can only help the user understand the meaning of the interlocutor but cannot realize two-way language interaction, resulting in a poor interactive experience between the interlocutor and the user.

[0004] The utility model provides a pair of translation glasses, comprising:

[0005] a processor and a microphone assembly, wherein the microphone assembly is electrically connected to the processor;

[0006] A first display screen and a second display screen are electrically connected to the processor respectively, wherein the display surface of the first display screen faces the inner side of the translation glasses, and the display surface of the second display screen faces the front side of the translation glasses;

[0007] The microphone component is used to pick up user voice information and interlocutor voice information; the processor is used to process the interlocutor voice information and translate it into a first text message, output the first text message to the first display screen for display, and also to process the user voice information and translate it into a second text message, output the second text message to the second display screen for display.

[0008] The translation glasses provided by the present invention also include:

[0009] The frame, the microphone assembly includes a plurality of microphones, and the plurality of microphones are electrically connected to the processor;

[0010] The processor is used to perform beamforming on the voice information picked up by the multiple microphones to obtain a first microphone array beam and a second microphone array beam, wherein the first microphone array beam points to the front side of the frame, and the second microphone array beam points to the bottom side of the frame.

[0011] According to the translation glasses provided by the utility model, the frame comprises: a frame, a left temple and a right temple, wherein the left temple and the right temple are symmetrically connected to the left and right sides of the frame;

[0012] The microphone assembly includes a first microphone group, a second microphone group and a third microphone group. The second microphone group is arranged on the frame, the first microphone group is arranged on the left temple, and the third microphone group is arranged on the right temple.

[0013] According to the translation glasses provided by the present invention, the second microphone group includes a plurality of second microphones, and the plurality of second microphones are arranged in the middle of the frame and are distributed in a centrally symmetrical manner.

[0014] According to the translation glasses provided by the present invention, the first microphone group includes a plurality of first microphones, and the plurality of first microphones are arranged at intervals along the left temple.

[0015] According to the translation glasses provided by the present invention, the third microphone group includes a plurality of third microphones, and the plurality of third microphones are arranged at intervals along the right temple.

[0016] According to the translation glasses provided by the present invention, the second microphone group includes five second microphones, one of which is arranged at the center of the frame, and the other four second microphones are evenly arranged around the center;

[0017] The second microphone group includes three first microphones, and the three first microphones are evenly spaced apart; the third microphone group includes three third microphones, and the three third microphones are evenly spaced apart.

[0018] The translation glasses provided by the present invention also include:

[0019] A camera is electrically connected to the processor and is used to obtain image information in front of the translation glasses; the processor is used to control the microphone component to pick up the voice information of the interlocutor based on the image information.

[0020] The utility model provides a pair of translation glasses, comprising:

[0021] Frames;

[0022] a lens fixed to the frame, the lens serving as the first display screen;

[0023] A micro projector is electrically connected to the processor, and is used to project the first text information onto the inner side of the lens.

[0024] According to the translation glasses provided by the present invention, the second display screen is fixed to the frame, and the second display screen is located above the lenses.

[0025] The translation glasses provided by this utility model are provided with a first display screen and a second display screen. The microphone assembly picks up the user's voice information and the interlocutor's voice information. After processing and translation by a processor, the interlocutor's voice information is converted into a first text message displayed on the first display screen, and the user's voice information is converted into a second text message displayed on the second display screen. The translation glasses can not only pick up the interlocutor's voice and translate it into the user's language and display it to the user, but also pick up the user's voice and translate it into the interlocutor's language and display it to the interlocutor. Only one user needs to wear the translation glasses to achieve two-way language interaction, enhancing the interactive experience between the interlocutor and the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0027] Figure 1 This is a structural diagram of the translation glasses provided by the utility model.

[0028] Figure 2 It is a structural schematic diagram of the translation glasses provided by the utility model.

[0029] Figure 3 This is a schematic diagram of the microphone array beam of the translation glasses provided by the present invention.

[0030] Figure 4 This is an algorithm block diagram of the translation glasses provided by the present invention.

[0031] Figure 5 This is a diagram of the microphone array beam response of the translation glasses provided by the present invention.

[0032] Reference numerals:

[0033] 1. Processor; 2. Microphone assembly; 2a. First microphone array beam; 2b. Second microphone array beam; 21. First microphone group; 211. First microphone; 22. Second microphone group; 221. Second microphone; 23. Third microphone group; 231. Third microphone; 3. First display screen; 4. Second display screen; 5. Spectacle frame; 51. Frame; 52. Left temple; 53. Right temple; 6. Camera. DETAILED DESCRIPTION

[0034] To make the purpose, technical solutions, and advantages of the present invention more clear, the following will be combined with the accompanying drawings to clearly and completely describe the technical solutions of the present invention. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0035] In the description of the embodiments of the present invention, it should be noted that, unless otherwise expressly specified and limited, the terms "first", "second" and "third" are numbered for the purpose of clearly describing the product components and do not represent any substantial difference. The terms "installed", "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be a connection between the two components. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood according to the specific circumstances. In addition, the meaning of "multiple" is two or more. In the specification and claims, "and / or" means at least one of the connected objects, and the character " / " generally indicates that the related objects are in an "or" relationship.

[0036] The following combination Figure 1-Figure 5 The present invention describes the translation glasses.

[0037] like Figure 1 and Figure 2 As shown, the translation glasses provided in an embodiment of the present invention include a processor 1, a microphone assembly 2, a first display screen 3, and a second display screen 4. The microphone assembly 2 is electrically connected to the processor 1. The first display screen 3 is electrically connected to the processor 1, and the second display screen 4 is electrically connected to the processor 1. The display surface of the first display screen 3 faces the inside of the translation glasses, and the display surface of the second display screen 4 faces the front of the translation glasses.

[0038] The microphone assembly 2 is used to pick up user voice information and interlocutor voice information. The processor 1 is used to process the interlocutor voice information and translate it into a first text message, which is then output to a first display screen 3 for display. The processor 1 is also used to process the user voice information and translate it into a second text message, which is then output to a second display screen 4 for display.

[0039] The translation glasses also include a frame 5 and lenses, with the lenses secured to the frame 5. A microphone assembly 2, a first display screen 3, and a second display screen 4 are typically mounted on the frame 5. The processor 1 can be integrated into the frame 5 to ensure real-time processing and transmission of information, improving the speed and accuracy of the translation glasses. Of course, the processor 1 can also be located in other devices, such as smartphones or smartwatches. These devices communicate with the electronic components of the translation glasses via wireless or wired connections to jointly implement the translation function.

[0040] The first display screen 3 can be independently provided with the lens. Optionally, the first display screen 3 can be a display screen such as an LCD or LED. This embodiment does not impose any specific restrictions on the type of the second display screen 4.

[0041] Alternatively, the lens serves as the first display screen 3, i.e., the first display screen 3 is a transparent display screen or an optical waveguide lens. This can be combined with augmented reality (AR) technology to superimpose the first text information onto the real world, thus realizing the functionality of AR translation glasses. The translation glasses also include a micro-projector (not shown), which is electrically connected to the processor 1 and is configured to project the first text information onto the inner surface of the lens. The micro-projector converts the digital signal corresponding to the first text information into a visible light image and projects it onto the lens. The transparent lens allows some light to pass through while reflecting light from the micro-projector, resulting in the first text information being displayed on the lens.

[0042] The second display screen 4 is fixed to the frame 5. Optionally, the second display screen 4 is located above the lenses to facilitate wearing and viewing by the user and the person speaking. The second display screen 4 can be an LCD or LED display screen, and this embodiment does not impose any specific restrictions on the type of the second display screen 4.

[0043] In a specific usage scenario, when a person speaks, processor 1 receives their English voice information, processes it, and translates it into Chinese text, which is then output to first display screen 3 for the user to view. When the user responds, processor 1 receives their Chinese voice information, processes it, and translates it into English text, which is then output to second display screen 4 for the person to view. This allows the person to understand what the user is saying, and two-way language interaction is achieved when one user wears the translation glasses.

[0044] The translation glasses provided in this embodiment of the utility model are provided with a first display screen 3 and a second display screen 4. The microphone assembly 2 picks up the user's voice information and the interlocutor's voice information. After processing and translation by the processor 1, the interlocutor's voice information is converted into a first text message displayed on the first display screen 3, and the user's voice information is converted into a second text message displayed on the second display screen 4. The translation glasses can not only pick up the interlocutor's voice and translate it into the user's language and display it to the user, but also pick up the user's voice and translate it into the interlocutor's language and display it to the interlocutor. With only one user wearing the translation glasses, two-way language interaction can be achieved, enhancing the interactive experience between the interlocutor and the user.

[0045] In the translation glasses provided by the embodiment of the present invention, the microphone assembly 2 includes multiple microphones, and the multiple microphones are electrically connected to the processor 1. The processor 1 is used to perform beamforming on the voice information picked up by the multiple microphones to obtain the first microphone array beam 2a and the second microphone array beam 2b. Figure 3 The first microphone array beam 2 a is directed toward the front side of the frame 5 , and the second microphone array beam 2 b is directed toward the bottom side of the frame 5 .

[0046] See also Figure 4 The microphone component 2 picks up multiple voice information in the environment. In order to more accurately pick up the voice of the user and the interlocutor, the processor 1 uses the microphone array algorithm to beamform the microphone component 2, so that the microphone component 2's perception direction of the signal is enhanced or attenuated, thereby obtaining a first microphone array beam 2a pointing to the interlocutor and a second microphone array beam 2b pointing to the user, thereby clearly receiving the voice information of the user and the interlocutor while suppressing noise or interference from other directions.

[0047] The microphone assembly 2 picks up the interlocutor's voice information through the first microphone array beam 2a and picks up the user's voice information through the second microphone array beam 2b; the processor 1 recognizes the two voice information and converts them into corresponding source language text information respectively; then the source language text information is translated into target language text information and displayed, including translating the user language into the interlocutor's language to obtain the second text information, sending it to the second display screen 4 for display, and translating the interlocutor's language into the user language to obtain the first text information, sending it to the first display screen 3 for display.

[0048] It should be noted that the underside, front, left, and right sides of the frame 5 refer to the user's perspective when wearing the translation glasses. When using the glasses, the user and the person speaking are typically face-to-face. In this embodiment, the first microphone array beam 2a is directed toward the front of the frame 5, enabling more accurate and clear voice recognition. The second microphone array beam 2b is directed toward the underside of the frame 5, toward the user's mouth, enabling more accurate and clear voice recognition.

[0049] In some embodiments of the present invention, the frame 5 includes a frame 51, a left temple 52 and a right temple 53, and the left temple 52 and the right temple 53 are symmetrically connected to the left and right sides of the frame 51. Figure 1 As shown, the microphone assembly 2 includes a first microphone group 21, a second microphone group 22 and a third microphone group 23. The second microphone group 22 is set on the frame 51, the first microphone group 21 is set on the left temple 52, and the third microphone group 23 is set on the right temple 53.

[0050] The frame 51 is located at the front of the glasses, the left temple 52 is located at the left rear side of the glasses, and the right temple 53 is located at the right rear side of the glasses. The first microphone group 21 is disposed on the left temple 52, the second microphone group 22 is disposed on the frame 51, and the third microphone group 23 is disposed on the right temple 53. This allows the multiple microphones of the microphone assembly 2 to be distributed in a three-dimensional space. This facilitates the processor 1 to perform beamforming on the microphone assembly 2, thereby obtaining the first microphone array beam 2a and the second microphone array beam 2b.

[0051] The first microphone group 21 includes at least one microphone, the second microphone group 22 includes at least one microphone, and the third microphone group 23 includes at least one microphone.

[0052] like Figure 2 As shown, in some embodiments of the present invention, the second microphone group 22 includes multiple second microphones 221, which are disposed in the middle of the frame 51. This arrangement of multiple second microphones 221 in the middle of the frame 51 facilitates the processor 1 performing beamforming to obtain a first microphone array beam 2a directed from the middle of the frame 5 toward the interlocutor, as well as a second microphone array beam 2b directed from the middle of the frame 5 toward the user, thereby improving the accuracy of picking up the interlocutor's voice.

[0053] Furthermore, the plurality of second microphones 221 are distributed in a centrally symmetrical manner, which can make it easier for the processor 1 to perform beamforming, enhance the first microphone array beam 2a and the second microphone array beam 2b, and simplify the beamforming algorithm.

[0054] In some embodiments of the present invention, the first microphone group 21 includes multiple first microphones 211, which are spaced apart along the left temple 52. This embodiment, by spacing the multiple first microphones 211 along the left temple 52, increases the three-dimensional spatial distribution of the microphone assembly 2, facilitating the processor 1 to enhance the first microphone array beam 2a and the second microphone array beam 2b when performing beamforming, thereby improving the accuracy of picking up the interlocutor's voice.

[0055] In some embodiments of the present invention, the third microphone group 23 includes multiple third microphones 231, which are spaced apart along the right temple 53. This embodiment, by spacing the multiple third microphones 231 along the right temple 53, increases the three-dimensional spatial distribution of the microphone assembly 2, facilitating beamforming by the processor 1 to enhance the first microphone array beam 2a and the second microphone array beam 2b, thereby improving the accuracy of picking up the interlocutor's voice.

[0056] Furthermore, multiple first microphones 211 are evenly spaced along the left temple 52, and / or multiple third microphones 231 are evenly spaced along the right temple 53, which can facilitate beamforming by the processor 1 and simplify the beamforming algorithm.

[0057] As a specific example, the second microphone group 22 includes five second microphones 221, one of which is located at the center of the frame 51, and the other four second microphones 221 are evenly spaced around the center of the frame 51. The first microphone group 21 includes three first microphones 211, which are evenly spaced. The third microphone group 23 includes three third microphones 231, which are evenly spaced.

[0058] See also Figure 2 Two lenses are provided on the frame 51. The center of the frame 51 is the midpoint of the line connecting the two lenses. One second microphone 221 is provided at the center, and the other four second microphones 221 are provided around the center in a square arrangement. The microphone assembly 2 of this embodiment includes a total of 11 microphones.

[0059] As a specific example, with the horizontal direction as the x-axis, the vertical direction as the y-axis, and the front and back directions as the z-axis, the second microphone 221 at the center of the temple is the coordinate origin (0, 0, 0), and the coordinates of the four second microphones 221 surrounding the origin are (2, 2, 0), (2, -2, 0), (-2, -2, 0), and (-2, 2, 0), respectively. The coordinates of the three first microphones 211 are (6, 0, 0), (6, 0, 2), and (6, 0, 4), respectively. The coordinates of the three third microphones 231 are (-6, 0, 0), (-6, 0, 2), and (-6, 0, 4), respectively. The unit of the coordinates is cm. Figure 5 As shown, the microphone arrangement of this embodiment can obtain a relatively ideal first microphone array beam 2a and second microphone array beam 2b.

[0060] The translation glasses provided by the present invention further include a camera 6, which is electrically connected to the processor 1 and is used to obtain image information in front of the translation glasses. The processor 1 is used to control the microphone component 2 to pick up the interlocutor's voice information based on the image information.

[0061] When a user wearing these translation glasses is conversing with someone, there may be multiple people in front of them, potentially causing interference from non-interviewing voices. This embodiment uses camera 6 to capture image information in front of the translation glasses, including the face of the person speaking. Processor 1 performs multimodal recognition based on this image information to determine whether the person is speaking. If so, it controls microphone assembly 2 to pick up the person's voice, improving voice pickup accuracy and preventing interference from other sounds directly in front.

[0062] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A pair of translation glasses, characterized in that: include: a processor and a microphone assembly, wherein the microphone assembly is electrically connected to the processor; A first display screen and a second display screen are electrically connected to the processor respectively, wherein the display surface of the first display screen faces the inner side of the translation glasses, and the display surface of the second display screen faces the front side of the translation glasses; The microphone component is used to pick up user voice information and interlocutor voice information; the processor is used to process the interlocutor voice information and translate it into a first text message, output the first text message to the first display screen for display, and also to process the user voice information and translate it into a second text message, output the second text message to the second display screen for display.

2. The translation glasses according to claim 1, characterized in that: Also includes: The frame, the microphone assembly includes a plurality of microphones, and the plurality of microphones are electrically connected to the processor; The processor is used to perform beamforming on the voice information picked up by the multiple microphones to obtain a first microphone array beam and a second microphone array beam, wherein the first microphone array beam points to the front side of the frame, and the second microphone array beam points to the bottom side of the frame.

3. The translation glasses according to claim 2, characterized in that: The frame comprises a frame, a left temple and a right temple, wherein the left temple and the right temple are symmetrically connected to the left and right sides of the frame; The microphone assembly includes a first microphone group, a second microphone group and a third microphone group. The second microphone group is arranged on the frame, the first microphone group is arranged on the left temple, and the third microphone group is arranged on the right temple.

4. The translation glasses according to claim 3, characterized in that: The second microphone group includes a plurality of second microphones, and the plurality of second microphones are arranged in the middle of the frame and are distributed in a centrally symmetrical manner.

5. The translation glasses according to claim 3, characterized in that: The first microphone group includes a plurality of first microphones, and the plurality of first microphones are arranged at intervals along the left temple.

6. The translation glasses according to claim 3, characterized in that: The third microphone group includes a plurality of third microphones, and the plurality of third microphones are arranged at intervals along the right temple.

7. The translation glasses according to claim 3, characterized in that: The second microphone group includes five second microphones, one of which is disposed at the center of the frame, and the other four second microphones are evenly disposed around the center; The second microphone group includes three first microphones, and the three first microphones are evenly spaced apart; the third microphone group includes three third microphones, and the three third microphones are evenly spaced apart.

8. The translation glasses according to claim 1, characterized in that: Also includes: a camera, the camera being electrically connected to the processor and configured to acquire image information in front of the translation glasses; The processor is used to control the microphone assembly to pick up the interlocutor's voice information according to the image information.

9. The translation glasses according to claim 1, characterized in that: include: Frames; a lens fixed to the frame, the lens serving as the first display screen; A micro projector is electrically connected to the processor, and is used to project the first text information onto the inner side of the lens.

10. The translation glasses according to claim 9, characterized in that: The second display screen is fixed to the frame, and the second display screen is located above the lens.

Images