Monocular AR glasses based on speech translation

By designing a monocular AR glasses with dual microphones and Bluetooth chips, the online voice translation and offline translation functions are realized, and the translation results are displayed on the waveguide through an AR optical machine, the problem that existing AR glasses cannot effectively display voice recognition content, and the efficiency and convenience of language communication are improved.

CN119575657APending Publication Date: 2025-03-07VISION INTELLIGENCE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311731425.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-15
Publication Date
2025-03-07

AI Technical Summary

Technical Problem

Existing AR glasses have problems with many functions in speech recognition and translation, but cannot effectively display speech recognition content, resulting in language communication disorders and reducing work efficiency and convenience of life.

Method used

A monocular AR glasses based on voice translation are designed, and sound is picked up through the dual microphone on the AR glasses legs, and connected to the mobile APP using a Bluetooth chip to realize online voice translation and offline translation functions. The translated text is displayed on the waveguide through an AR optical machine.

Benefits of technology

It solves communication barriers for people of different languages, improves work efficiency and life convenience, and realizes efficient display of speech recognition and translation through the design and function of AR glasses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119575657A_ABST
    Figure CN119575657A_ABST
Patent Text Reader

Abstract

The invention discloses monocular AR (Augmented Reality) glasses based on voice translation, belongs to the technical field of intelligent hardware, and aims to solve the problems that the existing AR glasses have various functions and complex voice links, and cannot effectively translate voice recognition content to display on the AR glasses, so that language communication is obstructed, and the user experience is poor. And an effective channel for solving communication of different languages is lacked, so that the working efficiency and the life convenience are reduced. The method has the technical effects that in a voice online translation state, the mobile phone APP decompresses the voice through an algorithm and transmits the decompressed voice to the cloud, and the voice is translated, translated and output to the mobile phone; in a voice off-line translation state, the mobile phone APP outputs language characters set by voice translation to the mobile phone through algorithm decompression, the translated characters are transmitted to the AR light machine of the AR glasses leg through the mobile phone, a user can visually see the character content directly translated by voice on the waveguide sheet, and through display of the translated content, the user can conveniently and rapidly translate the characters. The practicability of the AR glasses is improved, and communication obstacles of people with different languages are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent hardware, and in particular to monocular AR glasses based on voice translation. Background Art

[0002] As international cooperation continues to deepen, different languages ​​have become an obstacle to communication. In order to solve the timeliness of communication, it is imperative to develop a pair of glasses with voice translation display. Therefore, it is necessary to use current AR glasses technology to quickly understand the content of the other party's speech through voice recognition, translation, and display, thereby improving work efficiency.

[0003] The AR glasses available today have numerous functions and complex voice links, and cannot effectively translate the content of voice recognition and display it on the AR glasses, resulting in language communication barriers and a lack of effective channels for communication in different languages, which reduces work efficiency and convenience in life. Summary of the invention

[0004] To this end, the present invention provides a monocular AR glasses based on speech translation to solve the above-mentioned problems in the prior art.

[0005] In order to achieve the above object, the present invention provides the following technical solutions:

[0006] According to a first aspect of the present invention, a monocular AR glasses based on voice translation include an AR glasses leg, wherein the AR glasses leg is fixed to the side of the original glasses leg through a fixing bracket, a magnetic sheet is arranged on the surface of the AR glasses leg, the AR glasses leg is communicatively connected to a Bluetooth chip via a Bluetooth antenna, a dual microphone is arranged on the front of the AR glasses leg, a speaker is arranged on the surface of the AR glasses leg, a storage chip is arranged inside the AR glasses leg, an AR optical machine is arranged at one end of the AR glasses leg, a waveguide is fixed in the middle of the AR optical machine, a battery is arranged inside the AR glasses leg, the battery is connected to a charging chip, and a USB TYPE-C interface is arranged on the surface of the AR glasses leg.

[0007] Furthermore, the fixing bracket and the magnetic sheet of the AR glasses leg are magnetically connected, the fixing bracket and the AR glasses leg are respectively located on both sides of the original glasses leg, and the AR glasses leg can be added to the original glasses leg of myopia glasses or sunglasses.

[0008] Furthermore, the Bluetooth chip connects the AR glasses leg to the mobile phone via a Bluetooth antenna, thereby establishing a transmission channel between the AR glasses leg and the mobile phone APP.

[0009] Furthermore, the AR glasses leg picks up sound with dual microphones, sends the sound to the mobile phone APP via a Bluetooth chip, and the speaker of the AR glasses leg plays the audio.

[0010] Furthermore, when in use, when in the voice online translation state, the mobile phone APP is decompressed by the algorithm and transmitted to the cloud, and the voice is transcribed and translated and output to the mobile phone.

[0011] Furthermore, when in use, in the voice offline translation state, the mobile phone APP decompresses the language and text set by the voice translation through an algorithm and outputs it to the mobile phone.

[0012] Furthermore, when in use, the voice can be directly stored in the glasses, and the voice can be post-processed and converted into text to summarize or form a to-do list.

[0013] Furthermore, based on the transmission channel between the AR glasses leg and the mobile phone APP, the translated text is transmitted to the Bluetooth chip on the AR glasses leg through the mobile phone.

[0014] Furthermore, the Bluetooth chip outputs the received translated text to the AR optical machine, and the translated content is displayed on the waveguide.

[0015] Furthermore, the USB TYPE-C interface can charge the battery of the AR glasses leg, and the charging chip is used to manage and regulate power supply, battery charging and power conversion.

[0016] The present invention has the following advantages:

[0017] AR glasses legs are used for a single purpose and can be connected and fixed on different glasses legs through a fixing bracket, which increases the scope of use and provides convenience for users. At the same time, AR glasses legs are small in size and easy to carry. When in use, the AR glasses legs are picked up by dual microphones, which are synthesized by algorithms and sent to the mobile phone APP by the Bluetooth chip. When in the voice online translation state, the mobile phone APP is decompressed by the algorithm and transmitted to the cloud, and the voice is transcribed and translated and output to the mobile phone; when in the voice offline translation state, the mobile phone APP is decompressed by the algorithm and the language and text set for voice translation are output to the mobile phone. The translated text is transmitted to the Bluetooth chip on the AR glasses legs through the mobile phone, and the Bluetooth chip outputs the received translated text to the AR optical machine. Users can intuitively see the text content directly translated by the voice on the waveguide. By displaying the translated content, the practicality of AR glasses is improved, the communication barriers between people of different languages ​​are solved, and work efficiency and convenience of life are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a structural diagram of the overall front appearance of the device of the present invention;

[0019] Figure 2 This is a structural diagram of the overall external side appearance of the device of the present invention;

[0020] Figure 3 This is a structural diagram of the overall inner side appearance of the device of the present invention;

[0021] Figure 4 It is a flow chart of the device of the present invention.

[0022] In the picture: 1. AR glasses leg; 2. Fixed bracket; 4. Magnetic sheet; 5. Bluetooth chip; 6. Bluetooth antenna; 7. Dual microphones; 9. Speaker; 10. Storage chip; 11. AR optical machine; 12. Waveguide; 13. Battery; 14. Charging chip; 15. USB TYPE-C interface. DETAILED DESCRIPTION

[0023] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] Example 1

[0025] like Figures 1 to 3 As shown, a monocular AR glasses based on voice translation in an embodiment of the first aspect of the present invention includes an AR glasses leg 1, which is fixed to the side of the original glasses leg through a fixing bracket 2, a magnetic sheet 4 is arranged on the surface of the AR glasses leg 1, the AR glasses leg 1 is communication-connected with a Bluetooth chip 5 through a Bluetooth antenna 6, a dual microphone 7 is arranged on the front of the AR glasses leg 1, a speaker 9 is arranged on the surface of the AR glasses leg 1, a storage chip 10 is arranged inside the AR glasses leg 1, an AR optical machine 11 is arranged at one end of the AR glasses leg 1, a waveguide sheet 12 is fixed in the middle of the AR optical machine 11, a battery 13 is arranged inside the AR glasses leg 1, the battery 13 is connected to a charging chip 14, and a USB TYPE-C interface 15 is arranged on the surface of the AR glasses leg 1.

[0026] In the above embodiment, it should be noted that the fixing support 2 and the magnetic sheet 4 of the AR glasses leg 1 are magnetically connected, the fixing support 2 and the AR glasses leg 1 are respectively located on both sides of the original glasses leg, and the AR glasses leg 1 can be added to the original glasses leg of myopia glasses or sunglasses.

[0027] The technical effect achieved by the above embodiment is as follows: the AR glasses leg 1 is used for a single purpose, and can be connected and fixed on different glasses legs through the fixing bracket 2, thereby increasing the scope of use and providing convenience for the user. At the same time, the AR glasses leg 1 is small in size and easy to carry.

[0028] Example 2

[0029] like Figures 1 to 3 As shown, a monocular AR glasses based on voice translation includes all the contents of Example 1. In addition, the battery 13 of the AR glasses leg 1 can be charged by connecting the USB TYPE-C interface 15. The charging chip 14 is used to manage and adjust the power supply, battery charging and power conversion. The Bluetooth chip 5 connects the AR glasses leg 1 to the mobile phone through the Bluetooth antenna 6 to establish a transmission channel between the AR glasses leg 1 and the mobile phone APP.

[0030] The technical effect achieved by the above embodiment is: the battery 13 provides a power charging function for the AR glasses leg 1 to ensure the normal use of the AR optical machine 11, and the AR glasses leg 1 is paired and connected with the mobile phone through the Bluetooth chip 5 to facilitate data transmission.

[0031] Example 3

[0032] like Figures 1 to 3 As shown, a monocular AR glasses based on voice translation includes all the contents of Example 1. In addition, the AR glasses leg 1 is picked up by a dual microphone 7, which is sent to a mobile phone APP through a Bluetooth chip 5, and the speaker 9 of the AR glasses leg 1 plays the audio.

[0033] The technical effect achieved by the above embodiment is that the dual microphone 7 can increase the sound pickup intensity and improve the sound pickup accuracy through microphones in different directions, thereby ensuring the quality of voice pickup and helping to improve the accuracy of voice recognition and translation.

[0034] Example 4

[0035] like Figures 1 to 3 As shown, a monocular AR glasses based on voice translation includes all the contents of Example 1. In addition, when in use, when in the voice online translation state, the mobile phone APP is decompressed by an algorithm and transmitted to the cloud, and the voice is transcribed and translated and output to the mobile phone; when in the voice offline translation state, the mobile phone APP is decompressed by an algorithm and the language and text set by the voice translation are output to the mobile phone.

[0036] The technical effect achieved by the above embodiment is: the device can be used in two states: online voice translation and offline voice translation. The voice data is transcribed and translated in the mobile phone APP. In the offline voice translation state, the set language can be translated into text even when there is no network connection. In the online voice translation state, the voice data can also be uploaded to the cloud for recording and preservation.

[0037] Example 5

[0038] like Figures 1 to 3As shown, a monocular AR glasses based on voice translation includes all the contents of Example 1. In addition, based on the transmission channel between the AR glasses leg 1 and the mobile phone APP, the translated text is transmitted to the Bluetooth chip 5 on the AR glasses leg 1 through the mobile phone, and the Bluetooth chip 5 outputs the received translated text to the AR optical machine 11, and the translated content is displayed on the waveguide 12.

[0039] The technical effect achieved by the above embodiment is: the translated content is quickly transmitted back to the AR glasses leg 1 through the Bluetooth chip 5, and the user can intuitively see the text content directly translated by the voice on the waveguide 12. By displaying the translated content, the communication barriers between people of different languages ​​are solved, and work efficiency and life convenience are improved.

Claims

1. A monocular AR glasses based on speech translation, characterized by: The AR glasses leg (1) comprises an AR glasses leg (1), wherein the AR glasses leg (1) is fixed to the side of the original glasses leg (3) via a fixing bracket (2), a magnetic sheet (4) is arranged on the surface of the AR glasses leg (1), the AR glasses leg (1) is communicatively connected to a Bluetooth chip (5) via a Bluetooth antenna (6), a dual microphone (7) is arranged on the front of the AR glasses leg (1), a speaker (9) is arranged on the surface of the AR glasses leg (1), a storage chip (10) is arranged inside the AR glasses leg (1), an AR optical machine (11) is arranged at one end of the AR glasses leg (1), a waveguide sheet (12) is fixed in the middle of the AR optical machine (11), a battery (13) is arranged inside the AR glasses leg (1), the battery (13) is connected to a charging chip (14), and a USB TYPE-C interface (15) is arranged on the surface of the AR glasses leg (1).

2. The monocular AR glasses based on speech translation according to claim 1, characterized in that: The fixing bracket (2) and the magnetic sheet (4) of the AR glasses leg (1) are magnetically connected; the fixing bracket (2) and the AR glasses leg (1) are respectively located on both sides of the original glasses leg; and the AR glasses leg (1) can be added to the original glasses leg of myopia glasses or sunglasses.

3. The monocular AR glasses based on speech translation according to claim 1, characterized in that: The Bluetooth chip (5) connects the AR glasses leg (1) to the mobile phone via the Bluetooth antenna (6), thereby establishing a transmission channel between the AR glasses leg (1) and the mobile phone APP.

4. The monocular AR glasses based on speech translation according to claim 1, characterized in that: The AR glasses leg (1) picks up sound through the dual microphones (7), sends the sound to the mobile phone APP through the Bluetooth chip (5), and the speaker (9) of the AR glasses leg (1) plays the audio; When in use, in the state of online voice translation, the mobile phone APP is decompressed by the algorithm and transmitted to the cloud, and the voice is transcribed and translated and output to the mobile phone; When in use, in the offline voice translation state, the mobile phone APP decompresses the language and text set by the voice translation through the algorithm and outputs it to the mobile phone; When in use, the voice can be directly stored in the glasses, and the voice can be post-processed and converted into text to summarize or form a to-do list.

5. The monocular AR glasses based on speech translation according to claim 1, characterized in that: Based on the transmission channel between the AR glasses leg (1) and the mobile phone APP, the translated text is transmitted to the Bluetooth chip (5) on the AR glasses leg (1) through the mobile phone.

6. The monocular AR glasses based on speech translation according to claim 1, characterized in that: The Bluetooth chip (5) outputs the received translated text to the AR optical machine (11), and the translated content is displayed on the waveguide plate (12).

7. The monocular AR glasses based on speech translation according to claim 1, characterized in that: The connected USB TYPE-C interface (15) is used to charge the battery (13) of the AR glasses leg (1), and the charging chip (14) is used to manage and regulate power supply, battery charging and power conversion.