Intelligent auxiliary glasses system for deaf-mute

Abstract

The utility model relates to an intelligent auxiliary glasses system for a deaf-mute. The intelligent auxiliary glasses system comprises a central control module, a sign language detection module, a voice playing module, an environment detection module, a sound detection module, a display module and a vibration module, the central control module is connected with the sign language detection module, the voice playing module, the environment detection module, the sound detection module, the display module and the vibration module. The intelligent auxiliary glasses system provided by the utility model has comprehensive functions, and can fully consider the safety problem of deaf-mute people going out.

Description

Technical Field

[0001] The utility model relates to the technical field of intelligent glasses, in particular to an intelligent auxiliary glasses system for deaf-mute people. Background Art

[0002] The deaf-mute people are a special group. Since they cannot communicate like normal people, they need to use current technology to help the deaf-mute group so that they can communicate with others normally. In addition, the deaf-mute people also face greater safety issues when traveling. For example, in their daily travel, the deaf-mute people face potential safety hazards because they cannot hear traffic signals and vehicle sounds.

[0003] In recent years, with the issuance of national policies and the strong appeal of relevant departments, the attention paid to the travel and safety issues of the deaf-mute people in China has been increasing, which has inspired the enthusiasm of technicians to study wearable smart devices for the deaf-mute. There are many research directions for wearable devices for the deaf-mute in China. However, the development time of wearable smart devices for the deaf-mute is relatively short, and their functions are generally single. There is no mature product, and there is a lack of an integrated wearable device that can ensure the safety of the deaf-mute and achieve barrier-free communication. Utility Model Content

[0004] To this end, the technical problem to be solved by the utility model is to overcome the problem that the wearable smart devices for the deaf-mute in the prior art have single functions and do not fully consider the problem of safe travel for the deaf-mute.

[0005] In order to solve the above technical problems, the utility model provides an intelligent auxiliary glasses system for deaf-mute people, comprising a central control module, a sign language detection module, a voice playback module, an environment detection module, a sound detection module, a display module and a vibration module; the central control module is respectively connected with the sign language detection module, the voice playback module, the environment detection module, the sound detection module, the display module and the vibration module;

[0006] The sign language detection module is used to detect the sign language movements of the deaf-mute person and transmit them to the central control module, the central control module is used to translate the sign language movements of the deaf-mute person detected by the sign language detection module into a first text sequence, and the voice playback module is used to broadcast the first text sequence obtained by the central control module to other people in the form of voice;

[0007] The environment detection module is used to detect the environment information around the deaf-mute person and transmit it to the central control module, the central control module is used to convert the environment information detected by the environment detection module into a second text sequence, the display module is used to display the second text sequence obtained by the central control module, and the deaf-mute person receives the second text sequence information through the display module;

[0008] The sound detection module is used to detect the sounds around the deaf-mute and transmit them to the central control module, the central control module is used to convert the vehicle horn sounds around the deaf-mute detected by the sound detection module into a third text sequence, and at the same time translate the speech sounds of other people communicating with the deaf-mute detected by the sound detection module into a fourth text sequence, the display module is used to display the third text sequence and the fourth text sequence obtained by the central control module, and the deaf-mute receives the third text sequence and the fourth text sequence information through the display module;

[0009] The central control module is also used to control the vibration module to vibrate to provide safety reminders to the deaf-mute according to the environmental information around the deaf-mute detected by the environmental detection module or the vehicle horn sounds around the deaf-mute detected by the sound detection module.

[0010] In one embodiment of the utility model, the central control module includes a control chip, a sign language translation unit, a recognition unit, a whistle sound detection unit and a speech translation unit; the control chip is connected to the sign language translation unit, the recognition unit and the whistle sound detection unit respectively;

[0011] The sign language translation unit is used to translate the sign language movements of the deaf-mute person detected by the sign language detection module to obtain a first text sequence; the control chip is used to broadcast the first text sequence obtained by the sign language translation unit to other people through the voice playback module;

[0012] The recognition unit is used to perform vehicle recognition based on the environmental information detected by the environmental detection module, and the control chip is used to display the vehicle recognition result obtained by the recognition unit on the display module through a second text sequence;

[0013] The whistle sound detection unit is used to determine whether the sound detection module has received a vehicle whistle sound, and the control chip is used to display the vehicle whistle sound determined by the whistle sound detection unit on the display module through a third text sequence;

[0014] The speech translation unit is used to translate the voices of other people communicating with the deaf-mute detected by the sound detection module into a fourth text sequence, and the control chip is used to display the fourth text sequence obtained by the speech translation unit on the display module.

[0015] In one embodiment of the utility model, the sound detection module includes a microphone, an analog-to-digital converter and an audio processor connected in sequence, the microphone is used to identify the sounds around the deaf-mute person; the analog-to-digital converter is used to convert the sounds identified by the microphone from analog signals to digital signals; the audio processor is used to amplify and filter the sounds in the form of digital signals output by the analog-to-digital converter; and the central control module is used to receive the sounds amplified and filtered by the audio processor.

[0016] In one embodiment of the utility model, the sign language detection module includes a first camera, which is connected to the central control module. The sign language detection module acquires images of the sign language movements of the deaf-mute person through the first camera.

[0017] In one embodiment of the utility model, the environment detection module includes a distance sensor and a second camera, both of which are connected to the central control module. The environment detection module detects whether there is an object directly behind the deaf-mute person within a preset distance through the distance sensor; the central control module receives information that the distance sensor detects an object within the preset distance, and turns on the second camera to acquire an image of the object.

[0018] In one embodiment of the present invention, the vibration module is provided with a vibration motor, and the vibration module realizes vibration through the vibration motor.

[0019] In one embodiment of the present invention, a power supply module is further included, wherein the power supply module is connected to the central control module and is used to supply power to the central control module.

[0020] In one embodiment of the present invention, a navigation module is further included. The navigation module is connected to the central control module and adopts a GPS navigation system or a Beidou navigation system.

[0021] In one embodiment of the present invention, a communication module connected to the central control module is further included, and the communication module is wirelessly connected to a mobile terminal independent of the smart auxiliary glasses system.

[0022] In one embodiment of the present invention, the voice playing module is a speaker.

[0023] The above technical solution of the utility model has the following advantages compared with the prior art:

[0024] The intelligent auxiliary glasses system for the deaf-mute described in the utility model can not only realize "language communication" with other people, but also quickly identify dangerous sound signals by capturing the sounds of the surrounding environment, and remind the deaf-mute in real time through the vibration module;

[0025] The intelligent sound warning system of the utility model not only enhances the deaf-mute's perception of danger, but also provides timely alarms at critical moments. It can communicate with external mobile terminals through the communication module to seek help, effectively reducing traffic safety hazards and enabling the deaf-mute to participate in daily travel more safely. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to make the content of the utility model easier to understand, the utility model is further described in detail according to the specific embodiments of the utility model in combination with the accompanying drawings, wherein

[0027] Figure 1 This is a block diagram of the intelligent auxiliary glasses system for the deaf-mute in the embodiment of the utility model;

[0028] Figure 2 This is a block diagram of the central control module in the embodiment of the utility model;

[0029] Figure 3 This is a block diagram of a sound detection module in an embodiment of the utility model;

[0030] Figure 4 This is a block diagram of a sign language detection module in an embodiment of the present utility model;

[0031] Figure 5 This is a block diagram of an environment detection module in an embodiment of the utility model;

[0032] Figure 6 It is a block diagram of the communication between the intelligent auxiliary glasses system for the deaf and dumb and the external mobile terminal in the embodiment of the utility model.

[0033] Explanation of the figure marks in the specification: 1. Central control module; 100. Control chip; 101. Sign language translation unit; 102. Recognition unit; 103. Whistle detection unit; 104. Voice translation unit 104; 2. Sign language detection module; 200. First camera; 3. Voice playback module; 4. Environment detection module; 400. Distance sensor; 401. Second camera; 5. Sound detection module; 500. Microphone; 501. Analog-to-digital converter; 502. Audio processor; 6. Display module; 7. Vibration module; 8. Power supply module; 9. Navigation module; 10. Communication module; 11. Mobile terminal. DETAILED DESCRIPTION

[0034] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments so that those skilled in the art can better understand the present invention and implement it, but the embodiments are not intended to limit the present invention.

[0035] Reference Figure 1 As shown, the utility model relates to an intelligent auxiliary glasses system for deaf-mute people, comprising a central control module 1, a sign language detection module 2, a voice playback module 3, an environment detection module 4, a sound detection module 5, a display module 6 and a vibration module 7; the central control module 1 is respectively connected to the sign language detection module 2, the voice playback module 3, the environment detection module 4, the sound detection module 5, the display module 6 and the vibration module 7.

[0036] The sign language detection module 2 is used to detect the sign language movements of the deaf-mute and transmit them to the central control module 1. The central control module 1 is used to translate the sign language movements of the deaf-mute detected by the sign language detection module 2 into a first text sequence. The voice playback module 3 is used to broadcast the first text sequence obtained by the central control module 1 to other people in the form of voice. In short, when the deaf-mute needs to communicate with other people, the sign language detection module 2 can obtain the sign language movements of the deaf-mute in real time, the central control module 1 translates the sign language movements of the deaf-mute into the first text sequence, and plays the meaning that the deaf-mute wants to express to other people through the voice playback module 3, which can effectively facilitate barrier-free communication between the deaf-mute and other people.

[0037] The environment detection module 4 is used to detect the environmental information around the deaf-mute person and transmit it to the central control module 1. The central control module 1 is used to convert the environmental information detected by the environment detection module 4 into a second text sequence. The display module 6 is used to display the second text sequence obtained by the central control module 1. The deaf-mute person receives the second text sequence information through the display module 6.

[0038] The sound detection module 5 is used to detect the sounds around the deaf-mute and transmit them to the central control module 1. The central control module 1 is used to convert the vehicle horn sounds around the deaf-mute detected by the sound detection module 5 into a third text sequence, and at the same time translate the speaking sounds of other people communicating with the deaf-mute detected by the sound detection module 5 into a fourth text sequence. The display module 6 is used to display the third text sequence and the fourth text sequence obtained by the central control module 1, and the deaf-mute receives the third text sequence and the fourth text sequence information through the display module 6.

[0039] The central control module 1 is also used to control the vibration module 7 to vibrate to provide safety reminders to the deaf-mute according to the environmental information around the deaf-mute detected by the environmental detection module 4 or the vehicle horn sounds around the deaf-mute detected by the sound detection module 5.

[0040] Specifically, the smart auxiliary glasses system of this embodiment pays more attention to the travel safety of the deaf-mute people. Therefore, the central control module 1 can detect the environmental image of the blind spot behind the deaf-mute people through the environmental detection module 4, and the central control module 1 identifies whether there is a vehicle in the environmental image through the recognition unit 102 described below. If a vehicle is identified, the central control module 1 will display the recognition result on the display module 6 through a second text sequence, for example, displaying "There is a vehicle behind, please pay attention to safety". At the same time, the control module 1 can also control the vibration module 7 to vibrate to provide safety reminders to the deaf-mute people, so as to enhance the deaf-mute people's perception of potential threats.

[0041] Specifically, the sounds around the deaf-mute detected by the sound detection module 5 are generally divided into two types, one is the speaking voice of other people who communicate normally with the deaf-mute, and the other is the sound of a car horn. First, in this embodiment, the sounds around the deaf-mute may include the sound of a car horn, which is a relatively dangerous sound, so the central control module 1 screens out the sound of a car horn through the following horn detection unit 103, and the central control module 1 displays the detected car horn on the display module 6 through the third text sequence, for example, displaying "There may be a vehicle horn nearby, please pay attention to safety", and at the same time, the central control module 1 can also control the vibration module 7 to vibrate to remind the deaf-mute of safety, so as to enhance the deaf-mute's perception of potential threats. Second, in this embodiment, the sounds around the deaf-mute may also include the speaking voice of other people who communicate and interact with the deaf-mute, so the central control module 1 can translate the speaking voice of other people into a fourth text sequence through the following voice translation unit 104, and the central control module 1 displays the fourth text sequence on the display module 6.

[0042] See also Figure 2 The central control module 1 includes a control chip 100, a sign language translation unit 101, a recognition unit 102, a whistle detection unit 103 and a speech translation unit 104; the control chip 100 is respectively connected to the sign language translation unit 101, the recognition unit 102, the whistle detection unit 103 and the speech translation unit 104. The control chip 100 of this embodiment can be an Intel Movidis Myriad X chip, a Qualcomm Snapdragon AR1 Gen 1 chip, etc.

[0043] The sign language translation unit 101 is used to translate the sign language movements of the deaf-mute detected by the sign language detection module 2 to obtain a first text sequence; the control chip 100 is used to broadcast the first text sequence obtained by the sign language translation unit 101 to other people who are communicating with the deaf-mute through the voice playback module 3. In this embodiment, the sign language translation unit 101 can be an Alexa Net model. Since the Alexa Net model is a prior art, it will not be described in detail in this embodiment.

[0044] The recognition unit 102 is used to perform vehicle recognition (mainly to recognize whether there is a vehicle behind the deaf-mute person) on the environmental information detected by the environmental detection module 4, and the control chip 100 is used to display the vehicle recognition result obtained by the recognition unit 102 on the display module 6 through a second text sequence. In this embodiment, the recognition unit 102 can be a YOLOv8 model. If the YOLOv8 model recognizes that there is a moving vehicle directly behind the deaf-mute person, the control chip 100 controls the display module 6 to display "There is a vehicle behind, please pay attention to safety". Since the YOLOv8 model is a prior art, it will not be repeated in this embodiment.

[0045] The whistle detection unit 103 is used to determine whether the sound detection module 5 receives the vehicle whistle sound, and the control chip 100 is used to display the vehicle whistle sound determined by the whistle detection unit 103 on the display module 6 through a third text sequence. In this embodiment, the whistle detection unit 103 can be an acoustic event detection system (SEDnet). If a car whistle sound is detected, the control chip 100 controls the display module 6 to display a third text sequence: for example, "There may be a vehicle whistle nearby, please pay attention to safety." Since the acoustic event detection system (SEDnet) is a prior art, it will not be repeated in this embodiment.

[0046] The speech translation unit 104 is used to translate the voice of other people communicating with the deaf-mute detected by the sound detection module 5 into a fourth text sequence, and the control chip 100 is used to display the fourth text sequence obtained by the speech translation unit 104 on the display module 6. The speech translation unit 104 of this embodiment is an open source framework Mozilla DeepSpeech, which can convert the voice of other people into text. Since Mozilla DeepSpeech is a prior art, it will not be described in detail in this embodiment.

[0047] See also Figure 3 The sound detection module 5 includes a microphone 500, an analog-to-digital converter 501 and an audio processor 502 connected in sequence. The microphone 500 is used to identify the sounds around the deaf-mute; the analog-to-digital converter 501 is used to convert the sounds identified by the microphone 500 from analog signals to digital signals; the audio processor 502 is used to amplify and filter the sounds in the form of digital signals output by the analog-to-digital converter 501; and the central control module 1 is used to receive the sounds amplified and filtered by the audio processor 502. The chip model used by the audio processor of this embodiment is a TDA1547 chip or a DU562 chip.

[0048] See also Figure 4 The sign language detection module 2 includes a first camera 200, which is connected to the central control module 1. The sign language detection module 2 acquires images of the sign language movements of the deaf-mute person through the first camera 200.

[0049] See also Figure 5, the environment detection module 4 includes a distance sensor 400 and a second camera 401, both of which are connected to the central control module 1. The environment detection module 4 detects whether there is an object behind the deaf-mute person within a preset distance through the distance sensor 400; the central control module 1 receives the information that the distance sensor 400 detects an object within the preset distance, and turns on the second camera 401 to obtain the object image, and performs type detection on the object image taken by the second camera 401 through the recognition unit 102. If the object is detected to be a vehicle, the control chip 100 controls the display module 6 to display "There is a vehicle behind, please pay attention to safety". In this embodiment, the second camera 401 is usually set directly behind the smart auxiliary glasses system (corresponding to the back of the deaf-mute's head). The purpose of this is to ensure the travel safety of the deaf-mute as much as possible, and at the same time, it can avoid the second camera 401 from taking images in real time, effectively saving energy consumption.

[0050] The vibration module 7 is provided with a vibration motor, and the vibration module 7 realizes vibration through the vibration motor.

[0051] This embodiment further includes a power supply module 8 , which is connected to the central control module 1 , and is used to supply power to the central control module 1 .

[0052] In this embodiment, the power supply module 8 is a battery, which uses a lithium polymer (Li-Po) or lithium ion (Li-Ion) battery, and the voltage is generally between 3.7 V and 4.2 V. When the power of the power supply module 8 is less than 20%, the central control module 1 reminds the deaf-mute person through the display module 6 that the power is low and needs to be charged in time.

[0053] The present embodiment further includes a navigation module 9, which is connected to the central control module 1 and is a module based on the GPS navigation system or the Beidou navigation system. In actual use, the central control module 1 receives navigation information from the navigation module 9 and displays the navigation information through the display module 6.

[0054] See also Figure 6, this embodiment also includes a communication module 10 connected to the central control module 1, and the communication module 10 is wirelessly connected to a mobile terminal 11 independent of the intelligent auxiliary glasses system (i.e., wireless communication). The communication module 10 of this embodiment is a communication module based on 4G or 5G, and the mobile terminal 11 can be a mobile phone or tablet computer with 4G or 5G communication function. The central control module 1 communicates with the external mobile terminal 11 through the communication module 10, and the holder of the mobile terminal 11 can be the family or guardian of the deaf-mute. The intelligent auxiliary glasses system of this embodiment can be provided with a safety button connected to the central control module 1. When the deaf-mute encounters an emergency or dangerous situation, the central control module 1 is triggered by pressing the safety button to send the current navigation module 9 positioning information and SMS messages to the external mobile terminal 11 through the communication module 10. The SMS messages are usually pre-edited content, such as SMS messages such as "I encountered an emergency and requested help". After the holder of the mobile terminal 11 receives the positioning information and SMS messages of the deaf-mute, he can go to the scene to help the deaf-mute. In other embodiments, under the condition of the control chip 100, an APP such as WeChat can be installed in the display module 6. After the deaf-mute person presses the safety button, the central control module 1 sends the WeChat message to the mobile terminal 11 through the communication module 10 to request help.

[0055] The voice playing module 3 in this embodiment is a speaker.

[0056] The display module 6 of this embodiment is an OLED display screen.

[0057] Obviously, the above embodiments are merely examples for the purpose of clear explanation and are not intended to limit the implementation methods. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the implementation methods here. The obvious changes or modifications derived from these are still within the scope of protection of the invention of the utility model.

Claims

1. An intelligent auxiliary glasses system for the deaf and dumb, characterized by: The device comprises a central control module (1), a sign language detection module (2), a voice playing module (3), an environment detection module (4), a sound detection module (5), a display module (6) and a vibration module (7); the central control module (1) is connected to the sign language detection module (2), the voice playing module (3), the environment detection module (4), the sound detection module (5), the display module (6) and the vibration module (7) respectively; The sign language detection module (2) is used to detect the sign language movements of the deaf-mute person and transmit them to the central control module (1); the central control module (1) is used to translate the sign language movements of the deaf-mute person detected by the sign language detection module (2) into a first text sequence; and the voice playback module (3) is used to broadcast the first text sequence obtained by the central control module (1) to other people in the form of voice; The environment detection module (4) is used to detect the environment information around the deaf-mute person and transmit it to the central control module (1); the central control module (1) is used to convert the environment information detected by the environment detection module (4) into a second text sequence; the display module (6) is used to display the second text sequence obtained by the central control module (1); the deaf-mute person receives the second text sequence information through the display module (6); The sound detection module (5) is used to detect the sounds around the deaf-mute and transmit them to the central control module (1); the central control module (1) is used to convert the vehicle horn sounds around the deaf-mute detected by the sound detection module (5) into a third text sequence, and at the same time translate the speech sounds of other people communicating with the deaf-mute detected by the sound detection module (5) into a fourth text sequence; the display module (6) is used to display the third text sequence and the fourth text sequence obtained by the central control module (1); the deaf-mute receives the third text sequence and the fourth text sequence information through the display module (6); The central control module (1) is also used to control the vibration module (7) to vibrate so as to provide a safety reminder to the deaf-mute according to the environmental information around the deaf-mute detected by the environmental detection module (4) or the vehicle horn sound around the deaf-mute detected by the sound detection module (5).

2. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The central control module (1) comprises a control chip (100), a sign language translation unit (101), a recognition unit (102), a whistle sound detection unit (103) and a speech translation unit (104); the control chip (100) is connected to the sign language translation unit (101), the recognition unit (102), the whistle sound detection unit (103) and the speech translation unit (104) respectively; The sign language translation unit (101) is used to translate the sign language movements of the deaf-mute person detected by the sign language detection module (2) to obtain a first text sequence; the control chip (100) is used to broadcast the first text sequence obtained by the sign language translation unit (101) to other people through the voice playback module (3); The recognition unit (102) is used to perform vehicle recognition based on the environmental information detected by the environmental detection module (4), and the control chip (100) is used to display the vehicle recognition result obtained by the recognition unit (102) on the display module (6) through a second text sequence; The whistle sound detection unit (103) is used to determine whether the sound detection module (5) has received a vehicle whistle sound, and the control chip (100) is used to display the vehicle whistle sound determined by the whistle sound detection unit (103) on the display module (6) through a third text sequence; The speech translation unit (104) is used to translate the voice of other persons communicating with the deaf-mute person detected by the sound detection module (5) into a fourth text sequence, and the control chip (100) is used to display the fourth text sequence obtained by the speech translation unit (104) on the display module (6).

3. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The sound detection module (5) comprises a microphone (500), an analog-to-digital converter (501) and an audio processor (502) which are connected in sequence, wherein the microphone (500) is used to identify the sounds around the deaf-mute person; the analog-to-digital converter (501) is used to convert the sounds identified by the microphone (500) from analog signals into digital signals; the audio processor (502) is used to amplify and filter the sounds in the form of digital signals output by the analog-to-digital converter (501); and the central control module (1) is used to receive the sounds amplified and filtered by the audio processor (502).

4. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The sign language detection module (2) comprises a first camera (200), the first camera (200) being connected to the central control module (1), and the sign language detection module (2) acquires images of the sign language movements of the deaf-mute person through the first camera (200).

5. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The environment detection module (4) comprises a distance sensor (400) and a second camera (401), both of which are connected to the central control module (1). The environment detection module (4) detects whether there is an object directly behind the deaf-mute person within a preset distance through the distance sensor (400); the central control module (1) receives information that the distance sensor (400) detects an object within the preset distance, and turns on the second camera (401) to acquire an image of the object.

6. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The vibration module (7) is provided with a vibration motor, and the vibration module (7) achieves vibration through the vibration motor.

7. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: It also comprises a power supply module (8), wherein the power supply module (8) is connected to the central control module (1), and the power supply module (8) is used to supply power to the central control module (1).

8. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: It also comprises a navigation module (9), the navigation module (9) being connected to the central control module (1), and the navigation module (9) adopts a GPS navigation system or a Beidou navigation system.

9. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: It also includes a communication module (10) connected to the central control module (1), wherein the communication module (10) is wirelessly connected to a mobile terminal (11) independent of the intelligent auxiliary glasses system.

10. The intelligent auxiliary glasses system for the deaf-mute according to claim 1, characterized in that: The voice playing module (3) is a loudspeaker.

Images