Emergency help gesture recognition and remote translation bracelet for deaf-mute

Abstract

The invention relates to the field of intelligent wearable equipment, and discloses a gesture recognition and remote translation bracelet for emergency help of a deaf-mute. Comprising a bracelet body, a gesture recognition module, a central processing module, a translation module, a communication module, an alarm module, a display module and a power module, the gesture recognition module comprises a plurality of miniature cameras and an inertial sensor, and a deep learning neural network model is placed in the central processing module; the hand ring body comprises a display screen assembly and two belts, the surface of one belt is provided with a plurality of buckles, one end of the other belt is provided with a hoop, and the other end of the other belt is provided with a translation module; the gesture image information acquired by the plurality of micro cameras is fused with the dynamic data acquired by the inertial sensor, so that the recognition effect on the complex emergency help-seeking gesture is better, the help-seeking intention of the deaf-mute can be quickly and accurately captured, the position information of the user is synchronously transmitted, and quick response and rescue are realized.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent wearable devices, and specifically is a wristband for the deaf-mute to recognize emergency help gestures and perform remote translation. Background Art

[0002] Deaf-mute individuals face numerous communication barriers in their daily lives, especially in emergencies (such as sudden illness or threats to personal safety). They struggle to accurately express their needs and obtain assistance through language. Existing communication assistance devices, such as simple graphic communication boards and mobile translation software, are cumbersome to operate and slow to respond in emergencies, making them unable to quickly provide assistance. Furthermore, some gesture recognition devices have low accuracy for complex gestures and lack real-time interaction with the outside world or emergency rescue linkage capabilities.

[0003] Therefore, there is an urgent need for a device that can quickly identify the emergency help gestures of the deaf and mute people, and promptly translate and transmit the gesture information to external rescue personnel to ensure the life safety and communication needs of the deaf and mute group. Summary of the Invention

[0004] The purpose of the present invention is to provide a hand ring for deaf-mute people to recognize and translate emergency help gestures in order to solve the above-mentioned problem of deaf-mute people seeking emergency help.

[0005] The technical solution adopted by the present invention is as follows: a deaf-mute emergency help gesture recognition and remote translation bracelet, including a bracelet body, a gesture recognition module, a central processing module, a translation module, a communication module, an alarm module, a display module and a power module. The gesture recognition module includes multiple micro cameras and inertial sensors. A deep learning neural network model is placed inside the central processing module, and the translation module is used to convert gesture information into text and voice. The bracelet body includes a display screen assembly and two belts. The surface of one belt is provided with multiple buckles, and one end of the belt is provided with a clamp.

[0006] According to the above technical solution, the wristband body is made of a light and flexible material, and the surface of the wristband body is provided with operation buttons and a waterproof and breathable structure. The coordinated settings can make the wearer more comfortable when wearing it.

[0007] According to the above technical solution, the multiple micro cameras are distributed at different positions of the bracelet body to capture gestures in all directions.

[0008] According to the above technical solution, the inertial sensor is used to detect dynamic data such as acceleration and angular velocity of gesture motion.

[0009] According to the above technical solution, the central processing module trains a deep learning neural network model based on a large amount of hand gesture data commonly used by deaf-mute people.

[0010] According to the above technical solution, the translation module pre-stores a sign language-text and sign language-speech translation database.

[0011] According to the above technical solution, the communication module supports 4G / 5G, Wi-Fi, Bluetooth and satellite communications, and can automatically switch according to the network environment.

[0012] According to the above technical solution, the alarm module includes an audible and visual alarm and a vibration motor, the display module adopts a flexible OLED display screen, the power module adopts a high-capacity rechargeable lithium battery and supports wireless charging, and a power shell is provided on the surface of the power module corresponding to the display screen assembly.

[0013] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0014] 1. By fusing gesture image information collected by multiple micro cameras with dynamic data obtained by inertial sensors and using a deep learning neural network model for analysis and processing, the accuracy and speed of gesture recognition are significantly improved, especially for the recognition of complex emergency gestures. It can quickly and accurately capture the help-seeking intentions of deaf-mute people.

[0015] 2. The communication module supports multiple communication methods and can automatically and intelligently switch according to the network environment to ensure the reliable transmission of emergency information. At the same time, the bracelet establishes a linkage mechanism with the preset emergency contacts and rescue platform. When the emergency alarm is triggered, it not only sends the translated gesture information, but also simultaneously transmits the user's location information, enabling rapid response and rescue. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a schematic diagram of the main structure of the wristband for emergency help gesture recognition and remote translation for the deaf-mute of the present invention;

[0017] Figure 2 This is a schematic diagram of the side structure of the wristband in the present invention;

[0018] Figure 3 This is a schematic diagram of the internal structure of the display screen assembly in the present invention;

[0019] Figure 4 Schematic diagram of the wearing structure of the present invention;

[0020] Figure 5 This is a schematic diagram of the communication process structure in the present invention.

[0021] Markings in the figure: 1. Bracelet body; 2. Wrist; 3. Display screen assembly; 4. Belt; 5. Buckle; 6. Clamp; 7. Micro camera; 8. Waterproof and breathable structure; 9. Power supply shell; 10. Inertial sensor; 11. Display module; 12. Gesture recognition module; 13. Power supply module; 14. Central processing module; 15. Alarm module; 16. Pre-storage module; 17. Communication module; 18. Bluetooth module. DETAILED DESCRIPTION

[0022] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0023] Example:

[0024] Reference Figure 1-3 , a deaf-mute emergency help gesture recognition and remote translation bracelet, including a bracelet body 1, a gesture recognition module 12, a central processing module 14, a translation module, a communication module 17, an alarm module 15, a display module 11 and a power module 13, the gesture recognition module 12 includes multiple micro cameras 7 and inertial sensors 10, a deep learning neural network model is placed inside the central processing module 14, and the translation module is used to convert gesture information into text and voice, and the bracelet body 1 includes a display screen assembly 3 and two belts 4, a belt 4 is provided with multiple buckles 5 on the surface, and a belt 4 is provided with a clamp 6 at one end, 12 cooperates with multiple 7 and 10 for collecting gesture images and dynamic data, and the structure cooperates with 14 for recognizing gesture information, the communication module 17 supports multiple communication methods, the alarm module 15 is used to send an alarm signal, the display module 11 is used to display the translated text information, and the power module 13 provides power for the bracelet.

[0025] Reference Figure 1-3 The wristband body 1 is made of light and flexible material, and the surface of the wristband body 1 is provided with operation buttons and a waterproof and breathable structure 8. The setting of 8 can make the wearer more comfortable when wearing.

[0026] Reference Figure 1-3 , multiple micro cameras 7 are distributed in different positions of the bracelet body 1 for capturing gestures in all directions.

[0027] Reference Figure 1-4 The inertial sensor 10 is used to detect dynamic data such as acceleration and angular velocity of gesture motion.

[0028] Reference Figure 1-3 The central processing module 14 trains a deep learning neural network model based on a large amount of hand gesture data commonly used by deaf and mute people.

[0029] Reference Figure 1-3 ,The translation module pre-stores the sign language-text and sign language-speech translation databases.

[0030] Reference Figure 1-5 The communication module 17 supports 4G / 5G, Wi-Fi, Bluetooth and satellite communications, and can automatically switch according to the network environment.

[0031] Reference Figure 1-3 The alarm module 15 includes an audible and visual alarm and a vibration motor, the display module 11 adopts a flexible OLED display screen, the power module 13 adopts a high-capacity rechargeable lithium battery and supports wireless charging, and a power shell 9 is provided on the surface of the power module 13 corresponding to the display screen assembly 3.

[0032] The implementation principle of the embodiment of the deaf-mute emergency help gesture recognition and remote translation wristband of the present invention is as follows:

[0033] In actual use, the user wears the bracelet on their wrist. When a user makes a pre-set emergency help gesture in an emergency, multiple micro-cameras on the bracelet capture gesture images from different angles, and inertial sensors detect dynamic data of the gesture movement. This information is transmitted in real time to the central processing module. The central processing module uses a built-in deep learning neural network model to analyze and process the collected information, quickly identifying the gesture type. If it is an emergency help gesture, the central processing module immediately triggers the alarm module, emitting an audible and visual alarm signal and activating a vibration motor to attract the attention of nearby personnel. Simultaneously, the central processing module transmits the gesture information to the translation module, which converts the gesture information into text and speech based on a pre-stored translation database. The translated text is clearly displayed on the display module, and the voice information is automatically transmitted to the pre-set emergency contact or rescue platform through the communication module, automatically selecting the appropriate communication method based on the current network environment, such as 4G / 5G, Wi-Fi, or satellite communication. Rescuers can use this information to promptly understand the user's needs and implement rescue operations.

[0034] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A handband for hand gesture recognition and remote translation for emergency help requests for the deaf and dumb, comprising a handband body (1), a hand gesture recognition module (12), a central processing module (14), a translation module, a communication module (17), an alarm module (15), a display module (11) and a power module (13), characterized in that: The gesture recognition module (12) includes a plurality of micro cameras (7) and an inertial sensor (10), a deep learning neural network model is placed inside the central processing module (14), and the translation module is used to convert gesture information into text and voice, and the wristband body (1) includes a display screen component (3) and two belts (4), a surface of one belt (4) is provided with a plurality of buckles (5), and one end of the one belt (4) is provided with a clamp (6).

2. The deaf-mute emergency help gesture recognition and remote translation bracelet as claimed in claim 1, characterized in that: The wristband body (1) is made of a light and flexible material, and the surface of the wristband body (1) is provided with operation buttons and a waterproof and breathable structure (8).

3. The wristband for emergency help gesture recognition and remote translation for the deaf and mute according to claim 1, characterized in that: The multiple micro cameras (7) are distributed at different positions of the bracelet body (1).

4. The wristband for emergency help gesture recognition and remote translation for the deaf and mute according to claim 1, characterized in that: The inertial sensor (10) is used to detect dynamic data such as acceleration and angular velocity of gesture movement.

5. The wristband for emergency help gesture recognition and remote translation for the deaf-mute according to claim 1, characterized in that: The central processing module (14) trains a deep learning neural network model based on a large amount of hand gesture data commonly used by deaf-mute people.

6. The wristband for emergency help gesture recognition and remote translation for the deaf and mute according to claim 1, characterized in that: The translation module pre-stores a sign language-text and sign language-speech translation database.

7. The wristband for emergency help gesture recognition and remote translation for the deaf and mute according to claim 1, characterized in that: The communication module (17) supports 4G / 5G, Wi-Fi, Bluetooth and satellite communications, and can automatically switch according to the network environment.

8. The wristband for emergency help gesture recognition and remote translation for the deaf and mute according to claim 1, characterized in that: The alarm module (15) includes an audible and visual alarm and a vibration motor, the display module (11) uses a flexible OLED display screen, the power module (13) uses a high-capacity rechargeable lithium battery and supports wireless charging, and a power supply housing (9) is provided on the surface of the power module (13) corresponding to the display screen assembly (3).

Images