Legal sign language translation device and equipment

Abstract

The utility model discloses a legal sign language translation device and equipment, and relates to the technical field of electronic equipment, the legal sign language translation device comprises a voice module, a bending sensor, an attitude sensor and a signal processing module; the signal processing module is connected with the voice module, bending sensors arranged on all fingers on the palm and a posture sensor arranged on the palm of the user. The real-time posture of the palm of a user is collected through the posture sensor, the bending degree of each finger on the palm is collected through the bending sensor, and the electric signals are transmitted to the signal processing module, so that the signal processing module sends corresponding voice signals to the voice module; therefore, the voice module can play the voice corresponding to the legal sign language formed by the palm and the fingers at present. The legal sign language used by a user can be directly converted into voice, so that the user can quickly communicate with people who do not understand the legal sign language through played semantics, and the deaf-mute can be better helped to carry out legal consultation.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronic equipment, in particular to a legal sign language translation device and equipment. BACKGROUND

[0002] In the prior art, the deaf and mute people face communication barriers in daily life and usually need to communicate with others in sign language. However, most normal people do not learn sign language, so the deaf and mute people need to use other auxiliary equipment to quickly communicate with objects. Especially when the deaf and mute people need to consult the law, lawyers and other legal professionals usually do not learn sign language and are more unfamiliar with legal sign language, which makes it difficult for the deaf and mute people to consult the law. CONTENT OF THE UTILITY MODEL

[0003] The main purpose of the present application is to provide a legal sign language translation device and equipment, which aims to solve the technical problem of how to make it more convenient and clear for the deaf and mute people to consult the law.

[0004] To achieve the above purpose, the present application provides a legal sign language translation device, which comprises a voice module, a bending sensor, a posture sensor and a signal processing module.

[0005] The signal processing module is connected to the voice module, the bending sensor and the posture sensor respectively.

[0006] The posture sensor is arranged on the palm of the user and is used to collect the real-time posture of the palm and send the corresponding posture signal to the signal processing module.

[0007] The bending sensor is arranged on each finger of the palm and is used to collect the bending degree of each finger and send the corresponding bending signal to the signal processing module.

[0008] The signal processing module is used to send the corresponding voice signal to the voice module when receiving the posture signal and the bending signal.

[0009] The voice module is used to play the corresponding voice of the legal sign language composed of the palm and the fingers when receiving the voice signal.

[0010] Further, in this embodiment, the signal processing module comprises a controller and a voltage dividing unit.

[0011] The voltage dividing unit is connected to the bending sensor and the controller respectively, and the controller is also connected to the posture sensor and the voice module respectively.

[0012] The voltage dividing unit is configured to divide each of the bending signals transmitted by the bending sensors and transmit the divided bending signals to the controller.

[0013] The controller is configured to send the voice signal to the voice module upon receiving the divided bending signals and the gesture signal.

[0014] Further, in the embodiment, the controller comprises an RK3588 chip.

[0015] Further, in the embodiment, the RK3588 chip is further configured to connect to an upper computer through a serial bus and exchange information with the upper computer.

[0016] Further, in the embodiment, the legal sign language translation device further comprises a display module.

[0017] The display module is connected to the signal processing module.

[0018] The signal processing module is further configured to send a corresponding display signal to the display module upon receiving the gesture signal and each of the bending signals.

[0019] The display module is configured to display the corresponding text of the legal sign language formed by the palm and each of the fingers upon receiving the display signal.

[0020] Further, in the embodiment, the bending sensors comprise first to fifth acquisition units and an analog-to-digital conversion unit.

[0021] The first to fifth acquisition units are arranged one-to-one on each of the fingers on the palm.

[0022] The analog-to-digital conversion unit is connected to the first to fifth acquisition units and the signal processing module.

[0023] The analog-to-digital conversion unit is configured to convert analog bending acquisition signals formed by the first to fifth acquisition units collecting the bending degrees of each finger into digital bending signals and transmit the bending signals to the signal processing module.

[0024] Further, in the embodiment, the legal sign language translation device further comprises a visual acquisition module.

[0025] The visual acquisition module is connected to the signal processing module.

[0026] The visual acquisition module is configured to acquire images of the palm and the fingers and send corresponding visual signals to the signal processing module.

[0027] The signal processing module is further configured to send corresponding voice signals to the voice module when the visual signals are received.

[0028] Further, in this embodiment, the legal sign language translation device further comprises a Bluetooth module.

[0029] The Bluetooth module is connected to the signal processing module, and the Bluetooth module is further wirelessly connected to an external device.

[0030] The Bluetooth module is configured to receive external signals transmitted by the external device and transmit the external signals to the signal processing module.

[0031] The signal processing module is further configured to send corresponding voice signals to the voice module when the external signals, the posture signals, and the bending signals are received.

[0032] Further, in this embodiment, the bending sensor is a Flex2.2 bending sensor.

[0033] In addition, to achieve the above-mentioned purpose, the present application also provides a legal sign language translation device, which adopts the legal sign language translation device as described above.

[0034] This application provides a legal sign language translation device and apparatus. The legal sign language translation device includes: a voice module, a bending sensor, a posture sensor, and a signal processing module. The signal processing module is connected to the voice module, the bending sensor, and the posture sensor. The posture sensor is disposed on the user's palm and is used to collect the real-time posture of the palm and send the corresponding posture signal to the signal processing module. The bending sensor is disposed on each finger of the palm and is used to collect the degree of bending of each finger and send the corresponding bending signal to the signal processing module. The signal processing module is used to send the corresponding voice signal to the voice module when it receives the posture signal and the bending signal. The voice module is used to play the voice corresponding to the legal sign language formed by the palm and the fingers when it receives the voice signal. By collecting the real-time posture of the user's palm through the posture sensor and the degree of bending of each finger on the palm through the bending sensor, and transmitting the data as electrical signals to the signal processing module, the signal processing module can send the corresponding voice signal to the voice module, thereby enabling the voice module to play the voice corresponding to the legal sign language formed by the current palm and fingers. It can directly convert legal sign language used by users into speech, thereby enabling rapid communication with people who do not understand legal sign language through the played semantics, and better helping deaf and mute people to seek legal advice. Attached Figure Description

[0035] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0036] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 A structural connection diagram provided for Embodiment 1 of the legal sign language translation device of this application;

[0038] Figure 2 Structural connection diagram provided for Embodiment 2 of the legal sign language translation device of this application;

[0039] Figure 3 This is a structural connection diagram provided for Embodiment 3 of the legal sign language translation device of this application.

[0040] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0041] It should be understood that the specific embodiments described herein are merely for the purpose of illustration and are not intended to limit the technical solutions of the present application.

[0042] In order to better understand the technical solutions of the present application, the following will be described in detail in combination with the drawings of the specification and specific embodiments.

[0043] The present application proposes a legal sign language translation device of the first embodiment, please refer to Figure 1 , the legal sign language translation device comprises a voice module 10, a bending sensor 20, a posture sensor 30, a signal processing module 40;

[0044] The signal processing module 40 is connected to the voice module 10, the bending sensor 20 and the posture sensor 30 respectively;

[0045] The posture sensor 30 is arranged on the palm of the user, for collecting the real-time posture of the palm, and sending the corresponding posture signal to the signal processing module 40;

[0046] The bending sensor 20 is arranged on each finger on the palm, for collecting the bending degree of each finger, and sending the corresponding bending signal to the signal processing module 40;

[0047] The signal processing module 40 is used for sending the corresponding voice signal to the voice module 10 when receiving the posture signal and each bending signal;

[0048] The voice module 10 is used for playing the corresponding voice of the legal sign language composed of the palm and each finger when receiving the voice signal.

[0049] It should be noted that in the present embodiment, the posture sensor 30 can be a six-axis posture sensor 30, which is fixed on the palm of the user. It is internally integrated with a three-axis accelerometer and a three-axis gyroscope, which can measure the acceleration in three-dimensional space through the three-axis accelerometer, and obtain the corresponding velocity and displacement through integration; while the three-axis gyroscope is used to measure the angular velocity of the object, and the angle change can be obtained by integration. The current real-time posture of the user's palm is measured by combining the three-axis accelerometer and the three-axis gyroscope, and the measurement result (real-time posture of the palm) can be transmitted to the signal processing module 40 in the form of posture signal. In specific implementation, the specific model of the posture sensor 30 can be MPU6050.

[0050] It should be understood that in the embodiment, the bending sensor 20 can be a Flex2.2 bending sensor, which has the property of changing resistance according to the bending degree of the material. The bending sensor 20 can be arranged on the five fingers corresponding to the palm of the user. When the fingers are bent, the corresponding bending sensor 20 will also be bent, and the internal resistance will change, thereby generating a corresponding bending signal. The bending sensor 20 can transmit the above bending signal to the signal processing module 40.

[0051] It is easy to understand that in the embodiment, when the user is equipped with the legal sign language translation device, if the user performs a legal sign language, the posture sensor 30 can collect the real-time posture of the palm of the user in real time and send a corresponding posture signal to the signal processing module 40; usually, when performing legal sign language, the fingers on the palm will also be bent correspondingly, at this time, the bending sensor 20 located on each finger of the palm will collect the bending degree of each finger and send a corresponding bending signal to the signal processing module 40. The signal processing module 40 can determine the current posture of the palm in real time when receiving the posture signal, and determine the current bending degree of each finger of the palm in real time when receiving the bending signal. When determining the posture of the palm and the bending degree of each finger, the actual meaning of the legal sign language can be analyzed by the neural network model obtained by pre-training in the signal processing module 40, and a corresponding voice signal can be generated and transmitted to the voice module 10. The voice module 10 can play the real meaning expressed by the legal sign language in the form of voice when receiving the voice signal, so that the communication object can quickly understand the legal sign language, that is, quickly understand the real meaning that the user wants to express. In specific implementation, the model of the voice module 10 can be SYN6288.

[0052] It is worth noting that the legal sign language translation device proposed in the embodiment can be applied to the specific scene of deaf-mute people seeking legal advice, and can recognize legal sign language, thereby playing corresponding voice or displaying corresponding text. In order to better provide legal consultation services for deaf-mute people, the legal sign language that can be recognized by the device at least includes the corresponding sign language of common legal terms such as "legal person", "justifiable defense", "innocent presumption" and the like.

[0053] The application provides a legal sign language translation device, which comprises a voice module, a bending sensor, a posture sensor and a signal processing module; the signal processing module is connected with the voice module, the bending sensor and the posture sensor respectively; the posture sensor is arranged on a palm of a user and used to collect a real-time posture of the palm and send a corresponding posture signal to the signal processing module; the bending sensor is arranged on each finger on the palm and used to collect a bending degree of each finger and send a corresponding bending signal to the signal processing module; the signal processing module is used to send a corresponding voice signal to the voice module when the posture signal and the bending signal are received; and the voice module is used to play a voice corresponding to a legal sign language formed by the palm and the fingers when the voice signal is received. The real-time posture of the palm of the user is collected by the posture sensor, the bending degrees of the fingers on the palm are collected by the bending sensor, and the signals are transmitted to the signal processing module in the form of electric signals, so that the signal processing module can send a corresponding voice signal to the voice module, and the voice module can play a voice corresponding to a legal sign language formed by the current palm and fingers. The legal sign language used by the user can be directly converted into a voice, so that the user can quickly communicate with people who do not understand the legal sign language by playing the voice, and the user can better help the deaf and mute people to consult the law.

[0054] Based on the first embodiment, the same or similar contents in the second embodiment can be referred to the above description, and the subsequent description will not be repeated. On this basis, please refer to Figure 2 The signal processing module 40 comprises a controller 41 and a voltage dividing unit 42.

[0055] The voltage dividing unit 42 is connected with the bending sensor 20 and the controller 41 respectively; and the controller 41 is further connected with the posture sensor 30 and the voice module 10 respectively.

[0056] The voltage dividing unit 42 is used to divide the voltage of each bending signal transmitted by the bending sensor 20 and transmit the divided bending signal to the controller 41.

[0057] The controller 41 is used to send the voice signal to the voice module 10 when the divided bending signal and the posture signal are received.

[0058] It should be noted that in the embodiment, the signal processing module 40 can internally include a controller 41 and a voltage dividing unit 42 with driving capability. The controller 41 stores a program of the neural network model and can execute the program corresponding to the neural network model, that is, analyze and convert the posture signal and the bending signal into a voice signal. The voltage dividing unit 42 is used to limit the voltage output by the bending sensor 20 within the maximum voltage range that the controller 41 can withstand, which can prevent damage caused by the controller 41 receiving a bending signal with too high voltage, and also facilitate the controller 41 to identify the voltage to obtain the bending degree of each finger.

[0059] Notably, in the embodiment, the voltage dividing unit 42 is provided with a shunt resistor, which is used to reduce noise signals or interference signals in the circuit through the negative feedback mechanism of the shunt resistor, so as to improve the identification accuracy of the controller 41 to the voltage of the bending signal.

[0060] Further, in the embodiment, the controller 41 includes an RK3588 chip.

[0061] It is easy to understand that in the embodiment, the controller 41 can be an RK3588 chip, which has interfaces corresponding to various communication buses such as SPI bus and USART bus, and can realize the transmission and reception of various types of signals through different communication buses.

[0062] Further, in the embodiment, the RK3588 chip is also used to connect with the host computer 50 through a serial bus and interact with the host computer 50.

[0063] It is easy to understand that the host computer 50 can be a computer. In the embodiment, the controller 41 can be connected with the host computer 50 through a serial bus and directly interact with the host computer 50. The collected bending signal, posture signal and the like can be transmitted to the host computer 50 as basic training data, so as to train the neural network model by the host computer 50. Finally, the trained neural network model can be obtained from the host computer 50 and used.

[0064] Based on the first embodiment and / or the second embodiment of the present application, in the third embodiment of the present application, the same or similar contents as the above-mentioned first embodiment and second embodiment can be referred to the above introduction, and will not be repeated hereinafter. On this basis, please refer to Figure 3 , the legal sign language translation device further comprises a display module 60;

[0065] The display module 60 is connected with the signal processing module 40;

[0066] The signal processing module 40 is further configured to send a corresponding display signal to the display module 60 when the gesture signal and the bending signals are received.

[0067] The display module 60 is configured to display the corresponding text of the legal sign language formed by the palm and the fingers when the display signal is received.

[0068] It should be noted that in this embodiment, in order to facilitate the object to better understand the content expressed by the voice module 10, the controller 41 in the signal processing module 40 can also generate a display signal when the gesture signal and the bending signal are received, and transmit the display signal to the display module 60 connected thereto. The display module 60 can display the real meaning of the legal sign language made by the user in the form of text when the display signal is received. In a specific implementation, the type of the display module 60 can be a TFT-LCD display screen.

[0069] Further, in this embodiment, the bending sensor 20 includes a first acquisition unit 21 to a fifth acquisition unit 25 and an analog-to-digital conversion unit 26.

[0070] The first acquisition unit 21 to the fifth acquisition unit 25 are one-to-one corresponding to each finger on the palm.

[0071] The analog-to-digital conversion unit 26 is connected to the first acquisition unit 21 to the fifth acquisition unit 25 and the signal processing module 40.

[0072] The analog-to-digital conversion unit 26 is configured to convert the analog bending acquisition signals formed by the first acquisition unit 21 to the fifth acquisition unit 25 collecting the bending degree of each finger into digital bending signals, and transmit the bending signals to the signal processing module 40.

[0073] It should be noted that in the embodiment, since a person usually has five fingers, the bending sensor 20 needs to collect the bending degree of each of the five fingers. Therefore, a collection unit can be designed on each finger to collect the bending degree of the fixed finger respectively, that is, the first collection unit 21, the second collection unit 22, the third collection unit 23, the fourth collection unit 24 and the fifth collection unit 25 are correspondingly arranged on the five fingers of the user's palm. Since the electrical signals (bending collection signals) collected by the first collection unit 21 and the fifth collection unit 25 are analog signals, an analog-digital conversion unit 26 needs to be arranged between each collection unit and the signal processing module 40, so as to convert the analog bending collection signals into digital bending signals, and then transmit the digital bending signals to the controller 41 in the signal processing module 40, so that the signal processing module 40 can quickly identify the digital signals, thereby better judging the bending degree of each finger.

[0074] Further, in the embodiment, the legal sign language translation device further comprises a visual collection module 70;

[0075] The visual collection module 70 is connected with the signal processing module 40;

[0076] The visual collection module 70 is used for collecting images of the palm and each finger, and sending corresponding visual signals to the signal processing module 40;

[0077] The signal processing module 40 is further used for sending corresponding voice signals to the voice module 10 when receiving the visual signals.

[0078] It should be noted that in the embodiment, in order to make the legal sign language translation more accurate, the visual collection module 70 containing a camera or a photosensitive device can be used to record or capture the palm and each finger, generate corresponding visual signals, and send them to the controller 41 in the signal processing module 40 for identification, so as to be another judgment method of legal sign language. Correspondingly, when the signal processing module 40 receives the visual signals, it can also convert the true meaning of the legal sign language expressed by the visual signals into voice signals and send them to the voice module 10, so that the voice module 10 can play the voice of the true meaning expressed by the legal sign language.

[0079] Further, the legal sign language translation device further comprises a Bluetooth module 80;

[0080] The Bluetooth module 80 is connected with the signal processing module 40, and the Bluetooth module 80 is also wirelessly connected with an external device 90;

[0081] The Bluetooth module 80 is configured to receive the external signal transmitted by the external device 90 and transmit the external signal to the signal processing module 40.

[0082] The signal processing module 40 is further configured to send the corresponding voice signal to the voice module 10 when the external signal, the gesture signal and the bending signals are received.

[0083] It should be noted that in the embodiment, the controller 41 in the signal processing module 40 can also be wirelessly connected to the external device 90 through the Bluetooth module 80, so as to realize remote interaction of information between the controller 41 and the external device 90. As a case, the external device 90 can be a legal sign language translation device or equipment equipped on the other hand, at this time, the external signal transmitted by the external device 90 can be received through the Bluetooth module 80, or understood as the gesture signal corresponding to the other hand and the bending signals corresponding to each finger of the other hand. In this way, the controller 41 can determine the real-time gestures corresponding to the two hands and the bending degrees corresponding to the ten fingers according to the external signal transmitted by the external device 90 in combination with the gesture signal and the bending signal generated by the device, so as to determine the legal sign language formed by the two hands of the user, and transmit the corresponding voice signal to the voice module 10 to play the legal sign language in the form of voice.

[0084] The application also provides a legal sign language translation device, which adopts the legal sign language translation device as described above. The legal sign language translation device provided by the application embodiment can solve the technical problem of how to make it more convenient and clear for the deaf-mute to consult the law. Compared with the prior art, the legal sign language translation device provided by the application embodiment has the same beneficial effects as the legal sign language translation device provided by the above-mentioned embodiment, and the other technical features of the legal sign language translation device are the same as the features disclosed in the above-mentioned embodiment, which will not be repeated here.

[0085] The above is only the preferred embodiment of the application, and does not limit the patent scope of the application, and any equivalent structure or equivalent process transformation using the content of the application specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent processing scope of the application.

Claims

1. A legal sign language translation device, characterized in that, The legal sign language translation device includes: a voice module, a bending sensor, a posture sensor, and a signal processing module; The signal processing module is connected to the voice module, the bending sensor, and the posture sensor, respectively. The posture sensor is mounted on the user's palm to collect the real-time posture of the palm and send the corresponding posture signal to the signal processing module. The bending sensor is disposed on each finger of the palm and is used to collect the bending degree of each finger and send the corresponding bending signal to the signal processing module. The signal processing module is used to send a corresponding voice signal to the voice module when it receives the attitude signal and each of the bending signals; The voice module is used to play the voice corresponding to the legal sign language formed by the palm and each of the fingers when the voice signal is received; The legal sign language translation device also includes: a Bluetooth module; The Bluetooth module is connected to the signal processing module, and the Bluetooth module also wirelessly connects to external devices; The Bluetooth module is used to receive external signals transmitted by the external device and transmit the external signals to the signal processing module; The signal processing module is further configured to send the corresponding voice signal to the voice module when it receives the external signal, the attitude signal and each of the bending signals; The external device includes a legal sign language translation device for the other hand.

2. The legal sign language translation device as described in claim 1, characterized in that, The signal processing module includes: a controller and a voltage divider unit; The pressure divider unit is connected to the bending sensor and the controller respectively; the controller is also connected to the attitude sensor and the voice module respectively; The voltage divider unit is used to divide each of the bending signals transmitted by the bending sensor and transmit the divided bending signals to the controller. The controller is configured to send the voice signal to the voice module upon receiving the bending signals after voltage division and the attitude signal.

3. The legal sign language translation device as described in claim 2, characterized in that, The controller includes an RK3588 chip.

4. The legal sign language translation device as described in claim 3, characterized in that, The RK3588 chip is also used to connect to a host computer via a serial bus and to exchange information with the host computer.

5. The legal sign language translation device as described in claim 1, characterized in that, The legal sign language translation device also includes: a display module; The display module is connected to the signal processing module; The signal processing module is also used to send a corresponding display signal to the display module when it receives the attitude signal and each of the bending signals; The display module is used to display the text corresponding to the legal sign language formed by the palm and each of the fingers when the display signal is received.

6. The legal sign language translation device as described in claim 1, characterized in that, The bending sensor includes a first acquisition unit to a fifth acquisition unit and an analog-to-digital conversion unit; The first to the fifth acquisition units are respectively disposed on each finger of the palm; The analog-to-digital conversion unit is connected to the first acquisition unit, the fifth acquisition unit, and the signal processing module, respectively. The analog-to-digital conversion unit is used to convert the analog bending acquisition signals formed by the bending degree of each finger acquired by the first acquisition unit to the fifth acquisition unit into digital bending signals, and transmit each bending signal to the signal processing module.

7. The legal sign language translation device as described in claim 1, characterized in that, The legal sign language translation device also includes: a visual acquisition module; The visual acquisition module is connected to the signal processing module; The visual acquisition module is used to acquire images of the palm and each of the fingers, and send corresponding visual signals to the signal processing module; The signal processing module is further configured to send the corresponding voice signal to the voice module when the visual signal is received.

8. The legal sign language translation device as described in any one of claims 1-7, characterized in that, The bending sensor is a Flex2.2 bending sensor.

9. A legal sign language translation device, characterized in that, The legal sign language translation device is the same as any one of claims 1-8.

Images