Manual control sound production auxiliary device for aphasia patient

Abstract

The invention provides a manual control sound production auxiliary device for aphasia patients, which comprises a control host, the control host comprises a handheld part and a display panel, the display panel is arranged above the handheld part, the front side surface of the display panel is provided with an OLED display screen, a high-definition camera and a high-fidelity loudspeaker, the OLED display screen is arranged above the high-definition camera, and the OLED display screen is arranged above the high-definition camera. The high-fidelity loudspeaker is arranged below the OLED display screen, a key area is arranged on the outer surface of the handheld part, a plurality of function keys are arranged in the key area, and a controller is installed in an inner cavity of the handheld part. And the system can stably work in various scenes such as families, hospitals, outdoors and the like, and helps patients to communicate smoothly anytime and anywhere.

Description

Technical Field

[0001] The present invention relates to the technical field of vocalization assistance, and particularly to a hand-controlled vocalization assistance device for aphasia patients. Background Art

[0002] Aphasia is a syndrome of language communication disorder caused by damage to the brain's language center. Patients have varying degrees of defects in language functions such as expression, comprehension, reading, and writing, seriously affecting their daily life, social interaction, and mental health. According to statistics from the World Health Organization (WHO), approximately 3-5 out of every 1000 people globally suffer from aphasia, and the number of new patients exceeds 10 million each year. With the aggravation of population aging, this figure is still rising continuously. In China, the incidence rate of aphasia among people over 65 years old is as high as 2.5%, which means that a large number of elderly people are troubled by aphasia and their quality of life has dropped sharply.

[0003] At present, although there has been some development in communication assistance devices for aphasia patients in the market, there are still many limitations: Traditional communication boards: These use simple picture - text cards or fixed paper communication boards. Patients express their thoughts by pointing to the corresponding pictures or words. However, the content of such communication boards is fixed and it is difficult to meet the diverse expression needs of patients. A usage survey of 200 aphasia patients showed that when using traditional communication boards, it took an average of 2 - 5 minutes to find the required content for each communication, resulting in low communication efficiency. Especially in emergency situations, such as when a patient suddenly feels unwell and needs help, more than 70% of the patients are unable to convey key information within 1 minute, seriously affecting the timeliness of rescue. Electronic communication devices: Some electronic devices integrate speech synthesis functions and can convert the input text into voice output. However, most products have complex operations and require patients to have a high level of cognitive ability and fine - motor control ability for text input or complex menu selection. Research has shown that in tests on aphasia patients with limited hand movement function or severe cognitive impairment, only less than 30% of the patients can independently complete simple information input within 10 minutes, making them extremely difficult to use. In addition, the prices of such devices are generally high, with an average selling price ranging from 5000 to 10000 yuan, exceeding the financial capacity of many ordinary families and restricting their popularization and application. According to market research, due to price factors, only less than 20% of the families in need can purchase such devices. Lack of personalized customization: Existing assistance devices rarely consider the individual differences of patients and the dynamic changes in the rehabilitation process. Each aphasia patient has different degrees of impairment, remaining language functions, and life backgrounds, and unified devices are difficult to meet their personalized communication needs. A study tracked the rehabilitation process of 150 aphasia patients and found that as the rehabilitation training progressed, more than 80% of the patients had obvious changes in their communication abilities and needs within 3 - 6 months, but existing devices could not be flexibly adjusted and could not provide continuous and effective support for patients.

[0004] In view of the above problems, it is necessary to design a hand - controlled voice - generating assistance device for aphasia patients, which not only helps improve the quality of life of aphasia patients and promotes their social integration, but also reduces the burden on their families and society. Summary of the Invention

[0005] The present invention provides a hand - controlled voice - generating assistance device for aphasia patients to solve the problems of low intelligence level and poor use effect of the existing assistance devices, and realizes stable operation in various scenarios such as at home, in the hospital, and outdoors, helping patients communicate smoothly anytime and anywhere.

[0006] The present invention provides a hand - controlled voice - generating assistance device for aphasia patients, including a control host;

[0007] The control host includes a handheld part and a display panel, and the display panel is arranged above the handheld part;

[0008] An OLED display screen, a high-definition camera, and a high-fidelity speaker are installed on the front side of the display panel. The OLED display screen is disposed above the high-definition camera, and the high-fidelity speaker is disposed below the OLED display screen;

[0009] A key area is provided on the outer surface of the handheld part, and a plurality of function keys are provided in the key area;

[0010] A controller is installed in the inner cavity of the handheld part.

[0011] Preferably, for a hand-controlled voice assistance device for aphasia patients provided by the present application, a central processing unit, an image acquisition optimization unit, a storage unit, a key output unit, and a voice playback unit are provided in the controller. The input end of the image acquisition optimization unit is connected to the high-definition camera, the output end of the image acquisition optimization unit is connected to the central processing unit, the storage unit, the key output unit, and the voice playback unit are respectively connected to the central processing unit, the key output unit is connected to the function keys, the voice playback unit is connected to the high-fidelity speaker, and the image acquisition optimization unit is used to collect the facial features and gesture feature signals of the patient; the storage unit is used to store common sentences, vocabulary, voice files, the unique expressions of the patient, and common household languages; the key output unit is used to identify the function key signals; the voice playback unit is used to play voice signals.

[0012] Preferably, for a hand-controlled voice assistance device for aphasia patients provided by the present application, a battery compartment is provided at the bottom of the inner cavity of the handheld part, a battery pack is installed in the battery compartment, and the battery pack is electrically connected to the controller and the OLED display screen, and the battery pack is used to supply electrical energy to the controller and the OLED display screen.

[0013] Preferably, for a hand-controlled voice assistance device for aphasia patients provided by the present application, it further includes a one-key alarm button, the one-key alarm button is installed below the OLED display screen, and the one-key alarm button is connected to the central processing unit.

[0014] Preferably, for a hand-controlled voice assistance device for aphasia patients provided by the present application, the model of the OLED display screen is ssd1306.

[0015] Preferably, for a hand-controlled voice assistance device for aphasia patients provided by the present application, a Bluetooth module is further installed in the controller, and the central processing unit is connected to an external intelligent terminal through the Bluetooth module.

[0016] Preferably, a method for using a hand-controlled voice assistance device for aphasia patients includes the following steps:

[0017] A. When the patient is using it and selects content through the function buttons on the handheld part, the controller responds quickly and accurately retrieves the corresponding voice file from the storage module.

[0018] B. The retrieved voice file is processed by the optimization algorithm and then transmitted to the voice playback unit, which transmits the voice signal to the high-fidelity speaker for playback.

[0019] C. At the same time, the display module transmits the signal to the OLED display screen, which synchronously displays the content and updates the prompt information in real time according to the operation.

[0020] D. In addition, the high-definition front camera also captures the facial expressions or gesture images of the patient, which are optimized by the image acquisition optimization unit and then transmitted to the central processing unit.

[0021] E. The central processing unit analyzes the captured images, retrieves the corresponding voice files stored in the storage module, and transmits them to the voice playback module and the display module for voice broadcast and video display.

[0022] Preferably, the optimization method of the image acquisition optimization unit is as follows:

[0023] a. Divide the pixels of the captured image into several layers according to the brightness value. The brightness of each layer is different, and each layer is arranged from high to low according to the brightness value. Moreover, the boundary of the image in each layer is composed of closed curves.

[0024] b. For the layer with the lowest brightness and the layer with the highest brightness, first perform histogram equalization processing separately, then remove the background noise, and finally remove the noise points.

[0025] c. For the layers between the lowest brightness and the highest brightness, first remove the noise points, then remove the background noise, and finally perform histogram equalization processing.

[0026] d. Finally, merge all the processed layers into an image with enhanced image quality.

[0027] Beneficial effects:

[0028] (1) The structure of the present invention is novel in design, easy to use, and has a high degree of intelligence. Regardless of the hand movement ability and cognitive level of the patient, it can be easily operated, greatly improving the convenience of use. It can work stably in various scenarios such as home, hospital, and outdoors, helping patients communicate smoothly at any time and place.

[0029] (2) The present invention supports users to customize vocabulary, sentences and their voice input. Family members or medical staff of patients can input common special needs, habitual expressions, etc. into the system according to the actual situation of the patients. It can also flexibly adjust the operation difficulty and display content according to the rehabilitation progress and communication ability changes of the patients, realizing dynamic and personalized assistance and further improving the communication effect.

[0030] (3) The image acquisition optimization unit optimization method adopted by the present invention can accurately recognize the collected facial expression images and gesture images, further improving the communication efficiency.

[0031] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to be able to understand the technical means of the embodiment of the present invention more clearly, it can be implemented according to the content of the description. And in order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and understandable, the following specifically gives the specific implementation manners of the present invention. Brief Description of the Drawings

[0032] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the drawings required for use in the description of the embodiment will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to these drawings without creative efforts.

[0033] Figure 1 It is a schematic structural diagram of the present invention;

[0034] Figure 2 It is a block diagram of the control principle of the present invention;

[0035] Figure 3 It is a working flow chart of the present invention;

[0036] Description of the reference numerals: the handheld part 1, the display panel 2, the OLED display screen 3, the high-definition camera 4, the high-fidelity speaker 5, the button area 6, the function button 7, the controller 8, the central processing unit 9, the image acquisition optimization unit 10, the storage unit 11, the button output unit 12, the voice playback unit 13, the battery compartment 14, the battery pack 15, the one-key alarm button 16, the Bluetooth module 17, the external intelligent terminal 18. Detailed Description of the Embodiments

[0037] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this invention belongs; the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the present invention; the terms "comprising" and "having" and any variations thereof in the specification, claims and drawings of the present invention are intended to cover non-exclusive inclusion.

[0039] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the present invention. The phrase "embodiments" appearing in various places in the specification is not necessarily referring to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0040] The directional terms appearing in the following description are all the directions shown in the figures and do not limit the specific structure of the present invention. For example, in the description of the present invention, the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation of the present invention.

[0041] In addition, expressions indicating directions such as the X direction, Y direction, and Z direction used to describe the operation and structure of the components of this embodiment are not absolute but relative, and although these indications are appropriate when the components are in the positions shown in the figures, when these positions change, these directions should have different interpretations to correspond to the changes.

[0042] In addition, the terms "first", "second", etc. in the specification, claims or the above-mentioned drawings of the present invention are used to distinguish different objects and are not used to describe a specific order, and may explicitly or implicitly include one or more of such features.

[0043] In the description of the present invention, it should be noted that unless otherwise clearly specified and defined, the terms "installation", "connection", and "coupling" should be understood in a broad sense. For example, the "connection" or "coupling" of mechanical structures can refer to a physical connection. For example, a physical connection can be a fixed connection, such as a fixed connection through a fixing member, such as a screw, bolt, or other fixing member; a physical connection can also be a detachable connection, such as a snap connection or a clamping connection; a physical connection can also be an integral connection, such as a connection formed by welding, bonding, or integral molding. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0044] In order to enable those skilled in the art of this technology to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings.

[0045] Please refer to Figures 1 - 3 , the present invention discloses a hand-controlled voice assistance device for aphasia patients, including a control host;

[0046] The control host includes a handheld part 1 and a display panel 2, and the display panel 2 is arranged above the handheld part 1;

[0047] An OLED display screen 3, a high-definition camera 4, and a high-fidelity speaker 5 are installed on the front side of the display panel 2. The OLED display screen 3 is arranged above the high-definition camera 4, and the high-fidelity speaker 5 is arranged below the OLED display screen 3;

[0048] A key area 6 is arranged on the outer surface of the handheld part 1, and a plurality of function keys 7 are arranged in the key area 6;

[0049] A controller 8 is installed in the inner cavity of the handheld part 1.

[0050] In the present invention, a central processing unit 9, an image acquisition optimization unit 10, a storage unit 11, a key output unit 12, and a voice playback unit 13 are arranged in the controller 8. The input end of the image acquisition optimization unit 10 is connected to the high-definition camera 4, the output end of the image acquisition optimization unit 10 is connected to the central processing unit 9, the storage unit 11, the key output unit 12, and the voice playback unit 13 are respectively connected to the central processing unit 9, the key output unit 12 is connected to the function keys 7, the voice playback unit 13 is connected to the high-fidelity speaker 5. The image acquisition optimization unit 10 is used to collect the face features and gesture feature signals of the patient; the storage unit is used to store common sentences, vocabulary, voice files, the patient's unique expressions, and common household languages; the key output unit is used to identify the function key signals; the voice playback unit is used to play voice signals.

[0051] In the present invention, a battery compartment 14 is provided at the bottom of the inner cavity of the handheld part 1. A battery pack 15 is installed in the battery compartment 14. The battery pack 15 is electrically connected to the controller 8 and the OLED display screen 3. The battery pack 15 is used to supply electrical energy to the controller and the OLED display screen.

[0052] The present invention further includes a one - key alarm button 16. The one - key alarm button 16 is installed below the OLED display screen 3. The one - key alarm button 16 is connected to the central processing unit 9. When an emergency occurs, the patient can press the one - key alarm button to call for help.

[0053] In the present invention, the model of the OLED display screen 3 is ssd1306. The display interface of this OLED display is simple and intuitive, supporting the display of pictures and texts. In addition to displaying the selected content, it can also display information such as battery power and operation prompts in real time. There is a narrow border around the display screen, which not only protects the screen but also does not affect the visual effect.

[0054] In addition, in the present invention, a Bluetooth module 17 is also installed in the controller 8. The central processing unit 9 is connected to an external intelligent terminal 18 through the Bluetooth module 17. It can be connected to intelligent devices such as mobile phones and tablets, which is convenient for patients to expand the display area and enhance interactivity with the help of the intelligent device screen in scenarios such as going out and socializing.

[0055] Working principle: A method for using a hand - controlled voice - generating assistance device for aphasic patients includes the following steps:

[0056] A. When the patient is using it and operates the function keys on the handheld part to select content, the controller responds quickly and accurately retrieves the corresponding voice file from the storage module.

[0057] B. The retrieved voice file is processed by an optimization algorithm and then transmitted to the voice - playing unit. The voice - playing unit transmits the voice signal to the high - fidelity speaker for playback.

[0058] C. At the same time, the display module transmits the signal to the OLED display screen. The OLED display screen synchronously displays the content and updates the prompt information in real time according to the operation.

[0059] D. In addition, the high - definition front - facing camera also collects the facial expressions or gesture images of the patient. After being optimized by the image acquisition optimization unit, they are transmitted to the central processing unit.

[0060] E. The central processing unit analyzes the collected images, retrieves the corresponding voice files stored in the storage module, and transmits them to the voice - playing module and the display module for voice broadcast and video display.

[0061] Among them, the optimization method of the image acquisition optimization unit is as follows:

[0062] a. Divide the pixels of the captured image into several layers according to the brightness value. The brightness of each layer is different, and each layer is arranged from high to low according to the brightness value. Moreover, the boundaries of the images in each layer are composed of closed curves;

[0063] b. For the layer with the lowest brightness and the layer with the highest brightness, first perform histogram equalization processing separately, then remove background noise, and finally remove noise points;

[0064] c. For the layers between the lowest brightness and the highest brightness, first remove noise points, then remove background noise, and finally perform histogram equalization processing;

[0065] d. Finally, merge all the processed layers into an image with enhanced image quality.

[0066] The image acquisition optimization unit optimization method adopted by the present invention can accurately recognize the captured facial expression images and gesture images, and further improve the communication efficiency.

[0067] The present invention supports users to customize vocabulary, sentences and their voice input. Family members or medical staff of patients can input common special needs, idiomatic expressions, etc. into the system according to the actual situation of the patients; it can also flexibly adjust the operation difficulty and display content according to the rehabilitation progress and communication ability changes of the patients, realizing dynamic and personalized assistance, and further improving the communication effect.

[0068] In summary, the present invention has a novel structural design, is easy to use, and has a high degree of intelligence. Regardless of the hand movement ability and cognitive level of the patients, they can easily get started, greatly improving the convenience of use. It can work stably in various scenarios such as home, hospital, and outdoors, helping patients communicate smoothly at any time and anywhere.

[0069] As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A hand-controlled vocalization assistance device for aphasia patients, characterized in that, It includes a control host; The control host includes a handheld part (1) and a display panel (2), and the display panel (2) is arranged above the handheld part (1); An OLED display screen (3), a high-definition camera (4) and a high-fidelity speaker (5) are installed on the front side of the display panel (2). The OLED display screen (3) is arranged above the high-definition camera (4), and the high-fidelity speaker (5) is arranged below the OLED display screen (3); A key area (6) is arranged on the outer surface of the handheld part (1), and a plurality of function keys (7) are arranged in the key area (6); A controller (8) is installed in the inner cavity of the handheld part (1).

2. The hand-controlled voice assistance device for aphasia patients according to claim 1, characterized in that, A central processing unit (9), an image acquisition optimization unit (10), a storage unit (11), a key output unit (12) and a voice playback unit (13) are arranged in the controller (8). The input end of the image acquisition optimization unit (10) is connected to the high-definition camera (4), the output end of the image acquisition optimization unit (10) is connected to the central processing unit (9), the storage unit (11), the key output unit (12) and the voice playback unit (13) are respectively connected to the central processing unit (9), the key output unit (12) is connected to the function keys (7), the voice playback unit (13) is connected to the high-fidelity speaker (5), the image acquisition optimization unit (10) is used to collect the face features and gesture feature signals of the patient; the storage unit is used to store common statements, vocabulary, voice files, the unique expressions of the patient, and common household languages; the key output unit is used to identify the function key signals; the voice playback unit is used to play voice signals.

3. The hand-controlled voice assistance device for aphasia patients according to claim 1, characterized in that, A battery compartment (14) is arranged at the bottom of the inner cavity of the handheld part (1), and a battery pack (15) is installed in the battery compartment (14). The battery pack (15) is electrically connected to the controller (8) and the OLED display screen (3), and the battery pack (15) is used to supply electrical energy to the controller and the OLED display screen.

4. The hand-controlled voice assistance device for aphasia patients according to claim 1, characterized in that, It further includes a one-key alarm button (16). The one-key alarm button (16) is installed below the OLED display screen (3), and the one-key alarm button (16) is connected to the central processing unit (9).

5. An assisted hand-controlled vocalization device for aphasia patients according to claim 1, characterized in that, The model of the OLED display screen (3) is ssd1306.

6. The hand-controlled voice assistance device for aphasia patients according to claim 2, characterized in that: A Bluetooth module (17) is further installed in the controller (8), and the central processing unit (9) is connected to an external intelligent terminal (18) through the Bluetooth module (17).

7. The method of using a hand-controlled voice assistance device for aphasia patients as claimed in the claims, characterized in that, Its usage method includes the following steps: A. When the patient uses it and operates the function keys on the handheld part to select content, the controller responds quickly and accurately retrieves the corresponding voice file from the storage module; B. The retrieved voice file is processed by an optimization algorithm and then transmitted to the voice playback unit, and the voice playback unit transmits the voice signal to the high-fidelity speaker for playback; C. At the same time, the display module transmits the signal to the OLED display screen, and the OLED display screen synchronously displays the content and updates the prompt information in real time according to the operation; D. In addition, the high-definition front camera also collects the facial expressions or gesture images of the patient, and after being optimized by the image acquisition optimization unit, it is transmitted to the central processing unit; E. The central processing unit analyzes the collected images, retrieves the corresponding voice files stored in the storage module, and transmits them to the voice playback module and the display module for voice broadcast and video display.

8. The method of using a hand-controlled vocalization assistance device for aphasia patients according to claim 7, characterized in that, The optimization method of the image acquisition optimization unit is as follows: a. The pixels of the collected images are divided into several layers according to the brightness value. The brightness of each layer is different, and each layer is arranged from high to low according to the brightness value. Moreover, the boundaries of the images in each layer are composed of closed curves; b. For the layer with the lowest brightness and the layer with the highest brightness, first perform histogram equalization processing separately, then remove background noise, and finally remove noise points; c. For the layers between the lowest brightness and the highest brightness, first remove noise points, then remove background noise, and finally perform histogram equalization processing; d. Finally, all the processed layers are merged into an image with enhanced image.

Images