Intelligent auditory rehabilitation training system and method after artificial cochlea operation

Through an intelligent hearing rehabilitation training system, users can conduct hearing training on their own, overcoming the bottleneck of existing technologies that require doctor assistance, and achieving efficient, low-cost, and widely applicable hearing rehabilitation results.

CN121214737APending Publication Date: 2025-12-26OAK VALLEY INFORMATION CONSULTING (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202511090758.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-08-05
Publication Date
2025-12-26

AI Technical Summary

Technical Problem

Current cochlear implant postoperative hearing rehabilitation training requires the assistance of doctors, resulting in a large expenditure of manpower, money and time. Moreover, the training methods are monotonous and the applicable group is narrow, making it difficult for patients to persist.

Method used

Design an intelligent auditory rehabilitation training system after cochlear implant surgery, including a voice playback module, an input module, and a host. The system plays audio data through voice, obtains user input information, and automatically determines the training results based on the audio data and input information. The system adopts a combination of hardware and software and intelligent interactive design, and provides multiple training modes.

Benefits of technology

Users can perform hearing training independently, reducing reliance on doctors, saving time and money, making the training process more interesting and efficient, applicable to a wider range of people, and with significant training results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121214737A_ABST
    Figure CN121214737A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent auditory rehabilitation training system and method after an artificial cochlea operation, and is suitable for the technical field of rehabilitation training equipment. The method comprises a voice playing module used for playing audio data; wherein the audio data are audios of the user for auditory rehabilitation training; the input module is used for acquiring input information of a user; the host is connected with the voice playing module and the input module and is used for acquiring the audio data and controlling the voice playing module to play the audio data; obtaining input information fed back by a user for the audio data; and determining a training result of the user based on the audio data and the input information. According to the embodiment of the invention, a doctor does not need to assist in operation or judge a training result, and the user can operate at home for hearing training and does not need to go to a hospital or a rehabilitation institution for many times, so that a large amount of manpower, cost and time are saved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of rehabilitation training equipment, and in particular to an intelligent auditory rehabilitation training system and method after cochlear implantation. BACKGROUND

[0002] The existing auditory rehabilitation training method after cochlear implantation is generally that a rehabilitation therapist or a doctor issues a sound or plays a sound through a machine controlled by the doctor, and a patient reads along, which is the same as learning to speak from childhood, and a doctor needs to determine the training result.

[0003] Since a doctor needs to participate in the auditory rehabilitation training, the patient needs to go to a hospital or a rehabilitation institution for auditory training multiple times within one month to one year after the surgery. However, this way of auditory rehabilitation training assisted by a doctor needs to consume a large amount of manpower, cost and time. SUMMARY

[0004] Therefore, the present application provides an intelligent auditory rehabilitation training system and method after cochlear implantation to solve the problem of consuming a large amount of manpower, cost and time caused by the way of auditory rehabilitation training assisted by a doctor in the prior art.

[0005] A first aspect of the present application provides an intelligent auditory rehabilitation training system after cochlear implantation, comprising:

[0006] a voice playing module configured to play audio data; wherein the audio data is audio for auditory rehabilitation training of a user;

[0007] an input module configured to obtain input information of the user;

[0008] a host connected to the voice playing module and the input module, configured to obtain the audio data, control the voice playing module to play the audio data, obtain input information fed back by the user in response to the audio data, and determine a training result of the user based on the audio data and the input information.

[0009] In a possible implementation, the input module includes at least two orientation keys, and the voice playing module includes at least two first loudspeakers arranged at different orientations, and the orientation of each first loudspeaker corresponds to the orientation of one orientation key.

[0010] The host includes a sound localization module, which is configured to, when any first loudspeaker is selected to play the audio data, obtain selection information of the first loudspeaker playing the audio data and input information returned in response to the selection of the orientation key, and determine the training result based on the selection information and the input information; wherein the training result includes prompt information for prompting whether the selection of the key is accurate.

[0011] In a possible implementation, the intelligent auditory rehabilitation training system after cochlear implantation further includes an audio control board electrically connected to the host computer.

[0012] The audio control board is electrically connected to each first loudspeaker and each orientation key.

[0013] The audio control board is configured to select one first loudspeaker to play audio data based on a preset program, obtain selection information based on the first loudspeaker selected to play the audio data, and obtain input information in response to a selection operation of the user on the orientation key.

[0014] The sound localization module is configured to start the audio control board and obtain the selection information and the input information returned by the audio control board.

[0015] In a possible implementation, the intelligent auditory rehabilitation training system after cochlear implantation further includes a display screen electrically connected to the host computer.

[0016] The host computer is further configured to obtain display selection information and control the display screen to display the display selection information, wherein the display selection information includes display content associated with the playing content of the audio data.

[0017] The input information is obtained in response to a selection operation of the user on the display selection information.

[0018] In a possible implementation, the display selection information includes at least two training images, each training image includes an image of an object capable of emitting sound, and the audio data includes first audio data, and the first audio data includes a sound of a target object.

[0019] The host computer includes:

[0020] The sound localization module is configured to obtain the first audio data and at least two training images corresponding to the first audio data, control the voice playing module to play the first audio data, control the display screen to display the at least two training images, obtain the input information in response to a selection operation of the user on the training image, and determine a training result of the user based on the first audio data and the input information.

[0021] In a possible implementation, the display selection information includes at least two training images or at least two training text contents, each training image includes an image of an object capable of emitting sound, each training text content includes dialogue content, and the audio data includes at least one of second audio data, third audio data, and fourth audio data, the second audio data includes a sound of a target object and an interference sound, the third audio data includes sounds of at least two target objects, and the fourth audio data includes dialogue audio of at least two objects.

[0022] The host comprises a sound listening and distinguishing module; the sound listening and distinguishing module comprises at least one of the following:

[0023] The first submodule is configured to acquire second audio data and at least two training images corresponding to the second audio data, control the voice playing module to play the second audio data, and control the display screen to display the at least two training images; in response to a selection operation of the user on the training images, input information is acquired; and based on the second audio data and the input information, a training result of the user is determined.

[0024] The second submodule is configured to acquire third audio data and at least two training images corresponding to the third audio data, control the voice playing module to play the third audio data, and control the display screen to display the at least two training images; in response to a selection operation of the user on the training images, input information is acquired; and based on the third audio data and the input information, a training result of the user is determined.

[0025] The third submodule is configured to acquire fourth audio data and at least two training text contents corresponding to the fourth audio data, control the voice playing module to play the fourth audio data, and control the display screen to display the at least two training text contents; in response to a selection operation of the user on the training text contents, input information is acquired; and based on the fourth audio data and the input information, a training result of the user is determined.

[0026] In one possible implementation, the input module comprises a voice collecting module electrically connected with the host;

[0027] The host comprises:

[0028] The dictation and correction module is configured to acquire a training text, based on the training text, control the voice playing module to play audio data corresponding to the training text; acquire a user's repeated voice collected by the voice collecting module as input information, and convert the repeated voice into a repeated text; and based on the training text and the repeated text, determine a training result of the user.

[0029] In one possible implementation, the training result comprises at least one of a training score and a training suggestion; wherein the training score is used to represent a training score of the user, and the training suggestion is used to give relevant suggestions for the training progress of the user.

[0030] In one possible implementation, the artificial cochlea postoperative intelligent auditory rehabilitation training system further comprises a rotatably connected upper cover and a base, the upper cover is matched with the base; the display screen is arranged on the upper cover, and the host is arranged on the base.

[0031] A second aspect of the embodiment of the application provides an artificial cochlea postoperative intelligent auditory rehabilitation training method, applied to the artificial cochlea postoperative intelligent auditory rehabilitation training system of the first aspect, and comprising:

[0032] Acquire audio data, control the voice playing module to play the audio data; wherein the audio data is audio of the user for hearing rehabilitation training;

[0033] Acquire input information of the user for feedback of the audio data;

[0034] Determine the training result of the user based on the audio data and the input information.

[0035] The beneficial effects of the embodiments of the present application compared with the prior art are:

[0036] The first aspect of the embodiments of the present application provides an artificial cochlea postoperative intelligent hearing rehabilitation training system, which comprises a voice playing module, an input module and a host computer. The host computer is connected with the voice playing module and the input module, can acquire audio data, control the voice playing module to play the audio data, then acquire input information of the user for feedback of the audio data, and determine the training result of the user based on the audio data and the input information. Therefore, the artificial cochlea postoperative intelligent hearing rehabilitation training system provided by the embodiments of the present application can be operated by the user, and the training result of the user can be determined by the host computer. The user can operate the hearing training at home without the assistance of doctors or the judgment of the training result, and does not need to go to the hospital or the rehabilitation institution for many times, thereby saving a large amount of manpower, cost and time.

[0037] It can be understood that the beneficial effects of the second aspect can be referred to the related description in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0039] Figure 1 is a structural schematic diagram of an artificial cochlea postoperative intelligent hearing rehabilitation training system provided by the embodiments of the present application;

[0040] Figure 2 is a structural schematic diagram of another artificial cochlea postoperative intelligent hearing rehabilitation training system provided by the embodiments of the present application;

[0041] Figure 3 is a structural schematic diagram of a host computer provided by the embodiments of the present application;

[0042] Figure 4 is a flowchart of an artificial cochlea postoperative intelligent hearing rehabilitation training method provided by the embodiments of the present application;

[0043] Figure 5 Fig. 1 is a schematic diagram of an intelligent auditory rehabilitation training device for post- cochlear implantation provided by an embodiment of the present application;

[0044] Figure 6 Fig. 2 is a structural schematic diagram of a host provided by an embodiment of the present application.

[0045] Reference signs include:

[0046] 1 - an intelligent auditory rehabilitation training system for post-cochlear implantation;

[0047] 10 - a voice playing module, 101 - a first loudspeaker, 102 - a second loudspeaker;

[0048] 20 - an input module, 201 - an orientation key, 202 - a keyboard, 203 - a touchpad;

[0049] 30 - a host, 301 - a sound listening and orientation module, 302 - a sound listening and map recognition module, 303 - a sound listening and tone recognition module, 3031 - a first sub-module, 3032 - a second sub-module, 3033 - a third sub-module, 304 - a dictation and tone correction module;

[0050] 40 - an audio control board;

[0051] 50 - a display screen;

[0052] 60 - an upper cover;

[0053] 70 - a base. DETAILED DESCRIPTION

[0054] In the following description, specific details are set forth in order to provide a thorough understanding of embodiments of the present application. However, persons having ordinary skill in the art will appreciate that embodiments of the present application can be practiced without the specific details, and that the present application is not limited to the embodiments described herein. In other instances, well-known features are not described in detail in order to not unnecessarily obscure the present application.

[0055] It should be understood that the term "comprises" as used in the specification and the appended claims indicates the presence of the described features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0056] It should also be understood that the term "and / or" as used herein refers to any one of the associated listed items, combinations thereof, and all possible combinations thereof, and includes these combinations.

[0057] As used in the specification and the appended claims, the term "if' can be interpreted as meaning "when" or "upon" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if it is determined" or "if [the described condition or event] is detected" can be interpreted to mean "upon determining" or "in response to determining" or "upon detecting [the described condition or event]" or "in response to detecting [the described condition or event]" depending on the context.

[0058] In addition, in the description of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0059] Reference in the specification to "one embodiment" or "some embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in additional embodiments", etc. in various places in the specification are not necessarily all referring to the same embodiment, although they can. The terms "comprising", "including", "having" and their variants mean "including but not limited to", unless otherwise expressly specified.

[0060] After research, the existing training method needs to spend a lot of manpower, cost and time, and is relatively boring to train, and the training function is single and the applicable group is relatively narrow, so that patients generally cannot persist, and even have resistance.

[0061] The current postoperative hearing rehabilitation training method of cochlear implant mainly has the following problems: (1) the rehabilitation therapist or doctor is difficult to jump out of the existing artificial training method thinking, and has no time to do research and development innovation; (2) laymen do not understand the pain point problem of postoperative hearing rehabilitation training of cochlear implant, and rarely think about the corresponding solutions for different hearing impairment degrees, different age groups and different sound scenes; (3) using intelligent way to replace artificial training method requires higher hardware use and software development ability of technical personnel, and general technical personnel do not have both abilities.

[0062] The postoperative intelligent hearing rehabilitation training system and method of cochlear implant provided by the embodiments of the present application aim to solve the above technical problems of the prior art.

[0063] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. It should be pointed out that the following embodiments can be mutually referenced, borrowed or combined. For the same terms, similar features and similar implementation steps in different embodiments, they will not be described repeatedly.

[0064] Referring to Figure 1 As shown in the figure, the present embodiment provides a structural schematic diagram of an intelligent auditory rehabilitation training system 1 after cochlear implantation. As shown in the figure, Figure 1 As shown in the figure, the intelligent auditory rehabilitation training system 1 after cochlear implantation comprises a voice playing module 10, an input module 20 and a host 30.

[0065] The voice playing module 10 is configured to play audio data; wherein the audio data is audio for auditory rehabilitation training of a user.

[0066] The input module 20 is configured to obtain input information of the user.

[0067] The host 30 is connected with the voice playing module 10 and the input module 20, and the host 30 is configured to obtain the audio data, control the voice playing module 10 to play the audio data, obtain input information fed back by the user in response to the audio data, and determine a training result of the user based on the audio data and the input information.

[0068] Optionally, the host 30 can be electrically connected with the voice playing module 10 and the input module 20, or can be connected in a wired or wireless manner. The user is a trainer who needs to perform auditory rehabilitation training.

[0069] The intelligent auditory rehabilitation training system 1 after cochlear implantation provided by the present embodiment comprises the voice playing module 10, the input module 20 and the host 30, the host 30 is connected with the voice playing module 10 and the input module 20, can obtain the audio data, control the voice playing module 10 to play the audio data, then obtain the input information fed back by the user in response to the audio data, and determine the training result of the user based on the audio data and the input information. Therefore, the intelligent auditory rehabilitation training system 1 after cochlear implantation provided by the present embodiment can be operated by the user, and the host 30 can determine the training result of the user, without the need for a doctor to assist in operation or determine the training result. The user can operate at home to perform hearing training, without the need to go to a hospital or a rehabilitation institution multiple times, thereby saving a large amount of manpower, cost and time.

[0070] Referring to Figure 2 As shown in the figure, the present embodiment provides another structural schematic diagram of an intelligent auditory rehabilitation training system 1 after cochlear implantation. As shown in the figure, Figure 2As shown, the intelligent auditory rehabilitation training system 1 after cochlear implant surgery further comprises a display screen 50, a rotatably connected upper cover 60 and a base 70, the upper cover 60 is matched with the base 70; the display screen 50 is arranged on the upper cover 60, and the host 30 is arranged on the base 70.

[0071] In some embodiments, the input module 20 comprises at least two orientation keys 201, and the voice playing module 10 comprises at least two first speakers 101 arranged at different orientations, and the arrangement orientation of each first speaker 101 corresponds to the arrangement orientation of one orientation key 201.

[0072] Referring to Figure 2 As shown, the voice playing module 10 comprises four orientation first speakers 101 and second speakers 102, the four orientation first speakers 101 are respectively left speaker, right speaker, upper speaker and lower speaker, and the second speaker 102 is arranged on the base 70 as a main speaker.

[0073] The input module 20 comprises four orientation keys 201 arranged in up-down-left-right. The input module 20 can further comprise a keyboard 202 and a touchpad 203, and the keyboard 202 and the touchpad 203 are electrically connected with the host 30, and the touchpad 203 can be equivalent to a mouse. The intelligent auditory rehabilitation training system 1 after cochlear implant surgery can further comprise a mouse electrically connected with the host 30.

[0074] Optionally, the host 30 is a built-in micro host, and the keyboard 202 and the mouse can be a wireless keyboard 202 and a wireless mouse. The intelligent auditory rehabilitation training system 1 after cochlear implant surgery in the embodiments of the present application can be designed as an aluminum alloy portable box structure of acrylic plate.

[0075] Referring to Figure 3 As shown, the present embodiment provides a structural schematic diagram of the host 30. As shown in Figure 3 As shown, the host 30 comprises an acoustic orientation module 301.

[0076] The acoustic orientation module 301 is configured to, when any first speaker 101 is selected to play audio data, acquire selection information of the first speaker 101 playing the audio data and input information returned by selection of the orientation key 201, and determine a training result based on the selection information and the input information; wherein the training result comprises prompt information for prompting whether the key selection is accurate.

[0077] In combination with Figure 2 And Figure 3 As shown, the intelligent auditory rehabilitation training system 1 after cochlear implant surgery further comprises an audio control board 40 electrically connected with the host 30. The audio control board 40 is electrically connected with each first speaker 101 and each orientation key 201.

[0078] The audio control board 40 is configured to select a first loudspeaker 101 to play audio data based on a preset program, obtain selection information based on the first loudspeaker 101 selected to play the audio data, and obtain input information in response to a selection operation of a user on the orientation key 201.

[0079] The sound orientation module 301 is configured to start the audio control board 40 and obtain the selection information and the input information returned by the audio control board 40.

[0080] Optionally, the audio control board 40 is an arduino Uno board, which is a microcontroller development board. The orientation key 201 is a key sensor.

[0081] Optionally, the sound orientation module 301 uses the arduino Uno board as a lower computer of windows, and programs for randomly playing four orientation sounds are burned into the arduino Uno board. When the sound orientation function is started, the arduino Uno board sends a command for randomly playing different orientation sounds, the first loudspeaker 101 connected to the pins of the arduino Uno board randomly plays the sounds, and the orientation key 201 is connected to other pins of the arduino Uno board. After the trainer hears the sound, the trainer presses the orientation key 201 to select the sound orientation, and the program automatically judges whether the selection is correct or incorrect, thereby realizing the training function of intelligently judging the sound orientation. The function is suitable for all early hearing training stages after cochlear implantation.

[0082] Referring to Figure 2 The artificial cochlea postoperative intelligent hearing rehabilitation training system 1 further includes a display screen 50 electrically connected to the host computer 30.

[0083] The host computer 30 is further configured to obtain display selection information and control the display screen 50 to display the display selection information. The display selection information includes display content associated with the playing content of the audio data.

[0084] The input information is obtained in response to a selection operation of a user on the display selection information.

[0085] In some embodiments, the display selection information includes at least two training images, each training image includes an image of an object capable of emitting a sound, and the audio data includes first audio data, the first audio data includes a sound of a target object.

[0086] Referring to Figure 3As shown, the host 30 comprises a sound recognition module 302. The sound recognition module 302 is configured to acquire first audio data and at least two training images corresponding to the first audio data, control the voice playing module 10 to play the first audio data, and control the display screen 50 to display the at least two training images; acquire input information in response to a selection operation of a user on the training images; and determine a training result of the user based on the first audio data and the input information.

[0087] Optionally, the sound-emitting object can be a person, an animal, or an article.

[0088] Optionally, the sound recognition module 302 is written in python language and operates in a windows system. The sound recognition module 302 pre-records sounds emitted by different objects and inputs corresponding object pictures as training images. A python program is used to randomly play a sound of an object, and a trainer clicks to select an object picture that he considers to have emitted the sound after listening to the sound, and the system automatically determines whether the selection is correct or not. The function of the sound recognition module 302 helps the hearing-impaired train the correspondence between sounds and sound-emitting objects, and is suitable for cases of congenital hearing impairment or deafness at a young age.

[0089] In some embodiments, the display selection information comprises at least two training images or at least two training text contents, each training image comprises an image of a sound-emitting object, each training text content comprises dialogue content, and the audio data comprises at least one of second audio data, third audio data, and fourth audio data, the second audio data comprises a sound of a target object and an interference sound, the third audio data comprises sounds of at least two target objects, and the fourth audio data comprises dialogue audio of at least two objects.

[0090] Referring to Figure 3 As shown, the host 30 comprises a sound recognition module 302. The sound recognition module 302 is configured to acquire first audio data and at least two training images corresponding to the first audio data, control the voice playing module 10 to play the first audio data, and control the display screen 50 to display the at least two training images; acquire input information in response to a selection operation of a user on the training images; and determine a training result of the user based on the first audio data and the input information.

[0091] The first sub-module 3031 is configured to acquire second audio data and at least two training images corresponding to the second audio data, control the voice playing module 10 to play the second audio data, and control the display screen 50 to display the at least two training images; acquire input information in response to a selection operation of a user on the training images; and determine a training result of the user based on the second audio data and the input information.

[0092] The second submodule 3032 is configured to acquire third audio data and at least two training images corresponding to the third audio data, control the voice playing module 10 to play the third audio data, and control the display screen 50 to display the at least two training images; acquire input information in response to a selection operation of the user on the training images; and determine a training result of the user based on the third audio data and the input information.

[0093] The third submodule 3033 is configured to acquire fourth audio data and at least two training text contents corresponding to the fourth audio data, control the voice playing module 10 to play the fourth audio data, and control the display screen 50 to display the at least two training text contents; acquire input information in response to a selection operation of the user on the training text contents; and determine a training result of the user based on the fourth audio data and the input information.

[0094] Optionally, the function of the sound recognition module 303 is programmed in python language and operated in a windows system. The sound recognition module 303 is provided with a plurality of submenu options, which are also designed in a game mode by clicking to determine and automatically give scores.

[0095] Optionally, the sound recognition module 303 includes: (a) a first submodule 3031: randomly playing sounds of several objects with similar pronunciation to let the trainee determine which object; (b) a second submodule 3032: playing mixed sounds to let the hearing-impaired person determine which objects make the sounds; and (c) a third submodule 3033: randomly playing a recording containing multiple conversations to let the trainee determine the specific content of the conversation. The function of the sound recognition module 303 helps the hearing-impaired person to train the information acquisition ability in a multi-sound source scene, and is suitable for the middle and late stages of hearing training.

[0096] In some embodiments, the input module 20 includes a voice collecting module electrically connected with the host 30.

[0097] Referring to Figure 3 The host 30 includes a dictation and correction module 304.

[0098] The dictation and correction module 304 is configured to acquire training text, control the voice playing module 10 to play audio data corresponding to the training text based on the training text, acquire a user's repeated voice collected by the voice collecting module as input information, convert the repeated voice into repeated text, and determine a training result of the user based on the training text and the repeated text.

[0099] Optionally, the voice collecting module can be a microphone.

[0100] Optionally, the function of the dictation and correction module 304 is programmed in python language and operates in the windows system. The function of the dictation and correction module 304 can access various speech text conversion APIs (Application Programming Interface), randomly generate a piece of text as a training text, then play the corresponding audio data through the text-to-speech function, and the trainer repeats the sound orally after hearing the sound. The repeated speech is collected by the microphone and processed by the speech-to-text function. The newly generated repeated text is compared with the randomly generated training text at the beginning, and the score is automatically given. The function of the dictation and correction module 304 is suitable for the situation of inaccurate pronunciation caused by hearing impairment, and is generally used in the middle and late stages of auditory training.

[0101] In some embodiments, the training result includes at least one of a training score and a training suggestion; wherein the training score is used to represent the training score of the user, and the training suggestion is used to give relevant suggestions for the training progress of the user.

[0102] Optionally, the training suggestion can be to suggest the user to select which module among the sound localization module 301, the sound discrimination module 302, the sound discrimination module 303, and the dictation and correction module 304 to perform the hearing rehabilitation training according to the training progress of the user.

[0103] The artificial cochlea postoperative intelligent auditory rehabilitation training system 1 of the embodiment of the application can realize the game design function of random voice broadcast, speech text conversion, and automatic judgment scoring through python programming and artificial intelligence technology, so that the postoperative auditory rehabilitation training becomes more fun, more convenient, more intelligent, and the training effect is more obvious.

[0104] The artificial cochlea postoperative intelligent auditory rehabilitation training system 1 of the embodiment of the application has a simple manufacturing process, low cost, is convenient to carry, and can be used in various life scenes; moreover, the combination of software and hardware, modular design of functions, and intelligent interaction make the training process efficient and interesting.

[0105] The artificial cochlea postoperative intelligent auditory rehabilitation training system 1 of the embodiment of the application can be made into a smaller tablet with more convenient operation; it is suitable for Android, Harmony or other embedded systems, and is more widely applicable; through software upgrading and interface optimization, a rehabilitation training system suitable for children and the elderly is designed.

[0106] Based on the structure of the artificial cochlea postoperative intelligent auditory rehabilitation training system 1, the use process of the embodiment of the present application includes: starting the host power (12V input), entering the windows system, clicking to start the artificial cochlea postoperative intelligent auditory training system (software, python program), then starting the function menu of QtDesign interface design, displaying the sound localization module 301, the sound discrimination module 302, the sound discrimination module 303 and the sound writing and error correction module 304 four function module controls on the display interface of the display screen 50, and the hearing-impaired person can select the function module according to his own situation.

[0107] Among them, the function module controls of the sound localization module 301, the sound discrimination module 302 and the sound writing and error correction module 304 enter the corresponding execution program, the function module control of the sound discrimination module 303 is selected, the display interface displays three function sub-module controls of the first sub-module 3031, the second sub-module 3032 and the third sub-module 3033, and the corresponding function sub-module controls of the first sub-module 3031, the second sub-module 3032 and the third sub-module 3033 are selected to execute the corresponding execution program, so as to carry out targeted hearing and speech training.

[0108] The artificial cochlea postoperative intelligent auditory rehabilitation training system 1 of the embodiment of the present application contains software code and hardware equipment, and is mainly used to help the patients after artificial cochlea surgery to quickly recover hearing, is a new generation of intelligent rehabilitation medical technology, and belongs to the field of rehabilitation treatment technology.

[0109] The artificial cochlea postoperative intelligent auditory rehabilitation training system 1 of the embodiment of the present application can carry out artificial cochlea postoperative hearing rehabilitation training anytime and anywhere, help them to accurately distinguish the sound direction, identify the sound object, quickly adapt to the complex multi-sound source environment, and correct the pronunciation of the hearing-impaired person, and improve the listening and speaking ability and the life quality of the user.

[0110] In addition, the prototype of the artificial cochlea postoperative intelligent auditory rehabilitation training system 1 is tested, and the obtained effect proves that: (1) the function modules of the prototype are debugged and improved for more than 600 times, finally reach the stable training function, and the equipment failure rate is less than 0.1%; 20 hearing-impaired persons of different degrees are provided with the prototype training experience, and all achieve the expected training results; (3) many professional hearing rehabilitation training teachers or doctors make overall evaluation on the training system, and highly recognize the training effect.

[0111] Referring to Figure 4 As shown in the figure, the embodiment of the present application provides a flow chart of an artificial cochlea postoperative intelligent auditory rehabilitation training method. As Figure 4 As shown in the figure, the artificial cochlea postoperative intelligent auditory rehabilitation training method of the embodiment of the present application is applied to the artificial cochlea postoperative intelligent auditory rehabilitation training system 1, and includes steps S401 to S403.

[0112] S401, acquire audio data, and control the voice playing module 10 to play the audio data; wherein the audio data is audio for a user to perform hearing rehabilitation training.

[0113] S402, acquire input information fed back by the user in response to the audio data.

[0114] S403, determine a training result of the user based on the audio data and the input information.

[0115] The artificial cochlea postoperative intelligent hearing rehabilitation training method can be executed by the host 30.

[0116] Optionally, the artificial cochlea postoperative intelligent hearing rehabilitation training method further comprises: when any first loudspeaker 101 is selected to play the audio data, acquiring selection information of the first loudspeaker 101 playing the audio data and input information returned in response to selection of the direction key 201; and determining the training result based on the selection information and the input information; wherein the training result comprises prompt information for prompting whether the key selection is accurate.

[0117] Optionally, acquiring the selection information of the first loudspeaker 101 playing the audio data and the input information returned in response to selection of the direction key 201 comprises: starting the audio control board 40, and acquiring the selection information and the input information returned by the audio control board 40.

[0118] Optionally, before acquiring the input information fed back by the user in response to the audio data, the method further comprises: acquiring display selection information, and controlling the display screen 50 to display the display selection information; and acquiring the input information fed back by the user in response to the audio data comprises: in response to selection operation of the user in response to the display selection information, acquiring the input information.

[0119] Optionally, acquiring the audio data and controlling the voice playing module 10 to play the audio data comprises: acquiring first audio data and at least two training images corresponding to the first audio data, controlling the voice playing module 10 to play the first audio data, and controlling the display screen 50 to display the at least two training images.

[0120] Acquiring the input information fed back by the user in response to the audio data comprises: in response to selection operation of the user in response to the training image, acquiring the input information.

[0121] Determining the training result of the user based on the audio data and the input information comprises: determining the training result of the user based on the first audio data and the input information.

[0122] Optionally, the obtaining the audio data and controlling the voice playing module 10 to play the audio data comprises: obtaining second audio data and at least two training images corresponding to the second audio data, controlling the voice playing module 10 to play the second audio data, and controlling the display screen 50 to display the at least two training images.

[0123] The input information fed back by the user for the audio data is obtained, comprising: in response to a selection operation of the user for the training image, obtaining the input information.

[0124] The training result of the user is determined based on the audio data and the input information, comprising: determining the training result of the user based on the second audio data and the input information.

[0125] Optionally, the obtaining the audio data and controlling the voice playing module 10 to play the audio data comprises: obtaining third audio data and at least two training images corresponding to the third audio data, controlling the voice playing module 10 to play the third audio data, and controlling the display screen 50 to display the at least two training images.

[0126] The input information fed back by the user for the audio data is obtained, comprising: in response to a selection operation of the user for the training image, obtaining the input information.

[0127] The training result of the user is determined based on the audio data and the input information, comprising: determining the training result of the user based on the third audio data and the input information.

[0128] Optionally, the obtaining the audio data and controlling the voice playing module 10 to play the audio data comprises: obtaining fourth audio data and at least two training text contents corresponding to the fourth audio data, controlling the voice playing module 10 to play the fourth audio data, and controlling the display screen 50 to display the at least two training text contents.

[0129] The input information fed back by the user for the audio data is obtained, comprising: in response to a selection operation of the user for the training text content, obtaining the input information.

[0130] The training result of the user is determined based on the audio data and the input information, comprising: determining the training result of the user based on the fourth audio data and the input information.

[0131] Optionally, the intelligent auditory rehabilitation training after cochlear implant surgery further comprises: obtaining a training text, controlling the voice playing module 10 to play audio data corresponding to the training text based on the training text; obtaining a user's repeated speech collected by the voice collecting module as input information, and converting the repeated speech into a repeated text; and determining the training result of the user based on the training text and the repeated text.

[0132] Referring to Figure 5As shown in the figure, the embodiment of the present application provides a schematic diagram of the intelligent auditory rehabilitation training device 5 after cochlear implantation. As shown in the figure, Figure 5 As shown in the figure, the intelligent auditory rehabilitation training device 5 after cochlear implantation of the embodiment of the present application is applied to the intelligent auditory rehabilitation training system 1 after cochlear implantation, and includes a control module 501, an acquisition module 502, and a determination module 503.

[0133] The control module 501 is configured to acquire audio data and control the voice playing module 10 to play the audio data, wherein the audio data is audio for auditory rehabilitation training of a user.

[0134] The acquisition module 502 is configured to acquire input information fed back by the user for the audio data.

[0135] The determination module 503 is configured to determine a training result of the user based on the audio data and the input information.

[0136] In application, each module in the intelligent auditory rehabilitation training device 5 after cochlear implantation can be a software program module, can be realized by different logical circuits integrated in a processor, or can be realized by multiple distributed processors.

[0137] The intelligent auditory rehabilitation training device 5 after cochlear implantation of the embodiment of the present application can execute the method provided by the embodiment of the present application, and the implementation principles are similar. The actions performed by each module in the device of each embodiment of the present application are corresponding to the steps in the method of each embodiment of the present application. For the detailed function description of each module of the device, refer to the description in the corresponding method in the foregoing description, which will not be repeated here.

[0138] Referring to Figure 6 As shown in the figure, the embodiment of the present application provides a structural schematic diagram of the host 6. As shown in the figure, Figure 6 As shown in the figure, the host 6 of the embodiment of the present application includes a memory 301, a processor 303, and a computer program 302 stored in the memory 301 and executable on the processor 303. When the processor 303 executes the computer program, the steps of the method of each embodiment of the present application are implemented.

[0139] The host 6 can include, but is not limited to, the processor 303 and the memory 301. Those skilled in the art can understand that, Figure 6 The host 6 is only an example and does not constitute a limitation on the host 6. It can include more or fewer components than shown in the figure, or combine certain components or different components, for example, it can also include an input / output device, a network access device, etc.

[0140] The processor 303 can be a central processing unit (CPU), and can also be other general-purpose processors, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0141] The memory 301 can be an internal storage unit, such as a hard disk or a memory, in some embodiments. The memory 301 can be a removable / non-removable, volatile / non-volatile computer system storage medium, such as a non-volatile memory, for reading and writing non-volatile magnetic media. The memory 301 can also be an external storage device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, and the like, in other embodiments. The memory 301 is used to store an operating system, an application program, a boot loader, data, and other programs, such as program codes of computer programs, and the like. The memory 301 can also be used to temporarily store data that has been output or will be output.

[0142] It should be noted that the information interaction, execution process, and the like between the above-described devices / units, since based on the same concept as the method embodiments of the present application, the specific functions and the technical effects brought by them can be referred to the method embodiments part, and will not be described here.

[0143] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is exemplified, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the above described functions. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit, and the integrated unit can be realized in the form of hardware or software. In addition, the specific name of each functional unit and module is only for easy distinction, and does not limit the protection scope of the application. The specific working process of the unit and module in the system can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

[0144] The embodiment of the application further provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the steps in each method embodiment.

[0145] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, all or part of the processes in the above embodiment methods can be completed by a computer program to instruct related hardware. The computer program can be stored in a computer readable storage medium. When the processor executes the computer program, the steps of each method embodiment can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable medium at least includes any entity or device capable of carrying the computer program code to the device / terminal equipment, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc.

[0146] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiment methods. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM), a random access memory (RAM), a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), etc. The storage medium can also include a combination of the above-mentioned types of memories.

[0147] In the above embodiments, the description of each embodiment has its own focus. The parts not described or recorded in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0148] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0149] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / network device and method can be implemented in other ways. For example, the above-described apparatus / network device embodiments are only schematic. For example, the division of the above modules or units is only a logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or in other forms.

[0150] The units described as separate components above can or can not be physically separated, and the components shown as units can or can not be physical units, i.e. they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the present embodiment.

[0151] The above examples are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing examples, those skilled in the art should understand that the technical solutions recorded in the foregoing examples can still be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. An intelligent auditory rehabilitation training system after cochlear implantation, characterized in that, The application relates to an audio data playing device, which comprises the following parts: a voice playing module, which is used for playing audio data; wherein the audio data is audio for hearing rehabilitation training of a user; an input module, which is used for obtaining input information of the user; a host computer, which is connected with the voice playing module and the input module, is used for obtaining the audio data, controlling the voice playing module to play the audio data, obtaining input information fed back by the user for the audio data, and determining a training result of the user based on the audio data and the input information.

2. The intelligent post-implantation auditory rehabilitation training system for cochlear implant according to claim 1, wherein, The input module comprises at least two orientation keys, and the voice playing module comprises at least two first loudspeakers arranged at different orientations, the arrangement orientation of each first loudspeaker corresponding to the arrangement orientation of one orientation key. The host computer comprises a sound listening and orientation determining module, which is used for obtaining selection information of a first loudspeaker playing the audio data and input information returned by selection of the orientation key when any first loudspeaker is selected to play the audio data, determining the training result based on the selection information and the input information, and wherein the training result comprises prompt information for prompting whether the key selection is accurate.

3. The intelligent post-implantation auditory rehabilitation training system of claim 2, wherein, The application further comprises an audio control board electrically connected with the host computer. The audio control board is electrically connected with each first loudspeaker and each orientation key. The audio control board is used for selecting one first loudspeaker to play audio data based on a preset program, obtaining selection information based on the first loudspeaker selected to play the audio data, and obtaining input information in response to selection operation of the user for the orientation key. The sound listening and orientation determining module is used for starting the audio control board and obtaining the selection information and the input information returned by the audio control board.

4. The intelligent post-implantation auditory rehabilitation training system for cochlear implant according to claim 1, characterized in that, The application further comprises: a display screen electrically connected with the host computer; the host computer is further used for obtaining display selection information and controlling the display screen to display the display selection information; wherein the display selection information comprises display content associated with playing content of the audio data; The input information is obtained in response to selection operation of the user for the display selection information.

5. The intelligent post-implantation auditory rehabilitation training system of claim 4, wherein, The display selection information comprises at least two training images, each training image comprises an image of an object capable of emitting sound, the audio data comprises first audio data, and the first audio data comprises a sound of a target object. The host computer comprises: a sound listening and image determining module, which is used for obtaining first audio data and at least two training images corresponding to the first audio data, controlling the voice playing module to play the first audio data, controlling the display screen to display the at least two training images, obtaining input information in response to selection operation of the user for the training images, and determining the training result of the user based on the first audio data and the input information.

6. The intelligent post-implantation auditory rehabilitation training system of claim 4, wherein, The display selection information includes at least two training images or at least two training text contents, each of the training images includes an image of an object capable of emitting sound, and each of the training text contents includes dialogue content; the audio data includes at least one of second audio data, third audio data and fourth audio data; the second audio data includes a sound of a target object and an interference sound; the third audio data includes sounds of at least two target objects; and the fourth audio data includes dialogue audio of at least two objects. The host includes a sound listening and sound identifying module; and the sound listening and sound identifying module includes at least one of: a first sub-module configured to acquire second audio data and at least two training images corresponding to the second audio data, control the voice playing module to play the second audio data, and control the display screen to display the at least two training images; in response to a selection operation of the user on the training images, acquire input information; based on the second audio data and the input information, determine a training result of the user; a second sub-module configured to acquire third audio data and at least two training images corresponding to the third audio data, control the voice playing module to play the third audio data, and control the display screen to display the at least two training images; in response to a selection operation of the user on the training images, acquire input information; based on the third audio data and the input information, determine a training result of the user; a third sub-module configured to acquire fourth audio data and at least two training text contents corresponding to the fourth audio data, control the voice playing module to play the fourth audio data, and control the display screen to display the at least two training text contents; in response to a selection operation of the user on the training text contents, acquire input information; based on the fourth audio data and the input information, determine a training result of the user.

7. The intelligent post-implantation auditory rehabilitation training system of claim 1, wherein, The input module includes a voice collecting module electrically connected to the host; The host includes: a sound listening and sound identifying module configured to acquire training text, based on the training text, control the voice playing module to play audio data corresponding to the training text, acquire a repeated voice of the user collected by the voice collecting module as input information, convert the repeated voice into repeated text, and based on the training text and the repeated text, determine a training result of the user.

8. The post-implantation intelligent auditory rehabilitation training system of any one of claims 1-7, wherein, The training result includes at least one of a training score and a training suggestion; wherein the training score is used to represent a training score of the user, and the training suggestion is used to give relevant suggestions for a training progress of the user.

9. The post-implantation intelligent auditory rehabilitation training system of any one of claims 4-6, wherein, Further comprising: a rotatably connected upper cover and a base, the upper cover is matched with the base; the display screen is arranged on the upper cover, and the host is arranged on the base.

10. A method for intelligent auditory rehabilitation training after cochlear implant surgery, characterized in that, Applied to the artificial cochlea postoperative intelligent auditory rehabilitation training system in any one of claims 1-9, comprising: acquire audio data and control the voice playing module to play the audio data; wherein the audio data is audio of the user for auditory rehabilitation training; acquire input information fed back by the user for the audio data; determine a training result of the user based on the audio data and the input information.