Hearing assistance method and apparatus, electronic device, and storage medium
By establishing audio and video call and data transmission channels in the call software, the problem of communication difficulties between hearing-impaired people and professionals is solved, efficient remote hearing assistance services are realized, and service quality is improved.
Patent Information
- Application Number
- PCT/CN2025/080415
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-28
- Filing Date
- 2025-03-04
- Publication Date
- 2025-10-02
AI Technical Summary
The cost for hearing-impaired people to receive hearing-assistance services from professionals is high. The application of remote hearing-assistance services is unstable and difficult to develop. In addition, communication between hearing-impaired people and professionals is inconvenient, which reduces the quality of hearing-assistance services.
Through the call software, an audio and video call is established between the hearing assistance end and the assistance receiving end, the instructions of the hearing assistance application are obtained and run, a duplex communication data transmission channel is established, audio and video calls and data transmission are realized, and remote hearing assistance services are provided.
It improves the convenience and accuracy of hearing assistance services, reduces the difficulty of developing hearing assistance applications, and improves the stability and quality of services.
Smart Images

Figure CN2025080415_02102025_PF_FP_ABST
Abstract
Description
Hearing assistance method and device, electronic device, and storage medium
[0001] Related applications
[0002] This application claims priority to Chinese patent application number 202410374380.9, filed on March 28, 2024, entitled “Hearing assistance method and device, electronic device, storage medium,” the entire text of which is hereby incorporated by reference. Technical Field
[0003] The present application relates to the field of computers, and more specifically, to a hearing assistance method and device, electronic equipment, storage medium, and program product. Background Art
[0004] For people with hearing impairments, scientifically wearing hearing aids, cochlear implants and other hearing aids is a relatively good rehabilitation method, which can greatly help people with hearing impairments improve their quality of life. The hearing aid parameters in the hearing aid device need to be configured according to the hearing condition of the hearing-impaired person, and after wearing the hearing aid device, the hearing aid parameters in the hearing aid device need to be adjusted according to the actual wearing situation. Hearing tests for people with hearing impairments and the configuration of hearing aid devices usually require the participation of professionals. Due to transportation costs and inconveniences for people with hearing impairments to travel, the cost of hearing-impaired people receiving hearing assistance services from professionals is relatively high. In addition, the applications used to implement remote hearing assistance services in related technologies also have problems such as instability, difficulty in development, and inconvenience in communication between people with hearing impairments and professionals, which reduces the quality of hearing assistance services. Summary of the Invention
[0005] The embodiments of the present application provide a hearing assistance method and apparatus, an electronic device, a storage medium, and a program product.
[0006] According to one aspect of an embodiment of the present application, a hearing assistance method is provided, which is performed by a hearing assistance terminal. The method includes:
[0007] Establish an audio and video call between the hearing aid terminal and the auxiliary receiving terminal through the call software;
[0008] Obtaining an operating instruction for a hearing assistance application hosted in the call software, and operating the hearing assistance application in the call software according to the operating instruction;
[0009] Based on the hearing assistance application, establishing a data transmission channel between the hearing assistance terminal and the assistance receiving terminal, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and
[0010] A hearing assistance service is provided to the auxiliary receiving terminal through the data transmission channel and the audio and video call.
[0011] According to one aspect of an embodiment of the present application, a hearing assistance method is provided, which is performed by an assistance receiving terminal, and the method includes:
[0012] Establish an audio and video call between the auxiliary receiving end and the hearing assistive end through the call software;
[0013] Obtaining an operating instruction for a hearing assistance application hosted in the call software, and operating the hearing assistance application in the call software according to the operating instruction;
[0014] Based on the hearing assistance application, establishing a data transmission channel between the auxiliary receiving terminal and the hearing assistance terminal, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and
[0015] The hearing assistance service provided by the hearing assistance terminal is obtained through the data transmission channel and the audio and video call.
[0016] According to one aspect of an embodiment of the present application, a hearing assistance device is provided, the device comprising:
[0017] Establishing a module configured to establish an audio and video call between the hearing aid terminal and the auxiliary receiving terminal through the call software;
[0018] an operating module configured to obtain an operating instruction for a hearing assistance application hosted in the call software, and operate the hearing assistance application in the call software according to the operating instruction;
[0019] a communication module configured to establish a data transmission channel between the hearing assistance terminal and the assistance receiving terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and
[0020] The service module is configured to provide hearing assistance services to the auxiliary receiving terminal through the data transmission channel and the audio and video call.
[0021] According to one aspect of an embodiment of the present application, a hearing assistance device includes:
[0022] An establishment module is configured to establish an audio and video call between the auxiliary receiving terminal and the hearing assistive terminal through the call software;
[0023] an operating module configured to obtain an operating instruction for a hearing assistance application hosted in the call software, and operate the hearing assistance application in the call software according to the operating instruction;
[0024] a communication module configured to establish a data transmission channel between the auxiliary receiving terminal and the hearing assistance terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and
[0025] The acquisition module is configured to obtain the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and the audio and video call.
[0026] According to one aspect of an embodiment of the present application, an electronic device is provided, including:
[0027] one or more processors;
[0028] The storage device is used to store one or more computer programs, and when the one or more computer programs are executed by the one or more processors, the electronic device implements the method as described above.
[0029] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor of an electronic device, the electronic device implements the method as described above.
[0030] According to one aspect of an embodiment of the present application, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the method as described above is implemented.
[0031] The details of one or more embodiments of the present application are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the present application will become apparent from the description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the traditional technology, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the disclosed drawings without paying any creative work.
[0033] FIG1 is a schematic diagram of an implementation environment shown in an exemplary embodiment of the present application;
[0034] FIG2 is a flowchart of a hearing assistance method according to an exemplary embodiment of the present application;
[0035] FIG3 is a diagram of an application market interface shown in an exemplary embodiment of the present application;
[0036] FIG4 is a flowchart of a hearing assistance method shown in another exemplary embodiment of the present application;
[0037] FIG5 is a diagram of a parameter setting interface shown in an exemplary embodiment of the present application;
[0038] FIG6 is a schematic diagram of a feedback interface shown in another exemplary embodiment of the present application;
[0039] FIG7 is a schematic diagram showing hearing test results according to another exemplary embodiment of the present application;
[0040] FIG8 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0041] FIG9 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0042] FIG10 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0043] FIG11 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0044] FIG12 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0045] FIG13 is a schematic diagram of a hearing aid parameter calculation process shown in another exemplary embodiment of the present application;
[0046] FIG14 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0047] FIG15 is a schematic diagram of a hearing aid parameter adjustment interface shown in another exemplary embodiment of the present application;
[0048] FIG16 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0049] FIG17 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0050] FIG18 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0051] FIG19 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0052] FIG20 is a flowchart of a hearing assistance method according to another exemplary embodiment of the present application;
[0053] FIG21 is a schematic diagram of an implementation environment shown in another exemplary embodiment of the present application;
[0054] FIG22 is a schematic diagram of a hearing assistance process according to another exemplary embodiment of the present application;
[0055] FIG23 is a schematic diagram of an invitation interface shown in another exemplary embodiment of the present application;
[0056] FIG24 is a flow chart of a channel creation process shown in another exemplary embodiment of the present application;
[0057] FIG25 is a schematic diagram of a service selection interface shown in another exemplary embodiment of the present application;
[0058] FIG26 is a flowchart of an audiometry process shown in another exemplary embodiment of the present application;
[0059] FIG27 is a schematic diagram of an audiometry process according to an exemplary embodiment of the present application;
[0060] FIG28 is a schematic diagram of a selection interface shown in an exemplary embodiment of the present application;
[0061] FIG29 is a flow chart of a parameter configuration process shown in an exemplary embodiment of the present application;
[0062] FIG30 is a flow chart of a parameter adjustment process shown in an exemplary embodiment of the present application;
[0063] FIG31 is a structural diagram of a hearing assistance device according to an exemplary embodiment of the present application;
[0064] FIG32 is a structural diagram of a hearing assistance device according to an exemplary embodiment of the present application;
[0065] FIG33 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0066] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0067] Example embodiments will now be described in a more complete manner with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to these examples; rather, these embodiments are provided to make this application more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art.
[0068] In addition, the features, structures or characteristics described in the present application may be combined in one or more embodiments in any suitable manner. In the following description, there are many specific details so that the embodiments of the present application can be fully understood. However, it will be appreciated by those skilled in the art that when implementing the technical solution of the present application, it is not necessary to use all the detailed features in the embodiments, one or more specific details may be omitted, or other methods, elements, devices, steps, etc. may be adopted.
[0069] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.
[0070] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0071] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.
[0072] It should also be noted that the term "plurality" used in this application refers to two or more. "And / or" describes the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.
[0073] The following is a detailed introduction to the technical solutions of the embodiments of this application:
[0074] In related technologies, the cost of hearing-assisted services provided by professionals to people with hearing impairments is high, and applications used to implement remote hearing-assisted services also suffer from instability, difficulty in development, and communication difficulties between people with hearing impairments and professionals. Based on this, the embodiments of this application provide a hearing-assisted method and apparatus, electronic equipment, storage medium, and program product that can improve the quality of hearing-assisted services.
[0075] Please refer to Figure 1, which is a schematic diagram of an implementation environment involved in this application, which includes a hearing-assistive terminal 110 and an auxiliary receiving terminal 120. The hearing-assistive terminal 110 and the auxiliary receiving terminal 120 communicate with each other via a wired or wireless network. The hearing-assistive terminal 110 can send its own data to the auxiliary receiving terminal 120, and can also obtain data from the auxiliary receiving terminal 120.
[0076] Among them, the hearing assistance end 110 includes but is not limited to at least one of a terminal device and a server, which refers to an end that provides hearing assistance services, which can be a device corresponding to a hearing assistance provider, wherein the hearing assistance provider is used to provide hearing assistance services to hearing-impaired patients, for example, it can be an audiologist, doctor, etc.; the assistance receiving end 120 includes but is not limited to at least one of a terminal device and a server, which refers to an end that obtains hearing assistance services, which can be a device corresponding to a hearing assistance receiver, wherein the hearing assistance receiver refers to an object to which hearing assistance services need to be provided, for example, it can be a hearing-impaired patient, etc. For terminal devices, they may include but are not limited to mobile phones, tablets, laptops, computers, voice interaction devices, home appliances, vehicle-mounted terminals, aircraft, remote driving terminals, payment devices (for example, palm-swiping devices, etc.), etc.; for servers, they may be independent physical servers, or they may be server clusters or distributed systems composed of multiple physical servers, or they may be cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. This section does not restrict the specific forms of terminal devices and servers.
[0077] It should be noted that the number of hearing-assistive terminals 110 and auxiliary receiving terminals 120 in FIG1 is merely illustrative, and any number of hearing-assistive terminals 110 and auxiliary receiving terminals 120 may be provided according to actual needs.
[0078] In an exemplary embodiment, the hearing assistance terminal 110 and the auxiliary receiving terminal 120 provided by the embodiment of the present application are jointly executed. Exemplarily, the hearing assistance terminal 110 can establish an audio and video call between the hearing assistance terminal 110 and the auxiliary receiving terminal 120 through the call software, and obtain the running instructions for the hearing assistance application hosted in the call software, so as to run the hearing assistance application in the call software according to the running instructions, and then, based on the hearing assistance application, establish a data transmission channel between the hearing assistance terminal 110 and the auxiliary receiving terminal 120. The data transmission channel is a duplex communication channel for transmitting the application data of the hearing assistance application. Through the data transmission channel and the audio and video call, the auxiliary receiving terminal 120 is provided with hearing assistance. Compared with related technologies, the service can realize communication and exchange between the hearing assistance provider corresponding to the hearing assistance terminal 110 and the hearing assistance receiver corresponding to the assistance receiving terminal 120 through audio and video calls, which improves the convenience and accuracy of the hearing assistance service. In addition, the audio and video calls are established based on the call software, which can improve the stability of the audio and video calls. The hearing assistance application does not need to integrate the audio and video call function, and the hearing assistance application is hosted on the call software and runs based on the call software. It can reduce the difficulty of developing the hearing assistance application, improve the stability of the hearing assistance application, and improve the quality of the hearing assistance service.
[0079] Optionally, the implementation environment may also include a hearing aid device 130 to improve the hearing of the hearing aid recipient. After wearing the hearing aid device 130, the hearing aid recipient can hear more sounds based on the hearing aid device 130. The types of hearing aid devices 130 include but are not limited to hearing aids, cochlear implants, etc. The hearing aid device 130 can be connected to the auxiliary receiving terminal 120 via a near-field communication protocol such as Bluetooth. The hearing aid terminal 110 can control the hearing aid device 130 through data transmission channels, audio and video calls, and the connection between the auxiliary receiving terminal 120 and the hearing aid device 130, for example, to configure the hearing aid parameters of the hearing aid device 130.
[0080] The embodiments of this application subsequently involve user-related data such as hearing test results. When the method of this application is applied to specific products or technologies, the user's permission or consent is obtained, and the extraction, use and processing of relevant data comply with local safety standards and local laws and regulations.
[0081] 2 is a flowchart of a hearing assistance method according to an exemplary embodiment of the present application. The method can be applied to the implementation environment shown in FIG1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in FIG1 .
[0082] As shown in FIG2 , in an exemplary embodiment, the hearing assistance method may include steps S210 to S240 , which are described in detail as follows:
[0083] Step S210: establishing an audio and video call between the hearing aid terminal and the auxiliary receiving terminal through the call software.
[0084] It should be noted that the hearing assistance terminal refers to the end that provides hearing assistance services, including but not limited to at least one of a terminal device and a server. It can be the device corresponding to the hearing assistance provider, which is used to provide hearing assistance services to patients with hearing impairments, such as hearing aid fitters, doctors and other professionals who can provide hearing assistance services. Users can run a hearing assistance application on the device and select the hearing assistance provider mode in the hearing assistance application to make the device serve as a hearing assistance terminal for providing hearing assistance services.
[0085] An assistive receiving terminal (Hearing assistance receiving terminal) refers to an end for obtaining hearing assistance services, including but not limited to at least one of a terminal device and a server, which may be a device corresponding to a hearing assistance recipient, and a hearing assistance recipient refers to an object to which hearing assistance services need to be provided, such as a hearing-impaired patient, etc. Among them, a hearing assistance recipient refers to an object to which hearing assistance services need to be provided, for example, it may be a hearing-impaired person, etc. The user may run a hearing assistance application in the device, and select a hearing assistance recipient mode in the hearing assistance application to make the device act as an assistive receiving terminal. A hearing assistance recipient may wear a hearing aid device, wherein a hearing aid device (Hearing aid device) is a device used to improve the hearing of a hearing assistance recipient, and its types include but are not limited to hearing aids, cochlear implants, etc., which may be connected to an assistive receiving terminal via a near-field communication protocol such as Bluetooth, and its hearing aid parameters need to be configured and adjusted according to the hearing condition of the hearing-impaired person.
[0086] Call software refers to software that has audio and video call functions, where audio and video calls include but are not limited to voice calls, video calls, etc. Correspondingly, call software includes but is not limited to applications that can provide functions such as voice calls and video calls, for example, online meeting applications, social chat applications, and other applications that can provide audio and video call functions.
[0087] Both the hearing-assist terminal and the assistive receiving terminal are installed with call software, through which an audio and video call can be established between the hearing-assist terminal and the assistive receiving terminal, so that the hearing-assist provider and the hearing-assist receiver can communicate face to face based on the call, etc. The specific method of establishing the audio and video call can be flexibly set according to actual needs. In an optional example, if the call software is a social chat application, the audio and video call can be initiated by the hearing-assist terminal. Correspondingly, the hearing-assist provider can open the chat social application installed in the hearing-assist terminal, and according to the accounts of the hearing-assist provider and the hearing-assist receiver in the social chat application respectively, the audio and video call can be initiated by the hearing-assist terminal. Number, initiate an audio and video call request to the auxiliary receiving terminal. If the hearing assistance recipient chooses to answer the audio and video call in the auxiliary receiving terminal, an audio and video call between the hearing assistance terminal and the auxiliary receiving terminal is established; or, the audio and video call can be initiated by the auxiliary receiving terminal. Correspondingly, the hearing assistance recipient can open the chat social application installed in the auxiliary receiving terminal, and initiate an audio and video call request to the hearing assistance terminal based on the accounts of the hearing assistance provider and the hearing assistance recipient in the social chat application respectively. If the hearing assistance provider chooses to answer the audio and video call in the hearing assistance terminal, an audio and video call between the hearing assistance terminal and the auxiliary receiving terminal is established. In another optional example, if the audio and video call service is an online conference application, the hearing assistance provider and the hearing assistance recipient can agree on a meeting time and apply for a meeting number in the online conference application based on the meeting time. Subsequently, the hearing assistance provider can join the meeting through the online conference application in the hearing assistance terminal, and the hearing assistance recipient can join the meeting through the online conference application in the auxiliary receiving terminal, thereby establishing an audio and video call.
[0088] Step S220: Obtain an operating instruction for the hearing assistance application hosted in the call software, and operate the hearing assistance application in the call software according to the operating instruction.
[0089] A hearing assistance application refers to an application used to provide hearing assistance services, for example, hearing assistance services such as hearing testing services, fitting services, and information management services. The fitting service is used to update the hearing parameters of hearing aid devices, including but not limited to parameter configuration services and parameter adjustment services. The parameter configuration service is used to configure the hearing parameters of hearing aid devices, and the parameter adjustment service is used to adjust the hearing parameters of hearing aid devices. For a specific introduction to the hearing parameters, please refer to the subsequent records and will not be repeated here. The information management service is used to manage the attribute information of hearing aid devices, for example, to obtain or configure the attribute information of the subject device. The attribute information of the hearing aid device refers to information related to the attributes of the hearing aid device, including but not limited to the manufacturer, form, model, power, working mode, supported communication protocol version, hardware address, etc. of the hearing aid device. The hearing assistance application provides a hearing assistance receiver mode and a hearing assistance provider mode. Different modes provide different control permissions, functions, etc. Users can choose which mode to run the hearing assistance application. Among them, the hearing assistance end can use the hearing assistance provider mode to run the hearing assistance application, and the assistance receiving end can use the hearing assistance receiver mode to run the hearing assistance application.
[0090] The hearing-assistance application does not run independently. It is hosted in the call software and relies on the call software to run. In other words, the call software is the host of the hearing-assistance application. Hosting means that the hearing-assistance application relies on the call software to run, and uses the environment, components or interfaces provided by the call software to realize its own functions. The call software serves as the host of the hearing-assistance application and provides the basis for its operation. For example, the hearing-assistance application can be a small program, which is hosted in the call software through the interface provided by the hearing-assistance application. For another example, the hearing-assistance application can be a plug-in, which is hosted in the call software through plug-in technology. For another example, the hearing-assistance application can be a web application, which is hosted in the call software through the browser component contained in the hearing-assistance application.
[0091] After opening the call software, if a hearing assistance service is needed for the auxiliary receiving terminal, a running instruction for the hearing assistance application can be obtained. According to the running instruction, the hearing assistance application can be run in the call software. Among them, the running instruction can be triggered by the hearing assistance provider. That is, the hearing assistance provider can find the hearing assistance application in the call software, open the hearing assistance application and select the hearing assistance provider mode. Optionally, as shown in Figure 3, the hearing assistance application can be found in the application market of the call software.
[0092] Step S230: Based on the hearing assistance application, a data transmission channel is established between the hearing assistance terminal and the assistance receiving terminal. The data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application.
[0093] In order to implement remote hearing assistance services using a hearing assistance application, a data transmission channel can be established between the hearing assistance terminal and the assistance receiving terminal based on the hearing assistance application. The data transmission channel is a duplex communication channel for transmitting the application data of the hearing assistance application. Subsequently, the application data corresponding to the hearing assistance application can be transmitted between the hearing assistance terminal and the assistance receiving terminal through the data transmission channel. The type of data transmission channel established can be flexibly set according to actual needs. In an optional example, it can be a point-to-point protocol channel. It should be noted that the application data of the hearing assistance application includes but is not limited to data generated by the hearing assistance application, or data received by the hearing assistance application, data sent out by the hearing assistance application, etc., for example, subsequent test requests, parameter configuration strategies, etc.
[0094] The data transmission channel is a duplex communication channel established based on the hearing-assistance application and used to transmit the application data of the hearing-assistance application. It can transmit data between the hearing-assistance terminal and the auxiliary receiving terminal. Its type can be flexibly set according to actual needs, such as a point-to-point protocol channel. Application data is data generated by the hearing-assistance application during operation, or data received or sent out, such as test requests and parameter configuration policies. It can be transmitted between the hearing-assistance terminal and the auxiliary receiving terminal via the data transmission channel.
[0095] In an optional example, the hearing assistance provider may trigger an invitation request in the hearing assistance terminal to invite the assistance receiving terminal to perform hearing assistance services. The hearing assistance terminal may send the invitation request to the assistance receiving terminal. After the assistance receiving terminal receives the invitation request, the hearing assistance receiving terminal may trigger an operation to agree to the invitation request. The assistance receiving terminal generates an invitation agreement response based on the operation, thereby creating a data transmission channel between the hearing assistance terminal and the assistance receiving terminal based on the invitation agreement response. The data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application. In the aforementioned example, the invitation request is triggered by the hearing assistance provider in the hearing assistance terminal. In another optional example, the invitation request may be triggered by the hearing assistance receiving terminal in the assistance receiving terminal to invite the hearing assistance terminal to perform hearing assistance services.
[0096] Step S240: providing hearing assistance services to the auxiliary receiving terminal through the data transmission channel and audio and video calls.
[0097] After establishing the data transmission channel and audio and video calls, the hearing aid recipient and the hearing aid provider can communicate and exchange views through audio and video calls. At the same time, the application data of the hearing aid application is transmitted between the hearing aid end and the aid receiving end through the data transmission channel, so as to transmit the data triggered by the hearing aid provider or the hearing aid recipient in the hearing aid application to the other party, realize the remote service of the hearing aid application, and thus better provide hearing aid services to the hearing aid recipient.
[0098] In the embodiment shown in Figure 2, the application data of the hearing assistance application is transmitted between the auxiliary receiving end and the hearing assistance end through the data transmission channel, thereby realizing the remote service of the hearing assistance application, and realizing the communication and exchange between the hearing assistance provider corresponding to the hearing assistance end and the hearing assistance receiver corresponding to the auxiliary receiving end through audio and video calls, thereby improving the convenience and accuracy of the hearing assistance service. Moreover, the audio and video calls are established based on the call software, which can improve the stability of the audio and video calls. The hearing assistance application does not need to integrate the audio and video call function, and the hearing assistance application is hosted on the call software and runs based on the call software, which can reduce the development difficulty of the hearing assistance application, improve the stability of the hearing assistance application, and improve the quality of the hearing assistance service.
[0099] In an exemplary embodiment, referring to Figure 4, Figure 4 is a flow chart of a hearing assistance method proposed based on Figure 2. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0100] As shown in FIG4 , step S240 may include steps S410 to S420, which are described in detail as follows:
[0101] In step S410, the test request is sent to the auxiliary receiving end through the data transmission channel, and the hearing test result of the hearing aid recipient corresponding to the hearing aid device is determined based on the feedback information corresponding to the test request; wherein, the test request is used to instruct the auxiliary receiving end to control the hearing aid device to play the test audio corresponding to the test request, and the feedback information is used to indicate whether the hearing aid recipient hears the test audio.
[0102] It should be noted that hearing assistance service is a series of services provided to recipients of hearing assistance, including hearing test services, fitting services for updating hearing aid parameters of hearing aid devices (such as parameter configuration services and parameter adjustment services), and information management services for managing the attribute information of hearing aid devices.
[0103] The hearing assistance service may include a hearing test service, which is used to test the hearing condition of the hearing assistance recipient, wherein the test request is used to instruct the assistance receiving end to control the hearing aid device to play the test audio corresponding to the test request. When a hearing test is required, the hearing assistance end can generate a test request and send the test request to the assistance receiving end; the assistance receiving end is connected to the hearing aid device, which, after receiving the test request, can determine the corresponding test audio according to the test request and control the hearing aid device to play the test audio to test whether the wearer of the hearing aid device (i.e., the hearing assistance recipient) can hear the test audio. Then, the hearing aid device can obtain feedback information corresponding to the test request, wherein the feedback information is used to indicate whether the hearing assistance recipient hears the test audio corresponding to the test request, thereby determining the hearing test result of the hearing assistance recipient based on the feedback information.
[0104] Optionally, the test request includes relevant data of the corresponding test audio, so that the auxiliary receiving end can determine the test audio based on the relevant data, wherein the test request can directly include the test audio, or the test request can include the test sound frequency and the test sound intensity, so that the audio that matches the test sound frequency and the test sound intensity is used as the test audio corresponding to the test request, wherein the test sound frequency refers to the sound frequency used for hearing tests, and it is necessary to test the degree of hearing loss of the hearing aid recipient at this sound frequency; the test sound intensity refers to the sound intensity used for hearing tests, and it is necessary to test whether the hearing aid recipient can hear the sound of this sound intensity. In an optional example, the test request can be automatically generated by a hearing aid application, that is, the hearing aid application provides an automatic testing service. If the hearing aid provider triggers the automatic testing service in the hearing aid application running on the hearing aid end, the automatic testing service can automatically determine the relevant data of the test audio and automatically generate a test request based on the relevant data. In another optional example, the test request may be triggered by the hearing aid provider, that is, the hearing aid application provides a manual test service. If the hearing aid provider triggers the manual test service in the hearing aid application running on the hearing aid terminal, the hearing aid terminal can obtain the relevant data of the test audio set by the hearing aid provider and generate a test request based on the relevant data. For example, in an optional example, referring to Figure 5, Figure 5 is an exemplary test parameter setting interface, the interface includes a left ear hearing test result diagram 501 and a right ear hearing test result diagram 502 of the hearing aid recipient, and the test result diagram includes the hearing threshold of the hearing aid recipient at different sound frequencies; the interface also includes a left ear hearing test parameter setting control 503 and a right ear hearing test parameter setting control 504. After the hearing aid provider sets a test sound frequency of 6KHz and a test sound intensity of 55db in the control 504, it can trigger the hearing aid device to play a test audio with a sound frequency of 6KHz and a sound intensity of 55db to the right ear through the "Play" control.
[0105] The specific method for the hearing aid end to obtain feedback information corresponding to the test request can be flexibly set according to actual needs, for example, including but not limited to at least one of the following methods:
[0106] The first one is that after the hearing aid device plays the test audio, the hearing aid recipient can input feedback information through the user input interface provided by the auxiliary receiving end. The auxiliary receiving end can obtain the feedback information input by the auxiliary receiving end and send the feedback information to the hearing aid device through the data transmission channel, so that the hearing aid device obtains the feedback information of the test request.
[0107] Among them, the user input interface can be a touch screen, and correspondingly, a feedback interface can be displayed in the hearing assistance application running in the auxiliary receiving end, and the hearing assistance recipient can input feedback information through the feedback interface. For example, as shown in Figure 6, the feedback interface includes an "I heard" control. After playing the test audio, if the hearing assistance recipient hears the test audio, he can trigger the "I heard" control to input feedback information indicating that the hearing assistance recipient heard the test audio.
[0108] Optionally, after playing the test audio, if the auxiliary receiving end does not obtain feedback information input by the hearing aid recipient within a specified time period, it can also generate feedback information indicating that the hearing aid recipient did not hear the test audio, and send the feedback information to the hearing aid device through the data transmission channel.
[0109] Second, the hearing aid device displays a trigger control corresponding to the feedback information, obtains a trigger operation for the trigger control, and obtains feedback information of the test request according to the trigger operation.
[0110] Optionally, a trigger control corresponding to the feedback information can be displayed in the hearing assistance application running in the hearing aid device. After playing the test audio, the hearing assistance recipient can provide feedback to the hearing assistance provider through an audio or video call on whether the test audio is heard. For example, the hearing assistance recipient can express to the hearing assistance provider whether the test audio is heard through gestures, speech, etc. After the hearing assistance provider obtains the user's feedback, it can trigger the displayed trigger control to input the feedback information of the hearing assistance recipient. For example, as shown in Figure 5, the interface includes a "User Heard" control. After playing the test audio, the hearing assistance provider can trigger the "User Heard" control to input feedback information indicating that the hearing assistance recipient has heard it.
[0111] Step S420 , displaying the hearing test result, and sending the hearing test result to the auxiliary receiving terminal, so that the auxiliary receiving terminal displays the hearing test result.
[0112] After obtaining the hearing test results of the hearing aid recipient, the hearing aid terminal can display the hearing test results for the hearing aid provider to view; it can also send the hearing test results to the auxiliary receiving terminal so that the auxiliary receiving terminal displays the hearing test results for the hearing aid recipient to view.
[0113] The hearing test results may include at least one of the left ear hearing test results and the right ear hearing test results of the hearing aid recipient, and the hearing test results of each ear include the hearing threshold of the ear at different sound frequencies. The hearing threshold refers to the minimum sound intensity that can be heard, and the hearing threshold at a certain sound frequency refers to the minimum sound intensity that can be heard at that sound frequency. The hearing test results can be displayed in the form of a chart. For example, see Figure 7, which is an exemplary hearing test result display diagram, with the horizontal axis being the sound frequency and the vertical axis being the sound intensity.
[0114] It should be noted that the specific implementation details of steps S210 to S230 shown in FIG4 can refer to steps S210 to S230 shown in FIG2 , which will not be repeated here.
[0115] In the embodiment shown in FIG4 , a hearing test can be performed on the hearing aid recipient based on the data transmission channel and the audio and video call, thereby improving the accuracy and convenience of the hearing test.
[0116] In an exemplary embodiment, referring to Figure 8, Figure 8 is a flow chart of a hearing assistance method proposed based on Figure 4. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0117] As shown in FIG8 , if the hearing test result includes the hearing threshold of the hearing aid recipient at the set test sound frequency, step S410 may include steps S810 to S820, which are described in detail as follows:
[0118] Step S810, generating multiple test requests corresponding to the test sound frequency, and sending the multiple test requests in sequence to the auxiliary receiving end through the data transmission channel; wherein each test request includes a test sound intensity and a test sound frequency, and the test sound intensity included in different test requests is different.
[0119] Under the condition that the hearing test result includes the hearing threshold of the hearing aid recipient at the set test sound frequency, it is necessary to play test audio with different sound intensities at the test sound frequency, so as to determine the hearing threshold of the hearing aid recipient at the test sound frequency based on the feedback information of the hearing aid recipient on the test audio with different sound intensities. Therefore, multiple test requests corresponding to the test sound frequency can be generated, each test request including the test sound frequency and the test sound intensity, and the test sound intensities included in different test requests are different. The multiple test requests are then sent to the auxiliary receiving end, so that the auxiliary receiving end controls the hearing aid device to play the test audio with different test sound intensities at the test sound frequency according to the multiple test requests.
[0120] Step S820: In the process of generating multiple test requests, feedback information corresponding to the current test request is obtained. If it is determined that the conditions for determining the hearing threshold of the hearing aid recipient at the test sound frequency are not met based on the feedback information corresponding to the current test request and the test sound intensity corresponding to the current test request, the test sound intensity corresponding to the next test request is calculated, and the next test request is generated based on the test sound intensity and test sound frequency corresponding to the next test request, until the hearing threshold of the hearing aid recipient at the test sound frequency is determined.
[0121] The conditions for determining the hearing threshold of the hearing aid recipient at the test sound frequency are not met. Specifically, it may be due to insufficient feedback information, the test range is not covered, the sound intensity difference does not reach the threshold, there is a problem with the test audio playback, or the hearing aid recipient is unstable.
[0122] Insufficient feedback information refers to the inability of the feedback information to clearly indicate whether the hearing aid recipient heard the test audio. For example, when a user inputs feedback information through the input interface, the feedback information may be ambiguous due to operational errors, unclear expression, etc., and it is impossible to accurately determine whether the user heard the sound. For example, the hearing aid recipient accidentally touched other options when entering feedback information, resulting in the feedback information received by the system not matching the actual situation.
[0123] An uncovered test range means that the currently tested sound intensity range does not yet include the hearing threshold of the hearing aid recipient at the test sound frequency. For example, the initially set maximum sound intensity is too low or the minimum sound intensity is too high, causing the hearing threshold to fall outside the currently tested sound intensity range. If the initially set minimum sound intensity is 30dB, but the actual hearing threshold may be 20dB, then the hearing threshold cannot be determined within the current test range.
[0124] The sound intensity difference not reaching the threshold means that according to the patent's binary search method for the hearing threshold, when the difference between the updated maximum sound intensity and the minimum sound intensity is still greater than or equal to the set intensity threshold, the hearing threshold cannot be determined. This is because at this time, it is necessary to further narrow the search range and conduct further tests to approach the hearing threshold. For example, if the intensity threshold is set to 5dB, and the current difference between the maximum sound intensity and the minimum sound intensity is 8dB, it is necessary to continue adjusting the test sound intensity for testing.
[0125] Test audio playback issues refer to issues that may occur during the test audio playback process, such as hearing device malfunction or audio transmission errors. This can result in the hearing aid recipient not receiving the test audio properly, making it impossible to determine the hearing threshold based on the feedback information. For example, if the hearing aid device's speaker is damaged and unable to play the test audio properly, the hearing aid recipient will naturally not be able to hear the sound, and the feedback information will not reflect their true hearing condition.
[0126] Unstable hearing aid recipient status refers to the hearing aid recipient's unstable state during the test, such as lack of concentration or physical discomfort, which can lead to inaccurate feedback information. For example, if the hearing aid recipient is suddenly distracted during the test and loses focus on the test audio, they may provide incorrect feedback information, affecting the determination of the hearing threshold.
[0127] In the process of generating multiple test requests corresponding to the test sound frequency, the current test request can be sent to the auxiliary receiving end through the data transmission channel, so that the auxiliary receiving end plays the test audio that matches the test sound frequency and test sound intensity contained in the current test request, and obtains the feedback information corresponding to the current test request. If it is determined according to the feedback information corresponding to the current test request that the conditions for determining the hearing threshold of the hearing aid recipient at the test sound frequency are not met, then the test sound intensity corresponding to the next test request is calculated according to the feedback information corresponding to the current test request and the test sound intensity, and the next test request is generated according to the test sound intensity and test sound frequency corresponding to the next test request. The next test request is sent to the auxiliary receiving end through the data transmission channel, so that the auxiliary receiving end plays the test audio that matches the test sound frequency and test sound intensity contained in the next test request, and obtains the feedback information corresponding to the next test request. The cycle is repeated until the hearing threshold of the hearing aid recipient at the test sound frequency is determined. That is to say, from the perspective of the next test request, in the process of generating multiple test requests corresponding to the test sound frequency except the first test request, the test sound intensity contained in the test request is automatically calculated based on the test sound intensity contained in the previous test request of the test request and the feedback information of the previous test request.
[0128] Among them, the specific method of generating multiple test requests corresponding to the test sound frequency can be flexibly set according to actual needs. In an optional example, multiple different test sound intensities can be pre-set, and the first test sound intensity is extracted from the multiple test sound intensities in order from small to large to generate the first test request. If the feedback information of the first test request is that the user did not hear it, the second test sound intensity is extracted from the multiple test sound intensities to generate the second test request. If the feedback information of the second test request is that the user did not hear it, the third test sound intensity is extracted from the multiple test sound intensities to generate the third test request, and so on, until the corresponding feedback information is found to be a test request that the user can hear, and the test request corresponding to The test sound intensity is used as the hearing threshold of the hearing aid recipient at the test sound frequency; alternatively, the first test sound intensity can be extracted from multiple test sound intensities in descending order to generate a first test request; if the feedback information of the first test request is audible to the user, the second test sound intensity is extracted from the multiple test sound intensities to generate a second test request; if the feedback information of the second test request is audible to the user, the third test sound intensity is extracted from the multiple test sound intensities to generate a third test request, and so on, until a test request whose corresponding feedback information is not heard by the user is found, and the test sound intensity corresponding to the previous test request of the test request is used as the hearing threshold of the hearing aid recipient at the test sound frequency.
[0129] It should be noted that steps S810-S820 can be used to detect the hearing threshold of the hearing aid recipient at multiple test sound frequencies, wherein, after detecting the hearing threshold of the hearing aid recipient at the current test sound frequency, the hearing threshold of the hearing aid recipient at the next test sound frequency can be detected in a manner from large to small (or from small to large) according to the corresponding sound frequencies. The specific implementation details of steps S210-S230 shown in Figure 8 can refer to steps S210-S230 shown in Figure 2, and the specific implementation details of step S420 shown in Figure 8 can refer to step S420 shown in Figure 4, which will not be repeated here.
[0130] In the embodiment shown in FIG8 , the hearing of the hearing aid recipient is automatically tested, and the test sound intensity corresponding to the next test request can be calculated based on the feedback information corresponding to the current test request and the test sound intensity, thereby improving the efficiency of the hearing test.
[0131] In an exemplary embodiment, referring to Figure 9, Figure 9 is a flow chart of a hearing assistance method proposed based on Figure 8. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0132] As shown in FIG9 , step S820 may include steps S910 to S950, which are described in detail as follows:
[0133] Step S910: In the process of generating multiple test requests, feedback information corresponding to the current test request is obtained.
[0134] The specific method for obtaining the feedback information corresponding to the test request can be found in the above example and will not be repeated here.
[0135] Step S920, obtaining the maximum sound intensity and the minimum sound intensity used to calculate the test sound intensity corresponding to the current test request; wherein the test sound intensity corresponding to the current test request is less than or equal to the maximum sound intensity and greater than or equal to the minimum sound intensity.
[0136] The test sound intensity of the current test request is calculated based on the maximum sound intensity and the minimum sound intensity, wherein the test sound intensity is less than or equal to the maximum sound intensity and greater than or equal to the minimum sound intensity, and the hearing threshold of the hearing aid recipient is also less than or equal to the maximum sound intensity and greater than or equal to the minimum sound intensity.
[0137] Among them, for the first test request among multiple test requests corresponding to the test sound frequency, the corresponding maximum sound intensity is the set maximum sound intensity corresponding to the test sound frequency, and the minimum sound intensity is the minimum sound intensity corresponding to the test sound frequency; the corresponding test sound intensity can be the set sound intensity, or it can be calculated based on the average value between the maximum sound intensity and the minimum sound intensity.
[0138] For test requests other than the first test request among the multiple test requests corresponding to the test sound frequency, the maximum sound intensity and the minimum sound intensity are the values updated based on the feedback information corresponding to the previous test request. If the feedback information corresponding to the previous test request indicates that the hearing aid recipient heard the test audio corresponding to the test request, the maximum sound intensity is updated to the test sound intensity corresponding to the previous test request; if the feedback information corresponding to the previous test request indicates that the hearing aid recipient did not hear the test audio corresponding to the test request, the minimum sound intensity is updated to the test sound intensity corresponding to the previous test request.
[0139] Step S930, update the maximum sound intensity and the minimum sound intensity according to the feedback information corresponding to the current test request; wherein, if the feedback information corresponding to the current test request indicates that the hearing aid recipient hears the test audio corresponding to the current test request, the maximum sound intensity is updated to the test sound intensity corresponding to the current test request; if the feedback information corresponding to the current test request indicates that the hearing aid recipient does not hear the test audio corresponding to the current test request, the minimum sound intensity is updated to the test sound intensity corresponding to the current test request.
[0140] If the feedback information corresponding to the current test request indicates that the hearing assistance recipient hears the test audio corresponding to the current test request, it means that the hearing assistance recipient's hearing threshold at the test sound frequency is less than or equal to the test sound intensity corresponding to the current test request, and greater than or equal to the minimum sound intensity. Therefore, the maximum sound intensity is updated to the test sound intensity corresponding to the current test request, and the minimum sound intensity is not updated; if the feedback information corresponding to the current test request indicates that the hearing assistance recipient does not hear the test audio corresponding to the current test request, it means that the hearing assistance recipient's hearing threshold at the test sound frequency is greater than the test sound intensity corresponding to the current test request, and less than or equal to the maximum sound intensity. Therefore, the minimum sound intensity is updated to the test sound intensity corresponding to the current test request, and the maximum sound intensity is not updated.
[0141] Step S940: If the difference between the updated maximum sound intensity and the minimum sound intensity is greater than or equal to the set intensity threshold, the test sound intensity corresponding to the next test request is calculated based on the average value between the updated maximum sound intensity and the minimum sound intensity.
[0142] If the difference between the updated maximum and minimum sound intensities is greater than or equal to the set intensity threshold, the hearing aid recipient's hearing threshold at the test sound frequency is searched from the updated maximum and minimum sound intensities. Therefore, the average value between the updated maximum and minimum sound intensities is calculated, and the test sound intensity for the next test request is obtained based on the average value. The next test request is then generated based on the test sound intensity of the next test request. In other words, in this embodiment, a binary search method is used to search for the hearing aid recipient's hearing threshold.
[0143] Optionally, the average value between the updated maximum sound intensity and the minimum sound intensity can be directly used as the test sound intensity of the next test request; or, since the test sound intensity corresponding to the test request is used as the hearing threshold, in order to make the hearing threshold an integer multiple of the set value, it can be determined whether the average value between the updated maximum sound intensity and the minimum sound intensity is an integer multiple of the set value. If so, the average value is used as the test sound intensity of the next test request; if not, the value with the smallest difference from the average value and an integer multiple of the set value is obtained, and the value is used as the test sound intensity of the next test request. Among them, the value with the smallest difference from the average value, less than the average value, and an integer multiple of the set value can be obtained as the test sound intensity of the next test request; or, the value with the smallest difference from the average value, greater than the average value, and an integer multiple of the set value can be obtained as the test sound intensity of the next test request. Among them, the set value can be an intensity threshold, or the set value and the intensity threshold can be different.
[0144] Step S950: If the difference between the updated maximum sound intensity and the minimum sound intensity is less than the set intensity threshold, the hearing threshold at the test sound frequency is determined according to the average value between the updated maximum sound intensity and the minimum sound intensity.
[0145] If the difference between the updated maximum sound intensity and the minimum sound intensity is less than the set intensity threshold, the hearing threshold at the test sound frequency can be determined based on the average value between the updated maximum sound intensity and the minimum sound intensity. For example, the test sound intensity corresponding to the next test request can be used as the hearing threshold, and the next test request is not generated. The fact that the difference between the updated maximum sound intensity and the minimum sound intensity is less than the set intensity threshold is a condition for determining the hearing threshold of the hearing aid recipient at the test sound frequency.
[0146] It should be noted that the specific implementation details of steps S210-S230 shown in Figure 9 can refer to steps S210-S230 shown in Figure 2, the specific implementation details of step S420 shown in Figure 9 can refer to step S420 shown in Figure 4, and the specific implementation details of step S810 shown in Figure 9 can refer to step S810 shown in Figure 8, which will not be repeated here.
[0147] In the embodiment shown in FIG9 , a dichotomy method is used to gradually determine the hearing threshold of the hearing aid recipient at the test sound frequency, which can improve the efficiency of the hearing test.
[0148] In an exemplary embodiment, referring to Figure 10, Figure 10 is a flow chart of a hearing assistance method proposed based on Figure 8. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0149] As shown in FIG10 , step S810 may include steps S1010 to S1040, which are described in detail as follows:
[0150] Step S1010: Generate multiple test requests corresponding to the test sound frequencies.
[0151] The specific process of generating multiple test requests is described above and will not be repeated here.
[0152] Step S1020 , calculating the interval duration of the current test request; wherein, the interval durations corresponding to different test requests are not exactly the same.
[0153] In order to avoid the situation where the hearing aid recipient easily finds the pattern and gives feedback according to conditioned reflex due to periodic playback of test audio, resulting in low accuracy of the hearing test results, the interval duration of the current test request can be calculated. The interval duration is used to represent the time difference between the sending time of the current test request and the sending time of the next test request; and the interval durations corresponding to different test requests are not exactly the same.
[0154] Among them, the specific method of calculating the interval duration of the current test request can be flexibly set according to actual needs. In an optional example, a random number can be generated within a set range and the random number can be used as the interval duration of the current test request. That is, the interval duration of the test request is random. In another optional example, a plurality of different interval durations can be pre-set, and the interval durations can be extracted from the plurality of interval durations in order from large to small (or from small to large) as the interval duration of the test request. That is, the interval duration with the smallest duration is used as the interval duration of the first test request, the interval duration with the second largest duration is used as the interval duration of the second test request, and so on. If the interval duration with the longest duration is used as the interval duration of the test request, the interval duration with the smallest duration can be used as the interval duration of the subsequent test request again, and so on.
[0155] Step S1030: Calculate the sending time of the next test request according to the sending time and the interval length of the current test request.
[0156] The sending time of the next test request = the sending time of the current test request + the interval length of the current test request.
[0157] Step S1040: Send the next test request to the auxiliary receiving end through the data transmission channel according to the sending time of the next test request.
[0158] After calculating the sending time of the next test request, the next test request may be sent to the auxiliary receiving end through the data transmission channel according to the sending time.
[0159] It should be noted that the specific implementation details of steps S210-S230 shown in Figure 10 can refer to steps S210-S230 shown in Figure 2, the specific implementation details of step S420 shown in Figure 10 can refer to step S420 shown in Figure 4, and the specific implementation details of step S820 shown in Figure 10 can refer to step S820 shown in Figure 8, which will not be repeated here.
[0160] In the embodiment shown in FIG10 , the sending time intervals between adjacent test requests are not exactly the same, thereby avoiding the situation where periodic sending of test requests causes the user to find a pattern, conditional feedback, and result in low accuracy of the hearing test results.
[0161] In an exemplary embodiment, referring to Figure 11, Figure 11 is a flow chart of a hearing assistance method proposed based on Figure 4. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0162] As shown in FIG11 , the hearing assistance method may further include step S1110, which is described in detail as follows:
[0163] Step S1110, storing the hearing test results to a server; wherein the server includes a cloud server.
[0164] After obtaining the hearing test results, the hearing aid can store the hearing test results on a server. The server can be a cloud server, that is, the hearing test results are stored in the cloud; or the server can be a physical server.
[0165] It should be noted that the specific implementation details of steps S210-S230 shown in Figure 11 can refer to steps S210-S230 shown in Figure 2, and the specific implementation details of steps S410-S420 shown in Figure 11 can refer to steps S410-S420 shown in Figure 4, which will not be repeated here.
[0166] In the embodiment shown in FIG11 , storing the hearing test results on the server can reduce the storage pressure on the hearing aid terminal, making it easier for the hearing aid provider to obtain the hearing test results from the server after logging in on other terminals, thereby improving convenience.
[0167] In an exemplary embodiment, referring to Figure 12, Figure 12 is a flow chart of a hearing assistance method proposed based on Figure 2. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0168] As shown in FIG12 , step S240 may include steps S1210 to S1240, which are described in detail as follows:
[0169] Step S1210: Obtain the hearing test result of the hearing aid receiver corresponding to the hearing aid device connected to the auxiliary receiving end.
[0170] The hearing assistance service includes a parameter configuration service, which is used to configure the hearing assistance parameters of the hearing assistance device. The hearing assistance parameters of the hearing assistance device are used to indicate how the hearing assistance device helps the hearing assistance recipient improve his or her hearing. The types include but are not limited to hearing aid gain and maximum power output limit (MPO). The hearing aid gain is used to indicate how to amplify the sound, and the MPO is used to limit the maximum sound intensity output by the hearing assistance device. The MPO cannot exceed the discomfort threshold of the hearing assistance recipient.
[0171] In order to configure parameters, the hearing test results of the hearing aid recipient can be obtained.
[0172] Among them, the specific method of obtaining the hearing test results can be flexibly set according to actual needs. For example, in an optional example, the hearing test results of the hearing aid recipient can be obtained through steps S410-S420; or, in another optional example, the historical hearing test results of the hearing aid recipient can be obtained from the server.
[0173] Step S1220: Send the hearing test results to the server, so that the server generates a parameter configuration strategy for the hearing aid device according to the hearing test results.
[0174] In order to improve the efficiency of parameter configuration, the hearing test results are sent to the server, and the server generates a parameter configuration strategy for the hearing aid device based on the hearing test results; wherein the parameter configuration strategy is used to configure the hearing aid parameters of the hearing aid device. The server can be a cloud server or a physical server.
[0175] The parameter configuration strategy includes the hearing aid parameters of the hearing aid device at different sound frequencies, for example, the MPO and hearing aid gain of the hearing aid device at different sound frequencies. Optionally, multiple sound intensity levels can be set, and the hearing aid gain corresponding to the current sound frequency can include hearing aid gains corresponding to multiple sound intensity levels, so that for input audio of different sound intensities corresponding to the same sound frequency, the hearing aid device can amplify the input audio based on different hearing aid gains and output it to the hearing aid recipient. Among them, the specific number of sound intensity levels and the sound intensity range corresponding to each sound intensity level can be flexibly set according to actual needs. For example, three sound intensity levels of high, medium and low can be set. The sound intensity ranges corresponding to the three sound intensity levels of high, medium and low are 70-80db, 60-70db and 50-60db respectively. The sound intensity ranges corresponding to the three sound intensity levels of high, medium and low can be adjusted appropriately, covering 75db, 65db and 55db respectively; the hearing aid gains of the sound frequency of 1Khz at the high, medium and low sound intensity levels are 10db, 12db and 15db respectively. If the hearing aid device receives audio with a sound frequency of 1Khz and a sound intensity of 55db, the audio will be amplified by 15db.
[0176] Optionally, in the process of generating a parameter configuration strategy, in addition to referring to the hearing test results, age, gender, type of hearing aid device, and whether it is the first time to wear it, for example, refer to Figure 13, Figure 13 is an exemplary calculation method of the parameter configuration strategy, wherein gain is the fitting algorithm used to generate the parameter configuration strategy, and Figure E01 is the parameter configuration strategy, wherein, in order from top to bottom, the four curves represent the hearing aid gains of the three sound intensity levels of MPO, low, medium, and high, respectively.
[0177] Step S1230: Receive the parameter configuration policy sent by the server, and generate a parameter configuration request according to the parameter configuration policy.
[0178] After the server generates the parameter configuration policy, it sends the parameter configuration policy to the hearing assistance terminal, and the hearing assistance terminal generates a parameter configuration request, where the parameter configuration request is used to request configuration of hearing aid parameters of the hearing aid device, and the parameter configuration request includes a test configuration policy.
[0179] Step S1240: Send the parameter configuration request to the auxiliary receiving terminal through the data transmission channel, so that the auxiliary receiving terminal configures the hearing aid parameters of the hearing aid device according to the parameter configuration policy.
[0180] After generating the parameter configuration request, the hearing assistance terminal can send the parameter configuration request to the auxiliary receiving terminal through the duplex communication connection between the auxiliary receiving terminal, and the auxiliary receiving terminal configures the hearing assistance parameters of the hearing assistance device according to the parameter configuration request.
[0181] It should be noted that the specific implementation details of steps S210 to S230 shown in FIG12 can refer to steps S210 to S230 shown in FIG2 , which will not be repeated here.
[0182] In the embodiment shown in FIG12 , the parameter configuration strategy is generated by the server, which can increase the speed of generating the parameter configuration strategy and the speed of parameter configuration; and reduce the computational pressure of the hearing aid terminal.
[0183] In an exemplary embodiment, referring to Figure 14, Figure 14 is a flow chart of a hearing assistance method proposed based on Figure 2. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the hearing assistance terminal 110 in the implementation environment shown in Figure 1.
[0184] As shown in FIG14 , step S240 may include steps S1410 to S1440, which are described in detail as follows:
[0185] In step S1410 , a parameter acquisition request is sent to the auxiliary receiving terminal through a data transmission channel, so that the auxiliary receiving terminal acquires the current hearing aid parameters of the hearing aid device according to the parameter acquisition request.
[0186] In this embodiment, the hearing assistance service includes a parameter adjustment service. In order to adjust the hearing assistance parameters of the hearing aid device, the hearing assistance end can first generate a parameter acquisition request and send the parameter acquisition request to the auxiliary receiving end through the data transmission channel; after the auxiliary receiving end receives the parameter acquisition request, it obtains the current hearing assistance parameters of the hearing aid device according to the parameter acquisition request.
[0187] Step S1420: receiving the current hearing aid parameters sent by the auxiliary receiving terminal through the data transmission channel, and displaying the current hearing aid parameters on the parameter adjustment interface.
[0188] After the auxiliary receiving end obtains the current hearing aid parameters of the hearing aid device, it sends the current hearing aid parameters to the hearing assistance end through the data transmission channel; the hearing assistance end displays the received current hearing aid parameters on the parameter adjustment interface.
[0189] Step S1430 : In response to the adjustment operation triggered through the parameter adjustment interface, a target hearing aid parameter after adjusting the current hearing aid parameter is determined, and a parameter adjustment request is generated according to the target hearing aid parameter.
[0190] The hearing aid provider can trigger an adjustment operation in the parameter adjustment interface to adjust the current hearing aid parameters, so that the hearing aid terminal determines the target hearing aid parameters after adjusting the current hearing aid parameters according to the adjustment operation, and generates a parameter adjustment request containing the target hearing aid parameters. For example, referring to Figure 15, the parameter adjustment interface contains the current hearing aid parameters, wherein chart 1501 and table 1502 respectively represent the hearing aid parameters corresponding to the left ear. In chart 1501, in order from top to bottom, the four curves respectively represent the MPO corresponding to the left ear, the hearing aid gain for low sound intensity levels, the hearing aid gain for medium sound intensity levels, and the hearing aid gain for high sound intensity levels. Chart 1503 and table 1504 respectively represent the hearing aid parameters corresponding to the right ear. In chart 1503, in order from top to bottom, the four curves respectively represent the MPO corresponding to the right ear, the hearing aid gain for low sound intensity levels, the hearing aid gain for medium sound intensity levels, and the hearing aid gain for high sound intensity levels. The hearing aid provider can select the corresponding hearing aid parameter and modify it.
[0191] Optionally, the hearing aid provider can obtain the hearing aid recipient's wearing conditions of the hearing aid device based on audio and video calls or other methods with the hearing aid recipient, and adjust the current hearing aid parameters according to the wearing conditions.
[0192] In step S1440 , a parameter adjustment request is sent to the auxiliary receiving terminal through the data transmission channel, so that the auxiliary receiving terminal adjusts the hearing aid parameters of the hearing aid device according to the target hearing aid parameters.
[0193] After receiving the parameter adjustment request, the hearing assistance terminal can send the parameter adjustment request to the assistance receiving terminal through the data transmission channel. The assistance receiving terminal updates the hearing assistance parameters of the hearing assistance device according to the target hearing assistance parameters contained in the parameter adjustment request.
[0194] It should be noted that the specific implementation details of steps S210 to S230 shown in FIG14 can refer to steps S210 to S230 shown in FIG2 , which will not be repeated here.
[0195] In the embodiment shown in FIG14 , the hearing aid parameters of the hearing aid device can be adjusted through data transmission channels and audio and video calls, thereby improving the convenience of parameter adjustment. Furthermore, adjusting the hearing aid parameters based on the adjustment operation can improve the accuracy of parameter adjustment.
[0196] 16 is a flowchart of a hearing assistance method according to an exemplary embodiment of the present application. The method can be applied to the implementation environment shown in FIG1 and can be executed by the assistance receiving terminal 120 in the implementation environment shown in FIG1 .
[0197] As shown in FIG16 , in an exemplary embodiment, the hearing assistance method may include steps S1610 to S1640, which are described in detail as follows:
[0198] Step S1610: Establish an audio and video call between the auxiliary receiving terminal and the hearing assistive terminal through the call software.
[0199] The auxiliary receiving terminal is installed with a call software, which can establish an audio and video call between the auxiliary receiving terminal and the hearing assist terminal through the call software. The specific process of establishing an audio and video call between the auxiliary receiving terminal and the hearing assist terminal can be found in the above description and will not be repeated here.
[0200] Step S1620: Obtain a running instruction for the hearing assistance application hosted in the call software, and run the hearing assistance application in the call software according to the running instruction.
[0201] Optionally, the running instruction may be triggered by the hearing assistance recipient, or the assistance recipient may automatically generate the running instruction if it receives an invitation request from the hearing assistance end.
[0202] Step S1630: Based on the hearing assistance application, a data transmission channel is established between the auxiliary receiving end and the hearing assistance end. The data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application.
[0203] The specific process of establishing a data transmission channel based on the hearing assistance application can be found in the description of the aforementioned embodiment and will not be repeated here.
[0204] Step S1640: Obtain the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and audio and video calls.
[0205] After establishing the audio and video call and data transmission channels, the hearing aid recipient and the hearing aid provider can communicate and exchange with each other through audio and video calls. At the same time, the application data of the hearing aid application is transmitted between the hearing aid end and the auxiliary receiving end through the data transmission channel, so as to transmit the data triggered by the hearing aid provider or the hearing aid recipient in the hearing aid application to the other party, realize the remote service of the hearing aid application, and thus receive the hearing aid service through the auxiliary receiving end.
[0206] In the embodiment shown in Figure 16, communication and exchanges between the hearing assistance provider corresponding to the hearing assistance end and the hearing assistance recipient corresponding to the assistance receiving end are achieved through audio and video calls, which improves the convenience and accuracy of the hearing assistance service. In addition, the audio and video calls are established based on the call software, which can improve the stability of the audio and video calls. The hearing assistance application does not need to integrate the audio and video call functions, and the hearing assistance application is hosted on the call software and runs based on the call software. It can reduce the difficulty of developing the hearing assistance application, improve the stability of the hearing assistance application, and improve the quality of the hearing assistance service.
[0207] In an exemplary embodiment, referring to Figure 17, Figure 17 is a flowchart of a hearing assistance method proposed based on Figure 16. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the assistance receiving terminal 120 in the implementation environment shown in Figure 1.
[0208] As shown in FIG17 , step S1640 may include steps S1710 to S1750, which are described in detail as follows:
[0209] Step S1710: Establish a connection between the auxiliary receiving terminal and the hearing aid device by setting a near field communication protocol.
[0210] In the process of providing hearing assistance services, the participation of hearing aid devices is usually required. Therefore, it is necessary to establish a connection between the auxiliary receiving end and the hearing aid device.
[0211] To improve the quality of hearing assistance services, a near-field communication protocol for hearing assistance services can be pre-set. The auxiliary receiving end uses this pre-set near-field communication protocol to establish a connection between the auxiliary receiving end and the hearing aid device. Near-field communication protocols (NFC protocols) are used to establish a connection and transmit data between the auxiliary receiving end and the hearing aid device. Their types include but are not limited to Bluetooth.
[0212] The type of the near field communication protocol to be set includes but is not limited to Bluetooth and the like.
[0213] Step S1720, receiving a control request sent by the hearing aid terminal through the data transmission channel, and searching for a target command corresponding to the control request from multiple commands included in the set near-field communication protocol; wherein the multiple commands include at least one of a read command, a write command or a notification command.
[0214] In order to provide hearing assistance services, the hearing assistance terminal can generate a control request, such as the aforementioned parameter configuration request, parameter adjustment request, test request, etc.; then, the control request is sent to the assistance receiving terminal through the data transmission channel.
[0215] After receiving the control request, the auxiliary receiving end needs to control the hearing aid device according to the control request. In order to achieve control of the hearing aid device, the auxiliary receiving end needs to generate a data packet corresponding to the control request based on the set near-field communication protocol. The set near-field communication protocol includes multiple commands, and the multiple commands include read commands, write commands, and notification commands. The read command is used to instruct the reading of data from the hearing aid device, the write command is used to instruct the writing of data to the hearing aid device, and the notification command is used to instruct the hearing aid to notify. The auxiliary receiving end can select the target command corresponding to the control request from the multiple commands. If the control request is used to instruct the reading of data from the hearing aid device, the target command is a read command. For example, a parameter acquisition request is used to obtain the hearing aid parameters of the hearing aid device, which corresponds to a read command. For example, a parameter configuration request is used to configure the hearing aid parameters of the hearing aid device, which corresponds to a write command.
[0216] Step S1730, searching for a target instruction group corresponding to the hearing assistance service to which the control request belongs from the instruction groups corresponding to the various hearing assistance services included in the set near-field communication protocol, and searching for a target instruction corresponding to the control request from the target instruction group; wherein the various hearing assistance services include at least one of a hearing test service, a fitting service for updating hearing aid parameters of a hearing aid device, and an information management service for managing attribute information of a hearing aid device.
[0217] In setting the near-field communication protocol, corresponding instruction groups are set for different hearing assistance services, and the instruction groups contain instructions required by the corresponding hearing assistance services. Among them, the hearing assistance services include but are not limited to at least one of hearing test services, fitting services for updating hearing aid parameters of hearing aid devices, and information management services for managing attribute information of hearing aid devices. Among them, the fitting services include parameter configuration services, parameter adjustment services, etc.
[0218] From the command groups corresponding to the various hearing assistance services included in the near-field communication protocol, the target command group corresponding to the hearing assistance service to which the control request belongs is searched. The target command corresponding to the control request can be found from the target command group. For example, if the control request is a play request corresponding to the hearing test service, the target command group is the command group corresponding to the hearing test service, and the target command is the play command.
[0219] The target instruction group is the instruction group that the assistive device finds for the hearing assistance service to which the control request belongs, from the instruction groups corresponding to the various hearing assistance services included in the near-field communication protocol. This instruction group contains the instructions required by the corresponding hearing assistance service. The target instruction is the instruction that the assistive device finds for the control request from the target instruction group, and the hearing aid device performs the corresponding operation based on this instruction.
[0220] Step S1740, generating a data packet corresponding to the control request according to the control request, target command, target instruction group, and target instruction; wherein the header of the data packet contains identification information of the target command, identification information of the target instruction group, and identification information of the target instruction in sequence.
[0221] The auxiliary receiving end can generate a data packet corresponding to the control request according to the control request, the target command, the target instruction group, and the target instruction, thereby obtaining a data packet that matches the set near field communication protocol.
[0222] In order to enable the hearing aid device to quickly know the purpose of the data packet, the packet header of the data packet corresponding to the control request contains the identification information of the target command, the identification information of the target instruction group, and the identification information of the target instruction in sequence. The identification information can be an identification number.
[0223] In an optional example, the packet header of the data packet transmitted between the auxiliary receiving end and the hearing aid device includes, in sequence, an application layer protocol version, an information signal, a command identification number, a transmission direction, an instruction group identification number, an instruction identification number, and a payload; wherein the transmission direction is used to indicate whether the data packet is transmitted from the auxiliary receiving end to the hearing aid device, or from the hearing aid device to the auxiliary receiving end.
[0224] In step S1750, the data packet is sent to the hearing aid device through the connection, so that the hearing aid device executes the target instruction according to the data packet and the set near field communication protocol.
[0225] The auxiliary receiving end sends the data packet to the hearing aid device; the hearing aid device can parse the received data packet according to the set near-field communication protocol, thereby executing the target instruction corresponding to the received data packet.
[0226] Optionally, the data packet sent by the hearing aid device to the auxiliary receiving end may also be generated in the above manner.
[0227] It should be noted that the specific implementation details of steps S1610 to S1630 shown in Figure 17 can be referred to steps S1610 to S1630 shown in Figure 16, and will not be repeated here.
[0228] In the embodiment shown in Figure 17, the auxiliary receiving end and the hearing aid device transmit data by setting a near-field communication protocol, thereby obtaining the hearing aid service provided by the hearing aid application. In this way, as long as the hearing aid device supports the setting of the near-field communication protocol, the hearing aid service provided by the hearing aid application can be obtained.
[0229] In an exemplary embodiment, referring to Figure 18, Figure 18 is a flow chart of a hearing assistance method proposed based on Figure 17. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the assistance receiving terminal 120 in the implementation environment shown in Figure 1.
[0230] As shown in FIG. 18 , step S1710 may include steps S1810 to S1840 , which are described in detail as follows:
[0231] Step S1810: Receive a protocol detection request sent by the hearing aid terminal through the data transmission channel, and obtain the near field communication protocol supported by the hearing aid device according to the protocol detection request.
[0232] In order to avoid the situation where the near-field communication protocol supported by the hearing aid device does not match the set near-field communication protocol, resulting in the inability to provide hearing assistance services for the hearing aid device, the hearing assistance end can generate a protocol detection request to detect the near-field communication protocol supported by the hearing aid device; and send the protocol detection request to the auxiliary receiving end through the data transmission channel.
[0233] After receiving the protocol detection request, the auxiliary receiving end obtains the near-field communication protocol supported by the hearing aid device according to the protocol detection request.
[0234] Optionally, the auxiliary receiving end may establish a connection with the hearing aid device based on a near field communication protocol supported by the hearing aid device, so as to communicate with the hearing aid device through the connection and obtain the near field communication protocol supported by the hearing aid device.
[0235] In step S1820, the near field communication protocol supported by the hearing aid device is sent to the hearing aid terminal through the data transmission channel, so that the hearing aid terminal compares the near field communication protocol supported by the hearing aid device with the set near field communication protocol.
[0236] The auxiliary receiving end sends the near-field communication protocol supported by the hearing aid device to the hearing aid end through the data transmission channel. The hearing aid end compares the near-field communication protocol supported by the hearing aid device with the set near-field communication protocol to detect whether the near-field communication protocol supported by the hearing aid device matches the set near-field communication protocol.
[0237] Step S1830: Receive the installation package corresponding to the set near-field communication protocol sent by the hearing-assistive terminal through the data transmission channel, and send the installation package to the hearing-assistive device so that the hearing-assistive device installs the installation package; wherein, the installation package is sent by the hearing-assistive terminal after detecting that the near-field communication protocol supported by the hearing-assistive device does not match the set near-field communication protocol.
[0238] If it is detected that the near-field communication protocol supported by the hearing aid device does not match the set near-field communication protocol, the hearing aid terminal will set the installation package corresponding to the near-field communication protocol and send it to the auxiliary receiving terminal through the data transmission channel. The auxiliary receiving terminal will send the installation package to the hearing aid device. After receiving the installation package, the hearing aid device will install it, so that the hearing aid device supports the set near-field communication protocol.
[0239] If it is detected that the near-field communication protocol supported by the hearing aid device matches the set near-field communication protocol, the hearing aid terminal can send a connection establishment request to the auxiliary receiving terminal through the data transmission channel, so that the auxiliary receiving terminal establishes a connection between the auxiliary receiving terminal and the hearing aid device based on the set near-field communication protocol according to the connection establishment request.
[0240] Step S1840: Establish a connection with the hearing aid device by setting a near field communication protocol.
[0241] After the hearing aid device installs the installation package corresponding to the near-field communication protocol, the hearing aid device supports the setting of the near-field communication protocol, and the auxiliary receiving end can establish a connection with the hearing aid device according to the set near-field communication protocol.
[0242] It should be noted that the specific implementation details of steps S1610-S1630 shown in Figure 18 can refer to steps S1610-S1630 shown in Figure 16, and the specific implementation details of steps S1720-S1750 shown in Figure 18 can refer to steps S1720-S1750 shown in Figure 17, which will not be repeated here.
[0243] In the embodiment shown in Figure 18, it is possible to detect whether the near-field communication protocol supported by the hearing aid device matches the set near-field communication protocol. If there is no match, the installation package corresponding to the set near-field communication protocol can be sent to the hearing aid device for installation, thereby enabling the hearing aid device to support the set near-field communication protocol, improving hearing assistance services, and improving the success rate of parameter configuration.
[0244] In an exemplary embodiment, referring to Figure 19, Figure 19 is a flowchart of a hearing assistance method proposed based on Figure 16. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the auxiliary receiving terminal 120 in the implementation environment shown in Figure 1.
[0245] As shown in FIG. 19 , step S1640 may include steps S1910 to S1940, which are described in detail as follows:
[0246] Step S1910: Receive a parameter configuration request sent by the hearing aid terminal through a data transmission channel; wherein the parameter configuration request includes multiple hearing aid parameters of the hearing aid device.
[0247] The parameter configuration request is used to configure the hearing aid parameters of the hearing aid device, which may include multiple hearing aid parameters of the hearing aid device, for example, the hearing aid gain and MPO of the hearing aid device at different sound frequencies.
[0248] Step S1920: Select a target parameter configuration method corresponding to the parameter configuration request from a plurality of parameter configuration methods, and group a plurality of hearing aid parameters according to the target parameter configuration method to obtain a plurality of parameter groups; wherein different parameter configuration methods correspond to different grouping methods.
[0249] In this embodiment, different parameter configuration methods are provided, each of which groups the multiple hearing aid parameters included in a parameter configuration request differently. For example, if the left and right ears have different hearing abilities, the left and right channels correspond to different hearing aid parameters. Therefore, in one parameter configuration method, hearing aid parameters belonging to the same channel can be grouped together. In another optional parameter configuration method, hearing aid parameters belonging to the same channel can be grouped together based on the channel and sound frequency.
[0250] The target parameter configuration mode refers to a mode selected from a plurality of parameter configuration modes for configuring a parameter configuration request. From a plurality of parameter configuration modes, the specific process of selecting the target parameter configuration mode corresponding to the parameter configuration request can be flexibly set according to actual needs. In an optional example, the versions of the near-field communication protocol used to establish the connection between the hearing aid device and the auxiliary receiving end are different, and the corresponding maximum transmission units (MTU) are different. Therefore, the target parameter configuration mode can be selected according to the version of the near-field communication protocol corresponding to the hearing aid device and the auxiliary receiving end. The larger the MTU corresponding to the near-field communication protocol, the larger the target parameter configuration mode can be selected, in which the amount of data of the hearing aid parameters contained in the parameter group after grouping. For example, if the MTU is large, the parameter configuration mode of grouping according to the channel to which the hearing aid parameters belong can be selected. If the MTU is small, the parameter configuration mode of grouping according to the channel to which the hearing aid parameters belong and the sound frequency can be selected.
[0251] Step S1930: Generate data packets corresponding to a plurality of parameter groups, thereby obtaining a plurality of data packets; wherein the data packet corresponding to each parameter group contains the hearing aid parameters in each parameter group.
[0252] In the process of generating a data packet corresponding to a parameter group, the hearing aid parameters included in the parameter group are added to the data packet.
[0253] Step S1940: Send multiple data packets to the hearing aid device, so that the hearing aid device configures the hearing aid parameters of the hearing aid device according to the hearing aid parameters included in the received data packets.
[0254] After obtaining data packets corresponding to multiple parameter groups, that is, obtaining multiple data packets, the auxiliary receiving end can send the multiple data packets to the hearing aid device, so that the hearing aid device configures the hearing aid parameters of the hearing aid device according to the hearing aid parameters contained in the received data packets.
[0255] Optionally, when sending multiple data packets to a hearing aid device, the current data packet may be sent first to the hearing aid device, causing the hearing aid device to update its own hearing aid parameters based on the hearing aid parameters contained in the current data packet. If the update is successful, an update success notification is sent to the auxiliary receiving terminal, causing the auxiliary receiving terminal to send the next data packet to the auxiliary receiving terminal based on the update success notification, until all hearing aid parameters contained in multiple parameter groups are successfully updated. Optionally, if the update fails, the data packet based on the failed update may be resent.
[0256] It should be noted that, for the parameter adjustment process, the parameters can also be adjusted using the method of steps S1920-S1940; the specific implementation details of steps S1610-S1630 shown in Figure 19 can be referred to steps S1610-S1630 shown in Figure 16, and will not be repeated here.
[0257] In the embodiment shown in FIG19 , the hearing aid parameters of the hearing aid device can be configured according to different parameter configuration methods, thereby improving the flexibility of parameter configuration.
[0258] In an exemplary embodiment, referring to Figure 20, Figure 20 is a flowchart of a hearing assistance method proposed based on Figure 19. The method can be applied to the implementation environment shown in Figure 1 and can be executed by the assistance receiving terminal 120 in the implementation environment shown in Figure 1.
[0259] As shown in FIG. 20 , if the plurality of hearing aid parameters include hearing aid parameters corresponding to the left channel and the right channel, and the hearing aid parameters corresponding to each channel include hearing aid parameters corresponding to multiple sound frequencies, step S1920 may include steps S2010 to S2030, which are described in detail as follows:
[0260] Step S2010: Select a target parameter configuration method corresponding to the parameter configuration request from a plurality of parameter configuration methods.
[0261] The specific selection method can be flexibly set according to actual needs.
[0262] In step S2020 , according to the target parameter configuration mode, the hearing aid parameters belonging to the same channel among the multiple hearing aid parameters are divided into the same group to obtain parameter groups corresponding to the left channel and the right channel respectively.
[0263] The hearing aid recipient's left and right ears have different hearing conditions. Therefore, the multiple hearing aid parameters include hearing aid parameters corresponding to the left and right channels. The hearing aid parameters corresponding to the left channel are used to provide assistance to the left ear, and the hearing aid parameters corresponding to the right channel are used to provide assistance to the right ear. The hearing aid parameters corresponding to each channel include hearing aid parameters for that channel at multiple sound frequencies.
[0264] When grouping hearing aid parameters, hearing aid parameters belonging to the same channel can be divided into the same group, thereby obtaining parameter groups corresponding to the left channel and the right channel respectively. That is, hearing aid parameters are sent to the hearing aid device in units of channels.
[0265] In step S2030 , according to the target parameter configuration mode, the hearing aid parameters belonging to the same channel and the same sound frequency among the plurality of hearing aid parameters are divided into the same group to obtain a plurality of parameter groups.
[0266] When grouping hearing aid parameters, the hearing aid parameters belonging to the same channel and the same sound frequency among multiple hearing aid parameters can also be divided into the same group to obtain multiple parameter groups. That is to say, the hearing aid parameters are sent to the hearing aid device in units of a single channel and a single sound frequency.
[0267] It should be noted that the specific implementation details of steps S1610 to S1630 shown in Figure 20 can be referred to steps S1610 to S1630 shown in Figure 16, and the specific implementation details of steps S1910 and S1930 to S1940 shown in Figure 20 can be referred to steps S1910 and S1930 to S1940 shown in Figure 19, which will not be repeated here.
[0268] In the embodiment shown in FIG20 , hearing aid parameters belonging to the same channel can be divided into the same group, or hearing aid parameters belonging to the same channel and the same sound frequency can be divided into the same group, thereby improving the flexibility of parameter grouping and thus improving the flexibility of parameter configuration.
[0269] In order to better understand the present invention, the case where the hearing aid provider is a hearing aid fitter and the hearing aid recipient is a user with hearing impairment is used as an example for explanation. Referring to Figure 21, Figure 21 is a schematic diagram of an implementation environment involved in the present application, which includes a first terminal device and a second terminal device, the first terminal device is a terminal device used by the user, the second terminal device is a terminal device used by the hearing aid fitter, the first terminal device and the second terminal device are both installed with an online conference application, the hearing aid application in user mode runs in the online conference application of the first terminal device, and the hearing aid application in fitter mode runs in the online conference application of the second terminal device, a point-to-point data transmission channel is established between the first terminal device and the second terminal device, the first terminal device is connected to the hearing aid worn by the user based on the Bluetooth Low Energy (BLE) protocol, the second terminal device is connected to the cloud server, and the cloud server contains a cloud database and a fitting algorithm.
[0270] As shown in Figure 22, the process of providing hearing assistance services includes the following processes 1.1-1.7:
[0271] Process 1.1, invite users.
[0272] The hearing aid fitter and the user can agree on a fitting time and schedule an online meeting in the online meeting app. The fitter can then log in to the online meeting app on a second device and join the scheduled online meeting. The user can then log in to the online meeting app on a first device and join the scheduled online meeting, thus establishing an audio or video call between the fitter and the user.
[0273] The hearing aid fitter searches for the hearing aid application in the online conference application, opens the hearing aid application, selects the fitter mode, and then initiates an invitation request to the user. For example, referring to Figure 23, Figure 23 is an exemplary user invitation interface. The hearing aid fitter can trigger the invitation request through the "Invite User" control and send the invitation request to the first terminal device. The first terminal device presents the invitation. If the user triggers and agrees to the invitation, a point-to-point data transmission channel is created between the hearing aid application in the first terminal device and the hearing aid application in the second terminal device based on the point-to-point communication protocol, thereby realizing the remote transmission of the application data of the hearing aid application through the channel. Among them, referring to Figure 24, the process of creating a point-to-point data transmission channel includes steps S2401-step S2406, which are described in detail as follows:
[0274] Step S2401: The second terminal device sends a channel creation request to the channel service network element.
[0275] The channel service network element is used to provide channel management functions. After the hearing aid fitter triggers the "Invite User" control, the second terminal device can generate a channel creation request. The channel creation request contains the hearing aid fitter's identification information in the hearing aid application, such as the hearing aid fitter's account.
[0276] Step S2402: The channel service network element sends channel identification information to the second terminal device.
[0277] The channel service network element generates channel identification information according to the channel creation request, records the relationship between the channel identification information and the identification information of the hearing aid fitter, and sends the channel identification information to the second terminal device.
[0278] Step S2403: The second terminal device sends an invitation request to the first terminal device.
[0279] The invitation request contains channel identification information.
[0280] Step S2404: The first terminal device sends a joining request to the channel service network element.
[0281] The join request contains channel identification information.
[0282] Step S2405: The channel service network element sends a joining success notification to the first terminal device.
[0283] After receiving the joining request, the channel service network element associates and stores the user's identification information (for example, the user's account in the hearing assistance application, etc.), the hearing aid fitter's identification information, and the channel identification information, thereby creating a point-to-point data transmission channel between the first terminal device and the second terminal device, and sends a successful joining notification to the first terminal device.
[0284] Step S2406: The channel service network element sends a joining success notification to the second terminal device.
[0285] The channel service network element sends a joining success notification to the second terminal device so that the second terminal device can determine that the point-to-point data transmission channel has been successfully created. In the subsequent process, the first terminal device and the second terminal device can forward data through the channel service network element. The channel service network element can find the corresponding point-to-point data transmission channel and forward the data based on the identification information of the fitter and the user.
[0286] Step 1.2: Search for hearing aids.
[0287] After establishing a point-to-point data transmission channel between the first terminal device and the second terminal device, the second terminal device can notify the first terminal device to search for the hearing aid device and establish a connection between the auxiliary receiving end and the hearing aid device through BLE.
[0288] Optionally, the hearing aid fitter can guide the user to turn on the hearing aid through an audio or video call, and search for the hearing aid through the first terminal device.
[0289] Process 1.3, automatic audiometry.
[0290] After connecting the hearing aid device, the second terminal device may display a service selection interface, where, as shown in FIG25 , the service selection interface includes automatic audiometry, manual audiometry, parameter configuration, and viewing of user information, and the fitter may choose which service to perform.
[0291] If the hearing aid fitter chooses the automatic audiometry service, the user's hearing test can be performed automatically.
[0292] Procedure 1.4, manual audiometry.
[0293] If the hearing aid fitter chooses manual audiometry, he or she can manually perform a hearing test on the user.
[0294] Optionally, whether manual or automatic audiometry is performed, before the hearing test, the fitter will use an audio or video call to confirm whether the user's hearing aid is worn in accordance with the requirements and whether the ambient noise is appropriate. If so, the hearing test will be conducted.
[0295] In the process of performing the hearing test, as shown in FIG26 , the hearing test process includes steps S2601 to S2609, which are described in detail as follows:
[0296] Step S2601: The second terminal device sends a notification of entering an audiometry mode to the first terminal device.
[0297] The second terminal device sends a listening mode notification to the first terminal device, so that the first terminal device enters the test mode.
[0298] Step S2602: The first terminal device sends an audiometry mode notification to the hearing aid.
[0299] The first terminal device sends an audiometry mode notification to the hearing aid, so that the hearing aid enters the audiometry mode.
[0300] Step S2603: The first terminal device sends a listening mode entry response to the second terminal device.
[0301] Step S2604: The second terminal device sends a test sound frequency and a test sound intensity to the first terminal device.
[0302] In an optional example, the test sound frequency may range from (500Hz, 1kHz, 1500Hz, 2kHz, 3kHz, 4kHz, 6kHz, 8kHz), and the test sound intensity may range from (0, 5, 10, 15, 20, ..., 115, 120), i.e., discrete values from 0dB to 120dB with intervals of 5dB. The second terminal device sends a test sound frequency and test sound intensity to the first terminal device each time, and after receiving the corresponding feedback information, sends the next test sound frequency and test sound intensity.
[0303] Among them, if it is manual audiometry, the test sound frequency and test sound intensity can be set by the hearing care professional.
[0304] If it is an automatic audiometry, as shown in FIG27 , the hearing threshold of the user at the current test sound frequency can be determined by the method shown in FIG27 : wherein, the initial A, min and max are obtained, wherein A is the test sound intensity, min is the minimum sound intensity, and max is the maximum sound intensity. In FIG27 , the initial A=50db, the initial min=0db, and the initial max=120db are used as an example for explanation; then, A and the current test sound frequency are sent to the first terminal device to control the hearing aid to play the test audio with a sound intensity of A; then, the user's feedback information is determined. Whether the user can hear the test audio; if so, set max = A, then update A based on the average of max and min. To ensure that A is an integer of 5, first set X = (max + min) ÷ 2. Then, if X is an integer, then A = X; if X is not an integer, then A = X-2.5. If not, set min = A, then update A based on the average of max and min. To ensure that A is an integer of 5, first set X = (max + min) ÷ 2. Then, if X is an integer, then A = X; if X is not an integer, then A = X-2.5. After updating A, max, and min, determine whether (max - min) is less than or equal to the set intensity threshold. Here, an intensity threshold of 5 is used as an example. If so, A is used as the hearing threshold. If not, return to the step of playing the test audio with a sound intensity of A and loop.
[0305] Step S2605: The first terminal device sends a play request to the hearing aid.
[0306] The play request includes the test sound frequency and the test sound intensity.
[0307] Step S2606: The hearing aid plays the test audio.
[0308] The test audio matches the test sound frequency and the test sound intensity.
[0309] Step S2607: The first terminal device sends first feedback information indicating that the test audio is heard to the second terminal device.
[0310] The user can input feedback information indicating that the test audio is heard through the first terminal device, and the first terminal device sends the feedback information to the second terminal device.
[0311] Step S2608: The first terminal device sends second feedback information to the second terminal device, indicating that the test audio was not heard.
[0312] After the first terminal device sends a play request to the second terminal device, a timer is set to count down based on the set duration. If the user does not provide feedback before the timer expires, feedback information indicating that the test audio was not heard is sent to the second terminal device.
[0313] Steps S2604 to S2608 are performed multiple times until the hearing test results are obtained.
[0314] Step S2609: The second terminal device sends the hearing test result to the cloud server.
[0315] The cloud server stores the hearing test results.
[0316] After obtaining the hearing test results through manual audiometry, you can save the hearing test results, or return to the received audiometry to modify them, or, as shown in Figure 28, Figure 28 is the selection interface after obtaining the hearing test results. You can choose to save the hearing test results, or confirm to enter the parameter fitting.
[0317] Process 1.5, listening test results.
[0318] Hearing test results can be obtained through manual audiometry and automatic audiometry.
[0319] Process 1.6, parameter matching.
[0320] Parameter fitting includes parameter configuration and parameter modification.
[0321] As shown in FIG29 , the parameter configuration includes steps S2901 to S2913, which are described in detail as follows:
[0322] Step S2901: The second terminal device sends a request to obtain hearing test results to the cloud server.
[0323] Step S2902: The cloud server sends the hearing test result to the second terminal device.
[0324] Step S2903: The second terminal device sends a hearing aid parameter calculation request to the cloud server.
[0325] The hearing aid parameter calculation request includes the hearing test results.
[0326] Step S2904: The cloud server calculates hearing aid parameters.
[0327] Among them, the hearing aid parameters include the [3*F]wdrc matrix and the [1*F]MPO matrix, where F represents the sound frequency, the [3*F]wdrc matrix contains the hearing aid gains corresponding to the high, medium and low sound intensity levels at different sound frequencies F, and the [1*F]MPO matrix contains the MPO at different sound frequencies.
[0328] Step S2905: The cloud server sends the hearing aid parameters to the second terminal device.
[0329] Step S2906: The second terminal device sends the hearing aid parameters to the first terminal device.
[0330] Step S2907: The first terminal device sends a protocol version acquisition request to the hearing aid.
[0331] Step S2908: The hearing aid sends the Bluetooth protocol version to the first terminal device.
[0332] The hearing aid sends its own Bluetooth protocol version to the first terminal device according to the protocol version acquisition request.
[0333] In step S2909, the first terminal device sends the hearing aid parameters of one channel each time to the hearing aid.
[0334] The first terminal device can determine the hearing aid parameter sending mode based on the Bluetooth protocol version. If the MTU supported by the Bluetooth protocol version is larger, the first terminal device can send the hearing aid parameters of one channel at a time until all hearing aid parameters are sent to the hearing aid.
[0335] In step S2910, the first terminal device sends hearing aid parameters of one sound frequency each time to the hearing aid.
[0336] If the MTU supported by the Bluetooth protocol version is smaller, the first terminal device can send the hearing aid parameters corresponding to one sound frequency at a time until all the hearing aid parameters are sent to the hearing aid. Each sent hearing aid parameter can be encapsulated into a data packet and sent.
[0337] Step S2911: The hearing aid sends the hearing aid parameter configuration status to the first terminal device.
[0338] Step S2912: The second terminal device sends a configuration success notification to the first terminal device.
[0339] The configuration success notification is generated after the hearing aid parameter configuration status indicates that the configuration is successful.
[0340] Step S2913: The second terminal device saves the hearing aid parameters to the cloud server.
[0341] In the cloud server, the hearing aid parameters can be classified and stored based on the manufacturers to which the hearing aid parameters belong, so that it is convenient for manufacturers to obtain the hearing aid parameters from the cloud server.
[0342] As shown in FIG30 , parameter modification includes steps S3001 to S3014, which are described in detail as follows:
[0343] Step S3001: The first terminal device sends a protocol version acquisition request to the hearing aid.
[0344] Step S3002: The hearing aid sends the Bluetooth protocol version to the first terminal device.
[0345] The hearing aid sends its own Bluetooth protocol version to the first terminal device according to the protocol version acquisition request.
[0346] Step S3003: The second terminal device sends a parameter acquisition request to the first terminal device.
[0347] The parameter acquisition request is used to obtain the hearing aid parameters of the hearing aid.
[0348] Step S3004: The first terminal device sends a mono parameter reading request to the hearing aid.
[0349] If the MTU supported by the Bluetooth protocol version is larger, the first terminal device can read the hearing aid parameters of one channel from the hearing aid at a time until all the hearing aid parameters of the hearing aid are obtained. Therefore, the first terminal device can send a mono parameter read request to the hearing aid to obtain the hearing aid parameters of one channel.
[0350] Step S3005: The hearing aid sends the mono hearing aid parameters to the first terminal device.
[0351] The hearing aid sends the hearing aid parameters of one channel to the first terminal device according to the mono-channel parameter reading request.
[0352] Step S3006: The first terminal device sends a single frequency parameter reading request to the hearing aid.
[0353] If the MTU supported by the Bluetooth protocol version is smaller, the first terminal device can read the hearing aid parameters of one sound frequency from the hearing aid at a time until all the hearing aid parameters of the hearing aid are obtained. Therefore, the first terminal device can send a single frequency parameter read request to the hearing aid to obtain the hearing aid parameters of one sound frequency.
[0354] Step S3007: The hearing aid sends the hearing aid parameters of the single frequency to the first terminal device.
[0355] The hearing aid sends the hearing aid parameter of one sound frequency to the first terminal device according to the single frequency parameter reading request.
[0356] Step S3008: The first terminal device sends the hearing aid parameters to the second terminal device.
[0357] Step S3009: The second terminal device sends the adjusted hearing aid parameters to the first terminal device.
[0358] The hearing aid fitter can adjust the hearing aid parameters in the hearing aid application of the second terminal device, obtain the adjusted hearing aid parameters, and send the adjusted hearing aid parameters to the first terminal device.
[0359] In step S3010, the first terminal device sends hearing aid parameters of one channel each time to the hearing aid.
[0360] If the MTU supported by the Bluetooth protocol version is larger, the first terminal device may send the modified hearing aid parameters of one channel to the hearing aid each time until all the modified hearing aid parameters are sent to the hearing aid.
[0361] In step S3011, the first terminal device sends hearing aid parameters of one sound frequency each time to the hearing aid.
[0362] If the MTU supported by the Bluetooth protocol version is smaller, the first terminal device may send the modified hearing aid parameters for one sound frequency to the hearing aid each time until all the modified hearing aid parameters are sent to the hearing aid.
[0363] Step S3012: The hearing aid sends the hearing aid parameter configuration status to the first terminal device.
[0364] Step S3013: The second terminal device sends a configuration success notification to the first terminal device.
[0365] The configuration success notification is generated after the hearing aid parameter configuration status indicates that the configuration is successful.
[0366] Step S3014: The second terminal device saves the modified hearing aid parameters to the cloud server.
[0367] In the cloud server, the hearing aid parameters can be classified and stored based on the manufacturers to which the hearing aid parameters belong, so that it is convenient for manufacturers to obtain the hearing aid parameters from the cloud server.
[0368] Among them, the packet header of the data packet transmitted between the hearing aid and the first terminal device contains commands and instructions, among which the commands include read commands, notification commands, and write commands. Among them, entering / exiting audiometry mode, playing pure tone, obtaining protocol version, reading mono hearing aid parameters, reading single-frequency hearing aid parameters, etc. correspond to read commands, sending mono hearing aid parameters, sending single-frequency hearing aid parameters, etc. correspond to write commands, and timed broadcast of power information, volume information, hearing aid mode, etc. correspond to notification commands.
[0369] Procedure 1.7: View user information.
[0370] The hearing aid fitter can view the user's information, such as the user's age, by viewing the user information service.
[0371] It should be noted that the specific implementation details of each step in this embodiment have been described in detail in the above embodiments and will not be repeated here.
[0372] In this embodiment, there is no need to invest high costs in developing and maintaining audio and video communication capabilities in hearing assistance applications, and online conference applications have a stable communication foundation, which can improve the communication quality during hearing assistance services, realize web-based deployment of hearing assistance applications, and do not need to update native applications during function upgrades, thereby improving usability; data storage and fitting formulas are performed on the cloud, which can reduce dependence on terminal device performance, and fitters and users do not need high-performance equipment to use hearing assistance services, and the audience group is wider; point-to-point communication between users and fitters can reduce data transfer, improve real-time performance and data security; establishing a connection between the hearing aid and the second terminal device through the set Bluetooth protocol can facilitate third-party access. As long as the manufacturer implements the protocol-related functions, it can have powerful remote audiometry and fitting capabilities. For fitters, one application can achieve the operation capabilities of multiple brands of hearing aids.
[0373] In the above solution, the hearing-assistance terminal establishes an audio and video call with the assistive receiving terminal through a call software. The call software here can include audio and video call capabilities, such as online conferencing applications or social chat applications. The call can be established by either the hearing-assistance terminal initiating a request and the assistive receiving terminal answering, or by the assistive receiving terminal initiating a request and the hearing-assistance terminal answering. The hearing-assistance terminal then receives a run instruction for the hearing-assistance application hosted within the call software. This instruction can be triggered by the hearing-assistance provider, and then the hearing-assistance application runs within the call software. Next, a data transmission channel is established between the hearing-assistance application and the assistive receiving terminal. This is a duplex communication channel for transmitting application data. The hearing-assistance provider can initiate an invitation request on the hearing-assistance terminal, and the assistive receiving terminal responds to establish the channel. Through this data transmission channel and the audio and video call, the hearing-assistance terminal begins providing hearing-assistance services to the assistive receiving terminal. This solution utilizes audio and video calls to facilitate communication between the two parties, improving convenience and service accuracy. Establishing a connection through the call software improves stability, while also reducing the development difficulty of hearing-assistance applications and enhancing application stability and service quality.
[0374] The hearing-assistive terminal sends the test request to the auxiliary receiving terminal through the data transmission channel. The test request is used to instruct the auxiliary receiving terminal to control the hearing-assistive device to play the corresponding test audio. The test request may include relevant data of the test audio, such as directly including the test audio, or including the test sound frequency and test sound intensity. After receiving the request, the auxiliary receiving terminal controls the hearing-assistive device to play the test audio, obtains feedback information indicating whether the hearing-assistive recipient hears the test audio, and sends it to the hearing-assistive terminal. The hearing-assistive terminal determines the hearing test result of the hearing-assistive recipient based on the feedback information, displays the result, and sends it to the auxiliary receiving terminal for display. This solution performs hearing tests on hearing-assistive recipients through data transmission channels and audio and video calls, which improves the accuracy and convenience of the test.
[0375] When the hearing test results include the hearing threshold of the hearing aid recipient at the set test sound frequency, the hearing aid terminal generates multiple test requests corresponding to the test sound frequency. Each request contains a different test sound intensity and the same test sound frequency, and is sent to the aided receiving terminal in sequence. In the process of generating requests, feedback information of the current test request is obtained. If the conditions for determining the hearing threshold are not met, such as insufficient feedback information, the test range is not covered, the sound intensity difference does not reach the threshold, there is a problem with the test audio playback, or the hearing aid recipient is unstable, the test sound intensity of the next request is calculated based on the current feedback information and the test sound intensity, and then the next request is generated until the hearing threshold is determined. This solution can automatically test hearing and adjust the test sound intensity based on feedback, thereby improving the efficiency of hearing tests.
[0376] In the process of generating multiple test requests, the hearing aid terminal obtains the feedback information of the current test request, and at the same time obtains the maximum sound intensity and minimum sound intensity used to calculate the test sound intensity of the current test request. The maximum and minimum sound intensities are updated according to the feedback information. If the feedback shows that the hearing aid recipient hears the test audio, the maximum sound intensity is updated to the current test sound intensity; if not, the minimum sound intensity is updated. If the difference between the updated maximum and minimum sound intensities is greater than or equal to the set intensity threshold, the test sound intensity of the next test request is calculated based on the average value; if the difference is less than the set intensity threshold, the hearing threshold at the test sound frequency is determined based on the average value. This scheme uses a dichotomy method to gradually determine the hearing threshold, which further improves the efficiency of hearing tests.
[0377] When sending multiple test requests, the hearing aid calculates the interval between the current test requests. The interval between requests can vary, and this interval can be determined by generating a random number or extracting it sequentially according to a preset duration. The next request is calculated based on the send time and the interval between the current request and sent accordingly. This prevents users from finding patterns due to periodic test requests, thereby improving the accuracy of hearing test results.
[0378] After receiving the hearing test results, the hearing aid terminal stores them on a server, which can be a cloud server or a physical server. This operation reduces the storage pressure on the hearing aid terminal and makes it easier for the hearing aid provider to obtain the results after logging in from other terminals, thus improving convenience.
[0379] The hearing-assist terminal obtains the hearing test results of the hearing-assist receiver corresponding to the hearing-assist device connected to the assistive receiver. The results can be obtained through testing or historical results can be obtained from the server. The test results are sent to the server, and the server generates a parameter configuration strategy for the hearing-assist device based on the results. The strategy includes hearing-assist parameters under different sound frequencies. The hearing-assist terminal receives the strategy and generates a parameter configuration request, which is sent to the assistive receiver through the data transmission channel. The assistive receiver configures the hearing-assist parameters of the hearing-assist device according to the strategy. This solution generates the strategy by the server, which improves the parameter configuration speed and reduces the computing pressure of the hearing-assist terminal.
[0380] The hearing aid provider triggers the adjustment operation on the interface. The hearing aid provider determines the target hearing aid parameters after adjustment and generates a parameter adjustment request, which is sent to the auxiliary receiver. The auxiliary receiver adjusts the hearing aid parameters of the hearing aid device according to the target parameters. This solution adjusts parameters through data transmission channels and audio and video calls, improving the convenience and accuracy of parameter adjustment.
[0381] The assistive receiving end establishes an audio or video call with the hearing assistance end through the call software. It then receives instructions for the hearing assistance application hosted in the call software and runs the application. Based on this, a data transmission channel is established between the application and the hearing assistance end. Through this channel and the audio or video call, the assistive receiving end receives the hearing assistance service provided by the hearing assistance end. This solution also improves communication convenience, service accuracy, and stability, while reducing the difficulty of application development.
[0382] The auxiliary receiving end establishes a connection with the hearing aid device by setting a near-field communication protocol, such as the Bluetooth protocol. It receives the control request sent by the hearing aid end, searches for the corresponding target command from the multiple commands contained in the set protocol, searches for the target instruction group and target instruction from the instruction groups corresponding to the various hearing aid services, generates a data packet based on the control request, target command, target instruction group and target instruction, and sends it to the hearing aid device. The hearing aid device executes the instruction according to the data packet and protocol. As long as the hearing aid device supports the set protocol, it can obtain hearing aid services.
[0383] The assistive receiver receives the protocol detection request from the hearing aid, obtains the near-field communication protocol supported by the hearing aid, and sends it to the hearing aid. The hearing aid compares the protocols. If there is a mismatch, it sends an installation package with the protocol settings. The assistive receiver then sends the installation package to the hearing aid for installation. After installation, it establishes a connection with the hearing aid using the protocol settings. This solution improves the success rate of hearing assistance services and ensures that the hearing aid supports the required protocols.
[0384] The assistive receiver receives a parameter configuration request from the hearing aid device, which contains multiple hearing aid parameters. It selects a target configuration method from among multiple parameter configuration methods and groups the hearing aid parameters accordingly, generating multiple parameter groups. Different configuration methods group the parameters differently, and the selection can be based on the near-field communication protocol version. A data packet corresponding to the parameter group is generated and sent to the hearing aid device. The hearing aid device then configures its own parameters based on the parameters in the data packet. This solution improves the flexibility of parameter configuration.
[0385] When multiple hearing aid parameters include parameters for both the left and right channels, and each channel includes parameters for multiple sound frequencies, the auxiliary receiving end can group the hearing aid parameters for the same channel into a single group, resulting in a parameter group for the left and right channels; or group the hearing aid parameters for the same channel and the same sound frequency into a single group, resulting in multiple parameter groups, based on the target parameter configuration method. This further enhances the flexibility of parameter grouping and configuration.
[0386] Referring to Figure 31, Figure 31 is a block diagram of a hearing aid device according to an exemplary embodiment of the present application. As shown in Figure 31, the device includes:
[0387] Establishing module 3101, configured to establish an audio and video call between the hearing aid terminal and the auxiliary receiving terminal through the call software;
[0388] The running module 3102 is configured to obtain a running instruction for the hearing assistance application hosted in the call software, and run the hearing assistance application in the call software according to the running instruction;
[0389] The communication module 3103 is configured to establish a data transmission channel between the hearing assistance terminal and the assistance receiving terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application;
[0390] The service module 3104 is configured to provide hearing assistance services to the auxiliary receiving terminal through data transmission channels and audio and video calls.
[0391] In an exemplary embodiment, based on the above solution, the service module 3104 is specifically configured as follows:
[0392] The test request is sent to the auxiliary receiving end through the data transmission channel, and the hearing test result of the hearing aid recipient corresponding to the hearing aid device is determined based on the feedback information corresponding to the test request; wherein the test request is used to instruct the auxiliary receiving end to control the hearing aid device to play the test audio corresponding to the test request, and the feedback information is used to indicate whether the hearing aid recipient can hear the test audio;
[0393] Display the hearing test result and send the hearing test result to the auxiliary receiving terminal so that the auxiliary receiving terminal displays the hearing test result.
[0394] In an exemplary embodiment, based on the above solution, if the hearing test result includes the hearing threshold of the hearing aid recipient at the set test sound frequency, the service module 3104 is specifically configured to:
[0395] Generate multiple test requests corresponding to the test sound frequency, and send the multiple test requests to the auxiliary receiving end through the data transmission channel; wherein each test request includes a test sound intensity and a test sound frequency, and the test sound intensity included in different test requests is different;
[0396] In the process of generating multiple test requests, feedback information corresponding to the current test request is obtained. If it is determined according to the feedback information corresponding to the current test request that the conditions for determining the hearing threshold of the hearing aid recipient at the test sound frequency are not met, the test sound intensity corresponding to the next test request is calculated according to the feedback information corresponding to the current test request and the test sound intensity corresponding to the current test request. The next test request is generated according to the test sound intensity and test sound frequency corresponding to the next test request until the hearing threshold of the hearing aid recipient at the test sound frequency is determined.
[0397] In an exemplary embodiment, based on the above solution, the service module 3104 is specifically configured as follows:
[0398] Obtaining a maximum sound intensity and a minimum sound intensity for calculating a test sound intensity corresponding to a current test request; wherein the test sound intensity corresponding to the current test request is less than or equal to the maximum sound intensity and greater than or equal to the minimum sound intensity;
[0399] Update the maximum sound intensity and the minimum sound intensity according to the feedback information corresponding to the current test request; wherein, if the feedback information corresponding to the current test request indicates that the hearing aid recipient hears the test audio corresponding to the current test request, then update the maximum sound intensity to the test sound intensity corresponding to the current test request; if the feedback information corresponding to the current test request indicates that the hearing aid recipient does not hear the test audio corresponding to the current test request, then update the minimum sound intensity to the test sound intensity corresponding to the current test request;
[0400] If the difference between the updated maximum sound intensity and the minimum sound intensity is greater than or equal to the set intensity threshold, the test sound intensity corresponding to the next test request is calculated based on the average value between the updated maximum sound intensity and the minimum sound intensity;
[0401] If the difference between the updated maximum sound intensity and the minimum sound intensity is less than the set intensity threshold, the hearing threshold at the test sound frequency is determined according to the average value between the updated maximum sound intensity and the minimum sound intensity.
[0402] In an exemplary embodiment, based on the above solution, the service module 3104 is specifically configured as follows:
[0403] Calculate the interval duration of the current test request; the interval durations corresponding to different test requests may not be exactly the same;
[0404] Calculate the sending time of the next test request based on the sending time and interval length of the current test request;
[0405] According to the sending time of the next test request, the next test request is sent to the auxiliary receiving end through the data transmission channel.
[0406] In an exemplary embodiment, based on the above solution, the device further includes a storage module configured to:
[0407] The hearing test results are stored in a server; wherein the server includes a cloud server.
[0408] In an exemplary embodiment, based on the above solution, the service module 3104 is specifically configured as follows:
[0409] Obtaining hearing test results of the hearing aid recipient corresponding to the hearing aid device connected to the assistive receiving end;
[0410] Sending the hearing test results to the server so that the server generates a parameter configuration strategy for the hearing aid device based on the hearing test results;
[0411] Receive the parameter configuration policy sent by the server and generate a parameter configuration request according to the parameter configuration policy;
[0412] The parameter configuration request is sent to the auxiliary receiving end through the data transmission channel, so that the auxiliary receiving end configures the hearing aid parameters of the hearing aid device according to the parameter configuration strategy.
[0413] In an exemplary embodiment, based on the aforementioned solution, the service module 3104 is specifically configured to: send a parameter acquisition request to the auxiliary receiving terminal through a data transmission channel, so that the auxiliary receiving terminal obtains the current hearing aid parameters of the hearing aid device according to the parameter acquisition request;
[0414] Receive the current hearing aid parameters sent by the auxiliary receiving end through the data transmission channel, and display the current hearing aid parameters on the parameter adjustment interface;
[0415] In response to an adjustment operation triggered through the parameter adjustment interface, determining a target hearing aid parameter after adjusting the current hearing aid parameter, and generating a parameter adjustment request according to the target hearing aid parameter;
[0416] The parameter adjustment request is sent to the auxiliary receiving end through the data transmission channel, so that the auxiliary receiving end adjusts the hearing aid parameters of the hearing aid device according to the target hearing aid parameters.
[0417] It should be noted that the hearing assistance device provided in Figure 31 and the hearing assistance method corresponding to the hearing assistance terminal provided in the above embodiment belong to the same concept, and the specific way in which each module and unit performs operations has been described in detail in the method embodiment and will not be repeated here.
[0418] Referring to Figure 32, Figure 32 is a block diagram of a hearing aid device according to an exemplary embodiment of the present application. As shown in Figure 32, the device includes:
[0419] Establishing module 3201, configured to establish an audio and video call between the auxiliary receiving terminal and the hearing assistive terminal through the call software;
[0420] The running module 3202 is configured to obtain a running instruction for the hearing assistance application hosted in the call software, and run the hearing assistance application in the call software according to the running instruction;
[0421] The communication module 3203 is configured to establish a data transmission channel between the auxiliary receiving terminal and the hearing assistance terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application;
[0422] The acquisition module 3204 is configured to obtain the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and the audio and video call.
[0423] In an exemplary embodiment, based on the above solution, the acquisition module 3204 is specifically configured as follows:
[0424] Establishing a connection between the auxiliary receiving terminal and the hearing aid device by setting the near field communication protocol;
[0425] receiving a control request sent by the hearing aid terminal through a data transmission channel, and searching for a target command corresponding to the control request from a plurality of commands included in a set near-field communication protocol; wherein the plurality of commands include at least one of a read command, a write command, or a notification command;
[0426] Searching, from instruction groups corresponding to a plurality of hearing assistance services included in a set near-field communication protocol, for a target instruction group corresponding to the hearing assistance service to which the control request belongs, and searching, from the target instruction group, for a target instruction corresponding to the control request; wherein the plurality of hearing assistance services include at least one of a hearing test service, a fitting service for updating hearing aid parameters of a hearing aid device, and an information management service for managing attribute information of a hearing aid device;
[0427] Generate a data packet corresponding to the control request according to the control request, the target command, the target instruction group, and the target instruction; wherein the header of the data packet sequentially includes identification information of the target command, identification information of the target instruction group, and identification information of the target instruction;
[0428] The data packet is sent to the hearing aid device through the connection, so that the hearing aid device executes the target instruction according to the data packet and the set near field communication protocol.
[0429] In an exemplary embodiment, based on the above solution, the acquisition module 3204 is specifically configured as follows:
[0430] Receive the protocol detection request sent by the hearing aid terminal through the data transmission channel, and obtain the near-field communication protocol supported by the hearing aid device according to the protocol detection request;
[0431] Sending the near field communication protocol supported by the hearing aid device to the hearing aid terminal through the data transmission channel, so that the hearing aid terminal compares the near field communication protocol supported by the hearing aid device with the set near field communication protocol;
[0432] Receiving, via a data transmission channel, an installation package corresponding to a set near-field communication protocol sent by the hearing-assistive terminal, and sending the installation package to the hearing-assistive device so that the hearing-assistive device installs the installation package; wherein the installation package is sent by the hearing-assistive terminal after detecting that the near-field communication protocol supported by the hearing-assistive device does not match the set near-field communication protocol;
[0433] Establish a connection with the hearing aid device by setting the near field communication protocol.
[0434] In an exemplary embodiment, based on the above solution, the acquisition module 3204 is specifically configured as follows:
[0435] Receiving a parameter configuration request sent by the hearing aid terminal through a data transmission channel; wherein the parameter configuration request includes multiple hearing aid parameters of the hearing aid device;
[0436] Selecting a target parameter configuration method corresponding to the parameter configuration request from a plurality of parameter configuration methods, and grouping a plurality of hearing aid parameters according to the target parameter configuration method to obtain a plurality of parameter groups; wherein different parameter configuration methods correspond to different grouping methods;
[0437] Generate data packets corresponding to multiple parameter groups, thereby obtaining multiple data packets; wherein the data packet corresponding to each parameter group contains the hearing aid parameters in each parameter group;
[0438] The plurality of data packets are sent to the hearing aid device, so that the hearing aid device configures the hearing aid parameters of the hearing aid device according to the hearing aid parameters contained in the received data packets.
[0439] In an exemplary embodiment, under the condition that the multiple hearing aid parameters include hearing aid parameters corresponding to the left channel and the right channel respectively, and the hearing aid parameters corresponding to each channel include hearing aid parameters corresponding to multiple sound frequencies respectively, based on the above solution, the acquisition module 3204 is specifically configured as follows:
[0440] According to the target parameter configuration method, the hearing aid parameters belonging to the same channel among the multiple hearing aid parameters are divided into the same group to obtain parameter groups corresponding to the left channel and the right channel respectively;
[0441] or,
[0442] According to the target parameter configuration method, hearing aid parameters belonging to the same channel and the same sound frequency among the multiple hearing aid parameters are divided into the same group to obtain multiple parameter groups.
[0443] It should be noted that the hearing assistance device provided in Figure 32 and the hearing assistance method corresponding to the auxiliary receiving end provided in the above embodiment belong to the same concept, and the specific way in which each module and unit performs operations has been described in detail in the method embodiment and will not be repeated here.
[0444] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more computer programs, which, when executed by one or more processors, enables the electronic device to implement the hearing assistance method provided in the above-mentioned embodiments.
[0445] FIG33 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application.
[0446] It should be noted that the computer system 3300 of the electronic device shown in FIG33 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present application.
[0447] As shown in Figure 33, the computer system 3300 includes a central processing unit (CPU) 3301, which can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 3302 or the computer program loaded from the storage part 3308 to the random access memory (RAM) 3303, such as executing the hearing assistance method in the above embodiment. Various computer programs and data required for system operation are also stored in the RAM 3303. The CPU 3301, ROM 3302 and RAM 3303 are connected to each other via a bus 3304. An input / output (I / O) interface 3305 is also connected to the bus 3304.
[0448] In some embodiments, the following components are connected to the I / O interface 3305: an input section 3306 including a keyboard, a mouse, and the like; an output section 3307 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; a storage section 3308 including a hard disk; and a communication section 3309 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 3309 performs communication processing via a network such as the Internet. A drive 3310 is also connected to the I / O interface 3305 as needed. Removable media 3311, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 3310 as needed, so that computer programs read therefrom can be installed into the storage section 3308 as needed.
[0449] In particular, according to an embodiment of the present application, a computer program for implementing a hearing assistance method may be carried on a computer-readable medium, which may be downloaded and installed from a network via the communication part 3309 and / or installed from a removable medium 3311 .
[0450] It should be noted that the computer-readable medium shown in the embodiments of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a computer program that can be used by or in combination with an instruction execution system, device or device. A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable computer program, and such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer program embodied in the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.
[0451] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. Among them, each box in the flowchart or block diagram can represent a module, program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and a computer program.
[0452] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. In some cases, the names of these units do not constitute limitations on the units themselves.
[0453] Another aspect of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of an electronic device, the electronic device implements the aforementioned hearing assistance method. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently and not be incorporated into the electronic device.
[0454] Another aspect of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the hearing assistance method provided in each of the above embodiments. The computer program can be stored in a computer-readable storage medium. The computer program product can be a computer program as a product, such as an APP (Application, mobile application software), a web page, a mini-program, etc.; or the computer program product can also be a storage medium, device, terminal, virtual machine, etc. containing the computer program.
[0455] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0456] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.
Claims
1. A hearing assistance method, performed by a hearing assistance terminal, comprising: Establish an audio and video call between the hearing aid terminal and the assistive receiving terminal through the call software; Obtaining an operating instruction for a hearing assistance application hosted in the call software, and operating the hearing assistance application in the call software according to the operating instruction; Based on the hearing assistance application, establishing a data transmission channel between the hearing assistance terminal and the assistance receiving terminal, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and A hearing assistance service is provided to the auxiliary receiving terminal through the data transmission channel and the audio and video call.
2. The method according to claim 1, wherein providing hearing assistance services to the auxiliary receiving terminal through the data transmission channel and the audio and video call comprises: The test request is sent to the auxiliary receiving terminal through the data transmission channel, and the hearing test result of the hearing aid recipient corresponding to the hearing aid device is determined based on the feedback information corresponding to the test request; wherein the test request is used to instruct the auxiliary receiving terminal to control the hearing aid device to play the test audio corresponding to the test request, and the feedback information is used to indicate whether the hearing aid recipient hears the test audio; The hearing test result is displayed, and the hearing test result is sent to the auxiliary receiving terminal so that the auxiliary receiving terminal displays the hearing test result.
3. The method of claim 2, wherein the hearing test result comprises the hearing threshold of the hearing aid recipient at a set test sound frequency; The step of sending the test request to the auxiliary receiving terminal through the data transmission channel and determining the hearing test result of the hearing aid receiving terminal corresponding to the hearing aid device according to feedback information corresponding to the test request includes: generating a plurality of test requests corresponding to the test sound frequency, and transmitting the plurality of test requests to the auxiliary receiving end via the data transmission channel; wherein each test request includes a test sound intensity and the test sound frequency, and different test requests include different test sound intensities; In the process of generating the multiple test requests, feedback information corresponding to the current test request is obtained. If it is determined that the conditions for determining the hearing threshold of the hearing aid recipient at the test sound frequency are not met based on the feedback information corresponding to the current test request and the test sound intensity, the test sound intensity corresponding to the next test request is calculated, and the next test request is generated based on the test sound intensity and the test sound frequency corresponding to the next test request until the hearing threshold of the hearing aid recipient at the test sound frequency is determined.
4. The method of claim 3, wherein if it is determined, based on the feedback information corresponding to the current test request, that the condition for determining the hearing threshold of the hearing aid recipient at the test sound frequency is not met, calculating the test sound intensity corresponding to the next test request based on the feedback information corresponding to the current test request and the test sound intensity, comprising: Obtaining a maximum sound intensity and a minimum sound intensity for calculating a test sound intensity corresponding to the current test request; wherein the test sound intensity corresponding to the current test request is less than or equal to the maximum sound intensity and greater than or equal to the minimum sound intensity; The maximum sound intensity and the minimum sound intensity are updated according to the feedback information corresponding to the current test request; wherein, if the feedback information corresponding to the current test request indicates that the hearing aid recipient hears the test audio corresponding to the current test request, the maximum sound intensity is updated to the test sound intensity corresponding to the current test request; if the feedback information corresponding to the current test request indicates that the hearing aid recipient does not hear the test audio corresponding to the current test request, the minimum sound intensity is updated to the test sound intensity corresponding to the current test request; If the difference between the updated maximum sound intensity and the minimum sound intensity is greater than or equal to the set intensity threshold, the test sound intensity corresponding to the next test request is calculated according to the average value between the updated maximum sound intensity and the minimum sound intensity; If the difference between the updated maximum sound intensity and the minimum sound intensity is less than the set intensity threshold, the hearing threshold at the test sound frequency is determined according to the average value between the updated maximum sound intensity and the minimum sound intensity.
5. The method according to claim 3 or 4, wherein the sending of the plurality of test requests to the auxiliary receiving end in sequence through the data transmission channel comprises: Calculating the interval duration of the current test request; wherein the interval durations corresponding to different test requests are not exactly the same; Calculate the sending time of the next test request according to the sending time and interval length of the current test request; According to the sending time of the next test request, the next test request is sent to the auxiliary receiving end through the data transmission channel.
6. The method according to any one of claims 2 to 4, further comprising: The hearing test results are stored in a server; wherein the server includes a cloud server.
7. The method according to claim 1, wherein providing hearing assistance services to the auxiliary receiving terminal through the data transmission channel and the audio and video call further comprises: Obtaining a hearing test result of a hearing aid recipient corresponding to a hearing aid device connected to the auxiliary receiving end; Sending the hearing test result to a server, so that the server generates a parameter configuration strategy for the hearing aid device according to the hearing test result; receiving the parameter configuration policy sent by the server, and generating a parameter configuration request according to the parameter configuration policy; The parameter configuration request is sent to the auxiliary receiving end through the data transmission channel, so that the auxiliary receiving end configures the hearing aid parameters of the hearing aid device according to the parameter configuration policy.
8. The method according to any one of claims 1 to 6, wherein providing hearing assistance services to the auxiliary receiving terminal through the data transmission channel and the audio and video call comprises: sending a parameter acquisition request to the auxiliary receiving terminal through the data transmission channel, so that the auxiliary receiving terminal acquires the current hearing aid parameters of the hearing aid device according to the parameter acquisition request; receiving the current hearing aid parameters sent by the auxiliary receiving terminal through the data transmission channel, and displaying the current hearing aid parameters on a parameter adjustment interface; In response to an adjustment operation triggered through the parameter adjustment interface, determining a target hearing aid parameter after adjusting the current hearing aid parameter, and generating a parameter adjustment request according to the target hearing aid parameter; The parameter adjustment request is sent to the auxiliary receiving terminal through the data transmission channel, so that the auxiliary receiving terminal adjusts the hearing aid parameters of the hearing aid device according to the target hearing aid parameters.
9. A hearing assistance method, performed by an assistance receiving terminal, the method comprising: Establish an audio and video call between the auxiliary receiving end and the hearing assistive end through the call software; Obtaining an operating instruction for a hearing assistance application hosted in the call software, and operating the hearing assistance application in the call software according to the operating instruction; Based on the hearing assistance application, establishing a data transmission channel between the auxiliary receiving terminal and the hearing assistance terminal, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and The hearing assistance service provided by the hearing assistance terminal is obtained through the data transmission channel and the audio and video call.
10. The method according to claim 9, wherein obtaining the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and the audio and video call comprises: Establishing a connection between the auxiliary receiving terminal and the hearing aid device by setting the near field communication protocol; receiving a control request sent by the hearing aid terminal through the data transmission channel, and searching for a target command corresponding to the control request from a plurality of commands included in the set near field communication protocol; wherein the plurality of commands include at least one of a read command, a write command, or a notification command; Searching, from the instruction groups corresponding to the plurality of hearing assistance services included in the set near-field communication protocol, for a target instruction group corresponding to the hearing assistance service to which the control request belongs, and searching, from the target instruction group, for a target instruction corresponding to the control request; wherein the plurality of hearing assistance services include at least one of a hearing test service, a fitting service for updating hearing aid parameters of the hearing aid device, and an information management service for managing attribute information of the hearing aid device; generating a data packet corresponding to the control request according to the control request, the target command, the target instruction group, and the target instruction; wherein a header of the data packet sequentially includes identification information of the target command, identification information of the target instruction group, and identification information of the target instruction; The data packet is sent to the hearing aid device through the connection, so that the hearing aid device executes the target instruction according to the data packet and the set near field communication protocol.
11. The method of claim 10, wherein establishing a connection between the auxiliary receiving terminal and the hearing aid device by setting a near field communication protocol comprises: Receiving a protocol detection request sent by the hearing aid terminal through the data transmission channel, and obtaining a near field communication protocol supported by the hearing aid device according to the protocol detection request; Sending the near field communication protocol supported by the hearing aid device to the hearing aid terminal through the data transmission channel, so that the hearing aid terminal compares the near field communication protocol supported by the hearing aid device with the set near field communication protocol; receiving, via the data transmission channel, an installation package corresponding to the set near-field communication protocol sent by the hearing-assistive terminal, and sending the installation package to the hearing-assistive device, so that the hearing-assistive device installs the installation package; wherein the installation package is sent by the hearing-assistive terminal after detecting that the near-field communication protocol supported by the hearing-assistive device does not match the set near-field communication protocol; By setting the near field communication protocol, a connection is established with the hearing aid device.
12. The method according to claim 9, wherein obtaining the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and the audio and video call comprises: Receiving a parameter configuration request sent by the hearing aid terminal through the data transmission channel; wherein the parameter configuration request includes multiple hearing aid parameters of the hearing aid device; Selecting a target parameter configuration mode corresponding to the parameter configuration request from a plurality of parameter configuration modes, and grouping the plurality of hearing aid parameters according to the target parameter configuration mode to obtain a plurality of parameter groups; wherein different parameter configuration modes correspond to different grouping modes; Generate data packets corresponding to the plurality of parameter groups, respectively, to obtain a plurality of data packets; wherein the data packet corresponding to each parameter group contains the hearing aid parameters in each parameter group; The multiple data packets are sent to the hearing aid device, so that the hearing aid device configures the hearing aid parameters of the hearing aid device according to the hearing aid parameters included in the received data packets.
13. The method according to claim 12, wherein the plurality of hearing aid parameters include hearing aid parameters corresponding to a left channel and a right channel respectively, and the hearing aid parameters corresponding to each channel include hearing aid parameters corresponding to a plurality of sound frequencies respectively; The grouping of the plurality of hearing aid parameters according to the target parameter configuration mode to obtain a plurality of parameter groups includes: According to the target parameter configuration method, the hearing aid parameters belonging to the same channel among the multiple hearing aid parameters are divided into the same group to obtain parameter groups corresponding to the left channel and the right channel respectively.
14. The method according to claim 12, wherein the plurality of hearing aid parameters include hearing aid parameters corresponding to a left channel and a right channel respectively, and the hearing aid parameters corresponding to each channel include hearing aid parameters corresponding to a plurality of sound frequencies respectively; The grouping of the plurality of hearing aid parameters according to the target parameter configuration mode to obtain a plurality of parameter groups includes: According to the target parameter configuration method, the hearing aid parameters belonging to the same channel and the same sound frequency among the multiple hearing aid parameters are divided into the same group to obtain multiple parameter groups.
15. A hearing assist device, comprising: Establishing a module configured to establish an audio and video call between the hearing aid terminal and the auxiliary receiving terminal through the call software; an operating module configured to obtain an operating instruction for a hearing assistance application hosted in the call software, and operate the hearing assistance application in the call software according to the operating instruction; a communication module configured to establish a data transmission channel between the hearing assistance terminal and the assistance receiving terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and The service module is configured to provide hearing assistance services to the auxiliary receiving terminal through the data transmission channel and the audio and video call.
16. A hearing assistive device, comprising: An establishment module is configured to establish an audio and video call between the auxiliary receiving terminal and the hearing assistive terminal through the call software; an operating module configured to obtain an operating instruction for a hearing assistance application hosted in the call software, and operate the hearing assistance application in the call software according to the operating instruction; a communication module configured to establish a data transmission channel between the auxiliary receiving terminal and the hearing assistance terminal based on the hearing assistance application, wherein the data transmission channel is a duplex communication channel for transmitting application data of the hearing assistance application; and The acquisition module is configured to obtain the hearing assistance service provided by the hearing assistance terminal through the data transmission channel and the audio and video call.
17. An electronic device comprising: one or more processors; A storage device for storing one or more computer programs, which, when executed by the one or more processors, enables the electronic device to implement the method according to any one of claims 1 to 14.
18. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor of an electronic device, enables the electronic device to implement the method according to any one of claims 1 to 14.
19. A computer program product comprising a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 14 is implemented.
Citation Information
Patent Citations
Hearing examination and hearing aid fitting effect evaluation integrated management system
CN112289397A
Audio signal processing method and device, electronic equipment and storage medium
CN115175076A
Auditory assistance method, device and equipment and computer readable storage medium
CN115831344A
Intelligent Bluetooth headset, system and method for remote hearing test
CN116074678A
Hearing aid adjustment system, communication terminal, and computer program
JP2023023450A