Hearing compensation method and device based on software-defined hearing aid architecture and soft bone conduction, storage medium, computer program product and wearable device

Abstract

The application relates to the technical field of hearing aid, in particular to a hearing compensation method and device based on a software-defined hearing aid architecture and soft bone conduction, a storage medium, a computer program product and a wearable device. The method comprises the following steps: acquiring mixed hearing loss data of a user, and generating an initial mechanical-acoustic gain distribution configuration based on the mixed hearing loss data; parsing the initial mechanical-acoustic gain distribution configuration into algorithm module identifiers and corresponding parameter sets, and writing the algorithm module identifiers and the corresponding parameter sets into a runtime engine of a wearable device through a wireless communication module; in the runtime engine, driving a receiver based on the algorithm module identifiers and the corresponding parameter sets, and then outputting through a multi-path acoustic conduction path fusion; collecting a sound-vibration coupling feedback signal generated due to the fusion output through a microphone array, and adaptively updating the parameter sets in the runtime engine based on the sound-vibration coupling feedback signal.

Description

Technical Field

[0001] This application relates to the field of hearing aid technology, and in particular to a hearing compensation method, device, storage medium, computer program product, and wearable device based on software-defined hearing aid architecture and cartilage conduction. Background Technology

[0002] For users with cochlear damage, current air conduction and bone conduction hearing compensation devices are ineffective due to the lack of sensorineural pathways. While cochlear implantation uses electrical pulses to stimulate the auditory nerve and restore hearing through learning, it requires complex surgery and is very expensive. Current hearing compensation devices mostly use a single air conduction or bone conduction pathway to enhance hearing. However, for users with mixed hearing loss, whose hearing impairment includes both conductive and sensorineural components, single-path compensation methods often have limitations in terms of fit and stability. To improve fit, the industry has proposed utilizing novel conduction mechanisms such as cartilage conduction and further combining cartilage conduction actuators with air conduction speakers to form a composite output structure for synergistic compensation of different types of hearing loss. In this composite output structure, it is usually necessary to allocate and configure the air conduction output and mechanical vibration output according to the user's hearing profile, for example, by setting differentiated gain settings for the two types of output channels in different frequency bands based on the audiogram. However, existing cartilage conduction solutions mostly focus on improving hardware vibrators, while software processing algorithms are often fixed and lack configurable mechanisms tailored to individual differences. This makes it difficult to translate the compensation needs represented by a user's hearing profile into parameterized configurations that can be directly executed by the device, and to maintain consistent configuration and invocation relationships across different device forms and wearing methods, resulting in suboptimal hearing compensation effects. Therefore, improving the effectiveness of hearing compensation has become a pressing technical problem. Summary of the Invention

[0003] The main objective of this application is to provide a hearing compensation method, device, storage medium, computer program product, and wearable device based on software-defined hearing aid architecture and cartilage conduction, aiming to solve the technical problem of how to improve the effect of hearing compensation.

[0004] To achieve the above objectives, this application provides a hearing compensation method based on software-defined hearing aid architecture and cartilage conduction. The method is applied to a wearable device equipped with a receiver, microphone array, and wireless communication module using cartilage conduction. The method includes: Acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; The initial mechatronic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through the wireless communication module; In the runtime engine, the receiver is driven based on the algorithm module identifier and the corresponding parameter set, and then output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. The microphone array is used to collect the acoustic-vibration coupling feedback signal generated by the fusion output, and the parameter set in the runtime engine is adaptively updated based on the acoustic-vibration coupling feedback signal.

[0005] In one embodiment, the step of acquiring a user's mixed hearing loss data and generating an initial mechatronic gain allocation configuration based on the mixed hearing loss data includes: The mixed hearing loss data is formed by acquiring air and bone conduction threshold information associated with the user identifier and conduction characteristic information related to the cartilage conduction output path. Based on the mixed hearing loss data, compensation requirement parameters corresponding to multiple processing frequency bands are determined; Based on the compensation requirement parameters, an allocation relationship is established between the mechanical gain component and the acoustic gain component, and the initial mechanical-acoustic gain allocation configuration is generated based on the allocation relationship.

[0006] In one embodiment, the step of resolving the initial mechatronic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and writing the algorithm module identifier and the corresponding parameter set into the runtime engine of the wearable device through the wireless communication module, includes: The initial mechatronic gain allocation configuration is parsed to determine a module set of at least one signal processing chain, and a corresponding algorithm module identifier is generated for each module in the module set; Based on the initial mechatronic gain allocation configuration, a corresponding parameter set is generated for each algorithm module identifier, and the algorithm module identifier is bound to the parameter set; The bound algorithm module identifier and corresponding parameter set are sent to the runtime engine through the wireless communication module, so that the runtime engine can establish a callable mapping relationship between the algorithm module identifier and the parameter set.

[0007] In one embodiment, the step of driving the receiver in the runtime engine based on the algorithm module identifier and corresponding parameter set, and then fusing the output through multiple acoustic conduction paths, includes: The runtime engine calls the processing module corresponding to the algorithm module identifier and processes the input signal collected by the microphone array based on the parameter set to obtain the first driving component and the second driving component. A vibration drive signal for driving the receiver is generated based on the first drive component, and an acoustic drive signal for driving the receiver is generated based on the second drive component. The vibration drive signal and the acoustic drive signal are synchronized and scheduled, and output to the receiver, and then fused and output through multiple acoustic conduction paths.

[0008] In one embodiment, the step of acquiring the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array and adaptively updating the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal includes: While outputting the fused output, ambient sound signals are acquired through the microphone array, and reference information corresponding to the vibration drive signal and the acoustic drive signal is obtained. Based on the ambient sound signal and the reference information, the feedback component related to the coupling loop is extracted to obtain the acoustic-vibration coupling feedback signal; The acoustic-vibration coupling feedback signal is input to the update module in the runtime engine to generate a parameter adjustment amount corresponding to the parameter set, and the parameter set in the runtime engine is adaptively updated based on the parameter adjustment amount.

[0009] In one embodiment, after the steps of acquiring the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array and adaptively updating the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal, the method further includes: The updated configuration version information corresponding to the parameter set is recorded in the runtime engine, and the configuration version information is associated with the user identifier. An updated mechanical-acoustic gain allocation configuration is generated based on the configuration version information, and the updated mechanical-acoustic gain allocation configuration is stored as configuration data for subsequent parsing and invocation; When the user is detected to have reactivated the wearable device, the configuration data is invoked to determine the algorithm module identifier and the corresponding parameter set.

[0010] Furthermore, to achieve the above objectives, this application also proposes a hearing compensation device based on a software-defined hearing aid architecture and cartilage conduction. The device is applied to a wearable device equipped with a cartilage conduction receiver, microphone array, and wireless communication module. The device includes: The initial configuration module is used to acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; A configuration parsing module is used to parse the initial mechatronic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and write the algorithm module identifier and the corresponding parameter set into the runtime engine of the wearable device through the wireless communication module; The fusion output module is used in the runtime engine to drive the receiver based on the algorithm module identifier and the corresponding parameter set, and then fuse the output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. The target module is used to acquire the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array, and to adaptively update the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal.

[0011] Furthermore, to achieve the above objectives, this application also proposes a wearable device, the wearable device comprising: a memory, a processor, and a hearing compensation program based on a software-defined hearing aid architecture and cartilage conduction stored on the memory and executable on the processor, the hearing compensation program based on the software-defined hearing aid architecture and cartilage conduction configured to implement the steps of the hearing compensation method based on a software-defined hearing aid architecture and cartilage conduction as described in any of the above embodiments.

[0012] Furthermore, to achieve the above objectives, this application also proposes a storage medium storing a hearing compensation program based on a software-defined hearing aid architecture and cartilage conduction, wherein when the hearing compensation program based on the software-defined hearing aid architecture and cartilage conduction is executed by a processor, it implements the steps of the hearing compensation method based on the software-defined hearing aid architecture and cartilage conduction described above.

[0013] In addition, to achieve the above objectives, this application also proposes a computer program product comprising a computer program that, when executed by a processor, implements the steps of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction as described above.

[0014] This application acquires mixed hearing loss data from users and generates an initial mechatronic gain allocation configuration based on the mixed hearing loss data. The initial mechatronic gain allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the runtime engine of a wearable device via a wireless communication module. In the runtime engine, the receiver is driven based on the algorithm module identifiers and corresponding parameter sets, and the output is fused through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction. Acoustic-vibration coupling feedback signals generated by the fused output are collected via a microphone array, and the parameter set in the runtime engine is adaptively updated based on these acoustic-vibration coupling feedback signals. This application acquires users' mixed hearing loss data and generates an initial mechatronic gain allocation configuration accordingly, enabling the compensation configuration to reflect the user's individual hearing characteristics. This allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the runtime engine of the wearable device. This allows the device to perform compensation processing in a modular and parameterized manner. Within the runtime engine, the receiver is driven and the output is fused based on the algorithm module identifiers and corresponding parameter sets, achieving coordinated compensation for multiple output channels. Simultaneously, a microphone array collects acoustic-vibration coupling feedback signals caused by the fused output, and the parameter set in the runtime engine is adaptively updated based on these feedback signals, forming a closed-loop adjustment to maintain continuous adaptation between the fused output and the parameter configuration, thereby improving the hearing compensation effect. Attached Figure Description

[0015] Figure 1 This is a flowchart illustrating the first embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in this application; Figure 2 This is a schematic diagram of a sub-process in the second embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in this application; Figure 3 This is a schematic diagram of a sub-process in the third embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in this application; Figure 4 This is a schematic diagram of the modular structure of a hearing compensation device based on software-defined hearing aid architecture and cartilage conduction, as described in an embodiment of this application. Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in the embodiments of this application.

[0016] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0017] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application.

[0018] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0019] It should be noted that for users with cochlear damage, current air conduction and bone conduction hearing compensation devices are ineffective due to the lack of sensorineural pathways. While cochlear implantation uses electrical pulses to stimulate the auditory nerve and restore hearing through learning, it requires complex surgery and is very expensive. Current hearing compensation devices mostly use a single air conduction or bone conduction pathway to enhance hearing. However, for users with mixed hearing loss, whose hearing impairment includes both conductive and sensorineural components, single-path compensation methods often have limitations in terms of fit and stability. To improve fit, the industry has proposed utilizing novel conduction mechanisms such as cartilage conduction and further combining cartilage conduction actuators with air conduction speakers to form a composite output structure for synergistic compensation of different types of hearing loss. In this composite output structure, it is usually necessary to allocate and configure the air conduction output and mechanical vibration output according to the user's hearing profile, for example, by setting differentiated gain settings for the two types of output channels in different frequency bands based on the audiogram. However, existing cartilage conduction solutions mostly focus on improving hardware vibrators, while software processing algorithms are often fixed and lack configurable mechanisms tailored to individual differences. This makes it difficult to translate the compensation needs represented by a user's hearing profile into parameterized configurations that can be directly executed by the device, and to maintain consistent configuration and invocation relationships across different device forms and wearing methods, resulting in suboptimal hearing compensation effects. Therefore, improving the effectiveness of hearing compensation has become a pressing technical problem.

[0020] The main solution of this application is as follows: acquiring the user's mixed hearing loss data and generating an initial mechatronic gain allocation configuration based on the mixed hearing loss data; parsing the initial mechatronic gain allocation configuration into algorithm module identifiers and corresponding parameter sets, and writing the algorithm module identifiers and corresponding parameter sets into the runtime engine of the wearable device through a wireless communication module; in the runtime engine, driving the receiver based on the algorithm module identifiers and corresponding parameter sets, and then fusing the output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction; acquiring the acoustic-vibration coupling feedback signal generated by the fused output through a microphone array, and adaptively updating the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal.

[0021] This application acquires users' mixed hearing loss data and generates an initial mechatronic gain allocation configuration accordingly, enabling the compensation configuration to reflect the user's individual hearing characteristics. This allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the runtime engine of the wearable device. This allows the device to perform compensation processing in a modular and parameterized manner. Within the runtime engine, the receiver is driven and the output is fused based on the algorithm module identifiers and corresponding parameter sets, achieving coordinated compensation for multiple output channels. Simultaneously, a microphone array collects acoustic-vibration coupling feedback signals caused by the fused output, and the parameter set in the runtime engine is adaptively updated based on these feedback signals, forming a closed-loop adjustment to maintain continuous adaptation between the fused output and the parameter configuration, thereby improving the hearing compensation effect.

[0022] It should be noted that the executing entity of the method in this embodiment can be a computing service device with data processing, network communication, and program execution functions, or it can be the aforementioned wearable device with the same or similar functions. This embodiment and the following embodiments will be described using a wearable device as an example.

[0023] Based on this, a first embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction is proposed in this application. Please refer to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction according to this application.

[0024] In this embodiment, the method is applied to a wearable device equipped with a cartilage conduction receiver, a microphone array, and a wireless communication module. The method includes the following steps: S1: Obtain the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; It should be noted that mixed hearing loss data is a collection of data used to characterize hearing loss information where a user simultaneously experiences both conductive and sensorineural hearing loss. The mechatronic gain allocation configuration is configuration data used to characterize the gain allocation relationship between the "mechanical vibration output channel" and the "acoustic air conduction output channel" during the compensation process. Mechanical gain corresponds to the driving gain component of the cartilage conduction vibrator output link. Acoustic gain corresponds to the acoustic driving gain component of the air conduction speaker output link. The initial mechatronic gain allocation configuration is a first version (initial) allocation configuration generated based on the aforementioned mixed hearing loss data.

[0025] Specifically, the device or its associated application / detection terminal acquires the user's mixed hearing loss data. This acquisition process can involve importing existing hearing records, synchronizing test results, or online collection, with the core objective being to create a dataset that characterizes the differences in hearing status across different conduction pathways. To ensure the data can be used for subsequent configuration generation, the acquired data undergoes consistency processing, such as standardizing data structures and units, removing obviously abnormal or missing fields, and associating the data with user identifiers, ultimately resulting in standardized mixed hearing loss data that can be used for calculation and configuration mapping.

[0026] Furthermore, after obtaining standardized mixed hearing loss data, an initial mechatronic gain allocation configuration is generated based on this data. The key to this generation process is mapping the "user's hearing loss characteristics" to a "dual-channel compensation allocation strategy": first, determining the overall gain requirement to be compensated and its differences across different frequency bands / scenarios; then, breaking down the overall gain requirement into mechanical and acoustic gain components, and providing their allocation relationship, so that subsequent coordinated output can be achieved between the cartilage conduction vibrator and the air conduction loudspeaker using the same configuration. The final output initial mechatronic gain allocation configuration is typically expressed in a structured configuration form, which can be further parsed into executable module identifiers and parameter sets by subsequent steps.

[0027] This step first acquires data reflecting the user's mixed hearing loss characteristics, and then generates a gain allocation configuration for the mechanical and acoustic channels based on this data. Therefore, its direct function is to transform "individual user hearing differences" into "an initial parameterized configuration that can be used for dual-channel collaborative compensation." On this basis, subsequent steps can further implement this configuration into a module identifier and parameter set executable by the runtime engine, driving cartilage conduction and air conduction to form a fused output. Therefore, this step provides an individualized initial allocation baseline for hearing compensation, reducing the arbitrariness of dual-channel output configuration and giving the subsequent compensation process a clear parameter starting point and a basis for sustainable adjustment, thereby supporting the improvement of hearing compensation effectiveness.

[0028] S2: The initial mechanical-acoustic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through the wireless communication module; It should be noted that the runtime engine is the runtime environment used by the wearable device to load, organize, and execute the signal processing chain. The algorithm module identifier is identification information used to uniquely indicate a specific signal processing functional module. The parameter set is a set of parameters that corresponds one-to-one with the algorithm module identifier.

[0029] Specifically, after obtaining the initial mechanical-acoustic gain allocation configuration, the configuration is first structured and parsed, breaking down the "allocation relationship between mechanical and acoustic channels" into executable-level module call relationships and parameter constraints. On one hand, the set of processing modules that need to be called by the runtime engine is determined, and corresponding algorithm module identifiers are generated or matched for each processing module. On the other hand, configuration content related to each processing module is extracted from the initial mechanical-acoustic gain allocation configuration to form a parameter set bound to each algorithm module identifier, so that each module has directly referenceable parameter inputs during execution, thereby obtaining a mapping structure of "algorithm module identifier - parameter set".

[0030] Furthermore, after parsing, the "algorithm module identifier and corresponding parameter set" are sent to the wearable device in transmittable data units via the wireless communication module and written into the runtime engine of the wearable device. The writing process typically includes: encapsulating the data unit on the transmission side (e.g., including version information, verification information, and module mapping relationship); performing integrity verification and parsing on the device side after receiving the data; registering the algorithm module identifier in the module index or call table of the runtime engine; and writing the parameter set into the parameter storage area or configuration area associated with the corresponding module. This enables the runtime engine to locate the processing module based on the algorithm module identifier during subsequent execution and directly read the parameter set to complete module configuration and link construction.

[0031] This step further parses the "initial mechanical-acoustic gain allocation configuration" into "algorithm module identifiers and corresponding parameter sets" that the runtime engine can recognize, and writes them into the device-side runtime engine via wireless communication. This achieves a transformation from "individualized allocation strategies" to "device-side executable configurations." On one hand, the module identifiers enable the runtime engine to locate and organize signal processing functions in a modular manner, and the parameter sets constrain the processing behavior of each module by the allocation configuration. On the other hand, wireless writing allows the configuration to be deployed to the wearable device in a timely manner and registered and called by the runtime engine, providing a directly executable configuration basis for the subsequent synchronous driving of cartilage conduction and air conduction outputs in the runtime engine. This improves the configurability and consistency of the compensation process and establishes a unified parameter carrier object for subsequent adaptive updates based on feedback signals.

[0032] S3: In the runtime engine, based on the algorithm module identifier and corresponding parameter set, the receiver is driven, and then output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. It should be noted that cartilage conduction is a method of transmitting energy to the auditory system through the mechanical vibration of cartilage. A receiver is an output device that transmits acoustic signals to the user's auditory system via the air medium. A direct air conduction path is an acoustic conduction path formed directly by the receiver through the air. In this embodiment, the receiver is a single cartilage conduction receiver that can simultaneously generate multiple sound propagation paths, including cartilage conduction and air conduction. This receiver includes an air conduction horn and a bone conduction vibrator, and multiple sound propagation paths can be generated based on this receiver.

[0033] Specifically, in the runtime engine, the corresponding processing / control module is invoked based on the algorithm module identifier, and the corresponding parameter set is loaded. Under the constraints of the parameter set, the runtime engine generates control quantities or drive signals to drive the receiver. The runtime engine outputs the drive signals to the receiver, causing the receiver to output acoustic signals under the current configuration conditions.

[0034] Furthermore, after the receiver outputs an acoustic signal, this output, under the influence of the wearable device's contact structure with the human body, forms multiple acoustic conduction paths and is fused at the user side: one part of the output propagates directly along the air medium, forming a direct air conduction path; another part of the output, under the influence of the cartilage structure and its contact interface, forms cartilage-related transmission branches, one of which is a cartilage-air conduction path, and the other is a cartilage-bone conduction path. These three types of paths work together at the user side, causing the output to be presented in a multi-path superposition manner, thus constituting the fused output of the multi-path acoustic conduction paths.

[0035] Because this step parameterizes the receiver in the runtime engine based on the algorithm module identifier and corresponding parameter set, and makes the receiver output fused on the user side through multiple acoustic conduction paths such as cartilage-air conduction, cartilage-bone conduction and direct air conduction, the propagation results of the same output under different conduction mechanisms are incorporated into a unified configurable output framework. This ensures that the receiver output is controllable due to the constraint of the parameter set, and forms a fused output through multiple conduction paths. This provides a clear output object and closed-loop adjustment basis for subsequent acquisition of acoustic-vibration coupling feedback caused by the fused output using a microphone array and adaptive parameter updates, thereby supporting the continuous adaptation of the hearing compensation process.

[0036] S4: Acquire the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array, and adaptively update the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal.

[0037] It should be noted that the acoustic-vibration coupling feedback signal is a signal containing feedback components that is formed during the fusion output process by the cartilage-conducted vibration and the air-conducted acoustic output forming a coupling loop in the device structure, wearing contact interface, and acoustic path, and is picked up by the microphone array. Adaptive update refers to the process of dynamically adjusting the parameter set in the runtime engine based on the collected acoustic-vibration coupling feedback signal.

[0038] Specifically, during the execution of the air-bone dual-guide fusion output, the microphone array continuously acquires ambient sound and the feedback components introduced by the fusion output, obtaining an acquisition signal containing feedback information. Since the acquisition signal simultaneously contains external sound source components and feedback components introduced by the coupling loop, the acquisition signal can be correlated and its components extracted in the runtime engine by combining the reference information of the current output drive, in order to obtain an acoustic-vibration coupling feedback signal that characterizes the coupling loop. This allows the feedback information to be explicitly expressed in a form that can be used for parameter adjustment.

[0039] Furthermore, the runtime engine inputs the acoustic-vibration coupling feedback signal to the processing logic for parameter adjustment, determines the target parameter range related to the feedback, and generates the corresponding parameter adjustment amount. Then, the parameter adjustment amount is applied to the corresponding parameters in the parameter set to obtain the updated parameter set. After the update is complete, the runtime engine writes the updated parameter set back to the configuration area associated with the algorithm module identifier and reconfigures the relevant processing modules accordingly, so that subsequent fusion outputs continue to execute under the constraints of the new parameter set, thus forming a closed loop of "acquisition—update—re-execution".

[0040] Since this step uses a microphone array to collect the acoustic-vibration coupling feedback signal caused by the air-bone dual-guide fusion output, and adaptively updates the parameter set in the runtime engine accordingly, the changes in the coupling loop during the fusion output process are transformed into feedback basis that can be used for parameter adjustment: when changes in wearing status, coupling conditions, or output status cause changes in feedback characteristics, the runtime engine can dynamically correct the parameter set based on the feedback signal and use the updated parameter set for subsequent processing and driving, thereby maintaining the adaptability and stability of the fusion output and parameter configuration during continuous operation, and thus supporting the continuity and consistency of the hearing compensation process.

[0041] This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration based on the mixed hearing loss data. The initial mechatronic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through a wireless communication module. In the runtime engine, the receiver is driven based on the algorithm module identifier and the corresponding parameter set, and then the output is fused through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction. The acoustic-vibration coupling feedback signal generated by the fused output is collected through a microphone array, and the parameter set in the runtime engine is adaptively updated based on the acoustic-vibration coupling feedback signal. This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration accordingly, enabling the compensation configuration to reflect the user's individual hearing characteristics. This allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the wearable device's runtime engine. This allows the device to perform compensation processing in a modular and parameterized manner. Within the runtime engine, the receiver is driven and the output is fused based on the algorithm module identifiers and corresponding parameter sets, achieving coordinated compensation for multiple output channels. Simultaneously, a microphone array collects acoustic-vibration coupling feedback signals caused by the fused output, and the parameter set in the runtime engine is adaptively updated based on these feedback signals, forming a closed-loop adjustment to maintain continuous adaptation between the fused output and the parameter configuration, thereby improving the hearing compensation effect.

[0042] Based on the first embodiment described above, a second embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction is proposed in this application. Please refer to... Figure 2 , Figure 2 This is a schematic diagram of a sub-process in the second embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in this application.

[0043] like Figure 2 As shown, in this embodiment, step S1 includes: S11: Obtain air-bone conduction threshold information associated with the user identifier and conduction characteristic information related to the cartilage conduction output path to form the mixed hearing loss data; S12: Determine the compensation requirement parameters corresponding to multiple processing frequency bands based on the mixed hearing loss data; S13: Establish an allocation relationship between the mechanical gain component and the acoustic gain component based on the compensation requirement parameters, and generate the initial mechanical-acoustic gain allocation configuration based on the allocation relationship.

[0044] It should be noted that user identification is used to locate specific users on the system side and associate them with their hearing profiles, configuration records, and subsequent update records. Air-bone conduction threshold information is profile information characterizing the minimum perceptible level of sound in different frequency bands under air conduction pathways. Cartilage conduction output path-related conduction characteristic information characterizes the path characteristics of the cartilage conduction vibrator output transmitted to the auditory perception end through the wearing contact interface and soft tissue. Mixed hearing loss data is a dataset formed by combining air-bone conduction threshold information and cartilage conduction output path-related conduction characteristic information, used to characterize the differences in hearing status between air conduction and mechanical conduction pathways. Compensation requirement parameters are a set of parameters characterizing the required compensation intensity or compensation target within each processed frequency band.

[0045] Specifically, firstly, using the user identifier as an index, the air-bone conduction hearing threshold information associated with that user is obtained to reflect the user's hearing status under the air conduction path; simultaneously, conduction characteristic information related to the cartilage conduction output path is obtained to reflect the transmission characteristics of the mechanical vibration channel under the user's wearing and contact conditions. Then, the two types of information are uniformly organized, for example, by aligning frequency band classifications and processing missing or abnormal records, and the two types of information are merged into a data structure that can be read by the same configuration generation logic, thereby forming the mixed hearing loss data.

[0046] Furthermore, after obtaining the mixed hearing loss data, the data is analyzed according to multiple processing frequency bands to determine the compensation requirement parameters corresponding to each processing frequency band, so that the compensation requirement can be clearly expressed at the frequency band level. Then, using the compensation requirement parameters as input, the allocation relationship between the mechanical gain component and the acoustic gain component is established: for each processing frequency band, the compensation share undertaken by the mechanical channel and the acoustic channel is determined, and the allocation results of each frequency band are aggregated into an overall allocation configuration. Finally, based on the allocation relationship, the initial mechanical-acoustic gain allocation configuration is generated, which can serve as the basic configuration source for subsequent parsing into algorithm module identifiers and parameter sets and writing them into the runtime engine.

[0047] This step, using the user identifier as an index, simultaneously incorporates air-bone conduction threshold information and cartilage conduction output path conduction characteristic information, forming mixed hearing loss data that reflects the differences between the user and the two conduction paths. Furthermore, it determines compensation requirement parameters across multiple processing frequency bands, and based on this, establishes the allocation relationship between mechanical and acoustic gain components, generating an initial mechanical-acoustic gain allocation configuration. Therefore, it transforms the "individual user's dual-path hearing characteristics" into a "dual-channel gain allocation initial configuration that can be implemented across frequency bands." This initial configuration provides a unified baseline and parameter entry point for the subsequent modular execution and adaptive parameter updates of the runtime engine, thereby supporting the configurability and continuous adaptation of the air-bone dual-guide fusion output under individual differences.

[0048] Based on the first embodiment described above, in this embodiment, step S2 includes: S21: Analyze the initial mechatronic gain allocation configuration to determine a module set of at least one signal processing chain, and generate a corresponding algorithm module identifier for each module in the module set; S22: Generate corresponding parameter sets for each algorithm module identifier based on the initial mechatronic gain allocation configuration, and bind the algorithm module identifier to the parameter set; S23: The bound algorithm module identifier and corresponding parameter set are sent to the runtime engine through the wireless communication module, so that the runtime engine can establish a callable mapping relationship between the algorithm module identifier and the parameter set.

[0049] It should be noted that a signal processing chain is a combination of multiple processing modules organized in a certain order within the runtime engine. A module set is the collection of processing modules that constitute the signal processing chain. The callable mapping relationship is an association table or index structure within the runtime engine used to describe the relationship between "algorithm module identifier—parameter set—executable module".

[0050] Specifically, the initial mechatronic gain allocation configuration is first analyzed in a structured manner to identify the corresponding processing logic organization and thereby determine at least one set of modules for a signal processing chain. This determination process includes: identifying the types and order of functional modules required for each processing stage from the configuration, aggregating them into a module set; and generating a corresponding algorithm module identifier for each module in the module set, ensuring that each module has a unique, indexable, and callable entry point in the runtime engine, thus transforming the original configuration into an executable description of "module set - module identifier".

[0051] Furthermore, after obtaining the identifiers of each algorithm module, a corresponding parameter set is generated for each algorithm module identifier based on the initial mechatronic gain allocation configuration. This parameter set carries the configuration inputs required by the module during execution. Subsequently, the algorithm module identifier and the parameter set are bound together to form a directly deployable bound data unit. Then, the bound algorithm module identifier and corresponding parameter set are sent to the runtime engine via a wireless communication module. Upon receiving the data unit, the runtime engine registers it, writes the algorithm module identifier into a callable index, and writes the corresponding parameter set into the configuration storage area associated with the identifier. This establishes a callable mapping relationship between the algorithm module identifier and the parameter set, enabling the engine to automatically read the parameter set and complete module configuration and execution when calling the module by identifier.

[0052] Because this step resolves the initial mechatronic gain allocation configuration into a set of modules of at least one signal processing chain, generates an algorithm module identifier for each module, further generates a parameter set for each algorithm module identifier and completes the binding, and finally sends it to the runtime engine via wireless communication to establish a callable mapping relationship, it achieves a structured implementation from "allocation configuration" to "runtime executable link": the runtime engine can build a signal processing chain according to the module set, complete the module index with the algorithm module identifier, and complete the module parameterization configuration with the bound parameter set, so that the subsequent fusion output of synchronously driving the cartilage conduction vibrator and the air conduction loudspeaker has a clear, reusable and updatable execution entry point, while providing a locatable and replaceable parameter carrier object for subsequent parameter adaptive updates based on feedback signals.

[0053] This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration based on the mixed hearing loss data. The initial mechatronic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through a wireless communication module. In the runtime engine, the receiver is driven based on the algorithm module identifier and the corresponding parameter set, and then the output is fused through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction. The acoustic-vibration coupling feedback signal generated by the fused output is collected through a microphone array, and the parameter set in the runtime engine is adaptively updated based on the acoustic-vibration coupling feedback signal. This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration accordingly, enabling the compensation configuration to reflect the user's individual hearing characteristics. This allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the wearable device's runtime engine. This allows the device to perform compensation processing in a modular and parameterized manner. Within the runtime engine, the receiver is driven and the output is fused based on the algorithm module identifiers and corresponding parameter sets, achieving coordinated compensation for multiple output channels. Simultaneously, a microphone array collects acoustic-vibration coupling feedback signals caused by the fused output, and the parameter set in the runtime engine is adaptively updated based on these feedback signals, forming a closed-loop adjustment to maintain continuous adaptation between the fused output and the parameter configuration, thereby improving the hearing compensation effect.

[0054] Based on the second embodiment described above, a third embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction is proposed in this application. Please refer to... Figure 3 , Figure 3 This is a schematic diagram of a sub-process in the third embodiment of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in this application.

[0055] In this embodiment, step S3 includes: S31: In the runtime engine, the processing module corresponding to the algorithm module identifier is called, and the input signal collected by the microphone array is processed based on the parameter set to obtain the first driving component and the second driving component; S32: Generate a vibration drive signal for driving the receiver based on the first drive component, and generate an acoustic drive signal for driving the receiver based on the second drive component; S33: Synchronize and schedule the vibration drive signal and the acoustic drive signal, output them to the receiver, and then fuse them through multiple acoustic conduction paths.

[0056] It should be noted that the processing module is a signal processing unit that can be called and executed within the runtime engine. The input signal is signal data acquired by the microphone array and sent to the runtime engine for processing. The first drive component and the second drive component are two drive-related results obtained after the processing module processes the input signal, used to generate drive signals for the cartilage conduction vibrator and the air conduction loudspeaker, respectively. The vibration drive signal is the drive control signal used to drive the cartilage conduction vibrator to output vibration. The acoustic drive signal is the drive control signal used to drive the air conduction loudspeaker to output acoustic signals. Synchronous scheduling refers to arranging the output timing and update rhythm of the two drive signals in a consistent manner, enabling the two outputs to output collaboratively under the same scheduling framework. Multiple acoustic conduction paths are multiple acoustic or vibration transmission paths formed by the cartilage conduction receiver output under different conduction mechanisms, used to achieve fused output.

[0057] Specifically, in the runtime engine, the corresponding processing module is invoked based on the algorithm module identifier, and the parameter set bound to that processing module is loaded, enabling the processing module to process the input signal acquired by the microphone array under the current configuration conditions. The processing module analyzes and decomposes the input signal under the constraints of the parameter set, and outputs the processing result as a first driving component and a second driving component. The first driving component characterizes the vibration driving information related to the receiver, and the second driving component characterizes the acoustic driving information related to the receiver. Subsequently, the runtime engine generates a vibration driving signal for driving the receiver based on the first driving component and an acoustic driving signal for driving the receiver based on the second driving component, so that the input signal is mapped to the driving signals corresponding to the mechanical vibration channel and the acoustic output channel respectively under the same parameter set constraints.

[0058] Furthermore, after generating the vibration drive signal and the acoustic drive signal, the runtime engine synchronously schedules the two drive signals, maintaining their correlation in the time dimension and control rhythm, and outputs them to the receiver. Under the drive, the receiver output propagates to the user's auditory system through different conduction mechanisms, forming multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction. These multiple conduction paths are superimposed and merged on the user side, so that the output result no longer depends on a single conduction mode, but is completed in the form of a fused output of multiple acoustic conduction paths, thereby achieving coordinated output under air-bone dual conduction conditions.

[0059] Because this step processes the input signal based on the algorithm module identifier and parameter set in the runtime engine, and splits the processing result into a first driving component and a second driving component for the receiver respectively, and then outputs them to the corresponding conduction channels through synchronous scheduling and fusion output through multiple acoustic conduction paths, it realizes the coordinated control of different conduction mechanisms under a unified configuration and unified scheduling framework. This allows the same input signal to participate in the output through multiple conduction paths at the same time, providing a stable, controllable and fusion-characteristic output foundation for subsequent parameter adaptive updates based on acoustic-vibration coupling feedback signals, thereby supporting the continuous adaptation and consistent operation of the hearing compensation process.

[0060] Based on the second embodiment described above, in this embodiment, step S4 includes: S41: While outputting the fused output, ambient sound signals are collected through the microphone array, and reference information corresponding to the vibration drive signal and the acoustic drive signal is obtained; S42: Based on the ambient sound signal and the reference information, extract the feedback component related to the coupling loop to obtain the acoustic-vibration coupling feedback signal; S43: Input the acoustic-vibration coupling feedback signal into the update module in the runtime engine to generate a parameter adjustment amount corresponding to the parameter set, and adaptively update the parameter set in the runtime engine based on the parameter adjustment amount.

[0061] It should be noted that the ambient sound signal is the acoustic signal collected by the microphone array during the fusion output process. Reference information is the correlation information corresponding to the vibration-driven signal and the acoustic-driven signal, used to assist in identifying the feedback component. The coupling loop is the feedback path formed by the acoustic signal output from the air-conducting speaker and the mechanical vibration output from the cartilage-conducting vibrator in the wearing structure, contact interface, and acoustic path. The feedback component is the part of the ambient sound signal related to the coupling loop, formed by the device's output feedback. The parameter adjustment amount is the parameter change information calculated by the update module based on the acoustic-vibration coupling feedback signal.

[0062] Specifically, while the wearable device outputs a fused output, the microphone array continuously acquires ambient sound signals to obtain real-time acoustic input under the current wearing condition. Simultaneously, the device acquires reference information corresponding to the vibration-driven and acoustic-driven signals, enabling the runtime engine to establish a correlation between the "current output drive" and the "microphone acquisition results." Subsequently, the runtime engine performs correlation analysis based on the ambient sound signals and reference information, identifying feedback characteristics related to the output drive in the ambient sound signals and extracting feedback components related to the coupling loop, thereby obtaining an acoustic-vibration coupling feedback signal used to characterize the acoustic and vibration coupling loop.

[0063] Furthermore, after obtaining the acoustic-vibration coupling feedback signal, this feedback signal is input to the update module in the runtime engine. The update module determines the adjustment direction and magnitude of the parameter set based on the acoustic-vibration coupling feedback signal, and generates the parameter adjustment amount corresponding to the parameter set. Subsequently, the runtime engine replaces or corrects the relevant parameters in the parameter set according to the parameter adjustment amount, and writes the updated parameter set back to the configuration area associated with the algorithm module identifier, so that subsequent processing modules can read the updated parameter set when performing input signal processing and drive signal generation, thereby completing the adaptive update closed loop of the parameter set.

[0064] This step acquires ambient sound signals while outputting the fused output, and extracts feedback components related to the coupling loop from the acquired signals by combining the reference information corresponding to the multi-output drive, forming an acoustic-vibration coupling feedback signal. This feedback signal is then input into the update module to generate parameter adjustment amounts and update the parameter set in the runtime engine accordingly. Therefore, the changes in the coupling loop caused by the fused output are transformed into feedback basis that can be used for parameter correction, and the correction results are applied to the parameter set in real time, so that the subsequent drive signal generation and synchronization scheduling continue under the updated parameter constraints. This maintains the adaptability and stability of the fused output and processing parameters during continuous operation, supporting the continuous consistency of the hearing compensation process.

[0065] Based on the second embodiment described above, in this embodiment, after step S4, the following is further included: S4a: Record the configuration version information corresponding to the updated parameter set in the runtime engine, and associate the configuration version information with the user identifier; S4b: Generate an updated mechanical-acoustic gain allocation configuration based on the configuration version information, and store the updated mechanical-acoustic gain allocation configuration as configuration data for subsequent parsing and invocation; S4c: When the user is detected to have reactivated the wearable device, the configuration data is invoked to determine the algorithm module identifier and the corresponding parameter set.

[0066] It should be noted that configuration version information is used to identify the configuration version of the updated parameter set on the current device side. Configuration data is a data record that solidifies the updated mechanical-acoustic gain allocation configuration in a storable, searchable, and re-parseable format. Reactivation refers to the trigger condition for a user to restart or re-enter the working state after completing a usage cycle, used to trigger the configuration data retrieval process.

[0067] Specifically, after the runtime engine completes the adaptive update of the parameter set based on feedback signals, it internally records the updated parameter set as a version, generates configuration version information corresponding to the parameter set, and associates the configuration version information with the user identifier, enabling subsequent traceability of the corresponding configuration status from the user's perspective. Subsequently, based on the configuration version information, the updated parameter set is organized and aggregated to generate an updated mechanical-acoustic gain allocation configuration. This allocation configuration allows the "update result at the parameter set level" to be back-derived as a "configuration description at the allocation configuration level," and the updated mechanical-acoustic gain allocation configuration is stored as configuration data for direct retrieval and reuse later.

[0068] Furthermore, upon detecting that a user has reactivated the wearable device, the runtime engine locates the configuration version information associated with the user based on the user identifier and retrieves the configuration data corresponding to that version. The runtime engine then determines the algorithm module identifier and corresponding parameter set to be invoked based on the configuration data, restoring the configuration data to an executable "module identifier-parameter set" structure. This allows the device to directly adopt the configuration state obtained from the previous adaptive update during the reactivation phase, without having to return to the initial configuration, thereby completing rapid configuration restoration and execution preparation based on historical update results.

[0069] Because this step records the adaptively updated parameter set in a versioned manner and associates it with the user identifier, and then uses this version information to generate and store the updated mechanical-acoustic gain allocation configuration as reusable configuration data, and calls the configuration data when the user reactivates the device to determine the algorithm module identifier and corresponding parameter set, the parameter update results formed during a single run are precipitated as a traceable and reusable configuration baseline. In this way, when activated subsequently, the module and parameter configuration that better fits the user's current state can be directly restored, reducing the repeated configuration process and maintaining the consistency and continuity of configuration between previous and subsequent use cycles, thereby supporting the continuous adaptation of the hearing compensation process.

[0070] This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration based on the mixed hearing loss data. The initial mechatronic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through a wireless communication module. In the runtime engine, the receiver is driven based on the algorithm module identifier and the corresponding parameter set, and then the output is fused through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction. The acoustic-vibration coupling feedback signal generated by the fused output is collected through a microphone array, and the parameter set in the runtime engine is adaptively updated based on the acoustic-vibration coupling feedback signal. This embodiment acquires the user's mixed hearing loss data and generates an initial mechatronic gain allocation configuration accordingly, enabling the compensation configuration to reflect the user's individual hearing characteristics. This allocation configuration is then parsed into algorithm module identifiers and corresponding parameter sets, which are written into the wearable device's runtime engine. This allows the device to perform compensation processing in a modular and parameterized manner. Within the runtime engine, the receiver is driven and the output is fused based on the algorithm module identifiers and corresponding parameter sets, achieving coordinated compensation for multiple output channels. Simultaneously, a microphone array collects acoustic-vibration coupling feedback signals caused by the fused output, and the parameter set in the runtime engine is adaptively updated based on these feedback signals, forming a closed-loop adjustment to maintain continuous adaptation between the fused output and the parameter configuration, thereby improving the hearing compensation effect.

[0071] This application also provides a hearing compensation device based on software-defined hearing aid architecture and cartilage conduction. Please refer to... Figure 4 , Figure 4 This is a schematic diagram of the module structure of a hearing compensation device based on a software-defined hearing aid architecture and cartilage conduction, according to an embodiment of this application. The device is applied to a wearable device equipped with a cartilage conduction receiver, a microphone array, and a wireless communication module. The device includes: The initial configuration module 401 is used to acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data. The configuration parsing module 402 is used to parse the initial mechanical-acoustic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and write the algorithm module identifier and the corresponding parameter set into the runtime engine of the wearable device through the wireless communication module; The fusion output module 403 is used in the runtime engine to drive the receiver based on the algorithm module identifier and the corresponding parameter set, and then fuse the output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. The target module 404 is used to acquire the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array, and to adaptively update the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal.

[0072] The hearing compensation device based on software-defined hearing aid architecture and cartilage conduction provided in this application, employing the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction described in the above embodiments, can solve the technical problem of how to improve the effect of hearing compensation. Compared with the prior art, the beneficial effects of the hearing compensation device based on software-defined hearing aid architecture and cartilage conduction provided in this application are the same as the beneficial effects of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction provided in the above embodiments, and other technical features in the hearing compensation device based on software-defined hearing aid architecture and cartilage conduction are the same as the features disclosed in the methods of the above embodiments, and will not be repeated here.

[0073] This application provides a wearable device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in the above embodiments.

[0074] The following is for reference. Figure 5 , Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in the embodiments of this application. It shows a schematic diagram of the structure of a wearable device suitable for implementing the embodiments of this application. Figure 5 The wearable device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this application.

[0075] like Figure 5As shown, the wearable device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the wearable device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the wearable device to communicate wirelessly or wiredly with other devices to exchange data. While wearable devices with various systems are shown in the figures, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0076] In particular, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. When the computer program is executed by the processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0077] The wearable device provided in this application employs the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction as described in the above embodiments, which can solve the technical problem of how to improve the effect of hearing compensation. Compared with the prior art, the beneficial effects of the wearable device provided in this application are the same as those of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction provided in the above embodiments, and other technical features of this wearable device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0078] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0079] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0080] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction in the above embodiments.

[0081] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a wearable device, cause the wearable device to: acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; parse the initial mechatronic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and write the algorithm module identifier and the corresponding parameter set into the wearable device's runtime engine via a wireless communication module; in the runtime engine, drive the receiver based on the algorithm module identifier and the corresponding parameter set, and then fuse the output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction, and direct air conduction; acquire the acoustic-vibration coupling feedback signal generated by the fused output through a microphone array, and adaptively update the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal. Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0082] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0083] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0084] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described hearing compensation method based on software-defined hearing aid architecture and cartilage conduction, thereby solving the technical problem of how to improve the effect of hearing compensation. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction provided in the above embodiments, and will not be repeated here.

[0085] This application provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction as described above.

[0086] The computer program product provided in this application can solve the technical problem of how to improve the effect of hearing compensation. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiments of this application are the same as the beneficial effects of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction provided in the above embodiments, and will not be repeated here.

[0087] All user-related data involved in this application (e.g., mixed hearing loss data) was obtained with the user's permission or consent. In other words, when this application is applied to specific products or technologies, user permission is required to acquire and process the relevant data, and the processing of the data must comply with the relevant laws, regulations, and regulatory standards of the relevant countries and regions. For example, when it is necessary to acquire a user's mixed hearing loss data, a prompt to acquire mixed hearing loss data can be displayed on the user's terminal. After receiving confirmation from the user regarding the prompt, the terminal can acquire the user's mixed hearing loss data.

[0088] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. A hearing compensation method based on software-defined hearing aid architecture and cartilage conduction, characterized in that, The method is applied to wearable devices equipped with a cartilage conduction receiver, microphone array, and wireless communication module, and the method includes: Acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; The initial mechatronic gain allocation configuration is parsed into an algorithm module identifier and a corresponding parameter set, and the algorithm module identifier and the corresponding parameter set are written into the runtime engine of the wearable device through the wireless communication module; In the runtime engine, the receiver is driven based on the algorithm module identifier and the corresponding parameter set, and then output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. The microphone array is used to collect the acoustic-vibration coupling feedback signal generated by the fusion output, and the parameter set in the runtime engine is adaptively updated based on the acoustic-vibration coupling feedback signal.

2. The method as described in claim 1, characterized in that, The step of acquiring the user's mixed hearing loss data and generating an initial mechatronic gain allocation configuration based on the mixed hearing loss data includes: The mixed hearing loss data is formed by acquiring air and bone conduction threshold information associated with the user identifier and conduction characteristic information related to the cartilage conduction output path. Based on the mixed hearing loss data, compensation requirement parameters corresponding to multiple processing frequency bands are determined; Based on the compensation requirement parameters, an allocation relationship is established between the mechanical gain component and the acoustic gain component, and the initial mechanical-acoustic gain allocation configuration is generated based on the allocation relationship.

3. The method as described in claim 1, characterized in that, The step of resolving the initial mechatronic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and writing the algorithm module identifier and the corresponding parameter set into the runtime engine of the wearable device through the wireless communication module, includes: The initial mechatronic gain allocation configuration is parsed to determine a module set of at least one signal processing chain, and a corresponding algorithm module identifier is generated for each module in the module set; Based on the initial mechatronic gain allocation configuration, a corresponding parameter set is generated for each algorithm module identifier, and the algorithm module identifier is bound to the parameter set; The bound algorithm module identifier and corresponding parameter set are sent to the runtime engine through the wireless communication module, so that the runtime engine can establish a callable mapping relationship between the algorithm module identifier and the parameter set.

4. The method as described in claim 1, characterized in that, The step of driving the receiver in the runtime engine based on the algorithm module identifier and corresponding parameter set, and then fusing the output through multiple acoustic conduction paths, includes: The runtime engine calls the processing module corresponding to the algorithm module identifier and processes the input signal collected by the microphone array based on the parameter set to obtain the first driving component and the second driving component. A vibration drive signal for driving the receiver is generated based on the first drive component, and an acoustic drive signal for driving the receiver is generated based on the second drive component. The vibration drive signal and the acoustic drive signal are synchronized and scheduled, and output to the receiver, and then fused and output through multiple acoustic conduction paths.

5. The method as described in claim 4, characterized in that, The step of acquiring the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array, and adaptively updating the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal, includes: While outputting the fused output, ambient sound signals are acquired through the microphone array, and reference information corresponding to the vibration drive signal and the acoustic drive signal is obtained. Based on the ambient sound signal and the reference information, the feedback component related to the coupling loop is extracted to obtain the acoustic-vibration coupling feedback signal; The acoustic-vibration coupling feedback signal is input to the update module in the runtime engine to generate a parameter adjustment amount corresponding to the parameter set, and the parameter set in the runtime engine is adaptively updated based on the parameter adjustment amount.

6. The method as described in claim 5, characterized in that, After the steps of acquiring the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array and adaptively updating the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal, the method further includes: The updated configuration version information corresponding to the parameter set is recorded in the runtime engine, and the configuration version information is associated with the user identifier. An updated mechanical-acoustic gain allocation configuration is generated based on the configuration version information, and the updated mechanical-acoustic gain allocation configuration is stored as configuration data for subsequent parsing and invocation. When the user is detected to have reactivated the wearable device, the configuration data is invoked to determine the algorithm module identifier and the corresponding parameter set.

7. A hearing compensation device based on software-defined hearing aid architecture and cartilage conduction, characterized in that, The device is applied to a wearable device having a cartilage conduction receiver, a microphone array, and a wireless communication module, and the device includes: The initial configuration module is used to acquire the user's mixed hearing loss data and generate an initial mechatronic gain allocation configuration based on the mixed hearing loss data; A configuration parsing module is used to parse the initial mechatronic gain allocation configuration into an algorithm module identifier and a corresponding parameter set, and write the algorithm module identifier and the corresponding parameter set into the runtime engine of the wearable device through the wireless communication module; The fusion output module is used in the runtime engine to drive the receiver based on the algorithm module identifier and the corresponding parameter set, and then fuse the output through multiple acoustic conduction paths, including cartilage-air conduction, cartilage-bone conduction and direct air conduction. The target module is used to acquire the acoustic-vibration coupling feedback signal generated by the fusion output through the microphone array, and to adaptively update the parameter set in the runtime engine based on the acoustic-vibration coupling feedback signal.

8. A wearable device, characterized in that, The wearable device includes: a memory, a processor, and a hearing compensation program based on a software-defined hearing aid architecture and cartilage conduction stored on the memory and executable on the processor, the hearing compensation program based on the software-defined hearing aid architecture and cartilage conduction configured to implement the steps of the hearing compensation method based on a software-defined hearing aid architecture and cartilage conduction as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium stores a hearing compensation program based on a software-defined hearing aid architecture and cartilage conduction. When the hearing compensation program based on the software-defined hearing aid architecture and cartilage conduction is executed by a processor, it implements the steps of the hearing compensation method based on a software-defined hearing aid architecture and cartilage conduction as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the hearing compensation method based on software-defined hearing aid architecture and cartilage conduction as described in any one of claims 1 to 6.

Images