Sound receiving device control method and device based on dual-mode audio three-dimensional code
By using dual-mode audio 3D code technology in hearing aids, the operation instructions are encoded into the audio 3D code of the voice signal, which solves the problem of inconvenient operation of the knob or button, and achieves efficient and low-power listening control, improving the user experience.
Patent Information
- Application Number
- CN202210901398.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-28
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-07-28
AI Technical Summary
The knobs or buttons of existing hearing aids are inconvenient to operate, resulting in poor user experience, especially in small and complex back-ear hearing aids, which make it difficult to achieve effective hearing control.
Using a method based on dual-mode audio 3D code, the operation instructions are encoded into digital vectors and encoded into the audio 3D code of the voice signal, and sent to the sound receiving device through the voice signal, and the device's analytical ability is used to control it, avoiding the Physical modifications and additional power consumption of the device.
It realizes the transmission of hidden operation commands for sound receiving devices, improves user experience, and is especially suitable for digital hearing aids with high volume and battery life requirements, reducing environmental interference and enhancing operational concealment.
Smart Images

Figure CN115297406B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method and apparatus for controlling a sound receiving device based on a dual-mode audio three-dimensional code. Background Art
[0002] Sound receiving devices refer to devices that can analyze sound signals inside the device, thereby converting sound signals into electrical signals. General sound receiving devices include Bluetooth headsets, wearable devices, hearing aids, etc. The following is a specific description of hearing aids. The latest data from the World Health Organization shows that about 390 million people in the world suffer from disabling hearing loss, accounting for about 5% of the world's total population, of which 33 million are children. Although hearing loss will not have much impact on life safety, it will still cause many inconveniences in daily life. At present, hearing aids are the mainstream and more effective means of compensating the hearing of patients with hearing loss. After decades of development, hearing aids have entered the era of intelligent digital hearing aids through digital signal processing from the traditional analog hearing aid era that was mainly processed by analog devices.
[0003] Digital hearing aids often provide some manual control options. For example, in order to work better, hearing aids, especially behind-the-ear hearing aids, will provide several scene modes (control scene mode, control volume, etc.) for users to choose. The conventional method is to install several buttons on the behind-the-ear hearing aid, and the user presses the buttons to make selections to achieve better hearing effects. However, since the behind-the-ear hearing aid itself is small in size, the size of the buttons is even smaller, which makes the operation inconvenient and the user experience poor. Summary of the invention
[0004] Based on this, it is necessary to provide a sound receiving device control method and device based on dual-mode audio three-dimensional code, which can solve the inconvenience of using knobs, buttons or keys to operate the sound receiving device in response to the above technical problems.
[0005] A method for controlling a sound receiving device based on a dual-mode audio three-dimensional code, the method comprising:
[0006] Receiving an operation instruction and encoding the operation instruction into a digital vector;
[0007] Obtaining a first audio 3D code corresponding to a preset voice signal, encoding the digital vector into the first audio 3D code, and obtaining a second audio 3D code;
[0008] The second audio three-dimensional code is converted into a voice signal and sent to a sound receiving device.
[0009] In one of the embodiments, it also includes: selecting a control indicator corresponding to an element value from the first audio 3D code; calculating the grayscale values corresponding to different elements in the digital vector according to the control indicator and preset control parameters; encoding the digital vector into the first audio 3D code according to the grayscale value of the sound spectrogram corresponding to each element therein, to obtain a second audio 3D code.
[0010] In one of the embodiments, it further includes: obtaining distribution information of element values in the first audio three-dimensional code;
[0011] According to the distribution information, more than two control indicators are determined.
[0012] In one of the embodiments, it also includes: calculating the maximum and minimum values of the element value according to the distribution information, sampling according to a preset step size according to the maximum and minimum values to obtain multiple control values; and obtaining a control indicator according to the maximum, minimum and control values.
[0013] In one of the embodiments, the method further includes: calculating the maximum value, minimum value and average value of the element value according to the distribution information; and using the maximum value, minimum value and average value as control indicators.
[0014] In one of the embodiments, it also includes: using preset control parameters as adjustment weights, performing logical calculations on the control indicators, and weighting the logical calculation results by adjusting the weights to obtain the grayscale values of the sound spectrogram corresponding to different elements in the digital vector.
[0015] In one of the embodiments, it also includes: calculating the difference between the maximum value and the minimum value, and multiplying it by the control parameter to obtain deviation information; performing addition and subtraction calculations based on the average value and the deviation information to obtain the grayscale values of the sound spectrogram corresponding to different elements in the digital vector; wherein the grayscale values of the sound spectrogram corresponding to different elements in the digital vector are determined by controlling the size of the deviation information and the signs of the addition and subtraction calculations.
[0016] In one of the embodiments, it also includes: splicing the digital vector codes according to the grayscale values of the sound spectrogram corresponding to each element therein to obtain an audio 3D code segment; inserting the audio 3D code segment into the first audio 3D code to obtain a second audio 3D code.
[0017] In one of the embodiments, the method further includes: obtaining a preset position parameter, and according to the position parameter, inserting the audio 3D code segment into a position corresponding to the position parameter in the first audio 3D code to obtain a second audio 3D code.
[0018] In one embodiment, the method further includes: performing an inverse Fourier transform on the second audio 3D code to obtain a voice signal;
[0019] The voice signal is sent to the sound receiving device as a command control signal.
[0020] In one of the embodiments, the sound receiving device is a hearing aid or a digital hearing aid.
[0021] A sound receiving device control device based on dual-mode audio three-dimensional code, the device comprising:
[0022] An instruction receiving module, used for receiving an operation instruction and encoding the operation instruction into a digital vector;
[0023] An audio 3D code construction module, used to obtain a first audio 3D code corresponding to a preset voice signal, encode the digital vector into the first audio 3D code, and obtain a second audio 3D code;
[0024] The signal sending module is used to convert the second audio three-dimensional code into a voice signal and send it to a sound receiving device.
[0025] A method for analyzing a control signal of a sound receiving device based on a dual-mode audio three-dimensional code, the method comprising:
[0026] Receiving the above-mentioned voice signal sent by the terminal;
[0027] The voice signal is converted to obtain a third audio three-dimensional code, and the third audio three-dimensional code is aligned with the pre-stored first audio three-dimensional code. If the alignment is successful, a digital vector is extracted from the third audio three-dimensional code;
[0028] The operation instruction is obtained by parsing according to the mapping relationship between the digital vector and the pre-stored digital vector and the operation instruction.
[0029] In one of the embodiments, it also includes: traversing the element values in the first audio 3D code and the third audio 3D code, and when the difference between the element values in the first audio 3D code and the third audio 3D code is less than a threshold, the alignment is successful.
[0030] In one of the embodiments, it also includes: obtaining a deviation value between the first audio 3D code and the third audio 3D code when the difference between the element values in the first audio 3D code and the third audio 3D code is less than a threshold; and extracting a digital vector from the third audio 3D code according to the deviation value.
[0031] In one of the embodiments, the method further includes: selecting a corresponding area in the third audio three-dimensional code for alignment with the first audio three-dimensional code based on the position parameter.
[0032] In one embodiment, the third audio 3D code F3 is further registered with the pre-stored first audio 3D code F1 according to a registration algorithm, and the registration algorithm is as follows:
[0033] f(a,b,c)=∑|F1(x,y,z)-F3(x+a,y+b,z+c)|
[0034] Among them, the element values of the third audio three-dimensional code F3 are traversed to find the deviation value (a0, b0, c0) that minimizes f(a, b, c). When f(a0, b0, c0) < th, the alignment is successful, and th is the threshold.
[0035] In one embodiment, the method further includes: if the registration is successful, extracting a data block from the third audio three-dimensional code by using an extraction algorithm, parsing the data block to obtain a digital vector, and the extraction algorithm is as follows:
[0036] D2=F3(s1+a0:s1+a0+w0-1,s1+b0:s1+b0+Nw0-1,s1+c0:s1+c0+w0-1)
[0037] Where D2 refers to the data block, s1 represents the position parameter, the length, width and height of each component in the digital vector are w0, and N represents the number of components.
[0038] In one embodiment, the method further includes: using a decoding algorithm to parse the data block to obtain a digital vector, and the decoding algorithm is as follows:
[0039]
[0040] Wherein, m3 represents the mean value of the elements in the first audio 3D code, vect2(i) represents a digital vector,
[0041] In one of the embodiments, the terminal is a mobile phone, a tablet computer or a wearable device.
[0042] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.
[0043] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.
[0044] The above-mentioned sound receiving device control method and device based on dual-mode audio 3D code, first of all, for the sound receiving device that can recognize voice signals, the method of using knobs or buttons for control is abandoned, and the operation instructions are digitally encoded to obtain a digital vector, and then the first audio 3D code corresponding to the voice signal is selected, and the digital vector is encoded into the first audio 3D code to obtain a second audio 3D code. Since controlling the digital vector will not change the voice signal output, the operation instruction is sent to the sound receiving device along with the voice signal. Secondly, since the sound receiving device itself can parse the voice signal, the control method of the present invention does not require modification of the sound receiving device and does not bring additional power consumption. It is particularly suitable for devices such as digital hearing aids that have high volume requirements and battery life requirements. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] Figure 1 is a schematic flow chart of a method for controlling a sound receiving device based on a dual-mode audio three-dimensional code in an embodiment;
[0046] Figure 2 It is a structural block diagram of a sound receiving device control device based on dual-mode audio three-dimensional code in one embodiment;
[0047] Figure 3 It is a schematic flow chart of a method for analyzing a control signal of a sound receiving device based on a dual-mode audio three-dimensional code in one embodiment;
[0048] Figure 4 It is a structural block diagram of a sound receiving device control signal parsing device based on dual-mode audio three-dimensional code in an embodiment. DETAILED DESCRIPTION
[0049] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0050] In one embodiment, Figure 1 As shown, a method for controlling a sound receiving device based on a dual-mode audio three-dimensional code is provided, comprising the following steps:
[0051] Step 102, receiving an operation instruction and encoding the operation instruction into a digital vector.
[0052] Operation instructions refer to instructions for operating the sound receiving device. Generally, the transmission method of operation instructions includes infrared transmission, that is, sending a digital sequence through an infrared transmitter, and the receiving device needs to parse the infrared signal to obtain the digital sequence, so as to identify the corresponding operation instruction. In addition, instructions can also be sent through the network, Bluetooth, etc., but for sound receiving devices without network or Bluetooth protocols, additional chips need to be set up to parse the network signal to obtain the operation instruction.
[0053] In the present invention, the operation instructions are directly encoded into digital vectors that can be recognized by a computer.
[0054] Step 104, obtaining a first audio 3D code corresponding to a preset voice signal, encoding the digital vector into the first audio 3D code, and obtaining a second audio 3D code.
[0055] The audio 3D code is essentially a spectrum representation of the sound signal. In the audio 3D code, the y-axis represents the frequency, the x-axis represents the time, and the z-axis represents the amplitude. The amplitude is represented by color, and the spectrum diagram can be used to view the energy distribution at the specified frequency end. In this embodiment, the audio 3D code is synthesized through dual-mode speech, including a control signal of a digital signal and an analog speech signal, thereby forming a dual-mode audio 3D code. The speech signal in the dual-mode audio 3D code constitutes the time dimension and the frequency dimension, and the digital vector constitutes the third dimension, that is, the amplitude dimension.
[0056] In this embodiment, the first audio 3D code selected may be an audio 3D code corresponding to a specified background sound, but a prerequisite is that the second audio 3D code obtained by encoding the digital vector into the first audio 3D code can easily separate the digital vector. For example, the digital vector is three signals of different frequencies. When the digital vector is added to the first audio 3D code, in the second audio 3D code, the digital vector is three line segments. Therefore, the digital vector can be easily parsed from the second audio 3D code to implement the corresponding operation.
[0057] Step 106: convert the second audio three-dimensional code into a voice signal and send it to a sound receiving device.
[0058] In the above-mentioned sound receiving device control method based on dual-mode audio 3D code, firstly, for the sound receiving device that can recognize voice signals, the control method of knob or button is abandoned, and the operation instruction is digitally encoded to obtain a digital vector, and then the first audio 3D code corresponding to the voice signal is selected, and the digital vector is encoded into the first audio 3D code to obtain a second audio 3D code. Since controlling the digital vector will not change the voice signal output, the operation instruction is sent to the sound receiving device along with the voice signal. Secondly, since the sound receiving device itself can parse the voice signal, the control method of the present invention does not require modification of the sound receiving device and does not bring additional power consumption. It is particularly suitable for devices with high volume requirements and battery life requirements such as digital hearing aids.
[0059] In one of the embodiments, since the audio three-dimensional code contains rich information, such as frequency information and amplitude information, this information can be used to better carry the digital vector, thereby achieving better control. In this embodiment, since the amplitude is reflected by color, a specific element value can be selected as a control indicator. Therefore, according to the control indicator and the preset control parameter, the grayscale value corresponding to the different elements in the digital vector is calculated, and the digital vector is encoded according to the grayscale value of the sound spectrogram corresponding to each element, and encoded into the first audio three-dimensional code to obtain the second audio three-dimensional code. In the embodiment of the present invention, by reasonably utilizing the information in the audio three-dimensional code and selecting appropriate control parameters, when encoding the digital vector into the first audio three-dimensional code, on the one hand, the environmental interference received by the second audio three-dimensional code when it is converted into a voice signal can be reduced. On the other hand, when it is encoded into the first audio three-dimensional code, the original voice signal will not be changed. For private devices, the concealment of the operation instruction operation is increased, that is, the operation can be achieved through a voice that may be unrelated to the operation instruction.
[0060] In one embodiment, the distribution information of the element value in the first audio 3D code is obtained, and two or more control indicators are determined based on the distribution information. The control indicators are determined based on the distribution information, such as selecting the maximum value, minimum value, average value, etc. of the element value. By analyzing the distribution information to determine the control indicators, the digital vector can be better encoded into the first audio 3D code.
[0061] In one embodiment, the maximum and minimum values of the element values are calculated according to the distribution information, and based on the maximum and minimum values, sampling is performed according to a preset step size to obtain multiple control values; and the control index is obtained based on the maximum, minimum and control values.
[0062] Specifically, the first audio three-dimensional code is represented by the maximum value m1, the minimum value m2, and the average value m3 of the elements in F1 (x, y, z), so the maximum value m1, the minimum value m2, and the average value m3 are selected as control indicators.
[0063] In another embodiment, the preset control parameter is used as the adjustment weight, and the control indexes are logically calculated, and the logical calculation results are weighted by the adjustment weight to obtain the grayscale values corresponding to different elements in the digital vector. In other words, the grayscale values corresponding to different elements in the digital vector are determined based on both the control parameter and the control index.
[0064] In one of the embodiments, the difference between the maximum value and the minimum value is calculated and multiplied by the control parameter to obtain the deviation information; addition and subtraction calculations are performed based on the average value and the deviation information to obtain the grayscale values of the sound spectrogram corresponding to different elements in the digital vector; wherein the grayscale values of the sound spectrogram corresponding to different elements in the digital vector are determined by controlling the size of the deviation information and the sign of the addition and subtraction calculations.
[0065] The specific formula is as follows: Calculate the grayscale value of the sound spectrogram corresponding to the number 0 in the binary vector vect:
[0066] g1=m3-α1×(m1-m2)
[0067] where α1∈(0.2,0.5) is a control parameter.
[0068] Calculate the grayscale value of the sound spectrogram corresponding to the number 1 in the binary vector vect:
[0069] g2=m3+α2×(m1-m2)
[0070] where α2∈(0.2,0.5) is a control parameter.
[0071] In one of the embodiments, the digital vector codes are spliced according to the grayscale value of the sound spectrogram corresponding to each element therein to obtain an audio 3D code segment; the audio 3D code segment is inserted into the first audio 3D code to obtain a second audio 3D code.
[0072] Specifically, let the length of the digital vector vect be N. Each component of the digital vector vect generates an audio 3D code fragment of size w0×w0×w0, w0∈[1,10]. When the component is 0, the corresponding sound spectrogram grayscale value is g1, and when the component is 1, the corresponding sound spectrogram grayscale value is g2. Then, these data blocks are spliced together horizontally in order to obtain an audio 3D code fragment D(x,y,z) of size w0×Nw0×w0.
[0073] In one of the embodiments, a preset position parameter is obtained, and based on the position parameter, the audio three-dimensional code segment is inserted into a position corresponding to the position parameter in the first audio three-dimensional code to obtain a second audio three-dimensional code.
[0074] In this embodiment, the data D(x, y, z) is directly assigned to the middle and rear position of the audio 3D code F(x, y, z) to obtain a new audio 3D code:
[0075] F2(s1:s1+w0-1,s1:s1+Nw0-1,s1:s1+w0-1)=D
[0076] in It is a parameter about position.
[0077] In one of the embodiments, the second audio three-dimensional code is subjected to inverse Fourier transform to obtain a voice signal; and the voice signal is sent to a sound receiving device as a command control signal.
[0078] In one embodiment, the sound receiving device is a hearing aid or a digital hearing aid. The new voice signal E2 is played out through the mobile control terminal so that the sound receiving device receives the signal and performs control.
[0079] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.
[0080] In one embodiment, a sound receiving device control apparatus based on a dual-mode audio three-dimensional code is provided, comprising: an instruction receiving module 202 , an audio three-dimensional code construction module 204 and a signal sending module 206 .
[0081] An instruction receiving module 202, used for receiving an operation instruction and encoding the operation instruction into a digital vector;
[0082] The audio 3D code construction module 204 is used to obtain a first audio 3D code corresponding to a preset voice signal, encode the digital vector into the first audio 3D code, and obtain a second audio 3D code;
[0083] The signal sending module 206 is used to convert the second audio three-dimensional code into a voice signal and send it to a sound receiving device.
[0084] For the specific definition of the sound receiving device control device based on the dual-mode audio three-dimensional code, please refer to the definition of the sound receiving device control method based on the dual-mode audio three-dimensional code above, which will not be repeated here. Each module in the above-mentioned sound receiving device control device based on the dual-mode audio three-dimensional code can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0085] In one embodiment, a method for parsing a sound receiving device control signal based on a dual-mode audio 3D code is also provided, corresponding to the above-mentioned method for controlling a sound receiving device based on a dual-mode audio 3D code, comprising the following steps:
[0086] Step 302: Receive a voice signal sent by a terminal.
[0087] Step 304: convert the voice signal to obtain a third audio three-dimensional code, align the third audio three-dimensional code with the pre-stored first audio three-dimensional code, and if the alignment is successful, extract a digital vector from the third audio three-dimensional code.
[0088] Step 306: parse and obtain the operation instruction according to the digital vector and the pre-stored mapping relationship between the digital vector and the operation instruction.
[0089] In one embodiment, the element values in the first audio 3D code and the third audio 3D code are traversed, and when the sum of the difference between the element values in the first audio 3D code and the third audio 3D code is less than a threshold, the registration is successful.
[0090] In another embodiment, when the difference between the element values in the first audio three-dimensional code and the third audio three-dimensional code is less than a threshold, the deviation value of the first audio three-dimensional code and the third audio three-dimensional code is obtained; and a digital vector is extracted from the third audio three-dimensional code according to the deviation value.
[0091] In yet another embodiment, based on the position parameter, a corresponding area in the third audio three-dimensional code is selected for registration with the first audio three-dimensional code.
[0092] Specifically, the third audio three-dimensional code F3 and the pre-stored first audio three-dimensional code F1 are registered according to a registration algorithm, and the registration algorithm is as follows:
[0093] f(a,b,c)=∑|F1(x,y,z)-F3(x+a,y+b,z+c)|
[0094] Among them, the element values of the third audio three-dimensional code F3 are traversed to find the deviation value (a0, b0, c0) that minimizes f(a, b, c). When f(a0, b0, c0) < th, the alignment is successful, and th is the threshold.
[0095] In addition, if the registration is successful, the data block is extracted from the third audio 3D code through an extraction algorithm, and the data block is parsed to obtain a digital vector. The extraction algorithm is as follows:
[0096] D2=F3(s1+a0:s1+a0+w0-1,s1+b0:s1+b0+Nw0-1,s1+c0:s1+c0+w0-1)
[0097] Where D2 refers to the data block, s1 represents the position parameter, the length, width and height of each component in the digital vector are w0, and N represents the number of components.
[0098] In one embodiment, parsing the data block to obtain the digital vector includes:
[0099] The data block is parsed using a decoding algorithm to obtain a digital vector. The decoding algorithm is as follows:
[0100]
[0101] Wherein, m3 represents the mean value of the elements in the first audio 3D code, vect2(i) represents a digital vector,
[0102] In one embodiment, the terminal is a mobile phone, a tablet computer or a wearable device.
[0103] It should be understood that although Figure 3 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 3 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.
[0104] In one embodiment, a sound receiving device control signal parsing device based on a dual-mode audio three-dimensional code is provided, the device comprising:
[0105] The voice receiving module 402 is used to receive the voice signal sent by the terminal;
[0106] The registration module 404 is used to convert the voice signal to obtain a third audio 3D code, and register the third audio 3D code with the pre-stored first audio 3D code. If the registration is successful, a digital vector is extracted from the third audio 3D code.
[0107] The parsing module 406 is used to parse and obtain the operation instruction according to the digital vector and the pre-stored mapping relationship between the digital vector and the operation instruction.
[0108] For the specific definition of the sound receiving device control device based on the dual-mode audio three-dimensional code, please refer to the definition of the sound receiving device control method based on the dual-mode audio three-dimensional code above, which will not be repeated here. Each module in the above-mentioned sound receiving device control device based on the dual-mode audio three-dimensional code can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0109] In one of the embodiments, a sound receiving device control system based on a dual-mode audio three-dimensional code is provided, and the system includes: a terminal receives an operation instruction and encodes the operation instruction into a digital vector, obtains a first audio three-dimensional code corresponding to a preset voice signal, encodes the digital vector into the first audio three-dimensional code, obtains a second audio three-dimensional code, converts the second audio three-dimensional code into a voice signal and sends it to a sound receiving device; the sound receiving device receives the voice signal sent by the terminal; converts the voice signal to obtain a third audio three-dimensional code, aligns the third audio three-dimensional code with the pre-stored first audio three-dimensional code, and if the alignment is successful, extracts the digital vector from the third audio three-dimensional code; and parses the operation instruction according to the mapping relationship between the digital vector and the pre-stored digital vector and the operation instruction.
[0110] For the specific definition of the sound receiving device control signal analysis device based on the dual-mode audio three-dimensional code, please refer to the definition of the sound receiving device control signal analysis method based on the dual-mode audio three-dimensional code above, which will not be repeated here. Each module in the above-mentioned sound receiving device control signal analysis device based on the dual-mode audio three-dimensional code can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0111] In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for parsing a control signal of a sound receiving device based on a dual-mode audio three-dimensional code is implemented. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
[0112] Those skilled in the art will appreciate that the structures of the above-mentioned embodiments are merely partial structures related to the scheme of the present application, and do not constitute limitations on the computer device to which the scheme of the present application is applied. The specific computer device may include more or fewer components, or combine certain components, or have a different arrangement of components.
[0113] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method in the above embodiment when executing the computer program.
[0114] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method in the above embodiment are implemented.
[0115] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0116] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0117] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A method for controlling a sound receiving device based on a dual-mode audio three-dimensional code, characterized in that: The method comprises: Receiving an operation instruction and encoding the operation instruction into a digital vector; Obtaining a first audio 3D code corresponding to a preset voice signal, encoding the digital vector into the first audio 3D code, and obtaining a second audio 3D code; Convert the second audio 3D code into a voice signal and send it to a sound receiving device; Encoding the digital vector into the first audio 3D code to obtain a second audio 3D code includes: Selecting a control indicator corresponding to an element value from the first audio three-dimensional code; According to the control index and the preset control parameters, the grayscale values of the sound spectrogram corresponding to different elements in the digital vector are calculated; The digital vector is encoded into the first audio 3D code according to the grayscale value of the sound spectrogram corresponding to each element thereof, so as to obtain the second audio 3D code.
2. The method according to claim 1, characterized in that The control indicator corresponding to the element value selected from the first audio three-dimensional code includes: Obtaining distribution information of element values in the first audio three-dimensional code; According to the distribution information, more than two control indicators are determined.
3. The method according to claim 2, characterized in that According to the distribution information, more than two control indicators are determined, including: According to the distribution information, the maximum value and the minimum value of the element value are calculated, and according to the maximum value and the minimum value, sampling is performed according to a preset step length to obtain a plurality of control values; A control index is obtained according to the maximum value, the minimum value and the control value.
4. The method according to claim 2, characterized in that: According to the distribution information, more than two control indicators are determined, including: Calculate the maximum value, minimum value and average value of the element value according to the distribution information; The maximum value, minimum value and average value are used as control indicators.
5. The method according to claim 3, characterized in that: According to the control index and the preset control parameters, the grayscale values of the sound spectrogram corresponding to different elements in the digital vector are calculated, including: The preset control parameters are used as adjustment weights, and logical calculations are performed between the control indicators. The logical calculation results are weighted by adjusting the weights to obtain the grayscale values of the sound spectrogram corresponding to different elements in the digital vector.
6. The method according to claim 4, characterized in that According to the control index and the preset control parameters, the grayscale values of the sound spectrogram corresponding to different elements in the digital vector are calculated, including: Calculating a difference between the maximum value and the minimum value, and multiplying the difference by the control parameter to obtain deviation information; Addition and subtraction calculations are performed based on the average value and the deviation information to obtain the grayscale values of the sound spectrogram corresponding to different elements in the digital vector; wherein the grayscale values corresponding to different elements in the digital vector are determined by controlling the size of the deviation information and the signs of the addition and subtraction calculations.
7. The method according to claim 1, characterized in that The digital vector is encoded into the first audio 3D code according to the grayscale value of the sound spectrogram corresponding to each element thereof to obtain the second audio 3D code, including: The digital vectors are concatenated according to the grayscale value of the sound spectrogram corresponding to each element thereof to obtain an audio three-dimensional code segment; The audio 3D code segment is inserted into the first audio 3D code to obtain a second audio 3D code.
8. The method according to claim 7, characterized in that Inserting the audio 3D code segment into the first audio 3D code to obtain a second audio 3D code includes: A preset position parameter is obtained, and according to the position parameter, the audio 3D code segment is inserted into a position corresponding to the position parameter in the first audio 3D code to obtain a second audio 3D code.
9. The method according to any one of claims 1 to 8, characterized in that: Converting the second audio three-dimensional code into a voice signal and sending it to a sound receiving device includes: Performing inverse Fourier transform on the second audio 3D code to obtain a speech signal; The voice signal is sent to the sound receiving device as a command control signal.
10. The method according to any one of claims 1 to 8, characterized in that: The sound receiving device is a hearing aid.
11. A sound receiving device control device based on dual-mode audio three-dimensional code, characterized in that: The device comprises: An instruction receiving module, used for receiving an operation instruction and encoding the operation instruction into a digital vector; An audio 3D code construction module, used to obtain a first audio 3D code corresponding to a preset voice signal, encode the digital vector into the first audio 3D code, and obtain a second audio 3D code; A signal sending module, used for converting the second audio three-dimensional code into a voice signal and sending it to a sound receiving device; The audio 3D code construction module is also used to select a control indicator corresponding to an element value from the first audio 3D code; calculate the grayscale values of the sound spectrogram corresponding to different elements in the digital vector according to the control indicator and preset control parameters; encode the digital vector into the first audio 3D code according to the grayscale value of the sound spectrogram corresponding to each element therein, to obtain a second audio 3D code.
12. A method for analyzing control signals of a sound receiving device based on a dual-mode audio three-dimensional code, characterized in that: The method comprises: A voice signal according to any one of claims 1 to 10 sent by a receiving terminal; The voice signal is converted to obtain a third audio three-dimensional code, and the third audio three-dimensional code is aligned with the pre-stored first audio three-dimensional code. If the alignment is successful, a digital vector is extracted from the third audio three-dimensional code; The operation instruction is obtained by parsing according to the mapping relationship between the digital vector and the pre-stored digital vector and the operation instruction.
13. The method according to claim 12, characterized in that The registering the third audio three-dimensional code with the pre-stored first audio three-dimensional code includes: The element values in the first audio 3D code and the third audio 3D code are traversed, and when the sum of the differences between the element values in the first audio 3D code and the third audio 3D code is less than a threshold, the registration is successful.
14. The method according to claim 13, characterized in that If the registration is successful, extracting a digital vector from the third audio 3D code includes: Obtaining a deviation value between the first audio 3D code and the third audio 3D code when the sum of the differences of the element values in the first audio 3D code and the third audio 3D code is less than a threshold; A digital vector is extracted from the third audio 3D code according to the deviation value.
15. The method according to claim 14, characterized in that The method further comprises: According to the position parameters, a corresponding area in the third audio three-dimensional code is selected for alignment with the first audio three-dimensional code.
16. The method according to claim 15, characterized in that Aligning the third audio three-dimensional code with the pre-stored first audio three-dimensional code includes: According to the registration algorithm, the third audio three-dimensional code and the pre-stored first audio 3D code Perform registration, the registration algorithm is as follows: Wherein, y represents frequency, x represents time, and z represents amplitude. The third audio 3D code is traversed. The element value of is found by Minimum deviation value ,when When , the registration is successful. th is the threshold value.
17. The method according to claim 16, characterized in that If the registration is successful, extracting a digital vector from the third audio 3D code includes: If the registration is successful, a data block is extracted from the third audio 3D code through an extraction algorithm, and the data block is parsed to obtain a digital vector. The extraction algorithm is as follows: Among them, D2 refers to the data block, s1 Represents position parameters, the length, width, and height of each component in the numeric vector are , N Indicates the number of components.
18. The method according to claim 17, characterized in that Parse the data block to get a numeric vector, including: The data block is parsed using a decoding algorithm to obtain a digital vector. The decoding algorithm is as follows: in, m3 represents the mean value of the elements in the first audio 3D code, represents a numeric vector, , .
19. The method according to any one of claims 12 to 18, characterized in that The terminal is a mobile phone, a tablet computer or a wearable device.
20. A sound receiving device control signal parsing device based on dual-mode audio three-dimensional code, characterized in that: The device comprises: A voice receiving module, used to receive the voice signal according to any one of claims 1 to 10 sent by a terminal; A registration module, configured to convert the voice signal to obtain a third audio three-dimensional code, register the third audio three-dimensional code with the pre-stored first audio three-dimensional code, and if the registration is successful, extract a digital vector from the third audio three-dimensional code; The parsing module is used to parse and obtain the operation instruction according to the mapping relationship between the digital vector and the pre-stored digital vector and the operation instruction.
21. A sound receiving device control signal analysis system based on dual-mode audio three-dimensional code, characterized in that: The system comprises: The terminal receives the operation instruction and encodes the operation instruction into a digital vector, obtains a first audio 3D code corresponding to a preset voice signal, encodes the digital vector into the first audio 3D code, obtains a second audio 3D code, converts the second audio 3D code into a voice signal and sends it to a sound receiving device; Encoding the digital vector into the first audio 3D code to obtain a second audio 3D code, including: selecting a control indicator corresponding to an element value from the first audio 3D code; calculating the grayscale values of the sound spectrogram corresponding to different elements in the digital vector according to the control indicator and preset control parameters; encoding the digital vector into the first audio 3D code according to the grayscale value of the sound spectrogram corresponding to each element thereof, to obtain a second audio 3D code; The sound receiving device receives the voice signal sent by the terminal; converts the voice signal to obtain a third audio three-dimensional code, and aligns the third audio three-dimensional code with the pre-stored first audio three-dimensional code. If the alignment is successful, a digital vector is extracted from the third audio three-dimensional code; according to the mapping relationship between the digital vector and the pre-stored digital vector and the operation instruction, the operation instruction is parsed to obtain the operation instruction.
22. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 or the method according to any one of claims 12 to 19 are implemented.
23. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 or the method according to any one of claims 12 to 19 are implemented.
