Audio three-dimensional code encoding method and decoding method

By using audio 3D code encoding, the problem of decoding errors in remote hearing aid fitting was solved, achieving efficient transmission of fitting information and improving the accuracy of fitting.

CN117457010BActive Publication Date: 2026-11-06HUNAN XINHAILING SEMICON CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310174896.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-27
Publication Date
2026-11-06
Estimated Expiration
2043-02-27

AI Technical Summary

Technical Problem

In existing remote hearing aid fitting solutions, decoding errors are prone to occur during the transmission of fitting information, leading to transmission failures and affecting the fitting results.

Method used

The audio 3D code encoding method is adopted. It receives operation instructions and converts them into digital vectors of a preset number of bits. It applies a difference elimination algorithm to eliminate differences, obtains audio 3D codes, classifies them into level indicators, and generates sound control signals for transmission.

Benefits of technology

It improved the decoding accuracy of fitting information, reduced transmission errors, and improved the accuracy of remote fitting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117457010B_ABST
    Figure CN117457010B_ABST
Patent Text Reader

Abstract

This application relates to an audio 3D code encoding and decoding method. The method includes: receiving an operation command and encoding the operation command into a first digital vector; converting the first digital vector into a second digital vector of a preset number of bits; performing difference elimination on the second digital vector to obtain a third digital vector; acquiring a first audio 3D code corresponding to a preset speech signal; dividing the first audio 3D code; selecting a sub-image from the division result for value range division to obtain a level index; and calculating the number of pixels corresponding to each level index based on the third digital vector; converting the sub-image into a processed sub-image based on the level index and the number of pixels corresponding to each level; generating a second audio 3D code based on the processed sub-image and other sub-images from the division result; and converting the second audio 3D code into a sound control signal and sending it to a sound receiving device. This can significantly improve the decoding accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an audio three-dimensional code encoding and decoding method. Background Technology

[0002] Under current medical conditions, hearing aids have become the primary means of treating and correcting hearing loss in patients. However, hearing aid fitting is affected by many factors, including differences in the technical expertise of different hearing aid fitting institutions and the inconvenience of patients needing to make multiple trips to the fitting institution for hearing aid adjustments. These are practical difficulties in hearing aid fitting. In recent years, the development of internet technology and various functions of hearing aids has made it possible for hearing-impaired individuals to obtain hearing aid fitting services without leaving their homes.

[0003] However, existing remote fitting methods have various shortcomings. Regarding the input of fitting results into the hearing aid, current solutions generally use wired or Bluetooth transmission. This requires the hearing aid to be equipped with corresponding communication devices, which hinders the widespread use of hearing aids. Recently, a new technical solution has been proposed, using a three-dimensional audio method to transmit various control commands to the hearing aid. The encoding and decoding part is relatively simple, suitable only for short binary vectors. However, fitting information is much longer than ordinary control command information; that is, the length of the binary vector representing fitting information is much greater than that of the control commands. Using the existing simple encoding and decoding methods will introduce a large number of decoding errors, leading to mistransmission of fitting information. Summary of the Invention

[0004] Therefore, it is necessary to provide an audio 3D code encoding and decoding method that can solve the problem of mismatch information transmission errors, in order to address the aforementioned technical issues.

[0005] An audio 3D code encoding method, the method comprising: Receive an operation instruction and encode the operation instruction into a first digital vector, then convert the first digital vector into a second digital vector with a preset number of bits; According to a pre-set difference elimination algorithm, the second digital vector is subjected to difference elimination to obtain the third digital vector; Obtain the first audio three-dimensional code corresponding to the preset speech signal, divide the first audio three-dimensional code, select a sub-image from the division result to divide the value range, obtain the level index, and calculate the number of pixels corresponding to each level index according to the third digital vector; wherein, the number of levels of the level index is the same as the number of bits of the third digital vector. Based on the level index and the number of pixels corresponding to the level, the sub-image is transformed into a processed sub-image; Based on the processed subgraph and other subgraphs in the partitioning result, a second audio 3D code is generated; The second audio 3D code is converted into a sound control signal and sent to the sound receiving device.

[0006] In one embodiment, the first digital vector is a binary vector; the second digital vector is a decimal vector; and the method further includes: converting the binary first digital vector into a decimal second digital vector with a preset number of bits.

[0007] In one embodiment, the method further includes: dividing the first number vector into groups of the preset number of digits, converting each group into a decimal number, and obtaining a second decimal number vector of the preset number of digits.

[0008] In one embodiment, the method further includes: performing difference elimination on the second digital vector according to a pre-set difference elimination algorithm to obtain a third digital vector. ; in, For control parameters, This represents the i-th digit in the second numeric vector. This represents the i-th digit in the third digit vector. The preset number of bits is 32.

[0009] In one embodiment, the method further includes: obtaining the maximum and minimum values ​​in the subgraph, dividing the intervals of the maximum and minimum values ​​into levels of the preset number of bits, and obtaining a level index.

[0010] In one embodiment, the method further includes: calculating the number of pixels corresponding to each level indicator based on the third digital vector. ; in, This represents the number of pixels corresponding to the i-th level indicator. This represents the i-th digit in the third digit vector. The image size of the first spectrogram is represented by W, where W represents the width, H represents the height, and K represents the length.

[0011] In one embodiment, the method further includes: reassigning the pixel value according to the level index to which the value of each pixel in the sub-image falls, to obtain the processed sub-image.

[0012] In one embodiment, the method further includes: randomly selecting a number of pixels from the sub-image, assigning the pixel a value corresponding to a level index, and repeating this process 32 times to obtain the processed sub-image.

[0013] An audio 3D code encoding device, the device comprising: The vector encoding module is used to receive operation instructions and encode the operation instructions into a first digital vector, and convert the first digital vector into a second digital vector with a preset number of bits; The difference elimination module is used to perform difference elimination on the second digital vector according to a pre-set difference elimination algorithm to obtain a third digital vector; The vector fusion module is used to obtain a first audio 3D code corresponding to a preset speech signal, divide the first audio 3D code, select a sub-image from the division result for value range division to obtain a level index, and calculate the number of pixels corresponding to each level index based on the third digital vector; wherein, the number of levels of the level index is the same as the number of bits of the third digital vector; and convert the sub-image into a processed sub-image based on the level index and the number of pixels corresponding to the level. The sending module is used to generate a second audio 3D code based on the processed sub-graph and other sub-graphs in the partitioning result; and to convert the second audio 3D code into a sound control signal and send it to the sound receiving device.

[0014] An audio 3D code decoding method, the method comprising: The aforementioned sound control signal is sent by the receiving terminal; The speech signal is converted to obtain a third audio three-dimensional code. The third audio three-dimensional code is registered with a pre-stored first audio three-dimensional code. If the registration is successful, a fourth digital vector is extracted from the third audio three-dimensional code. The operation instructions are obtained by parsing the fourth digital vector and the pre-stored mapping relationship between digital vectors and operation instructions.

[0015] In one embodiment, the method further includes: traversing the element values ​​in the first audio 3D code and the third audio 3D code; when the sum of the differences between the element values ​​in the first audio 3D code and the third audio 3D code is less than a threshold, the registration is successful and a registration point is obtained.

[0016] In one embodiment, the method further includes: extracting a fourth digital vector based on the third audio 3D code and the registration point.

[0017] In one embodiment, it further includes: Based on the third audio 3D code and the registration point, the spectrogram carrying the verification information is obtained as follows: ; In this context, R4 represents the spectrogram carrying matching information, and F3 represents the third spectrogram. Indicate the registration point; The number of pixels at each value level in the spectrogram carrying matching information is: ; in, This represents the number of pixels at each value level in the spectrogram carrying matching information. This indicates the value corresponding to each level. This represents a logical operator, where a value of 1 is assigned if the pairs are equal, and 0 is assigned otherwise. ; Based on the number of pixels at each value level in the spectrogram carrying matching information, the fifth vector is determined as follows: ; in, This represents the i-th element in the fifth vector; Based on the fifth vector, the sixth vector is calculated as follows: ; in, This represents the i-th element in the sixth vector; The sixth vector is converted into a binary vector to obtain the fourth vector.

[0018] A computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the above-described method.

[0019] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the above-described method.

[0020] The aforementioned audio 3D code encoding and decoding methods, firstly, no longer simply assign values ​​to each component of the image. This is because the value of each component is no longer limited to 0 or 1 as in traditional techniques. In the second digital vector of this invention, each component is independent, and their values ​​may differ significantly, be very similar, or even be equal. Direct assignment would lead to errors in the calculation of the position of any component during decoding, resulting in errors in the calculation of all subsequent components, thus greatly reducing the decoding accuracy. To solve this problem, this invention employs a new statistical method for encoding. During decoding, it is not necessary to calculate the position of each component; only statistical analysis of the entire image is required, greatly improving the decoding accuracy. Attached Figure Description

[0021] Figure 1 This is a schematic flowchart of a sound receiving device control method based on dual-mode audio three-dimensional code in one embodiment; Figure 2This is a structural block diagram of a sound receiving device control apparatus based on dual-mode audio 3D codes in one embodiment; Figure 3 This is a schematic flowchart illustrating a method for parsing control signals of a sound receiving device based on dual-mode audio three-dimensional codes in one embodiment. Figure 4 This is a structural block diagram of a control signal parsing device for a sound receiving device based on dual-mode audio three-dimensional codes in one embodiment. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0023] It is worth noting that the sound receiving device in this invention can be a hearing aid or other sound receiving device, and the receiving terminal refers to a terminal, wearable device, etc.

[0024] In one embodiment, such as Figure 1 As shown, an audio 3D code encoding method is provided, including the following steps: Step 102: Receive the operation instruction and encode the operation instruction into a first digital vector, and convert the first digital vector into a second digital vector with a preset number of bits.

[0025] Operation commands refer to instructions for operating the sound receiving device. Common methods for sending operation commands include infrared transmission, where a digital sequence is sent via an infrared transmitter. The receiving device needs to analyze the infrared signal to obtain the digital sequence and thus identify the corresponding operation command. Alternatively, commands can be sent via network, Bluetooth, etc. However, for sound receiving devices without network or Bluetooth protocols, an additional chip is required to analyze network signals to obtain the operation commands.

[0026] In this invention, the operation instructions are directly encoded into a first digital vector that can be recognized by a computer. This means that, generally speaking, the first digital vector is a binary vector. In this step, the first digital vector is further converted into a vector with a higher base. Therefore, the second digital vector can be a decimal vector or a hexadecimal vector.

[0027] Step 104: Perform difference elimination on the second digital vector according to the pre-set difference elimination algorithm to obtain the third digital vector.

[0028] Because of the number system, there are significant differences between the bits. Therefore, a difference elimination algorithm is used to eliminate the differences between the bits in the second number vector.

[0029] Step 106: Obtain the first audio three-dimensional code corresponding to the preset speech signal, divide the first audio three-dimensional code, select a sub-image from the division result to divide the value range, obtain the level index, and calculate the number of pixels corresponding to each level index based on the third digital vector.

[0030] Division refers to dividing the audio 3D code into regions, such as dividing it into two equal parts (upper and lower) or four equal parts. The division is based on retaining the registration part and storing the verification information part. The specific division can be determined according to the requirements. The level index has the same number of bits as the third digital vector. The choice of the number of bits corresponds to the design requirements. The higher the number of bits, the higher the reliability. Conversely, the longer the processing time and the lower the recognition success rate, the higher the reliability. Therefore, the number of bits can be designed according to the actual needs of the project. For example, if the design number of bits is 32, the third digital vector will be a 32-bit vector after conversion. Therefore, after determining the value range, it can be divided into 32 equal parts to obtain 32 levels, thus obtaining the level index.

[0031] Step 108: Based on the level index and the number of pixels corresponding to the level, convert the sub-image into a processed sub-image.

[0032] Step 110: Based on the processed subgraph and other subgraphs in the partitioning result, generate a second audio 3D code, and convert the second audio 3D code into a sound control signal to send to the sound receiving device.

[0033] Audio 3D codes are essentially spectral representations of sound signals. In an audio 3D code, the y-axis represents frequency, the x-axis represents time, and the z-axis represents amplitude. Amplitude is represented by color, and the energy distribution at a specified frequency can be viewed using a spectrogram. In this embodiment, the audio 3D code is constructed through dual-mode speech synthesis, including digital control signals and analog speech signals. The speech signals in the dual-mode audio 3D code form the time and frequency dimensions, while the digital vectors form the third dimension, namely the amplitude dimension.

[0034] In this embodiment, the selection of the first audio 3D code can be the audio 3D code corresponding to a specified background sound. However, a prerequisite is that the second audio 3D code obtained by encoding the digital vector into the first audio 3D code can easily separate the digital vector. For example, if the digital vector is three signals of different frequencies, when the digital vector is added to the first audio 3D code, the digital vector in the second audio 3D code is three line segments. Therefore, the digital vector can be easily parsed from the second audio 3D code, thereby realizing the corresponding operation.

[0035] In the aforementioned audio 3D code encoding method, firstly, the method no longer simply assigns each component to the image. This is because the value of each component is no longer limited to 0 or 1 as in traditional techniques. In the second digital vector of this invention, each component is independent, and their values ​​may differ significantly, be very similar, or even be equal. Direct assignment would lead to errors in the calculation of the position of any component during decoding, resulting in errors in the calculation of all subsequent components, thus greatly reducing the decoding accuracy. To solve this problem, this invention employs a new statistical method for encoding. During decoding, it is not necessary to calculate the position of each component; only statistical analysis of the entire image is required, greatly improving the decoding accuracy.

[0036] In one embodiment, since the audio 3D code contains rich information, such as frequency and amplitude information, this information can be used to better carry the digital vector, thereby achieving better control. In this embodiment, to further reduce the amount of computation, the binary first digital vector is converted into a decimal second digital vector.

[0037] In one embodiment, the first digital vector is divided into groups of a predetermined number of bits, and each group is converted into a decimal number to obtain a second decimal digital vector of the predetermined number of bits. Specifically, the predetermined number of groups determines the number of bits in the second digital vector; for example, dividing it into 32 groups results in a 32-bit second digital vector.

[0038] In one embodiment, since the differences between the components in the second digital vector are too large, difference elimination is required. Specifically, the second digital vector is subjected to difference elimination according to a pre-set difference elimination algorithm to obtain the third digital vector: ; in, For control parameters, This represents the i-th digit in the second numeric vector. This represents the i-th digit in the third digit vector. The default bit depth is 32.

[0039] In one embodiment, the first spectrogram Divide into two subgraphs and The formula is as follows: ; The formation process of the first spectrogram is as follows: Select a segment of speech signal. As the basic speech signal, specific language signals After framing, windowing, and discrete Fourier transform, a three-dimensional spectrogram can be obtained, denoted as... Where x is time, y is frequency, z is amplitude, and the image size is [image size not specified]. .

[0040] In one embodiment, the maximum and minimum values ​​in the subgraph are obtained, and the intervals of the maximum and minimum values ​​are divided into levels with a preset number of bits to obtain level indicators.

[0041] Specifically, statistics The range of values ​​is used to obtain the maximum value. and minimum value The values ​​are divided into 32 levels, and each level has a value of as follows: ; In one embodiment, the number of pixels corresponding to each level indicator is calculated based on the third digital vector as follows: ; in, This represents the number of pixels corresponding to the i-th level indicator. It represents the i-th bit of the third digit vector.

[0042] In one embodiment, the pixels are reassigned according to the level index to which each pixel value falls in the sub-image, resulting in a processed sub-image. The specific steps are as follows: 1. Order ,exist Random selection The number of points, reassigned to ; 2. Order ,exist Randomly select from the pixels that have not yet been reassigned The number of points, assign it a value ; 3. When If the loop is complete, otherwise proceed to step 2; 4. Using sub-images and Synthesize new spectrograms The formula is as follows:

[0043] It should be understood that, although Figure 1 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 1At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0044] In one embodiment, an audio 3D code encoding device is provided, including: a vector encoding module 202, a difference elimination module 204, a vector fusion module 206, and a transmission module 208.

[0045] Vector encoding module 202 is used to receive operation instructions and encode the operation instructions into a first digital vector, and convert the first digital vector into a second digital vector with a preset number of bits; The difference elimination module 204 is used to perform difference elimination on the second digital vector according to a pre-set difference elimination algorithm to obtain a third digital vector; The vector fusion module 206 is used to acquire a first audio three-dimensional code corresponding to a preset speech signal, divide the first audio three-dimensional code, select a sub-image from the division result for value range division to obtain a level index, and calculate the number of pixels corresponding to each level index based on the third digital vector; wherein, the number of levels of the level index is the same as the number of bits of the third digital vector; and convert the sub-image into a processed sub-image based on the level index and the number of pixels corresponding to the level. The sending module 208 is used to generate a second audio three-dimensional code based on the processed sub-graph and other sub-graphs in the partitioning result; and to convert the second audio three-dimensional code into a sound control signal and send it to the sound receiving device.

[0046] Specific limitations regarding the audio 3D code encoding device can be found in the limitations of the audio 3D code encoding method above, and will not be repeated here. Each module in the aforementioned audio 3D code encoding device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in a computer device, or stored in software in the memory of a computer device, so that the processor can call and execute the corresponding operations of each module.

[0047] In one embodiment, an audio 3D code decoding method is also provided, corresponding to the above-described audio 3D code encoding method, comprising the following steps: Step 302: Receive the voice control signal sent by the terminal.

[0048] Step 304: Convert the speech signal to obtain the third audio three-dimensional code, register the third audio three-dimensional code with the pre-stored first audio three-dimensional code, and if the registration is successful, extract the fourth digital vector from the third audio three-dimensional code.

[0049] Step 306: Based on the mapping relationship between the fourth digital vector and the pre-stored digital vector and operation instructions, the operation instructions are parsed and obtained.

[0050] In one embodiment, the element values ​​in the first audio 3D code and the third audio 3D code are traversed. When the sum of the differences between the element values ​​in the first audio 3D code and the third audio 3D code is less than a threshold, the registration is successful and the registration point is obtained.

[0051] Specifically, after receiving the voice control signal, a three-dimensional spectrogram can be obtained through framing, windowing, and discrete Fourier transform, denoted as: .

[0052] During registration, the two spectrograms will be... and Registration is performed using only information from the first half of the image; the calculation formula is as follows: (6) Find the command by traversing the pixels. smallest And need ,in It is a pre-set threshold, if If so, then the registration failure process ends here.

[0053] In one embodiment, if registration is successful, a fourth digital vector is extracted based on the third audio 3D code and the registration point.

[0054] Specifically, based on the third audio 3D code and the registration point, the spectrogram carrying the verification information is obtained as follows: ; In this context, R4 represents the spectrogram carrying matching information, and F3 represents the third spectrogram. Indicate the registration points; count the number of pixels at each value level in the spectrogram carrying matching information: ; in, This represents the number of pixels at each value level in the spectrogram carrying matching information. This indicates the value corresponding to each level. This represents a logical operator, where a value of 1 is assigned if the pairs are equal, and 0 is assigned otherwise. Based on the number of pixels at each value level in the spectrogram carrying matching information, the fifth vector is determined as follows: ; in, Let represent the i-th element in the fifth vector; based on the fifth vector, the sixth vector is calculated as follows: ; in, This represents the i-th bit in the sixth vector; converting the sixth vector into a binary vector yields the fourth vector.

[0055] It should be understood that, although Figure 3 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 3 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0056] In one embodiment, an audio 3D code decoding device is provided, the device comprising: The voice receiving module 402 is used to receive voice control signals sent by the terminal; The registration module 404 is used to convert the speech signal to obtain a third audio three-dimensional code, register the third audio three-dimensional code with a pre-stored first audio three-dimensional code, and if the registration is successful, extract a fourth digital vector from the third audio three-dimensional code. The parsing module 406 is used to parse the operation instructions according to the fourth digital vector and the pre-stored mapping relationship between digital vectors and operation instructions.

[0057] For specific limitations regarding the audio 3D code decoding device, please refer to the limitations of the audio 3D code decoding method above, which will not be repeated here. Each module in the aforementioned audio 3D code decoding device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in a computer device, or stored in software in the memory of a computer device, so that the processor can call and execute the corresponding operations of each module.

[0058] In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, memory, a network interface, a display screen, and an input device connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, it implements an audio 3D code decoding method. The display screen may be a liquid crystal display (LCD) or an e-ink display. The input device may be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.

[0059] Those skilled in the art will understand that the above structure does not constitute a limitation on the computer device to which the present application solution is applied. A specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0060] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, the processor executing the computer program to implement the steps of the method described above.

[0061] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described above.

[0062] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0063] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0064] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. An audio three-dimensional code encoding method, characterized in that, The method includes: Receive an operation instruction and encode the operation instruction into a first digital vector, then convert the first digital vector into a second digital vector with a preset number of bits; According to a pre-set difference elimination algorithm, the second digital vector is subjected to difference elimination to obtain the third digital vector; Obtain the first audio three-dimensional code corresponding to the preset speech signal, divide the first audio three-dimensional code, select a sub-image from the division result to divide the value range, obtain the level index, and calculate the number of pixels corresponding to each level index according to the third digital vector; wherein, the number of levels of the level index is the same as the number of bits of the third digital vector. Based on the level index and the number of pixels corresponding to the level, the sub-image is transformed into a processed sub-image; Based on the processed subgraph and other subgraphs in the partitioning result, a second audio 3D code is generated; The second audio 3D code is converted into a sound control signal and sent to the sound receiving device.

2. The method according to claim 1, characterized in that, The first digital vector is a binary vector; the second digital vector is a decimal vector. The first number vector is divided into groups of the preset number of digits, and each group is converted into a decimal number to obtain a second decimal number vector of the preset number of digits.

3. The method according to claim 2, characterized in that, According to a pre-set difference elimination algorithm, the second digital vector is subjected to difference elimination to obtain a third digital vector, including: According to the pre-set difference elimination algorithm, the second digital vector is subjected to difference elimination to obtain the third digital vector: in, For control parameters, This represents the i-th digit in the second numeric vector. This represents the i-th digit in the third digit vector. The preset number of bits is 32.

4. The method according to any one of claims 1 to 3, characterized in that, Select a subgraph from the partitioning results and divide its value range to obtain level indicators, including: Obtain the maximum and minimum values ​​in the subgraph, divide the intervals of the maximum and minimum values ​​into levels with a preset number of digits, and obtain the level index.

5. The method according to claim 4, characterized in that, The number of pixels corresponding to each level indicator is calculated based on the third digital vector, including: The number of pixels corresponding to each level indicator is calculated based on the third digital vector as follows: in, This represents the number of pixels corresponding to the i-th level indicator. This represents the i-th digit in the third digit vector. The image size of the first spectrogram is represented by W, where W represents the width, H represents the height, and K represents the length.

6. The method according to claim 4, characterized in that, Based on the level index and the number of pixels corresponding to the level, the sub-image is transformed into a processed sub-image, including: Based on the level index to which the value of each pixel in the sub-image falls, the pixel is reassigned to obtain the processed sub-image.

7. The method according to claim 6, characterized in that, Based on the level index to which the value of each pixel in the sub-image falls, the pixels are reassigned to obtain the processed sub-image, including: Randomly select the number of pixels in the sub-image and assign the pixel a value corresponding to the level index. Repeat this process 32 times to obtain the processed sub-image.

8. A method for decoding three-dimensional audio codes, characterized in that, The method includes: The sound control signal in the audio three-dimensional code encoding method according to any one of claims 1 to 7, sent by the receiving terminal; The speech signal is converted to obtain a third audio three-dimensional code. The third audio three-dimensional code is registered with a pre-stored first audio three-dimensional code. If the registration is successful, a fourth digital vector is extracted from the third audio three-dimensional code. The operation instructions are obtained by parsing the fourth digital vector and the pre-stored mapping relationship between digital vectors and operation instructions.

9. The method according to claim 8, characterized in that, Registering the third audio 3D code with the pre-stored first audio 3D code includes: The element values ​​in the first audio 3D code and the third audio 3D code are traversed. When the sum of the differences between the element values ​​in the first audio 3D code and the third audio 3D code is less than a threshold, the registration is successful and the registration point is obtained.

10. The method according to claim 9, characterized in that, Extracting the fourth digital vector from the third audio 3D code includes: Based on the third audio 3D code and the registration point, the spectrogram carrying the verification information is obtained as follows: In this context, R4 represents the spectrogram carrying matching information, and F3 represents the third spectrogram. Indicate the registration point; The number of pixels at each value level in the spectrogram carrying matching information is: in, This represents the number of pixels at each value level in the spectrogram carrying matching information. This indicates the value corresponding to each level. This represents a logical operator, where a value of 1 is assigned if the pairs are equal, and 0 is assigned otherwise. ; Based on the number of pixels at each value level in the spectrogram carrying matching information, the fifth vector is determined as follows: in, Let W represent the i-th element in the fifth vector, H represent the width, H represent the height, and K represent the length. Based on the fifth vector, the sixth vector is calculated as follows: in, This represents the i-th element in the sixth vector. For control parameters; The sixth vector is converted into a binary vector to obtain the fourth vector.

Citation Information

Patent Citations

  • Control method and control platform for music fountain as well as mobile terminal

    CN105234039A

  • Method for beautifying three-dimensional code according to image color

    CN114565518A