Asynchronous audio synchronization method and device

Abstract

The invention discloses an asynchronous audio synchronization method and device. The method comprises the following steps: if an audio processing instruction is detected, determining a target reference clock, and controlling a microphone transmitter to carry out audio recording based on the target reference clock and a set recording frequency; in the audio recording process, the recording residual length is monitored, so that the recording frequency is adjusted when the recording frequency adjustment condition is met, and synchronous recording of the audio is realized; and after recording is completed, the microphone receiver is controlled to play and receive the audio based on the target reference clock and the set playing frequency, and the playing frequency is adjusted according to the residual playing length, so that synchronous playing of the audio is realized. According to the technical scheme of the invention, the recording and playing processes can be monitored, the audio synchronization processing is realized, the synchronization efficiency is improved, and the bandwidth consumption is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to an asynchronous audio synchronization method and device. Background Art

[0002] In wireless microphone systems, audio input and playback are often implemented separately. The microphone transmitter records audio, which is then sent to the microphone receiver by the transmitter, and then the receiver outputs the audio. Both the transmitter and the receiver synchronize the clock through a crystal oscillator, and the clock accuracy is affected by the precision and accuracy of the crystal oscillator, resulting in certain errors in asynchronous audio synchronization, causing inconsistencies in the microphone's reception, transmission, and playback data times. In this case, due to the inconsistency of the audio input, transmission, and playback clocks, problems such as low asynchronous audio synchronization efficiency, poor results, and jitter will occur.

[0003] Therefore, how to monitor the recording and playback process, realize synchronous processing of audio, improve synchronization efficiency, and reduce bandwidth consumption is a problem that needs to be solved urgently. Summary of the invention

[0004] The present invention provides an asynchronous audio synchronization method and device to monitor the recording and playing process, realize synchronous processing of audio, improve synchronization efficiency and reduce bandwidth consumption.

[0005] According to one aspect of the present invention, there is provided an asynchronous audio synchronization method, comprising:

[0006] If an audio processing instruction is detected, a target reference clock is determined, and the microphone transmitter is controlled to perform audio recording based on the target reference clock and the set recording frequency;

[0007] During the audio recording process, the remaining recording length is monitored to adjust the recording frequency when the recording frequency adjustment conditions are met, thereby achieving synchronous audio recording;

[0008] After the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of the audio.

[0009] According to another aspect of the present invention, there is provided an asynchronous audio synchronization device, comprising:

[0010] A recording module, for determining a target reference clock if an audio processing instruction is detected, and controlling a microphone transmitter to perform audio recording based on the target reference clock and a set recording frequency;

[0011] An adjustment module is used to monitor the remaining recording length during the audio recording process, so as to adjust the recording frequency when the recording frequency adjustment conditions are met, thereby realizing synchronous recording of the audio;

[0012] The playback module is used to control the microphone receiver to play the received audio based on the target reference clock and the set playback frequency after the recording is completed, and adjust the playback frequency according to the remaining playback length to achieve synchronous playback of the audio.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the asynchronous audio synchronization method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the asynchronous audio synchronization method described in any embodiment of the present invention when executed.

[0018] According to another aspect of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the asynchronous audio synchronization method of any embodiment of the present invention is implemented.

[0019] The technical solution of the embodiment of the present invention is that if an audio processing instruction is detected, the target reference clock is determined, and the microphone transmitter is controlled to record audio based on the target reference clock and the set recording frequency; during the process of recording audio, the recording remaining length is monitored to adjust the recording frequency when the recording frequency adjustment condition is met to achieve synchronous recording of audio; after the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of audio. By monitoring the recording and playback process, synchronous processing of audio can be achieved, synchronization efficiency can be improved, and bandwidth consumption can be reduced.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a flow chart of an asynchronous audio synchronization method provided by Embodiment 1 of the present invention;

[0023] Figure 2A is a flowchart of audio playback provided by Embodiment 2 of the present invention;

[0024] Figure 2B is a flowchart of audio recording provided by Embodiment 2 of the present invention;

[0025] Figure 2C-2E is a schematic diagram of selecting a target reference clock provided by Embodiment 2 of the present invention;

[0026] Figure 3 is a structural block diagram of an asynchronous audio synchronization device provided by Embodiment 3 of the present invention;

[0027] Figure 4 It is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", "target", "candidate", "alternative", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. The acquisition, storage, use, processing, etc. of data in the technical solution of this application comply with the relevant provisions of national laws and regulations.

[0030] Embodiment 1

[0031] Figure 1 1 is a flowchart of an asynchronous audio synchronization method provided in Embodiment 1 of the present invention; this embodiment is applicable to the case where a wireless microphone system controls a microphone transmitter and a microphone receiver to synchronously record and play audio, and the method can be executed by an asynchronous audio synchronization device, and the asynchronous audio synchronization device can be implemented in the form of hardware and / or software, and the asynchronous audio synchronization device can be configured in an electronic device, such as a wireless microphone system, wherein the wireless microphone system includes a microphone transmitter and a microphone receiver, and one microphone receiver can correspond to one or at least two microphone transmitters, such as Figure 1 As shown, the asynchronous audio synchronization method includes:

[0032] S101: If an audio processing instruction is detected, a target reference clock is determined, and a microphone transmitter is controlled to perform audio recording based on the target reference clock and a set recording frequency.

[0033] Among them, the audio processing instruction refers to the processing instruction received by the wireless microphone system for audio recording and audio playback. The target reference clock refers to the target clock that the wireless microphone system finally converges to. It is the target value for asynchronous audio synchronization and the working clock of the entire wireless microphone system after synchronization. The target reference clock can be the clock of the Radio Frequency (RF) module or the clock of the Microcontroller Unit (MCU) module. The microphone transmitter is a device used for audio recording in the wireless microphone system. Setting the recording frequency refers to the pre-set frequency for controlling the microphone transmitter to record audio. The microphone receiver and microphone transmitter in the wireless microphone system are in a host-slave relationship. One host can correspond to multiple slaves, that is, the number of microphone transmitters can be one or more.

[0034] It should be noted that both the microphone transmitter and the microphone receiver contain their own RF module and MCU module. During the recording process, the recording frame is transmitted from the MCU module of the microphone transmitter to the RF module. Correspondingly, during the playback process, the playback frame is transmitted from the RF module of the microphone receiver to the MCU module.

[0035] Optionally, determining a target reference clock includes: determining a reference clock selection strategy according to a corresponding relationship between a microphone receiver and a microphone transmitter; and selecting a reference clock based on the reference clock selection strategy to obtain a target reference clock.

[0036] Among them, the selection strategy refers to selecting the clock of a component in the wireless microphone system as the target reference clock, and the other components are synchronized through the steps S101-S103 of the present invention, so as to keep their own clocks consistent with the target reference clock. The corresponding relationship between the microphone receiver and the microphone transmitter can be one-to-one, one-to-two or one-to-many. The corresponding relationship is one-to-many, that is, one microphone receiver is connected to multiple microphone transmitters, and the selection strategy is to use the clock of the RF module as the reference clock or the clock of the microcontroller module as the reference clock.

[0037] Optionally, if the correspondence between the microphone receiver and the microphone transmitter is one-to-one, the clock of the RF module can be used as the target reference clock, or the clock of the MCU module of the microphone transmitter can be used as the target reference clock. If the correspondence between the microphone receiver and the microphone transmitter is one-to-two or one-to-many, both the microphone receiver and the microphone transmitter can use the clock of the RF module as the target reference clock.

[0038] S102. During the process of recording audio, the remaining recording length is monitored to adjust the recording frequency when a recording frequency adjustment condition is met, thereby achieving synchronous recording of audio.

[0039] The remaining recording length refers to the length of the audio that has not been recorded yet, and specifically can be the real-time remaining length of the FIFO (First In First Out) during the recording process. The recording frequency adjustment condition refers to the condition that indicates whether to adjust the recording frequency (i.e., set the recording frequency).

[0040] Optionally, during the process of recording audio, the remaining recording length is monitored to adjust the recording frequency when the recording frequency adjustment conditions are met, including: during the process of recording audio, determining the remaining recording length through a preset data buffer; determining whether the recording frequency adjustment conditions are met based on the remaining recording length, a preset break threshold, and a preset excess threshold; if so, updating the recording frequency, and continuing audio recording based on the updated recording frequency.

[0041] The preset data buffer may be, for example, a FIFO buffer. The preset sound-breaking threshold is a threshold used to assess whether there is an abnormal risk of sound-breaking, and may specifically be the minimum data threshold of the FIFO. The preset exceeding threshold is a threshold used to assess whether there is an abnormal risk of audio acceptance exceeding the standard, and may specifically be the maximum data threshold of the FIFO. The preset sound-breaking threshold is less than the preset exceeding threshold.

[0042] Optionally, during the process of recording audio, a variable corresponding to the amount of remaining data in the FIFO buffer may be read, and the current remaining length of recording may be determined based on the reading result.

[0043] Optionally, if the remaining recording length is greater than or equal to the preset audio interruption threshold and less than or equal to the preset excess threshold, it is determined that the recording frequency adjustment condition is not met. At this time, audio recording can continue based on the set recording frequency.

[0044] Optionally, whether the conditions for adjusting the recording frequency are met is determined based on the remaining recording length, the preset sound-breaking threshold, and the preset exceeding threshold, including: if the remaining recording length is less than the preset sound-breaking threshold or the remaining recording length is greater than the preset exceeding threshold, it is determined that the conditions for adjusting the recording frequency are met; accordingly, the recording frequency is updated, including: if the remaining recording length is less than the preset sound-breaking threshold, then the setting of the recording frequency is increased based on the preset step size to update the recording frequency; if the remaining recording length is greater than the preset exceeding threshold, then the setting of the recording frequency is reduced based on the preset step size to update the recording frequency.

[0045] The preset increase step size refers to a preset increase range of the set input frequency, and the preset decrease step size refers to a preset decrease range of the set input frequency.

[0046] It should be noted that when the remaining recording length is less than the preset audio interruption threshold, it can be considered that there is a risk of audio interruption abnormality, so frequency adjustment is required. When the remaining recording length is greater than the preset excess threshold, it can be considered that there is a risk of audio acceptance exceeding the standard abnormality, so frequency adjustment is required.

[0047] Optionally, the mclk (Master / System clock input) frequency of the audio codec chip codec in the microphone transmitter can be increased or decreased to update the recording frequency, where codec is an audio codec chip used to convert analog audio signals into IIS digital interface audio signals, and mclk is called the master clock or system clock, which is used for synchronization between the audio codec and the main controller.

[0048] It should be noted that the present invention does not use a fixed mclk, and its corresponding sampling rate multiple is not fixed but dynamically adjusted.

[0049] S103: After the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of the audio.

[0050] The setting of the playing frequency refers to the frequency of controlling the microphone receiver to play the audio in advance. The remaining playing length refers to the length of the audio that has not been played, which can be the real-time remaining length of the FIFO during the playing process. The input audio and the received audio are asynchronous audio.

[0051] Optionally, after the recording is completed, the microphone transmitter can be controlled to send the recorded audio to the microphone receiver through the RF module, and the microphone receiver can be controlled to receive the audio, and further play the received audio based on the target reference clock and the set playback frequency.

[0052] Optionally, the microphone receiver can play the received audio through the local RF module, or connect the received audio from the audio output pin to output the analog audio signal corresponding to the received audio to an external device for the external device to play or monitor. The present invention is not limited to this.

[0053] Optionally, the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of the audio, including: in the process of playing the received audio, determining the remaining playback length through a preset data buffer; determining whether the playback frequency adjustment conditions are met based on the remaining playback length, a preset break threshold, and a preset exceedance threshold; if so, updating the playback frequency to continue playing the received audio based on the updated playback frequency.

[0054] Among them, the preset data buffer can be, for example, a FIFO buffer. The preset sound-breaking threshold is a threshold used to evaluate whether there is an abnormal risk of sound breaking, and can specifically be the minimum data threshold of FIFO, and the value can be 5. The preset exceeding standard threshold is a threshold used to evaluate whether there is an abnormal risk of audio acceptance exceeding standard, and can specifically be the maximum data threshold of FIFO, and the value can be 25. The preset sound-breaking threshold is less than the preset exceeding standard threshold. The playback frequency adjustment condition refers to the condition that characterizes whether to adjust the playback frequency (i.e., set the playback frequency).

[0055] Optionally, during the audio playback process, the variable corresponding to the remaining data amount in the FIFO buffer may be read, and the current remaining playback length may be determined based on the read result.

[0056] Optionally, if the remaining playback length is greater than or equal to a preset audio interruption threshold and less than or equal to a preset excess threshold, it is determined that the playback frequency adjustment condition is not met, and audio playback can continue based on the set playback frequency.

[0057] Optionally, whether the playback frequency adjustment conditions are met is determined based on the remaining playback length, a preset break threshold, and a preset exceeding threshold, including: if the remaining playback length is less than the preset break threshold or the remaining playback length is greater than the preset exceeding threshold, then it is determined that the playback frequency adjustment conditions are met; accordingly, the playback frequency is updated, including: if the remaining playback length is less than the preset break threshold, then the step size is reduced based on the preset, and the set playback frequency is reduced to update the playback frequency; if the remaining playback length is greater than the preset exceeding threshold, then the step size is increased based on the preset, and the set playback frequency is increased to update the playback frequency.

[0058] The preset increase step size refers to a preset increase range of the set playback frequency, and the preset decrease step size refers to a preset decrease range of the set playback frequency.

[0059] Optionally, the MCLK frequency of the audio codec chip codec in the microphone transmitter can be increased or decreased to update the playback frequency. The audio codec chip is an important sub-component in the microphone transmitter and microphone receiver, responsible for converting digital audio into analog audio for recording and playback.

[0060] It should be noted that the remaining playback length is the remaining audio in the FIFO buffer. When the remaining playback length is less than the minimum audio (that is, the preset audio break threshold), it is necessary to reduce the mclk frequency to slow down the audio playback speed so that the fifo is not consumed so quickly. At the same time, the remaining playback length can be restored to a normal state that is greater than or equal to the preset audio break threshold and less than or equal to the preset excess threshold, and vice versa.

[0061] It should be noted that the present invention can avoid the asynchronous situation where the audio loses a section of sound after playing for a period of time by adaptively and dynamically adjusting the frequency during the recording and playback process. Through the technical solution of the present invention, no matter how long the audio is recorded and played, the audio will not be lost, thereby realizing asynchronous audio synchronization.

[0062] The technical solution of the embodiment of the present invention is that if an audio processing instruction is detected, the target reference clock is determined, and the microphone transmitter is controlled to record audio based on the target reference clock and the set recording frequency; during the process of recording audio, the recording remaining length is monitored to adjust the recording frequency when the recording frequency adjustment condition is met to achieve synchronous recording of audio; after the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of audio. By monitoring the recording and playback process, synchronous processing of audio can be achieved, synchronization efficiency can be improved, and bandwidth consumption can be reduced.

[0063] Embodiment 2

[0064] Figure 2A is a flowchart of audio playback provided by Embodiment 2 of the present invention; Figure 2B is a flowchart of audio recording provided by Embodiment 2 of the present invention; Figure 2C-2E This is a schematic diagram of the selection of the target reference clock provided in the second embodiment of the present invention; based on the above embodiment, this embodiment provides a preferred solution for achieving asynchronous audio synchronization by adjusting the playback or recording frequency.

[0065] Specifically, Figure 2A As shown, the method may include the following clock adjustment process of the playback frame, that is, the audio playback process:

[0066] By controlling the microphone receiver to play audio, after the playback frame starts, the remaining length A of the current playback fifo (i.e., the remaining playback length) can be measured in real time, and compared with the preset break threshold B and the preset excess threshold C respectively. If A is less than the preset break threshold B, the mclk frequency of the codec is reduced so that the playback frequency is updated to D. If A is greater than the preset excess threshold C, the mclk frequency of the codec is increased so that the playback frequency is updated to D. Frequency adjustment is implemented until the playback frame ends, where B can be taken as 5 and C can be taken as 25.

[0067] Specifically, Figure 2B As shown, the method may include the following recording frame clock adjustment process, that is, the audio recording process:

[0068] By controlling the microphone transmitter to record audio, after the recording frame starts, the remaining length A of the current playback fifo (i.e., the remaining recording length) can be measured in real time, and compared with the preset break threshold B and the preset excess threshold C respectively. If A is less than the preset break threshold B, the mclk frequency of the codec is reduced so that the recording frequency is updated to D. If A is greater than the preset excess threshold C, the mclk frequency of the codec is increased so that the recording frequency is updated to D. Frequency adjustment is implemented until the recording frame ends, where B can be taken as 5 and C can be taken as 25.

[0069] Preferably, the microphone receiver is the host and the microphone transmitter is the slave. If the correspondence between the microphone receiver and the microphone transmitter is one-to-one, then refer to Figure 2C , the transmission is performed in the slave's RF system (i.e., RF module), and the playback is performed in the host's RF system, with the RF module's clock as the target reference clock; see also Figure 2D , the MCU system (i.e. MCU module) of the slave is used for transmission, and the MCU system of the host is used for playback, with the clock of the MCU module of the microphone transmitter as the target reference clock. If the correspondence between the microphone receiver and the microphone transmitter is one-to-two, you can refer to Figure 2E , transmitted in the RF system of the first slave, transmitted in the RF system of the second slave, played in the RF system of the host, and both the microphone receiver and the microphone transmitter can use the clock of the RF module as the target reference clock.

[0070] Embodiment 3

[0071] Figure 3 : is a structural block diagram of an asynchronous audio synchronization device provided in the third embodiment of the present invention; this embodiment can be applied to the situation where a wireless microphone system controls a microphone transmitter and a microphone receiver to perform synchronous recording and playback of audio. The asynchronous audio synchronization device provided in the embodiment of the present invention can execute the asynchronous audio synchronization method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method; the asynchronous audio synchronization device can be implemented in the form of hardware and / or software, and configured in an electronic device with an asynchronous audio synchronization function, such as a wireless microphone system, such as Figure 3 As shown, the asynchronous audio synchronization device specifically includes:

[0072] The recording module 301 is used to determine the target reference clock if an audio processing instruction is detected, and control the microphone transmitter to perform audio recording based on the target reference clock and the set recording frequency;

[0073] An adjustment module 302, used for monitoring the remaining recording length during the audio recording process, so as to adjust the recording frequency when the recording frequency adjustment condition is met, so as to achieve synchronous recording of the audio;

[0074] The playback module 303 is used to control the microphone receiver to play the received audio based on the target reference clock and the set playback frequency after the recording is completed, and adjust the playback frequency according to the remaining playback length to achieve synchronous playback of the audio.

[0075] The technical solution of the embodiment of the present invention is that if an audio processing instruction is detected, the target reference clock is determined, and the microphone transmitter is controlled to record audio based on the target reference clock and the set recording frequency; during the process of recording audio, the recording remaining length is monitored to adjust the recording frequency when the recording frequency adjustment condition is met to achieve synchronous recording of audio; after the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of audio. By monitoring the recording and playback process, synchronous processing of audio can be achieved, synchronization efficiency can be improved, and bandwidth consumption can be reduced.

[0076] Furthermore, the input module 301 is specifically used for:

[0077] Determine a reference clock selection strategy according to the corresponding relationship between the microphone receiver and the microphone transmitter; the selection strategy is to use the clock of the radio frequency module as the reference clock or the clock of the microcontroller module as the reference clock;

[0078] A reference clock is selected based on a reference clock selection strategy to obtain a target reference clock.

[0079] Furthermore, the adjustment module 302 may include:

[0080] The length determination unit is used to determine the remaining recording length by using a preset data buffer during the audio recording process;

[0081] A condition determination unit, used to determine whether the recording frequency adjustment condition is met according to the remaining recording length, the preset sound break threshold and the preset over-limit threshold;

[0082] The recording unit is used to update the recording frequency if yes, and continue audio recording based on the updated recording frequency.

[0083] Furthermore, the condition determination unit is specifically used for:

[0084] If the remaining recording length is less than the preset sound-breaking threshold or the remaining recording length is greater than the preset exceeding threshold, it is determined that the recording frequency adjustment condition is met;

[0085] Accordingly, the input unit is specifically used for:

[0086] If the remaining length of the recording is less than the preset sound-breaking threshold, the step length is increased based on the preset, and the set recording frequency is increased to update the recording frequency; if the remaining length of the recording is greater than the preset excess threshold, the step length is reduced based on the preset, and the set recording frequency is reduced to update the recording frequency.

[0087] Furthermore, the playing module 303 may include:

[0088] The remaining length determining unit is used to determine the remaining length of the playback through a preset data buffer during the playback of the received audio;

[0089] A judgment unit, used to determine whether a playback frequency adjustment condition is met according to a remaining playback length, a preset break threshold, and a preset over-limit threshold;

[0090] The playing unit is configured to update the playing frequency if yes, so as to continue playing the received audio based on the updated playing frequency.

[0091] Furthermore, the judging unit is specifically used for:

[0092] If the remaining playback length is less than the preset sound-breaking threshold or the remaining playback length is greater than the preset exceeding threshold, it is determined that the playback frequency adjustment condition is met;

[0093] Accordingly, the playback unit is specifically used for:

[0094] If the remaining playback length is less than the preset break threshold, the step length is reduced based on the preset, and the set playback frequency is reduced to update the playback frequency; if the remaining playback length is greater than the preset excess threshold, the step length is increased based on the preset, and the set playback frequency is increased to update the playback frequency.

[0095] Embodiment 4

[0096] Figure 4 It is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Figure 4 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0097] like Figure 4As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0098] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0099] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the asynchronous audio synchronization method.

[0100] In some embodiments, the asynchronous audio synchronization method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the asynchronous audio synchronization method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the asynchronous audio synchronization method in any other appropriate manner (e.g., by means of firmware).

[0101] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0102] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0103] In the context of the present invention, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or equipment. A computer readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. A more specific example of a machine readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0104] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0105] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0106] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0107] In one embodiment, the present invention further includes a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the asynchronous audio synchronization method of any embodiment of the present invention is implemented.

[0108] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0109] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0110] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An asynchronous audio synchronization method, characterized in that: include: If an audio processing instruction is detected, a target reference clock is determined, and the microphone transmitter is controlled to perform audio recording based on the target reference clock and the set recording frequency; During the audio recording process, the remaining recording length is monitored to adjust the recording frequency when the recording frequency adjustment conditions are met, thereby achieving synchronous audio recording; After the recording is completed, the microphone receiver is controlled to play the received audio based on the target reference clock and the set playback frequency, and the playback frequency is adjusted according to the remaining playback length to achieve synchronous playback of the audio.

2. The method according to claim 1, characterized in that The determining of the target reference clock comprises: Determine a reference clock selection strategy according to the corresponding relationship between the microphone receiver and the microphone transmitter; the selection strategy is to use the clock of the radio frequency module as the reference clock or the clock of the microcontroller module as the reference clock; A reference clock is selected based on a reference clock selection strategy to obtain a target reference clock.

3. The method according to claim 1, characterized in that During the audio recording process, the remaining recording length is monitored to adjust the recording frequency when the recording frequency adjustment conditions are met, including: During the process of recording audio, the remaining length of recording is determined by presetting the data buffer; Determine whether the recording frequency adjustment condition is met according to the remaining recording length, the preset sound break threshold and the preset over-limit threshold; If so, the recording frequency is updated, and audio recording is continued based on the updated recording frequency.

4. The method according to claim 3, characterized in that According to the remaining recording length, the preset break threshold and the preset over-limit threshold, determine whether the recording frequency adjustment conditions are met, including: If the remaining recording length is less than the preset sound-breaking threshold or the remaining recording length is greater than the preset exceeding threshold, it is determined that the recording frequency adjustment condition is met; Update the entry frequency accordingly, including: If the remaining length of the recording is less than the preset sound-breaking threshold, the step length is increased based on the preset, and the set recording frequency is increased to update the recording frequency; if the remaining length of the recording is greater than the preset excess threshold, the step length is reduced based on the preset, and the set recording frequency is reduced to update the recording frequency.

5. The method according to claim 1, characterized in that Adjust the playback frequency according to the remaining playback length to achieve synchronous audio playback, including: During the process of playing the received audio, the remaining length of the playback is determined by presetting the data buffer; Determine whether the playback frequency adjustment condition is met according to the remaining playback length, the preset break threshold, and the preset over-limit threshold; If so, the playback frequency is updated to continue playing the received audio based on the updated playback frequency.

6. The method according to claim 5, characterized in that According to the remaining playback length, the preset break threshold and the preset over-limit threshold, it is determined whether the playback frequency adjustment conditions are met, including: If the remaining playback length is less than the preset sound-breaking threshold or the remaining playback length is greater than the preset exceeding threshold, it is determined that the playback frequency adjustment condition is met; Update the playback frequency accordingly, including: If the remaining playback length is less than the preset break threshold, the step length is reduced based on the preset, and the set playback frequency is reduced to update the playback frequency; if the remaining playback length is greater than the preset excess threshold, the step length is increased based on the preset, and the set playback frequency is increased to update the playback frequency.

7. An asynchronous audio synchronization device, characterized in that: include: A recording module, for determining a target reference clock if an audio processing instruction is detected, and controlling a microphone transmitter to perform audio recording based on the target reference clock and a set recording frequency; An adjustment module is used to monitor the remaining recording length during the audio recording process, so as to adjust the recording frequency when the recording frequency adjustment conditions are met, thereby realizing synchronous recording of the audio; The playback module is used to control the microphone receiver to play the received audio based on the target reference clock and the set playback frequency after the recording is completed, and adjust the playback frequency according to the remaining playback length to achieve synchronous playback of the audio.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executed by the at least one processor, and the computer program is executed by the at least one processor so as to enable the at least one processor to execute the asynchronous audio synchronization method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the asynchronous audio synchronization method according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, implements the asynchronous audio synchronization method according to any one of claims 1-6.

Images