Audio synchronous playing method and device based on remote WiFi

Abstract

The invention relates to the technical field of audio synchronous playing, in particular to an audio synchronous playing method and device based on remote WiFi. The method comprises the following steps: acquiring an audio uploading risk value of audio source equipment and an audio receiving risk value of audio receiving equipment based on an audio synchronous playing request, and judging whether to respond to the audio synchronous playing request based on the audio uploading risk value and the audio receiving risk value; according to the audio segment management sequence, performing content segment labeling on target audio data to be uploaded to obtain audio labeling segments, calculating audio feature parameters of each audio labeling segment, forming an information frame by the audio labeling segments, the audio feature parameters corresponding to the audio labeling segments and a preset playing timestamp, and sending the information frame to the server; the audio synchronization control system generates the information frame instruction and sends the information frame instruction to the audio source device through WiFi so as to instruct the audio source device to send the information frame to the audio receiving device, and the accuracy of audio synchronization playing can be improved.

Description

Technical Field

[0001] The present invention relates to the technical field of audio synchronous playback, and in particular to a method and device for audio synchronous playback based on remote WiFi. Background Art

[0002] Traditional audio playback systems rely primarily on wired connections, such as audio cables and coaxial cables, to transmit and synchronize audio signals. However, this approach not only limits the flexibility of audio equipment layout and increases the complexity of installation and maintenance, but is also costly and inefficient for large-scale audio deployments.

[0003] In the existing technology, although there are some audio synchronization playback solutions based on wireless technologies such as Bluetooth and Zigbee, these technologies are limited by problems such as transmission distance, bandwidth and synchronization accuracy, resulting in high transmission delay and low synchronization accuracy, which makes it difficult to meet the needs of high-end audio applications.

[0004] Therefore, there is an urgent need for a remote WiFi-based audio synchronization playback method and device to solve the above problems. Summary of the Invention

[0005] The purpose of the present invention is to provide a method and device for audio synchronization playback based on remote WiFi: to solve the technical problems of high transmission delay and low synchronization accuracy in audio synchronization playback in the prior art.

[0006] The purpose of the present invention can be achieved through the following technical solutions: On the one hand, a remote WiFi-based audio synchronization playback method is applied to an audio synchronization control system, the method comprising: The audio synchronization control system receives an audio synchronization playback request uploaded by an audio source device, obtains an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determines whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value; Responding to an audio synchronization playback request and annotating the uploaded target audio data by content segments according to the audio segment management sequence, obtaining audio annotated segments, calculating audio feature parameters of each audio annotated segment, and composing an information frame with the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp; The audio synchronization control system generates an information frame instruction and sends the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

[0007] Furthermore, obtaining the audio upload risk value of the audio source device specifically includes the following process: The duration of a period of time before the audio source device uploads the audio synchronous playback request is collected and marked as the time threshold. The time threshold is divided into i sub-time periods, where i is a natural number greater than zero. The operation performance value of the audio source device in each sub-time period is obtained, and the operation performance marginal value is set. When the operation performance value is greater than or equal to the operation performance marginal value, the sub-time period is marked as an operation abnormality period. When the operation performance value is greater than the operation performance marginal value, the sub-time period is marked as a normal operation period. All operation abnormality periods are matched into an operation abnormality period group, and the operation abnormality correlation value of each operation abnormality period group is calculated. The operation abnormality correlation values ​​are accumulated to obtain the operation abnormality characterization coefficient. The adjacent operation performance values ​​corresponding to the normal operation period are summed to obtain the normal operation characterization coefficient. The ratio of the operation abnormality characterization coefficient to the normal operation characterization coefficient is recorded as the audio upload risk value.

[0008] Furthermore, obtaining the operating performance value of the audio source device in each sub-time period specifically includes the following process: A frequency detection point and a voltage detection point of the audio source device are set within the sub-time period, a frequency characteristic curve is drawn based on the audio signal sampling frequency detected by the frequency detection point, and the number of frequency fluctuation amplitudes exceeding a preset frequency fluctuation amplitude threshold in the frequency characteristic curve is counted; a voltage characteristic curve is drawn based on the voltage detected by the voltage detection point of the audio source device, and the number of voltage fluctuation amplitudes exceeding a preset voltage fluctuation amplitude threshold in the voltage characteristic curve is counted, and the two numbers are added to obtain a sum value, which is recorded as the operating performance value of the audio source device in each sub-time period.

[0009] Furthermore, obtaining the audio reception risk value of the audio receiving device specifically includes the following process: Obtain the abnormal magnification value of the audio receiving device in each sub-time period, establish a rectangular coordinate system with the number of sub-time periods as the X-axis and the magnification value as the Y-axis, draw a magnification value curve by plotting points, and then obtain the ratio between the number of all rising segments and the sum of the number of rising segments, falling segments and horizontal segments from the magnification value curve, and mark the ratio as the abnormal magnification characteristic value. At the same time, obtain the reception magnification value of the audio receiving device in each sub-time period, and calculate the average of the reception magnification values ​​of all sub-time periods, and record the average as the reception magnification characteristic value, where the reception magnification value represents the success rate of receiving audio in the sub-time period, and the ratio of the abnormal magnification characteristic value to the reception magnification characteristic value is recorded as the audio reception risk value.

[0010] Furthermore, obtaining the abnormality magnification value of the audio receiving device in each sub-time period specifically includes the following process: The load rate of the audio receiving device in each sub-time period is collected, where the load rate is the number of audio signals simultaneously received by the audio receiving device in the sub-time period. A rectangular coordinate system is established with the number of sub-time periods as the X-axis and the load rate as the Y-axis. A load rate curve is drawn by plotting points. A first area enclosed by a line segment of the load rate curve above a preset load rate curve and the preset load rate curve is calculated. A second area enclosed by the load rate curve and the X-axis is calculated. The ratio between the first area and the second area is calculated. The degree of the obtuse angle formed by the first intersection of the load rate curve and the preset load rate curve is calculated, and the product value is multiplied by the ratio to obtain the product value. The product value is recorded as the abnormality multiple of the audio receiving device in each sub-time period.

[0011] Furthermore, judging whether to respond to the audio synchronous playback request based on the audio upload risk value and the audio reception risk value specifically includes the following process: Upload audio to risk value and audio reception risk value Substitute into the association formula , calculate the risk value of the synchronous playback request ,in, For audio upload risk factor, is the audio reception risk factor; Loading a synchronous play request risk threshold, wherein the synchronous play request value threshold is stored in the audio synchronization control system and its value is set by the system; Determine the risk value of synchronous playback requests Is it greater than the synchronous play request risk threshold? If so, do not respond to the audio synchronous play request; if not, respond to the audio synchronous play request.

[0012] Furthermore, obtaining the audio segment management sequence specifically includes the following processes: Count the duration of the target audio data to be uploaded, and divide the target audio data to be uploaded into several audio segments based on the duration, obtain the Mel-frequency cepstral coefficients of each audio segment, and sort the Mel-frequency cepstral coefficients of each audio segment from large to small. After sorting, a sequence is generated, which is the audio segment management sequence.

[0013] Furthermore, calculating the audio feature parameters of each audio annotation segment specifically includes the following process: Setting audio annotation segment detection points, detecting and obtaining first audio feature information, second audio feature information, up to the i-th audio feature information of each audio annotation segment, wherein the first audio feature information includes a first zero-crossing rate and a first audio energy, and the i-th audio feature information includes an i-th zero-crossing rate and an i-th audio energy, where the zero-crossing rate represents the number of times the audio signal waveform crosses the zero axis, and the audio energy represents the power of the audio signal on the frequency axis; Adding the first zero-crossing rate and the first audio energy to obtain a first audio characteristic coefficient; until the i-th audio characteristic coefficient is obtained; The largest audio feature coefficient from the first audio feature coefficient to the i-th candidate aging feature value is selected, and the largest audio feature coefficient is used as the audio feature parameter.

[0014] On the other hand, a device for synchronously playing audio based on remote WiFi is applicable to any of the methods for synchronously playing audio based on remote WiFi described above, and the device includes: An audio synchronization control unit is configured to receive an audio synchronization playback request uploaded by an audio source device, obtain an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determine whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value; An audio processing unit, configured to respond to an audio synchronization playback request and perform content segmentation annotation on the uploaded target audio data according to the audio segment management sequence, obtain audio annotated segments, calculate audio feature parameters for each audio annotated segment, and combine the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp into an information frame; The audio sending unit is used to receive the information frame instruction generated by the audio synchronization control system and send the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

[0015] Compared with the existing solutions, the present invention achieves the following beneficial effects: On the one hand, the present invention can realize wireless transmission of audio data through a WiFi network, so that audio devices are no longer restricted by the connection of physical cables, thereby greatly improving the flexibility of audio playback.

[0016] On the other hand, the present invention can achieve low-latency transmission of audio data by optimizing the WiFi network, ensuring that the audio signal can reach each audio receiving device in real time, avoiding the audio asynchrony problem caused by transmission delay.

[0017] Finally, the present invention can ensure that multiple audio devices can maintain a high degree of time consistency when playing audio, improve synchronization accuracy, thereby avoiding the time difference problem during audio playback and improving the coherence and immersion of the overall sound effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments described in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0019] Figure 1 This is a workflow diagram of a method for synchronous audio playback based on remote WiFi according to an embodiment of the present invention; Figure 2 This is a device block diagram of a remote WiFi-based audio synchronization playback device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0021] In addition, the described features, structures or characteristics can be combined in any suitable manner in one or more example embodiments. In the following description, many specific details are provided to provide a full understanding of the example embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure can be practiced while omitting one or more of the specific details, or other methods, components, steps, etc. can be adopted. In other cases, well-known structures, methods, implementations or operations are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0022] This embodiment provides a method for synchronous audio playback based on remote WiFi. Figure 1 This is a workflow diagram of a method for synchronous audio playback based on remote WiFi according to an embodiment of the present invention. Figure 1 As shown, the method includes the following steps: Step S101: The audio synchronization control system receives an audio synchronization playback request uploaded by an audio source device, obtains an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determines whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value. Step S102: responding to the audio synchronization playback request and annotating the uploaded target audio data by content segments according to the audio segment management sequence to obtain audio annotated segments, calculating audio feature parameters for each audio annotated segment, and assembling the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp into an information frame; Step S103: The audio synchronization control system generates an information frame instruction and sends the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

[0023] In summary, the present invention obtains the audio upload risk value of the audio source device and the audio reception risk value of the audio receiving device based on the audio synchronous playback request, determines whether to respond to the audio synchronous playback request based on the audio upload risk value and the audio reception risk value, performs content segmentation annotation on the target audio data to be uploaded according to the audio segmentation management sequence to obtain audio annotated segments, calculates the audio feature parameters of each audio annotated segment, and composes the audio annotated segment, the audio feature parameters corresponding to the audio annotated segment, and the preset playback timestamp into an information frame, the audio synchronization control system generates an information frame instruction and sends the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device, which can improve the accuracy of audio synchronous playback.

[0024] In some embodiments, obtaining the audio upload risk value of the audio source device specifically includes the following process: The duration of a period of time before the audio source device uploads the audio synchronous playback request is collected and marked as the time threshold. The time threshold is divided into i sub-time periods, where i is a natural number greater than zero. The operation performance value of the audio source device in each sub-time period is obtained, and the operation performance marginal value is set. When the operation performance value is greater than or equal to the operation performance marginal value, the sub-time period is marked as an operation abnormality period. When the operation performance value is greater than the operation performance marginal value, the sub-time period is marked as a normal operation period. All operation abnormality periods are matched into an operation abnormality period group, and the operation abnormality correlation value of each operation abnormality period group is calculated. The operation abnormality correlation values ​​are accumulated to obtain the operation abnormality characterization coefficient. The adjacent operation performance values ​​corresponding to the normal operation period are summed to obtain the normal operation characterization coefficient. The ratio of the operation abnormality characterization coefficient to the normal operation characterization coefficient is recorded as the audio upload risk value.

[0025] Furthermore, obtaining the operating performance value of the audio source device in each sub-time period specifically includes the following process: A frequency detection point and a voltage detection point of the audio source device are set within the sub-time period, a frequency characteristic curve is drawn based on the audio signal sampling frequency detected by the frequency detection point, and the number of frequency fluctuation amplitudes exceeding a preset frequency fluctuation amplitude threshold in the frequency characteristic curve is counted; a voltage characteristic curve is drawn based on the voltage detected by the voltage detection point of the audio source device, and the number of voltage fluctuation amplitudes exceeding a preset voltage fluctuation amplitude threshold in the voltage characteristic curve is counted, and the two numbers are added to obtain a sum value, which is recorded as the operating performance value of the audio source device in each sub-time period.

[0026] In some embodiments, obtaining the audio reception risk value of the audio receiving device specifically includes the following process: Obtain the abnormal magnification value of the audio receiving device in each sub-time period, establish a rectangular coordinate system with the number of sub-time periods as the X-axis and the magnification value as the Y-axis, draw a magnification value curve by plotting points, and then obtain the ratio between the number of all rising segments and the sum of the number of rising segments, falling segments and horizontal segments from the magnification value curve, and mark the ratio as the abnormal magnification characteristic value. At the same time, obtain the reception magnification value of the audio receiving device in each sub-time period, and calculate the average of the reception magnification values ​​of all sub-time periods, and record the average as the reception magnification characteristic value, where the reception magnification value represents the success rate of receiving audio in the sub-time period, and the ratio of the abnormal magnification characteristic value to the reception magnification characteristic value is recorded as the audio reception risk value.

[0027] Furthermore, obtaining the abnormality magnification value of the audio receiving device in each sub-time period specifically includes the following process: The load rate of the audio receiving device in each sub-time period is collected, where the load rate is the number of audio signals simultaneously received by the audio receiving device in the sub-time period. A rectangular coordinate system is established with the number of sub-time periods as the X-axis and the load rate as the Y-axis. A load rate curve is drawn by plotting points. A first area enclosed by a line segment of the load rate curve above a preset load rate curve and the preset load rate curve is calculated. A second area enclosed by the load rate curve and the X-axis is calculated. The ratio between the first area and the second area is calculated. The degree of the obtuse angle formed by the first intersection of the load rate curve and the preset load rate curve is calculated, and the product value is multiplied by the ratio to obtain the product value. The product value is recorded as the abnormality multiple of the audio receiving device in each sub-time period.

[0028] In some embodiments, determining whether to respond to the audio synchronous playback request based on the audio upload risk value and the audio reception risk value specifically includes the following process: Upload audio to risk value and audio reception risk value Substitute into the association formula , calculate the risk value of the synchronous playback request ,in, For audio upload risk factor, is the audio reception risk factor; Loading a synchronous play request risk threshold, wherein the synchronous play request value threshold is stored in the audio synchronization control system and its value is set by the system; Determine the risk value of synchronous playback requests Is it greater than the synchronous play request risk threshold? If so, do not respond to the audio synchronous play request; if not, respond to the audio synchronous play request.

[0029] In some embodiments, obtaining the audio segment management sequence specifically includes the following process: Count the duration of the target audio data to be uploaded, and divide the target audio data to be uploaded into several audio segments based on the duration, obtain the Mel-frequency cepstral coefficients of each audio segment, and sort the Mel-frequency cepstral coefficients of each audio segment from large to small. After sorting, a sequence is generated, which is the audio segment management sequence.

[0030] It is worth mentioning that Mel-Frequency Cepstral Coefficient (MFCC): a commonly used audio feature representation method, which simulates the way the human ear perceives audio signals and extracts coefficients that can characterize the frequency characteristics of the audio signal through a series of processing steps.

[0031] In some embodiments, calculating the audio feature parameters of each audio annotation segment specifically includes the following process: Setting audio annotation segment detection points, detecting and obtaining first audio feature information, second audio feature information, up to the i-th audio feature information of each audio annotation segment, wherein the first audio feature information includes a first zero-crossing rate and a first audio energy, and the i-th audio feature information includes an i-th zero-crossing rate and an i-th audio energy, where the zero-crossing rate represents the number of times the audio signal waveform crosses the zero axis, and the audio energy represents the power of the audio signal on the frequency axis; Adding the first zero-crossing rate and the first audio energy to obtain a first audio characteristic coefficient; until the i-th audio characteristic coefficient is obtained; The largest audio feature coefficient from the first audio feature coefficient to the i-th candidate aging feature value is selected, and the largest audio feature coefficient is used as the audio feature parameter.

[0032] In some embodiments, Figure 2 is a device block diagram of an audio synchronization playback device based on remote WiFi according to an embodiment of the present invention, such as Figure 2 As shown, the device includes: An audio synchronization control unit is configured to receive an audio synchronization playback request uploaded by an audio source device, obtain an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determine whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value; An audio processing unit, configured to respond to an audio synchronization playback request and perform content segmentation annotation on the uploaded target audio data according to the audio segment management sequence, obtain audio annotated segments, calculate audio feature parameters for each audio annotated segment, and combine the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp into an information frame; The audio sending unit is used to receive the information frame instruction generated by the audio synchronization control system and send the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

[0033] The above embodiments can be implemented in whole or in part via software, hardware, firmware, or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. When loaded or executed on a computer, the processes or functions described in the embodiments of this application are fully or partially generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired means (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium accessible by a computer or a data storage device such as a server or data center that contains a collection of one or more available media. The available medium can be magnetic media (e.g., floppy disks, hard disks, tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0034] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0035] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0036] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is only for some logical functions. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0037] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0038] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for synchronous audio playback based on remote WiFi, characterized in that: Applied to an audio synchronization control system, the method includes: The audio synchronization control system receives an audio synchronization playback request uploaded by an audio source device, obtains an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determines whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value; Responding to an audio synchronization playback request and annotating the uploaded target audio data by content segments according to the audio segment management sequence, obtaining audio annotated segments, calculating audio feature parameters of each audio annotated segment, and composing an information frame with the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp; The audio synchronization control system generates an information frame instruction and sends the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

2. The method for synchronously playing audio based on remote WiFi according to claim 1, characterized in that: Get the specific audio upload risk value of the audio source device The following processes are included: The duration of a period of time before the audio source device uploads the audio synchronous playback request is collected and marked as the time threshold. The time threshold is divided into i sub-time periods, where i is a natural number greater than zero. The operation performance value of the audio source device in each sub-time period is obtained, and the operation performance marginal value is set. When the operation performance value is greater than or equal to the operation performance marginal value, the sub-time period is marked as an operation abnormality period. When the operation performance value is greater than the operation performance marginal value, the sub-time period is marked as a normal operation period. All operation abnormality periods are matched into an operation abnormality period group, and the operation abnormality correlation value of each operation abnormality period group is calculated. The operation abnormality correlation values ​​are accumulated to obtain the operation abnormality characterization coefficient. The adjacent operation performance values ​​corresponding to the normal operation period are summed to obtain the normal operation characterization coefficient. The ratio of the operation abnormality characterization coefficient to the normal operation characterization coefficient is recorded as the audio upload risk value.

3. The method for synchronous audio playback based on remote WiFi according to claim 2, characterized in that: Get the specific performance values ​​of the audio source device in each sub-time period The following processes are included: A frequency detection point and a voltage detection point of the audio source device are set within the sub-time period, a frequency characteristic curve is drawn based on the audio signal sampling frequency detected by the frequency detection point, and the number of frequency fluctuation amplitudes exceeding a preset frequency fluctuation amplitude threshold in the frequency characteristic curve is counted; a voltage characteristic curve is drawn based on the voltage detected by the voltage detection point of the audio source device, and the number of voltage fluctuation amplitudes exceeding a preset voltage fluctuation amplitude threshold in the voltage characteristic curve is counted, and the two numbers are added to obtain a sum value, which is recorded as the operating performance value of the audio source device in each sub-time period.

4. The method for synchronous audio playback based on remote WiFi according to claim 1, wherein: Get the audio receiving risk value of the audio receiving device The following processes are included: Obtain the abnormal magnification value of the audio receiving device in each sub-time period, establish a rectangular coordinate system with the number of sub-time periods as the X-axis and the magnification value as the Y-axis, draw a magnification value curve by plotting points, and then obtain the ratio between the number of all rising segments and the sum of the number of rising segments, falling segments and horizontal segments from the magnification value curve, and mark the ratio as the abnormal magnification characteristic value. At the same time, obtain the reception magnification value of the audio receiving device in each sub-time period, and calculate the average of the reception magnification values ​​of all sub-time periods, and record the average as the reception magnification characteristic value, where the reception magnification value represents the success rate of receiving audio in the sub-time period, and the ratio of the abnormal magnification characteristic value to the reception magnification characteristic value is recorded as the audio reception risk value.

5. The method for synchronous audio playback based on remote WiFi according to claim 4, characterized in that: Get the specific abnormal magnification value of the audio receiving device in each sub-time period The following processes are included: The load rate of the audio receiving device in each sub-time period is collected, where the load rate is the number of audio signals simultaneously received by the audio receiving device in the sub-time period. A rectangular coordinate system is established with the number of sub-time periods as the X-axis and the load rate as the Y-axis. A load rate curve is drawn by plotting points. A first area enclosed by a line segment of the load rate curve above a preset load rate curve and the preset load rate curve is calculated. A second area enclosed by the load rate curve and the X-axis is calculated. The ratio between the first area and the second area is calculated. The degree of the obtuse angle formed by the first intersection of the load rate curve and the preset load rate curve is calculated, and the product value is multiplied by the ratio to obtain the product value. The product value is recorded as the abnormality multiple of the audio receiving device in each sub-time period.

6. The method for synchronous audio playback based on remote WiFi according to claim 1, characterized in that: Determine whether to respond to the audio synchronous playback request based on the audio upload risk value and the audio reception risk value. The following processes are included: Upload audio to risk value and audio reception risk value Substitute into the association formula , calculate the risk value of the synchronous playback request ,in, For audio upload risk factor, is the audio reception risk factor; Loading a synchronous play request risk threshold, wherein the synchronous play request value threshold is stored in the audio synchronization control system and its value is set by the system; Determine the risk value of synchronous playback requests Is it greater than the synchronous play request risk threshold? If so, do not respond to the audio synchronous play request; if not, respond to the audio synchronous play request.

7. The method for synchronous audio playback based on remote WiFi according to claim 1, characterized in that: Obtaining the audio segment management sequence specifically includes the following processes: Count the duration of the target audio data to be uploaded, and divide the target audio data to be uploaded into several audio segments based on the duration, obtain the Mel-frequency cepstral coefficients of each audio segment, and sort the Mel-frequency cepstral coefficients of each audio segment from large to small. After sorting, a sequence is generated, which is the audio segment management sequence.

8. The method for synchronous audio playback based on remote WiFi according to claim 1, characterized in that: Calculate the audio feature parameters of each audio annotation segment The following processes are included: Setting audio annotation segment detection points, detecting and obtaining first audio feature information, second audio feature information, up to the i-th audio feature information of each audio annotation segment, wherein the first audio feature information includes a first zero-crossing rate and a first audio energy, and the i-th audio feature information includes an i-th zero-crossing rate and an i-th audio energy, where the zero-crossing rate represents the number of times the audio signal waveform crosses the zero axis, and the audio energy represents the power of the audio signal on the frequency axis; Adding the first zero-crossing rate and the first audio energy to obtain a first audio characteristic coefficient; until the i-th audio characteristic coefficient is obtained; The largest audio feature coefficient from the first audio feature coefficient to the i-th candidate aging feature value is selected, and the largest audio feature coefficient is used as the audio feature parameter.

9. An audio synchronization playback device based on remote WiFi, characterized in that: A method for synchronously playing audio based on remote WiFi applicable to any one of claims 1 to 8, the device comprising: An audio synchronization control unit is configured to receive an audio synchronization playback request uploaded by an audio source device, obtain an audio upload risk value of the audio source device and an audio reception risk value of the audio reception device based on the audio synchronization playback request, and determine whether to respond to the audio synchronization playback request based on the audio upload risk value and the audio reception risk value; An audio processing unit, configured to respond to an audio synchronization playback request and perform content segmentation annotation on the uploaded target audio data according to the audio segment management sequence, obtain audio annotated segments, calculate audio feature parameters for each audio annotated segment, and combine the audio annotated segments, the audio feature parameters corresponding to the audio annotated segments, and a preset playback timestamp into an information frame; The audio sending unit is used to receive the information frame instruction generated by the audio synchronization control system and send the information frame instruction to the audio source device via WiFi to instruct it to send the information frame to the audio receiving device.

Images