Multi-channel audio stream analysis and presentation method and corresponding equipment for broadcast-level audio system

Through core probes and distributed probes, the problem of insufficient analysis capabilities of single-device in the existing technology is solved, real-time analysis and system-level presentation of multiple audio streams are realized, and the efficiency and resource utilization of audio streams are improved.

CN118075501BActive Publication Date: 2025-03-07中央广播电视总台
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410154498.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-02-02
Publication Date
2025-03-07
Estimated Expiration
2044-02-02

AI Technical Summary

Technical Problem

In the prior art, specialized equipment can only analyze one audio stream, and lacks the ability to analyze multiple audio streams and comprehensive presentation, resulting in large resources for real-time analysis of audio streams and is unable to realize system-level presentation of audio services.

Method used

Through core probes and distributed probes, basic analysis of the network package level and load encoding level is carried out for the ST2110-30 audio stream, and the audio stream is converted into an NDI code stream, and the peak data and loudness data are calculated, and the analysis data is finally presented in real time on the system service and user interface pages.

Benefits of technology

It realizes multi-channel audio stream analysis and comprehensive presentation of broadcast-level audio systems, has multi-channel analysis capabilities and resource distributed deployment capabilities, reduces device resource consumption, and supports system-level presentation of audio services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118075501B_ABST
    Figure CN118075501B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides a multi-channel audio stream analysis and presentation method and corresponding equipment for a broadcast-level audio system, including: step S10, receiving an original ST2110-30 audio stream; step S20, performing basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and converting the ST2110-30 audio stream into an NDI code stream; step S30, calculating peak data and loudness data on the NDI code stream; step S40, sending the basic analysis data of the original ST2110-30 audio stream, and the peak data and loudness data corresponding to the NDI code stream to the system service and user interface page; step S50, the system service and user interface page present the basic analysis data and the calculation result data in real time; it has the beneficial effects of multi-channel analysis and comprehensive presentation, and is applicable to the technical field of broadcast services.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of broadcast services, and specifically to a method for analyzing and presenting multi-channel audio streams in a broadcast-level audio system and corresponding equipment. Background Art

[0002] In the AoIP audio system, the existing technical solution is to use dedicated equipment to analyze the audio multicast data of ST2110-30 and display the analysis data on the interface of the dedicated equipment, such as TEK's Prism oscilloscope; these dedicated equipment have analysis capabilities and can analyze and display the data in the ST2110-30 multicast packet. The dedicated equipment is positioned as an independent professional analysis tool. When the user needs to view which ST2110-30 audio stream, the stream will be pulled over for analysis, but it does not have the ability of multi-channel analysis, does not have the ability of distributed deployment of analysis resources, and does not have the ability to comprehensively present analysis results.

[0003] In summary, the dedicated equipment in the prior art can only analyze one audio stream at a time, and there is no way to perform multi-channel real-time analysis. To achieve multi-channel audio stream analysis, the analysis can only be completed one by one through signal source polling. In addition, in this single-device analysis mode, real-time analysis of the audio stream requires a large amount of local resources of the device, which is not conducive to the expansion of the number of multi-channel audio analysis channels. In addition, the presentation of single-device analysis data is not a system-level presentation, and audio business connection cannot be achieved. Summary of the invention

[0004] In order to solve one of the above-mentioned technical defects, an embodiment of the present application provides a multi-channel audio stream analysis and presentation method and corresponding equipment of a broadcast-level audio system.

[0005] According to a first aspect of an embodiment of the present application, a method for analyzing and presenting a multi-channel audio stream of a broadcast-level audio system is provided, comprising:

[0006] Step S10, receiving the original ST2110-30 audio stream;

[0007] Step S20, performing basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and converting the ST2110-30 audio stream into an NDI code stream;

[0008] Step S30, calculating the peak data and loudness data of the NDI code stream;

[0009] Step S40, sending the basic analysis data of the original ST2110-30 audio stream, as well as the peak data and loudness data corresponding to the NDI code stream to the system service and user interface page;

[0010] Step S50: the system service and user interface page presents basic analysis data and calculation result data in real time.

[0011] Preferably, the step S50 further includes:

[0012] Whether to alarm is determined based on the basic analysis data and calculation result data. If an alarm occurs, the driver software or alarm light will give a prompt.

[0013] Preferably, in step S20, the basic analysis at the network packet level includes:

[0014] Audio packet interval analysis, audio packet size analysis and error packet analysis.

[0015] Preferably, in step S20, the basic analysis at the load coding level includes:

[0016] Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis.

[0017] Preferably, in step S20, the ST2110-30 audio stream is converted into an NDI code stream; specifically including:

[0018] The payload data in the ST2110-30 audio stream is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

[0019] Preferably, in the step S50, the basic analysis data and calculation result data presented in real time on the system service and user interface page, the basic analysis data and calculation result data presented specifically include:

[0020] Presented in the form of audio level peak data and peak meters, audio loudness data and loudness meters.

[0021] According to a second aspect of an embodiment of the present application, a multi-channel audio stream analysis and presentation system of a broadcast-level audio system is provided, comprising:

[0022] Core probe, which has a built-in ST2110-30 audio data core analysis engine;

[0023] The ST2110-30 audio data core analysis engine is used to perform basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and convert the ST2110-30 audio stream into an NDI code stream;

[0024] Distributed probes are used to calculate peak data and loudness data for NDI streams;

[0025] The presentation module is used to present basic analysis data and calculation result data in real time.

[0026] Preferably, in the core probe, the basic analysis at the network packet level includes:

[0027] Audio packet interval analysis, audio packet size analysis and error packet analysis;

[0028] The basic analysis at the load encoding level includes:

[0029] Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis.

[0030] Preferably, in the core probe, the ST2110-30 audio stream is converted into an NDI code stream; specifically including:

[0031] The payload data in the ST2110-30 audio stream is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

[0032] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored; the computer program is executed by a processor to implement the method described above.

[0033] The embodiment of the present application adopts the above technical solution, which has the following technical effects:

[0034] 1. The multi-channel audio stream analysis and presentation method and system of the broadcast-level audio system provided in the embodiment of the present application perform overall analysis and parsing of the audio stream packet level and content level through core probes and distributed probes, and can display accurate and real-time audio peak data and audio loudness data to users in real time through the presentation module, providing technical reference for staff. Compared with traditional methods, it has multi-channel analysis capabilities and comprehensive presentation capabilities.

[0035] 2. In the embodiment of the present application, the core probe and the distributed probe are used to analyze the flow, so that the analysis data can be uniformly integrated into the user's system service and user interface page for comprehensive presentation. The analysis data such as the audio peak meter, loudness meter and PTP timestamp can be combined in one module according to the user-defined presentation content. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0037] Figure 1A schematic diagram of a flow chart of a method for analyzing and presenting a multi-channel audio stream in a broadcast-level audio system provided in an embodiment of the present application;

[0038] Figure 2 A schematic diagram of the structure of a multi-channel audio stream analysis and presentation system for a broadcast-level audio system provided in an embodiment of the present application;

[0039] In the figure:

[0040] 10 is a core probe, 20 is a distributed probe, and 30 is a presentation module. DETAILED DESCRIPTION

[0041] In order to make the technical solutions and advantages in the embodiments of the present application more clearly understood, the exemplary embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than an exhaustive list of all the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0042] Embodiment 1

[0043] like Figure 1 As shown, a method for analyzing and presenting multi-channel audio streams of a broadcast-level audio system includes:

[0044] Step S10, receiving the original ST2110-30 audio stream;

[0045] Step S20, performing basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and converting the ST2110-30 audio stream into an NDI code stream;

[0046] Step S30, calculating the peak data and loudness data of the NDI code stream;

[0047] Step S40, sending the basic analysis data of the original ST2110-30 audio stream, as well as the peak data and loudness data corresponding to the NDI code stream to the system service and user interface page;

[0048] Step S50: the system service and user interface page presents basic analysis data and calculation result data in real time.

[0049] In this embodiment, the step S50 further includes:

[0050] Whether to alarm is determined based on the basic analysis data and calculation result data. If an alarm occurs, the driver software or alarm light will give a prompt.

[0051] like Figure 2 As shown, a multi-channel audio stream analysis and presentation system for a broadcast-level audio system is characterized by comprising:

[0052] Core probe 10, which has a built-in ST2110-30 audio data core analysis engine;

[0053] The ST2110-30 audio data core analysis engine is used to perform basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and convert the ST2110-30 audio stream into an NDI code stream;

[0054] Distributed probe 20, used to calculate peak data and loudness data of NDI code stream;

[0055] The presentation module 30 is used to present the basic analysis data and calculation result data in real time.

[0056] In this embodiment, the analysis of the audio stream is achieved by means of a core probe + a distributed probe, and the analysis data is comprehensively presented.

[0057] Specifically, the core probe converts the ST2110-30 audio stream into an NDI code stream; during the conversion process, the calculation of the audio level value and the loudness value is lossless, while reducing the bandwidth of the audio stream and reducing network occupancy.

[0058] Furthermore, the distributed probe is responsible for receiving the converted NDI code stream sent by the core probe, and calculating the level value (peak data) and loudness value (loudness data) of the NDI code stream. In practical applications, the distributed probe can be a terminal workstation.

[0059] The multi-channel audio stream analysis and presentation method and system for a broadcast-level audio system provided in the embodiment of the present application perform overall analysis and parsing of the audio stream packet level and content level through core probes and distributed probes, and can display accurate and real-time audio peak data and audio loudness data to users in real time through a presentation module, providing technical reference for staff. Compared with traditional methods, it has multi-channel analysis capabilities and comprehensive presentation capabilities.

[0060] Embodiment 2

[0061] On the basis of the first embodiment, in the method for analyzing and presenting multi-channel audio streams of a broadcast-level audio system, in step S20, the basic analysis at the network packet level includes:

[0062] Audio packet interval analysis, audio packet size analysis and error packet analysis.

[0063] Specifically, in step S20, the basic analysis at the load coding level includes:

[0064] Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis.

[0065] Furthermore, in the step S20, the ST2110-30 audio stream is converted into an NDI code stream; specifically including:

[0066] The payload data in the ST2110-30 audio stream is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

[0067] In this embodiment, the distributed probe 20 includes: a plurality of distributed probes capable of processing multiple payload data in parallel.

[0068] In this embodiment, in step S50, the basic analysis data and calculation result data presented in real time on the system service and user interface page include:

[0069] Presented in the form of audio level peak data and peak meters, audio loudness data and loudness meters.

[0070] Accordingly, in the multi-channel audio stream analysis and presentation system of the broadcast-level audio system provided in the second embodiment of the present application, in the core probe 10, the basic analysis at the network packet level includes:

[0071] Audio packet interval analysis, audio packet size analysis and error packet analysis;

[0072] The basic analysis at the load encoding level includes:

[0073] Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis.

[0074] Specifically, in the core probe 10, the ST2110-30 audio stream is converted into an NDI code stream; specifically including:

[0075] The payload data in the ST2110-30 audio stream is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

[0076] In this embodiment, the main work contents of the core probe include:

[0077] Stream analysis function: The core probe has a built-in ST2110-30 audio data core analysis engine, which can perform packet-by-packet analysis on the received ST2110-30 multicast data stream in real time and deeply analyze the ST2110-30 multicast data stream; the analysis content includes but is not limited to: audio sampling rate, encoding type, audio amplitude, audio packet size, error packet, PTP timestamp, etc.

[0078] Task decomposition and allocation function: In addition to completing the analysis content that needs to be completed by itself, the core probe extracts the payload data in the audio stream from the ST2110-30 stream, encapsulates the extracted audio payload data into an NDI stream, and pushes the NDI stream to the distributed probe;

[0079] The core probe converts the payload data from ST2110-30 to NDI bitstream without loss in subsequent peak and loudness calculations. Therefore, the conversion process will not affect the accuracy of subsequent analysis. The advantage of the conversion is that it reduces the bandwidth of the audio bitstream, thereby reducing the network resource consumption of the analysis server.

[0080] By completing the analysis functions of audio peak calculation and loudness calculation through distributed probes, the resource overhead of core probes can be reduced and the number of streams analyzed by core probes in real time can be increased.

[0081] Real-time submission of analysis data: The core probe provides analysis data to system services and user interface pages.

[0082] In this embodiment, the work contents of the distributed probe include:

[0083] Real-time analysis and calculation of peak data: Distributed probes receive tasks assigned by core probes, perform peak calculations on the NDI stream audio in the tasks, and obtain real-time audio level peak calculation data.

[0084] Real-time calculation of loudness data: Distributed probes receive tasks assigned by core probes, calculate the loudness of the NDI stream audio in the tasks, and obtain real-time audio loudness data.

[0085] Real-time submission of analysis data: Distributed probes provide analysis data to system services and user interface pages; enabling the pages to present audio level peak data and peak meters, audio loudness data and loudness meters in real time.

[0086] In the embodiment of the present application, core probes and distributed probes are used to analyze the flow, so that the analysis data can be uniformly integrated into the user's system service and user interface page for comprehensive presentation. The analysis data such as audio peak meter, loudness meter and PTP timestamp can be presented as a whole in one module according to the user-defined presentation content; at the same time, an upper-level standard library can be established to quickly alarm when discrepancies occur in the analysis content.

[0087] The present application also provides an electronic device, including:

[0088] memory; processor; and computer program;

[0089] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described above.

[0090] An embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored; the computer program is executed by a processor to implement the method described above.

[0091] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0092] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0093] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1A function specified in one or more boxes.

[0094] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0095] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0096] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for analyzing and presenting multi-channel audio streams in a broadcast-level audio system, characterized in that: include: Step S10, receiving the original ST2110-30 audio stream; Step S20, performing basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and converting the ST2110-30 audio stream into an NDI code stream; Step S30, calculating the peak data and loudness data of the NDI code stream; Step S40, sending the basic analysis data of the original ST2110-30 audio stream, as well as the peak data and loudness data corresponding to the NDI code stream to the system service and user interface page; Step S50, the system service and user interface page presents basic analysis data and calculation result data in real time; The step S50 further includes: Determine whether to alarm based on basic analysis data and calculation result data. If an alarm occurs, the driver software or alarm light will prompt; In step S20, the basic analysis at the network packet level includes: Audio packet interval analysis, audio packet size analysis and error packet analysis; In step S20, the basic analysis at the load coding level includes: Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis; In the step S20, the ST2110-30 audio stream is converted into an NDI code stream; specifically including: The payload data in the audio stream of step ST2110-30 is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

2. The method for analyzing and presenting multi-channel audio streams of a broadcast-level audio system according to claim 1, characterized in that: In the step S50, the basic analysis data and calculation result data are presented in real time on the system service and user interface page, and the presented basic analysis data and calculation result data specifically include: Presented in the form of audio level peak data and peak meters, audio loudness data and loudness meters.

3. A multi-channel audio stream analysis and presentation system for a broadcast-level audio system, characterized in that: include: A core probe (10) having a built-in ST2110-30 audio data core analysis engine; The ST2110-30 audio data core analysis engine is used to perform basic analysis on the received original ST2110-30 audio stream at the network packet level and the payload coding level, and convert the ST2110-30 audio stream into an NDI code stream; Distributed probes (20), which are multiple, are used to calculate peak data and loudness data of the NDI code stream; A presentation module (30), used for presenting basic analysis data and calculation result data in real time; In the core probe (10), the basic analysis at the network packet level includes: Audio packet interval analysis, audio packet size analysis and error packet analysis; The basic analysis at the load encoding level includes: Coding type analysis, audio sampling rate analysis, audio amplitude analysis and PTP timestamp analysis; In the core probe (10), the ST2110-30 audio stream is converted into an NDI code stream; specifically, the following steps are performed: The payload data in the ST2110-30 audio stream is extracted from the ST2110-30 stream, and the extracted audio payload data is encapsulated as an NDI code stream.

4. A computer-readable storage medium having a computer program stored thereon; the computer program is executed by a processor to implement the method according to any one of claims 1 to 2.

Citation Information

Patent Citations

  • Data transmission in a physical downlink control channel

    CN110786066A

  • Method and device for realizing conversion from any streaming media protocol to NDI

    CN113645485A