Methods, systems, terminals and media for detecting multi-channel sound playback faults in cinemas

Abstract

This invention discloses a method, system, terminal, and medium for detecting multi-channel sound reproduction faults in cinemas. The method involves inputting audio data into a room acoustic model for simulation to obtain a reference signal, playing and collecting audio data to obtain a recording signal, determining the activation state of each channel in each frame based on the sound pressure level (SPL) of the channels in the reference signal, comparing the SPL of the reference signal and the recording signal in each frame to determine if the SPL of each frame is abnormal, and then, based on the activation state of each channel in each frame and whether the SPL of each frame is abnormal, counting the total number of frames with channel abnormalities and the total number of frames belonging to the discrimination frames for each channel, and determining whether each channel has a fault based on the total number of abnormal frames and the total number of frames belonging to the discrimination frames. Compared with existing technologies, this method can detect which channel has a sound reproduction fault.

Description

Technical Field

[0001] This invention relates to the field of cinema fault detection technology, and in particular to a method, system, terminal and medium for detecting multi-channel sound playback faults in cinemas. Background Technology

[0002] Audio channel playback failure is one of the common problems in cinemas. Once the audio channel malfunctions, it will affect the audience's viewing experience.

[0003] While it's possible to determine if the cinema's sound is working properly by analyzing the sound pressure level during normal movie playback, it's impossible to detect which channel is malfunctioning in real time because multiple speakers are emitting sound simultaneously.

[0004] Therefore, existing technologies need to be improved and enhanced. Summary of the Invention

[0005] The main objective of this invention is to provide a method, system, smart terminal, and storage medium for detecting multi-channel audio playback faults in cinemas, aiming to solve the problem of not being able to detect which channel is faulty in real time.

[0006] To achieve the above objectives, a first aspect of the present invention provides a method for detecting multi-channel sound playback faults in cinemas, the method comprising:

[0007] Acquire multi-channel audio data;

[0008] The multi-channel audio data is input into a pre-constructed room acoustic model for acoustic simulation to obtain a reference signal;

[0009] Play the multi-channel audio data and collect it to obtain the recording signal;

[0010] Align the reference signal and the recording signal based on the time offset;

[0011] Based on a preset time interval, the reference signal and the recording signal are processed into frames.

[0012] The activation state of each channel in each frame is obtained based on the sound pressure level of each channel in each frame of the reference signal.

[0013] The sound pressure levels of the reference signal and the recording signal are compared frame by frame to obtain the sound pressure anomaly determination result for each frame;

[0014] Based on the activation state of each channel in each frame and the sound pressure anomaly determination result of each frame, the value of the anomaly counter and the value of the discrimination frame counter corresponding to each channel are obtained. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the anomaly counter is used to count the total number of frames with channel anomalies.

[0015] Based on the values ​​of the anomaly counter and the discrimination frame counter, the fault detection results for each channel are obtained and output.

[0016] Optionally, aligning the reference signal and the recording signal based on the time offset includes:

[0017] The audio delay value is obtained by comparing the time offset between the reference signal and the recording signal;

[0018] Based on the audio delay value, align the reference signal and the recording signal.

[0019] Optionally, obtaining the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal includes:

[0020] The sound pressure level of each channel is compared with the preset threshold corresponding to that channel frame by frame to obtain the activation status of each channel in each frame.

[0021] Optionally, when the audio channel has symmetrical channels, it further includes:

[0022] When the preset threshold of the channel is less than the preset threshold of the symmetrical channel, the preset threshold of the channel is added to half of the preset threshold of the symmetrical channel.

[0023] Optionally, obtaining the value of the anomaly counter and the value of the discrimination frame counter for each channel based on the activation state of each channel in each frame and the sound pressure anomaly determination result of each frame includes:

[0024] When the audio channel is an active channel or the sound pressure abnormality judgment result is a sound pressure abnormality, the value of the discrimination frame counter corresponding to that audio channel is incremented;

[0025] When a channel is active and the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is incremented; otherwise, when a channel is active or the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is decremented.

[0026] Optionally, obtaining and outputting the fault detection result for each channel based on the value of the anomaly counter and the value of the discrimination frame counter includes:

[0027] Calculate the ratio of the abnormality counter value to the discrimination frame counter value for each channel, and obtain the fault detection result for each channel based on the comparison result of the ratio and a preset threshold.

[0028] Optionally, after obtaining the fault detection results of the audio channel, the following may also be included:

[0029] The activation state of each frequency band in each frame is determined based on the sound pressure level of each frequency band in the reference signal of each frame of the faulty channel.

[0030] Based on the activation status of each frequency band in each frame and the sound pressure anomaly determination result of each frame, the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter corresponding to each frequency band are obtained. The frequency band discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the frequency band anomaly counter is used to count the total number of frames with frequency band anomalies.

[0031] Based on the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter, the fault detection result of each frequency band in the fault channel is obtained and output.

[0032] A second aspect of the present invention provides a cinema multi-channel sound playback fault detection system, wherein the system comprises:

[0033] The audio data acquisition module is used to acquire multi-channel audio data;

[0034] An acoustic simulation module is used to input the multi-channel audio data into a pre-built room acoustic model to perform acoustic simulation and obtain a reference signal;

[0035] The acquisition module is used to play and acquire the multi-channel audio data to obtain the recording signal;

[0036] An alignment module is used to align the reference signal and the recording signal based on a time offset;

[0037] The framing module is used to perform framing processing on the reference signal and the recording signal based on a preset time interval;

[0038] The activation state module is used to obtain the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal.

[0039] The sound pressure anomaly module is used to compare the sound pressure levels of the reference signal and the recording signal frame by frame to obtain the sound pressure anomaly determination result for each frame.

[0040] The statistics module is used to obtain the value of the abnormal counter and the value of the discrimination frame counter for each channel based on the activation state of each channel in each frame and the sound pressure abnormality judgment result of each frame. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the abnormal counter is used to count the total number of frames with channel abnormalities.

[0041] The fault determination module is used to obtain and output the fault detection result of each channel based on the value of the abnormality counter and the value of the discrimination frame counter.

[0042] A third aspect of the present invention provides a smart terminal, the smart terminal including a memory, a processor, and a cinema multi-channel sound playback fault detection program stored in the memory and executable on the processor, wherein the cinema multi-channel sound playback fault detection program, when executed by the processor, implements any of the steps of the above-mentioned cinema multi-channel sound playback fault detection method.

[0043] A fourth aspect of the present invention provides a computer-readable storage medium storing a cinema multi-channel sound playback fault detection program, wherein the cinema multi-channel sound playback fault detection program, when executed by a processor, implements any of the steps of the above-described cinema multi-channel sound playback fault detection method.

[0044] As can be seen from the above, this invention simulates audio data by inputting it into a room acoustic model to obtain a reference signal, plays and collects audio data to obtain a recording signal, determines the activation state of each channel in each frame based on the sound pressure level of the channels in the reference signal, compares the sound pressure levels of the reference signal and the recording signal in each frame to determine whether the sound pressure level of each frame is abnormal, and then, based on the activation state of each channel in each frame and whether the sound pressure level of each frame is abnormal, counts the total number of frames with channel abnormalities and the total number of frames belonging to the discrimination frames in each channel. Based on the total number of frames with channel abnormalities and the total number of frames belonging to the discrimination frames, it determines whether each channel has a fault. Compared with the prior art, this invention can detect which channel has a sound reproduction fault. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a schematic flowchart of the cinema multi-channel sound reproduction fault detection method provided in the embodiment of the present invention;

[0047] Figure 2 yes Figure 1 Block diagram of cinema multi-channel sound playback fault detection function in an embodiment;

[0048] Figure 3 yes Figure 1 A schematic diagram of the vocal tract test results in the embodiment;

[0049] Figure 4 This is a schematic diagram illustrating the specific process for frequency band detection of a faulty audio channel;

[0050] Figure 5 This is a schematic diagram of the structure of the cinema multi-channel sound reproduction fault detection system provided in an embodiment of the present invention;

[0051] Figure 6 This is a block diagram illustrating the internal structure of a smart terminal provided in an embodiment of the present invention. Detailed Implementation

[0052] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of the invention. However, those skilled in the art will understand that the invention can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods are omitted so as not to obscure the description of the invention with unnecessary detail.

[0053] It should be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0054] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0055] It should also be further understood that the term "and / or" as used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0056] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0057] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0058] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0059] While it is possible to analyze whether the sound pressure level is abnormal and whether the overall sound reproduction of the cinema is normal during normal movie playback, it is impossible to determine which channel has a sound reproduction problem because multiple speakers are emitting sound at the same time.

[0060] Through practice, it has been found that when the sound is divided into shorter time segments, if an abnormality occurs in a certain time segment, the channel with higher energy in that time segment is more likely to have a problem, while the channel with lower energy is less likely to have a problem; if no abnormality occurs in a certain time segment, the channel with higher energy in that time segment is also less likely to have a problem.

[0061] Therefore, the present invention provides a method for detecting multi-channel sound playback faults in cinemas. By inputting audio data into a room acoustic model for simulation, obtaining a reference signal, playing and recording the audio data, obtaining the recording signal, and counting the total number of frames with abnormal sound pressure levels in each channel and the total number of frames that need to be judged within a certain period of time, the probability of each channel having a problem is determined, thereby detecting the channel with the sound playback fault.

[0062] Exemplary methods

[0063] This invention provides a method for detecting multi-channel sound reproduction faults in cinemas. The method, as a detection module running on the cinema's backend server, automatically detects whether sound reproduction faults exist in the cinema's sound channels. Specifically, as shown... Figure 1 As shown, this embodiment includes the following steps:

[0064] Step S100: Acquire multi-channel audio data;

[0065] Specifically, the stereo sound systems currently used in cinemas are typically 5.1 channels, including a center channel, front left and right channels, rear left and right surround channels, and a subwoofer channel. The center channel, also known as the main channel, contains human voices and close-up action sounds (including breathing and footsteps). The left and right channels mainly contain background music and ambient sounds from distant scenes. The audio data can be pre-recorded audio streams or selected segments of the film.

[0066] In some possible implementations, the stereo sound system used in the cinema is 7.1 channel or 15.1 channel, and correspondingly, the audio data is also a 7.1 channel audio stream or a 15.1 channel audio stream; if the audio data is still a 5.1 channel audio stream, it can be converted into a 7.1 channel audio stream or a 15.1 channel audio stream through a channel mapping table, and then used for sound reproduction fault detection.

[0067] like Figure 2 As shown, the audio data in this embodiment comes from a digital cinema media server. It includes audio streams from each channel input to the audio mixing and routing module. Then, after equalization and delay processing by the equalization and delay module, the audio data from each channel is input to the power amplifier and transmitted to the speakers. Therefore, the audio data for each channel can be obtained from the audio mixing and routing module.

[0068] Step S200: Input multi-channel audio data into a pre-built room acoustic model to perform acoustic simulation and obtain a reference signal;

[0069] Specifically, based on the cinema's projection space structure, room acoustic environment modeling is employed to obtain a room acoustic model that includes multiple sound sources and multiple receivers. The room acoustic model models the propagation process of sound signals according to the structure of the acoustic environment, accurately simulating the room's impulse response.

[0070] After the room acoustic model is established, multi-channel audio data is input, and the audio data is simulated to be played through various speakers in the cinema. The sound signals at various set locations in the cinema are obtained based on the room acoustic model as reference signals and compared with the sound signals collected on-site in the cinema.

[0071] Constructing a room acoustic model based on acoustic parameters and obtaining sound signals at a set location is a conventional technique in this field, and will not be elaborated upon here.

[0072] Step S300: Play and acquire multi-channel audio data to obtain a recording signal;

[0073] Specifically, the audio data of each channel is transmitted to the speakers of each channel, and the audio data is played in the cinema through the speakers. At the same time, the microphone array collects sound signals at a set position in the cinema room to obtain the recording signal.

[0074] When using a microphone array to capture sound, it is best not to place the microphone array on the center line of the cinema. This ensures that even if the left and right channels contain the same content, there will be an energy difference and a time difference in the time it takes for the sound to reach the microphone, making it easier to distinguish between them.

[0075] Step S400: Align the reference signal and the recording signal based on the time offset;

[0076] Specifically, the reference signal obtained from the room acoustic model and the recording signal obtained from the cinema recording will exhibit audio asynchrony. This asynchrony results in a time offset. By analyzing and comparing the waveforms of the reference signal and the recording signal, the time offset, i.e., the audio delay value, is obtained. The phase of the reference signal or recording signal is then corrected based on the obtained audio delay value to achieve alignment. This technique of aligning audio signals based on audio delay correction is widely used in remote conferencing and cinema projection and is a standard technique in this field, so it will not be elaborated upon further here.

[0077] In some examples, the reference signal and the recording signal are transformed by FFT (Fast Fourier Transform) to obtain the corresponding phase spectrum and amplitude spectrum, and the difference between the phase spectra is compared to determine the audio delay value.

[0078] Step S500: Based on a preset time interval, perform frame segmentation processing on the reference signal and the recording signal;

[0079] Specifically, the reference signal and the recording signal are framed from the starting position or a preset position according to a preset time length (e.g., 5 seconds), and the length of each frame is the preset time length. The preset position can be set as needed, such as 5 minutes after the starting position.

[0080] Step S600: Obtain the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal.

[0081] Specifically, after frame-by-frame processing, the reference signal is analyzed frame by frame to obtain the audio data of each channel in each frame. The sound pressure level (SPL) is calculated based on the audio data, and the SPL of each channel is compared with its corresponding preset threshold. If the SPL of a channel is greater than the preset threshold, that channel is determined to be an active channel; otherwise, it is a non-active channel. This process is repeated for each channel to determine its activation status. For example, if the SPL of the left channel in the current frame S1 is 60 dB and the preset threshold for the left channel is 50 dB, then the left channel is determined to be an active channel in the current frame S1. It should be noted that multiple active channels may exist simultaneously in the same frame; the preset thresholds for all channels can be set to be the same, or different preset thresholds can be set for different channels based on the content of the reference signal.

[0082] In one example, since the microphone array for collecting sound is not placed on the center line of the cinema, there are energy difference and time difference between the sound signals of symmetrical channels (such as left channel and right channel) when they reach the microphone. Therefore, for channels with symmetrical channels, the preset threshold of the channel is processed to increase the separation degree of the symmetrical channels. Specifically, when the preset threshold of a channel is less than the preset threshold of its symmetrical channel, half of the preset threshold of the symmetrical channel is added to the preset threshold of this channel. For example, CH5 and CH6 are left surround channel and right surround channel, the preset threshold of CH5 is T1, and the preset threshold of CH6 is T2. Assuming that the microphone is deviated to the left of the center line, T1 < T2, then the preset threshold of T1 can be adjusted to (T1+T2 / 2), thereby increasing the separation degree of CH5 and CH6.

[0083] Step S700: Compare the sound pressure levels of the reference signal and the recorded signal frame by frame to obtain the sound pressure abnormality determination result of each frame.

[0084] Specifically, the sound pressure levels of the reference signal and the recorded signal are subtracted frame by frame. If the difference between the two sound pressure levels exceeds the preset sound pressure difference threshold, the sound pressure abnormality determination result of this frame is sound pressure abnormality, and this frame is also called a sound pressure abnormal frame; otherwise, the frame is determined as a sound pressure normal frame. For example: in the current frame S1, the sound pressure level of the reference signal is 60 decibels, and the sound pressure level of the recorded signal is 50 decibels, the difference between the two sound pressure levels is 10 decibels, which exceeds the preset sound pressure difference threshold (5 decibels), so the sound pressure of the current frame S1 is determined to be abnormal. The preset sound pressure difference threshold is set based on experience according to the spatial structure of the cinema.

[0085] Step S800: Obtain the value of the abnormality counter corresponding to each channel and the value of the discrimination frame counter according to the activation state of each channel of each frame and the sound pressure abnormality determination result of each frame. The above-mentioned discrimination frame counter is used to count the total number of frames belonging to discrimination frames, and the above-mentioned abnormality counter is used to count the total number of frames with channel abnormality;

[0086] Specifically, according to the needs of film content expression, certain time periods can be divided into different sections such as dialogue (dominated by center channel energy), background sound (dominated by left and right channel energy), and ambient sound (dominated by surround channel energy). According to which section the time point of the sound pressure abnormality falls into, it can be estimated whether the faulty channel is the center channel, the left and right channels or the surround channel. After statistics over a period of time, the probability of problems occurring in each channel can be obtained.

[0087] Based on the activation status of each channel in each frame and the sound pressure anomaly determination result of each frame, all possible cases are combined, resulting in four cases as shown in Table 1. For example, for frame S with channel A, we can obtain: frame S with sound pressure anomaly, channel A is an active channel (discrimination frame type 1); frame S with sound pressure anomaly, channel A is an inactive channel (discrimination frame type 3); frame S with normal sound pressure, channel A is an active channel (discrimination frame type 2); and frame S with normal sound pressure, channel A is an inactive channel (non-discrimination frame). Frames with discrimination frame types 1 to 3 are all discrimination frames, which need to be analyzed and judged to assign values ​​to the anomaly counter. Frames that are non-discrimination frames do not need to be analyzed and judged and can be ignored.

[0088] Table 1. Correspondence between Frame Type and Anomaly Counter, and Frame Type Counter

[0089]

[0090] Each channel is equipped with two types of counters: an exception counter that counts the total number of frames with channel anomalies and a discrimination frame counter that counts the total number of frames belonging to the discrimination frame. Taking channel A as an example, if the sound pressure level of channel A is abnormal in the current frame S and channel A is an active channel (i.e., discrimination frame type 1), then the exception counter is incremented by one and the discrimination frame counter is incremented by one; if the sound pressure level of channel A is abnormal in the current frame S and channel A is an inactive channel (i.e., discrimination frame type 3), then the exception counter is decremented by one and the discrimination frame counter is incremented by one; other cases are deduced from Table 1 and so on.

[0091] This embodiment tested 7.1 channel audio and obtained the following results: Figure 3 The results shown indicate that the shaded blocks corresponding to CH1 to CH8 represent active channels, and the shaded blocks corresponding to sound pressure anomalies represent frames with sound pressure anomalies. After statistical analysis, the values ​​of the anomaly counters and the discrimination frame counters for each channel can be obtained as shown in Table 2.

[0092] Table 2. Statistical Results for Each Channel

[0093]

[0094] Step S900: Obtain and output the fault detection results for each channel based on the values ​​of the anomaly counter and the discrimination frame counter.

[0095] Specifically, the probability of a channel malfunction is represented by the ratio between the value of the anomaly counter for each channel and the value of the discrimination frame counter. A ratio closer to 1 indicates a higher probability of a malfunction in that channel, while a ratio closer to -1 indicates a lower probability. This ratio is compared to a preset threshold (e.g., 0.9). If the ratio is greater than the preset threshold, the channel is determined to be malfunctioning.

[0096] In this embodiment, it can be determined from Table 2 that the CH3 channel is faulty.

[0097] As described above, when multiple channels and frequency bands emit sound simultaneously, the activation state of each channel in each frame, the abnormality of the sound pressure level in each frame, and the total number of frames with channel abnormalities and the total number of frames belonging to the discrimination frame are counted. Based on the number of abnormal frames and the total number of frames belonging to the discrimination frame, it is determined whether each channel has a fault. Therefore, the probability of a channel fault can be estimated based on the correlation between the channel activation state and the occurrence of sound pressure abnormalities, thereby detecting which channel has a playback fault.

[0098] In some embodiments, after obtaining the fault detection results of a channel, in order to further analyze which frequency bands the fault occurs in the faulty channel, such as... Figure 4 As shown, it also includes the following steps:

[0099] Step S910: Determine the activation state of each frequency band in each frame based on the sound pressure level of each frequency band in the reference signal of each frame of the faulty channel.

[0100] Specifically, in step S600, the activation state of each channel in each frame can be determined. By replacing the channel in step S600 with the frequency band of the faulty channel, the activation state of each frequency band in each frame can be determined.

[0101] Step S920: Based on the activation status of each frequency band in each frame and the sound pressure anomaly determination result of each frame, obtain the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter corresponding to each frequency band. The frequency band discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the frequency band anomaly counter is used to count the number of frames with frequency band anomalies.

[0102] Specifically, similar to step S800, by replacing the audio channel with a frequency band, the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter for each frequency band can be obtained.

[0103] Step S930: Based on the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter, obtain and output the fault detection results for each frequency band in the fault channel.

[0104] Specifically, the probability of a frequency band malfunction is represented by the ratio between the value of the band anomaly counter and the value of the band discrimination frame counter for each frequency band. The closer this ratio is to 1, the higher the probability of a malfunction in that frequency band; the closer the ratio is to -1, the lower the probability of a malfunction. This ratio is compared to a preset threshold (e.g., 0.9). If it is greater than the preset threshold, the frequency band is determined to be faulty.

[0105] As mentioned above, further analysis of the abnormal frequency bands can more clearly pinpoint the faulty component. For example, dividing the frequency bands into high, mid, and low frequencies allows analysis to determine whether the faulty speaker unit is the tweeter, woofer, or midrange driver. This improves the accuracy of fault diagnosis.

[0106] Exemplary System

[0107] like Figure 5 As shown, corresponding to the above-described cinema multi-channel sound playback fault detection method, this embodiment of the invention also provides a cinema multi-channel sound playback fault detection system, the system comprising:

[0108] The audio data acquisition module 600 is used to acquire multi-channel audio data;

[0109] The acoustic simulation module 610 is used to input the multi-channel audio data into a pre-built room acoustic model to perform acoustic simulation and obtain a reference signal;

[0110] Acquisition module 620 is used to play and acquire the multi-channel audio data to obtain a recording signal;

[0111] Alignment module 630 is used to align the reference signal and the recording signal based on the time offset;

[0112] The framing module 640 is used to perform framing processing on the reference signal and the recording signal based on a preset time interval;

[0113] The activation state module 650 is used to obtain the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal.

[0114] The sound pressure anomaly module 660 is used to compare the sound pressure levels of the reference signal and the recording signal frame by frame to obtain the sound pressure anomaly determination result for each frame.

[0115] The statistics module 670 is used to obtain the value of the abnormal counter and the value of the discrimination frame counter for each channel based on the activation state of each channel in each frame and the sound pressure abnormality judgment result of each frame. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the abnormal counter is used to count the total number of frames with channel abnormalities.

[0116] The fault determination module 680 is used to obtain and output the fault detection result of each channel based on the value of the abnormality counter and the value of the discrimination frame counter.

[0117] Specifically, in this embodiment, the specific functions of each module of the above-mentioned cinema multi-channel sound playback fault detection system can be referred to the corresponding description in the above-mentioned cinema multi-channel sound playback fault detection method, and will not be repeated here.

[0118] Based on the above embodiments, the present invention also provides a smart terminal, the principle block diagram of which can be as follows: Figure 6 As shown. The aforementioned smart terminal includes a processor, memory, network interface, and display screen connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and a cinema multi-channel sound fault detection program. The internal memory provides an environment for the operation of the operating system and the cinema multi-channel sound fault detection program stored in the non-volatile storage medium. The network interface of the smart terminal is used for communication with external terminals via a network connection. When the cinema multi-channel sound fault detection program is executed by the processor, it implements the steps of any of the aforementioned cinema multi-channel sound fault detection methods. The display screen of the smart terminal can be a liquid crystal display (LCD) or an e-ink display.

[0119] Those skilled in the art will understand that Figure 6 The block diagram shown is merely a partial structural diagram related to the present invention and does not constitute a limitation on the smart terminal to which the present invention is applied. A specific smart terminal may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0120] In one embodiment, a smart terminal is provided, the smart terminal including a memory, a processor, and a cinema multi-channel sound playback fault detection program stored in the memory and executable on the processor, wherein the cinema multi-channel sound playback fault detection program performs the following operation instructions when executed by the processor:

[0121] Acquire multi-channel audio data;

[0122] The multi-channel audio data is input into a pre-constructed room acoustic model for acoustic simulation to obtain a reference signal;

[0123] Play the multi-channel audio data and collect it to obtain the recording signal;

[0124] Align the reference signal and the recording signal based on the time offset;

[0125] Based on a preset time interval, the reference signal and the recording signal are processed into frames.

[0126] The activation state of each channel in each frame is obtained based on the sound pressure level of each channel in each frame of the reference signal.

[0127] The sound pressure levels of the reference signal and the recording signal are compared frame by frame to obtain the sound pressure anomaly determination result for each frame;

[0128] Based on the activation state of each channel in each frame and the sound pressure anomaly determination result of each frame, the value of the anomaly counter and the value of the discrimination frame counter corresponding to each channel are obtained. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the anomaly counter is used to count the total number of frames with channel anomalies.

[0129] Based on the values ​​of the anomaly counter and the discrimination frame counter, the fault detection results for each channel are obtained and output.

[0130] Optionally, aligning the reference signal and the recording signal based on the time offset includes:

[0131] The audio delay value is obtained by comparing the time offset between the reference signal and the recording signal;

[0132] Based on the audio delay value, align the reference signal and the recording signal.

[0133] Optionally, obtaining the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal includes:

[0134] The sound pressure level of each channel is compared with the preset threshold corresponding to that channel frame by frame to obtain the activation status of each channel in each frame.

[0135] Optionally, when the audio channel has symmetrical channels, it further includes:

[0136] When the preset threshold of the channel is less than the preset threshold of the symmetrical channel, the preset threshold of the channel is added to half of the preset threshold of the symmetrical channel.

[0137] Optionally, obtaining the value of the anomaly counter and the value of the discrimination frame counter for each channel based on the activation state of each channel in each frame and the sound pressure anomaly determination result of each frame includes:

[0138] When the audio channel is an active channel or the sound pressure abnormality judgment result is a sound pressure abnormality, the value of the discrimination frame counter corresponding to that audio channel is incremented;

[0139] When a channel is active and the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is incremented; otherwise, when a channel is active or the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is decremented.

[0140] Optionally, obtaining and outputting the fault detection result for each channel based on the value of the anomaly counter and the value of the discrimination frame counter includes:

[0141] Calculate the ratio of the abnormality counter value to the discrimination frame counter value for each channel, and obtain the fault detection result for each channel based on the comparison result of the ratio and a preset threshold.

[0142] Optionally, after obtaining the fault detection results of the audio channel, the following may also be included:

[0143] The activation state of each frequency band in each frame is determined based on the sound pressure level of each frequency band in the reference signal of each frame of the faulty channel.

[0144] Based on the activation status of each frequency band in each frame and the sound pressure anomaly determination result of each frame, the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter corresponding to each frequency band are obtained. The frequency band discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the frequency band anomaly counter is used to count the total number of frames with frequency band anomalies.

[0145] Based on the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter, the fault detection result of each frequency band in the fault channel is obtained and output.

[0146] This invention also provides a computer-readable storage medium storing a cinema multi-channel sound playback fault detection program. When the cinema multi-channel sound playback fault detection program is executed by a processor, it implements the steps of any of the cinema multi-channel sound playback fault detection methods provided in this invention.

[0147] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0148] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the above device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this invention. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0149] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0150] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0151] In the embodiments provided by this invention, it should be understood that the disclosed apparatus / terminal devices and methods can be implemented in other ways. For example, the apparatus / terminal device embodiments described above are merely illustrative. For instance, the division of the above modules or units is merely a logical functional division, and in actual implementation, it can be divided in other ways. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0152] If the integrated modules / units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction.

[0153] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions are not in essence a departure from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.

Claims

1. A method for detecting multi-channel sound playback faults in cinemas, characterized in that, The method includes: Acquire multi-channel audio data; The multi-channel audio data is input into a pre-constructed room acoustic model for acoustic simulation to obtain a reference signal; Play the multi-channel audio data and collect it to obtain the recording signal; Align the reference signal and the recording signal based on the time offset; Based on a preset time interval, the reference signal and the recording signal are processed into frames. The activation state of each channel in each frame is obtained based on the sound pressure level of each channel in each frame of the reference signal. The sound pressure levels of the reference signal and the recording signal are compared frame by frame to obtain the sound pressure anomaly determination result for each frame; When a channel is active or the sound pressure anomaly determination result is a sound pressure anomaly, the value of the discrimination frame counter corresponding to that channel is incremented; when a channel is active and the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is incremented; otherwise, when a channel is active or the sound pressure anomaly determination result is a sound pressure anomaly, the value of the anomaly counter corresponding to that channel is decremented. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the anomaly counter is used to count the total number of frames with channel anomalies. Based on the values ​​of the anomaly counter and the discrimination frame counter, the fault detection results for each channel are obtained and output.

2. The cinema multi-channel sound reproduction fault detection method as described in claim 1, characterized in that, The alignment of the reference signal and the recording signal based on the time offset includes: The audio delay value is obtained by comparing the time offset between the reference signal and the recording signal; Based on the audio delay value, align the reference signal and the recording signal.

3. The cinema multi-channel sound reproduction fault detection method as described in claim 1, characterized in that, The step of obtaining the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of reference signal includes: The sound pressure level of each channel is compared with the preset threshold corresponding to that channel frame by frame to obtain the activation status of each channel in each frame.

4. The cinema multi-channel sound reproduction fault detection method as described in claim 3, characterized in that, When the vocal tract has symmetrical vocal tracts, it further includes: When the preset threshold of the channel is less than the preset threshold of the symmetrical channel, the preset threshold of the channel is added to half of the preset threshold of the symmetrical channel.

5. The cinema multi-channel sound reproduction fault detection method as described in claim 1, characterized in that, The step of obtaining and outputting the fault detection result for each channel based on the value of the anomaly counter and the value of the discrimination frame counter includes: Calculate the ratio of the abnormality counter value to the discrimination frame counter value for each channel, and obtain the fault detection result for each channel based on the comparison result of the ratio and a preset threshold.

6. The cinema multi-channel sound reproduction fault detection method as described in claim 1, characterized in that, After obtaining the fault detection results for the audio channel, the following is also included: The activation state of each frequency band in each frame is determined based on the sound pressure level of each frequency band in the reference signal of each frame of the faulty channel. Based on the activation status of each frequency band in each frame and the sound pressure anomaly determination result of each frame, the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter corresponding to each frequency band are obtained. The frequency band discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the frequency band anomaly counter is used to count the total number of frames with frequency band anomalies. Based on the value of the frequency band anomaly counter and the value of the frequency band discrimination frame counter, the fault detection result of each frequency band in the fault channel is obtained and output.

7. A cinema multi-channel sound reproduction fault detection system, characterized in that, The system includes: The audio data acquisition module is used to acquire multi-channel audio data; An acoustic simulation module is used to input the multi-channel audio data into a pre-built room acoustic model to perform acoustic simulation and obtain a reference signal; The acquisition module is used to play and acquire the multi-channel audio data to obtain the recording signal; An alignment module is used to align the reference signal and the recording signal based on a time offset; The framing module is used to perform framing processing on the reference signal and the recording signal based on a preset time interval; The activation state module is used to obtain the activation state of each channel in each frame based on the sound pressure level of each channel in each frame of the reference signal. The sound pressure anomaly module is used to compare the sound pressure levels of the reference signal and the recording signal frame by frame to obtain the sound pressure anomaly determination result for each frame. The statistics module is used to increment the value of the discrimination frame counter corresponding to the channel when the channel is an active channel or the sound pressure anomaly determination result is a sound pressure anomaly; and to increment the value of the anomaly counter corresponding to the channel when the channel is an active channel and the sound pressure anomaly determination result is a sound pressure anomaly. Otherwise, it decrements the value of the anomaly counter corresponding to the channel when the channel is an active channel or the sound pressure anomaly determination result is a sound pressure anomaly. The discrimination frame counter is used to count the total number of frames belonging to the discrimination frame, and the anomaly counter is used to count the total number of frames with channel anomalies. The fault determination module is used to obtain and output the fault detection result of each channel based on the value of the abnormality counter and the value of the discrimination frame counter.

8. A smart terminal, characterized in that, The smart terminal includes a memory, a processor, and a cinema multi-channel sound playback fault detection program stored in the memory and executable on the processor. When the cinema multi-channel sound playback fault detection program is executed by the processor, it implements the steps of the cinema multi-channel sound playback fault detection method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a cinema multi-channel sound playback fault detection program, which, when executed by a processor, implements the steps of the cinema multi-channel sound playback fault detection method as described in any one of claims 1-6.

Images