Inspection method of conference room audio system, medium and program product

Abstract

The invention discloses an inspection method for a conference room audio system, a medium and a program product. The method comprises the following steps: determining at least one target audio device to be inspected in a conference room audio system; performing performance index detection on the at least one target audio device by controlling a loudspeaker in the at least one target audio device to play a corresponding test audio and controlling a corresponding microphone in the at least one target audio device to collect the audio played by the loudspeaker; and generating an inspection report of the conference room audio system according to the performance index detection result of the at least one target audio device. Therefore, the original audio equipment in the conference room audio system can be efficiently utilized to realize automatic inspection of the conference room audio system, so that the operation health state of the conference room audio system can be monitored in real time, the inspection report can be quickly generated, and the inspection efficiency and the detection accuracy of the conference room audio system are remarkably improved; conference audio quality and system stability are ensured, and hardware and labor cost are saved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of audio equipment detection, and in particular to a method, medium and program product for inspecting a conference room audio system. Background Art

[0002] With the popularity of remote and virtual meetings, conference rooms play a vital role in modern communication, placing high demands on audio systems to ensure clear transmission of remote and local sounds. Conference room audio systems usually include audio devices such as speakers, microphones, and all-in-one conference machines. These audio devices often have audio problems such as echo, reflection, environmental noise interference, audio distortion, signal interruption, freeze, unclear voice, etc. These problems will seriously affect the audio quality and communication effect of the meeting.

[0003] At present, professionals are usually required to conduct regular on-site inspections of conference room audio systems using additional equipment (such as sound level meters) to record the operating status and performance indicators of the equipment. This inspection method is inefficient, cumbersome, time-consuming and labor-intensive, with high hardware and labor costs. It is unable to achieve real-time status perception and rapid response to problems, and is difficult to meet the inspection needs of a large number of conference rooms. Summary of the invention

[0004] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0005] In a first aspect, the present disclosure provides a method for inspecting a conference room audio system, comprising:

[0006] Determine at least one target audio device to be inspected in the conference room audio system;

[0007] Performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play corresponding test audio and a corresponding microphone in the at least one target audio device to collect audio played by the speaker;

[0008] An inspection report of the conference room audio system is generated according to the performance indicator detection result of the at least one target audio device.

[0009] In a second aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the inspection method of the conference room audio system provided in the first aspect of the present disclosure.

[0010] In a third aspect, the present disclosure provides an electronic device, including:

[0011] a storage device having a computer program stored thereon;

[0012] A processing device is used to execute the computer program in the storage device to implement the steps of the inspection method of the conference room audio system provided in the first aspect of the present disclosure.

[0013] In a fourth aspect, the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the inspection method of the conference room audio system provided in the first aspect of the present disclosure.

[0014] In the above technical solution, when conducting an inspection of the conference room audio system, first determine at least one target audio device to be inspected in the conference room audio system, then perform a performance index test on the at least one target audio device by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker; finally, generate an inspection report of the conference room audio system based on the performance index test results of the at least one target audio device. In this way, the original audio devices in the conference room audio system can be efficiently utilized to realize automatic inspection of the conference room audio system, facilitate real-time monitoring of the operating health status of the conference room audio system, quickly generate inspection reports, and significantly improve the inspection efficiency and detection accuracy of the conference room audio system, thereby ensuring the conference audio quality and system stability, and saving hardware and labor costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale. In the drawings:

[0016] Figure 1A The figure is an architecture diagram of a conference room audio system according to an exemplary embodiment.

[0017] Figure 1B The figure is an architecture diagram of a conference room audio system according to another exemplary embodiment.

[0018] Figure 1C is an architecture diagram of a conference room audio system according to yet another exemplary embodiment.

[0019] Figure 2 The present invention is a flow chart of a method for inspecting a conference room audio system according to an exemplary embodiment.

[0020] Figure 3 The present invention is a flowchart showing a process of inspecting a conference room audio system according to an exemplary embodiment.

[0021] Figure 4 The diagram is a flow diagram of a patrol signal of a conference room audio system according to an exemplary embodiment.

[0022] Figure 5 The present invention is a block diagram of a device for inspecting a conference room audio system according to an exemplary embodiment.

[0023] Figure 6 The diagram is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0024] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0025] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0026] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0027] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0028] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0029] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0030] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0032] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0033] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0034] At the same time, it is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0035] The audio system of a conference room usually includes: the physical spatial acoustic environment, the audio central control (for example, conference terminals, remote servers (for example, main control center), etc.), as well as audio equipment such as speakers, microphones, and all-in-one conference machines. Among them, the physical spatial acoustic environment includes sound-absorbing materials, reflection characteristics of walls and ceilings, reverberation time, environmental noise, etc. These factors directly affect the audio quality. The audio central control is used for the overall control of sound signals. Speakers are used for playing audio, amplifying sound, etc., and microphones are used to collect sound signals. The all-in-one conference machine integrates hardware devices (such as microphones, speakers) and audio processing algorithms (such as automatic gain control (AGC), acoustic echo cancellation (AEC), and noise suppression (ANS)) to provide an overall solution.

[0036] According to actual application requirements, conference room audio systems can be divided into three types: local deployment, remote deployment, and local + remote deployment to meet different privacy and data processing requirements.

[0037] In one embodiment, the conference room audio system can use Figure 1A The remote deployment method shown in . Figure 1A As shown, the conference room audio system may include audio devices and remote servers connected via a wide area network, wherein the audio devices are located in the local physical conference room, and the remote server is a remote server, such as a cloud server. The conference room audio system includes microphone M1, speaker Y1, all-in-one conference machine, microphone M2, microphone M3, speaker Y2 and other audio devices, and the remote server is connected to these audio devices via a wide area network. Figure 3 and Figure 4 As shown, the remote server directly controls the audio equipment through the network to collect and control data. All data analysis and calculations (including the operation of artificial intelligence models) involved in the inspection of the conference room audio system, that is, artificial intelligence (AI) analysis, are performed on the remote server. The remote deployment method is suitable for scenarios with low privacy requirements, high computing performance requirements, and the need to simplify the system architecture. Among them, the artificial intelligence model includes a variety of algorithm modules or sub-models for analyzing various performance indicators of audio signals, such as the deep noise reduction model mentioned below, the short-time objective intelligibility index algorithm, and the recurrent neural network.

[0038] In another embodiment, the conference room audio system can be used Figure 1B The local + remote deployment method shown in . Figure 1B As shown, the conference room audio system includes audio equipment, conference terminals and remote servers, wherein the conference terminals and audio equipment are connected via a local area network (for example, via Bluetooth, network cable, WiFi, etc.), and the conference terminals and remote servers are connected via a wide area network. The audio equipment and conference terminals are located in the local physical conference room, and the remote server is a remote server. Figure 3 and Figure 4 As shown in the figure, the remote server controls the conference terminal through the wide area network, and the conference terminal controls the audio device through the local area network. Figure 1BAs shown in the figure, the conference room audio system includes microphone M1, speaker Y1, all-in-one conference machine, microphone M2, microphone M3, speaker Y2 and other audio devices. The conference terminal is connected to these audio devices through a local area network. According to the privacy and computing performance requirements, the data analysis and calculation (including the operation of artificial intelligence models) involved in the inspection of the conference room audio system can be performed on a remote server or on the conference terminal, but the performance indicator test results of the audio equipment need to be transmitted back to the remote server (such as Figure 4 shown).

[0039] In yet another embodiment, the conference room audio system may be implemented using Figure 1C The local deployment method shown in . Figure 1C As shown, the conference room audio system includes audio equipment and conference terminals connected via a local area network, and the audio equipment and conference terminals are located in the local physical conference room. Figure 1C As shown in the figure, the conference room audio system includes microphone M1, speaker Y1, conference all-in-one machine, microphone M2, microphone M3, speaker Y2 and other audio devices. The conference terminal is connected to these audio devices through a local area network. All data analysis and calculations involved in the inspection of the conference room audio system (including the operation of artificial intelligence models) are performed on the conference terminal. The local deployment method is suitable for scenarios with high privacy requirements, and the data does not leave the local area.

[0040] The remote server is connected to the conference terminal or directly connected to the audio device via the wide area network. Its main functions include: running artificial intelligence models to process data collected from conference terminals and audio devices; providing remote control, management, maintenance and upgrade functions for conference terminals and audio devices; storing all inspection data and analysis results (i.e., performance indicator test results of audio devices) for later viewing and analysis; in the case of remote deployment, the remote server can skip the conference terminal and directly connect to the audio device via the wide area network for data collection and control, and send test audio to the audio device for playback.

[0041] The conference terminal connects to various audio devices (microphones, speakers, and all-in-one conference machines) in the conference room through a local area network. Its main functions include: controlling the working status of the audio device; collecting data from the audio device and sending test audio to the audio device for playback; in the case of local processing, the conference terminal can run an artificial intelligence model to analyze the audio signal, and decide whether to analyze and transmit it back to the remote server based on the deployment method.

[0042] Figure 2 FIG. 1 is a flow chart showing a method for inspecting a conference room audio system according to an exemplary embodiment. Figure 2 As shown, the inspection method may include the following S101 to S103.

[0043] In S101, at least one target audio device to be inspected in the conference room audio system is determined.

[0044] In the present disclosure, the at least one target audio device to be inspected may include all audio devices in the conference room audio system, or may be part of the audio devices, and the user may specify the audio device to be inspected.

[0045] In S102, a performance indicator test is performed on at least one target audio device by controlling a speaker in at least one target audio device to play a corresponding test audio and a corresponding microphone in at least one target audio device to collect the audio played by the speaker.

[0046] In S103, an inspection report of the conference room audio system is generated according to the performance indicator detection result of at least one target audio device.

[0047] In the present disclosure, the above inspection method can be executed by a conference terminal, can be executed by a remote server, or can be executed collaboratively by a conference terminal and a remote server.

[0048] In one implementation, the conference room audio system is deployed locally. In this case, the inspection method is performed by the conference terminal. Figure 3 shown.

[0049] In another embodiment, the conference room audio system is remotely deployed. In this case, the inspection method is executed by a remote server. Figure 3 shown.

[0050] In another embodiment, the conference room audio system adopts a local + remote deployment mode. In this case, the inspection method can be executed collaboratively by the conference terminal and the remote server.

[0051] When the conference terminal and the remote server cooperate to perform the above inspection method, the data analysis and calculation involved in the inspection of the conference room audio system can be performed at the conference terminal. After obtaining the performance index detection result of at least one target audio device, the conference terminal transmits it back to the remote server, so that the remote server generates an inspection report of the conference room audio system according to the received performance index detection result of at least one target audio device. At this time, the above S101 may include: the conference terminal determines at least one target audio device to be inspected in the conference room audio system; the above S102 may include: the conference terminal performs performance index detection on at least one target audio device by controlling the speaker in at least one target audio device to play the corresponding test audio and the corresponding microphone in at least one target audio device to collect the audio played by the speaker, and sends the performance index detection result of at least one target audio device to the remote server; the above S103 may include: the remote server generates an inspection report of the conference room audio system according to the performance index detection result of at least one target audio device sent by the conference terminal. That is, the above S101 and S102 can be performed by the conference terminal, and the above S103 is performed by the remote server.

[0052] When the conference terminal and the remote server cooperate to execute the above inspection method, the data analysis and calculation involved in the conference room audio system inspection can be executed on the remote server. At this time, the remote server executes the above inspection method using the conference terminal as the communication medium, such as Figure 3 As shown, the remote server controls the conference terminals through the network.

[0053] In the above technical solution, when conducting an inspection of the conference room audio system, first determine at least one target audio device to be inspected in the conference room audio system, then perform a performance index test on the at least one target audio device by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker; finally, generate an inspection report of the conference room audio system based on the performance index test results of the at least one target audio device. In this way, the original audio devices in the conference room audio system can be efficiently utilized to realize automatic inspection of the conference room audio system, facilitate real-time monitoring of the operating health status of the conference room audio system, quickly generate inspection reports, and significantly improve the inspection efficiency and detection accuracy of the conference room audio system, thereby ensuring the conference audio quality and system stability, and saving hardware and labor costs.

[0054] The following is a detailed description of the specific implementation of determining at least one target audio device to be inspected in the conference room audio system in the above S101. Specifically, it can be implemented through multiple implementations. In one implementation, the second state of each audio device in the conference room audio system can be first obtained, wherein the second state is used to indicate whether the audio device is online; then, the audio device whose second state is online is directly determined as the target audio device.

[0055] In another embodiment, if Figure 3 As shown, the second status of each audio device in the conference room audio system can be obtained first; if there is no audio device with the second status of offline, that is, all audio devices in the conference room audio system are online, then the online audio device can be determined as the target audio device, and then the automatic inspection program can be started; if there is an audio device with the second status of offline, the offline device is processed, and at this time, selection information can be sent to the user terminal for the user to choose whether to skip the inspection of the offline audio device. After receiving the selection information, the user terminal displays the selection information so that the user can choose whether to skip the inspection of the offline audio device. If the user terminal receives a first selection instruction for indicating to skip the inspection of the offline audio device, the first selection instruction is sent to the conference terminal or the remote server; after receiving the first selection instruction, the conference terminal or the remote server determines the online audio device as the target audio device. If the user terminal receives a second selection instruction for indicating an inspection including offline audio devices, the second selection instruction is sent to the conference terminal or the remote server; after receiving the second selection instruction, the conference terminal or the remote server can control the audio device in the second state of offline to start, and then determine each audio device in the conference room audio system as a target audio device; or, after receiving the selection information through the user terminal, the user can manually start the offline audio device, and then input the second selection instruction to the user terminal. At this time, after receiving the second selection instruction, the conference terminal or the remote server can determine the online audio device as the target audio device.

[0056] The following is a detailed description of a specific implementation method of performing performance index detection on at least one target audio device in S102 by controlling a speaker in at least one target audio device to play a corresponding test audio and a corresponding microphone in at least one target audio device to collect the audio played by the speaker. Specifically, the at least one target audio device may include m first speakers and n first microphones, where m≥1 and n≥1. Figure 3 As shown, a cyclic cross-validation strategy can be used to detect the performance indicators of the m first speakers and the n first microphones, which can be implemented by the following steps (1) to (4):

[0057] Step (1): Combine m first loudspeakers and n first microphones one by one to form m*n loudspeaker-microphone pairs.

[0058] Step (2): for each speaker-microphone pair, control the first speaker in the speaker-microphone pair to play the first test audio, and control the first microphone in the speaker-microphone pair to collect the current audio to obtain the first collected audio.

[0059] Step (3): Determine first performance indicators of the first microphone and the first speaker in the speaker-microphone pair based on the first collected audio.

[0060] In the present disclosure, the first test audio may include a continuous frequency sweep signal from low frequency to high frequency, and the first performance indicator may include a frequency response (FR) and / or a total harmonic distortion (THD). The speaker-microphone pair is a device pair consisting of a first speaker among m first speakers and a first microphone among n first microphones.

[0061] For example, at least one target audio device includes a speaker Y1, a speaker Y2, a microphone M1, a microphone M2, and a microphone M3, that is, m=2, n=3, and two first speakers (i.e., speaker Y1, speaker Y2) and three first microphones (microphone M1, microphone M2, and microphone M3) are combined one by one to obtain the following six speaker-microphone pairs: (speaker Y1, microphone M1), (speaker Y1, microphone M2), (speaker Y1, microphone M3), (speaker Y2, microphone M1), (speaker Y2, microphone M2), (speaker Y2, microphone M3). At this time, performance index detection can be performed on each speaker-microphone pair to detect the frequency response and / or total harmonic distortion of the microphone and speaker in each speaker-microphone pair. Among them, Figure 3 In the example, the microphone M1 and the speaker Y1 to be tested are selected for explanation.

[0062] Specifically, the frequency responses of the first microphone and the first speaker in the speaker-microphone pair can be determined based on the first picked-up audio in the following manner: first, the first picked-up audio is converted from the time domain to the frequency domain by short-time Fourier transform; then, the amplitude of each frequency component in the spectrum of the first picked-up audio obtained after the conversion is analyzed, and a frequency response curve is plotted based on the amplitude; finally, the frequency response curve is used as both the frequency response of the first microphone in the speaker-microphone pair and the frequency response of the first speaker in the speaker-microphone pair.

[0063] In addition, the total harmonic distortion of the first microphone and the first speaker in the speaker-microphone pair can be determined based on the first picked-up audio in the following manner: first, the harmonic components and the fundamental components of the first picked-up audio are calculated; then, the total harmonic distortion rate is calculated by comparing the amplitudes of the harmonic components and the fundamental components as the total harmonic distortion of the first microphone and the first speaker in the speaker-microphone pair.

[0064] Step (4): Summarize all the first performance indicators as the performance indicator detection result of at least one target audio device.

[0065] In the present disclosure, after the first performance indicators of the first speaker and the first microphone in each speaker-microphone pair are detected, the indicators can be summarized based on the device dimension. Specifically, for each of the m first speakers, if the first speaker includes the first performance indicators obtained by multiple detections, the first performance indicators obtained by the multiple detections with the best indicator value are determined as the final first performance indicator of the first speaker, and if the first speaker includes the first performance indicator obtained by one detection, the first performance indicator obtained by the one detection is determined as the final first performance indicator of the first speaker; at the same time, for each of the n first microphones, if the first microphone includes the first performance indicators obtained by multiple detections, the first performance indicators obtained by the multiple detections with the best indicator value are determined as the final first performance indicator of the first microphone, and if the first microphone includes the first performance indicator obtained by one detection, the first performance indicator obtained by the one detection is determined as the final first performance indicator of the first microphone; finally, the final first performance indicator of each first speaker and the final first performance indicator of each first microphone are used as the performance indicator detection result of at least one target audio device.

[0066] In order to more comprehensively evaluate the performance of at least one target audio device, in addition to detecting the frequency response and / or total harmonic distortion of the first microphone and the first speaker through the first test audio, the speech intelligibility (Short-Time Objective Intelligibility, STOI) and / or stuttering of the first speaker can also be detected through the second test audio, wherein the second test audio can include a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards. The preset standards can be, for example, a series of standards for voice communication quality assessment formulated by the telecommunication standardization department of the International Telecommunication Union (ITU), such as ITU-T P.501. Specifically, in addition to the above steps (1) to (4), the above S102 can also include the following steps (5) to (7).

[0067] Step (5): For each speaker-microphone pair, control the first speaker in the speaker-microphone pair to play the second test audio, and control the first microphone in the speaker-microphone pair to collect the current audio to obtain the second collected audio.

[0068] Step (6): Determine the second performance indicator of the first microphone and the first speaker in the speaker-microphone pair based on the second collected audio.

[0069] In the present disclosure, the second performance indicator includes speech intelligibility (Short-Time ObjectiveIntelligibility, STOI) and / or jamming.

[0070] Specifically, after obtaining the second echoed audio, the short-time objective intelligibility index algorithm can be used to calculate the similarity between the second test audio (belonging to the clean speech signal) and the second echoed audio (belonging to the lossy speech signal) to measure the speech intelligibility as the speech intelligibility of the first microphone and the first speaker in the speaker-microphone pair.

[0071] In addition, after acquiring the second audio, a recurrent neural network (RNN) can be used to capture the time dependency and change trend in the second audio so as to accurately identify the stuttering phenomenon in the second audio.

[0072] Step (7): Summarize all second performance indicators as the performance indicator detection result of at least one target audio device.

[0073] In the present disclosure, after detecting the second performance indicators of the first microphone and the first speaker in each speaker-microphone pair, the indicators can be summarized based on the device dimension. Specifically, for each of the m first speakers, if the first speaker includes the second performance indicators obtained by multiple detections, the second performance indicators obtained by multiple detections with the best indicator value are determined as the final second performance indicator of the first speaker, and if the first speaker includes the second performance indicator obtained by one detection, the second performance indicator obtained by the one detection is determined as the final second performance indicator of the first speaker; at the same time, for each of the n first microphones, if the first microphone includes the second performance indicators obtained by multiple detections, the second performance indicators obtained by multiple detections with the best indicator value are determined as the final second performance indicator of the first microphone, and if the first microphone includes the second performance indicator obtained by one detection, the second performance indicator obtained by the one detection is determined as the final second performance indicator of the first microphone; finally, the final second performance indicator of each first speaker and the final second performance indicator of each first microphone are used as the performance indicator detection result of at least one target audio device.

[0074] In addition to m first speakers and n first microphones, the at least one target audio device may also include p integrated conference machines, where p≥1. In this case, in addition to the performance indicator testing of the m first speakers and n first microphones, the performance testing of the p integrated conference machines is also required. Figure 3 As shown, when the integrated conference machine is detected, the first states of the m first speakers and the n first microphones are first determined, and the first states are used to indicate whether the corresponding devices have failed; then, different detection strategies are adopted for the integrated conference machine according to different first states. Specifically, the above S102 may also include the following steps (8) to (10).

[0075] Step (8): Determine the first states of the m first speakers and the n first microphones according to the performance indicator detection results of the m first speakers and the n first microphones.

[0076] In the present disclosure, after obtaining the performance indicator detection results of m first speakers and n first microphones, for each of the m first speakers, each indicator (for example, FR, THD, STOI, and stuttering) in the performance indicator detection results of the first speaker (that is, the final first performance indicator and the final second performance indicator) can be compared with the corresponding threshold value to determine whether the corresponding indicator is normal; if each indicator in the performance indicator detection results of the first speaker is normal, it is determined that the first speaker is not faulty; if there are abnormal indicators in the performance indicator detection results of the first speaker, it is determined that the first speaker is faulty.

[0077] At the same time, for each of the n first microphones, each indicator (for example, FR, THD) in the performance indicator detection result of the first speaker (that is, the final first performance indicator) is compared with its corresponding threshold value to determine whether the corresponding indicator is normal; if each indicator in the performance indicator detection result of the first microphone is normal, it is determined that the first microphone is not faulty; if there are abnormal indicators in the performance indicator detection result of the first microphone, it is determined that the first microphone is faulty.

[0078] Step (9): Determine the target detection strategy of the all-in-one conference machine based on the first state.

[0079] Specifically, if Figure 3 As shown, if there is a first speaker that has not failed and there is a first microphone that has not failed, the target detection strategy is determined to be to perform performance index detection on the all-in-one conference machine based on the target speaker and the target microphone; if there is a first speaker that has not failed and each first microphone has failed, the target detection strategy is determined to be to perform performance index detection on the all-in-one conference machine based on the target speaker; if each first speaker has failed and there is a first microphone that has not failed, the target detection strategy is determined to be to perform performance index detection on the all-in-one conference machine based on the target microphone; if each first speaker and each first microphone have failed, the target detection strategy is determined to be to perform performance index detection on the all-in-one conference machine based on the second speaker and the second microphone of the all-in-one conference machine.

[0080] The target speaker is any first speaker that has not failed, and the target microphone is any first microphone that has not failed. Figure 3 In the example, the target microphone is microphone M1 and the target speaker is speaker Y1.

[0081] Step (10): Perform performance index detection on each integrated conference machine according to the target detection strategy.

[0082] In one embodiment, when the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target speaker and the target microphone, step (10) may include at least one of the following steps (a1), (a2) and (a3).

[0083] Step (a1): for each all-in-one conference machine, control the target speaker to play the first test audio, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the third collected audio; determine the first performance indicator of the second microphone of the all-in-one conference machine based on the third collected audio.

[0084] In the present disclosure, a similar method as in the above step (3) of determining the first performance indicators of the first microphone and the first speaker in the speaker-microphone pair according to the first picked-up audio can be adopted to determine the first performance indicator of the second microphone of the all-in-one conference machine according to the third picked-up audio, and the present disclosure will not repeat it.

[0085] Step (a2): For each all-in-one conference machine, control the target speaker to play the third test audio, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the fourth collected audio; based on the fourth collected audio, determine the third performance indicator of the second microphone of the all-in-one conference machine and the automatic gain control indicator of the all-in-one conference machine.

[0086] In the present disclosure, the third test audio includes components covering low frequencies to high frequencies, a speech speed and pronunciation clarity that meet preset standards, and a voice segment that contains a volume change from low to high.

[0087] The third performance indicator may include speech intelligibility and / or jamming, wherein the third performance indicator is a hardware performance indicator of the all-in-one conference machine, and automatic gain control is a performance indicator of the audio processing algorithm of the all-in-one conference machine.

[0088] In a possible implementation, the fourth re-collected audio can be denoised based on an artificial intelligence deep noise reduction (Deep Noise Suppression, DeepNS) model, and then the difference between the total root mean square value of the fourth re-collected audio obtained after noise reduction and the total root mean square value of the third test audio (belonging to a clean voice signal) is calculated to obtain the gain adjustment value and adjustment time as the automatic gain control indicator result of the all-in-one conference machine.

[0089] Among them, a method similar to the above-mentioned step (5) of determining the second performance indicators of the first microphone and the first speaker in the speaker-microphone pair according to the second picked-up audio can be adopted to determine the speech intelligibility and jamming index results of the second microphone of the conference all-in-one machine according to the fourth picked-up audio, which will not be repeated in the present disclosure.

[0090] Step (a3): for each all-in-one conference machine, control the target speaker to play the fourth test audio, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the fifth collected audio; determine the noise suppression index of the all-in-one conference machine based on the fifth collected audio.

[0091] In the present disclosure, the fourth test audio may include speech segments covering low-frequency to high-frequency components, with speech speed and pronunciation clarity meeting preset standards, and containing different noise types and signal-to-noise ratios. Noise suppression indicators are also performance indicators of the audio processing algorithm of the conference all-in-one machine.

[0092] In a possible implementation, after obtaining the fifth audio sample, the noise part in the fifth audio sample can be extracted based on the DeepNS model; then, the difference between the total root mean square value of the noise part and the total root mean square value of the fourth test audio (belonging to the original noise signal) is calculated to obtain the overall level of noise residue as the noise suppression index result of the all-in-one conference machine.

[0093] When the target detection strategy is to detect the performance indicators of the conference machine based on the target speaker and the target microphone, in addition to detecting the FR, THD, speech intelligibility, and jamming indicators of the second microphone of the conference machine, as well as the automatic gain control and noise suppression indicators of the conference machine, the echo cancellation indicator of the conference machine can also be detected, wherein the echo cancellation indicator is also a performance indicator of the audio processing algorithm of the conference machine. Specifically, when the target detection strategy is to detect the performance indicators of the conference machine based on the target speaker and the target microphone, the above step (10) can include the following step (a4) in addition to at least one of step (a1), step (a2) and step (a3).

[0094] Step (a4): For each all-in-one conference machine, control the target speaker and the second speaker of the all-in-one conference machine to play the second test audio simultaneously, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the sixth echo audio; determine the echo cancellation index of the all-in-one conference machine based on the sixth echo audio.

[0095] In a possible implementation, the sixth collected audio can be denoised based on the DeepNS model, and the total RMS value of the sixth collected audio obtained after denoising is calculated. The difference between the total RMS value of the second test audio (belonging to a clean voice signal) and the overall level of voice clipping and echo residue is obtained as the echo cancellation index result of the all-in-one conference machine.

[0096] When the target detection strategy is to perform performance index detection on the all-in-one conference machine based on the target speaker and the target microphone, in addition to performing performance index detection on the second microphone of the all-in-one conference machine and the audio processing algorithm of the all-in-one conference machine, the second speaker of the all-in-one conference machine may also be detected. Specifically, when the target detection strategy is to perform performance index detection on the all-in-one conference machine based on the target speaker and the target microphone, the above step (10) may include at least one of the following steps (a5) and (a6) in addition to at least one of step (a1), step (a2) and step (a3).

[0097] Step (a5): for each all-in-one conference machine, control the second speaker of the all-in-one conference machine to play the first test audio, and control the target microphone to collect the current audio to obtain the seventh collected audio; based on the seventh collected audio, determine the first performance indicator of the second speaker of the all-in-one conference machine.

[0098] In the present disclosure, a similar method as that in the above step (3) of determining the first performance indicators of the first microphone and the first speaker in the speaker-microphone pair according to the first picked-up audio can be adopted to determine the first performance indicator of the second speaker of the all-in-one conference machine according to the seventh picked-up audio, and the present disclosure will not repeat them.

[0099] Step (a6): for each all-in-one conference machine, control the second speaker of the all-in-one conference machine to play the second test audio, and control the target microphone to collect the current audio to obtain the eighth collected audio; based on the eighth collected audio, determine the second performance indicator of the second speaker of the all-in-one conference machine.

[0100] In the present disclosure, a method similar to the above step (5) of determining the second performance indicators of the first microphone and the first speaker in the speaker-microphone pair based on the second picked-up audio can be adopted to determine the second performance indicator of the second speaker of the all-in-one conference machine based on the eighth picked-up audio, and the present disclosure will not repeat it.

[0101] In another embodiment, if Figure 3 As shown, when the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target speaker, the above step (10) may include at least one of the above steps (a1), (a2) and (a3).

[0102] like Figure 3 As shown, when the target detection strategy is to detect the performance index of the conference all-in-one machine based on the target speaker, in addition to detecting the FR, THD, speech intelligibility, and jamming index of the second microphone of the conference all-in-one machine, as well as the automatic gain control and noise suppression index of the conference all-in-one machine, the echo cancellation index of the conference all-in-one machine can also be detected. Specifically, when the target detection strategy is to detect the performance index of the conference all-in-one machine based on the target speaker, the above step (10) can include the above step (a4) in addition to at least one of step (a1), step (a2) and step (a3).

[0103] In yet another embodiment, when the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target microphone, the above step (10) may include at least one of the following steps (b1) and (b2).

[0104] Step (b1): for each all-in-one conference machine, control the second speaker of the all-in-one conference machine to play the first test audio, and control the target microphone to collect the current audio to obtain the seventh collected audio; based on the seventh collected audio, determine the first performance indicator of the second speaker of the all-in-one conference machine.

[0105] In the present disclosure, a similar method as that in the above step (3) of determining the first performance indicators of the first microphone and the first speaker in the speaker-microphone pair according to the first picked-up audio can be adopted to determine the first performance indicator of the second speaker of the all-in-one conference machine according to the seventh picked-up audio, and the present disclosure will not repeat them.

[0106] Step (b2): For each all-in-one conference machine, control the second speaker of the all-in-one conference machine to play the second test audio, and control the target microphone to collect the current audio to obtain the eighth collected audio; determine the second performance indicator of the second speaker of the all-in-one conference machine based on the eighth collected audio.

[0107] In the present disclosure, a method similar to the above step (5) of determining the second performance indicators of the first microphone and the first speaker in the speaker-microphone pair based on the second picked-up audio can be adopted to determine the second performance indicator of the second speaker of the all-in-one conference machine based on the eighth picked-up audio, and the present disclosure will not repeat it.

[0108] like Figure 3 As shown, when the target detection strategy is to detect the performance index of the integrated conference machine based on the target microphone, in addition to the FR, THD, speech intelligibility, automatic gain control, jamming and noise suppression indicators of the integrated conference machine, the echo cancellation indicator of the integrated conference machine can also be detected. Specifically, when the target detection strategy is to detect the performance index of the integrated conference machine based on the target microphone, the above step (10) can include the following step (b3) in addition to at least one of the above steps (b1) and (b2).

[0109] Step (b3): ​​for each all-in-one conference machine, control the second speaker of the all-in-one conference machine to play the second test audio, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the ninth echoed audio; determine the echo cancellation index of the all-in-one conference machine based on the ninth echoed audio.

[0110] In the present disclosure, a similar method as that in the above step (a4) of determining the echo cancellation index of the all-in-one conference machine according to the sixth collected audio can be adopted to determine the echo cancellation index of the all-in-one conference machine according to the ninth collected audio, which will not be repeated in the present disclosure.

[0111] In yet another embodiment, when the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the second speaker and the second microphone of the all-in-one conference machine, the above step (10) may include the above step (b3).

[0112] The following describes in detail a specific implementation of generating an inspection report of a conference room audio system according to a performance indicator detection result of at least one target audio device in S103.

[0113] Specifically, the overall health of at least one target audio device can be generated based on the performance indicator detection result of at least one target audio device, and / or the first state of at least one target audio device can be determined to obtain an evaluation result. Then, an inspection report of the conference room audio system can be generated based on the overall health and / or the evaluation result.

[0114] In one implementation, the overall health of at least one target audio device may be generated based on the performance indicator test result of at least one target audio device. Then, based on the at least one overall health, an inspection report of the conference room audio system may be generated. In this case, the inspection report may include the overall health of the conference room audio system and the performance indicator test result of at least one target audio device.

[0115] The inspection report includes the overall health of the conference room audio system, which can help users intuitively understand the overall health status of the conference room audio system.

[0116] In another embodiment, the first state of at least one target audio device can be determined based on the performance indicator detection result of at least one target audio device to obtain an evaluation result; then, based on the evaluation result, an inspection report of the conference room audio system is generated. At this time, the inspection report can include the evaluation result (i.e., the first state of at least one target audio device) and the performance indicator detection result of at least one target audio device.

[0117] The inspection report includes at least one first state of whether the target audio device is faulty and at least one performance indicator detection result of the target audio device, so that the user can quickly understand the status of the corresponding audio device through the inspection report.

[0118] In another embodiment, the overall health of at least one target audio device can be generated based on the performance indicator detection result of at least one target audio device, and the first state of at least one target audio device can be determined based on the performance indicator detection result of at least one target audio device to obtain an evaluation result; then, an inspection report of the conference room audio system is generated based on the overall health and the evaluation result. At this time, the inspection report can include the overall health, the evaluation result (i.e., the first state of at least one target audio device), and the performance indicator detection result of at least one target audio device.

[0119] In addition, the performance indicator detection result of at least one target audio device may be displayed in the form of a chart, so that the user can understand the performance indicator of the corresponding audio device more intuitively.

[0120] In addition, an alarm message can be generated for the audio device whose first state is a fault, so as to notify the user (for example, the operation and maintenance personnel) to conduct troubleshooting and repair. In order to facilitate troubleshooting, the target fault cause corresponding to the performance indicator test result of the faulty audio device can be determined based on the pre-established correspondence between the reference performance indicator and the fault cause, and the fault cause can be added to the inspection report.

[0121] In order to facilitate users to intuitively understand the status of the conference room audio system from different dimensions, a radar chart of the conference room audio system can be generated based on the performance indicator test results of at least one target audio device, and the radar chart can be displayed in the inspection report. The radar chart can be constructed from dimensions such as sound pickup performance, sound amplification performance, conference all-in-one machine algorithm performance, and comprehensive performance.

[0122] The following is a detailed description of the specific implementation method for generating the overall health of at least one target audio device based on the performance indicator detection results of at least one target audio device. Specifically, for each target audio device, the sub-health of each performance indicator of the target audio device can be calculated, and then the weighted sum of the sub-health of each performance indicator of the target audio device is determined as the health of the target audio device; finally, the weighted sum of the health of each target audio device is determined as the overall health of at least one target audio device.

[0123] Among them, for each performance indicator of the audio device, a correspondence between the performance indicator interval and the reference sub-health can be pre-constructed, so that the reference sub-health corresponding to the interval to which the performance indicator of the audio device belongs can be determined later according to the correspondence as the sub-health of the performance indicator of the audio device.

[0124] In order to more comprehensively evaluate the performance of the conference room audio system, in addition to testing the performance of the hardware audio devices in the conference room audio system, such as Figure 3 and Figure 4 As shown, the performance of the acoustic environment of the conference room space can also be detected. Specifically, the inspection method of the conference room audio system can also include the following steps (C1) to (C3).

[0125] Step (C1): determining first states of the m first speakers and the n first microphones according to performance indicator detection results of the m first speakers and the n first microphones.

[0126] Step (C2): If there is a first speaker that is not faulty and there is a first microphone that is not faulty, then use the target speaker and the target microphone to detect the spatial acoustic environment of the physical conference room where the at least one target audio device is located.

[0127] Step (C3): If each first speaker and each first microphone fails, the spatial acoustic environment of the physical conference room is abandoned for detection (e.g. Figure 4 shown).

[0128] In one embodiment, step (C2) may include the following steps (C11) to (C14):

[0129] Step (C11): Control the target speaker to play the fifth test audio, and control the target microphone to collect the current audio to obtain the tenth collected audio.

[0130] In the present disclosure, the fifth test audio includes a pulse signal.

[0131] Step (C12): performing noise reduction on the tenth audio sample.

[0132] Step (C13): Generate an energy attenuation curve of the tenth audio sample after noise reduction.

[0133] Step (C14): Determine the reverberation time (Reverb Time 60dB Decay, RT60) of the spatial acoustic environment according to the energy decay curve.

[0134] After obtaining the energy decay curve of the tenth sampled audio after noise reduction, linear regression can be used to fit the linear part of the energy decay curve, and the time required for the initial energy to decay by 60 decibels (dB) can be calculated to obtain the reverberation time index result of the spatial acoustic environment.

[0135] In addition to using pulse signals to detect the reverberation time of a spatial acoustic environment, other signals suitable for measuring the reverberation time may also be used, and the present disclosure does not make any specific limitation on this.

[0136] In order to more comprehensively evaluate the performance of the spatial acoustic environment of the conference room, in addition to detecting the reverberation time of the spatial acoustic environment, the background noise level (BNL) of the spatial acoustic environment can also be detected. Specifically, in addition to the above steps (C11) to (C14), the above step (C2) can also include the following steps (C15) to (C17).

[0137] Step (C15): When the physical conference room is in a quiet state, control the target microphone to collect the ambient sound signal of the physical conference room.

[0138] Step (C16): extracting pure background noise information from the ambient sound signal.

[0139] Among them, pure background noise information usually refers to the background noise that still exists in the environment in the absence of any obvious sound source.

[0140] Step (C17): Determine the ambient noise floor of the spatial acoustic environment based on the pure noise floor information.

[0141] In the present disclosure, an A-weighted filter may be used to process pure background noise information and calculate the total root mean square value of the weighted signal to obtain the overall level of ambient noise as an ambient background noise index result of the spatial acoustic environment.

[0142] In addition, when each first speaker fails and / or each first microphone fails, in order to more comprehensively evaluate the performance of the conference room audio system, additional microphones or speakers can be added to the physical conference room as needed to detect the spatial acoustic environment. Specifically, the above-mentioned conference room audio system inspection method can also include the following steps:

[0143] If there is a first speaker that has not failed and each of the first microphones has failed, the spatial acoustic environment is detected using the target speaker and the third microphone, wherein the third microphone is a device temporarily added to the physical conference room;

[0144] If each first speaker fails and there is a first microphone that has not failed, the spatial acoustic environment is detected using a third speaker and a target microphone, wherein the third speaker is a device temporarily added to the physical conference room;

[0145] If each first speaker and each first microphone fails, the third speaker and the third microphone are used to detect the spatial acoustic environment.

[0146] Among them, a similar method as the above-mentioned step (C2) in which the spatial acoustic environment of the physical conference room where at least one target audio device is located is used to detect the spatial acoustic environment using a third speaker and a target microphone (at this time, the third speaker acts as the target speaker), the target speaker and a third microphone are used to detect the spatial acoustic environment (at this time, the third microphone acts as the target microphone), and the third speaker and a third microphone are used to detect the spatial acoustic environment (at this time, the third microphone acts as the target microphone and the third speaker acts as the target speaker), which will not be repeated in the present disclosure.

[0147] In addition, when each first speaker fails and / or each first microphone fails, in order to more comprehensively evaluate the performance of the conference all-in-one machine, additional microphones or speakers can be added to the physical conference room as needed to detect the conference all-in-one machine. Specifically, if there is a first speaker that has not failed and each first microphone fails, the performance index of the conference all-in-one machine is detected based on the target speaker and the third microphone; if each first speaker fails and there is a first microphone that has not failed, the performance index of the conference all-in-one machine is detected based on the third speaker and the target microphone; if each first speaker and each first microphone fails, the performance index of the conference all-in-one machine is detected based on the target speaker and the target microphone. Among them, a method similar to that when the target detection strategy is to detect the performance index of the conference all-in-one machine based on the target speaker and the target microphone, the performance index of each conference all-in-one machine is detected based on the target speaker and the third microphone, the performance index of the conference all-in-one machine is detected based on the third speaker and the target microphone, and the performance index of the conference all-in-one machine is detected based on the target speaker and the target microphone. This disclosure will not be repeated.

[0148] Figure 5 FIG. 1 is a block diagram of a device for inspecting a conference room audio system according to an exemplary embodiment. Figure 5 As shown, the inspection device 500 of the conference room audio system includes:

[0149] A first determining module 501 is used to determine at least one target audio device to be inspected in the conference room audio system;

[0150] A first detection module 502 is used to perform performance indicator detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker;

[0151] The generating module 503 is used to generate an inspection report of the conference room audio system according to the performance indicator detection result of the at least one target audio device.

[0152] In the above technical solution, when conducting an inspection of the conference room audio system, first determine at least one target audio device to be inspected in the conference room audio system, then perform a performance index test on the at least one target audio device by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker; finally, generate an inspection report of the conference room audio system based on the performance index test results of the at least one target audio device. In this way, the original audio devices in the conference room audio system can be efficiently utilized to realize automatic inspection of the conference room audio system, facilitate real-time monitoring of the operating health status of the conference room audio system, quickly generate inspection reports, and significantly improve the inspection efficiency and detection accuracy of the conference room audio system, thereby ensuring the conference audio quality and system stability, and saving hardware and labor costs.

[0153] Optionally, the at least one target audio device includes m first speakers and n first microphones, wherein m≥1, n≥1;

[0154] The first detection module 502 includes:

[0155] A combining submodule, used for combining the m first loudspeakers with the n first microphones one by one to form m*n loudspeaker-microphone pairs;

[0156] A first control submodule is used for controlling the first speaker in each speaker-microphone pair to play a first test audio, and controlling the first microphone in the speaker-microphone pair to collect current audio to obtain a first collected audio, wherein the first test audio includes a continuous sweep frequency signal from low frequency to high frequency;

[0157] A first determination submodule, configured to determine a first performance indicator of the first microphone and the first speaker in the speaker-microphone pair according to the first collected audio, wherein the first performance indicator includes a frequency response and / or a total harmonic distortion;

[0158] The first summarizing submodule is used to summarize all the first performance indicators as the performance indicator detection result of the at least one target audio device.

[0159] Optionally, the first detection module 502 further includes:

[0160] A second control submodule is used for controlling the first speaker in each speaker-microphone pair to play a second test audio, and controlling the first microphone in the speaker-microphone pair to collect current audio to obtain a second collected audio, wherein the second test audio includes a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards;

[0161] A second determination submodule, configured to determine a second performance indicator of the first microphone and the first speaker in the speaker-microphone pair according to the second collected audio, wherein the second performance indicator includes speech intelligibility and / or jamming;

[0162] The second summarizing submodule is used to summarize all the second performance indicators as the performance indicator detection result of the at least one target audio device.

[0163] Optionally, the at least one target audio device further includes p all-in-one conference machines, where p≥1;

[0164] The first detection module 502 further includes:

[0165] a third determination submodule, configured to determine a first state of the m first speakers and the n first microphones according to a performance indicator detection result of the m first speakers and the n first microphones, wherein the first state is used to indicate whether a corresponding device fails;

[0166] A fourth determination submodule, configured to determine a target detection strategy for the all-in-one conference machine according to the first state;

[0167] The all-in-one machine detection submodule is used to perform performance indicator detection on each of the all-in-one conference machines according to the target detection strategy.

[0168] Optionally, the fourth determining submodule includes:

[0169] a fifth determination submodule, for determining, if there is a first speaker that has not failed and there is a first microphone that has not failed, that the target detection strategy is to perform performance index detection on the all-in-one conference machine based on a target speaker and a target microphone, wherein the target speaker is any first speaker that has not failed, and the target microphone is any first microphone that has not failed;

[0170] a sixth determination submodule, configured to determine that the target detection strategy is to perform performance indicator detection on the integrated conference machine based on the target speaker if there is a first speaker that has not failed and each of the first microphones has failed;

[0171] a seventh determination submodule, configured to determine, if each of the first speakers fails and there is a first microphone that has not failed, that the target detection strategy is to perform a performance indicator detection on the all-in-one conference machine based on the target microphone;

[0172] The eighth determination submodule is used to determine the target detection strategy to perform performance indicator detection on the all-in-one conference machine based on the second speaker and the second microphone of the all-in-one conference machine if each of the first speakers and each of the first microphones fails.

[0173] Optionally, the target detection strategy is to perform performance index detection on the all-in-one conference machine based on a target loudspeaker and a target microphone, or to perform performance index detection on the all-in-one conference machine based on the target loudspeaker;

[0174] The integrated machine detection submodule includes at least one of the following:

[0175] A third control submodule is used to control the target speaker to play the first test audio for each of the all-in-one conference machines, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain a third collected audio; a ninth determination submodule is used to determine the first performance indicator of the second microphone of the all-in-one conference machine according to the third collected audio;

[0176] A fourth control submodule is used to control the target speaker to play the third test audio for each of the all-in-one conference machines, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain a fourth collected audio, wherein the third test audio includes components covering low frequencies to high frequencies, and the speech speed and pronunciation clarity meet preset standards, and include voice segments with volume changes from low to high; a tenth determination submodule is used to determine a third performance indicator of the second microphone of the all-in-one conference machine and an automatic gain control indicator of the all-in-one conference machine according to the fourth collected audio, wherein the third performance indicator includes speech intelligibility and / or jamming;

[0177] The fifth control submodule is used to control the target speaker to play the fourth test audio for each of the all-in-one conference machines, and control the second microphone of the all-in-one conference machine to collect the current audio to obtain the fifth re-collected audio, wherein the fourth test audio includes voice segments covering low-frequency to high-frequency components, whose speech speed and pronunciation clarity meet the preset standards, and contain different noise types and signal-to-noise ratios; the eleventh determination submodule is used to determine the noise suppression index of the all-in-one conference machine based on the fifth re-collected audio.

[0178] Optionally, the integrated machine detection submodule further includes:

[0179] a sixth control submodule, for each of the all-in-one conference machines, controlling the target speaker and the second speaker of the all-in-one conference machine to simultaneously play a second test audio, and controlling the second microphone of the all-in-one conference machine to collect current audio, to obtain a sixth collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet preset standards;

[0180] The twelfth determination submodule is used to determine the echo cancellation index of the all-in-one conference machine according to the sixth collected audio.

[0181] Optionally, the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on a target speaker and a target microphone;

[0182] The integrated machine detection submodule also includes:

[0183] a seventh control submodule, for controlling the second speaker of each of the all-in-one conference machines to play the first test audio, and controlling the target microphone to collect the current audio, to obtain a seventh collected audio; a thirteenth determination submodule, for determining the first performance indicator of the second speaker of the all-in-one conference machine according to the seventh collected audio; and / or

[0184] The eighth control submodule is used to control the second speaker of each of the conference all-in-one machines to play the second test audio, and control the target microphone to collect the current audio to obtain the eighth re-collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; the fourteenth determination submodule is used to determine the second performance indicator of the second speaker of the conference all-in-one machine based on the eighth re-collected audio, wherein the second performance indicator includes speech intelligibility and / or jamming.

[0185] Optionally, the target detection strategy is to perform performance index detection on the all-in-one conference machine based on the target microphone;

[0186] The integrated machine detection submodule includes:

[0187] a ninth control submodule, for controlling the second speaker of each of the all-in-one conference machines to play the first test audio, and controlling the target microphone to collect the current audio, to obtain the seventh collected audio; a fifteenth determination submodule, for determining the first performance indicator of the second speaker of the all-in-one conference machine according to the seventh collected audio; and / or

[0188] The tenth control submodule is used to control the second speaker of each of the all-in-one conference machines to play the second test audio, and control the target microphone to collect the current audio to obtain an eighth re-collected audio, wherein the second test audio includes a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; the sixteenth determination submodule is used to determine the second performance indicator of the second speaker of the all-in-one conference machine based on the eighth re-collected audio, wherein the second performance indicator includes speech intelligibility and / or stuttering.

[0189] Optionally, the integrated machine detection submodule further includes:

[0190] An eleventh control submodule is used for controlling the second speaker of each of the all-in-one conference machines to play a second test audio, and controlling the second microphone of the all-in-one conference machine to collect current audio, so as to obtain a ninth collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards;

[0191] The seventeenth determination submodule is used to determine the echo cancellation index of the all-in-one conference machine according to the ninth collected audio.

[0192] Optionally, the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on a second speaker and a second microphone of the all-in-one conference machine;

[0193] The performing performance indicator detection on each of the integrated conference devices according to the target detection strategy includes:

[0194] An eleventh control submodule is used for controlling the second speaker of each of the all-in-one conference machines to play a second test audio, and controlling the second microphone of the all-in-one conference machine to collect current audio, so as to obtain a ninth collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards;

[0195] The seventeenth determination submodule is used to determine the echo cancellation index of the all-in-one conference machine according to the ninth collected audio.

[0196] Optionally, the first determining module 501 includes:

[0197] An acquisition submodule, used for acquiring a second state of each audio device in the conference room audio system, wherein the second state is used to indicate whether the audio device is online;

[0198] An eighteenth determining submodule is configured to determine the audio device in the second state of being online as the target audio device.

[0199] Optionally, the inspection device 500 further includes:

[0200] a sending module, configured to, before the eighteenth determining submodule determines the audio device whose second status is online as the target audio device, if there is the audio device whose second status is offline, send selection information to the user terminal for the user to select whether to skip the inspection of the offline audio device;

[0201] a triggering submodule, configured to, in response to receiving a first selection instruction sent by the user terminal for instructing to skip the inspection of offline audio devices, or the absence of the audio device whose second status is offline, trigger the eighteenth determining submodule to determine the audio device whose second status is online as the target audio device;

[0202] A twelfth control submodule is used to control the audio device whose second state is offline to start in response to receiving a second selection instruction sent by the user terminal to indicate a patrol including offline audio devices, and to determine each of the audio devices in the conference room audio system as the target audio device.

[0203] Optionally, the inspection device 500 further includes:

[0204] a second determination module, configured to determine a first state of the m first speakers and the n first microphones according to a performance indicator detection result of the m first speakers and the n first microphones, wherein the first state is used to indicate whether a corresponding device fails;

[0205] The second detection module is used to detect the spatial acoustic environment of the physical conference room where the at least one target audio device is located using a target speaker and a target microphone if there is a non-malfunctioning first speaker and a non-malfunctioning first microphone, wherein the target speaker is any non-malfunctioning first speaker and the target microphone is any non-malfunctioning first microphone.

[0206] Optionally, the second detection module includes:

[0207] A thirteenth control submodule is used to control the target speaker to play the fifth test audio, and control the target microphone to collect the current audio to obtain a tenth collected audio, wherein the fifth test audio includes a pulse signal;

[0208] A noise reduction submodule, used for performing noise reduction on the tenth audio sample;

[0209] The first generating submodule is used to generate an energy attenuation curve of the tenth audio sample obtained after noise reduction;

[0210] The nineteenth determination submodule is used to determine the reverberation time of the spatial acoustic environment according to the energy attenuation curve.

[0211] Optionally, the second detection module further includes:

[0212] A fourteenth control submodule is used to control the target microphone to collect the ambient sound signal of the physical conference room when the physical conference room is in a quiet state;

[0213] An extraction submodule, used to extract pure background noise information from the ambient sound signal;

[0214] The twentieth determination submodule is used to determine the ambient noise floor of the spatial acoustic environment according to the pure noise floor information.

[0215] Optionally, the inspection device 500 further includes:

[0216] A third detection module is used to detect the spatial acoustic environment using the target speaker and a third microphone if there is a first speaker that is not faulty and each of the first microphones is faulty, wherein the third microphone is a device temporarily added to the physical conference room;

[0217] a fourth detection module, configured to detect the spatial acoustic environment using a third speaker and the target microphone if each of the first speakers fails and there is a first microphone that is not failed, wherein the third speaker is a device temporarily added to the physical conference room;

[0218] The fourth detection module is configured to detect the spatial acoustic environment using the third speaker and the third microphone if each of the first speakers and each of the first microphones fails.

[0219] Optionally, the conference room audio system includes an audio device and a conference terminal connected via a local area network, and the inspection device 500 is applied to the conference terminal.

[0220] Optionally, the conference room audio system includes an audio device and a remote server connected via a wide area network, and the inspection device 500 is applied to the remote server.

[0221] Optionally, the conference room audio system includes an audio device, a conference terminal and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network;

[0222] The first determining module 501 is used to determine at least one target audio device to be inspected in the conference room audio system through the conference terminal;

[0223] The first detection module 502 is used to perform performance indicator detection on the at least one target audio device by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker through the conference terminal, and send the performance indicator detection result of the at least one target audio device to the remote server;

[0224] The generating module 503 is used to generate, through the remote server, an inspection report of the conference room audio system according to the performance indicator detection result of the at least one target audio device sent by the conference terminal.

[0225] Optionally, the conference room audio system includes an audio device, a conference terminal and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network;

[0226] The remote server includes the inspection device 500, and the remote server controls the inspection device 500 to work by using the conference terminal as a communication medium.

[0227] Optionally, the generating module 503 includes:

[0228] a second generating submodule, configured to generate an overall health of the at least one target audio device according to the performance indicator detection result of the at least one target audio device; and / or a twenty-first determining submodule, configured to determine a first state of the at least one target audio device according to the performance indicator detection result of the at least one target audio device to obtain an evaluation result, wherein the first state is used to characterize whether a corresponding device fails;

[0229] The third generating submodule is used to generate an inspection report of the conference room audio system according to the overall health and / or the evaluation result.

[0230] In addition, the present disclosure also provides a computer-readable medium on which a computer program is stored. When the computer program is executed by a processing device, the steps of the inspection method of the conference room audio system provided by the present disclosure are implemented.

[0231] The present disclosure also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the inspection method of the conference room audio system provided by the present disclosure.

[0232] Reference below Figure 6 , which shows a schematic diagram of the structure of an electronic device (conference terminal or remote server) 600 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0233] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0234] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a first microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a first speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0235] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0236] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0237] In some embodiments, the conference terminals and remote servers may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0238] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0239] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: determines at least one target audio device to be inspected in the conference room audio system; performs performance indicator detection on the at least one target audio device by controlling the speaker in the at least one target audio device to play corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker; and generates an inspection report of the conference room audio system according to the performance indicator detection result of the at least one target audio device.

[0240] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0241] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0242] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of the module does not limit the module itself in some cases. For example, the first determination module may also be described as "a module for determining at least one target audio device to be inspected in the conference room audio system".

[0243] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0244] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0245] According to one or more embodiments of the present disclosure, Example 1 provides an inspection method for a conference room audio system, comprising: determining at least one target audio device to be inspected in the conference room audio system; performing performance indicator detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker; and generating an inspection report for the conference room audio system based on the performance indicator detection result of the at least one target audio device.

[0246] According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein the at least one target audio device includes m first speakers and n first microphones, wherein m≥1, n≥1; the performance index detection of the at least one target audio device is performed by controlling the speakers in the at least one target audio device to play corresponding test audio and the corresponding microphones in the at least one target audio device to collect the audio played by the speakers, including: combining the m first speakers with the n first microphones one by one to form m*n speaker-microphone pairs; for each of the speaker-microphone pairs, controlling the first speaker in the speaker-microphone pair to play a first test audio, and controlling the first microphone in the speaker-microphone pair to collect current audio to obtain a first picked-up audio, wherein the first test audio includes a continuous sweep signal from low frequency to high frequency; determining the first performance index of the first microphone and the first speaker in the speaker-microphone pair based on the first picked-up audio, wherein the first performance index includes frequency response and / or total harmonic distortion; and summarizing all the first performance indexes as the performance index detection result of the at least one target audio device.

[0247] According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 2, which performs performance index detection on the at least one target audio device by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker, and also includes: for each of the speaker-microphone pairs, controlling the first speaker in the speaker-microphone pair to play the second test audio, and controlling the first microphone in the speaker-microphone pair to collect the current audio, to obtain a second picked-up audio, wherein the second test audio includes a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet preset standards; based on the second picked-up audio, determining the second performance index of the first microphone and the first speaker in the speaker-microphone pair, wherein the second performance index includes speech intelligibility and / or stuttering; and summarizing all the second performance indexes as the performance index detection result of the at least one target audio device.

[0248] According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 2, wherein the at least one target audio device also includes p all-in-one conference machines, wherein p≥1; the performance indicator detection of the at least one target audio device is performed by controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker, and also includes: determining the first state of the m first speakers and the n first microphones according to the performance indicator detection results of the m first speakers and the n first microphones, wherein the first state is used to characterize whether the corresponding device has a fault; determining the target detection strategy of the all-in-one conference machine according to the first state; and performing performance indicator detection on each of the all-in-one conference machines according to the target detection strategy.

[0249] According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 4, which determines the target detection strategy of the conference all-in-one machine based on the first state, including: if there is a first speaker that has not failed and there is a first microphone that has not failed, then determining the target detection strategy as performing performance indicator detection on the conference all-in-one machine based on the target speaker and the target microphone, wherein the target speaker is any first speaker that has not failed, and the target microphone is any first microphone that has not failed; if there is a first speaker that has not failed and each of the first microphones fails, then determining the target detection strategy as performing performance indicator detection on the conference all-in-one machine based on the target speaker; if each of the first speakers fails and there is a first microphone that has not failed, then determining the target detection strategy as performing performance indicator detection on the conference all-in-one machine based on the target microphone; if each of the first speakers and each of the first microphones fails, then determining the target detection strategy as performing performance indicator detection on the conference all-in-one machine based on the second speaker and the second microphone of the conference all-in-one machine.

[0250] According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 5, wherein the target detection strategy is to perform performance indicator detection on the conference all-in-one machine based on the target speaker and the target microphone, or to perform performance indicator detection on the conference all-in-one machine based on the target speaker; the performance indicator detection on each of the conference all-in-one machines is performed according to the target detection strategy, including at least one of the following: for each of the conference all-in-one machines, the target speaker is controlled to play the first test audio, and the second microphone of the conference all-in-one machine is controlled to collect the current audio to obtain a third re-collected audio; based on the third re-collected audio, the first performance indicator of the second microphone of the conference all-in-one machine is determined; for each of the conference all-in-one machines, the target speaker is controlled to play the third test audio, and the second microphone of the conference all-in-one machine is controlled to collect the current audio to obtain a fourth re-collected audio, wherein the third test audio includes components covering low frequency to high frequency, and the speech speed and pronunciation clarity meet the preset standards, and the voice segment includes a volume change from low to high; based on the fourth re-collected audio frequency, determine the third performance index of the second microphone of the conference all-in-one machine and the automatic gain control index of the conference all-in-one machine, wherein the third performance index includes speech intelligibility and / or jamming; for each of the conference all-in-one machines, control the target speaker to play the fourth test audio, and control the second microphone of the conference all-in-one machine to collect the current audio, and obtain the fifth collected audio, wherein the fourth test audio includes voice segments covering low-frequency to high-frequency components, speech speed and pronunciation clarity that meet the preset standards, and contain different noise types and signal-to-noise ratios; according to the fifth collected audio, determine the noise suppression index of the conference all-in-one machine; for each of the conference all-in-one machines, control the target speaker and the second speaker of the conference all-in-one machine to play the second test audio at the same time, and control the second microphone of the conference all-in-one machine to collect the current audio, and obtain the sixth collected audio, wherein the second test audio includes voice segments covering low-frequency to high-frequency components, speech speed and pronunciation clarity that meet the preset standards; according to the sixth collected audio, determine the echo cancellation index of the conference all-in-one machine.

[0251] According to one or more embodiments of the present disclosure, Example 7 provides the method of Example 6, wherein the target detection strategy is to perform performance indicator detection on the conference all-in-one machine based on the target speaker and the target microphone; the performance indicator detection on each of the conference all-in-one machines according to the target detection strategy also includes: for each of the conference all-in-one machines, controlling the second speaker of the conference all-in-one machine to play the first test audio, and controlling the target microphone to collect the current audio, to obtain a seventh re-collected audio; determining the first performance indicator of the second speaker of the conference all-in-one machine based on the seventh re-collected audio; and / or for each of the conference all-in-one machines, controlling the second speaker of the conference all-in-one machine to play the second test audio, and controlling the target microphone to collect the current audio, to obtain an eighth re-collected audio, wherein the second test audio includes a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet preset standards; determining the second performance indicator of the second speaker of the conference all-in-one machine based on the eighth re-collected audio, wherein the second performance indicator includes speech intelligibility and / or stuttering.

[0252] According to one or more embodiments of the present disclosure, Example 8 provides the method of Example 5, wherein the target detection strategy is to perform performance indicator detection on the conference all-in-one machine based on the target microphone; the performance indicator detection is performed on each of the conference all-in-one machines according to the target detection strategy, including at least one of the following: for each of the conference all-in-one machines, control the second speaker of the conference all-in-one machine to play the first test audio, and control the target microphone to collect the current audio to obtain the seventh re-collected audio; determine the first performance indicator of the second speaker of the conference all-in-one machine based on the seventh re-collected audio; for each of the conference all-in-one machines, control the second speaker of the conference all-in-one machine to play the second test audio, and control the target microphone to collect the current audio The first audio is used to collect the second test audio of the first conference machine, and the eighth recollected audio is obtained, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; according to the eighth recollected audio, the second performance indicator of the second speaker of the conference all-in-one machine is determined, wherein the second performance indicator includes speech intelligibility and / or stuttering; for each of the conference all-in-one machines, the second speaker of the conference all-in-one machine is controlled to play the second test audio, and the second microphone of the conference all-in-one machine is controlled to collect the current audio, so as to obtain the ninth recollected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; according to the ninth recollected audio, the echo cancellation indicator of the conference all-in-one machine is determined.

[0253] According to one or more embodiments of the present disclosure, Example 9 provides the method of Example 1, which determines at least one target audio device to be inspected in the conference room audio system, including: obtaining a second state of each audio device in the conference room audio system, wherein the second state is used to characterize whether the audio device is online; and determining the audio device whose second state is online as the target audio device.

[0254] According to one or more embodiments of the present disclosure, Example 10 provides the method of Example 9, and before the step of determining the audio device whose second state is online as the target audio device, the method also includes: if there is an audio device whose second state is offline, sending selection information to the user terminal for the user to choose whether to skip the inspection of the offline audio device; in response to receiving a first selection instruction sent by the user terminal to indicate skipping the inspection of the offline audio device, or there is no audio device whose second state is offline, executing the step of determining the audio device whose second state is online as the target audio device; in response to receiving a second selection instruction sent by the user terminal to indicate inspection including offline audio devices, controlling the audio device whose second state is offline to start, and determining each of the audio devices in the conference room audio system as the target audio device.

[0255] According to one or more embodiments of the present disclosure, Example 11 provides a method of any one of Examples 2-8, wherein the method further includes: determining a first state of the m first speakers and the n first microphones based on performance indicator detection results of the m first speakers and the n first microphones, wherein the first state is used to characterize whether a corresponding device has a fault; if there is a first speaker that has not failed and there is a first microphone that has not failed, then using a target speaker and a target microphone to detect the spatial acoustic environment of a physical conference room where the at least one target audio device is located, wherein the target speaker is any first speaker that has not failed, and the target microphone is any first microphone that has not failed.

[0256] According to one or more embodiments of the present disclosure, Example 12 provides the method of Example 11, which uses a target speaker and a target microphone to detect the spatial acoustic environment of a physical conference room where the at least one target audio device is located, including: controlling the target speaker to play a fifth test audio, and controlling the target microphone to collect the current audio to obtain a tenth re-collected audio, wherein the fifth test audio includes a pulse signal; performing noise reduction on the tenth re-collected audio; generating an energy attenuation curve of the tenth re-collected audio after noise reduction; and determining the reverberation time of the spatial acoustic environment according to the energy attenuation curve.

[0257] According to one or more embodiments of the present disclosure, Example 13 provides the method of Example 12, which uses a target speaker and a target microphone to detect the spatial acoustic environment of a physical conference room where the at least one target audio device is located, and also includes: when the physical conference room is in a quiet state, controlling the target microphone to collect the ambient sound signal of the physical conference room; extracting pure background noise information from the ambient sound signal; and determining the ambient background noise of the spatial acoustic environment based on the pure background noise information.

[0258] According to one or more embodiments of the present disclosure, Example 14 provides the method of Example 11, which also includes: if there is a first speaker that is not faulty and each of the first microphones is faulty, the spatial acoustic environment is detected using the target speaker and the third microphone, wherein the third microphone is a device temporarily added to the physical conference room; if each of the first speakers is faulty and there is a first microphone that is not faulty, the spatial acoustic environment is detected using the third speaker and the target microphone, wherein the third speaker is a device temporarily added to the physical conference room; if each of the first speakers and each of the first microphones is faulty, the spatial acoustic environment is detected using the third speaker and the third microphone.

[0259] According to one or more embodiments of the present disclosure, Example 15 provides a method of any one of Examples 1-8, wherein the conference room audio system includes an audio device and a conference terminal connected via a local area network, and the method is applied to the conference terminal; or the conference room audio system includes an audio device and a remote server connected via a wide area network, and the method is applied to the remote server.

[0260] According to one or more embodiments of the present disclosure, Example 16 provides a method of any one of Examples 1-8, wherein the conference room audio system includes an audio device, a conference terminal, and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network; the remote server executes the inspection method using the conference terminal as a communication medium; or, determining at least one target audio device to be inspected in the conference room audio system includes: the conference terminal determines at least one target audio device to be inspected in the conference room audio system; controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect audio from the speaker. The method of performing performance index detection on the at least one target audio device in a manner of controlling the speaker in the at least one target audio device to play the corresponding test audio and the corresponding microphone in the at least one target audio device to collect the audio played by the speaker, thereby detecting the performance index of the at least one target audio device, and sending the performance index detection result of the at least one target audio device to the remote server; the method of generating an inspection report on the audio system of the conference room according to the performance index detection result of the at least one target audio device includes: the remote server generating an inspection report on the audio system of the conference room according to the performance index detection result of the at least one target audio device sent by the conference terminal.

[0261] According to one or more embodiments of the present disclosure, Example 17 provides a method of any one of Examples 1-8, wherein the conference room audio system includes an audio device, a conference terminal, and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network; and the remote server executes the inspection method using the conference terminal as a communication medium.

[0262] According to one or more embodiments of the present disclosure, Example 18 provides the method of Example 1, which generates an inspection report of the conference room audio system based on the performance indicator detection result of the at least one target audio device, including: generating an overall health of the at least one target audio device based on the performance indicator detection result of the at least one target audio device, and / or determining a first state of the at least one target audio device to obtain an evaluation result, wherein the first state is used to characterize whether a corresponding device has a fault; generating an inspection report of the conference room audio system based on the overall health and / or the evaluation result.

[0263] According to one or more embodiments of the present disclosure, Example 19 provides a computer-readable medium having a computer program stored thereon, which implements the steps of any of the methods described in Examples 1-18 when executed by a processing device.

[0264] According to one or more embodiments of the present disclosure, Example 20 provides a computer program product, including a computer program, which implements the steps of any one of the methods of Examples 1-18 when executed by a processor.

[0265] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0266] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0267] Although the subject matter has been described in language specific to structural features and / or method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Claims

1. A method for inspecting a conference room audio system, characterized in that: include: Determine at least one target audio device to be inspected in the conference room audio system; Performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play corresponding test audio and a corresponding microphone in the at least one target audio device to collect audio played by the speaker; An inspection report of the conference room audio system is generated according to the performance indicator detection result of the at least one target audio device.

2. The method according to claim 1, characterized in that The at least one target audio device includes m first speakers and n first microphones, wherein m≥1, n≥1; The method of performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play corresponding test audio and a corresponding microphone in the at least one target audio device to collect audio played by the speaker includes: Combine the m first loudspeakers and the n first microphones one by one to form m*n loudspeaker-microphone pairs; For each of the speaker-microphone pairs, control the first speaker in the speaker-microphone pair to play a first test audio, and control the first microphone in the speaker-microphone pair to collect current audio to obtain a first collected audio, wherein the first test audio includes a continuous sweep frequency signal from low frequency to high frequency; Determine, according to the first collected audio, a first performance indicator of the first microphone and the first speaker in the speaker-microphone pair, wherein the first performance indicator comprises a frequency response and / or a total harmonic distortion; All the first performance indicators are aggregated as a performance indicator detection result of the at least one target audio device.

3. The method according to claim 2, characterized in that The method of performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker, further includes: For each of the speaker-microphone pairs, control the first speaker in the speaker-microphone pair to play a second test audio, and control the first microphone in the speaker-microphone pair to collect current audio to obtain a second collected audio, wherein the second test audio includes a speech segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; Determine, according to the second collected audio, a second performance indicator of the first microphone and the first speaker in the speaker-microphone pair, wherein the second performance indicator includes speech intelligibility and / or jamming; All the second performance indicators are aggregated as the performance indicator detection result of the at least one target audio device.

4. The method according to claim 2, characterized in that: The at least one target audio device further includes p integrated conference devices, where p≥1; The method of performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker, further includes: Determine, according to the performance indicator detection results of the m first speakers and the n first microphones, a first state of the m first speakers and the n first microphones, wherein the first state is used to indicate whether a corresponding device fails; Determining a target detection strategy for the all-in-one conference machine according to the first state; According to the target detection strategy, performance index detection is performed on each of the all-in-one conference machines.

5. The method according to claim 4, characterized in that The determining, according to the first state, a target detection strategy of the all-in-one conference machine includes: If there is a first speaker that is not faulty and there is a first microphone that is not faulty, determining that the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target speaker and the target microphone, wherein the target speaker is any first speaker that is not faulty, and the target microphone is any first microphone that is not faulty; If there is a first speaker that has not failed, and each of the first microphones has failed, determining that the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target speaker; If each of the first speakers fails, and there is a first microphone that has not failed, determining that the target detection strategy is to perform performance indicator detection on the all-in-one conference machine based on the target microphone; If each of the first speakers and each of the first microphones fails, the target detection strategy is determined to perform performance indicator detection on the all-in-one conference machine based on the second speaker and the second microphone of the all-in-one conference machine.

6. The method according to claim 5, characterized in that The target detection strategy is to perform performance index detection on the all-in-one conference machine based on a target loudspeaker and a target microphone, or to perform performance index detection on the all-in-one conference machine based on the target loudspeaker; The performing performance indicator detection on each of the integrated conference devices according to the target detection strategy includes at least one of the following: For each of the all-in-one conference machines, control the target speaker to play the first test audio, and control the second microphone of the all-in-one conference machine to collect current audio to obtain a third collected audio; determine the first performance indicator of the second microphone of the all-in-one conference machine according to the third collected audio; For each of the all-in-one conference machines, control the target speaker to play the third test audio, and control the second microphone of the all-in-one conference machine to collect the current audio, so as to obtain a fourth collected audio, wherein the third test audio includes components covering low frequency to high frequency, and the speech speed and pronunciation clarity meet the preset standards, and include a voice segment with a volume varying from low to high; determine the third performance index of the second microphone of the all-in-one conference machine and the automatic gain control index of the all-in-one conference machine according to the fourth collected audio, wherein the third performance index includes speech intelligibility and / or jamming; For each of the all-in-one conference machines, control the target speaker to play the fourth test audio, and control the second microphone of the all-in-one conference machine to collect the current audio, so as to obtain a fifth collected audio, wherein the fourth test audio includes voice segments covering low-frequency to high-frequency components, whose speech speed and pronunciation clarity meet the preset standards, and contain different noise types and signal-to-noise ratios; determine the noise suppression index of the all-in-one conference machine according to the fifth collected audio; For each of the all-in-one conference machines, the target speaker and the second speaker of the all-in-one conference machine are controlled to play the second test audio at the same time, and the second microphone of the all-in-one conference machine is controlled to collect the current audio to obtain a sixth echoed audio, wherein the second test audio includes voice segments covering low-frequency to high-frequency components, and the speaking speed and pronunciation clarity all meet the preset standards; based on the sixth echoed audio, the echo cancellation index of the all-in-one conference machine is determined.

7. The method according to claim 6, characterized in that The target detection strategy is to perform performance index detection on the all-in-one conference machine based on the target speaker and the target microphone; The performing performance index detection on each of the integrated conference devices according to the target detection strategy also includes: For each of the all-in-one conference machines, control the second speaker of the all-in-one conference machine to play the first test audio, and control the target microphone to collect the current audio to obtain a seventh collected audio; determine the first performance indicator of the second speaker of the all-in-one conference machine based on the seventh collected audio; and / or For each of the all-in-one conference machines, the second speaker of the all-in-one conference machine is controlled to play a second test audio, and the target microphone is controlled to collect the current audio to obtain an eighth re-collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; based on the eighth re-collected audio, the second performance indicator of the second speaker of the all-in-one conference machine is determined, wherein the second performance indicator includes speech intelligibility and / or stuttering.

8. The method according to claim 5, characterized in that The target detection strategy is to perform performance index detection on the all-in-one conference machine based on the target microphone; The performing performance indicator detection on each of the integrated conference devices according to the target detection strategy includes at least one of the following: For each of the all-in-one conference machines, control the second speaker of the all-in-one conference machine to play the first test audio, and control the target microphone to collect the current audio to obtain a seventh collected audio; determine the first performance indicator of the second speaker of the all-in-one conference machine according to the seventh collected audio; For each of the all-in-one conference machines, control the second speaker of the all-in-one conference machine to play a second test audio, and control the target microphone to collect the current audio, to obtain an eighth collected audio, wherein the second test audio includes a voice segment covering low-frequency to high-frequency components, and the speech speed and pronunciation clarity meet the preset standards; determine the second performance indicator of the second speaker of the all-in-one conference machine according to the eighth collected audio, wherein the second performance indicator includes speech intelligibility and / or jamming; For each of the all-in-one conference machines, the second speaker of the all-in-one conference machine is controlled to play the second test audio, and the second microphone of the all-in-one conference machine is controlled to collect the current audio to obtain a ninth echoed audio, wherein the second test audio includes voice segments covering low-frequency to high-frequency components, and the speaking speed and pronunciation clarity all meet the preset standards; based on the ninth echoed audio, the echo cancellation index of the all-in-one conference machine is determined.

9. The method according to claim 1, characterized in that: The step of determining at least one target audio device to be inspected in the conference room audio system includes: Acquire a second state of each audio device in the conference room audio system, wherein the second state is used to indicate whether the audio device is online; The audio device in the second state of being online is determined as the target audio device.

10. The method according to claim 9, characterized in that Before the step of determining the audio device in the second online state as the target audio device, the method further includes: If there is the audio device whose second status is offline, sending selection information to the user terminal so that the user can choose whether to skip the inspection of the offline audio device; In response to receiving a first selection instruction sent by the user terminal for instructing to skip the inspection of offline audio devices, or there is no audio device whose second status is offline, performing the step of determining the audio device whose second status is online as the target audio device; In response to receiving a second selection instruction sent by the user terminal for indicating a patrol including offline audio devices, the audio devices in the second state of offline are controlled to start, and each of the audio devices in the conference room audio system is determined as the target audio device.

11. The method according to any one of claims 2 to 8, characterized in that: The method further comprises: Determine, according to the performance indicator detection results of the m first speakers and the n first microphones, a first state of the m first speakers and the n first microphones, wherein the first state is used to indicate whether a corresponding device fails; If there is a first speaker that is not faulty and there is a first microphone that is not faulty, the spatial acoustic environment of the physical conference room where the at least one target audio device is located is detected using the target speaker and the target microphone, wherein the target speaker is any first speaker that is not faulty and the target microphone is any first microphone that is not faulty.

12. The method according to claim 11, characterized in that The detecting, using a target loudspeaker and a target microphone, a spatial acoustic environment of a physical conference room where the at least one target audio device is located includes: Control the target speaker to play a fifth test audio, and control the target microphone to collect current audio, to obtain a tenth collected audio, wherein the fifth test audio includes a pulse signal; Performing noise reduction on the tenth audio sample; Generate an energy attenuation curve of the tenth audio sample after noise reduction; The reverberation time of the spatial acoustic environment is determined according to the energy decay curve.

13. The method according to claim 12, characterized in that The detecting, using the target loudspeaker and the target microphone, the spatial acoustic environment of the physical conference room where the at least one target audio device is located, further includes: When the physical conference room is in a quiet state, controlling the target microphone to collect an ambient sound signal of the physical conference room; Extracting pure background noise information from the ambient sound signal; The ambient noise floor of the spatial acoustic environment is determined according to the pure noise floor information.

14. The method according to claim 11, characterized in that The method further comprises: If there is a first speaker that is not faulty and each of the first microphones is faulty, the spatial acoustic environment is detected using the target speaker and the third microphone, wherein the third microphone is a device temporarily added to the physical conference room; If each of the first speakers fails and there is a first microphone that is not failed, the spatial acoustic environment is detected using a third speaker and the target microphone, wherein the third speaker is a device temporarily added to the physical conference room; If each of the first speakers and each of the first microphones fails, the third speaker and the third microphone are used to detect the spatial acoustic environment.

15. The method according to any one of claims 1 to 8, characterized in that The conference room audio system includes an audio device and a conference terminal connected via a local area network, and the method is applied to the conference terminal; or The conference room audio system includes an audio device and a remote server connected via a wide area network, and the method is applied to the remote server.

16. The method according to any one of claims 1 to 8, characterized in that The conference room audio system includes an audio device, a conference terminal and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network; The remote server executes the inspection method using the conference terminal as a communication medium; or The determining of at least one target audio device to be inspected in the conference room audio system includes: the conference terminal determining at least one target audio device to be inspected in the conference room audio system; the performing of performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker, including: the conference terminal performing performance index detection on the at least one target audio device by controlling a speaker in the at least one target audio device to play a corresponding test audio and a corresponding microphone in the at least one target audio device to collect the audio played by the speaker, and sending the performance index detection result of the at least one target audio device to the remote server; the generating of an inspection report of the conference room audio system according to the performance index detection result of the at least one target audio device includes: the remote server generating an inspection report of the conference room audio system according to the performance index detection result of the at least one target audio device sent by the conference terminal.

17. The method according to any one of claims 1 to 8, characterized in that The conference room audio system includes an audio device, a conference terminal and a remote server, wherein the conference terminal is connected to the audio device via a local area network, and the conference terminal is connected to the remote server via a wide area network; The remote server executes the inspection method using the conference terminal as a communication medium.

18. The method according to claim 1, characterized in that The step of generating an inspection report of the conference room audio system according to the performance indicator detection result of the at least one target audio device includes: Generate an overall health of the at least one target audio device according to the performance indicator detection result of the at least one target audio device, and / or determine a first state of the at least one target audio device to obtain an evaluation result, wherein the first state is used to indicate whether a corresponding device fails; Generate an inspection report of the conference room audio system according to the overall health status and / or the evaluation result.

19. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processing device, the steps of the method according to any one of claims 1 to 18 are implemented.

20. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 18 are implemented.

Images