Conference unit and working method of conference unit

Abstract

Provided in the present application are a conference unit and a working method of the conference unit. The conference unit comprises: a first microphone, an analog audio link, a second microphone, an analog-to-digital conversion circuit, a data distribution circuit, a first digital audio link and a second digital audio link. The analog audio link is connected to the first microphone; an input end of the data distribution circuit is connected to an output end of the analog-to-digital conversion circuit; and a first output end of the data distribution circuit is connected to the first digital audio link, and a second output end of the data distribution circuit is connected to the second digital audio link. The conference unit in the embodiments of the present application uses two digital audio links and one analog audio link to carry out redundant backup of audio data, thereby helping to improve the reliability of audio transmission and backup during conferences.

Description

Conference unit and working method of conference unit Technical Field

[0001] The present application relates to the technical field of conference system design, and in particular to a conference unit and a working method of the conference unit. Background Art

[0002] A conference unit is the core device used by delegates during a meeting. One of its functions is to capture and output audio during the meeting. Audio reliability is paramount for meetings; audio must not be interrupted. Any audio failure would disrupt the meeting and negatively impact all participants. Therefore, sufficient audio redundancy is a crucial technical requirement for conference units. However, existing backup solutions typically rely on single analog backups. Analog audio signal transmission is susceptible to interference, has limited transmission distance, and is difficult to back up and manage in batches of conference units, resulting in low reliability.

[0003] Summary of the Invention

[0004] In response to the above problems, the present application provides a conference unit and a working method of the conference unit, which is conducive to improving the reliability of the conference unit's audio redundancy backup and ensuring the normal output of the conference audio.

[0005] To achieve the above objectives, the present application provides a conference unit in a first aspect, comprising:

[0006] a first microphone, an analog audio link, a second microphone, an analog-to-digital conversion circuit, a data distribution circuit, a first digital audio link, and a second digital audio link;

[0007] The analog audio link is connected to the first microphone; the analog audio link is used to output the first analog audio data collected by the first microphone to the phantom power supply device for backup;

[0008] The input end of the data distribution circuit is connected to the output end of the analog-to-digital conversion circuit, the first output end of the data distribution circuit is connected to the first digital audio link, and the second output end of the data distribution circuit is connected to the second digital audio link; the analog-to-digital conversion circuit is used to convert the first analog audio data collected by the second microphone; the data distribution circuit is used to send the first digital audio data obtained after the conversion by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link;

[0009] The first digital audio link is used to output the first digital audio data sent by the data distribution circuit to the audio output end through MCA-STREAM digital processing and transmission technology; the second digital audio link is used to send the first digital audio data sent by the data distribution circuit to the network switch through the AES67 network, so as to be output to the digital audio processor through the network switch for backup.

[0010] In combination with the first aspect, in a possible embodiment, the conference unit also includes a power management circuit; the first input end of the power management circuit is connected to the first power supply, and the second input end of the power management circuit is connected to the second power supply; the output end of the power management circuit is connected to the data distribution circuit and the analog-to-digital conversion circuit in sequence; the first power supply and the second power supply power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit, and the first power supply and the second power supply serve as backup power supplies for each other.

[0011] In combination with the first aspect, in a possible implementation, the network switch is a PoE switch; the first power supply is the PoE switch; and the second power supply is a host of the conference system.

[0012] In conjunction with the first aspect, in one possible implementation, the conference unit further includes a digital-to-analog conversion circuit; after sending the first digital audio data to the first digital audio link, the data distribution circuit is further configured to instruct the audio output terminal to return the first digital audio data and to send the second digital audio data returned by the audio output terminal to the digital-to-analog conversion circuit; and, the first digital audio data is sent to the digital-to-analog conversion circuit.

[0013] The digital-to-analog conversion circuit is configured to convert the second digital audio data into second analog audio data, and convert the first digital audio data into third analog audio data, and send the second analog audio data and the third analog audio data to the data distribution circuit;

[0014] The data distribution circuit is also used to calculate the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data, and obtain the loss rate of the audio data transmitted by the first digital audio link based on the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data; when the loss rate is greater than or equal to the loss rate threshold, it is determined that the first digital audio link transmission is abnormal, and an audio output indication signal is sent to the network switch through the second digital audio link; the audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output end; the audio output end is used to output the first digital audio data sent by the network switch as the audio output of the conference.

[0015] In combination with the first aspect, in a possible implementation, for any one channel of analog audio data A among the second analog audio data and the third analog audio data, the data distribution circuit is specifically configured to:

[0016] Slide on the analog audio data A with the set time window and step size, and calculate the energy mean in the time window; when the energy mean in the time window is less than the first energy threshold and greater than or equal to the second energy threshold, divide the time window into a first sub-time window and a second sub-time window with the vertical central axis of the time window as the boundary, and calculate the energy mean in the first sub-time window and the second sub-time window; if the energy mean in the first sub-time window and / or the second sub-time window is less than the first energy threshold and greater than or equal to the second energy threshold, continue to divide the first sub-time window and / or the second sub-time window into windows with the vertical central axis as the boundary, until the target time window is obtained; the energy mean in the sub-time window a of the target time window is greater than or equal to the first energy threshold, and the energy mean in the sub-time window b of the target time window is less than the second energy threshold; the time window or sub-time window with the energy mean greater than or equal to the first energy threshold is marked as a human voice audio data window, and the time window or sub-time window with the energy mean less than the second energy threshold is marked as an environmental noise audio data window; the analog audio data A is framed to obtain multiple audio frames, and based on the multiple audio frames, the human voice audio data windows and the environmental noise audio data windows, the human voice audio length in the analog audio data A is obtained.

[0017] In combination with the first aspect, in a possible implementation, the data allocation circuit is specifically used to: obtain human voice audio frames from multiple audio frames, count the number of intersections between the audio data in the human voice audio frames and the audio data in the human voice audio data window; count the number of audio data in the ambient noise audio data window; and use the number of intersections between the audio data in the human voice audio frames and the audio data in the human voice audio data window and the number of audio data in the ambient noise audio data window to calculate the human voice audio length in the simulated audio data A.

[0018] A second aspect of the present application provides a working method of a conference unit, which is applied to the conference unit described in any one of the first aspects, and the method includes:

[0019] Using an analog audio link to output first analog audio data collected by the first microphone to a phantom power supply device for backup;

[0020] converting the first analog audio data collected by the second microphone through an analog-to-digital conversion circuit;

[0021] Sending the first digital audio data converted by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link through the data distribution circuit;

[0022] Using a first digital audio link to output first digital audio data sent by the data distribution circuit to an audio output terminal through MCA-STREAM digital processing and transmission technology;

[0023] The first digital audio data sent by the data distribution circuit is sent to the network switch via the AES67 network using a second digital audio link, so as to be output to the digital audio processor through the network switch for backup.

[0024] In combination with the second aspect, in one possible embodiment, the first input end of the power management circuit is connected to the first power supply, and the second input end of the power management circuit is connected to the second power supply; the output end of the power management circuit is connected to the data distribution circuit and the analog-to-digital conversion circuit in sequence; the first power supply and the second power supply power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit, and the first power supply and the second power supply serve as backup power supplies for each other.

[0025] In conjunction with the second aspect, in a possible implementation, the network switch is a PoE switch; the first power supply is the PoE switch; and the second power supply is a host of the conference system.

[0026] In conjunction with the second aspect, in one possible implementation, after the data distribution circuit sends the first digital audio data to the first digital audio link, the method further includes:

[0027] instructing the audio output terminal to return the first digital audio data through the data distribution circuit;

[0028] receiving the digital audio data returned by the audio output terminal through the data distribution circuit to obtain second digital audio data; sending the second digital audio data to the digital-to-analog conversion circuit; and sending the first digital audio data to the digital-to-analog conversion circuit;

[0029] converting the second digital audio data into second analog audio data through the digital-to-analog conversion circuit, and converting the first digital audio data into third analog audio data, and sending the second analog audio data and the third analog audio data to the data distribution circuit;

[0030] The human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data are calculated through the data distribution circuit, and the loss rate of the audio data transmitted by the first digital audio link is obtained based on the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data; when the loss rate is greater than or equal to the loss rate threshold, it is determined that the first digital audio link transmission is abnormal, and an audio output indication signal is sent to the network switch through the second digital audio link; the audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output end, so that the audio output end outputs the first digital audio data sent by the network switch as the audio output of the conference.

[0031] In conjunction with the second aspect, in one possible implementation, calculating the length of the human voice audio in the second analog audio data and the length of the human voice audio in the third analog audio data includes:

[0032] The data distribution circuit slides on the analog audio data A with a set time window and step size to calculate the energy mean in the time window; when the energy mean in the time window is less than the first energy threshold and greater than or equal to the second energy threshold, the time window is divided into a first sub-time window and a second sub-time window with the vertical center axis of the time window as the boundary, and the energy mean in the first sub-time window and the second sub-time window is calculated; if the energy mean in the first sub-time window and / or the second sub-time window is less than the first energy threshold and greater than or equal to the second energy threshold, the energy mean in the first sub-time window and / or the second sub-time window is continued to be divided with the vertical center axis as the boundary. The rows are windowed until a target time window is obtained; the energy mean in a sub-time window a of the target time window is greater than or equal to a first energy threshold, and the energy mean in a sub-time window b of the target time window is less than a second energy threshold; the time window or sub-time window whose energy mean is greater than or equal to the first energy threshold is marked as a human voice audio data window, and the time window or sub-time window whose energy mean is less than the second energy threshold is marked as an environmental noise audio data window; the analog audio data A is framed to obtain multiple audio frames, and the human voice audio length in the analog audio data A is obtained based on the multiple audio frames, the human voice audio data windows and the environmental noise audio data windows.

[0033] In conjunction with the second aspect, in one possible implementation, obtaining the length of the human voice audio in the analog audio data A based on multiple audio frames, the human voice audio data window, and the ambient noise audio data window includes:

[0034] Acquire a human voice audio frame from a plurality of audio frames through a data distribution circuit, and count the number of intersections of audio data in the human voice audio frame and audio data in the human voice audio data window;

[0035] Counting the number of audio data in the ambient noise audio data window by a data distribution circuit;

[0036] The human voice audio length in the simulated audio data A is calculated by the data allocation circuit using the number of intersections of the audio data in the human voice audio frame and the audio data in the human voice audio data window and the number of audio data in the ambient noise audio data window.

[0037] As can be seen, in the embodiments of this application, two digital audio links plus one analog audio link are used in the conference unit for redundant audio data backup. These two digital audio links can address issues such as analog audio links' susceptibility to interference, limited transmission distance, and difficulty in backing up and managing batches of conference units, thereby improving the reliability of audio transmission and backup during meetings. Furthermore, there is no need to configure two conference systems or dual conference units, which helps save costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0039] FIG1 is a schematic diagram of a conference unit provided in an embodiment of the present application;

[0040] FIG2 is a schematic diagram of another conference unit provided in an embodiment of the present application;

[0041] FIG3 is a schematic diagram of another conference unit provided in an embodiment of the present application;

[0042] FIG4 is a schematic diagram of a time window provided in an embodiment of the present application;

[0043] FIG5 is a flow chart of a working method of a conference unit provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0045] The terms "including" and "having," as used in the specification, claims, and drawings of this application, and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus. In addition, the terms "first," "second," and "third," etc., are used to distinguish between different objects, not to describe a particular order.

[0046] Please refer to Figure 1, which is a schematic diagram of a conference unit provided in an embodiment of the present application. As shown in Figure 1, the conference unit includes a first microphone, an analog audio link, a second microphone, an analog-to-digital conversion circuit, a data distribution circuit, a first digital audio link, and a second digital audio link. The analog audio link is connected to the first microphone; the analog audio link is used to output the first analog audio data collected by the first microphone to a phantom power supply device for backup. The first microphone is powered by a phantom power supply circuit, and the phantom power supply device can be a mixing console. The analog audio link can be connected to the phantom power supply device via an XLR interface.

[0047] The input of the data distribution circuit is connected to the output of the analog-to-digital conversion circuit. The first output of the data distribution circuit is connected to the first digital audio link, and the second output of the data distribution circuit is connected to the second digital audio link. The analog-to-digital conversion circuit is configured to convert the first analog audio data collected by the second microphone. The data distribution circuit is configured to transmit the first digital audio data converted by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link. The first digital audio link is configured to output the first digital audio data sent by the data distribution circuit to an audio output terminal using MCA-STREAM (Multi-Channel Audio STREAM) digital processing and transmission technology. The audio output terminal can be the main unit of the conference system. Specifically, as shown in Figure 1, the first digital audio link is connected to the local audio network, connecting the current conference unit to the previous and next conference units, and ultimately connecting all conference units to the main unit of the conference system. The second digital audio link is configured to transmit the first digital audio data sent by the data distribution circuit to a network switch via an AES67 network, for output to the digital audio processor via the network switch for backup. The network switch is a PoE switch, and the second digital audio link can be connected to the network switch via an RJ45 interface.

[0048] As can be seen, in the embodiments of this application, two digital audio links plus one analog audio link are used in the conference unit for redundant audio data backup. These two digital audio links can address issues such as analog audio links' susceptibility to interference, limited transmission distance, and difficulty in backing up and managing batches of conference units, thereby improving the reliability of audio transmission and backup during meetings. Furthermore, there is no need to configure two conference systems or dual conference units, which helps save costs.

[0049] Exemplarily, as shown in FIG2 , the conference unit further includes a power management circuit; a first input of the power management circuit is connected to a first power supply, which may be a PoE switch, i.e., powered by PoE. A second input of the power management circuit is connected to a second power supply, which is exemplarily connected to the second power supply via a local power supply network, which may be a main unit of the conference system. An output of the power management circuit is sequentially connected to a data distribution circuit and an analog-to-digital conversion circuit; the first and second power supplies power the data distribution circuit, the analog-to-digital conversion circuit, and the second microphone via the power management circuit, and the first and second power supplies serve as backup power sources for each other.

[0050] In this implementation, the first power supply and the second power supply can simultaneously power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit. The two power supplies serve as backup power supplies for each other. If any power supply fails, it will not affect the normal operation of the data distribution circuit, the analog-to-digital conversion circuit and the second microphone, thereby improving the power supply reliability of the conference unit.

[0051] Exemplarily, as shown in Figure 3, the conference unit further includes a digital-to-analog conversion circuit. After sending the first digital audio data to the first digital audio link, the data distribution circuit is further configured to instruct the audio output terminal to return the first digital audio data, and to send the digital audio data (i.e., second digital audio data) returned by the audio output terminal to the digital-to-analog conversion circuit; and further, to send the first digital audio data to the digital-to-analog conversion circuit. The digital-to-analog conversion circuit is configured to convert the second digital audio data into second analog audio data, and convert the first digital audio data into third analog audio data, and to send the second and third analog audio data to the data distribution circuit.

[0052] Exemplarily, the data distribution circuit may be a device with logic processing capabilities, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc. The data distribution circuit is further configured to calculate the length of the human voice audio in the second analog audio data and the length of the human voice audio in the third analog audio data, and obtain a loss rate of audio data transmitted by the first digital audio link based on the length of the human voice audio in the second analog audio data and the length of the human voice audio in the third analog audio data; if the loss rate is greater than or equal to a loss rate threshold, determining that the first digital audio link transmission is abnormal, and sending an audio output indication signal to the network switch via the second digital audio link; the audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output terminal; the audio output terminal is used to output the first digital audio data sent by the network switch as the audio output of the conference.

[0053] Exemplarily, as shown in Figure 4, for any one analog audio data A in the second analog audio data and the third analog audio data, the data distribution circuit slides on the analog audio data A with a set time window and step size, calculates the energy mean within the time window, and when the energy mean within the time window is less than the second energy threshold, the time window is marked as an ambient noise audio data window, that is, it is considered that the audio data in the window is mainly ambient noise data; when the energy mean within the time window is greater than or equal to the first energy threshold, the time window is marked as a human voice audio data window, that is, it is considered that the audio data in the window is mainly ambient noise data; when the energy mean within the time window is less than the first energy threshold and greater than or equal to the second energy threshold, the time window is divided into a first sub-time window and a second sub-time window with the vertical central axis of the time window as the boundary. The data allocation circuit then calculates the energy mean within the first sub-time window and the second sub-time window, and determines the audio data within the first sub-time window and the second sub-time window in the same manner. If the energy mean within the first sub-time window and / or the second sub-time window is less than the second energy threshold, the first sub-time window and / or the second sub-time window are similarly marked as an ambient noise audio data window. If the energy mean within the first sub-time window and / or the second sub-time window is greater than or equal to the first energy threshold, the first sub-time window and / or the second sub-time window are similarly marked as a human voice audio data window. If the energy mean within the first sub-time window and / or the second sub-time window is less than the first energy threshold and greater than or equal to the second energy threshold, the first sub-time window and / or the second sub-time window are further windowed along the vertical central axis until a target time window is obtained. The energy mean within sub-time window a of the target time window is greater than or equal to the first energy threshold, and the energy mean within sub-time window b of the target time window is less than the second energy threshold. It should be understood that the purpose of this is to find the dividing point between the human voice audio data and the ambient noise audio data by dividing the time window, that is, the intersection of the vertical center axis of the target time window and the waveform of the simulated audio data A. The time window and step size are set to s milliseconds.

[0054] Exemplarily, the data allocation circuit is further configured to frame the analog audio data A to obtain multiple audio frames, and obtain the length of the human voice audio in the analog audio data A based on the multiple audio frames, the human voice audio data window, and the ambient noise audio data window. Specifically, the data allocation circuit obtains a human voice audio frame from the multiple audio frames, traverses each human voice audio frame, counts the number of intersections between the audio data in the human voice audio frame and the audio data in the human voice audio data window, and then counts the number of audio data in the ambient noise audio data window; the length of the human voice audio in the analog audio data A is calculated using the number of intersections between the audio data in the human voice audio frame and the audio data in the human voice audio data window and the number of audio data in the ambient noise audio data window, as expressed by the formula:

[0055] Wherein, L represents the length of the human voice audio in the simulated audio data A, T represents the duration of the simulated audio data A, m represents the human voice audio frame, n represents the human voice audio data window, sum(m∩n) represents the total number of intersections of the audio data in the human voice audio frame and the audio data in the human voice audio data window, k represents the ambient noise audio data window, sum(k) represents the total number of audio data in the ambient noise audio data window. The intersection of the audio data in the human voice audio frame and the audio data in the human voice audio data window is regarded as the real and effective human voice audio data. Indicates the proportion of real and effective human voice audio data in the total audio data.

[0056] For example, since there is a clear difference in energy between human voice and ambient noise, the data allocation circuit can calculate the energy in each audio frame and compare the energy with a preset value to distinguish whether the audio frame is a human voice audio frame or an ambient noise audio frame.

[0057] For example, assuming that the calculated length of the human voice audio in the second analog audio data is L1 and the calculated length of the human voice audio in the third analog audio data is L2, the loss rate of the audio data transmitted by the first digital audio link is calculated using the following formula:

[0058] Where Loss represents the loss rate, and α represents a preset adjustment coefficient, which ranges from (1 to 2). Since the second digital audio data is the audio data transmitted and returned by the data distribution circuit through the first digital audio link, it undergoes two transmissions through the first digital audio link. Therefore, the adjustment coefficient α is required to adjust L1 so that the adjusted human voice audio length approximates the human voice audio length analyzed after a single transmission through the first digital audio link. The adjustment coefficient α can be set by R&D personnel based on experimental data.

[0059] Please refer to FIG5 , which is a flowchart of a working method of a conference unit provided in an embodiment of the present application. The method can be applied to the conference unit shown in FIG1 to FIG3 . As shown in FIG5 , the method includes steps 501 to 505:

[0060] 501: Outputting first analog audio data collected by a first microphone to a phantom power supply device for backup using an analog audio link;

[0061] 502: Convert the first analog audio data collected by the second microphone using an analog-to-digital conversion circuit;

[0062] 503: Sending the first digital audio data converted by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link through the data distribution circuit;

[0063] 504: Outputting the first digital audio data sent by the data distribution circuit to the audio output terminal using the first digital audio link through MCA-STREAM digital processing and transmission technology;

[0064] 505: Use a second digital audio link to send the first digital audio data sent by the data distribution circuit to the network switch via the AES67 network, so as to be output to the digital audio processor through the network switch for backup.

[0065] As can be seen, in the embodiments of this application, two digital audio links plus one analog audio link are used in the conference unit for redundant audio data backup. These two digital audio links can address issues such as analog audio links' susceptibility to interference, limited transmission distance, and difficulty in backing up and managing batches of conference units, thereby improving the reliability of audio transmission and backup during meetings. Furthermore, there is no need to configure two conference systems or dual conference units, which helps save costs.

[0066] Exemplarily, the first input end of the power management circuit is connected to the first power supply, and the second input end of the power management circuit is connected to the second power supply; the output end of the power management circuit is connected to the data distribution circuit and the analog-to-digital conversion circuit in sequence; the first power supply and the second power supply power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit, and the first power supply and the second power supply serve as backup power supplies for each other.

[0067] Exemplarily, the network switch is a PoE switch; the first power supply is the PoE switch; and the second power supply is a host of the conference system.

[0068] Exemplarily, after the data distribution circuit sends the first digital audio data to the first digital audio link, the method further includes:

[0069] instructing the audio output terminal to return the first digital audio data through the data distribution circuit;

[0070] receiving the digital audio data returned by the audio output terminal through the data distribution circuit to obtain second digital audio data; sending the second digital audio data to the digital-to-analog conversion circuit; and sending the first digital audio data to the digital-to-analog conversion circuit;

[0071] converting the second digital audio data into second analog audio data through the digital-to-analog conversion circuit, and converting the first digital audio data into third analog audio data, and sending the second analog audio data and the third analog audio data to the data distribution circuit;

[0072] The human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data are calculated through the data distribution circuit, and the loss rate of the audio data transmitted by the first digital audio link is obtained based on the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data; when the loss rate is greater than or equal to the loss rate threshold, it is determined that the first digital audio link transmission is abnormal, and an audio output indication signal is sent to the network switch through the second digital audio link; the audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output end, so that the audio output end outputs the first digital audio data sent by the network switch as the audio output of the conference.

[0073] Exemplarily, calculating the length of the human voice audio in the second analog audio data and the length of the human voice audio in the third analog audio data includes:

[0074] The data distribution circuit slides on the analog audio data A with a set time window and step size to calculate the energy mean in the time window; when the energy mean in the time window is less than the first energy threshold and greater than or equal to the second energy threshold, the time window is divided into a first sub-time window and a second sub-time window with the vertical center axis of the time window as the boundary, and the energy mean in the first sub-time window and the second sub-time window is calculated; if the energy mean in the first sub-time window and / or the second sub-time window is less than the first energy threshold and greater than or equal to the second energy threshold, the energy mean in the first sub-time window and / or the second sub-time window is continued to be divided with the vertical center axis as the boundary. The rows are windowed until a target time window is obtained; the energy mean in a sub-time window a of the target time window is greater than or equal to a first energy threshold, and the energy mean in a sub-time window b of the target time window is less than a second energy threshold; the time window or sub-time window whose energy mean is greater than or equal to the first energy threshold is marked as a human voice audio data window, and the time window or sub-time window whose energy mean is less than the second energy threshold is marked as an environmental noise audio data window; the analog audio data A is framed to obtain multiple audio frames, and the human voice audio length in the analog audio data A is obtained based on the multiple audio frames, the human voice audio data windows and the environmental noise audio data windows.

[0075] Exemplarily, obtaining the length of the human voice audio in the analog audio data A based on multiple audio frames, the human voice audio data window, and the ambient noise audio data window includes:

[0076] Acquire a human voice audio frame from a plurality of audio frames through a data distribution circuit, and count the number of intersections of audio data in the human voice audio frame and audio data in the human voice audio data window;

[0077] Counting the number of audio data in the ambient noise audio data window by a data distribution circuit;

[0078] The human voice audio length in the simulated audio data A is calculated by the data allocation circuit using the number of intersections of the audio data in the human voice audio frame and the audio data in the human voice audio data window and the number of audio data in the ambient noise audio data window.

[0079] It should be noted that the specific implementation of the method embodiment shown in FIG5 can refer to the relevant descriptions in the embodiments shown in FIG1 to FIG4 , and can achieve the same or similar beneficial effects.

[0080] The above is a detailed introduction to the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A conference unit, characterized in that: include: a first microphone, an analog audio link, a second microphone, an analog-to-digital conversion circuit, a data distribution circuit, a first digital audio link, and a second digital audio link; The analog audio link is connected to the first microphone; the analog audio link is used to output the first analog audio data collected by the first microphone to a phantom power supply device for backup; The input end of the data distribution circuit is connected to the output end of the analog-to-digital conversion circuit, the first output end of the data distribution circuit is connected to the first digital audio link, and the second output end of the data distribution circuit is connected to the second digital audio link; The analog-to-digital conversion circuit is used to convert the first analog audio data collected by the second microphone; the data distribution circuit is used to send the first digital audio data obtained after the conversion by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link; The first digital audio link is used to output the first digital audio data sent by the data distribution circuit to the audio output end through MCA-STREAM digital processing and transmission technology; the second digital audio link is used to send the first digital audio data sent by the data distribution circuit to the network switch through the AES67 network, so as to be output to the digital audio processor through the network switch for backup.

2. The conference unit according to claim 1, characterized in that: The conference unit also includes a power management circuit; a first input end of the power management circuit is connected to a first power supply, and a second input end of the power management circuit is connected to a second power supply; an output end of the power management circuit is connected to the data distribution circuit and the analog-to-digital conversion circuit in sequence; the first power supply and the second power supply supply power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit, and the first power supply and the second power supply serve as backup power supplies for each other.

3. The conference unit according to claim 2, characterized in that: The network switch is a PoE switch; the first power supply is the PoE switch; and the second power supply is a host of the conference system.

4. The conference unit according to any one of claims 1 to 3, characterized in that: The conference unit further includes a digital-to-analog conversion circuit; after sending the first digital audio data to the first digital audio link, the data distribution circuit is further used to instruct the audio output terminal to return the first digital audio data, and send the second digital audio data returned by the audio output terminal to the digital-to-analog conversion circuit; and, send the first digital audio data to the digital-to-analog conversion circuit; The digital-to-analog conversion circuit is used to convert the second digital audio data into second analog audio data, and convert the first digital audio data into third analog audio data, and send the second analog audio data and the third analog audio data to the data distribution circuit; The data distribution circuit is further used to calculate the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data, and obtain the loss rate of the audio data transmitted by the first digital audio link based on the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data; When the loss rate is greater than or equal to the loss rate threshold, determining that the first digital audio link transmission is abnormal, and sending an audio output indication signal to the network switch through the second digital audio link; The audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output end; the audio output end is used to output the first digital audio data sent by the network switch as the audio output of the conference.

5. The conference unit according to claim 4, characterized in that: For any one channel of analog audio data A among the second analog audio data and the third analog audio data, the data distribution circuit is specifically used for: Slide on the analog audio data A with a set time window and step size, and calculate the energy mean within the time window; When the energy mean value in the time window is less than the first energy threshold value and greater than or equal to the second energy threshold value, the time window is divided into a first sub-time window and a second sub-time window with the vertical center axis of the time window as the boundary, and the energy mean values ​​in the first sub-time window and the second sub-time window are calculated; if the energy mean value in the first sub-time window and / or the second sub-time window is less than the first energy threshold value and greater than or equal to the second energy threshold value, the first sub-time window and / or the second sub-time window are continued to be divided into windows with the vertical center axis as the boundary until the target time window is obtained; the sub-time window of the target time window is The energy mean within time window a is greater than or equal to the first energy threshold, and the energy mean within sub-time window b of the target time window is less than the second energy threshold; the time window or sub-time window whose energy mean is greater than or equal to the first energy threshold is marked as a human voice audio data window, and the time window or sub-time window whose energy mean is less than the second energy threshold is marked as an ambient noise audio data window; the analog audio data A is framed to obtain multiple audio frames, and based on the multiple audio frames, the human voice audio data window and the ambient noise audio data window, the human voice audio length in the analog audio data A is obtained.

6. The conference unit according to claim 5, characterized in that: The data allocation circuit is specifically used to: obtain a human voice audio frame from the multiple audio frames, and count the number of intersections of audio data in the human voice audio frame and audio data in the human voice audio data window; Count the number of audio data in the ambient noise audio data window; and calculate the vocal audio length in the analog audio data A by using the number of intersections of the audio data in the vocal audio frame and the audio data in the vocal audio data window and the number of audio data in the ambient noise audio data window.

7. A working method of a conference unit, characterized in that: Applied to the conference unit according to any one of claims 1 to 6; the method comprises: The analog audio link is used to output the first analog audio data collected by the first microphone to a phantom power supply device for backup; Converting the first analog audio data collected by the second microphone by the analog-to-digital conversion circuit; Sending the first digital audio data converted by the analog-to-digital conversion circuit to the first digital audio link and the second digital audio link through the data distribution circuit; Outputting the first digital audio data sent by the data distribution circuit to the audio output terminal by using the first digital audio link through MCA-STREAM digital processing and transmission technology; The second digital audio link is used to send the first digital audio data sent by the data distribution circuit to a network switch through an AES67 network, so as to be output to a digital audio processor through the network switch for backup.

8. The method according to claim 7, characterized in that A first input end of the power management circuit is connected to a first power supply, and a second input end of the power management circuit is connected to a second power supply; an output end of the power management circuit is connected to the data distribution circuit and the analog-to-digital conversion circuit in sequence; the first power supply and the second power supply supply power the data distribution circuit, the analog-to-digital conversion circuit and the second microphone through the power management circuit, and the first power supply and the second power supply serve as backup power supplies for each other.

9. The method according to claim 8, characterized in that The network switch is a PoE switch; the first power supply is the PoE switch; and the second power supply is a host of the conference system.

10. The method according to any one of claims 7 to 9, characterized in that: After the data distribution circuit sends the first digital audio data to the first digital audio link, the method further includes: Instructing the audio output terminal to return the first digital audio data through the data distribution circuit; Receiving the digital audio data returned by the audio output terminal through the data distribution circuit to obtain second digital audio data; sending the second digital audio data to the digital-to-analog conversion circuit; and sending the first digital audio data to the digital-to-analog conversion circuit; The second digital audio data is converted into second analog audio data by the digital-to-analog conversion circuit, and the converting the first digital audio data into third analog audio data, and sending the second analog audio data and the third analog audio data to the data distribution circuit; The human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data are calculated by the data distribution circuit, and the loss rate of the audio data transmitted by the first digital audio link is obtained based on the human voice audio length in the second analog audio data and the human voice audio length in the third analog audio data; when the loss rate is greater than or equal to the loss rate threshold, it is determined that the first digital audio link transmission is abnormal, and an audio output indication signal is sent to the network switch through the second digital audio link; the audio output indication signal is used to instruct the network switch to output the backed-up first digital audio data to the audio output end, so that the audio output end outputs the first digital audio data sent by the network switch as the audio output of the conference.

Images