A method, apparatus and device for switching a state of a pickup device

Abstract

The application provides a state switching method, device and equipment of a sound pickup device, and relates to the technical field of audio. In the method, the state of the sound pickup device is switched according to a user control instruction; if the sound pickup device is switched to a sound pickup state, the energy of a first input audio signal of the sound pickup device is detected to obtain an energy parameter of the first input audio signal; if the energy parameters of the sound pickup device within a first preset time duration all do not meet a preset energy condition, the sound pickup device is switched from the sound pickup state to a mute state; and if the energy parameters of the sound pickup device within the first preset time duration meet the preset energy condition, the sound pickup device is controlled to continuously be in the sound pickup state. Thus, the state switching of the sound pickup device is accurately controlled, the power consumption of the sound pickup device is saved, and unnecessary cost waste is avoided.

Description

Technical Field

[0001] This invention relates to the field of audio technology, and more specifically, to a method, apparatus, and device for switching the state of a sound pickup device. Background Technology

[0002] With societal development, meeting formats have become more diverse, such as in-person meetings and remote meetings. In scenarios with multiple participants, multiple audio pickup terminals can be configured at a single access point to easily capture the speech of each participant. This audio is then transmitted wirelessly or via wired links to the aggregation terminal, which then transmits or plays the audio locally.

[0003] However, when other speakers need to discuss privately in hushed tones to avoid disturbing the main speaker, they need to be able to actively switch their microphones to silent mode and switch them back to silent mode when they need to speak. In addition, due to the large number of devices and their random placement, users may forget to operate them, resulting in unnecessary energy consumption. Summary of the Invention

[0004] The purpose of this invention is to address the shortcomings of the prior art by providing a method, apparatus, and device for switching the state of a microphone, thereby solving the problem of high energy consumption in conference equipment in the prior art.

[0005] To achieve the above objectives, the technical solutions adopted in the embodiments of this application are as follows:

[0006] In a first aspect, embodiments of this application provide a method for switching the state of a microphone, the method comprising:

[0007] The state of the pickup device is switched according to user control commands;

[0008] If the pickup device is switched to pickup mode, the energy of the first input audio signal of the pickup device is detected to obtain the energy parameters of the first input audio signal;

[0009] If the energy parameters of the pickup device do not meet the preset energy conditions within the first preset time period, the pickup device will be switched from the pickup state to the silent state.

[0010] If the energy parameters of the pickup device meet the preset energy condition within a first preset time period, then the pickup device is controlled to remain in the pickup state.

[0011] Optionally, the energy parameters of the first input audio signal include: the energy parameters of multiple sub-bands of the first input audio signal in a preset spectrum;

[0012] If the energy parameters of the pickup device do not meet the preset energy condition within a first preset time period, before switching the pickup device from the pickup state to the silent state, the method further includes:

[0013] The energy parameters of the multiple sub-bands are weighted and summed to obtain the total energy parameters of the first input audio signal;

[0014] Determine whether the total energy parameter is greater than or equal to a preset energy threshold;

[0015] If the total energy parameter is greater than or equal to the preset energy threshold, then the energy parameter is determined to meet the preset energy condition.

[0016] If the total energy parameter is less than the preset energy threshold, then it is determined that the energy parameter does not meet the preset energy condition.

[0017] Optionally, the method further includes:

[0018] If the energy parameter of the pickup device meets the preset energy condition within the first preset duration, then the state timer of the pickup device is reset to zero and the timing is restarted.

[0019] If the state timer reaches the first preset duration, and the energy parameters of the pickup device within the first preset duration do not meet the preset energy condition, then the pickup device will be switched from the pickup state to the silent state.

[0020] Optionally, after switching the microphone from a pickup state to a silent state, the method further includes:

[0021] If the pickup device is in a silent state, the energy of the second input audio signal of the pickup device is detected to obtain the energy parameters of the second input audio signal;

[0022] If the energy parameters meet the preset energy conditions, the sound pickup device will be switched from silent state to sound pickup state to collect and transmit audio data.

[0023] If the energy parameters of the pickup device do not meet the preset energy conditions within the second preset time period, the pickup device will be switched from the silent state to the power-off state.

[0024] Optionally, the step of switching the pickup device from a silent state to a pickup state if the energy parameter meets the preset energy condition includes:

[0025] If the energy parameters of the second input audio signal of the pickup device meet the preset energy condition within a consecutive second preset number of frames, then the pickup device will be switched from the silent state to the pickup state.

[0026] Optionally, after switching the pickup device from a silent state to a pickup state, the method further includes:

[0027] Speech detection is performed on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located;

[0028] If there is speaking sound in the environment where the sound pickup device is located, the sound pickup device is controlled to continue to be in the sound pickup state;

[0029] If there is no sound in the environment where the sound pickup device is located, the sound pickup device will be switched from the sound pickup state to the silent state.

[0030] Optionally, the step of performing speech detection on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located includes:

[0031] The fundamental tone of the third input audio signal of the pickup device within a third preset time period is detected to obtain the fundamental tone data within the third preset time period;

[0032] If the number of frames containing pitch data within the third preset duration is greater than or equal to the third preset number of frames, then it is determined that there is speaking sound in the environment where the sound pickup device is located;

[0033] If the number of frames containing pitch data within the third preset duration is less than the third preset number of frames, then it is determined that there is no speaking sound in the environment where the sound pickup device is located.

[0034] Optionally, when switching the pickup device from a silent state to a pickup state, the method further includes:

[0035] The status timer of the microphone is paused.

[0036] If there is no speech in the environment where the microphone is located, after switching the microphone from the microphone state to the silent state, the method further includes:

[0037] Control the state timer to resume timing;

[0038] If the state timer reaches the second preset duration and the energy parameters of the input audio signal of the pickup device do not meet the preset energy condition, then the pickup device will be switched from the silent state to the power-off state.

[0039] Optionally, the method further includes:

[0040] If the sound pickup device is in sound pickup mode, then the energy of the first input audio signal of the sound pickup device is detected to obtain the energy parameter of the first input audio signal;

[0041] If the energy parameters of the pickup device do not meet the preset energy conditions within a first preset time period, the pickup device will be switched from pickup state to silent state.

[0042] If the energy parameters of the pickup device meet the preset energy condition within a first preset time period, then the pickup device is controlled to remain in the pickup state.

[0043] Optionally, the method further includes:

[0044] If the energy parameter of the pickup device meets the preset energy condition within the first preset duration, then the state timer of the pickup device is reset to zero and the timing is restarted.

[0045] If the state timer reaches the first preset duration, and the energy parameters of the pickup device within the first preset duration do not meet the preset energy condition, then the pickup device will be switched from the pickup state to the silent state.

[0046] Secondly, embodiments of this application provide a state switching device for a microphone, the device comprising:

[0047] The first control module is used to switch the state of the pickup device according to user control commands;

[0048] The detection module is used to perform energy detection on the first input audio signal of the pickup device if the pickup device is switched to the pickup state, and to obtain the energy parameters of the first input audio signal.

[0049] The second control module is used to switch the pickup device from the pickup state to the silent state if the energy parameters of the pickup device do not meet the preset energy conditions within a first preset time period.

[0050] The third control module is used to control the pickup device to remain in the pickup state if the energy parameter of the pickup device meets the preset energy condition within a first preset time period.

[0051] Thirdly, embodiments of this application provide a sound pickup device, including: a processor, a transmitter, and a receiver; the processor is communicatively connected to the transmitter and the receiver via a bus; the receiver is used to receive audio signals and transmit them to the processor; the processor is used to execute the state switching method of the sound pickup device as described in any of the first aspects; the transmitter is used to send the audio signals to other terminal devices.

[0052] Compared with the prior art, this application has the following beneficial effects:

[0053] This application provides a method, apparatus, and device for switching the state of a microphone. In this method, the state of the microphone is switched according to a user control command. If the microphone is switched to a microphone state, energy detection is performed on the first input audio signal of the microphone to obtain the energy parameters of the first input audio signal. If the energy parameters of the microphone do not meet the preset energy condition within a first preset time period, the microphone is switched from the microphone state to a silent state. If the energy parameters of the microphone meet the preset energy condition within the first preset time period, the microphone is controlled to remain in the microphone state. Thus, the switching of the microphone state is precisely controlled, power consumption of the microphone is saved, and unnecessary cost waste is avoided. Attached Figure Description

[0054] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0055] Figure 1 A schematic diagram of a conference system provided in this application embodiment;

[0056] Figure 2 A flowchart illustrating a state switching method for a microphone provided in an embodiment of this application;

[0057] Figure 3 A flowchart illustrating a timing control method for state switching provided in an embodiment of this application;

[0058] Figure 4 A flowchart illustrating a method for determining whether energy parameters meet preset energy conditions, provided in an embodiment of this application;

[0059] Figure 5 A flowchart illustrating another method for switching the state of a microphone provided in an embodiment of this application;

[0060] Figure 6A flowchart illustrating another method for switching the state of a pickup device provided in an embodiment of this application;

[0061] Figure 7 A flowchart illustrating a speech detection method provided in an embodiment of this application;

[0062] Figure 8 A flowchart illustrating another state switching timing control method provided in this application embodiment;

[0063] Figure 9 A schematic diagram of a state switching device for a pickup device provided in an embodiment of this application;

[0064] Figure 10 This is a schematic diagram of a sound pickup device provided in an embodiment of this application.

[0065] Icons: 100-Gathering terminal, 200-Pickup terminal, 801-First control module, 802-Detection module, 803-Second control module, 804-Third control module, 901-Processor, 902-Transmitter, 903-Receiver. Detailed Implementation

[0066] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. The components of the embodiments of the present application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0067] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0068] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0069] Furthermore, the terms "first" and "second" are used only to distinguish descriptions and should not be interpreted as indicating or implying relative importance.

[0070] It should be noted that, where there is no conflict, the features in the embodiments of the present invention can be combined with each other.

[0071] To save power consumption, this application provides a method, apparatus, and device for switching the state of a microphone.

[0072] Before explaining the method for switching the state of a microphone provided in the embodiments of this application, the conference system to which the method for switching the state of a microphone is applied will be explained first. Figure 1 This is a schematic diagram of a conference system provided in an embodiment of this application. Figure 1 As shown, the conference system includes: a convergence terminal 100 and a microphone terminal 200, with the convergence terminal 100 communicating with multiple microphone terminals 200.

[0073] It should be noted that, Figure 1 The structure shown represents the connection between a convergence terminal 100 and multiple microphone terminals 200. In a conference system, there may be multiple other convergence terminals 100, each communicating with multiple microphone terminals 200. This conference system can be used for online multi-person conferences or offline multi-person conferences. In a practical scenario, multiple microphone terminals 200 are set up in the same meeting room. These microphone terminals 200 collect audio signals, and the multiple audio signals are transmitted to the convergence terminal 100, which then processes and aggregates the multiple audio signals. It should be noted that... Figure 1 The arrangement of the central gathering terminal 100 and the microphone terminal 200 in the meeting room is only to illustrate the connection between the two and is merely an example. The central gathering terminal 100 can also be placed outside the meeting table or integrated into it.

[0074] For example, the microphone terminal 200 is equipped with a push-button switch and a microphone indicator light. The user can issue control commands via the push-button switch; pressing the switch once toggles the microphone's state (from silent to microphone mode, or vice versa). When in microphone mode, the microphone indicator light remains on; when in silent mode, the indicator light turns off. The user can power off the device by pressing and holding the push-button switch for several seconds.

[0075] For example, the aggregation terminal 100 is communicatively connected to audio playback terminals in other meeting venues connected to the conference system, so as to transmit the target audio signal to the audio playback terminals in other meeting venues connected to the conference system, so that the audio playback terminals can play the target audio signal.

[0076] The following specific examples illustrate a method for switching the state of a microphone provided in this application. Figure 2 This is a flowchart illustrating a state switching method for a microphone device provided in an embodiment of this application. The execution subject of this method is the microphone device, which can be a device with sending, receiving, and processing functions. Figure 2 As shown, the method includes:

[0077] S101. Switch the state of the pickup device according to the user's control command.

[0078] Receive user control commands and switch the state of the microphone according to the user control commands. If the microphone is in a silent state, switch the microphone from silent state to microphone state according to the user control commands. If the microphone is in microphone state, switch the microphone from microphone state to silent state according to the user control commands.

[0079] If the microphone is switched to microphone mode according to user control instructions, it can be switched to silent mode according to user control instructions; or the mode can be switched according to other steps in this embodiment.

[0080] If the microphone is switched to silent mode according to user control instructions, it must be switched back to microphone mode according to user control instructions.

[0081] S102. If the pickup device is switched to pickup mode, the energy of the first input audio signal of the pickup device is detected to obtain the energy parameters of the first input audio signal.

[0082] The pickup state refers to the normal operating state of the audio pickup device. The device can collect and transmit audio data normally, but its power consumption is higher compared to the silent state. Therefore, it is necessary to determine whether it needs to remain in pickup state continuously.

[0083] In the sound pickup state, the energy of the first input audio signal of the sound pickup device is detected to obtain the energy parameters of the first input audio signal.

[0084] In the environment where the sound pickup device is located, there will always be audio signals input to the device. These could be human voices or ambient noise. Human voices are generally louder, while ambient noise is quieter. Energy parameters can be used to perform VAD (Voice Activity Detection) on the first input audio signal to determine whether it is human voice or ambient noise.

[0085] S103. If the energy parameters of the pickup device do not meet the preset energy conditions within the first preset time period, the pickup device will be switched from the pickup state to the silent state.

[0086] If the energy parameters do not meet the preset energy conditions, it indicates that the current first input audio signal is ambient noise (or it may be the user whispering, which does not need to be input to the sound pickup device), and there has been no human voice input.

[0087] For example, the first preset duration can be 10 minutes. That is, if the energy parameters of the first input audio signal of the pickup device do not meet the preset energy condition within 10 consecutive minutes, it indicates that there is no voice input for 10 consecutive minutes, and the pickup device will be switched from the pickup state to the silent state.

[0088] S104. If the energy parameters of the pickup device meet the preset energy conditions within the first preset time period, then control the pickup device to remain in the pickup state.

[0089] If the energy parameters of the first input audio signal of the pickup device meet the preset energy conditions within the first preset time period, it indicates that there is human voice input, and the pickup device is switched from the pickup state to the silent state.

[0090] In summary, in this embodiment, the state of the microphone is switched according to user control commands. If the microphone is switched to microphone mode, energy detection is performed on the first input audio signal to obtain the energy parameters of the first input audio signal. If the energy parameters of the microphone do not meet the preset energy conditions within a first preset time period, the microphone is switched from microphone mode to silent mode. If the energy parameters of the microphone meet the preset energy conditions within the first preset time period, the microphone is controlled to remain in microphone mode. Thus, precise control of the microphone state switching is achieved, saving power consumption and avoiding unnecessary cost waste.

[0091] In the above Figure 2 Based on the corresponding embodiments, this application also provides a method for determining whether energy parameters meet preset energy conditions. Figure 3 This is a flowchart illustrating a method for determining whether energy parameters meet preset energy conditions, provided in an embodiment of this application. The energy parameters of the first input audio signal include: energy parameters of multiple sub-bands of the first input audio signal within a preset spectrum. For example... Figure 3 As shown, in S103, if the energy parameters of the pickup device do not meet the preset energy condition within the first preset time period, before switching the pickup device from the pickup state to the silent state, the method further includes:

[0092] S201. The energy parameters of multiple sub-bands are weighted and summed to obtain the total energy parameters of the first input audio signal.

[0093] For example, taking an audio signal with a sampling frequency of 8kHz as an example, the spectrum of the audio signal can be divided into 6 sub-bands: 80Hz~250Hz, 250Hz~500Hz, 500Hz~1kHz, 1kHz~2kHz, 2kHz~3kHz, and 3kHz~4kHz.

[0094] The energy of each sub-band is calculated based on its audio sub-signals. The energy parameters of these sub-bands are then weighted and summed to obtain the total energy parameter of the first input audio signal. The weights of the energy parameters for each sub-band can be determined by the user.

[0095] S202. Determine whether the total energy parameter is greater than or equal to the preset energy threshold.

[0096] The preset energy threshold can be determined by the user.

[0097] S203. If the total energy parameter is greater than or equal to the preset energy threshold, then the energy parameter is determined to meet the preset energy condition.

[0098] S204. If the total energy parameter is less than the preset energy threshold, then it is determined that the energy parameter does not meet the preset energy condition.

[0099] In summary, in this embodiment, the energy parameters of multiple sub-bands are weighted and summed to obtain the total energy parameter of the first input audio signal; it is then determined whether the total energy parameter is greater than or equal to a preset energy threshold; if the total energy parameter is greater than or equal to the preset energy threshold, the energy parameter is determined to meet the preset energy condition; if the total energy parameter is less than the preset energy threshold, the energy parameter is determined to not meet the preset energy condition. Thus, the total energy parameter of the first input audio signal is accurately determined.

[0100] In the above Figure 2 Based on the corresponding embodiments, this application also provides a timing control method for state switching. Figure 4 This is a flowchart illustrating a timing control method for state switching provided in an embodiment of this application. Figure 4 As shown, the method also includes:

[0101] S301. If the energy parameters of the pickup device meet the preset energy conditions within the first preset duration, the state timer of the pickup device is reset to zero and the timing is restarted.

[0102] The status timer in the sound pickup state is used to record the duration of no voices. Each time the energy parameter is detected to meet the preset energy condition, it indicates that there is continuous voice, and the status timer of the sound pickup device is reset to zero and the timing starts again.

[0103] S302. If the state timer reaches the first preset duration and the energy parameters of the pickup device within the first preset duration do not meet the preset energy conditions, then the pickup device will be switched from the pickup state to the silent state.

[0104] After resetting the timer, a new round of judgment is made. If the state timer reaches the first preset duration and the energy parameters of the microphone do not meet the preset energy conditions within the first preset duration, the microphone is switched from microphone state to silent state.

[0105] In summary, in this embodiment, if the energy parameters of the pickup device meet the preset energy condition within the first preset duration, the state timer of the pickup device is reset to zero and the timing restarts; if the state timer reaches the first preset duration and the energy parameters of the pickup device do not meet the preset energy condition within the first preset duration, the pickup device is switched from the pickup state to the silent state. Thus, the state switching of the pickup device is precisely controlled, reducing the power consumption of the pickup device.

[0106] In the above Figure 2 Based on the corresponding embodiments, this application also provides another method for switching the state of a pickup device. Figure 5 This is a flowchart illustrating another method for switching the state of a microphone provided in an embodiment of this application. Figure 5 As shown, after switching the pickup device from pickup state to silent state in S103, the method further includes:

[0107] S401. If the pickup device is in a silent state, the energy of the second input audio signal of the pickup device is detected to obtain the energy parameters of the second input audio signal.

[0108] When a user does not need to speak temporarily, they can manually switch the microphone to silent mode; alternatively, it can be switched automatically from other states to silent mode. In silent mode, the microphone only collects audio data and does not transmit it, thus saving power.

[0109] In a silent state, the energy of the second input audio signal of the pickup device is detected to obtain the energy parameters of the second input audio signal.

[0110] In the environment where the sound pickup device is located, there will always be audio signals input to the device. These could be human voices or ambient noise. Human voices are generally louder, while ambient noise is quieter. Energy parameters can be used to perform a VAD (Voice over Audio) decision on the second input audio signal to determine whether it is human voice or ambient noise.

[0111] S402. If the energy parameters meet the preset energy conditions, the pickup device will be switched from silent mode to pickup mode to collect and transmit audio data.

[0112] If the energy parameters meet the preset energy conditions, it indicates that the current second input audio signal is human voice. Switch the pickup device from silent mode to pickup mode to collect and transmit audio data.

[0113] Among them, the sound pickup state is the normal working state of the sound pickup device, in which the sound pickup device can normally collect and transmit audio data. Compared with the silent state, the power consumption is larger.

[0114] S403. If the energy parameters of the pickup device do not meet the preset energy conditions within the second preset time period, the pickup device will be switched from the silent state to the power-off state.

[0115] If the energy parameters of the microphone do not meet the preset energy conditions within the second preset time period, it indicates that the current second input audio signal is ambient noise (or perhaps users are whispering, which does not need to be input to the microphone), and no human voice has been input, meaning the meeting may have ended. To save power and avoid unnecessary cost waste, switch the microphone from silent mode to power off mode.

[0116] For example, the second preset duration can be 10 minutes. It should be noted that, to ensure that normal speaking is not affected, the second preset duration should not be too short.

[0117] In summary, in this embodiment, if the microphone is in a silent state, energy detection is performed on the second input audio signal of the microphone to obtain the energy parameters of the second input audio signal. If the energy parameters meet the preset energy conditions, the microphone is switched from the silent state to the microphone state to collect and transmit audio data. If the energy parameters of the microphone do not meet the preset energy conditions within a second preset time period, the microphone is switched from the silent state to the power-off state. Therefore, by performing real-time energy detection, the power consumption of the microphone is saved, unnecessary cost waste is avoided, and user privacy is protected.

[0118] Based on the above embodiments, in this application embodiment, if the energy parameter in S402 meets the preset energy condition, the microphone is switched from a silent state to a microphone state, including:

[0119] If the energy parameters of the second input audio signal within a consecutive second preset number of frames meet the preset energy conditions, the microphone will switch from silent mode to microphone mode.

[0120] To ensure more accurate state judgment and switching, the microphone is switched from silent mode to microphone mode if the energy parameters of the second input audio signal within a consecutive second preset number of frames meet a preset energy condition. This avoids misjudgments.

[0121] For example, the second preset frame number can be 3. That is, if the energy parameters of the second input audio signal in 3 consecutive frames all meet the preset energy condition, then it is determined that human voice has appeared.

[0122] In summary, in this embodiment, if the energy parameters of the second input audio signal within a consecutive second preset number of frames all meet the preset energy condition, the microphone is switched from a silent state to a microphone state. Thus, the switch from a silent state to a microphone state is accurately achieved.

[0123] In the above Figure 5 Based on the corresponding embodiments, this application also provides another method for switching the state of a pickup device. Figure 6 This is a flowchart illustrating another method for switching the state of a microphone provided in an embodiment of this application. Figure 6 As shown, after switching the pickup device from a silent state to a pickup state in S402, the method further includes:

[0124] S501. Perform voice detection on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located.

[0125] Based on the above energy assessment, louder audio signals are identified as human voices. However, louder sounds such as knocking or door opening may cause misjudgments.

[0126] Therefore, after switching to the sound pickup mode, further identification is needed to perform voice detection on the third input audio signal of the sound pickup device to determine whether there is speaking sound in the environment where the sound pickup device is located.

[0127] S502. If there is speaking sound in the environment where the microphone is located, control the microphone to continue to be in the microphone state.

[0128] If there is speaking sound in the environment where the microphone is located, it indicates that the judgment is accurate, and the microphone is controlled to continue to pick up sound.

[0129] S503. If there is no sound in the environment where the microphone is located, switch the microphone from microphone mode to silent mode.

[0130] If there is no sound in the environment where the microphone is located, it indicates a misjudgment, and the microphone will be switched from microphone mode to silent mode.

[0131] In summary, in this embodiment, voice detection is performed on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located. If there is speaking sound in the environment where the pickup device is located, the pickup device is controlled to continue to be in the pickup state; if there is no speaking sound in the environment where the pickup device is located, the pickup device is switched from the pickup state to the silent state. Thus, a second judgment is made to more accurately switch the state.

[0132] In the above Figure 5 Based on the corresponding embodiments, this application also provides a speech detection method. Figure 7 This is a flowchart illustrating a speech detection method provided in an embodiment of this application. Figure 7 As shown, in S501, speech detection is performed on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located, including:

[0133] S601. The fundamental tone of the third input audio signal of the pickup device within the third preset time period is detected to obtain the fundamental tone data within the third preset time period.

[0134] The sound produced by the overall vibration of the sound-producing body (the longer the vibration length, the lower the frequency) is called the fundamental tone. In a meeting setting, the fundamental tone can represent the effective characteristics of a person's speaking voice.

[0135] For example, the third preset duration can be 30 seconds. That is, for the first 30 seconds after switching to the pickup state, the pitch of the third input audio signal of the pickup device is detected.

[0136] For example, a preset pitch retrieval algorithm can be used to detect whether a pitch exists in the 80-500Hz frequency band.

[0137] S602. If the number of frames containing pitch data within the third preset duration is greater than or equal to the third preset frame number, then it is determined that there is speaking sound in the environment where the sound pickup device is located.

[0138] For example, the third preset frame count can be 6.

[0139] If the number of frames containing pitch data within the third preset time period is greater than or equal to the third preset frame number, it indicates that continuous human voices are present, thus confirming that there is speaking sound in the environment where the sound pickup device is located.

[0140] S603. If the number of frames containing pitch data within the third preset duration is less than the third preset frame number, then it is determined that there is no speaking sound in the environment where the sound pickup device is located.

[0141] If the number of frames containing pitch data within the third preset time period is less than the third preset number of frames, it indicates that there is no continuous human voice (possibly whispering), thus determining that there is no speaking sound in the environment where the sound pickup device is located.

[0142] In summary, in this embodiment, the pitch of the third input audio signal within a third preset duration is detected by the pickup device to obtain pitch data within the third preset duration. If the number of frames containing pitch data within the third preset duration is greater than or equal to the third preset number of frames, it is determined that there is speech in the environment where the pickup device is located; if the number of frames containing pitch data within the third preset duration is less than the third preset number of frames, it is determined that there is no speech in the environment where the pickup device is located. Thus, speech is accurately detected.

[0143] In the above Figure 5 Based on the corresponding embodiments, this application also provides another timing control method for state switching. Figure 8 This is a flowchart illustrating another state-switching timing control method provided in an embodiment of this application. Figure 8 As shown, when switching the pickup device from a silent state to a pickup state, the method further includes:

[0144] S701, Controls the status timer of the pickup device to pause timing.

[0145] In order to more accurately determine the second preset duration, the third preset duration, etc., the embodiments of this application use the state timer of the pickup device to advance the timing.

[0146] Since there may be a situation where the device switches again after switching from silent mode to pickup mode, the status timer for controlling the pickup device is paused.

[0147] Furthermore, in S503, if there is no speech sound in the environment where the microphone is located, after switching the microphone from the microphone state to the silent state, it also includes:

[0148] S702, Control state timer resumes timing.

[0149] After switching from the pickup state to the silent state, it indicates that the pickup device has been in a silent state for a period of time. The state timer then resumes timing, continuing to time after the pause, so that the state switch is more accurate.

[0150] S703. If the state timer reaches the second preset duration and the energy parameters of the second input audio signal of the pickup device do not meet the preset energy conditions, then the pickup device will be switched from the silent state to the power-off state.

[0151] For example, the second preset duration can be 10 minutes. If the timer is paused after 5 minutes of silent operation, it will resume from the 5-minute mark when the timer is resumed. If 10 minutes have elapsed and the energy parameters of the second input audio signal of the microphone do not meet the preset energy conditions, the microphone will be switched from silent to off state. This achieves precise control and reduces the power consumption of the microphone.

[0152] In summary, in this embodiment, the state timer of the microphone is paused; the state timer is resumed; if the state timer reaches a second preset duration and the energy parameters of the second input audio signal of the microphone do not meet the preset energy conditions, the microphone is switched from a silent state to a power-off state. This achieves precise control and reduces the power consumption of the microphone.

[0153] The following describes the state switching device, equipment, and storage medium of the pickup device provided in this application, which are used to execute the application. The specific implementation process and technical effects are described above and will not be repeated below.

[0154] Figure 9 This is a schematic diagram of a state switching device for a pickup device provided in an embodiment of this application.

[0155] like Figure 9 As shown, the device includes:

[0156] The first control module 801 is used to switch the state of the pickup device according to user control commands.

[0157] The detection module 802 is used to perform energy detection on the first input audio signal of the pickup device if the pickup device is switched to the pickup state, so as to obtain the energy parameters of the first input audio signal.

[0158] The second control module 803 is used to switch the pickup device from the pickup state to the silent state if the energy parameters of the pickup device do not meet the preset energy conditions within the first preset time period.

[0159] The third control module 804 is used to control the pickup device to remain in the pickup state if the energy parameters of the pickup device meet the preset energy conditions within the first preset time period.

[0160] Furthermore, the detection module 802 is specifically used for the energy parameters of the first input audio signal, including: the energy parameters of multiple sub-bands of the first input audio signal in a preset spectrum; weighted summation of the energy parameters of the multiple sub-bands to obtain the total energy parameter of the first input audio signal; determining whether the total energy parameter is greater than or equal to a preset energy threshold; if the total energy parameter is greater than or equal to the preset energy threshold, then determining that the energy parameter meets the preset energy condition; if the total energy parameter is less than the preset energy threshold, then determining that the energy parameter does not meet the preset energy condition.

[0161] Furthermore, the third control module 804 is also used to control the state timer of the pickup device to be cleared and restarted if the energy parameters of the pickup device within the first preset duration meet the preset energy conditions; if the state timer reaches the first preset duration and the energy parameters of the pickup device within the first preset duration do not meet the preset energy conditions, then the pickup device is switched from the pickup state to the silent state.

[0162] Furthermore, the detection module 802 is also used to perform energy detection on the second input audio signal of the pickup device if the pickup device is in a silent state, so as to obtain the energy parameters of the second input audio signal;

[0163] Furthermore, the second control module 803 is also used to switch the pickup device from a silent state to a pickup state if the energy parameters meet the preset energy conditions, so as to collect and transmit audio data.

[0164] Furthermore, the third control module 804 is also used to switch the microphone from a silent state to a power-off state if the energy parameters of the microphone do not meet the preset energy conditions within the second preset time period.

[0165] Furthermore, the second control module 803 is specifically used to switch the pickup device from a silent state to a pickup state if the energy parameters of the second input audio signal of the pickup device meet the preset energy conditions within a consecutive second preset number of frames.

[0166] Furthermore, the detection module 802 is also used to perform voice detection on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located.

[0167] Furthermore, the second control module 803 is also used to control the microphone to remain in the microphone state if there is speaking sound in the environment where the microphone is located.

[0168] Furthermore, the third control module 804 is also used to switch the microphone from the microphone state to the silent state if there is no sound in the environment where the microphone is located.

[0169] Furthermore, the detection module 802 is specifically used to perform pitch detection on the third input audio signal of the pickup device within a third preset time period to obtain pitch data within the third preset time period; if the number of frames containing pitch data within the third preset time period is greater than or equal to the third preset number of frames, it is determined that there is speech in the environment where the pickup device is located; if the number of frames containing pitch data within the third preset time period is less than the third preset number of frames, it is determined that there is no speech in the environment where the pickup device is located.

[0170] Furthermore, the second control module 803 is also used to control the state timer of the pickup device to pause timing; control the state timer to resume timing; if the state timer reaches the second preset duration and the energy parameters of the input audio signal of the pickup device do not meet the preset energy conditions, then the pickup device is switched from the silent state to the power-off state.

[0171] Figure 10 This is a schematic diagram of a microphone provided in an embodiment of this application. The microphone can be a device with processing, transmitting, and receiving functions. For example... Figure 10 As shown:

[0172] The pickup device includes a processor 901, a transmitter 902, and a receiver 903. The processor 901 is connected to the transmitter 902 and the receiver 903 via a bus communication connection.

[0173] Receiver 903 receives audio signals and transmits them to processor 901. Processor 901 executes the method embodiments described above. The specific implementation and technical effects are similar and will not be repeated here. Transmitter 902 transmits audio signals to other terminal devices.

[0174] Optionally, the present invention also provides a program product, such as a computer-readable storage medium, including a program that, when executed by a processor, is used to perform the above-described method embodiments.

[0175] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0176] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0177] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0178] The integrated units implemented as software functional units described above can be stored in a computer-readable storage medium. These software functional units, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for switching the state of a microphone, characterized in that, The method includes: The state of the pickup device is switched according to user control commands; If the pickup device is switched to pickup mode, the energy of the first input audio signal of the pickup device is detected to obtain the energy parameters of the first input audio signal; If the energy parameters of the pickup device do not meet the preset energy conditions within the first preset time period, the pickup device will be switched from the pickup state to the silent state. If the energy parameter of the pickup device meets the preset energy condition within a first preset time period, then the pickup device is controlled to remain in the pickup state. After switching the microphone from pickup mode to silent mode, the method further includes: If the pickup device is in a silent state, the energy of the second input audio signal of the pickup device is detected to obtain the energy parameters of the second input audio signal; If the energy parameters meet the preset energy conditions, the pickup device is switched from silent state to pickup state to collect and transmit audio data, and the state timer of the pickup device is controlled to pause. Speech detection is performed on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located; If there is no sound in the environment where the microphone is located, the microphone is switched from microphone state to silent state, and the state timer is controlled to resume timing. If the state timer reaches the second preset duration and the energy parameters of the second input audio signal of the pickup device do not meet the preset energy condition, then the pickup device will be switched from the silent state to the power-off state.

2. The method according to claim 1, characterized in that, The energy parameters of the first input audio signal include: the energy parameters of multiple sub-bands of the first input audio signal in a preset spectrum; If the energy parameters of the pickup device do not meet the preset energy condition within a first preset time period, before switching the pickup device from the pickup state to the silent state, the method further includes: The energy parameters of the multiple sub-bands are weighted and summed to obtain the total energy parameters of the first input audio signal; Determine whether the total energy parameter is greater than or equal to a preset energy threshold; If the total energy parameter is greater than or equal to the preset energy threshold, then the energy parameter is determined to meet the preset energy condition. If the total energy parameter is less than the preset energy threshold, then it is determined that the energy parameter does not meet the preset energy condition.

3. The method according to claim 1, characterized in that, The method further includes: If the energy parameter of the pickup device meets the preset energy condition within the first preset duration, then the state timer of the pickup device is reset to zero and the timing is restarted. If the state timer reaches the first preset duration, and the energy parameters of the pickup device within the first preset duration do not meet the preset energy condition, then the pickup device will be switched from the pickup state to the silent state.

4. The method according to claim 1, characterized in that, After switching the microphone from pickup mode to silent mode, the method further includes: If the energy parameters of the pickup device do not meet the preset energy conditions within the second preset time period, the pickup device will be switched from the silent state to the power-off state.

5. The method according to claim 4, characterized in that, If the energy parameter meets the preset energy condition, then switching the pickup device from a silent state to a pickup state includes: If the energy parameters of the second input audio signal of the pickup device meet the preset energy condition within a consecutive second preset number of frames, then the pickup device will be switched from the silent state to the pickup state.

6. The method according to claim 4, characterized in that, After switching the microphone from a silent state to a microphone state, the method further includes: If there is speaking sound in the environment where the sound pickup device is located, the sound pickup device is controlled to continue to be in the sound pickup state.

7. The method according to claim 6, characterized in that, The step of performing voice detection on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located includes: The fundamental tone of the third input audio signal of the pickup device within a third preset time period is detected to obtain the fundamental tone data within the third preset time period; If the number of frames containing pitch data within the third preset duration is greater than or equal to the third preset number of frames, then it is determined that there is speaking sound in the environment where the sound pickup device is located; If the number of frames containing pitch data within the third preset duration is less than the third preset number of frames, then it is determined that there is no speaking sound in the environment where the sound pickup device is located.

8. A state switching device for a sound pickup device, characterized in that, The device includes: The first control module is used to switch the state of the pickup device according to user control commands; The detection module is used to perform energy detection on the first input audio signal of the pickup device if the pickup device is switched to the pickup state, and to obtain the energy parameters of the first input audio signal. The second control module is used to switch the pickup device from the pickup state to the silent state if the energy parameters of the pickup device do not meet the preset energy conditions within a first preset time period. The third control module is used to control the pickup device to remain in the pickup state if the energy parameter of the pickup device meets the preset energy condition within a first preset time period. The detection module is further configured to perform energy detection on the second input audio signal of the pickup device if the pickup device is in a silent state, to obtain the energy parameter of the second input audio signal; and to perform speech detection on the third input audio signal of the pickup device to determine whether there is speaking sound in the environment where the pickup device is located. The second control module is further configured to switch the pickup device from a silent state to a pickup state if the energy parameter meets the preset energy condition, so as to collect and transmit audio data, and control the state timer of the pickup device to pause the timing. The third control module is further configured to switch the microphone from the microphone state to a silent state if there is no speaking sound in the environment where the microphone is located, and use the second control module to control the state timer to resume timing; if the state timer reaches the second preset duration and the energy parameters of the second input audio signal of the microphone do not meet the preset energy condition, then use the second control module to switch the microphone from the silent state to the power-off state.

9. A sound pickup device, characterized in that, include: Processor, transmitter, receiver; The processor is connected to the transmitter and the receiver via a bus communication connection. The receiver is used to receive audio signals and transmit them to the processor; The processor is used to execute the state switching method of the pickup device as described in any one of claims 1 to 7; the transmitter is used to send the audio signal to other terminal devices.

Images