A mixing processing method, system, device and storage medium

By obtaining and controlling the microphone playback permissions and order, the problem of multiple microphones outputting audio simultaneously in large conference rooms is solved, resulting in noisy sound, and clear audio output is achieved.

CN115442713BActive Publication Date: 2025-02-11PTN ELECTRONICS LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211295920.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-21
Publication Date
2025-02-11
Estimated Expiration
2042-10-21

AI Technical Summary

Technical Problem

In a large conference room, because multiple microphones output audio simultaneously, the sound output from the audio appears noisy and it is impossible to clearly listen to the specific speech.

Method used

By obtaining the number of microphone audio outputs, determine whether it is greater than the preset number, obtaining the microphone playback permissions and playback order, controlling the audio output based on this information, ensuring that only microphones with high privileges will output audio first.

Benefits of technology

It effectively prevents the sound from noisy when multiple people speak at the same time, and ensures that the specific speech can be clearly listened to.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115442713B_ABST
    Figure CN115442713B_ABST
Patent Text Reader

Abstract

The present application relates to the field of audio processing, and in particular to a mixing processing method, system, device and storage medium, wherein the method comprises obtaining the number of microphone audio outputs; determining whether the number of microphone audio outputs is greater than a preset number; if the number of microphone audio outputs is greater than the preset number, obtaining microphone playback authority; based on the microphone playback authority, obtaining the microphone playback order; and based on the microphone playback order, controlling the audio output. This can effectively prevent the situation where when multiple people speak together through the microphone, the sound system outputs multiple people's audio, causing the sound to be very noisy and making it impossible to hear the specific content of the speech.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of audio processing, and in particular to a mixing processing method, system, device and storage medium. Background Art

[0002] In work and life, when we need to discuss something, we usually hold a meeting in a conference room. When holding a meeting in a large conference room, since there are many people and the conference room is large, a microphone is needed for audio output so that everyone can hear the speaker's voice.

[0003] However, due to the presence of numerous microphones, if multiple people are speaking at the same time, the sound output by the speaker will appear very noisy due to the simultaneous output of the multiple voices, so that the specific content of the speech cannot be heard clearly. Summary of the invention

[0004] In order to ensure that the output audio is not too noisy and the specific speaking content can be heard clearly when multiple people are speaking through a microphone, the present application provides a mixing processing method, system, device and storage medium.

[0005] The present application provides a mixing processing method, system, device and storage medium using the following technical solutions:

[0006] A mixing processing method, comprising:

[0007] Get the number of microphone audio outputs;

[0008] Determine whether the microphone audio output quantity is greater than a preset quantity;

[0009] If the microphone audio output quantity is greater than a preset quantity, obtaining microphone playback permission;

[0010] Based on the microphone playback permission, obtain the microphone playback order;

[0011] Based on the microphone playback order, the audio output is controlled.

[0012] By adopting the above technical solution, first determine whether there are multiple microphones with audio output. If there are multiple microphones with audio output, obtain the permission of each microphone, and obtain the microphone playback order according to the microphone playback permission. The microphone playback order determines the microphone currently playing, and then the audio of the currently playing microphone is output through the speaker. This can effectively prevent the speaker from outputting multiple people's audio when multiple people speak through the microphone together, resulting in a noisy sound and making it impossible to hear the specific content of the speech.

[0013] Optionally, obtaining microphone playback permission includes:

[0014] Get the meeting list;

[0015] Based on the conference list, obtaining conference participants;

[0016] Based on the conference participants, obtain microphone playback permission.

[0017] By adopting the above technical solution, participants who need to attend the meeting are obtained according to the meeting list, and then different microphone playback permissions are set according to different participants. When a person with a low microphone playback permission and a person with a high microphone playback permission speak at the same time, the output of the person with a high microphone playback permission is given priority. Dividing permissions can avoid multiple people speaking at the same time, resulting in noisy output sound.

[0018] Optionally, obtaining microphone playback permission based on the conference participant includes:

[0019] Based on the conference participants, the conference host is obtained, and the microphone of the conference host is used as the first authority, where the first authority is the highest authority;

[0020] Obtain the positions of the remaining participants;

[0021] Based on the position of the participant, microphone playback permission is obtained.

[0022] By adopting the above technical solution, the host of the meeting has the microphone with the highest authority. As long as the host is speaking, the audio of the host will be output first. Except for the host, the others will have the microphone playback authority divided according to their positions. No matter when, the host's microphone authority is kept the highest, so as to ensure the stability of the meeting.

[0023] Optionally, obtaining the microphone playback order based on the microphone playback permission includes:

[0024] Based on the position, obtaining microphone playback permission corresponding to the position;

[0025] When the positions are the same, the microphone playback permissions are the same;

[0026] When the positions are different, the microphone playback authority of the conference participant with a higher position is higher than the microphone playback authority of the conference participant with a lower position;

[0027] Based on the microphone playback authority, a microphone playback order is obtained.

[0028] By adopting the above technical solution, the microphone playback authority is divided according to the different positions of each person participating in the meeting. If two people have the same position, then the microphone playback authority is the same. If two people have different positions, then the microphone playback authority of the person with the higher position is higher than the microphone playback authority of the person with the lower position.

[0029] Optionally, controlling the audio output based on the microphone playback order includes:

[0030] Detecting whether the microphone of the conference host receives the audio data;

[0031] If the conference host's microphone receives the audio data, the audio output of the conference host's microphone is controlled and the microphones of other conference participants are turned off;

[0032] If the microphone of the microphone host does not receive the audio data, the audio output is controlled based on the microphone playback authority.

[0033] By adopting the above technical solution, if the conference host is speaking, the audio received by the conference host's microphone must be output first. If the audio data of the conference host's microphone is not received, it means that the current conference host has finished speaking and needs others to express their opinions. The audio output is controlled according to the microphone playback permission. The microphone of the conference supporter can output audio at any time and will not be affected by the speech of others.

[0034] Optionally, controlling the audio output based on the microphone playback permission includes:

[0035] Determine whether the audio data of the conference participant having the same microphone playback permission is received;

[0036] If the audio data of the conference participant with the same microphone playback permission is received, audio text is obtained based on the audio data;

[0037] Determining whether two consecutive audio texts are similar within a preset time period;

[0038] If two consecutive audio texts are similar, the microphone of the conference participant with the two consecutive audio texts being similar is obtained as the target microphone;

[0039] Based on the target microphone, controlling audio output;

[0040] If two consecutive audio texts are not similar, the audio output is randomly controlled;

[0041] By adopting the above technical solution, if people with the same microphone playback permission speak at the same time, the microphone will not output the voices of both people at the first time. Instead, if it is detected that someone has repeated what has been said, it means that the person currently speaking may want to express his or her opinion or has a better suggestion. At this time, the audio data of the participant who has spoken repeatedly will be played.

[0042] Optionally, after controlling the audio output based on the microphone playback order, the step further includes:

[0043] During audio playback, determining whether audio data from a microphone with a first permission is received;

[0044] If audio data from a microphone with the first permission is received, the currently playing audio is closed, and the audio data from the microphone with the first permission is played;

[0045] If the audio data of the microphone of the first authority is not received, the audio output is maintained.

[0046] By adopting the above technical solution, even during the audio playback process, that is, when someone is currently speaking, if the microphone of the first authority has audio output, the audio data of the microphone of the first authority will be played immediately, and if the audio data of the microphone of the first authority is not received, the audio output will be maintained. This can prevent others from being interrupted in time when they speak for too long or make inappropriate remarks.

[0047] In a second aspect, the present application provides a mixing processing system, which adopts the following technical solution.

[0048] A mixing processing system, comprising:

[0049] The first acquisition module is used to obtain the number of microphone audio outputs;

[0050] A judging module, used to judge whether the number of audio outputs of the microphone is greater than a preset number;

[0051] A second acquisition module is used to obtain microphone playback permission if the number of microphone audio outputs is greater than a preset number;

[0052] A third acquisition module, used to acquire a microphone playback order based on the microphone playback authority;

[0053] The control module is used to control the audio output based on the microphone playback order.

[0054] By adopting the above technical solution, the first acquisition module is connected with the judgment module, the first acquisition module acquires the number of microphone audio outputs, and obtains how many microphones currently receive audio data, that is, how many people are speaking, and then the judgment module determines whether the microphone audio data is greater than the preset number. If it is greater than the preset number, the second acquisition module acquires the microphone playback authority, the second acquisition module is connected with the judgment module, the second acquisition module is connected with the third acquisition module, the third acquisition module acquires the microphone playback order according to the microphone playback authority, the third acquisition module is connected with the control module, and the control module controls the audio output according to the microphone playback order. It can effectively prevent the situation where when multiple people speak together through the microphone, the sound output of multiple people's audio causes the sound to be very noisy, and the specific content of the speech cannot be heard at all.

[0055] In a third aspect, the present application provides a terminal device, which adopts the following technical solution:

[0056] A terminal device includes a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor loads and executes the computer program, any of the methods described above is adopted.

[0057] By adopting the above technical solution, the above method is generated into a computer program and stored in a memory so as to be loaded and executed by a processor, thereby making a terminal device based on the memory and the processor for easy use.

[0058] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0059] A computer-readable storage medium stores a computer program, and when the computer program is loaded and executed by a processor, the above-mentioned mixing processing method is adopted.

[0060] By adopting the above technical solution, the above mixing processing method is generated into a computer program and stored in a computer-readable storage medium so as to be loaded and executed by a processor. The computer-readable storage medium facilitates the reading and storage of the computer program.

[0061] In summary, the present application includes at least one of the following beneficial technical effects:

[0062] First, determine whether there are multiple microphones with audio output. If there are multiple microphones with audio output, obtain the permissions of each microphone, and obtain the microphone playback order based on the microphone's playback permissions. The microphone playback order determines the microphone currently playing, and then the audio of the currently playing microphone is output through the speaker. This can effectively prevent the speaker from outputting multiple people's audio when multiple people speak through the microphone, resulting in a noisy sound and making it impossible to hear the specific content of the speech. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0064] Figure 2 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0065] Figure 3 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0066] Figure 4 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0067] Figure 5 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0068] Figure 6 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0069] Figure 7 It is a flowchart of one implementation method of a mixing processing method in an embodiment of the present application;

[0070] Figure 8 It is a system block diagram of a mixing processing system according to an embodiment of the present application.

[0071] Description of reference numerals:

[0072] 1. First acquisition module; 2. Judgment module; 3. Second acquisition module; 4. Third acquisition module; 5. Control module. DETAILED DESCRIPTION

[0073] The present application is further described in detail below in conjunction with all the accompanying drawings.

[0074] The present application embodiment discloses a mixing processing method, referring to Figure 1 ,include:

[0075] S100: Obtain the number of microphone audio outputs.

[0076] Specifically, the microphone audio output quantity refers to the quantity of audio received from the microphone and then output through the speaker. The audio is the audio data generated by a person speaking.

[0077] S110: Determine whether the number of microphone audio outputs is greater than a preset number.

[0078] If the microphone audio quantity is less than or equal to the preset quantity, no action will be taken.

[0079] Specifically, the preset number is the number of audio data received by the microphones that are allowed to be played through the speakers at the same time. For example, if the preset number is set to 2, it means that at most only audio data received by two microphones are allowed to be played through the speakers at the same time.

[0080] S120: If the number of microphone audio outputs is greater than a set number, obtaining microphone playback permission.

[0081] Specifically, the microphone playback permission is the order in which the audio received by the microphone is output to the speaker. When two people are speaking at the same time, the audio data of the person with lower microphone playback permission cannot be played through the speaker.

[0082] S130: Acquire a microphone playback order based on the microphone playback authority.

[0083] Specifically, the microphone playback order is determined by the microphone playback authority to determine which microphone's audio data is currently being played.

[0084] S140: Control audio output based on the microphone playback order.

[0085] The implementation principle of the implementation method of the present application is as follows: first determine whether there are multiple microphones with audio output. If there are multiple microphones with audio output, obtain the permission of each microphone, and obtain the microphone playback order according to the microphone playback permission. The microphone playback order determines the microphone currently playing, and then the audio of the currently playing microphone is output through the speaker. This can effectively prevent the speaker from outputting multiple people's audio when multiple people speak through the microphone together, resulting in a noisy sound and making it impossible to hear the specific content of the speech.

[0086] In one implementation of this embodiment, Figure 2 As shown, step S120, i.e. obtaining microphone playback permission, includes:

[0087] S200: Obtain a meeting list.

[0088] Specifically, the meeting list is a schedule of meetings to be held next, including the time of the meeting, the content of the meeting, and the persons attending the meeting.

[0089] S210: Acquire conference participants based on the conference list.

[0090] Specifically, participants are the people who attend the meeting. For example, the meeting list shows that there is a meeting on January 1, 2022. The meeting time is from 8:00 to 12:00. The people who attend the meeting are A, B, C, D, E... A, B, C, D, E... are the participants.

[0091] S220: Acquire microphone playback permission based on the conference participant.

[0092] Specifically, different conference participants may have different microphone playback permissions. When the microphone playback permissions are different, the audio data played by the microphones will be different when speaking at the same time.

[0093] The implementation principle provided by this embodiment is: according to the conference list, the participants who need to attend the meeting are obtained, and then different microphone playback permissions are set according to different participants. When the microphone with low playback permission and the microphone with high playback permission speak at the same time, the output of the microphone with high playback permission is given priority. Dividing permissions can avoid multiple people speaking at the same time, resulting in noisy output sound.

[0094] In one implementation of this embodiment, Figure 3 As shown, step S220, based on the conference participant, obtains the microphone playback permission, including:

[0095] S300: Based on the conference participants, obtain the conference host, and use the microphone of the conference host as the first authority, where the first authority is the highest authority.

[0096] Specifically, the conference host is the person who plays a leading role in the meeting and is responsible for the process of the meeting, such as proposing topics, coordinating the scene, etc. The microphone with the highest authority has a higher priority than all other microphones.

[0097] S310: Obtain the positions of the remaining meeting participants.

[0098] Specifically, the remaining participants are the other participants except the meeting host, and the positions held are the positions of each person participating in the meeting, excluding the meeting host.

[0099] S320: Acquire microphone playback permission based on the position of the participant.

[0100] Specifically, the microphone playback permission is determined according to the position of each participant. The higher the position, the higher the microphone playback permission, and correspondingly, the lower the position, the lower the microphone playback permission. For example, there are three types of participants: leaders, A-level employees, and B-level employees. The leader's position is higher than that of A-level employees, and the position of A-level employees is higher than that of B-level employees. Therefore, the leader's microphone playback permission is higher than that of A-level employees, and the A-level employees' microphone playback permission is higher than that of B-level employees.

[0101] The implementation principle of this implementation method is: the host of the meeting has the microphone with the highest authority. As long as the host is speaking, the audio of the host will be output first. Except for the host, other people are divided into microphone playback permissions according to their positions. No matter when, the host's microphone has the highest authority, so as to ensure the stability of the meeting.

[0102] In one implementation of this embodiment, Figure 4 As shown, step S130, based on the microphone playback permission, obtains the microphone playback order, including:

[0103] S400: Based on the job title, obtain microphone playback permission corresponding to the job title.

[0104] Specifically, the microphone playback permission corresponding to the position is determined according to the level of the participants. For example, there are 4 levels of positions for participants, A, B, C and D, plus the conference host, there are 5 levels in total. Assuming that A's position is higher than B's position, which is higher than C's position, which is higher than D's position, then the microphone permission level can be divided into 5 levels: conference host, A, B, C and D. The conference host is the first permission level, then A is the second permission level, B is the third permission level, C is the fourth permission level, and D is the fifth permission level.

[0105] S410: When the positions are the same, the microphone playback permissions are the same.

[0106] Specifically, since it is impossible for there to be only one person for each position in the meeting, for example, there may be five people at position level B, and the microphone playback permissions of these five people are the same.

[0107] S420: When the positions are different, the microphone playback permission of the conference participant with a higher position is higher than the microphone playback permission of the conference participant with a lower position.

[0108] Specifically, since A's position is higher than B's, A's microphone playback permission is higher than B's microphone playback permission. When A and B speak at the same time, A's audio data will be output first.

[0109] S430: Obtain a microphone playback order based on the microphone playback authority.

[0110] Specifically, before the meeting, different microphone playback permissions can be arranged in advance according to the venue layout. For example, at the venue, after obtaining the participants and their respective positions, the seats in the venue are arranged in advance. Each seat has a label corresponding to the name of the participant, and then each seat corresponds to a microphone, and the microphone playback permissions are set according to the position.

[0111] The microphone playback order is such that, for example, two people are allowed to speak at the same time. Then, when three persons, ABC, are speaking, the audio data of A and B will be output.

[0112] The implementation principle of the implementation method of the present application is: according to the different positions of each person participating in the meeting, the microphone playback authority is divided. If two people have the same position, then the microphone playback authority is the same. If two people have different positions, then the microphone playback authority of the person with a higher position is higher than the microphone playback authority of the person with a lower position.

[0113] In one implementation of this embodiment, Figure 5 As shown, step S140, i.e., controlling the audio output based on the microphone playback order, includes:

[0114] S500: Detect whether the microphone of the conference host receives the audio data.

[0115] Specifically, when the conference host's microphone receives audio data, it means that the conference host is speaking.

[0116] S510: If the conference host's microphone receives the audio data, the audio output of the conference host's microphone is controlled and the microphones of other conference participants are turned off.

[0117] Specifically, when the conference host is speaking, it may be necessary to summarize the meeting or to carry out some process of the meeting. Therefore, when the conference host is speaking, the microphones of other people are turned off, and the words of other people cannot be output through the audio.

[0118] S520: If the microphone of the microphone host does not receive the audio data, control the audio output based on the microphone playback authority.

[0119] Specifically, when the host does not speak and other people express their opinions, the audio output is controlled according to the microphone playback permissions. Controlling audio output according to microphone playback permissions is specifically reflected in the case when multiple people speak in a short period of time. For example, if the setting is 1 second, one person has just finished speaking and 1 second later two other people want to speak. If only the audio data of two people is allowed to be output, then the latter two people will decide whose microphone can output the audio based on their respective microphone playback permissions.

[0120] The implementation principle of the implementation method of the present application is: if the conference host is speaking, the audio received by the conference host's microphone must be output first. If the audio data of the conference host's microphone is not received, it means that the current conference host has finished speaking and needs others to express their opinions. According to the microphone playback permission, the audio output is controlled. The microphone of the conference supporter can output audio at any time and will not be affected by the speech of others.

[0121] In one implementation of this embodiment, Figure 6 As shown, step S520, i.e., controlling the audio output based on the microphone playback order, further includes:

[0122] S600: Determine whether the audio data of the conference participant with the same microphone playback authority is received.

[0123] Specifically, that is, two people with the same microphone playback authority speak at the same time. If yes, execute step S610, if not, execute step S650.

[0124] S610: If the audio data of the conference participant with the same microphone playback permission is received, audio text is obtained based on the audio data.

[0125] Specifically, audio text is the process of converting received sound into text.

[0126] S620: determining whether two consecutive audio text segments are similar within a preset time period.

[0127] Specifically, the preset time period is a time set by the user, and is used to determine whether two identical sentences are said within a short period of time. By comparing the converted texts, if the semantics are similar, it means that the two sentences are similar.

[0128] S630: If the two consecutive audio texts are similar, obtain the microphone of the participant whose two consecutive audio texts are similar as the target microphone.

[0129] Specifically, if a person repeats what he says to himself twice in a short period of time, it means that he may want to express his own opinion or have some good ideas that need to be shared with others. At this time, his microphone can output audio.

[0130] S640: Control audio output based on the target microphone.

[0131] S650: If two consecutive audio texts are not similar, the audio output is randomly controlled.

[0132] Specifically, when the texts are not similar, one person's microphone is randomly selected for audio output.

[0133] The implementation principle of this embodiment is: if two people with the same microphone playback permission speak at the same time, the microphone will not output the voices of both people at the first time. Instead, if it is detected that someone has repeated what has been said, it means that the person currently speaking may want to express his or her opinion or has a better suggestion. At this time, the audio data of the participant who has spoken repeatedly will be played.

[0134] In one implementation of this embodiment, Figure 7 As shown, after step S140, that is, controlling the audio output based on the microphone playback order, the following further comprises:

[0135] S700: During audio playback, determine whether audio data from a microphone with a first permission is received.

[0136] Specifically, in audio playback, it means that someone's current speech is being played through the speaker, and receiving audio data from the microphone of the first authority means that the conference host has spoken while others are speaking.

[0137] S710: If audio data from a microphone with a first permission is received, close the currently playing audio and play the audio data from the microphone with the first permission.

[0138] Specifically, usually, the conference host will not interrupt others when they are speaking, but when the conference host interrupts others, the speaker's microphone will be immediately turned off, the audio output will be stopped, and the conference host's microphone will be played.

[0139] S720: If the audio data of the microphone with the first authority is not received, keep the audio output.

[0140] The implementation principle of this embodiment is: even during the audio playback process, that is, when someone is currently speaking, if the microphone of the first authority has audio output, the audio data of the microphone of the first authority will be played immediately, and if the audio data of the microphone of the first authority is not received, the audio output will be maintained. This can prevent others from speaking for too long or making inappropriate remarks and interrupt them in time.

[0141] In a second aspect, the present application provides a mixing processing system.

[0142] A mixing processing system, comprising:

[0143] The first acquisition module 1 is used to obtain the number of microphone audio outputs;

[0144] A determination module 2 is used to determine whether the number of microphone audio outputs is greater than a preset number;

[0145] A second acquisition module 3 is used to obtain microphone playback permission if the number of microphone audio outputs is greater than a preset number;

[0146] A third acquisition module 4 is used to acquire a microphone playback order based on the microphone playback authority;

[0147] The control module 5 is used to control the audio output based on the microphone playback sequence.

[0148] The implementation principle of a mixing processing system in this embodiment is as follows: the first acquisition module 1 is connected to the judgment module 2, the first acquisition module 1 acquires the number of microphone audio outputs, and obtains how many microphones currently receive audio data, that is, how many people are speaking, and then the judgment module 2 determines whether the microphone audio data is greater than the preset number, if it is greater than the preset number, the second acquisition module 3 acquires the microphone playback authority, the second acquisition module 3 is connected to the judgment module 2, the second acquisition module 3 is connected to the third acquisition module 4, the third acquisition module 4 acquires the microphone playback order according to the microphone playback authority, the third acquisition module 4 is connected to the control module 5, and the control module controls the audio output according to the microphone playback order. It can effectively prevent the sound from being very noisy when multiple people speak through the microphone together, and the specific content of the speech cannot be heard at all.

[0149] The embodiment of the present application also discloses a terminal device, including a memory and a processor. The memory stores a computer program that can be run on the processor. When the processor loads and executes the computer program, a mixing processing method is adopted.

[0150] The terminal device may be a computer device such as a desktop computer, a laptop computer or a cloud server, and the terminal device includes but is not limited to a processor and a memory. For example, the terminal device may also include input and output devices, a network access device and a bus.

[0151] Among them, the processor can adopt a central processing unit (CPU). Of course, according to actual usage, other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. can also be adopted. The general-purpose processor can adopt a microprocessor or any conventional processor, etc., and this application does not impose any restrictions on this.

[0152] Among them, the memory can be an internal storage unit of the terminal device, such as a hard disk or memory of the terminal device, or it can be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital card (SD) or a flash memory card (FC) equipped on the terminal device, and the memory can also be a combination of an internal storage unit and an external storage device of the terminal device. The memory is used to store computer programs and other programs and data required by the terminal device. The memory can also be used to temporarily store data that has been output or is to be output, and this application does not impose any restrictions on this.

[0153] Among them, through this terminal device, a mixing processing method in the above embodiment is stored in the memory of the terminal device, and is loaded and executed on the processor of the terminal device, which is convenient for use.

[0154] The embodiment of the present application further discloses a computer-readable storage medium, and the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, a mixing processing method in the above embodiment is adopted.

[0155] Among them, the computer program can be stored in a computer-readable medium, the computer program includes computer program code, the computer program code can be in the form of source code, object code, executable file or certain middleware, etc. The computer-readable medium includes any entity or device that can carry the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the computer-readable medium includes but is not limited to the above-mentioned components.

[0156] Among them, through this computer-readable storage medium, a mixing processing method in the above embodiment is stored in a computer-readable storage medium, and is loaded and executed on a processor to facilitate the storage and application of the above method.

[0157] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A mixing processing method, characterized in that: include: Get the number of microphone audio outputs; Determine whether the microphone audio output quantity is greater than a preset quantity; If the microphone audio output quantity is greater than a preset quantity, obtaining microphone playback permission; Based on the microphone playback permission, obtain the microphone playback order; Controlling audio output based on the microphone playback order; Wherein, obtaining microphone playback permission includes: Get the meeting list; Based on the conference list, obtaining conference participants; Based on the conference participants, obtain microphone playback permission; Wherein, obtaining microphone playback permission based on the conference participant includes: Based on the conference participants, the conference host is obtained, and the microphone of the conference host is used as the first authority, where the first authority is the highest authority; Obtain the positions of the remaining participants; Based on the position of the participant, obtain microphone playback permission; Wherein, controlling the audio output based on the microphone playback order includes: Detecting whether the microphone of the conference host receives audio data; If the conference host's microphone receives the audio data, the audio output of the conference host's microphone is controlled and the microphones of other conference participants are turned off; If the conference host's microphone does not receive the audio data, then based on the microphone playback authority, controlling the audio output; Wherein, controlling the audio output based on the microphone playback permission includes: Determine whether the audio data of the conference participant having the same microphone playback permission is received; If the audio data of the conference participant with the same microphone playback permission is received, audio text is obtained based on the audio data; Determining whether two consecutive audio texts are similar within a preset time period; If two consecutive audio texts are similar, the microphone of the conference participant with the two consecutive audio texts being similar is obtained as the target microphone; Based on the target microphone, controlling audio output; If two consecutive audio texts are not similar, the audio output is randomly controlled.

2. A mixing processing method according to claim 1, characterized in that: The obtaining of the microphone playback order based on the microphone playback authority includes: Based on the position, obtain microphone permissions corresponding to the position; When the positions are the same, the microphone permissions are the same; When the positions are different, the microphone authority of the conference participant with a higher position is higher than the microphone authority of the conference participant with a lower position; Based on the microphone authority, a microphone playback order is obtained.

3. The mixing processing method according to claim 1, characterized in that: After controlling the audio output based on the microphone playback order, the method further includes: During audio playback, determining whether audio data from a microphone with a first permission is received; If audio data from a microphone with the first permission is received, the currently playing audio is closed, and the audio data from the microphone with the first permission is played; If the audio data of the microphone of the first authority is not received, the audio output is maintained.

4. A mixing processing system, characterized in that: include: A first acquisition module (1) is used to acquire the amount of microphone audio output; A judging module (2) is used to judge whether the number of microphone audio outputs is greater than a preset number; A second acquisition module (3) is used to obtain microphone playback permission if the number of microphone audio outputs is greater than a preset number; A third acquisition module (4) is used to acquire a microphone playback order based on the microphone playback authority; A control module (5) is used to control the audio output based on the microphone playback sequence; Wherein, obtaining microphone playback permission includes: Get the meeting list; Based on the conference list, obtaining conference participants; Based on the conference participants, obtain microphone playback permission; Wherein, obtaining microphone playback permission based on the conference participant includes: Based on the conference participants, the conference host is obtained, and the microphone of the conference host is used as the first authority, where the first authority is the highest authority; Obtain the positions of the remaining participants; Based on the position of the participant, obtain microphone playback permission; Wherein, controlling the audio output based on the microphone playback order includes: Detecting whether the microphone of the conference host receives audio data; If the conference host's microphone receives the audio data, the audio output of the conference host's microphone is controlled and the microphones of other conference participants are turned off; If the conference host's microphone does not receive the audio data, then based on the microphone playback authority, controlling the audio output; Wherein, controlling the audio output based on the microphone playback permission includes: Determine whether the audio data of the conference participant having the same microphone playback permission is received; If the audio data of the conference participant with the same microphone playback permission is received, audio text is obtained based on the audio data; Determining whether two consecutive audio texts are similar within a preset time period; If two consecutive audio texts are similar, the microphone of the conference participant with the two consecutive audio texts being similar is obtained as the target microphone; Based on the target microphone, controlling audio output; If two consecutive audio texts are not similar, the audio output is randomly controlled.

5. A terminal device, comprising a memory and a processor, characterized in that: The memory stores a computer program that can be run on the processor, and when the processor loads and executes the computer program, the method according to any one of claims 1 to 3 is adopted.

6. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, characterized in that: When the computer program is loaded and executed by a processor, the method according to any one of claims 1 to 3 is adopted.

Citation Information

Patent Citations

  • Conference control method and device, electronic equipment, storage medium and program product

    CN114268761A

  • Conference system and method for controlling conference

    JP2006060364A