Operation triggering method, device, electronic device and storage medium

Abstract

The present invention provides an operation triggering method, device, electronic device and storage medium. The steps of the operation triggering method include: judging whether the volume of an interactive terminal of a remote interactive system is greater than a preset volume threshold; counting the number of interactive terminals whose volume is greater than the volume threshold; triggering a corresponding operation in the remote interactive system according to the counted number of interactive terminals whose volume is greater than the volume threshold. The present invention presets suitable operation triggering conditions for different actual scenarios, and the triggering conditions are judged based on the number of interactive terminals with volume exceeding the threshold, and triggers corresponding operations for different preset scenarios. The present invention provides suitable operations for each conference or teaching scenario, improves the rationality of equipment operation for remote interactive conferences or training, and the entire operation switching process is automatic, without the need for participants to actively operate the equipment, thereby improving the fluency of meetings or courses.

Description

Technical Field

[0001] The present invention relates to the technical field of remote interactive teaching or conference, and more specifically, to an operation triggering method, device, electronic equipment and storage medium of a remote interactive system. Background Art

[0002] Remote interactive systems are widely used in remote conferencing or remote training / education and other fields. By using remote interactive systems, multiple participants in different geographical locations can exchange real-time video, audio and other data, greatly facilitating collaboration between participants.

[0003] Usually, different participants' speeches often require switching different output images and different output sounds. Currently, the switching of sound or image mainly relies on manual switching, which is very untimely.

[0004] In addition, other operations, such as the input of video and audio of the recording system audio, also rely on manual operation, which is complicated and inconvenient. Summary of the invention

[0005] In order to overcome at least one of the defects of the prior art described above, the present invention provides an operation triggering method, device, electronic device and storage medium. The technical solution adopted by the present invention is as follows.

[0006] In a first aspect, the present invention provides an operation triggering method, the operation triggering method comprising the steps of: determining whether the volume of an interactive terminal of a remote interactive system is greater than a preset volume threshold;

[0007] Counting the number of interactive terminals whose volume is greater than the volume threshold;

[0008] The corresponding operation in the remote interactive system is triggered according to the number of interactive terminals whose volume is greater than the volume threshold.

[0009] In one embodiment, the interactive terminal includes at least two different types of terminals;

[0010] The process of counting the number of interactive terminals whose volume is greater than the volume threshold comprises the steps of:

[0011] Counting the number of interactive terminals of one type whose volume is greater than the volume threshold; and triggering corresponding operations on the interactive terminals according to the number of interactive terminals whose volume is greater than the volume threshold, comprising the steps of:

[0012] A corresponding operation is triggered on the remote interactive system according to the counted number of interactive terminals of one type.

[0013] In one embodiment, the interactive terminal includes at least two different types of terminals;

[0014] The process of counting the number of interactive terminals whose volume is greater than the volume threshold comprises the steps of:

[0015] Counting the number of interactive terminals whose volume is greater than the volume threshold among at least two types of interactive terminals respectively;

[0016] The process of triggering corresponding operations on interactive terminals according to the number of interactive terminals whose volumes are greater than the volume threshold comprises the steps of:

[0017] A corresponding operation is triggered on the remote interactive system according to the counted number of the at least two types of interactive terminals.

[0018] In one embodiment, the process of triggering corresponding operations on the remote interactive system according to the counted numbers of the at least two types of interactive terminals includes the steps of:

[0019] Set different priorities for different types of interactive terminals.

[0020] In one implementation, for interactive terminals of the same type, the volume thresholds are the same.

[0021] In one implementation, for interactive terminals of the same type, at least two interactive terminals have different volume thresholds.

[0022] In one implementation, the triggered operations in the remote interactive system include: image playback of the interactive terminal, sound playback of the interactive terminal, and / or start / stop of the recording and broadcasting system of the remote interactive system.

[0023] In a second aspect, the present invention provides an operation triggering device, comprising:

[0024] A judging module, used to judge whether the volume of the interactive terminal of the remote interactive system is greater than a preset volume threshold;

[0025] A statistics module, used for counting the number of interactive terminals whose volume is greater than the volume threshold;

[0026] The trigger module is used to trigger corresponding operations in the remote interactive system according to the number of interactive terminals whose volumes are greater than the volume threshold.

[0027] In a third aspect, the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above-mentioned methods when executing the program.

[0028] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method of any of the above-mentioned embodiments.

[0029] The present invention presets appropriate operation trigger conditions for different actual scenarios, and the trigger conditions are judged based on the number of interactive terminals with volume exceeding the threshold value, and triggers corresponding operations for different preset scenarios. The present invention provides suitable operations for each conference or teaching scenario, improves the rationality of equipment operation for remote interactive conferences or training, and the entire operation switching process is automatic, without the need for participants to actively operate the equipment, which improves the fluency of meetings or courses. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the structure of a remote interactive system according to an embodiment of the present invention.

[0031] Figure 2 It is a flow chart of the operation triggering method of the present invention.

[0032] Figure 3 Schematic diagram of the operation trigger device of the present invention. DETAILED DESCRIPTION

[0033] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0034] Embodiment 1

[0035] like Figure 1 As shown, a remote interactive system includes multiple interactive terminals and an MCU or a cloud server, for example, Figure 1 Four interactive terminals (interactive terminals A, B, C and D) are shown. The four interactive terminals are placed in four different meeting places or classrooms.

[0036] like Figure 2 As shown, the operation triggering method of the present invention includes the following steps:

[0037] S101. Determine whether the volume of the interactive terminal of the remote interactive system is greater than a preset volume threshold;

[0038] S102. Counting the number of interactive terminals whose volume is greater than the volume threshold;

[0039] S103. Trigger corresponding operations in the remote interactive system according to the counted number of interactive terminals whose volumes are greater than the volume threshold.

[0040] It should be noted that S101, S102 and S103 are merely reference numerals for clarifying the embodiment and the accompanying drawings. Figure 2 The corresponding relationship does not represent a limitation on the order of the steps of the video encoding method in this embodiment.

[0041] S101. Determine whether the volume of the interactive terminal of the remote interactive system is greater than a preset volume threshold.

[0042] The operation triggering method of the present invention is to determine whether the interactive terminal has an interactive need by the volume of the interactive terminal. When the sound of the interactive terminal is greater than the preset volume threshold, it is automatically assumed that the interactive terminal is initiating an interactive need. For example, if the volume of a conference room or classroom is always below the volume threshold, it can be considered that people in the conference room are whispering. When the volume suddenly exceeds the threshold, it is considered that someone is speaking. At this time, the system assumes that the interactive terminal corresponding to the conference room is initiating an interactive need.

[0043] Generally speaking, the interactive terminal has a microphone for picking up the sound of the venue or classroom. At this time, the volume of the interactive terminal can be obtained based on the picked up sound. Of course, other independent volume judgment tools can also be used to obtain the volume of the interactive terminal. In short, the volume of the interactive terminal refers to the volume of the sound signal received by the sound receiving module of the interactive terminal.

[0044] S102. Count the number of interactive terminals whose volume is greater than the volume threshold.

[0045] In this step, the number of interactive terminals whose volume exceeds the volume threshold at a certain moment is counted.

[0046] For example, at a certain moment, if the volume of two interactive terminals is greater than the volume threshold, it can be considered that at this moment, both interactive terminals have raised the demand for interaction.

[0047] S103. Trigger corresponding operations in the remote interactive system according to the counted number of interactive terminals whose volumes are greater than the volume threshold.

[0048] Generally speaking, when the volume of an interactive terminal is greater than a volume threshold, it can be considered that the conference room or classroom corresponding to the interactive terminal has a need for interaction. In practice, some conference rooms have false needs for interaction due to false triggering. For example, someone in a conference room is discussing a problem privately, but the volume of the discussion is too high, causing the volume to be greater than the threshold, triggering a need for interaction, while in fact, the conference room does not actually need to raise a demand for interaction. In order to avoid the above-mentioned false triggering situation, step S103 presets a quantity interval for the operation triggered by each scenario based on past experience, which is used to further confirm the interactive needs of the conference room or classroom that raises the interaction, and then implements the corresponding operation suitable for the scenario.

[0049] For example, in Figure 1 At the conference scene shown, when the volume of only one interactive terminal is greater than the volume threshold, it is considered that the participants in each venue are taking turns to speak, and the corresponding operation is performed at this time, such as each venue plays the picture and sound of the venue whose volume is greater than the volume threshold. When the volume of two interactive terminals is greater than the volume threshold, it is considered that the participants in these two venues are discussing issues, and another operation is performed at this time, such as each venue plays the composite picture and mixed sound of the two venues whose volume is greater than the volume threshold. When the volume of three or more interactive terminals is greater than the volume threshold, it can be considered based on past experience that only one venue is speaking and the participants in other venues are making noise, and the third operation is performed at this time.

[0050] For example, only the images and sounds of the venue with the loudest volume can be played.

[0051] It should be pointed out that in addition to the above-mentioned operations on the picture or sound, the operations here can also be other operations of the remote interactive system. For example, the remote interactive system has a recording and broadcasting function. When the volume of the four venues is greater than the threshold, it is considered to be a halftime break or a meeting, and the corresponding operation is to terminate the recording and broadcasting.

[0052] The method of the present invention presets suitable operation trigger conditions for different actual scenarios, and the trigger conditions are judged based on the number of interactive terminals with volume exceeding the threshold value, and trigger corresponding operations for different preset scenarios. The method of the present invention provides suitable operations for each conference or teaching scenario, improves the rationality of equipment operation for remote interactive conferences or training, and the entire operation switching process is automatic, without the need for participants to actively operate the equipment, thereby improving the fluency of meetings or courses.

[0053] In one embodiment, the interactive terminal includes at least two different types of terminals; the process of counting the number of interactive terminals whose volume is greater than the volume threshold comprises the steps of: counting the number of interactive terminals of one type of interactive terminals whose volume is greater than the volume threshold; the process of triggering corresponding operations on the interactive terminals according to the number of interactive terminals whose volume is greater than the volume threshold comprises the step of: triggering corresponding operations on the remote interactive system according to the counted number of interactive terminals of one type.

[0054] For example, the interactive terminals are divided into two categories: the main speaker terminal and the listening terminal. The listening terminal is considered to be more important. The listening terminal is used as the standard, and the number of listening terminals with volume greater than the threshold is counted to trigger the corresponding operation. Assuming that only one listening terminal has a volume greater than the threshold, it is considered that the listening terminal is speaking, and each interactive terminal outputs the image of the listening terminal. When there is no (i.e., 0) listening terminal with a volume greater than the threshold, it is considered that the main speaker terminal is speaking, and the image and sound of the main speaker terminal are output. Of course, similar settings can also be made with the main speaker terminal as the standard.

[0055] In reality, there will be speakers and listeners at remote teaching or conferences. The speakers and listeners play different roles in teaching or conferences, so different types of terminals are divided according to their actual activities, which is more conducive to meeting the needs of actual scenarios.

[0056] In one embodiment, the interactive terminal includes at least two different types of terminals; the process of counting the number of interactive terminals whose volumes are greater than the volume threshold comprises the steps of: separately counting the number of interactive terminals whose volumes are greater than the volume threshold among the at least two types of interactive terminals; the process of triggering corresponding operations on the interactive terminals according to the number of interactive terminals whose volumes are greater than the volume threshold comprises the step of: triggering corresponding operations on the remote interactive system according to the counted number of the at least two types of interactive terminals.

[0057] For example, the interactive terminal includes three types of terminals, namely, the host terminal, the speaker terminal, and the listening terminal. Only the number of host terminals and the speaker terminal whose volume is greater than the threshold can be counted, and then the corresponding operation is triggered according to the combination of their respective numbers. Assuming that there is 1 host terminal and 3 speaker terminals, when the volume of the host terminal is greater than the threshold and the volume of 1-3 speaker terminals is greater than the threshold, it is considered that the host terminal and the speaker terminal are interacting, and each interactive terminal plays the images and sounds of the host terminal and the speaker terminal. For another example, the number of terminals of the host terminal, the speaker terminal, and the listening terminal whose volume is greater than the threshold can be counted. When the volume of 1 host terminal, 1 speaker terminal, and 1 listening terminal is greater than the threshold, it is considered that these three types of terminals are interacting, and the combined images and mixed sounds of these three interactive terminals whose volumes are greater than the threshold are played. Of course, the interactive terminal can also include only the speaker terminal and the listening terminal, and the remote interactive system is triggered according to the number of speaker terminals whose volume is greater than the threshold and the number of listening terminals whose volume is greater than the threshold.

[0058] In one implementation, different priorities are set for different types of interactive terminals. For example, the interactive terminals include three types of terminals: the host terminal, the speaker terminal, and the listener terminal. The priorities are from high to low: the host terminal, the speaker terminal, and the listener terminal. When the volume of the host terminal and at least one speaker terminal is greater than a threshold, the number of listener terminals with a volume greater than the threshold is ignored, and the corresponding operation is triggered only according to the number of the host terminal and the speaker terminal with a volume greater than the threshold.

[0059] In one implementation, for the same type of interactive terminals, the volume thresholds are the same. For example, if there are three main speaker terminals, and the device environments and external environments of the three main speaker terminals are similar, the volume thresholds of the three main speaker terminals can be set to be the same.

[0060] In one embodiment, for the same type of interactive terminals, at least two interactive terminals have different volume thresholds.

[0061] There is a heavy thunderstorm at the location of listening terminal E, and the external sound is relatively noisy. In this case, the volume threshold of listening terminal E can be adjusted to be larger than that of the other four listening terminals to prevent listening terminal E from being mistakenly triggered by the sound of the rainstorm.

[0062] In one implementation, the triggered operations in the remote interactive system include: image playback of the interactive terminal, sound playback of the interactive terminal, and / or start / stop of the recording and broadcasting system of the remote interactive system.

[0063] Embodiment 2

[0064] Corresponding to the operation triggering method of the first embodiment, the present invention also provides an operation triggering device 1, such as Figure 3 As shown, the operation triggering device includes: a judgment module 101, a statistics module 102 and a triggering module 103.

[0065] The judging module 101 is used to judge whether the volume of the interactive terminal of the remote interactive system is greater than

[0066] Preset volume thresholds;

[0067] A statistics module 102, configured to count the number of interactive terminals whose volume is greater than the volume threshold;

[0068] The trigger module 103 is used to trigger a corresponding operation in the remote interactive system according to the number of interactive terminals whose volume is greater than the volume threshold.

[0069] The operation trigger device can be used as a part of the remote interactive system to trigger other modules in the remote interactive system to perform corresponding operations, or it can be used as an independent device for interacting with the remote interactive system to trigger the remote interactive system to perform corresponding operations by extracting the volume information of the interactive terminal in the remote interactive system.

[0070] In one embodiment, the interactive terminals include at least two different types of terminals; the statistical module counts the number of interactive terminals of one type whose volume is greater than the volume threshold.

[0071] The trigger module triggers a corresponding operation on the remote interactive system according to the statistical number of one type of interactive terminals.

[0072] In one embodiment, the interactive terminal includes at least two different types of terminals; the statistical module respectively counts the number of interactive terminals whose volumes are greater than the volume threshold among the at least two types of interactive terminals; and the trigger module triggers a corresponding operation on the remote interactive system according to the counted number of the at least two types of interactive terminals.

[0073] In one implementation, the trigger module sets different priorities for different types of interactive terminals.

[0074] In one implementation, for interactive terminals of the same type, the volume thresholds are the same.

[0075] In one implementation, for interactive terminals of the same type, at least two interactive terminals have different volume thresholds.

[0076] In one embodiment, the triggered operations in the remote interactive system include: image playback of the interactive terminal, sound playback of the interactive terminal and / or start / stop of the recording and broadcasting system of the remote interactive system. The device of the present invention presets suitable operation triggering conditions for different actual scenarios. The triggering conditions are judged based on the number of interactive terminals with volume exceeding the threshold, and corresponding operations are triggered for different preset scenarios. The device of the present invention provides suitable operations for each meeting or teaching scenario, improves the rationality of equipment operation for remote interactive meetings or training, and the entire operation switching process is automatic, without the need for participants to actively operate the equipment, thereby improving the fluency of meetings or courses.

[0077] Embodiment 3

[0078] An embodiment of the present invention further provides a computer storage medium on which computer instructions are stored. When the instructions are executed by a processor, the operation triggering method of any of the above embodiments is implemented.

[0079] Those skilled in the art can understand that: all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, random access memories (RAM), read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0080] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to execute all or part of the methods of each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, RAM, ROM, magnetic disks or optical disks.

[0081] Corresponding to the above-mentioned computer storage medium, in one embodiment, a computer device is also provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any one of the operation triggering methods in the above-mentioned embodiments is implemented.

[0082] The above computer device presets appropriate operation trigger conditions for different actual scenarios. The trigger conditions are determined based on the number of interactive terminals with volume exceeding the threshold value, and corresponding operations are triggered for different preset scenarios. In addition, suitable operations are provided for each conference or teaching scenario, which improves the rationality of equipment operation for remote interactive conferences or training, and the entire operation switching process is automatic, without the need for participants to actively operate the equipment, which improves the fluency of meetings or courses.

[0083] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0084] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the embodiments here. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. An operation triggering method, characterized in that: The operation triggering method comprises the steps of: Determining whether the volume of a target interactive terminal of a remote interactive system is greater than a preset volume threshold, wherein the remote interactive system has a recording and broadcasting function; Counting the number of target interactive terminals whose volume is greater than the volume threshold; triggering an operation in the remote interactive system corresponding to the operation according to the number of target interactive terminals whose volume is greater than the volume threshold; The types of the target interactive terminals include: a host terminal, a lecture terminal and a listener terminal; The process of counting the number of target interactive terminals whose volume is greater than the volume threshold comprises the steps of: Counting the number of interactive terminals of various types whose volume is greater than the volume threshold respectively; The process of triggering an operation in the remote interactive system corresponding to the operation according to the number of target interactive terminals whose volume is greater than the volume threshold counted comprises the steps of: An operation in the remote interactive system corresponding to the operation is triggered according to a combination of the type and number of target interactive terminals whose volumes are greater than the volume threshold, wherein when the volumes of all target interactive terminals are greater than the volume threshold, the remote interactive system terminates recording and broadcasting.

2. The operation triggering method according to claim 1, characterized in that: For interactive terminals of the same type, the volume threshold is the same.

3. The operation triggering method according to claim 1, characterized in that: For interactive terminals of the same type, if the number of interactive terminals is greater than or equal to 2, then at least two interactive terminals have different volume thresholds.

4. The operation triggering method according to claim 1, characterized in that: The triggered operations in the remote interactive system also include: image playback of the interactive terminal, sound playback of the interactive terminal and / or start / stop of the recording and broadcasting system of the remote interactive system.

5. An operation triggering device, characterized in that: include: A judgment module, used to judge whether the volume of the interactive terminal of the remote interactive system is greater than a preset volume threshold, wherein the remote interactive system has a recording and broadcasting function; A statistics module, used to count the number of interactive terminals whose volume is greater than the volume threshold among various types of target interactive terminals, wherein the types of the target interactive terminals include: a host terminal, a speaker terminal, and a listener terminal; A trigger module, used for triggering an operation in the remote interactive system corresponding to the operation according to the number of interactive terminals whose volume is greater than the volume threshold counted; The process in which the trigger module executes the operation in the remote interactive system corresponding to the trigger operation based on the number of interactive terminals whose volumes are greater than the volume threshold, includes: An operation in the remote interactive system corresponding to the operation is triggered according to a combination of the type and number of target interactive terminals whose volumes are greater than the volume threshold, wherein when the volumes of all target interactive terminals are greater than the volume threshold, the remote interactive system terminates recording and broadcasting.

6. A computer storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the operation triggering method as described in any one of claims 1 to 4 is implemented.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the operation triggering method as described in any one of claims 1 to 4 is implemented.

Images