Control Method, Control Management System, Communication Interface and Cooperative Control System

Abstract

The present invention provides a control method, a control management system, a communication interface, and a collaborative control system. The method includes: receiving a control signaling; determining the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of a plurality of control devices; and processing the control signaling based on the control authority of the control device corresponding to the control signaling. The method, control management system, communication interface, and collaborative control system provided by the present invention can connect multiple control devices, process the control signaling sent by each control device according to the control authorities of each control device, enable participants to operate the intelligent conference large screen simultaneously, improve the interactive experience of the conference, reduce the waiting time of the conference, and reduce the risk of damage to the control device caused by the transfer of the control device.

Description

Technical Field

[0001] The present invention relates to the technical field of collaborative control, and particularly to a control method, a control management system, a communication interface, and a collaborative control system. Background Art

[0002] In order to improve office efficiency, more and more enterprises have started to use intelligent conference large screens. The intelligent conference large screen can be pre-installed with office software such as conference software and whiteboards. Through collaborative work with intelligent pens, the conference efficiency can be improved; the conference host can use the intelligent pen to amplify sound, record, annotate, turn pages, simulate a mouse on the conference large screen, and can also use the intelligent pen for voice control and near-field recording.

[0003] However, currently, the intelligent conference large screen and the intelligent pen are in a one-to-one mode. When the conference host operates the intelligent conference large screen with the intelligent pen, other participants cannot operate the intelligent conference large screen simultaneously and cannot perform related operations through the intelligent pen, which affects the conference interaction experience. In addition, during the meeting, when others need to speak or annotate, etc., there is a situation of passing the intelligent pen, resulting in increased conference waiting and the risk of damage to the intelligent pen. Summary of the Invention

[0004] The present invention provides a control method, a control management system, a communication interface, and a collaborative control system to solve the defect that the operation of a single intelligent pen in the prior art cannot meet the conference requirements.

[0005] The present invention provides a control method, including:

[0006] Receiving a control signaling;

[0007] Based on the control permissions of a plurality of preset control devices, determining the control permission of the control device corresponding to the control signaling;

[0008] Processing the control signaling based on the control permission of the control device corresponding to the control signaling.

[0009] According to a control method provided by the present invention, the control permissions of the plurality of preset control devices are determined based on the following steps:

[0010] Determining the priorities of the plurality of control devices;

[0011] Based on the priorities of the plurality of control devices, determining the control permissions of the plurality of control devices.

[0012] According to a control method provided by the present invention, the priority of the control device is determined based on at least one of the connection order, communication order, and device code of the corresponding control device.

[0013] A control method provided by the present invention, which controls the control authority of a corresponding control device based on the control signaling and processes the control signaling, includes:

[0014] If the priority of the control device corresponding to the control signaling is the first priority, execute the control signaling;

[0015] Otherwise, determine whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, place the control signaling in the buffer area and execute the control signaling in the buffer area.

[0016] A control method provided by the present invention, which receives control signaling, includes:

[0017] Receive the control signaling forwarded by the communication interface, where the control signaling is sent by the corresponding control device to the communication interface.

[0018] The present invention also provides a control management system, including:

[0019] A receiving module: used to receive control signaling;

[0020] An authority module: used to determine the control authority of the control device corresponding to the control signaling based on the control authorities of a plurality of preset control devices;

[0021] A processing module: used to process the control signaling based on the control authority of the control device corresponding to the control signaling.

[0022] The present invention also provides a control method, including:

[0023] Receive the control signaling sent by the control device;

[0024] Forward the control signaling to the control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the control authorities of a plurality of preset control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0025] According to a control method provided by the present invention, when the control signaling is a voice signaling, the forwarding of the control signaling to the control management system includes:

[0026] Synthesize the voice signals sent by multiple control devices into one voice signal and forward it to the control management system;

[0027] Or, based on the priorities of the multiple control devices, forward the voice signals sent by the multiple control devices to the control management system in the order from high to low of the priorities.

[0028] A control method provided by the present invention, the forwarding the control signaling to a control management system includes:

[0029] Based on the device identifier of the control device corresponding to the control signaling, the timestamp of receiving the control signaling, and the control signaling, construct control data, and place the control data into a forwarding queue;

[0030] Based on the chronological order of the timestamps of the control data in the forwarding queue, send the control data to the control management system one by one.

[0031] A control method provided by the present invention, the forwarding the control signaling to a control management system further includes:

[0032] If the control signaling conforms to the control authority of the control device corresponding to the control signaling, then forward the control signaling to the control management system.

[0033] The present invention also provides a communication interface, including:

[0034] A receiving module, configured to receive control signaling sent by a control device;

[0035] A forwarding module, configured to forward the control signaling to a control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the control authorities of a plurality of preset control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0036] The present invention also provides a collaborative control system, including:

[0037] The above-mentioned control management system, the above-mentioned communication interface, and a control device communicatively connected to the communication interface.

[0038] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, the steps of any one of the above-mentioned control methods are implemented.

[0039] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any one of the above-mentioned control methods are implemented.

[0040] The present invention also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of any one of the above-mentioned control methods are implemented.

[0041] The control method, control management system, communication interface, and collaborative control system provided by the present invention obtain the control authority of the control device that sends the control signal through the pre-set control authorities of multiple already-connected control devices, and then execute the control signal according to the control authority, realizing the ability to respond to and process the control signals sent by multiple connected control devices, enabling conference participants to operate the intelligent conference large screen simultaneously, improving the interactive experience of the conference, reducing the conference waiting time, and reducing the risk of damage to the control device caused by the transfer of the control device. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following-described drawings are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0043] Figure 1 It is one of the flow diagrams of the control method provided by the present invention;

[0044] Figure 2 It is the flow diagram of the control device authority setting method provided by the present invention;

[0045] Figure 3 It is the second flow diagram of the control method provided by the present invention;

[0046] Figure 4 It is the flow diagram of the control signal forwarding method provided by the present invention;

[0047] Figure 5 It is the structure diagram of the connection and recognition between the intelligent pen and the intelligent conference large screen provided by the present invention;

[0048] Figure 6 It is the structure diagram of the control management system provided by the present invention;

[0049] Figure 7 It is the structure diagram of the communication interface provided by the present invention;

[0050] Figure 8 It is the structure diagram of the collaborative control system provided by the present invention;

[0051] Figure 9 It is the structure diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0052] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without creative efforts shall fall within the protection scope of the present invention.

[0053] Currently, the control operation of the intelligent conference large screen is based on the control of a unique intelligent pen connected thereto. Under this one-to-one mode, during a meeting, only one participant can operate the intelligent conference large screen. When one person is operating, the other participants cannot operate the intelligent conference large screen simultaneously, which affects the conference interaction experience.

[0054] Although there are multi-device control situations in the existing control of presentation software during a speech, this application scenario is for multi-device control of page turning of the electronic manuscript displayed in the presentation software, and the control device controls the translation of the electronic manuscript displayed in the presentation software by triggering a page turning signal. In the actual application process, compared with the one-to-one mode, the interaction experience has been improved, but because it can only control the page turning action by triggering a signal, it cannot respond to other operation actions, such as gesture actions, air mouse actions, etc., or cannot respond to other control types, such as voice control. This will still affect the conference interaction experience of the participants.

[0055] Therefore, how to use multiple control devices for collaborative control is an urgent problem to be solved in the art.

[0056] The embodiments of the present invention provide a solution for how to achieve collaborative operation of multiple control devices in intelligent conference scenarios and other scenarios that require the use of multiple control devices for collaborative control. In this scenario, at least a control management system and multiple control devices can be included, and a communication interface can also be included. Among them, the control management system is used to respond to operation requests sent by multiple control devices. The control device can collect voice, gesture signals or respond to button clicks. For example, the control device can be an intelligent pen with functions of voice control, handwriting input and button page turning. In addition, the control device can be directly connected to the intelligent conference large screen, and the control signaling generated by it is directly sent to the intelligent conference large screen; the control device can also be indirectly connected to the intelligent response large screen through the communication interface, and the control signaling generated by it is sent to the communication interface and then forwarded by the communication interface to the intelligent conference large screen.

[0057] Figure 1 is one of the flow diagrams of the control method provided by the present invention. As Figure 1As shown in the figure, an embodiment of the present invention provides a control method, which can be applied to a control management system in a collaborative control scenario. Here, the control management system can specifically manage the permissions of each control device and execute the control signaling sent by the control device. Taking the intelligent meeting scenario as an example for illustration below, for other scenarios, the execution process is basically the same and will not be elaborated here. The method includes:

[0058] Step 110, receiving control signaling;

[0059] Specifically, the control signaling is a signaling with a control intention, which can specifically be voice information, gesture information, or event information. The control device can collect voice information, gesture information, or respond to the click event of a button on the control device to generate and send control signaling. The control signaling can be directly sent from the control device to the control management system, or can be first sent from the control device to the communication interface, and then forwarded by the communication interface to the control management system. In this process, the communication interface can only undertake the task of signaling forwarding, or can preprocess the control signaling and then forward the preprocessed control signaling to the control management system. The embodiment of the present invention does not limit this.

[0060] Step 120, determining the control permission of the control device corresponding to the control signaling based on the pre-set control permissions of multiple control devices;

[0061] Considering that in actual applications, when multiple control devices are simultaneously connected to the intelligent meeting large screen, these connected control devices may operate the intelligent meeting large screen simultaneously. At this time, the intelligent meeting large screen will respond to these operations simultaneously, resulting in conflicts, and further leading to chaotic operations of the intelligent meeting large screen and affecting the progress of the meeting. Therefore, the embodiment of the present invention performs permission control based on multiple connected control devices to enable multiple connected control devices to operate the intelligent meeting large screen based on their own permissions.

[0062] Specifically, when the control signaling is received in step 110, the control management system can search for the control permission of the control device corresponding to the control signaling among the pre-set control permissions of multiple control devices to obtain the control permission of the control device for use in step 130. Here, the control permission defines the scope that the corresponding control device can control. The control management system only needs to execute the control signaling under the control permission, and the control signaling exceeding the control permission should be ignored and not executed.

[0063] It should be noted that the control permissions of multiple control devices can be manually set by the keynote speaker of the meeting after the connection of multiple control devices is completed, or can be the control permissions of multiple control devices connected and set in the previous meeting, or can be set by the keynote speaker for each control device in the list based on the list of control devices that have been connected in history. The embodiments of the present invention do not make specific limitations on this. The control permissions of multiple control devices after the setting is completed can be saved in the cache of the control management system, or can be saved in the hard disk of the control management system. The embodiments of the present invention do not limit this.

[0064] Step 130: Process the control signal based on the control permission of the control device corresponding to the control signal.

[0065] Specifically, after obtaining the control permission of the control device corresponding to the control signal from step 120, the control management system processes the control signal according to the control permission. It should be noted that processing the control signal according to the control permission includes determining whether the control device sending the control signal has the control permission required by the control signal. If the control device currently does not have the control permission of the control signal, the control signal is discarded. If the control device currently has the control permission of the control signal, the control signal is parsed to obtain the specific operation on the intelligent conference large screen, and the corresponding operation is executed on the intelligent conference large screen. Further, parsing the control signal can be understood as performing speech recognition and intention understanding on the voice information, converting the corresponding operation path for the gesture information, and determining the corresponding operation for the event information. The embodiments of the present invention do not limit this. When executing the corresponding operation, it can be executed immediately, or can be executed sequentially according to the order of receiving each control signal. The embodiments of the present invention do not limit this.

[0066] The control method provided by the embodiments of the present invention obtains the control permission of the control device sending the control signal through the pre-set control permissions of multiple control devices, and then executes the control signal according to the control permission, so that multiple control devices in the scenario of collaborative control can achieve orderly control. Specifically in the intelligent conference scenario, the participants can operate the intelligent conference large screen at the same time, improving the interactive experience of the meeting, reducing the waiting time of the meeting, and reducing the risk of damage to the control device caused by the transfer of the control device. And through the control of permissions, the conflict generated when multiple control devices control at the same time is avoided, further improving the interactive experience of the meeting.

[0067] Based on the above embodiments, Figure 2 is a flowchart of the control device permission setting method provided by the present invention. As Figure 2 shown, the control permissions of multiple control devices pre-set in step 120 are determined based on the following steps:

[0068] Step 210: Determine the priorities of multiple control devices;

[0069] Step 220: Determine the control authorities of multiple control devices based on the priorities of multiple control devices.

[0070] Considering that during a meeting, there may be a situation where multiple control devices perform control operations simultaneously. For example, when multiple control devices are performing gesture input operations in parallel, at this time, the host needs to perform some operations, such as turning pages or using a flying mouse, etc. The operations of the host need to be given priority to ensure that the meeting process will not be interrupted. In view of the above situation, the embodiments of the present invention set the control authorities of control devices in the form of priorities, so that control devices with different priorities can correspond to different control authorities, thereby further ensuring the orderly progress of the meeting and improving the interactive experience of the meeting.

[0071] Specifically, after multiple control devices are connected, the priorities of each control device can be set, and then the corresponding control authorities of each control device can be set according to the priorities of each control device. It should be noted that setting the corresponding control authorities of each control device according to the priorities of each control device can be determined based on the mapping relationship between the priorities and the control authorities. Among them, the priorities of the control devices can be fixed after being set in advance, or can be changed according to user operations during the meeting. The priorities can be determined based on pre-configurations, or can be determined according to the connection order, or can be determined by applying according to the control device codes. The embodiments of the present invention do not limit this.

[0072] Based on the above embodiments, the embodiments of the present invention provide a preferred embodiment, where the priorities of the control devices are determined based on at least one of the connection order, communication order, and device codes of the corresponding control devices.

[0073] Specifically, setting the priorities of the control devices according to the connection order can be that the first connected control device has the highest priority, and the subsequent connected control devices have normal priorities. It can also be according to the preset threshold number of connections. When the number of connections is less than the preset threshold number of connections, the control devices are set with priorities from high to low in the order of connection. When the number of connections is greater than or equal to the preset threshold number of connections, the lowest priority is set. For example, a total of 4 levels of priorities are set, the preset threshold number of connections is set to 3, the first 3 connected control devices are respectively assigned the highest 3 priorities, and all subsequent connected control devices are assigned the lowest 4th priority. The embodiments of the present invention do not limit this.

[0074] Set the priority of the control device according to the communication order. It can be that the control device currently communicating with the control management system has the highest priority, and the remaining control devices connected to the control management system but not having information interaction are set with normal priority. If a new control device interacts with the control management system subsequently, the priority of the new control device can be adjusted to the highest priority, and the priority of the control device that has ended the interaction with the control management system can be adjusted to normal priority.

[0075] Set the priority of the control device according to the device code. It can be that the control device actively sends its own device code to the control management system to apply for the highest priority. After receiving the device code, the control management system can judge whether to assign the highest priority to the control device corresponding to the device code according to the pre-set rules, or display the received device code on the screen for the operator to confirm whether to assign the highest priority to the control device corresponding to the device code. For example, it is pre-set that at most 3 control devices can be configured with the highest priority. Currently, one control device has been configured with the highest priority. At this time, if the control management system receives the device code sent by a control device, it can configure the highest priority for the control device corresponding to the device code.

[0076] The priority configuration method provided by the embodiments of the present invention can realize flexible configuration of the priorities of multiple control devices, thus ensuring the flexibility of the cooperation scenario.

[0077] Based on the above embodiments, step 130 includes:

[0078] If the priority of the control device corresponding to the control signaling is the first priority, execute the control signaling;

[0079] Otherwise, judge whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, place the control signaling in the buffer area and execute the control signaling in the buffer area.

[0080] Specifically, for the received control signaling, the priority of the control device corresponding to the control signaling can be determined from the priority settings of each control device.

[0081] On this basis, it can be judged whether the priority of the control device corresponding to the control signaling is the first priority. Here, the first priority can be the highest priority among the pre-set priorities. Here, "first" is used to distinguish from other priorities. For the control device in the first priority, the control signaling sent by it needs to be executed immediately.

[0082] If the priority of the control signaling corresponding to the control device is the first priority, the operation corresponding to the control signaling can be directly executed. If the priority of the control signaling corresponding to the control device is not the first priority, it is necessary to first determine whether the control signaling conforms to the control authority of its corresponding control device. If it conforms, the control signaling is placed in the buffer area, and the control signaling in the buffer area is executed. Among them, the control signaling in the buffer area is executed in the order in which the signaling enters the buffer area. During the sequential execution process, if a new control signaling belonging to the first priority is received, the execution of the control signaling in the buffer will be suspended until the execution of the control signaling of the first priority is completed, and then the control signaling in the buffer will continue to be executed sequentially.

[0083] The control method provided by the embodiment of the present invention sets a discriminatory execution method for the control signaling under the first priority, so that the control signaling sent by the control device with the highest control authority can be executed in a timely manner and respond in real time, ensuring that the meeting process can proceed smoothly.

[0084] Based on any of the above embodiments, step 110 includes:

[0085] Receive the control signaling forwarded by the communication interface, and the control signaling is sent from the corresponding control device to the communication interface.

[0086] Considering that the control device should be applicable to various intelligent conference large screens, similar to a wireless mouse, it will not be limited by the type of intelligent conference large screen. Therefore, the embodiment of the present invention uses a communication interface, for example: USB Dongle.

[0087] Specifically, the communication interface can be connected to the control management system through a physical interface, and at the same time, the communication interface can be wirelessly connected to each control device. The control device can send control information to the communication interface, and then the communication interface forwards the control information to the control management system. It should be noted that only one communication interface is required in the embodiment of the present invention to complete the connection with multiple control devices, and each control device in the communication interface corresponds to each control device through the unique code of each control device. After receiving the control signaling, the communication interface can also preprocess the control signaling, and then forward the preprocessed control signaling to the control management system for use in step 120. It should be noted that the preprocessing of the control signaling here can be voice synthesis, adding a time stamp, or adding the identification information of the control device corresponding to the control signaling, etc., and the embodiment of the present invention does not limit this.

[0088] Figure 3 It is the second flow chart of the control method provided by the present invention. As Figure 3As shown in the figure, an embodiment of the present invention provides a control method. This method can be applied to a communication interface in a collaborative control scenario. The communication interface can realize the communication connection between the control management system and each control device. The method includes:

[0089] Step 310, receiving a control signal sent by a control device;

[0090] Specifically, the control signal is a signal with a control intention, which can be voice information, gesture information, or event information. The control device can collect voice information, gesture information, or respond to a click event of a button on the control device to generate a control signal and send it. The number of control devices can be one or more.

[0091] Step 320, forwarding the control signal to the control management system so that the control management system determines the control authority of the control device corresponding to the control signal based on the pre-set control authorities of multiple control devices, and processes the control signal based on the control authority of the control device corresponding to the control signal.

[0092] Specifically, the control signal received according to step 310 is forwarded to the control management system for the control management system to obtain the authority of the control device corresponding to the control signal according to the pre-set control authorities of multiple control devices in its system, and process the control signal according to the control authority. It should be noted that the control signal can be forwarded to the control management system without preprocessing by the communication interface directly, or can be preprocessed by the communication interface to obtain a preprocessed control signal and then forwarded. The embodiment of the present invention does not limit this. Among them, the preprocessing of the control signal can be voice synthesis, adding a time stamp, or adding the identification information of the control device corresponding to the control signal, etc. The embodiment of the present invention does not limit this.

[0093] In addition, the method executed in the control management system has been described in steps 110 to 130 above and will not be repeated here.

[0094] The control method provided by the embodiment of the present invention obtains the control authority of the control device sending the control signal through the pre-set control authorities of multiple connected control devices, and then executes the control signal according to the control authority, realizing the ability to respond to and process control signals sent by multiple connected control devices, enabling participants to operate the intelligent conference large screen simultaneously, improving the interactive experience of the conference, reducing the waiting time of the conference, and reducing the risk of damage to the control device caused by the transfer of the control device. And through the control of permissions, the conflict generated when multiple control devices control simultaneously is avoided, further improving the interactive experience of the conference.

[0095] Based on the above embodiments, in step 320, when the control signaling is voice signaling, forwarding the control signaling to the control management system includes:

[0096] Combining the voice signals sent by multiple control devices into one voice signal and forwarding it to the control management system;

[0097] Or, based on the priorities of multiple connected control devices, forwarding the voice signals sent by the multiple control devices to the control management system in descending order of priority.

[0098] To reduce the processing pressure of the control management system and improve its processing performance, so that the control management system can respond quickly or even in real time in sequence when receiving multiple operation signals. Therefore, in the embodiments of the present invention, the control signaling is preprocessed in the communication interface, and then the preprocessed control signaling is forwarded by the communication interface to the control management system.

[0099] At the same time, considering that the control signaling can support multiple types, in the embodiments of the present invention, the type of the control signaling is judged, and corresponding processing is performed according to the type judgment.

[0100] Specifically, when the type of the control signaling is voice signaling, for the situation where multiple voice signals from multiple control devices are received within the same time period, in order to improve the forwarding efficiency, the communication interface can combine the multiple parallel voice signals into one voice signal and then forward it.

[0101] In addition, to ensure the quality of the voice signaling, for the multiple voice signals received from multiple control devices within the same time period, the communication interface can forward the voice signals to the control management system in descending order of the priorities of the control devices corresponding to the voice signals.

[0102] Further, in the embodiments of the present invention, whether the preprocessing method of the voice signaling is to combine multiple voice signals into one voice signal and then forward it, or to forward it in the order of priorities, can be the default of the communication interface, or can be configured by the operator through the control management system and sent to the communication interface. After receiving this configuration, the communication interface can write this configuration into the cache. The embodiments of the present invention do not limit this.

[0103] It should be noted that after receiving the voice signaling, the communication interface can also perform processing such as noise reduction, echo cancellation, and power amplification on the voice signaling. The embodiments of the present invention do not limit this.

[0104] In addition, for the case where the type of control signaling is non-voice type, the control signaling can also be forwarded to the control management system based on the priority of the control device corresponding to the control signaling in the order from high to low of the priority of the control device, and can also be forwarded to the control management system based on the timestamp of the received control signaling in the order of the timestamps. The embodiments of the present invention do not limit this.

[0105] Based on the above embodiments, Figure 4 is a schematic flowchart of the control signaling forwarding method provided by the present invention. As Figure 4 shown, forwarding the control signaling to the control signaling in step 320 includes:

[0106] Step 321, constructing control data based on the device identifier of the control device corresponding to the control signaling, the timestamp of receiving the control signaling, and the control signaling, and placing the control data into the forwarding queue;

[0107] Step 322, sending the control data to the control management system one by one based on the order of the timestamps of the control data in the forwarding queue.

[0108] Considering some control operations that need to be executed synchronously, for example: through gesture acquisition of the control device, writing or annotating on the large screen of the intelligent conference, or the control device submitting an encoding application such as raising the priority, for such messages, the communication interface can forward them in the order of receiving the control signaling. To facilitate the control management system to know the order of sending of each control message while receiving the control signaling, in the embodiments of the present invention, the communication interface will add a timestamp to the control signaling before forwarding such control signaling.

[0109] In addition, considering that the control management system needs to know the control device corresponding to sending such control signaling to perform different operation processes according to the control device, for example: when writing or annotating on multiple control devices, the control management system needs to distinguish different colors according to different control devices, or when the control device sends an encoding application such as raising the priority, the control management system needs to make corresponding configurations for the encoding application such as raising the priority for the control device. Therefore, in the embodiments of the present invention, the device identifier of the control device is added to the control signaling before forwarding such control operations.

[0110] Specifically, after receiving the control signaling, the communication interface can form the control data of the control signaling, including the control signaling, the device identifier of the control device corresponding to the control signaling, and the timestamp when the control signaling is received, and put the control data into the forwarding queue in its own buffer. Subsequently, the communication interface can send the control data to the control management system one by one according to the timestamps of the control data in the forwarding queue in the order of the timestamps. It should be noted that when the communication interface sends the control data to the control management system one by one according to the order of the timestamps, it can poll the queue through a separate polling process or thread to extract and forward the control data corresponding to the earliest timestamp, or extract and forward the control data corresponding to the earliest timestamp from the queue every once in a while through a timer. The embodiments of the present invention do not limit this.

[0111] Based on any of the above embodiments, in step 320, forwarding the control signaling to the control management system further includes:

[0112] If the control signaling conforms to the control authority of the control device corresponding to the control signaling, forward the control signaling to the control management system.

[0113] Specifically, the communication interface can judge the control authority of the control device corresponding to the control signaling. If the control device has the control authority of the control signaling, then transfer the control signaling to the control management system. If the control device does not have the control authority of the control signaling, the control signaling can be directly ignored and the forwarding of the control signaling is no longer executed. Among them, the control authority of the control device can be obtained by the control management system actively sending it to the communication interface, or can be obtained by the communication interface requesting and querying the control management system after receiving the control signaling. The embodiments of the present invention do not limit this.

[0114] Based on any of the above embodiments, the present invention also provides a specific embodiment. Figure 5 It is a structural diagram of the connection and recognition between the intelligent pen and the intelligent conference large screen provided by the present invention. As Figure 5 shown, multiple intelligent pens are connected to the USB Dongle, and the USB Dongle is connected to the intelligent conference large screen. The USB Dongle and the intelligent conference large screen manage the intelligent pens and process operation data through the control management system. The specific implementation manner of the collaborative control system provided by the embodiments of the present invention is as follows:

[0115] In the embodiments of the present invention, the communication interface is the USB Dongle, and the control device is the intelligent pen.

[0116] Step 510, the USB Dongle stores device ID codes of multiple smart pens. By pairing the USB Dongle with the ID codes of multiple smart pens, the connection between the smart pens, the control and management system, and the smart conference display can be achieved. The establishment of the specific connection can be realized through steps 511 - 513:

[0117] Step 511, set the refresh period for the USB Dongle of the smart conference display to receive data to 5 ms to receive the request ID codes of the smart pens.

[0118] Step 512, when the smart pen is enabled, it will send a request to the USB Dongle. The USB Dongle pairs the received ID codes of the smart pens. When the received ID codes of the smart pens are consistent with the device ID codes stored in the Dongle, the connection is successful, and the connected smart pen can operate on the smart conference display.

[0119] Step 513, when the received ID codes of the smart pens are inconsistent with the ID codes stored in the Dongle, the pairing fails, and this smart pen cannot operate on the smart conference display.

[0120] Step 520, after the smart pens are connected to the smart conference display, through the control and management system on the smart conference display, the priorities of the multiple connected smart pens can be managed, and different priority operation functions and permissions for the smart pens to the smart conference display can be granted. The control and management system provides multiple smart pen priority algorithm options, including: connection order priority sorting method, digital communication order sorting method with the smart conference display, encoding signal application sorting method of the smart pen, and administrator sorting method.

[0121] Among them, the connection order priority sorting method is the default setting that the first connected smart pen has the highest priority, that is, the smart pen in the administrator role (similar to the conference host), and the other smart pens have the normal priority.

[0122] The communication order sorting method is that the control and management system sets that the smart pen currently interacting with the smart conference display has the highest priority, and the other smart pens have their priorities dynamically set according to the communication with the smart conference display.

[0123] The encoding signal application sorting method is that the smart pen can send an encoding to the smart conference display to apply for the highest priority.

[0124] In addition, the keynote speaker has administrator permissions and can set the priorities of the smart pens. The administrator can set other smart pens to the highest priority and can sort the priorities of the smart pens through the management page.

[0125] The control and management system defaults to sorting the priorities of the smart pens according to the connection order priority sorting method.

[0126] If multiple intelligent pens send messages to the intelligent conference large screen simultaneously, then the intelligent pen with the highest priority obtains the qualification to operate the intelligent conference large screen, and the remaining control messages enter the message buffer to wait for responses in sequence.

[0127] Step 530: Through voice interaction, gesture interaction, air mouse interaction, and button interaction, realize data interaction between multiple intelligent pens and the intelligent conference large screen and its control and management system.

[0128] Among them, for the voice interaction function, we embed a DSP chip for voice processing in the USB Dongle. When there is voice data from one intelligent pen, it can be used for noise reduction, echo cancellation, and power amplification processing; when there is multi-channel voice data from multiple pens, voice synthesis can be performed on the basis of single-channel voice processing to improve the communication efficiency of the participants. The specific steps are as follows:

[0129] Step 531-1: If only one intelligent pen controls the intelligent conference large screen through voice, the voice data is transmitted to the USB Dongle, and after noise reduction, echo cancellation, and power amplification processing, the intelligent conference large screen is controlled through voice recognition and voice control.

[0130] Step 531-2: If multiple intelligent pens control the intelligent conference large screen through voice, if the intelligent conference large screen control software selects multi-channel voice synthesis, after the USB Dongle receives multi-channel voice data, it synthesizes multi-channel voice to realize voice control of the intelligent conference large screen.

[0131] Among them, when multiple intelligent pens control the intelligent conference large screen through voice, if the intelligent conference large screen control software does not select to synthesize multi-channel voice, the multi-channel voice controls the intelligent conference large screen in order according to the priority of the intelligent pens. And the administrator can also only allow one-way voice control, and other-way voice control is invalid.

[0132] For the gesture function of the control channel interaction, the gestures of multiple pens can be input in parallel. Multiple intelligent pens can write or annotate simultaneously in scenarios such as whiteboard and document browsing modes, and the handwriting colors of different intelligent pens are different, replacing the touching fingers with non-contact remote input intelligent pens. The specific steps are as follows:

[0133] Step 532-1: The intelligent pen performs gesture input. Among them, the intelligent conference large screen can receive gesture inputs from multiple intelligent pens simultaneously to write and annotate on the intelligent conference large screen simultaneously.

[0134] Step 532-2: After the USB Dongle receives the control data of different smart pens, it will distinguish from other smart pens according to the ID code of the smart pen. The USB Dongle sets a timestamp based on the initial time when it receives the control data of the smart pen, and then adds it to the processing queue of the control data.

[0135] Step 532-3: The USB Dongle sender continuously obtains the control data from the processing queue and sends it to the control management system in the order of the timestamps.

[0136] Step 532-4: After the control management system receives the control data of multiple smart pens, the control data of multiple pens can be fused on the smart meeting large screen according to the time series. On the smart meeting large screen, taking annotation as an example, different smart pens annotate different colored handwriting according to their different ID codes. Based on the processing efficiency (in milliseconds) of the smart pen, USB Dongle, and control management system, the annotation data completed at the same time can be seamlessly fused together.

[0137] For the air mouse function in the command channel interaction, only the smart pen with the highest priority can use the air mouse to control the smart meeting large screen. The specific steps are as follows:

[0138] Step 533-1: The smart pen responds to the air mouse button event and sends the air mouse control command.

[0139] Step 533-2: The USB Dongle only transmits the control data generated by the smart pen with the highest priority to the control management system through HID technology to simulate a mouse.

[0140] Among them, the independent control command channel is independent of the voice channel and the control channel, ensuring that multiple pens will not interfere with each other when collaborating in office.

[0141] For the button function in the command channel interaction, the smart pen can send buttons to the smart meeting large screen to implement different control commands corresponding to different buttons. The specific steps are as follows:

[0142] Step 534-1: The smart pen sends an encoding. Among them, the encoding includes: applying for the highest priority or other special shortcut operations on the smart meeting large screen, including but not limited to applying for connection, actively disconnecting, switching colors, etc. Different operations correspond to different encodings. This operation is distinguished by the smart pen ID code and only takes effect on the smart pen used by itself, without affecting the operations of other smart pens.

[0143] Step 534-2: The USB Dongle stores the available digital signals of the smart pen in the software linked list and linearly executes them in the order of pen priority and request time.

[0144] The control device provided by the present invention will be described below. The control device described below can be correspondingly referred to the control method described above.

[0145] Figure 6 is a schematic structural diagram of the control and management system provided by the present invention. As Figure 6 shown, the control and management system includes: a receiving module 610, a permission module 620, and a processing module 630;

[0146] Among them,

[0147] The receiving module 610 is used to receive control signals;

[0148] The permission module 620 is used to determine the control permission of the control device corresponding to the control signal based on the pre-set control permissions of multiple control devices;

[0149] The processing module 630 is used to process the control signal based on the control permission of the control device corresponding to the control signal.

[0150] In the embodiment of the present invention, through the receiving module 610, which is used to receive control signals; the permission module 620, which is used to determine the control permission of the control device corresponding to the control signal based on the pre-set control permissions of multiple control devices; and the processing module 630, which is used to process the control signal based on the control permission of the control device corresponding to the control signal, it is realized that the control signals sent by multiple connected control devices can be responded to and processed, enabling the participants to operate the intelligent conference large screen simultaneously, improving the interactive experience of the conference, reducing the waiting time of the conference, and reducing the risk of damage to the control device caused by the transfer of the control device. And through the control of permissions, the conflicts generated when multiple control devices control simultaneously are avoided, further improving the interactive experience of the conference.

[0151] Based on any of the above embodiments, the permission module 620 includes:

[0152] A determination priority sub-module, which is used to determine the priorities of multiple control devices;

[0153] An acquisition permission sub-module, which is used to determine the control permissions of multiple control devices based on the priorities of multiple control devices.

[0154] Based on any of the above embodiments, the priorities of the control devices in the determination priority sub-module are determined based on at least one of the connection order, communication order, and device code of the corresponding control devices.

[0155] Based on any of the above embodiments, the processing module 630 includes:

[0156] An execution sub-module, which is used to execute the control signal if the priority of the control device corresponding to the control signal is the first priority;

[0157] Otherwise, determine whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, place the control signaling into the buffer and execute the control signaling in the buffer.

[0158] Based on any of the above embodiments, the receiving module 610 is further configured to receive the control signaling forwarded by the communication interface, and the control signaling is sent from the control device to the communication interface.

[0159] Figure 7 It is a schematic structural diagram of the communication interface provided by the present invention. As Figure 7 shown, the communication interface includes: a receiving module 710 and a forwarding module 720;

[0160] Among them,

[0161] The receiving module 710 is configured to receive the control signaling sent by the control device;

[0162] The forwarding module 720 is configured to forward the control signaling to the control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0163] In the embodiment of the present invention, through the receiving module 710, which is configured to receive the control signaling sent by the control device; and the forwarding module 720, which is configured to forward the control signaling to the control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling, it is possible to respond to and process the control signaling sent by multiple connected control devices, enabling conference participants to operate the intelligent conference large screen simultaneously, improving the interactive experience of the conference, reducing the waiting time of the conference, and reducing the risk of damage to the control device caused by the transfer of the control device. Moreover, through the control of permissions, conflicts generated when multiple control devices control simultaneously are avoided, further improving the interactive experience of the conference.

[0164] Based on any of the above embodiments, the forwarding module 720 includes:

[0165] A voice processing sub-module: configured to, when the control signaling is voice signaling, forward the control signaling to the control management system, synthesize multiple voice signals sent by multiple control devices into one voice signal and forward it to the control management system;

[0166] Or, based on the priorities of multiple connected control devices, forward the voice signals sent by multiple control devices to the control management system in descending order of priority.

[0167] Based on any of the above embodiments, the forwarding module 720 includes:

[0168] A combining subunit, configured to construct control data based on the device identifier of the control device corresponding to the control signaling, the timestamp of receiving the control signaling, and the control signaling, and place the control data into a forwarding queue;

[0169] A forwarding subunit, which sequentially sends the control data to the control management system one by one based on the sequence of timestamps of the control data in the forwarding queue.

[0170] Based on any of the above embodiments, the forwarding module 720 further includes:

[0171] A judgment sub-module, configured to forward the control signaling to the control management system if the control signaling conforms to the control authority of the control device corresponding to the control signaling.

[0172] Figure 8 It is a schematic structural diagram of the collaborative control system provided by the present invention. As Figure 8 shown, the system includes:

[0173] The above-mentioned control management system 810, the above-mentioned communication interface 820, and the control device 830 connected to the above-mentioned communication interface 820.

[0174] Specifically, the communication interface 820 is connected to the control management system 810 through a physical interface. The communication interface 820 judges the control device 830 requesting connection according to the list of unique control device codes set internally. If the control device 830 requesting connection is in the list of unique control device codes set internally by the communication interface 820, the control device 830 is allowed to connect and a communication link is established. The control device 830 sends control signaling. After receiving the control signaling, the communication interface 820 performs preprocessing operations such as voice synthesis, adding a timestamp or a unique device identifier to the control signaling and then forwards it to the control management system 810. The control management system 810 executes the operation corresponding to the control signaling according to the locally preset control authority of the control device 830.

[0175] In an embodiment of the present invention, the communication interface 820 performs preprocessing operations such as voice synthesis, timestamp addition, or addition of the unique identifier of the control device on the control signaling, and forwards the preprocessed results to the control management system 810 according to the order of priorities or according to the order of timestamps. This enables the control management system 810 to operate the intelligent conference large screen based on the forwarded control signaling, reducing the preprocessing operations of the control management system 810, improving the performance of the control management system 810, reducing the response latency of the intelligent conference large screen, and enhancing the interactive experience of the conference. The control management system 810 obtains the control authority of the control device sending the control signaling based on the pre-set control authorities of multiple connected control devices, and then executes the control signaling according to the control authority. The control management system 810 can respond to and process the control signaling sent by multiple connected control devices, allowing participants to operate the intelligent conference large screen simultaneously, improving the interactive experience of the conference, reducing the conference waiting time, and reducing the risk of damage to the control device caused by the transfer of the control device. Additionally, through the control of permissions and the execution of control signaling according to priorities, conflicts generated when multiple control devices control simultaneously are avoided, further improving the interactive experience of the conference.

[0176] Figure 9 An example of the physical structure diagram of an electronic device is shown as Figure 9 As shown, the electronic device may include: a processor 910, a communications interface 920, a memory 930, and a communication bus 940. Among them, the processor 910, the communication interface 920, and the memory 930 communicate with each other through the communication bus 940. The processor 910 can call the logical instructions in the memory 930 to execute a control method, which includes: receiving control signaling; determining the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices; processing the control signaling based on the control authority of the control device corresponding to the control signaling;

[0177] Or the method includes: receiving the control signaling sent by the control device; forwarding the control signaling to the control management system so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0178] In addition, when the logical instructions in the above-mentioned memory 930 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0179] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the control methods provided by the above-mentioned various methods. The method includes: receiving a control signaling; determining the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices; and processing the control signaling based on the control authority of the control device corresponding to the control signaling.

[0180] Or the method includes: receiving the control signaling sent by a control device; forwarding the control signaling to a control management system so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0181] On another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the control methods provided by the above-mentioned various methods. The method includes: receiving a control signaling; determining the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices; and processing the control signaling based on the control authority of the control device corresponding to the control signaling.

[0182] Or the method includes: receiving the control signaling sent by a control device; forwarding the control signaling to a control management system so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling.

[0183] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0184] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0185] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features. And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A control method, characterized in that, it includes: Receiving a control signaling, which is generated by a control device; Based on the control authorities of a plurality of preset control devices, determining the control authority of the control device corresponding to the control signaling, so that the plurality of connected control devices operate the intelligent conference large screen based on their own authorities; Processing the control signaling based on the control authority of the control device corresponding to the control signaling; wherein, processing the control signaling includes: judging whether the control device sending the control signaling has the control authority required by the control signaling, if the control device currently does not have the control authority of the control signaling, then discard the control signaling; if the control device currently has the control authority of the control signaling, then parse the control signaling to obtain the specific operation on the intelligent conference large screen, and perform the corresponding operation on the intelligent conference large screen; The control authorities of the plurality of preset control devices are determined based on the following steps: Determining the priorities of the plurality of control devices; Based on the priorities of the plurality of control devices, determining the control authorities of the plurality of control devices; If the priority of the control device corresponding to the control signaling is the first priority, then execute the control signaling; Otherwise, judge whether the control signaling conforms to the control authority of the control device corresponding to the control signaling, if it conforms, then place the control signaling in the buffer area and execute the control signaling in the buffer area; executing the control signaling in the buffer area is executed in the order in which the signaling enters the buffer area; during the sequential execution, if a new control signaling belonging to the first priority is received, the execution of the control signaling in the buffer will be suspended until the first priority control signaling is executed, and then continue to sequentially execute the control signaling in the buffer.

2. The control method according to claim 1, characterized in that, The priority of the control device is determined based on at least one of the connection order, communication order and device code of the corresponding control device.

3. The control method according to any one of claims 1 to 2, the receiving the control signaling, includes: Receiving the control signaling forwarded by the communication interface, and the control signaling is sent by the corresponding control device to the communication interface.

4. A control method, characterized in that, it includes: Receiving a control signaling sent by a control device; Forwarding the control signaling to a control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the control authorities of a plurality of preset control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling; wherein, processing the control signaling includes: judging whether the control device sending the control signaling has the control authority required by the control signaling, if the control device currently does not have the control authority of the control signaling, then discard the control signaling; if the control device currently has the control authority of the control signaling, then parse the control signaling to obtain the specific operation on the intelligent conference large screen, and perform the corresponding operation on the intelligent conference large screen; The control management system determines the priorities of the plurality of control devices; Determine the control authority of the multiple control devices based on the priorities of the multiple control devices; if it is determined that the priority of the control device corresponding to the control signaling is the first priority, then control the intelligent conference large screen to execute the control signaling; Otherwise, the control management system determines whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, the control signaling is placed in the buffer area, and the control signaling in the buffer area is executed; controlling the intelligent conference large screen to execute the control signaling in the buffer area is executed in the order of the sequence in which the signaling enters the buffer area; during the sequential execution, if a new control signaling belonging to the first priority is received, the execution of the control signaling in the buffer will be paused until the control signaling of the first priority is executed, and then the control signaling in the buffer will continue to be executed sequentially.

5. The control method according to claim 4, characterized in that, when the control signaling is a voice signaling, the forwarding the control signaling to the control management system includes: Combining the voice signals sent by multiple control devices into one voice signal and forwarding it to the control management system; Or, based on the priorities of the multiple control devices, forwarding the voice signals sent by the multiple control devices to the control management system in the order from high to low of the priorities.

6. The control method according to claim 4, characterized in that, the forwarding the control signaling to the control management system includes: Constructing control data based on the device identifier of the control device corresponding to the control signaling, the timestamp of receiving the control signaling, and the control signaling, and placing the control data in the forwarding queue; Sending the control data to the control management system one by one based on the order of the timestamps of the control data in the forwarding queue.

7. The control method according to any one of claims 4 to 6, characterized in that, the forwarding the control signaling to the control management system further includes: If the control signaling conforms to the control authority of the control device corresponding to the control signaling, then forward the control signaling to the control management system.

8. A control management system, characterized in that, including: Receiving module: used to receive control signaling, and the control signaling is generated by a control device; Authority module: used to determine the control authority of the control device corresponding to the control signaling based on the preset control authorities of multiple control devices, so that the multiple connected control devices operate the intelligent conference large screen based on their own authorities; Processing module: used to process the control signaling based on the control authority of the control device corresponding to the control signaling; wherein, the processing the control signaling includes: determining whether the control device sending the control signaling has the control authority required by the control signaling. If the control device currently does not have the control authority of the control signaling, then discard the control signaling; if the control device currently has the control authority of the control signaling, then parse the control signaling to obtain the specific operation on the intelligent conference large screen, and perform the corresponding operation on the intelligent conference large screen; The preset control authorities of the multiple control devices are determined based on the following steps: Determine the priorities of the multiple control devices; Based on the priorities of the multiple control devices, determine the control authorities of the multiple control devices; If the priority of the control device corresponding to the control signaling is the first priority, execute the control signaling; Otherwise, determine whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, place the control signaling into the buffer area and execute the control signaling in the buffer area; the control signaling in the buffer area is executed in the order of their entry into the buffer area. During the sequential execution, if a new control signaling belonging to the first priority is received, the execution of the control signaling in the buffer will be suspended until the execution of the control signaling of the first priority is completed, and then the execution of the control signaling in the buffer will continue sequentially.

9. A communication interface, characterized in that, it includes: a receiving module for receiving control signaling sent by a control device; a forwarding module for forwarding the control signaling to a control management system, so that the control management system determines the control authority of the control device corresponding to the control signaling based on the pre-set control authorities of multiple control devices, and processes the control signaling based on the control authority of the control device corresponding to the control signaling; wherein, the processing of the control signaling includes: determining whether the control device sending the control signaling has the control authority required by the control signaling. If the control device currently does not have the control authority of the control signaling, the control signaling is discarded; if the control device currently has the control authority of the control signaling, the control signaling is parsed to obtain specific operations on the intelligent conference large screen, and corresponding operations are performed on the intelligent conference large screen; The control management system determines the priorities of the multiple control devices; Based on the priorities of the multiple control devices, determine the control authorities of the multiple control devices; if it is determined that the priority of the control device corresponding to the control signaling is the first priority, control the intelligent conference large screen to execute the control signaling; Otherwise, the control management system determines whether the control signaling conforms to the control authority of the control device corresponding to the control signaling. If it conforms, place the control signaling into the buffer area and execute the control signaling in the buffer area; controlling the intelligent conference large screen to execute the control signaling in the buffer area is executed in the order of their entry into the buffer area. During the sequential execution, if a new control signaling belonging to the first priority is received, the execution of the control signaling in the buffer will be suspended until the execution of the control signaling of the first priority is completed, and then the execution of the control signaling in the buffer will continue sequentially.

10. A collaborative control system, characterized in that, it includes: the control management system as claimed in claim 8, the communication interface as claimed in claim 9, and a control device communicatively connected to the communication interface.

11. An electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, when the processor executes the program, it implements the steps of the control method as claimed in any one of claims 1 to 7.

12. A non-transitory computer-readable storage medium, having a computer program stored thereon, wherein: when the computer program is executed by a processor, the steps of the control method according to any one of claims 1 to 7 are implemented.

Images