Conference equipment control method and device, electronic equipment and computer storage medium
By deploying conference equipment and wearable devices in large offline conference scenarios, intelligent interaction between conference equipment and participants is achieved, the problem of inefficiency in meetings in traditional conference forms is solved, and the efficiency of meeting information sharing and interaction is improved.
Patent Information
- Application Number
- CN202311467550.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-06
AI Technical Summary
In large-scale offline conference scenarios, traditional conference formats lead to inconvenient sharing of conference information and low meeting efficiency. Participants need to manually operate conference equipment, resulting in low interaction efficiency.
By deploying at least one conference device in the conference room and having each attendee wearable devices, a communication connection between the conference device and the wearable device is established. The participants obtain gesture operation data through the wearable device and control the conference device to perform target interaction operations.
The intelligent interaction between the participants through the wearable device and the meeting device is realized, and the meeting efficiency is improved, so that the participants can control them to perform specific operations without moving to the meeting device.
Smart Images
Figure CN119937772A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent conferencing, and more specifically, to a conference equipment control method, device, electronic equipment and computer storage medium in the field of intelligent conferencing. Background Art
[0002] At present, large-scale offline meetings have become an important way for people to communicate, cooperate and make decisions.
[0003] In traditional conference formats, participants use paper documents, slides, and whiteboards to communicate and make decisions during the meeting. For example, participants manually operate a projector to play slides (e.g., manually turn pages of slides) so that participants can explain the content of the meeting to other participants based on the slides.
[0004] When there are many participants and the meeting process is complicated, the use of traditional meeting formats will obviously lead to low meeting efficiency. Summary of the invention
[0005] The present application provides a conference equipment control method, device, electronic device and computer storage medium, which can improve the meeting efficiency in large offline conference scenarios.
[0006] In a first aspect, a conference device control method is provided. At least one conference device is deployed in an offline conference scene, and each participant wears a wearable device. The wearable device establishes a communication connection with the conference device. The method is executed by a target wearable device among the wearable devices. The target wearable device is a wearable device worn by a first participant. The method includes:
[0007] When the first conference participant has a conference interaction requirement during the conference, the gesture operation of the first conference participant is collected through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation;
[0008] Determining a first conference device to be controlled by the gesture operation from at least one of the conference devices;
[0009] Based on the gesture operation data, a device control instruction is sent to the first conference device, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
[0010] In the above technical scheme, in a large conference scenario, the embodiment of the present application provides an intelligent conference interaction method: by deploying at least one conference device in the conference room, and each participant wears a wearable device, and establishes a communication connection between the wearable device and the conference device; when the participant has a conference interaction demand, the gesture operation data can be obtained through the wearable device worn by the participant, and the first conference device can be controlled to perform the target interaction operation based on the gesture operation data. In order to achieve the purpose of intelligent interaction between the participant and the conference device through the wearable device; compared with the manual operation of the conference device in the related technology, the intelligent control of the conference device through the wearable device can enable the participant to control the conference device to perform specific operations through gesture operation at the current position without moving to the conference device for operation, which can effectively improve the efficiency of the meeting for large conference scenarios.
[0011] In a second aspect, a conference device control device is provided. At least one conference device is deployed in an offline conference scene, and each participant wears a wearable device. The wearable device establishes a communication connection with the conference device. The device is configured in a target wearable device among the wearable devices. The target wearable device is a wearable device worn by a first participant. The device includes:
[0012] A gesture collection module, used for collecting gesture operations of the first participant through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operations when the first participant has a conference interaction requirement during the conference;
[0013] A device determination module, used to determine a first conference device to be controlled by the gesture operation from at least one of the conference devices;
[0014] The instruction sending module is used to send a device control instruction to the first conference device based on the gesture operation data, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
[0015] In a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store executable program codes, and the processor is used to call and run the executable program codes from the memory, so that the electronic device executes the conference device control method described in the above aspect.
[0016] In a fourth aspect, a computer program product is provided, which includes: a computer program code, when the computer program code is run on a computer, the computer executes the conference device control method described in the above aspect.
[0017] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 It is a schematic diagram of the system architecture of an intelligent conference system provided in an embodiment of the present application;
[0019] Figure 2 is a schematic flow chart of a conference device control method provided in an embodiment of the present application;
[0020] Figure 3 is a schematic flow chart of another conference device control method provided in an embodiment of the present application;
[0021] Figure 4 is a schematic flow chart of another conference device control method provided in an embodiment of the present application;
[0022] Figure 5 is a schematic flow chart of another conference device control method provided in an embodiment of the present application;
[0023] Figure 6 It is a structural schematic diagram of a conference equipment control device provided in an embodiment of the present application;
[0024] Figure 7 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0026] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0027] In traditional large-scale offline conference scenarios, paper documents are distributed to each participant so that each participant can understand the meeting content and process; participants manually operate the projector to play slides (for example, manually turn the pages of the slides) so that participants can explain the meeting content to other participants based on the slides; when participants need to make meeting decisions with other participants, they can write the decision content on the whiteboard and summarize the decision results. In other words, in traditional meeting formats, participants use paper documents, slides or whiteboards to communicate and make decisions during the meeting.
[0028] However, in the case of a large number of participants and a complex meeting process, the traditional meeting format of distributing paper documents and manually operating the projector or whiteboard will obviously lead to problems such as inconvenient information sharing and low meeting efficiency. Moreover, if the projector and whiteboard need to be operated, the participants need to move from the meeting location to the location of the projector or whiteboard. When there are many participants and the meeting process is complex, the interaction efficiency between the participants will obviously be reduced, further reducing the meeting efficiency.
[0029] In order to solve the problem of low meeting efficiency caused by traditional meeting formats, the embodiment of the present application proposes an intelligent conference system, which can improve the meeting efficiency of large-scale meetings through intelligent interaction between conference equipment and wearable devices. Figure 1 is a schematic diagram of the system architecture of an intelligent conference system provided in an embodiment of the present application, such as Figure 1 As shown, the smart conference system includes at least one conference device 110 and at least one wearable device 120 .
[0030] The conference device 110 is a device deployed in a conference room and used to display conference content. Exemplarily, the conference device 110 may be a smart projector, a smart speaker, an electronic whiteboard, a smart display screen, etc. Optionally, the conference device 110 may have intelligent functions such as voice recognition, image recognition, and data processing.
[0031] The wearable device 120 is a smart device worn by the participants. For example, the wearable device 120 may be a smart watch, smart glasses, etc. Optionally, the wearable device 120 has a variety of sensors and computing capabilities, and can sense the physiological state, location information, etc. of the participants.
[0032] In a conference scenario, the wearable device 120 may establish a communication connection with the conference device 110, so that the participants can intelligently interact with the conference device 110 through the wearable device 120. Exemplarily, the communication connection may be a wireless network connection or a Bluetooth connection.
[0033] Optionally, the participants can interact with the conference device 110 in various ways, such as voice, gesture, trigger, etc., through the wearable device 120. For example, the participants can use voice commands to control the smart projector to play specific conference materials; or the conference device 110 can transmit information such as conference materials and agenda arrangements to the wearable devices 120 of each participant in real time to realize the sharing and transmission of conference information.
[0034] Optionally, the intelligent conference system may also be configured with a main control device (not shown in the figure), through which specific participants can be selectively arranged to intelligently interact with the conference device 110 through the wearable device 120.
[0035] Optionally, the intelligent conference system may also be configured with a cloud platform (not shown in the figure) to store conference data, and process and analyze the conference data through the cloud platform.
[0036] Figure 2 is a schematic flow chart of a conference device control method provided in an embodiment of the present application. It should be understood that the method can be applied to Figure 1 A wearable device 120 is shown.
[0037] For example, Figure 2 As shown, the method 200 includes:
[0038] Step 201, when the first participant has a conference interaction requirement during the conference, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation.
[0039] In the conference scene provided in the embodiment of the present application, at least one conference device and at least one wearable device are deployed, wherein the wearable device is worn by the participant (or participant). Exemplarily, the conference device may be conference room equipment such as a smart projector, an electronic whiteboard, a smart speaker, a smart display, etc., and may also be referred to as a smart conference device, which may have intelligent functions such as voice recognition, image recognition, and data processing. The wearable device may be a smart watch, smart eyes, AR glasses, etc., which has a variety of sensors and computing capabilities, and can sense the location information, physiological state data, etc. of the participant. Optionally, in an offline conference scene, each participant wears a wearable device, and each wearable device establishes a communication connection with at least one conference device, respectively. Exemplarily, the wearable device may establish a Bluetooth connection with the conference device.
[0040] In large offline conference scenarios, due to the large number of participants and conference materials, the communication process between participants is relatively complicated, and traditional conference equipment and operation procedures can no longer meet the needs, resulting in poor meeting efficiency. In order to improve the efficiency of large-scale conferences, this application proposes an intelligent conference system that combines conference equipment with wearable devices worn by participants. At least one conference device is deployed in the conference room, and each participant wears a wearable device, and a communication connection is established between the wearable device and the conference device to achieve intelligent interaction between the conference device and the wearable device worn by the participant, so that each participant can conveniently interact, share information and process data with the conference device through the wearable device, so as to further improve the efficiency of large-scale conferences.
[0041] Based on the intelligent conference system proposed in this application, when the participants have conference interaction needs, such as the need to share part of the conference content, or the need to explain the conference content to other participants, they do not need to move to the conference equipment for manual operation; instead, they can directly control the conference equipment to perform conference content sharing operations through the wearable device they wear. Correspondingly, in a possible implementation, during the meeting, the first participant wears a target wearable device. During the meeting, when the first participant has conference interaction needs, the gesture operation of the first participant can be collected through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation. This allows the first participant to control the conference equipment to perform specific operations through gesture operations at the current position without having to move to the conference equipment to perform operations. For large-scale conference scenarios, the meeting efficiency can be effectively improved.
[0042] Optionally, the target wearable device is configured with a target sensor that can collect gesture operation data, and the target sensor may be a camera, an IMU sensor, etc.
[0043] The conference interaction requirements are the interaction requirements between the participants and the conference equipment during the conference. For example, they may be the requirements for sharing conference content, speaking at a conference, voting at a conference, editing conference content, operating conference content, etc. This embodiment does not limit the specific content of the conference interaction requirements.
[0044] Optionally, in addition to the gesture operation data corresponding to the gesture operation, the target wearable device may also collect voice data, touch screen operation data, etc. of the first participant.
[0045] Step 202: Determine, from at least one conference device, a first conference device to be controlled by the gesture operation.
[0046] Since there may be multiple conference devices deployed in a large conference room, for example, an electronic whiteboard, a smart projector, and a smart display screen are deployed in the conference room at the same time. The wearable device corresponding to the participant can be connected to multiple conference devices at the same time, and different conference devices can be used to display different conference content. Therefore, in the process of intelligent interaction between the wearable device and the conference device, it is necessary to determine the specific conference device that the wearable device needs to interact with. In a possible implementation, after the target wearable device obtains the gesture operation data required to interact with the first participant, it first determines the first conference device that the gesture operation indication needs to control from at least one conference device, and then transmits the gesture operation data to the first conference device.
[0047] Optionally, when determining the first conference device, the target wearable device may select the corresponding first conference device according to the content type of the gesture operation data.
[0048] Optionally, the first conference device can also be determined by the device selection operation of the first participant. After the target wearable device obtains the gesture operation data, a device selection prompt can be displayed, which includes device options of multiple conference devices, and then the first conference device is determined based on the received trigger operation of the device option.
[0049] Step 203: Send a device control instruction to the first conference device based on the gesture operation data, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
[0050] After the target wearable device obtains the gesture operation data and determines the first conference device that executes the gesture operation data, if the first conference device and the target wearable device have established a communication connection, the target wearable device can send a device control instruction to the first conference device based on the gesture operation data, and the corresponding first conference device receives the device control instruction and executes the target interaction operation indicated by the gesture operation based on the device control instruction, so as to achieve the purpose of the target wearable device controlling the first conference device to execute the target interaction operation based on the gesture operation data.
[0051] Optionally, if the first conference device has not established a communication connection with the target wearable device, the target wearable device first establishes a communication connection with the first conference device, and then performs a subsequent step of sending a device control instruction to the first conference device based on the gesture operation data.
[0052] The present application provides a method for intelligent conference interaction: by deploying at least one conference device in the conference room, and each participant wears a wearable device, and establishes a communication connection between the wearable device and the conference device; when the participant has a conference interaction requirement, the gesture operation data can be obtained through the wearable device worn by the participant, and the first conference device can be controlled to perform the target interaction operation based on the gesture operation data. In order to achieve the purpose of intelligent interaction between the participant and the conference device through the wearable device; compared with the manual operation of the conference device in the related art, the intelligent control of the conference device through the wearable device can enable the participant to control the conference device to perform specific operations through gesture operation at the current position without moving to the conference device for operation, which can effectively improve the efficiency of the meeting for large conference scenes.
[0053] In a large conference scenario, there are many participants and correspondingly a large number of wearable devices. In order to avoid conflicts in data transmission between multiple wearable devices, in a possible implementation, a master control device is also deployed in the smart conference system to control the interaction sequence of each wearable device.
[0054] Figure 3 is a schematic flow chart of another conference device control method provided in an embodiment of the present application. It should be understood that this method can be applied to Figure 1 A wearable device 120 is shown.
[0055] For example, Figure 3 As shown, the method 300 includes:
[0056] Step 301: When the target wearable device receives the gesture operation collection instruction sent by the main control device, it is determined that the first participant has a conference interaction requirement, and the target sensor in the target wearable device is activated.
[0057] Among them, a master control device is also deployed in the offline meeting scene, and the master control device is used to control the order in which each wearable device collects gesture operations. Optionally, the master control device can be held by the meeting host to control the offline meeting process, such as the order in which each participant speaks at the meeting, the order in which the meeting content is shared, etc.
[0058] When the conference host determines that a certain participant has the need for conference interaction, for example, when the conference host determines that it is the turn of the first participant to share the conference, the device identifier of the target wearable device worn by the first participant can be selected on the master device, and the corresponding master device receives the device selection operation for the target wearable device, and can send a gesture operation collection instruction to the target wearable device. After the target wearable device receives the gesture operation instruction sent by the master device, it is determined that the first participant has the need for conference interaction during the meeting, and then the gesture operation data of the first participant can be obtained through the target wearable device carried by the first participant.
[0059] In order to avoid the wearable device collecting interactive data in real time and waste power consumption of the wearable device by collecting more invalid data, when the target wearable device receives the gesture operation instruction sent by the main control device, the target sensor in the target wearable device is started based on the gesture operation instruction to collect gesture operation data corresponding to the gesture operation of the first participant through the target sensor.
[0060] Step 302: When the first participant has a conference interaction requirement during the conference, at least one gesture collection function is displayed, and different gesture collection functions require different gesture operation data to be collected by the target wearable device.
[0061] Different gesture operation data may be required to be acquired under different conference interaction requirements. For example, sometimes the complete operation trajectory needs to be acquired, and sometimes only the operation direction needs to be acquired. In order to meet the conference interaction requirements in different scenarios, in a possible implementation, when the first participant has a conference interaction requirement during the conference, at least one gesture collection function can be displayed. The gesture operation data required to be collected by the target wearable device under different gesture collection functions are different, and the first participant can select the gesture collection function that needs to be executed currently.
[0062] Step 303: based on the triggering operation of the target gesture collection function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the gesture operation data required to be collected under the target gesture collection function.
[0063] The first participant can select a target gesture collection function in at least one gesture collection function, and the corresponding target wearable device can collect the gesture operation of the first participant through the target sensor based on the trigger operation of the target gesture operation function to obtain the gesture operation data required under the target gesture collection function.
[0064] Optionally, the at least one gesture collection function may include a gesture editing function, a gesture control function, and a gesture decision function. Correspondingly, in an exemplary example, step 303 may also include at least one of step 303A, step 303B, and step 303C.
[0065] Step 303A, when the target gesture collection function is a gesture editing function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain a target operation trajectory indicated by the gesture operation.
[0066] When the target gesture collection function is a gesture editing function, it means that the first participant wants to edit the conference content on the conference device, and the target wearable device needs to sense the gesture operation trajectory of the first participant. The gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the target operation trajectory indicated by the gesture operation, which is used to subsequently control the conference device to edit the conference content according to the target operation trajectory.
[0067] Step 303B, when the target gesture collection function is a gesture control function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the target operation direction indicated by the gesture operation.
[0068] When the target gesture operation function is a gesture control function, it means that the first participant wants to control the conference device to turn pages or perform other control operations on the conference content. Then the target wearable device does not need to fully perceive the gesture operation trajectory of the first participant, but only needs to perceive the gesture operation direction of the first participant to determine the page turning direction. Correspondingly, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the target operation direction indicated by the gesture operation, which is used to control the conference content according to the operation direction later.
[0069] Step 303C, when the target gesture collection function is a gesture decision function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain a target operation image indicated by the gesture operation.
[0070] When the target gesture operation function is a gesture decision function, it indicates that the first participant wants to participate in the decision-making of the meeting content. Then the target wearable device does not need to fully perceive the gesture operation trajectory of the first participant, but only needs to perceive whether the gesture of the first participant is an approval gesture or a disapproval gesture, etc. The gesture operation of the first participant is correspondingly collected through the target sensor in the target wearable device to obtain a target operation image indicated by the gesture operation, which is used to subsequently determine the indicated decision result according to the target operation image.
[0071] Optionally, different target wearable devices have different ways of collecting gesture data. For example, if the target wearable device is a smart watch, since smart watches are generally worn on the user's hand, the gesture operation data can be directly collected through the speed sensor on the target wearable device; if the target wearable device is smart glasses, the gesture operation data can be collected through the image sensor on the smart glasses.
[0072] Step 304: When the target wearable device establishes a communication connection with at least two conference devices, a device selection prompt is displayed, where the device selection prompt is used to prompt the selection of the conference device to be controlled by the gesture operation.
[0073] In the case where the target wearable device has established a communication connection with multiple conference devices, in order to avoid target interactive data transmission errors, in one possible implementation, the target wearable device can display a device selection prompt based on the device identifiers of the multiple conference devices, and the device selection prompt includes identification options of the multiple device identifiers so that the first participant can select the first conference device to be controlled by the gesture operation.
[0074] Step 305: Based on the triggering operation of the device selection prompt, determine the first conference device that needs to be controlled by the gesture operation from at least one conference device.
[0075] If the first participant needs to transmit the target interactive data to the first conference device, he can click the identification option corresponding to the first conference device in the device selection prompt. The corresponding target wearable device receives the trigger operation of the device selection prompt, and determines the first conference device to be controlled as indicated by the gesture operation based on the identification option indicated by the trigger operation.
[0076] Step 306: Send a device control instruction to the first conference device based on the gesture operation data, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
[0077] Corresponding to the fact that the target gesture collection function can be a gesture editing function, a gesture control function, or a gesture decision function, the target interaction operation performed by the first conference device is also different. Correspondingly, in an exemplary example, step 306 may also include at least one of step 306A, step 306B, and step 306C.
[0078] Step 306A, when the target gesture collection function is a gesture editing function, based on the target operation trajectory, a device control instruction including the target operation trajectory is sent to the first conference device, so that the first conference device displays the edited conference content corresponding to the target operation trajectory.
[0079] When the target gesture collection function is a gesture editing function, the target wearable device collects the target operation trajectory corresponding to the gesture operation. In order to control the first conference device to perform the target interaction operation indicated by the gesture operation, the target wearable device can send a device control instruction containing the target operation trajectory to the first conference device based on the target operation trajectory. The corresponding first conference device receives the target operation trajectory corresponding to the gesture operation, and then displays the corresponding edited conference content based on the target operation trajectory.
[0080] For example, if the first participant wants to demonstrate the meeting content on the electronic whiteboard, the first participant does not need to go near the electronic whiteboard. The target wearable device can collect the target operation trajectory of the first participant's corresponding gesture operation and send the target operation trajectory to the electronic whiteboard. The electronic whiteboard can display the edited meeting content corresponding to the target operation trajectory.
[0081] Step 306B, when the target gesture collection function is a gesture control function, the content control direction is determined based on the target operation direction, and a device control instruction corresponding to the content control direction is sent to the first conference device, so that the first conference device performs a page turning operation on the currently displayed conference content based on the content control direction.
[0082] When the target gesture collection function is a gesture control function, the target wearable device collects the target operation direction corresponding to the gesture operation. In order to control the first conference device to perform the target interaction operation indicated by the gesture operation, the target wearable device can determine the content control direction of the conference content based on the target operation direction, and send a device control instruction corresponding to the content control direction to the first conference device. The corresponding first conference device receives the content control direction corresponding to the gesture operation, and then performs a page turning operation on the currently displayed conference content based on the content control direction.
[0083] For example, if the first participant needs to control the conference content displayed on the projector to turn the page to the left, the corresponding first participant can execute a left page turning gesture, the corresponding target wearable device collects the gesture direction corresponding to the page turning gesture as left, and determines to turn the page to the left based on the gesture direction, and sends the left page turning operation to the projector, so that the projector turns the currently displayed conference content to the left.
[0084] Step 306C, when the target gesture collection function is a gesture decision function, determine the content voting result of the first participant based on the target operation image, and send a device control instruction containing the content voting result to the first conference device, so that the first conference device displays the conference content decision result based on the content voting result.
[0085] When the target gesture collection function is a gesture decision-making function, the target wearable device collects the target operation image corresponding to the gesture operation. In order to control the first conference device to perform the target interaction operation indicated by the gesture operation, the target wearable device can determine the content voting result of the first participant on the conference content based on the target operation image, and send a device control instruction corresponding to the content voting result to the first conference device. The corresponding first conference device receives the content voting result corresponding to the gesture operation, and then displays the conference content decision result based on the content voting result.
[0086] Exemplarily, if the first participant needs to make a voting decision, he or she can perform a voting gesture (an approval gesture, a disapproval gesture, or a no-voting gesture), and the corresponding target wearable device collects the target operation image corresponding to the voting gesture, and determines the content voting result indicated by the target operation image based on the pre-stored voting result characteristics, and sends the content voting result to the conference device, so that the conference device displays the content decision result based on the content voting result.
[0087] Optionally, the first conference device can also perform other intelligent interaction operations with the conference device through the target wearable device. For example, taking the intelligent interaction data as voice interaction, and the first conference device as a smart speaker, the target wearable device transmits the target voice data to the target smart speaker to control the target smart speaker to play the target voice data, thereby realizing targeted conference speech data collection and playback.
[0088] Taking the target interaction data as the target voice data and the first conference device being a smart projector as an example, the target wearable device transmits the target voice data to the smart projector to control the smart projector to perform the target operation indicated by the target voice data. For example, if the target voice data is "display document A", the smart projector opens and displays document A.
[0089] In this embodiment, in view of the different gesture operation data of gesture operations that need to be collected in several scenarios, multiple gesture collection functions are provided to collect different gesture operation data. Different gesture collection functions are set for different scenes to intelligently adapt to different conference interaction scenes. Moreover, the gesture editing function corresponds to the need to collect the complete operation trajectory, the gesture control function corresponds to the need to collect the operation direction, and the gesture decision function corresponds to the need to collect the image corresponding to the gesture operation. When it is necessary to edit the meeting content on the whiteboard and control the page turning, there is no need to go to the whiteboard. You can directly draw the trajectory with gestures and display it on the whiteboard to improve the efficiency of the meeting. When multiple people make decisions, the decision result can be directly determined by the collected image to avoid the inaccuracy of manual statistics. In addition, the target wearable device determines the process of the first conference device to be controlled by the gesture operation through the device selection prompt. When the target wearable device is connected to multiple conference devices, the conference device currently required to be controlled can be accurately controlled.
[0090] In addition to being able to control conference equipment through wearable devices to perform interactive operations, in large-scale conference scenarios, conference equipment can also be used to share meeting information, meeting content, etc. with each participant in real time.
[0091] Figure 4 is a schematic flow chart of another conference device control method provided in an embodiment of the present application. It should be understood that this method can be applied to Figure 1 A wearable device 120 is shown.
[0092] For example, Figure 4 As shown, the method 400 includes:
[0093] Step 401: Receive target conference information sent by a second conference device, where the target conference information at least includes the object identifier of each participant participating in the conference and the device identifier of a wearable device worn by each participant.
[0094] Step 402: Display the object identification of each participant and the device identification of the wearable device worn by each participant on the target wearable device.
[0095] Since each participant in the meeting wears a wearable device, and the wearable device has established a communication connection with the second conference device, that is, the second conference device can obtain the object identification of each participant and the device identification of the wearable device worn by the participant; in order to facilitate the subsequent information exchange between different participants, in a possible implementation, after the target wearable device establishes a communication connection with the second conference device, the second conference device can send the target conference information to the target wearable device, and the corresponding target wearable device receives the target conference information sent by the second conference device. The target conference information includes at least the object identification of each participant in the meeting and the device identification of the wearable device worn by each participant.
[0096] Optionally, the first conference device and the second conference device may be the same conference device or different conference devices. Optionally, the second conference device may be a master control conference device, and the second conference device establishes a communication connection with wearable devices corresponding to all conference participants.
[0097] Optionally, the first participant can view the various participants in the meeting and the wearable devices worn by each participant through the target wearable device he / she wears; if it is necessary to share meeting content such as meeting materials with a certain participant, the meeting content can be shared with specific other participants through the conference device by selecting the wearable device corresponding to each participant.
[0098] Optionally, the second conference device can also transmit information such as conference materials and agenda arrangements to the wearable devices of each participant in real time to achieve sharing and transmission of conference information.
[0099] Step 403, when the first conference participant has a conference content sharing requirement, determine the conference content to be shared and the target device identifier corresponding to at least one second conference participant to be shared.
[0100] When the first participant has the need to share conference content, since the target wearable device of the first participant has not established a direct communication connection with the wearable devices of other participants, the first participant can indirectly share the required shared conference content with other participants through the second conference device. In a possible implementation, when the first participant has the need to share conference content, the first participant can select the required shared conference content and at least one second participant to be shared from the target wearable device; the corresponding target wearable device can determine the required shared conference content and the target device identifier corresponding to the at least one second participant to be shared, and then share the conference content with the second participant.
[0101] Step 404: Generate a conference content sharing request based on the shared conference content and the target device identifier.
[0102] Since the target wearable device has established a communication connection with the second conference device, and the second conference device has established a communication connection with the wearable devices worn by other conference participants, the corresponding target wearable device can indirectly share the conference content with other conference participants through the second conference device. In a corresponding possible implementation, the target wearable device generates a conference content sharing request based on the shared conference content and the target device identifier, and the conference content sharing request includes the shared conference content to be shared, and the target device identifier of the wearable device worn by each second conference participant to be shared.
[0103] Step 405: Send a conference content sharing request to the second conference device, so that the second conference device sends the shared conference content to the wearable devices worn by each second conference participant based on the conference content sharing request.
[0104] The target wearable device sends a conference content sharing request to the second conference device, and the corresponding second conference device receives the conference content sharing request, so that based on the conference content sharing request, the shared conference content can be sent to the wearable devices of each second participant, thereby achieving the purpose of the participant sharing the conference content with other specific participants.
[0105] In this embodiment, the target conference information is sent to the wearable device of each participant through the conference device to achieve real-time sharing and transmission of information; in addition, when the first participant needs to share the meeting content with other participants, it can also be shared with the wearable devices of other participants through the conference device, further improving the convenience of sharing meeting content between the participants.
[0106] The above embodiment describes the conference device control method with the wearable device as the execution subject, in which the conference device control method mainly involves the intelligent interaction process between the wearable device and the conference device. This embodiment further describes the intelligent interaction process between the wearable device and the conference device during the conference device control process.
[0107] Figure 5 is a schematic flow chart of another conference device control method provided in an embodiment of the present application. It should be understood that this method can be applied to Figure 1 The intelligent conference system shown.
[0108] For example, Figure 5 As shown, the method 500 includes:
[0109] Step 501: During a meeting, when a first participant has a need for meeting interaction, the target wearable device obtains gesture operation data of the first participant.
[0110] Step 502: The target wearable device determines the target conference device to be controlled as indicated by the gesture operation data.
[0111] Step 503: Based on the gesture operation data, the target wearable device sends a device control instruction to the target conference device.
[0112] The implementation of steps 501 to 503 may refer to the implementation process of the conference device control method with the wearable device as the execution subject in the above embodiment, and this embodiment will not be described in detail here.
[0113] Step 504: The target conference device receives the device control instruction sent by the target wearable device.
[0114] After the target wearable device sends the device control instruction to the target conference device, the target conference device can correspondingly receive the device control instruction sent by the target wearable device.
[0115] Step 505: The target conference device executes the target interactive operation based on the device control instruction.
[0116] After the target conference device receives the device control instruction, it can perform the corresponding interactive operation according to the device control instruction, so as to achieve the purpose of controlling the target conference device to perform the target interactive operation through the target wearable device.
[0117] Taking a large conference as an example, smart conference equipment such as smart projectors, smart speakers and electronic whiteboards are deployed in the conference room. These smart conference equipment has intelligent functions such as voice recognition, image recognition and data processing. Participants wear wearable devices such as smart watches or smart glasses. These wearable devices have sensors and computing capabilities, and can sense the physiological state and location information of participants. For example, smart watches can monitor the heart rate and body temperature of participants, and smart glasses can obtain the location information of participants. Optionally, smart conference equipment and wearable devices are intelligently connected through technologies such as wireless networks or Bluetooth. Participants can interact and share information with smart conference room equipment through wearable devices. For example, participants can tell the smart projector to present a specific material through voice commands, or mark on the electronic whiteboard through gestures. Alternatively, smart conference equipment can transmit meeting materials, agenda arrangements and other information to the smart watches of participants in real time, and participants can view and edit these meeting information at any time.
[0118] Optionally, considering the limited data processing capabilities of conference equipment or wearable devices, a data processing and analysis platform (cloud platform) can be established in the cloud, which can store conference materials and can also be used to process and analyze conference data. For example, by analyzing the interaction data and physiological data of participants, the participation level and emotional state of participants can be evaluated.
[0119] In this embodiment, in a large conference scenario, the present application provides a method for intelligent conference interaction: by deploying at least one conference device in the conference room, and each participant wears a wearable device, and establishes a communication connection between the wearable device and the conference device; when the participant has a conference interaction requirement, the gesture operation data can be obtained through the wearable device worn by the participant, and the first conference device can be controlled to perform the target interaction operation based on the gesture operation data. In order to achieve the purpose of intelligent interaction between the participant and the conference device through the wearable device; compared with the manual operation of the conference device in the related art, the intelligent control of the conference device through the wearable device can enable the participant to control the conference device to perform specific operations through gesture operation at the current position without moving to the conference device for operation, which can effectively improve the efficiency of the meeting for large conference scenarios.
[0120] Figure 6 This is a structural schematic diagram of a conference equipment control device provided in an embodiment of the present application. At least one conference equipment is deployed in an offline conference scene, and each participant wears a wearable device. The wearable device establishes a communication connection with the conference equipment. The device is configured in a target wearable device among the wearable devices. The target wearable device is the wearable device worn by the first participant.
[0121] For example, Figure 6 As shown, the device 600 includes:
[0122] The gesture collection module 601 is used to collect the gesture operation of the first participant through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation when the first participant has a conference interaction requirement during the conference;
[0123] A device determination module 602, configured to determine a first conference device to be controlled by the gesture operation from at least one of the conference devices;
[0124] The instruction sending module 603 is used to send a device control instruction to the first conference device based on the gesture operation data, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
[0125] In a possible implementation, the gesture acquisition module 601 is also used to: display at least one gesture acquisition function when the first participant has the conference interaction requirements during the meeting, and the gesture operation data required to be collected by the target wearable device under different gesture acquisition functions are different; based on the triggering operation of the target gesture acquisition function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the gesture operation data required to be collected under the target gesture acquisition function.
[0126] In a possible implementation, the gesture acquisition module 601 is further used for: when the target gesture acquisition function is a gesture editing function, collecting the gesture operation of the first participant through the target sensor in the target wearable device to obtain the target operation trajectory indicated by the gesture operation; when the target gesture acquisition function is a gesture control function, collecting the gesture operation of the first participant through the target sensor in the target wearable device to obtain the target operation direction indicated by the gesture operation; when the target gesture acquisition function is a gesture decision function, collecting the gesture operation of the first participant through the target sensor in the target wearable device to obtain the target operation image indicated by the gesture operation.
[0127] In one possible implementation, the instruction sending module 603 is also used to: when the target gesture acquisition function is the gesture editing function, based on the target operation trajectory, send the device control instruction containing the target operation trajectory to the first conference device, so that the first conference device displays the edited conference content corresponding to the target operation trajectory; when the target gesture acquisition function is the gesture control function, determine the content control direction based on the target operation direction, and send the device control instruction corresponding to the content control direction to the first conference device, so that the first conference device performs a page turning operation on the currently displayed conference content based on the content control direction; when the target gesture acquisition function is the gesture decision function, determine the content voting result of the first participant based on the target operation image, and send the device control instruction containing the content voting result to the first conference device, so that the first conference device displays the conference content decision result based on the content voting result.
[0128] In one possible implementation, a main control device is also deployed in the offline meeting scene, and the main control device is used to control the order in which each of the wearable devices collects gesture operations; the device also includes: a first determination module, which is used to determine whether the first participant has the meeting interaction requirements and start the target sensor in the target wearable device when the target wearable device receives the gesture operation collection instruction sent by the main control device.
[0129] In one possible implementation, the device also includes: an information receiving module, used to receive target conference information sent by a second conference device, the target conference information at least including the object identification of each of the participants participating in the meeting, and the device identification of the wearable device worn by each of the participants; a display module, used to display the object identification of each of the participants, and the device identification of the wearable device worn by each of the participants on the target wearable device.
[0130] In one possible implementation, the device also includes: a second determination module, used to determine the shared conference content to be shared and the target device identifier corresponding to at least one second conference participant to be shared when the first conference participant has a conference content sharing requirement; a generation module, used to generate a conference content sharing request based on the shared conference content and the target device identifier; and a request sending module, used to send the conference content sharing request to the second conference device, so that the second conference device sends the shared conference content to the wearable devices worn by each of the second conference participants based on the conference content sharing request.
[0131] In one possible implementation, the device determination module is further used to: display a device selection prompt when the target wearable device establishes a communication connection with at least two conference devices, and the device selection prompt is used to prompt the selection of the conference device required to be controlled by the gesture operation; based on the triggering operation of the device selection prompt, determine the first conference device required to be controlled by the gesture operation from at least one of the conference devices.
[0132] Figure 7 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.
[0133] For example, Figure 7 As shown, the electronic device 700 includes: a memory 701 and a processor 702, wherein the memory 701 stores an executable program code 703, and the processor 702 is used to call and execute the executable program code 703 to perform a conference device control method.
[0134] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores an executable program code, and the processor is used to call and execute the executable program code to execute a conference equipment control method provided by an embodiment of the present application.
[0135] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0136] In the case of dividing each functional module according to each function, the device may also include an acquisition module, an identification module, a control module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here.
[0137] It should be understood that the device provided in this embodiment is used to execute the above-mentioned conference equipment control method, and thus can achieve the same effect as the above-mentioned implementation method.
[0138] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is applied to an electronic device, the processing module may be used to control and manage the electronic device. The storage module may be used to support the electronic device to execute mutual program codes, etc.
[0139] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.
[0140] In addition, the device provided in the embodiments of the present application may specifically be a chip, component or module, and the chip may include a connected processor and memory; wherein the memory is used to store instructions, and when the processor calls and executes the instructions, the chip can execute a conference equipment control method provided in the above embodiments.
[0141] This embodiment also provides a computer-readable storage medium, in which a computer program code is stored. When the computer program code is executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement a conference device control method provided in the above embodiment.
[0142] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement a conference device control method provided by the above embodiment.
[0143] Among them, the device, computer-readable storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0144] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0145] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0146] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A conference equipment control method, characterized in that: At least one conference device is deployed in an offline conference scene, and each participant wears a wearable device, the wearable device establishes a communication connection with the conference device, the method is executed by a target wearable device among the wearable devices, the target wearable device is a wearable device worn by a first participant, and the method includes: When the first conference participant has a conference interaction requirement during the conference, the gesture operation of the first conference participant is collected through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation; Determining a first conference device to be controlled by the gesture operation from at least one of the conference devices; Based on the gesture operation data, a device control instruction is sent to the first conference device, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
2. The method according to claim 1, characterized in that In the case where the first participant has a conference interaction requirement during the conference, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operation, including: During the conference, if the first participant meets the conference interaction requirement, at least one gesture collection function is displayed, and the gesture operation data to be collected by the target wearable device under different gesture collection functions are different; Based on the triggering operation of the target gesture collection function, the gesture operation of the first participant is collected through the target sensor in the target wearable device to obtain the gesture operation data required to be collected under the target gesture collection function.
3. The method according to claim 2, characterized in that The triggering operation of the target gesture collection function is based on collecting the gesture operation of the first participant through the target sensor in the target wearable device to obtain the gesture operation data required to be collected under the target gesture collection function, including: In a case where the target gesture collection function is a gesture editing function, the gesture operation of the first participant is collected by the target sensor in the target wearable device to obtain a target operation trajectory indicated by the gesture operation; In the case where the target gesture collection function is a gesture control function, the gesture operation of the first participant is collected by the target sensor in the target wearable device to obtain a target operation direction indicated by the gesture operation; In the case where the target gesture collection function is a gesture decision function, the gesture operation of the first participant is collected by the target sensor in the target wearable device to obtain a target operation image indicated by the gesture operation.
4. The method according to claim 3, characterized in that The sending of a device control instruction to the first conference device based on the gesture operation data includes at least one of the following: In the case where the target gesture collection function is the gesture editing function, based on the target operation trajectory, sending the device control instruction containing the target operation trajectory to the first conference device, so that the first conference device displays the edited conference content corresponding to the target operation trajectory; In the case where the target gesture acquisition function is the gesture control function, determining a content control direction based on the target operation direction, and sending the device control instruction corresponding to the content control direction to the first conference device, so that the first conference device performs a page turning operation on the currently displayed conference content based on the content control direction; In the case where the target gesture acquisition function is the gesture decision-making function, the content voting result of the first participant is determined based on the target operation image, and the device control instruction containing the content voting result is sent to the first conference device, so that the first conference device displays the conference content decision result based on the content voting result.
5. The method according to any one of claims 1 to 4, characterized in that: A main control device is also deployed in the offline conference scene, and the main control device is used to control the collection order of gesture operations by each of the wearable devices; The method further comprises: When the target wearable device receives the gesture operation collection instruction sent by the main control device, it is determined that the first conference participant has the conference interaction requirement, and the target sensor in the target wearable device is started.
6. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Receive target conference information sent by the second conference device, where the target conference information at least includes an object identifier of each of the conference participants and a device identifier of the wearable device worn by each of the conference participants; The object identification of each of the conference participants and the device identification of the wearable device worn by each of the conference participants are displayed on the target wearable device.
7. The method according to claim 6, characterized in that The method further comprises: In the case where the first conference participant has a conference content sharing requirement, determining the conference content to be shared and a target device identifier corresponding to at least one second conference participant to be shared; Based on the shared conference content and the target device identifier, generating a conference content sharing request; The conference content sharing request is sent to the second conference device, so that the second conference device sends the shared conference content to the wearable device worn by each of the second conference participants based on the conference content sharing request.
8. The method according to any one of claims 1 to 4, characterized in that: The step of determining, from at least one of the conference devices, a first conference device to be controlled by the gesture operation comprises: In the case where the target wearable device establishes a communication connection with at least two conference devices, displaying a device selection prompt, wherein the device selection prompt is used to prompt the selection of the conference device to be controlled by the gesture operation; Based on the triggering operation of the device selection prompt, the first conference device to be controlled by the gesture operation is determined from at least one of the conference devices.
9. A conference equipment control device, characterized in that: At least one conference device is deployed in an offline conference scene, and each participant wears a wearable device, the wearable device establishes a communication connection with the conference device, the device is configured in a target wearable device among the wearable devices, the target wearable device is a wearable device worn by a first participant, and the device includes: A gesture collection module, used for collecting gesture operations of the first participant through the target sensor in the target wearable device to obtain gesture operation data corresponding to the gesture operations when the first participant has a conference interaction requirement during the conference; A device determination module, used to determine a first conference device to be controlled by the gesture operation from at least one of the conference devices; The instruction sending module is used to send a device control instruction to the first conference device based on the gesture operation data, so that the first conference device performs the target interaction operation indicated by the gesture operation based on the device control instruction.
10. An electronic device, characterized in that: The electronic device comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory, so that the electronic device executes the method according to any one of claims 1 to 8.
11. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 8 is implemented.