Remote conference management method and device, electronic equipment and storage medium

By building virtual meeting scenarios and synchronous information, the problem of insufficient participation and collaboration tools in remote meetings is solved, and the immersive experience and information sharing of remote participants is realized, and the communication and interaction effect is improved.

CN119052404APending Publication Date: 2024-11-29INST OF COMPUTING TECH CHINA ACAD OF RAILWAY SCI +2
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411262748.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-10
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Participants have low sense of participation and concentration in remote meetings, and cannot immerse themselves in the real conference atmosphere. The data presentation and collaboration tools have limited functions, so they cannot realize real-time synchronized information sharing and collaboration among remote attendees.

Method used

By constructing a virtual conference scenario based on physical scenes collected by field devices, synchronizing on-site conference information using sensors and IoT devices, and immersing remote attendees in virtual conference scenarios by extending real-world devices and input devices, realizing information synchronization on virtual whiteboards and cooperation.

Benefits of technology

It improves the sense of participation and concentration of remote participants, establishes effective communication and interaction, and realizes information sharing and collaboration between remote participants and on-site meetings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119052404A_ABST
    Figure CN119052404A_ABST
Patent Text Reader

Abstract

The invention relates to a remote conference management method and device, electronic equipment and a storage medium, and the method comprises the steps: building a virtual conference scene based on a physical scene of a field conference collected by field equipment, and the field equipment comprises a sensor and Internet of Things equipment; connection with a remote participant is established through an interaction device, the remote participant is immersed in the virtual conference scene, and the interaction device comprises an augmented reality device and an input device; synchronizing conference information of the on-site conference to the virtual conference scene, and displaying the conference information on a virtual whiteboard of the virtual conference; and in response to the on-site conference, receiving a synchronization request of the additional information of the remote conventioneers, synchronizing the additional information to the on-site conference, the additional information being information edited by the remote conventioneers through the input device based on the conference information and displayed on the virtual whiteboard. According to the invention, the participation sense and concentration degree of the remote conventioneers can be improved, effective communication and interaction are established, and information sharing and assistance between the remote conventioneers and the on-site conference are realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of conference management, and in particular to a remote conference management method, device, electronic equipment and storage medium. Background Art

[0002] A teleconference is a meeting format in which participants discuss and communicate about matters through a network connection using video conferencing tools. In a teleconference, participants can be in different locations, even in different countries or time zones. This format of meeting can improve the efficiency and flexibility of the meeting and avoid the health risks that may be caused by face-to-face communication.

[0003] Traditional remote conferences usually use 2D video and audio to achieve communication between participants. Compared with on-site meetings, participants in remote conferences have lower sense of participation and concentration, cannot immerse themselves in the real conference atmosphere, lack face-to-face interaction, and may even feel alienated, making it difficult to establish effective communication and interaction. At the same time, the data display and collaboration tools in remote conferences are usually limited in function and cannot achieve real-time synchronous information sharing and collaboration among remote participants. For example, when the sharing initiator among the participants shares the screen, others cannot share the screen synchronously and cannot collaborate with the sharing initiator in real time. Summary of the invention

[0004] Based on this, it is necessary to provide a remote conference management method, device, electronic device and storage medium that can immerse remote participants in a real conference atmosphere and realize real-time synchronous information sharing and collaboration among remote participants in response to the above technical problems.

[0005] The present invention provides a remote conference management method, the method comprising:

[0006] Building a virtual meeting scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and IoT devices;

[0007] Establishing a connection with a remote participant through an interactive device and immersing the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device;

[0008] Synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting;

[0009] In response to the on-site conference accepting a synchronization request for additional information from a remote participant, the additional information is synchronized to the on-site conference, wherein the additional information is information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0010] In one embodiment, the step of constructing a virtual conference scene based on the physical scene of the on-site conference collected by on-site equipment includes:

[0011] Clean and fuse the physical scene data collected on site;

[0012] Store the collected physical scene data and virtual meeting scene data.

[0013] In one embodiment, the step of constructing a virtual conference scene based on the physical scene of the on-site conference collected by on-site equipment includes:

[0014] Synchronize the physical scene of the on-site meeting to the virtual meeting scene;

[0015] In response to a movement displacement of a physical object of the on-site meeting exceeding a first threshold, a position of a virtual object corresponding to the physical object in the virtual meeting scene is updated.

[0016] In one embodiment, synchronizing the physical scene of the on-site meeting to the virtual meeting scene includes:

[0017] Compare the physical scene of the on-site meeting with the virtual scene and obtain comparative differences;

[0018] Optimize virtual meeting scenarios in real time based on comparison differences.

[0019] In one embodiment, immersing the remote participants in the virtual conference scene includes:

[0020] Update the empty seats in the virtual conference scene and locate the viewing position of the remote participants at the empty seats.

[0021] In one embodiment, the method further comprises:

[0022] In response to the on-site conference accepting a synchronization request for additional information from a remote participant, the viewing position of the remote participant is moved to the virtual whiteboard.

[0023] In one embodiment, the method further comprises:

[0024] In response to the on-site conference accepting the remote participant's request for information viewing permission, the remote participant is authorized to freely view the conference information.

[0025] The present invention also provides a remote conference management device, the device comprising:

[0026] A construction module, used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and Internet of Things devices;

[0027] An establishing module, used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device;

[0028] A synchronization module is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting;

[0029] The response module is used to respond to the on-site conference accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site conference, wherein the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0030] The present invention also provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements any of the above-mentioned remote conference management methods when executing the computer program.

[0031] The present invention also provides a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements any of the remote conference management methods described above.

[0032] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method described in any one of the above is implemented.

[0033] The above-mentioned remote conference management method, device, electronic device and storage medium, by constructing a virtual conference that is synchronized with the physical scene and conference information of the on-site conference, remote participants enter the virtual conference room through interactive devices, immerse themselves in the virtual conference scene, and obtain a similar experience to the real conference scene, which can improve the participation and concentration of remote participants and establish more effective communication and interaction. At the same time, after obtaining the synchronization information authority of the on-site conference, the remote participants can synchronize additional information to the on-site conference, and can assist the on-site conference, thereby realizing information sharing and assistance between remote participants and the on-site conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 A flow chart of a remote conference management method according to an embodiment of the present invention;

[0036] Figure 2 A flow chart of a remote conference management method according to another embodiment of the present invention;

[0037] Figure 3 A schematic diagram of a remote conference management device according to an embodiment of the present invention;

[0038] Figure 4 The figure is a diagram showing the internal structure of a computer device according to an embodiment. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0040] Combine the following Figure 1-Figure 4 The invention describes a remote conference management method, device, electronic device and storage medium.

[0041] like Figure 1 As shown, in one embodiment, a remote conference management method includes the following steps:

[0042] Step S110, constructing a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, where the on-site devices include sensors and Internet of Things devices.

[0043] Based on digital twin technology, the virtual reproduction of the physical scene of the on-site meeting is achieved through sensor data collection, 3D model creation, and real-time data integration. Use digital twin technology to generate a virtual environment consistent with the actual scene, including space modeling and object modeling, and update the data of the virtual meeting scene in real time to ensure synchronization with the actual scene of the on-site meeting. The on-site equipment used to collect on-site meeting data includes various sensors, as well as IoT devices such as cameras, audio equipment, computers and network equipment. After the on-site equipment collects the on-site physical scene data, it is cleaned and fused relative to the collected physical scene data to ensure the accuracy of the data, and the collected physical scene data and virtual meeting scene data are stored at the same time.

[0044] Step S120, establishing a connection with a remote participant through an interactive device, and immersing the remote participant in a virtual conference scene, wherein the interactive device includes an extended reality device and an input device.

[0045] Among them, Extended Reality (XR) includes augmented reality (AR), virtual reality (VR) and mixed reality (MR). Input devices include keyboards, touch screens, microphones, etc. Remote participants enter the virtual meeting room through extended reality devices and combine input devices to achieve real-time interaction with the on-site meeting.

[0046] Specifically, the remote participants are immersed in the empty seats in the virtual conference scene through the extended reality device. The empty seats in the virtual conference scene are updated in real time, and the viewing position of the remote participants is located at the empty seats.

[0047] Step S130, synchronizing the meeting information of the on-site meeting to the virtual meeting scene, and displaying it on the virtual whiteboard of the virtual meeting.

[0048] The meeting information of the on-site meeting is stored in the on-site computer equipment and can be displayed through the meeting screen. When synchronized to the virtual meeting scene, the information displayed on the meeting screen is displayed on the virtual whiteboard of the virtual meeting.

[0049] Step S140, in response to the on-site conference accepting the synchronization request of the remote participant's additional information, synchronizing the additional information to the on-site conference, where the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0050] After remote participants edit content on the virtual whiteboard through input devices based on conference information, they can send information synchronization requests to the on-site conference as needed. After the on-site conference accepts the synchronization request, the attachment information edited on the virtual whiteboard will be synchronously displayed on the screen of the on-site conference.

[0051] Optionally, in response to the on-site conference accepting a synchronization request for additional information from a remote participant, the viewing position of the remote participant is moved to the virtual whiteboard, so that the remote participant has a better experience of having an on-site conference atmosphere.

[0052] When the remote participant needs to freely view the conference information, he or she may also request viewing permission from the on-site conference. After authorization, the on-site conference, in response to the on-site conference accepting the remote participant's information viewing permission request, authorizes the remote participant to freely view the conference information.

[0053] The remote conference management method of this embodiment, by building a virtual conference that is synchronized with the physical scene and conference information of the on-site conference, allows remote participants to enter the virtual conference room through interactive devices, immerse themselves in the virtual conference scene, and obtain an experience similar to the real conference scene, thereby improving the participation and concentration of remote participants and establishing more effective communication and interaction. At the same time, after obtaining the synchronization information authority of the on-site conference, the remote participants can synchronize additional information to the on-site conference, assist the on-site conference, and realize information sharing and assistance between remote participants and the on-site conference.

[0054] like Figure 2 As shown, in one embodiment, constructing a virtual conference scene based on the physical scene of the on-site meeting collected by on-site equipment includes the following steps:

[0055] Step S112, synchronizing the physical scene of the on-site meeting to the virtual meeting scene.

[0056] Specifically, the physical scene of the on-site meeting is compared with the virtual meeting scene and the difference is obtained.

[0057] The virtual meeting scene is optimized in real time based on the comparison differences. Through comparison, the accuracy of the virtual meeting scene can be verified, and the virtual meeting scene can be continuously optimized based on the feedback.

[0058] Step S122: in response to the movement displacement of the physical object of the on-site meeting exceeding the first threshold, updating the position of the virtual object corresponding to the physical object in the virtual meeting scene.

[0059] After the participants of the on-site meeting occupy the seats of the on-site meeting, there are generally multiple unoccupied seats. Remote participants will be immersed in the corresponding virtual empty seats in the virtual meeting. During the meeting, when the on-site participants change seats, there may be overlap with the seats of remote participants. In this regard, the physical objects (including on-site participants) of the on-site meeting move more than the first threshold, and the positions of the virtual objects corresponding to the physical objects in the virtual meeting scene are updated. Then, the empty seats in the virtual meeting scene are updated, and the viewing position of the remote participants is located at the empty seats. At this point, the overlap of positions can be avoided, and the remote participants can also have a better atmosphere experience of on-site participation.

[0060] The remote conference management device provided by the present invention is described below. The remote conference management device described below and the remote conference management method described above can be referenced to each other.

[0061] like Figure 3 As shown, in one embodiment, a remote conference management device includes a construction module 310 , an establishment module 320 , a synchronization module 330 and a corresponding module 340 .

[0062] The construction module 310 is used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, where the on-site devices include sensors and Internet of Things devices.

[0063] The establishing module 320 is used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene. The interactive device includes an extended reality device and an input device.

[0064] The synchronization module 330 is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene, and display it on the virtual whiteboard of the virtual meeting.

[0065] The response module 340 is used to respond to the on-site meeting accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site meeting, wherein the additional information is the information edited by the remote participant through the input device based on the meeting information and displayed on the virtual whiteboard.

[0066] Figure 4 An example of a physical structure diagram of an electronic device is shown. The electronic device may be a smart terminal, and its internal structure diagram may be as follows: Figure 4 As shown. The electronic device includes a processor, a memory and a network interface connected via a system bus. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a remote conference management method is implemented, and the method includes:

[0067] A construction module, used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and Internet of Things devices;

[0068] An establishing module, used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device;

[0069] A synchronization module is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting;

[0070] The response module is used to respond to the on-site conference accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site conference, wherein the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0071] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present invention, and does not constitute a limitation on the electronic device to which the scheme of the present invention is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0072] On the other hand, the present invention further provides a computer storage medium storing a computer program, which implements a remote conference management method when the computer program is executed by a processor, the method comprising:

[0073] A construction module, used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and Internet of Things devices;

[0074] An establishing module, used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device;

[0075] A synchronization module is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting;

[0076] The response module is used to respond to the on-site conference accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site conference, wherein the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0077] In another aspect, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and when the processor executes the computer instructions, a remote conference management method is implemented, the method comprising:

[0078] A construction module, used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and Internet of Things devices;

[0079] An establishing module, used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device;

[0080] A synchronization module is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting;

[0081] The response module is used to respond to the on-site conference accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site conference, wherein the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

[0082] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing related hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory.

[0083] By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0084] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0085] The above-described embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the present invention. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the attached claims.

Claims

1. A remote conference management method, It is characterized in that The method comprises: Building a virtual meeting scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and IoT devices; Establishing a connection with a remote participant through an interactive device and immersing the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device; Synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting; In response to the on-site conference accepting a synchronization request for additional information from a remote participant, the additional information is synchronized to the on-site conference, wherein the additional information is information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

2. The remote conference management method according to claim 1, It is characterized in that The method of constructing a virtual conference scene based on the physical scene of the on-site conference collected by on-site equipment includes: Clean and fuse the physical scene data collected on site; Store the collected physical scene data and virtual meeting scene data.

3. The remote conference management method according to claim 1, It is characterized in that The method of constructing a virtual conference scene based on the physical scene of the on-site conference collected by on-site equipment includes: Synchronize the physical scene of the on-site meeting to the virtual meeting scene; In response to a movement displacement of a physical object of the on-site meeting exceeding a first threshold, a position of a virtual object corresponding to the physical object in the virtual meeting scene is updated.

4. The remote conference management method according to claim 3, It is characterized in that The step of synchronizing the physical scene of the on-site meeting to the virtual meeting scene includes: Compare the physical scene of the on-site meeting with the virtual scene and obtain comparative differences; Optimize virtual meeting scenarios in real time based on comparison differences.

5. The remote conference management method according to claim 3, It is characterized in that The method of immersing the remote participants in the virtual conference scene comprises: Update the empty seats in the virtual conference scene and locate the viewing position of the remote participants at the empty seats.

6. The remote conference management method according to claim 3, It is characterized in that The method further comprises: In response to the on-site conference accepting a synchronization request for additional information from a remote participant, the viewing position of the remote participant is moved to the virtual whiteboard.

7. The remote conference management method according to any one of claims 1 to 6, It is characterized in that The method further comprises: In response to the on-site conference accepting the remote participant's request for information viewing permission, the remote participant is authorized to freely view the conference information.

8. A remote conference management device, It is characterized in that The device comprises: A construction module, used to construct a virtual conference scene based on the physical scene of the on-site meeting collected by on-site devices, wherein the on-site devices include sensors and Internet of Things devices; An establishing module, used to establish a connection with a remote participant through an interactive device and immerse the remote participant in the virtual conference scene, wherein the interactive device includes an extended reality device and an input device; A synchronization module is used to synchronize the meeting information of the on-site meeting to the virtual meeting scene and display it on the virtual whiteboard of the virtual meeting; The response module is used to respond to the on-site conference accepting the synchronization request of the remote participant's additional information, and synchronize the additional information to the on-site conference, wherein the additional information is the information edited by the remote participant through the input device based on the conference information and displayed on the virtual whiteboard.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program. It is characterized in that When the processor executes the computer program, the remote conference management method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, It is characterized in that When the computer program is executed by a processor, the remote conference management method according to any one of claims 1 to 7 is implemented.