Remote conference method, data interaction method, device and computer storage medium

By obtaining eye movement information of participants and generating interactive information, the problem of insufficient human interaction in remote meetings is solved, the naturalness and efficiency of the meeting is improved, and the quality and effectiveness of the meeting is improved.

CN114679437BActive Publication Date: 2024-12-06ALIBABA (CHINA) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210238594.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-11
Publication Date
2024-12-06
Estimated Expiration
2042-03-11

AI Technical Summary

Technical Problem

The lack of natural interaction between people in existing remote meeting technologies leads to a stiff meeting rhythm and low information transmission efficiency, which reduces the quality and effectiveness of the meeting.

Method used

By obtaining eye movement information of participants, generating interactive information, and performing interactive operations based on this information to assist in the conduct of remote meetings, realizing natural interaction between the speaker and the participants.

Benefits of technology

It improves the rhythmic nature of remote meetings and the quality of information transmission, ensuring the effectiveness and efficiency of the meeting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114679437B_ABST
    Figure CN114679437B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides a remote conference method, a data interaction method, a device and a computer storage medium. The remote conference method includes: obtaining eye movement information of participants participating in the remote conference; generating interaction information corresponding to the remote conference based on the eye movement information; and performing interaction operations corresponding to the remote conference based on the interaction information to assist the remote conference. The technical solution provided in this embodiment, by obtaining the eye movement information of participants participating in the remote conference, and then generating interaction information corresponding to the remote conference based on the eye movement information, and performing interaction operations corresponding to the remote conference based on the interaction information, effectively enables the speaker to interact naturally with other participants through eye contact, which is conducive to making the rhythm of the remote conference more natural and efficient, ensuring the quality and effect of conference information transmission, and further improving the practicality of the method.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a remote conference method, a data interaction method, a device and a computer storage medium. Background Art

[0002] Remote conference refers to a meeting held across regions using modern communication methods. Currently, most remote conferences are held on personal computers (PCs). In addition, since the remote conference interface often needs to display the content of the meeting, there is a lack of natural human interaction between the speaker and other personnel, which can easily lead to a stiff meeting rhythm and loss of information transmission, thereby reducing the quality and effectiveness of the meeting. Summary of the invention

[0003] The embodiments of the present invention provide a remote conference method, a data interaction method, a device and a computer storage medium, which enable a natural eye contact between a speaker and a participant, thereby making the rhythm of the remote conference more real and reliable, and ensuring the quality and effect of conference information transmission.

[0004] In a first aspect, an embodiment of the present invention provides a remote conference method, including:

[0005] Obtain eye movement information of participants in remote conferences;

[0006] Based on the eye movement information, generating interaction information corresponding to the remote conference;

[0007] An interactive operation corresponding to the remote conference is performed based on the interactive information to assist the remote conference.

[0008] In a second aspect, an embodiment of the present invention provides a remote conference device, including:

[0009] A first acquisition module is used to acquire eye movement information of participants in a remote conference;

[0010] A first generating module, configured to generate interaction information corresponding to the remote conference based on the eye movement information;

[0011] The first processing module is used to perform an interactive operation corresponding to the remote conference based on the interactive information to assist the remote conference.

[0012] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the remote conferencing method in the above-mentioned first aspect.

[0013] In a fourth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the remote conferencing method in the first aspect when executed.

[0014] In a fifth aspect, an embodiment of the present invention provides a computer program product, comprising: a computer program, which, when executed by a processor of an electronic device, enables the processor to execute the steps in the remote conferencing method shown in the first aspect above.

[0015] In a sixth aspect, an embodiment of the present invention provides a data interaction method, including:

[0016] Obtaining the data to be processed displayed in the display interface;

[0017] Determining eye movement information of multiple persons respectively viewing the data to be processed;

[0018] Based on the eye movement information, generating interaction information corresponding to the data to be processed;

[0019] The data to be processed is annotated and displayed based on the interaction information.

[0020] In a seventh aspect, an embodiment of the present invention provides a data interaction device, including:

[0021] A second acquisition module is used to acquire the data to be processed displayed in the display interface;

[0022] A second determination module is used to determine eye movement information of multiple persons viewing the data to be processed respectively;

[0023] A second generating module, configured to generate interaction information corresponding to the data to be processed based on the eye movement information;

[0024] The second processing module is used to annotate and display the data to be processed based on the interaction information.

[0025] In an eighth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data interaction method in the above-mentioned sixth aspect.

[0026] In a ninth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the data interaction method in the sixth aspect when executed.

[0027] In the tenth aspect, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the steps in the data interaction method shown in the sixth aspect above.

[0028] In an eleventh aspect, an embodiment of the present invention provides a data interaction method, including:

[0029] Obtaining a preset virtual space generated by virtual reality technology;

[0030] Determine the eye movement information corresponding to each person participating in the preset virtual space;

[0031] Based on the eye movement information, generating interaction information corresponding to the preset virtual space;

[0032] An interactive operation corresponding to the preset virtual space is performed based on the interactive information.

[0033] In a twelfth aspect, an embodiment of the present invention provides a data interaction device, including:

[0034] A third acquisition module is used to acquire a preset virtual space generated by virtual reality technology;

[0035] The third determination module is used to determine the eye movement information corresponding to each person participating in the preset virtual space;

[0036] A third generating module, configured to generate interaction information corresponding to the preset virtual space based on the eye movement information;

[0037] The third processing module is used to perform an interactive operation corresponding to the preset virtual space based on the interactive information.

[0038] In the thirteenth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data interaction method in the above-mentioned eleventh aspect.

[0039] In a fourteenth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the data interaction method in the above-mentioned eleventh aspect when executed.

[0040] In the fifteenth aspect, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the steps in the data interaction method shown in the above-mentioned eleventh aspect.

[0041] In a sixteenth aspect, an embodiment of the present invention provides a remote conference method, including:

[0042] Obtain the conference permission information of each participating terminal in the remote conference;

[0043] Determine, based on the conference authority information, conference data that can be displayed by each participating terminal, wherein the conference data includes at least a portion of a display file that needs to be displayed in the remote conference;

[0044] The participating terminals are used to display the corresponding conference data.

[0045] In a seventeenth aspect, an embodiment of the present invention provides a remote conference device, including:

[0046] The fourth acquisition module is used to obtain the conference authority information of each participating terminal in the remote conference;

[0047] A fourth determination module, configured to determine conference data that can be displayed by each participating terminal based on the conference authority information, wherein the conference data includes at least a portion of a display file that needs to be displayed in the remote conference;

[0048] The fourth processing module is used to display the corresponding conference data using the participating terminal.

[0049] In the eighteenth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the remote conferencing method in the above-mentioned sixteenth aspect.

[0050] In a nineteenth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the remote conferencing method in the sixteenth aspect when executed.

[0051] In the twentieth aspect, an embodiment of the present invention provides a computer program product, comprising: a computer program, which, when executed by a processor of an electronic device, enables the processor to execute the steps in the remote conferencing method shown in the above-mentioned sixteenth aspect.

[0052] The technical solution provided in this embodiment obtains the eye movement information of the participants in the remote conference, and then generates interaction information corresponding to the remote conference based on the eye movement information, and performs interaction operations corresponding to the remote conference based on the interaction information. This effectively enables the speaker to interact naturally with other participants through eye contact, which is conducive to making the rhythm of the remote conference more natural and efficient, ensuring the quality and effect of conference information transmission, and further improving the practicality of the method. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0054] Figure 1 A schematic diagram of a scenario of a remote conference method provided by an embodiment of the present invention;

[0055] Figure 2 A schematic diagram of a remote conference method provided by an embodiment of the present invention;

[0056] Figure 3 A schematic diagram of a process for generating interactive information corresponding to the remote conference based on the eye movement information provided in an embodiment of the present invention;

[0057] Figure 4 Schematic diagram of the operation mode of the remote conference provided in the embodiment of the present invention being the conversation mode Figure 1 ;

[0058] Figure 5 Schematic diagram of the operation mode of the remote conference provided in the embodiment of the present invention being the conversation mode Figure 2 ;

[0059] Figure 6 A schematic diagram showing that the operation mode of the remote conference provided in the embodiment of the present invention is a lecture mode;

[0060] Figure 7 A schematic diagram showing that the operation mode of the remote conference provided in the embodiment of the present invention is a discussion mode;

[0061] Figure 8 A flowchart of another remote conference method provided by an embodiment of the present invention;

[0062] Fig. 9 A schematic diagram of annotated statistical information provided by an embodiment of the present invention;

[0063] Fig.10 A flowchart of another remote conference method provided by an embodiment of the present invention;

[0064] Fig.11 A schematic diagram of generating a communication group corresponding to the hot spot information provided by an embodiment of the present invention;

[0065] Fig.12A flowchart of another remote conference method provided by an embodiment of the present invention;

[0066] Fig.13 A flowchart of a remote conference method provided by an application embodiment of the present invention;

[0067] Fig.14 A flow chart of a data interaction method provided by an embodiment of the present invention;

[0068] Fig.15 A schematic diagram of a flow chart of another data interaction method provided by an embodiment of the present invention;

[0069] Fig.16 A schematic diagram of another remote conference method provided by an embodiment of the present invention;

[0070] Fig.17 A schematic diagram of the structure of a remote conference device provided by an embodiment of the present invention;

[0071] Fig.18 For Fig.17 A schematic diagram of the structure of an electronic device corresponding to the remote conference device provided in the illustrated embodiment;

[0072] Fig.19 A schematic diagram of the structure of a data interaction device provided by an embodiment of the present invention;

[0073] Fig. 20 For Fig.19 A schematic diagram of the structure of an electronic device corresponding to the data interaction device provided in the illustrated embodiment;

[0074] Fig.21 A schematic diagram of the structure of another data interaction device provided by an embodiment of the present invention;

[0075] Fig. 22 For Fig.21 A schematic diagram of the structure of an electronic device corresponding to the data interaction device provided in the illustrated embodiment;

[0076] Fig.23 A schematic diagram of the structure of another remote conference device provided by an embodiment of the present invention;

[0077] Fig.24 For Fig.23 A schematic diagram of the structure of an electronic device corresponding to the remote conference device provided in the illustrated embodiment. DETAILED DESCRIPTION

[0078] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are protected by the present invention, but the case of including at least one is not excluded. It should be understood that the scope of the term "and / or" used in this article.

[0079] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. "Multiple" generally includes at least two. " is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0080] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0081] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a product or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such a product or system. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the product or system including the elements.

[0082] In order to facilitate understanding of the specific implementation process and effects of the technical solution in this application, the following is a brief description of the relevant technologies:

[0083] Teleconferencing refers to a meeting held across regions using modern communication methods. With the rapid development of science and technology, teleconferencing has become a necessary way to achieve office work in order to avoid low work efficiency due to different office locations.

[0084] Most of the current remote conferences are conducted on personal computers (PCs). In addition, since the remote conference interface often needs to display the conference content, the speaker lacks natural human interaction such as body language, eye contact, and facial expressions. For example, the speaker cannot interact with other people in real time and does not know whether everyone is listening to the conference content. Alternatively, the speaker can only control or edit the displayed conference content through devices such as the mouse and keyboard, such as zooming in and out of the displayed content. At this time, when using the mouse to move or click the full screen, it is easy to cause a chaotic operation.

[0085] In addition, when participants ask questions to the speaker, they may not be able to clearly describe the specific location of the meeting content displayed, which will reduce the quality and efficiency of communication. During the meeting, when the meeting document needs to be presented quickly, participants may not know the specific location of the speaker's speech.

[0086] Based on the above description, it can be known that existing remote conferences are prone to stiff meeting rhythms and loss of information transmission, thereby reducing the quality and effectiveness of the meeting. In order to solve the above technical problems, this embodiment provides a remote conference method, a data interaction method, a device, and a computer storage medium, wherein the execution subject of the remote conference method is a remote conference device, and the remote conference device can be implemented as a mobile phone, a tablet computer, a personal computer PC, a conference room device, a head-mounted display device implemented by augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology, and other devices capable of performing remote conference operations. For details, refer to the attached Figure 1 As shown:

[0087] A remote conference device is used to obtain eye movement information of participants in a remote conference, wherein each participant can participate in the remote conference through their corresponding remote conference device, for example: the remote conference device corresponding to each participant may include remote conference device a, remote conference device b and remote conference device c, and the above-mentioned remote conference device a, remote conference device b and remote conference device c can be communicated and connected with the remote conference device corresponding to the speaker through a preset network, and the preset network can be a wireless network or a wired network, thereby realizing that the remote conference device, remote conference device a, remote conference device b and remote conference device c can conduct the same remote conference.

[0088] The above-mentioned remote conference can be a real remote conference or a virtual remote conference. A real remote conference can refer to a remote conference formed in a real space. For example, the remote conference device corresponding to the speaker is located in Beijing, the remote conference device a corresponding to the participant is located in Shanghai, the remote conference device b corresponding to the participant is located in Shenzhen, and the remote conference device c corresponding to the participant is located in Guangzhou. Through the preset network and the conference application in each remote conference device, a remote conference can be directly generated. In this remote conference, the remote conference device corresponding to the speaker can display the meeting-related data that needs to be explained and the image acquisition information of each participant. The remote conference device a, remote conference device b, and remote conference device c can display the meeting-related data explained by the speaker, the image acquisition information of the speaker and / or the image acquisition information of other participants.

[0089] A virtual remote conference may refer to a remote conference formed in a virtual space. When the remote conference is a virtual remote conference, the remote conference device at this time may preferably be a head-mounted display device realized by AR, VR or MR technology. Specifically, the remote conference device corresponding to the speaker is located in Beijing, the remote conference device a corresponding to the participant is located in Beijing or Shanghai, the remote conference device b corresponding to the participant is located in Beijing or Shenzhen, and the remote conference device c corresponding to the participant is located in Beijing or Guangzhou. Through the preset network and the conference application in each remote conference device, a virtual conference room can be directly generated. In the virtual conference room, a virtual speaker corresponding to the remote conference device and virtual participants corresponding to the remote conference device a, remote conference device b and remote conference device c can be generated respectively.

[0090] In order to ensure the quality and effect of the remote conference, the eye movement information of the participants in the remote conference can be obtained in real time, wherein the number of participants can be one or more, and when the number of participants is multiple, the eye movement information obtained is also multiple. Specifically, the eye movement information may include the movement amplitude (or movement distance) of the eyeball, the movement direction (up, down, left, right, etc.), the movement type (blinking, closing eyes, etc.), the number of movements, etc.

[0091] After the eye movement information is acquired, the eye movement information may be analyzed and processed to generate interactive information corresponding to the remote conference, and the interactive information may include at least one of the following: interactive information for moving the displayed data upward, interactive information for moving the displayed data downward, interactive information for enlarging the displayed data, interactive information for marking the displayed data, interactive information for performing instant dialogue operations with the participants, etc. After the interactive information is acquired, interactive operations corresponding to the remote conference may be performed based on the interactive information, for example, the displayed data may be adjusted based on the interactive information, or dialogue operations between the presenter and the participants may be performed based on the interactive information, thereby effectively assisting the remote conference to proceed smoothly and efficiently.

[0092] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the case where there is no conflict between the embodiments, the following embodiments and the features in the embodiments can be combined or separated with each other. In addition, the step sequence in the following method embodiments is only an example and not a strict limitation.

[0093] Figure 2 A flowchart of a remote conference method provided by an embodiment of the present invention; see attached Figure 2 As shown, this embodiment provides a remote conference method, the execution subject of the method can be a remote conference device, and the remote conference device can be implemented as software, or a combination of software and hardware. Specifically, when the remote conference device is implemented as hardware, it can be various electronic devices with display screens and eye tracking devices, including but not limited to smart phones, tablet computers, personal computers PCs, conference room display devices, head-mounted display devices implemented by augmented reality (AR), virtual reality (VR) or mixed reality (MR) technology, etc. When the remote conference device is implemented as software, it can be installed in the electronic devices listed above. Based on the above-mentioned remote conference device, the remote conference method in this embodiment may include the following steps:

[0094] Step S201: Acquire eye movement information of participants in a remote conference.

[0095] Step S202: Generate interaction information corresponding to the remote conference based on the eye movement information.

[0096] Step S203: performing an interactive operation corresponding to the remote conference based on the interactive information to assist the remote conference.

[0097] The specific implementation process and effects of each of the above steps are described in detail below:

[0098] Step S201: Acquire eye movement information of participants in a remote conference.

[0099] In order to ensure the quality and effect of the remote conference, the eye movement information of the participants in the remote conference can be obtained in real time, wherein the number of participants can be one or more. When the number of participants is multiple, the eye movement information obtained is also multiple. The eye movement information is used to characterize the user's eye movement record when the user faces a preset interface, which may specifically include the eye movement amplitude (or movement distance), movement path, movement direction (up, down, left, right, etc.), movement type (blinking, closing eyes, etc.), number of movements, length of stay in a preset area, eye gaze angle information, etc. Specifically, the eye movement information can be obtained by continuously capturing and recording the user's eye movements through an eye tracker and / or an image acquisition device. For example, the eye gaze movement, eye saccade movement and tracking movement, as well as the spatial information and time information of various movements, etc. can be captured through the eye tracker and the image acquisition device.

[0100] Example 1: One or more image acquisition devices are configured on the remote conference device. When the remote conference device is a conference room display device, since the conference room display device may correspond to one or more users, in order to accurately obtain the eye movement information of multiple users, the remote conference device may be provided with multiple image acquisition devices, and the multiple image acquisition devices may be evenly distributed around the remote conference device. After the remote conference device presents the display interface to the user, it can capture and record the eye movement information of each user through the image acquisition device (one or more) configured by itself and the eye tracking technology, so as to obtain the eye movement information of the participants in the remote conference.

[0101] Example 2: One or more eye trackers are configured on the remote conference device. When the remote conference device is a smart phone, tablet computer, or personal computer PC, since the user corresponding to the above conference room display device is usually one, in order to accurately obtain the user's eye movement information, one or more eye trackers can be set on the remote conference device. When there are multiple eye trackers, multiple eye trackers can be evenly distributed around the remote conference device. After the remote conference device presents the display interface to the user, it can capture and record the user's eye movement information through the eye tracker (one or more) configured by itself and the eye tracking technology, so as to obtain the eye movement information of the participants participating in the remote conference.

[0102] Step S202: Generate interaction information corresponding to the remote conference based on the eye movement information.

[0103] Since the eye movement information includes the eye movement amplitude, movement path, movement direction (up, down, left, right, etc.), movement type (blinking, closing eyes, etc.), movement number, duration of stay in a preset area, eye gaze angle information and other information, different eye movement information may correspond to different interactive information, for example: when the eye movement information is an upward movement of the eye, and the movement amplitude is greater than a preset threshold, interactive information for moving the display data upward may be generated; when the eye movement information includes the duration of stay in a preset area, and the duration of stay is greater than or equal to the preset threshold, interactive information for marking the display data may be generated, or interactive information for instant communication with the participants may be generated, etc. Therefore, in order to accurately assist the normal and efficient conduct of the remote conference, after obtaining the eye movement information, the eye movement information may be analyzed and processed to generate interactive information corresponding to the remote conference. In some instances, a mapping relationship between eye movement information and interaction information is pre-configured. After obtaining the eye movement information, the pre-stored mapping relationship can be obtained by accessing a preset area, and then the interaction information corresponding to the remote conference is generated based on the eye movement information and the mapping relationship, thereby effectively realizing the ability to quickly and accurately generate interaction information.

[0104] Step S203: performing an interactive operation corresponding to the remote conference based on the interactive information to assist the remote conference.

[0105] After generating interactive information corresponding to the remote conference, interactive operations corresponding to the remote conference can be performed based on the interactive information. For example, when the interactive information is interactive information used to implement a marking operation on display data, the display data can be marked based on the above interactive information; when the interactive information is interactive information used to implement instant communication with the participants, instant communication between the speaker and the participants can be implemented based on the interactive information, etc., thereby effectively realizing the ability to stably and effectively assist the normal progress of the remote conference.

[0106] In some other instances, in order to improve the security and reliability of remote conferences, before obtaining the eye movement information of the participants participating in the remote conference, it also includes: obtaining the identity information of the participants participating in the remote conference; performing identity authentication and authority verification operations on the participants based on the identity information, so as to determine whether the participants are legal persons participating in the remote conference. When the participants are legal persons, the authority information of the participants can be determined based on the identity information, and different authority information can correspond to different conference display data; when the participants are illegal persons, the participants can be prohibited from participating in the remote conference.

[0107] Specifically, in order to accurately ensure that participants with different permissions can view data that matches their permissions, the method in this embodiment may also include: obtaining conference permission information of each participating terminal in the remote conference; determining the conference data that each participating terminal can display based on the conference permission information, and the conference data includes at least a part of the display file that needs to be displayed in the remote conference; and using the participating terminal to display the corresponding conference data.

[0108] Among them, determining the conference data that can be displayed by each participating terminal based on the conference permission information may include: in the display file, determining the in-authority data and out-of-authority data corresponding to each participating terminal based on the conference permission information; processing the out-of-authority data to obtain processed data that cannot be viewed; based on the processed data and the in-authority data, obtaining the conference data that can be displayed by each participating terminal.

[0109] The remote conference method provided in this embodiment obtains the eye movement information of the participants in the remote conference, then generates interaction information corresponding to the remote conference based on the eye movement information, and performs interaction operations corresponding to the remote conference based on the interaction information. This effectively enables the speaker to interact naturally with other participants through eye contact, which is conducive to making the rhythm of the remote conference more natural and efficient, ensuring the quality and effect of the transmission of conference information, and further improving the practicality of the method.

[0110] Figure 3 A flowchart of generating interaction information corresponding to a remote conference based on eye movement information provided in an embodiment of the present invention; in addition to generating interaction information corresponding to a remote conference based on a pre-configured mapping relationship between eye movement information and interaction information, there are other implementations of generating interaction information, for details, refer to the attached Figure 3 As shown, in this embodiment, generating interaction information corresponding to the remote conference based on eye movement information may include:

[0111] Step S301: Determine the operation mode of the remote conference.

[0112] Among them, when a remote conference is generated using a remote conference device, the generated remote conference may correspond to different operating modes. In some instances, the operating mode may include any one of the following: lecture mode, discussion mode, dialogue mode, etc. Specifically, when the remote conference is in lecture mode, at this time, the person allowed to speak in the remote conference may be the speaker, and other participants are prohibited from speaking. In addition, the display interface of the remote conference device corresponding to the speaker may display information related to the conference (document information, image information, video information, etc.) and image information of each participant. Specifically, the information related to the conference may be displayed in the middle of the display interface, and the image acquisition information of each participant may be displayed at the top, bottom, left or right end of the display interface. It can be understood that when the number of participants is large, the display size of the image information of each participant is relatively small; when the number of participants is small, the display size of the image information of each participant is relatively large. Similarly, the display interface of the remote conference device corresponding to the participant can also display information related to the meeting and the image acquisition information of the speaker, effectively enabling the speaker to have eye contact with each participant through the remote conference device during the remote conference, which is conducive to improving the quality and effectiveness of the conference delivery.

[0113] When the remote conference is in discussion mode, the persons allowed to speak in the remote conference may include the speaker and / or other participants, and the number of persons allowed to speak may be two or more to implement the discussion operation. In specific implementation, the display interface corresponding to the speaker may display information related to the conference and image acquisition information of each participant. Specifically, the speaker and participants who need to be discussed may be displayed in the upper half of the interface, and the information related to the conference may be displayed in the lower half of the interface; or, the information related to the conference may be displayed in the upper half of the interface, and the speaker and participants for discussion may be displayed in the lower half of the interface. In this way, the discussion object may be highlighted, thereby making the discussion operation more efficient.

[0114] Furthermore, when displaying information related to the meeting, in order to improve the quality and efficiency of the discussion, at least part of the content of the discussion can be marked and displayed in the displayed meeting-related information based on eye movement information, such as highlighting, emphasizing, icon display, etc. This enables the presenter and each participant to locate the content of the ongoing discussion more directly and quickly, so that when discussions are needed during a remote meeting, efficient discussions can be conducted in a timely and effective manner, thereby improving the quality and effectiveness of the meeting.

[0115] When the remote conference is in dialogue mode, the persons allowed to speak in the remote conference may include the speaker and / or other participants, and the number of persons allowed to speak is two or more, so as to realize the discussion operation. In specific implementation, the display interface corresponding to the speaker can display the image acquisition information of each participant who needs to have a dialogue, and there is no need to display the data related to the meeting. At this time, the speaker can have eye contact with each participant through the remote conference device. Similarly, the display interface corresponding to the participant who is participating in the dialogue can display the image acquisition information of the speaker, and the display interface corresponding to the participant who is not participating in the dialogue can display the image acquisition information of each participant and the speaker, and the image acquisition information of the participant and the speaker who are performing the dialogue operation can be marked and displayed, which effectively realizes that when a dialogue operation is required during the remote conference, an efficient dialogue can be carried out immediately and effectively, which is conducive to improving the quality and effect of the meeting.

[0116] It should be noted that the operating mode of the remote conference is not limited to the modes listed above. Technical personnel in this field can make arbitrarily configurations according to specific application scenarios or application requirements. For example, the operating mode of the remote conference may include a free mode, and the display interface of the remote conference can freely switch to display conference-related content or the image acquisition information of the speaker. Different speakers may have different corresponding image acquisition information, etc., which will not be repeated here.

[0117] When conducting a remote conference, since different operating modes of the remote conference have different conference effects, in order to ensure the efficient conduct of the remote conference, the operating mode of the remote conference can be determined first. In some instances, the operating mode of the remote conference can be determined based on the mode selection operation of the speaker. Specifically, before conducting the remote conference, the display interface of the remote conference device corresponding to the speaker can display the operating mode controls that can be implemented by the remote conference, such as: lecture mode control, dialogue mode control, discussion mode control, etc., and then obtain the selection operation input by the user for each of the above operating mode controls, and determine the current operating mode of the remote conference based on the selection operation. For example; when the selection operation input by the user for the lecture mode control is obtained, it can be determined that the current operating mode of the remote conference is the lecture mode.

[0118] In other instances, the operating mode of the remote conference can be automatically determined based on the speaker's sound configuration operation of the remote conference or the default sound configuration operation of the remote conference. At this time, determining the operating mode of the remote conference includes: obtaining sound configuration information corresponding to each participant in the remote conference; and determining the operating mode of the remote conference based on the sound configuration information.

[0119] Specifically, since the operating mode of a remote conference may be related to the sound configuration information, in order to accurately determine the operating mode of a remote conference, before conducting a remote conference, the sound configuration information corresponding to each participant (including: the speaker and other participants) may be obtained. The sound configuration information may be generated based on the speaker's sound configuration operation. For example, when the speaker limits the number of persons who can speak in a remote conference to 1, 2 or more (more than 2), the corresponding sound configuration information may be obtained. Alternatively, the sound configuration information may be generated based on a default configuration operation. For example, the sound configuration information may be generated based on the default configuration operation. For example, the sound configuration information may be configured by default to allow the speaker to speak and prohibit other persons from speaking in a remote conference. The sound configuration information may be configured by default to allow everyone to speak in a remote conference.

[0120] After obtaining the sound configuration information corresponding to each participant, the sound configuration information corresponding to each participant can be analyzed and processed to determine the operation mode of the remote conference. In some instances, a mapping relationship between the sound configuration information corresponding to each participant and the operation mode of the remote conference is pre-configured, and the operation mode of the remote conference can be determined based on the mapping relationship and the sound configuration information. For example, when the sound configuration information obtained is used to identify that the number of people who can make sounds within a preset time period is 1, it can be determined that the operation mode of the remote conference is a lecture mode; when the sound configuration information obtained is used to identify that the number of people who can make sounds within a preset time period is 2, it can be determined that the operation mode of the remote conference is a dialogue mode; when the sound configuration information obtained is used to identify that the number of people who can make sounds within a preset time period is more than 2, it can be determined that the operation mode of the remote conference is a discussion mode.

[0121] In other instances, since there are often display files in remote conferences and different operating modes have different display requirements for display files, the operating mode of the remote conference is not only related to the sound configuration information, but also may be related to the different display requirements of the display files. In order to accurately determine the operating mode of the remote conference, determining the operating mode of the remote conference based on the sound configuration information in this embodiment may include: detecting whether there is a display file in the remote conference; determining the operating mode of the remote conference based on the detection result of the display file and the sound configuration information.

[0122] Before a remote conference, if the presenter has a display file that needs to be displayed, the display file can be uploaded to the remote conference device, or the display file can be obtained by accessing a preset area so that the display file can be displayed through the display interface; if the presenter does not have a display file that needs to be displayed, there is no need to upload the display file to the remote conference device. At this time, in order to accurately determine the operation mode of the remote conference, it is possible to detect whether there is a display file in the remote conference, and then the detection result of the display file and the sound configuration information can be analyzed and processed to determine the operation mode of the remote conference.

[0123] Among them, based on the detection result of the display file and the sound configuration information, determining the operating mode of the remote conference may include: based on the sound configuration information, counting the number of people who can perform voice interaction operations within a preset time period; when the detection result is that the display file exists and the number of people is one, determining that the operating mode is a lecture mode; when the detection result is that the display file exists and the number of people is at least two, determining that the operating mode is a discussion mode; when the detection result is that the display file does not exist and the number of people is at least two, determining that the operating mode is a dialogue mode.

[0124] Specifically, since the sound configuration information corresponding to each participant can identify whether each participant can make a sound or perform voice interaction operations, after obtaining the sound configuration information corresponding to each participant, the number of people who can perform voice interaction operations within a preset time period is counted based on the sound configuration information, and then the detection results of the display file and the counted number of people who can perform voice interaction operations within the preset time period can be comprehensively displayed to determine the operation mode of the remote conference.

[0125] For example, when the detection result is that the display file exists and the number of people is one, since the number of people allowed to perform voice interaction operations is only one, at this time, it is often the speaker who explains the content of the meeting, so it can be determined that the operating mode is the lecture mode. When the detection result is that the display file exists and the number of people is at least two, since the number of people allowed to perform voice interaction operations is at least two, at this time it can include communication between the speaker and other participants, and then the operating mode can be determined to be the discussion mode. When the detection result is that the display file does not exist and the number of people is at least two, since there is no display file in the display interface of the remote conference, at this time it can be determined that it is mainly a scene where the speaker communicates directly with other people, and then the operating mode can be determined to be the dialogue mode.

[0126] Step S302: Generate interaction information corresponding to the remote conference based on the eye movement information and the operation mode.

[0127] Since the same eye movement information can generate different interaction information when the remote conference is in different operating modes, after determining the operating mode of the remote conference, the eye movement information and the operating mode can be analyzed and processed to generate interaction information corresponding to the remote conference.

[0128] In some instances, generating interaction information corresponding to a remote conference based on eye movement information and an operating mode may include: when the operating mode is a conversation mode, generating conversation interaction information corresponding to participants in the remote conference based on eye movement information, the conversation interaction information being used to determine target participants who are about to have a conversation with the speaker in the remote conference.

[0129] Specifically, when the operation mode is the dialogue mode, since the remote conference interface at this time often does not display files, that is, only the image acquisition information of each participant needs to be displayed, such as Figure 4 As shown in the figure, when there is one speaker and eight participants, the image acquisition information of the eight participants can be evenly displayed in the display interface of the speaker. At this time, after the speaker's eye movement information is obtained, since the eye movement information at this time is mainly used to determine the target participant who is about to have a conversation with the speaker in the remote conference, the dialogue interaction information for realizing the dialogue operation between the speaker and the participants can be generated based on the eye movement information.

[0130] For example, when the speaker is viewing the interface of a remote conference, the speaker's eye movement information can be obtained in real time. If the eye movement information shows that the speaker stays at a preset position for more than a preset time, the participant corresponding to the preset position can be determined as the target participant, and then dialogue interaction information corresponding to the target participant can be generated. The dialogue interaction information is used to determine the target participant.

[0131] In other instances, in order to ensure the smooth progress of the remote conference in the dialogue mode, the remote conference device may also include a voice recognition device, which obtains the voice information of the speaker and generates dialogue interaction information based on the voice information and eye movement information to enable dialogue operations between the speaker and the participants of the remote conference. This can further improve the accuracy of the generation of dialogue interaction information.

[0132] Example 1, see Attachment Figure 4As shown, during a remote conference, the speaker's eye movement information and voice information can be obtained in real time. When it can be determined based on the speaker's eye movement information that the speaker stays on the upper part of the page for more than a preset time, and based on the speaker's voice information "Please introduce yourself", the target participant for dialogue operation can be determined based on the above eye movement information and voice information. Therefore, dialogue interaction information for determining the target participant can be generated, and then dialogue prompt information can be generated based on the dialogue interaction information. The dialogue prompt information is only related to the target participant, and the remote conference devices corresponding to other participants will not receive the above dialogue prompt information.

[0133] When the interactive information is dialogue interactive information, performing interactive operations corresponding to the remote conference based on the interactive information may include: determining a target participant who is about to have a dialogue with the speaker in the remote conference based on the dialogue interactive information; and generating dialogue prompt information for the target participant so that the target participant can have a dialogue with the speaker based on the dialogue prompt information.

[0134] After acquiring the conversation interaction information, the target participant who is about to have a conversation with the speaker in the remote conference can be determined based on the conversation interaction information. In order to enable the target participant to promptly understand the speaker's intention to have a conversation with him / her, conversation prompt information corresponding to the target participant can be generated. The conversation prompt information can include at least one of the following: information highlighting the avatar frame, generating pop-up prompt information for conducting a conversation with the speaker, etc. The above-mentioned conversation prompt information can be sent to the remote conference device of the target participant, so that the conversation prompt information can be displayed in the remote conference device of the target participant, and then the target participant can conduct a conversation with the speaker based on the conversation prompt information.

[0135] Example 2, see Attachment Figure 5 As shown, after the target participant obtains the conversation prompt information, the target participant can understand that the speaker wants to have a conversation with him / her based on the conversation prompt information. At this time, in order to further improve the natural eye contact between the speaker and each participant, the speaker and the target dialogue person can be highlighted in the display interface of the speaker and the display interface of each other participant, that is, the speaker and the target dialogue person are enlarged in the middle of the interface, and the other participants are reduced in size.

[0136] When the target person and the speaker complete the dialogue operation, the highlight display mode between the target person and the speaker can be exited, so that the display interface of the speaker is restored to display the avatars of each participant evenly, which is convenient for the next dialogue operation.

[0137] In the above implementation, by configuring the remote conference in dialogue mode and then detecting the speaker's eye movement information, it is possible to effectively determine whether the speaker is paying attention to a certain participant based on the eye movement information. If the speaker is paying attention to a certain participant, the display interface of the participant being paid attention to is controlled to receive and interact with feedback, so that the two parties who need to have a dialogue can complete the "eye contact" and naturally establish a dialogue relationship in the meeting. This can effectively solve the problem of confusion of communication objects due to the lack of direct contact between people in remote video in the prior art, especially in unfamiliar scenarios (such as: new student meetings, unable to call people by their names), and further improve the stability and reliability of the operation of the remote conference method.

[0138] It should be noted that since the operating mode of the remote conference can include a lecture mode or a discussion mode in addition to the conversation mode, and different operating modes may correspond to different ways of generating interactive information, therefore, another implementation method of generating interactive information corresponding to the remote conference based on eye movement information and operating mode in this embodiment may include: when the operating mode is a lecture mode or a discussion mode, generating annotated interactive information corresponding to the display file in the remote conference based on eye movement information.

[0139] Among them, when the remote conference is in lecture mode, since the content of the speaker's speech will change, in order to enable the participants to timely understand the progress of the speech, when the operating mode is lecture mode or discussion mode, the eye movement information corresponding to the speaker and / or each participant can be obtained, and then the annotation interaction information corresponding to the display file in the remote conference can be generated based on the eye movement information. It should be noted that the annotation interaction information corresponding to the speaker's eye movement information and the annotation interaction information corresponding to the eye movement information of each participant may be different. Specifically, the annotation interaction information corresponding to the speaker is mainly used to annotate the lecture content of the displayed file; the annotation interaction information corresponding to each participant is mainly used to annotate specific content in the displayed file to indicate that the participant is interested in or has questions about the above-mentioned specific content, etc.

[0140] In continuation of the above content, when the interactive information is annotated interactive information, performing interactive operations corresponding to the remote conference based on the interactive information may include: annotating and displaying the display file based on the annotated interactive information. Specifically, annotating and displaying the display file based on the annotated interactive information may include: determining the conference identity of the participant corresponding to the eye movement information; when the conference identity is the speaker, dynamically annotating and / or dynamically displaying the data related to the conference progress in the display file based on the annotated interactive information; when the conference identity is the listener, annotating the data of interest in the display file based on the annotated interactive information.

[0141] For each participant in the remote conference, each participant may have a corresponding conference identity. Based on the conference identity, the conference identity of the participant corresponding to the eye movement information can be determined. For example, when the participant is a speaker, the speaker's identity can be displayed in the display interface of the remote conference; when the participant is a listener, the listener's identity can be displayed in the display interface of the remote conference. After determining the conference identity of the participant corresponding to the eye movement information, corresponding interactive operations can be performed based on the conference identity and annotation interaction information corresponding to each participant. Specifically, when the conference identity is the speaker, the data related to the conference progress in the display file is dynamically annotated and / or dynamically displayed based on the annotation interaction information, wherein the dynamic annotation of the data related to the conference progress may include highlighting, enlarging, displaying in a specific color, etc., and the dynamic display of the data related to the conference progress may include: sliding up and down, enlarging, reducing, etc.; when the conference identity is a listener, the data of interest in the display file is annotated based on the annotation interaction information.

[0142] Example 3, see Attachment Figure 6 As shown, when the remote conference is in lecture mode, the display interface corresponding to the speaker can display the image acquisition information of each participant and the display files related to the meeting. When the speaker speaks to the first line of data in the display file, the first line of data can be highlighted; when the speaker speaks to the third line of data in the display file, the third line of data can be highlighted, thereby effectively realizing that when it is necessary to demonstrate relevant files through a remote conference, the data in the display file can be dynamically marked based on the speaker's eye movement information (line of sight position), so that the participants can understand the progress of the meeting in real time and maintain a high degree of concentration.

[0143] In addition, the speaker can also use eye movement information to interact with the data of the display file. Specifically, when the speaker's eye movement information shows upward movement, the display file can be automatically slid up, and when the speaker's eye movement information shows downward movement, the display file can be automatically slid down; when the speaker's eye movement information shows that the preset position is focused on for more than a preset time, the data at the preset position in the display file can be enlarged and displayed, etc., thereby enabling the speaker to automatically and naturally interact with the display file through eye movement information, avoiding the frequent and busy operations that occur when adjusting the display file using a mouse or keyboard.

[0144] Similarly, when the participant is a listener, the listener's eye movement information can be obtained. When the eye movement information is used to identify that the listener's attention duration on a certain data in the display file is longer than a preset duration, annotation interaction information can be generated based on the listener's eye movement information, and then the data of interest in the display file (i.e., the above-mentioned data being paid attention to) can be annotated based on the annotation interaction information.

[0145] It should be noted that in order to accurately dynamically annotate and / or dynamically display the data related to the meeting progress in the display file based on the annotation interaction information, in addition to obtaining the speaker's eye movement information, the speaker's voice information can also be obtained, and the voice information and eye movement information can be combined to generate annotation interaction information, and then the data related to the voice information in the display file can be dynamically annotated and / or dynamically displayed based on the generated annotation interaction information.

[0146] Example 4, see Attachment Figure 7 As shown, when the remote conference is in discussion mode, since the number of participants who can perform voice interaction operations in the remote conference is two or more, and since the display interface of the remote conference also needs to display the display file, in order to improve the quality and efficiency of the discussion, corresponding annotation interaction information can be generated based on the eye movement information of each participant, and then the preset data in the display file can be annotated and displayed based on the annotated interaction information. At this time, the number of annotated display data in the display file can be multiple.

[0147] In some instances, in order to distinguish the different display data corresponding to different participants, when annotating the display data, image information corresponding to each participant can be attached as an identity identifier, so that each person participating in the meeting can intuitively know the display data that each participant is concerned about, and then can interact and display based on each annotated display data, which effectively realizes fast and reliable discussion operations based on specific data in remote meetings.

[0148] It should be noted that in order to accurately mark and display the preset data in the display file based on the annotated interaction information, in addition to obtaining the listener's eye movement information, the listener's voice information can also be obtained, and the voice information and eye movement information can be combined to generate annotated interaction information. Then, based on the generated annotated interaction information, specific data related to the voice information in the display file can be annotated and displayed.

[0149] In the above implementation, each participant in the remote conference can conduct discussions quickly and accurately, and each person participating in the discussion can have a targeted discussion on a certain location data in the displayed file through eye contact. Other participants can intuitively locate the file location being discussed, thereby effectively omitting the interpretation cost of describing the location in words or the execution cost of manually marking the location.

[0150] In this embodiment, by determining the operating mode of the remote conference and then generating interactive information corresponding to the remote conference based on eye movement information and the operating mode, the quality and efficiency of generating the interactive information are effectively guaranteed, and the quality and effect of the remote conference are further improved.

[0151] Figure 8 A flowchart of another remote conference method provided by an embodiment of the present invention; based on the above embodiment, refer to the attached Figure 8 As shown, when the conference identity of the participant is a listener, after marking the data of interest in the display file based on the marked interaction information, the method in this embodiment may further include:

[0152] Step S801: collect statistics on the annotation interaction information of all listeners to obtain annotation statistical information.

[0153] Since the transmission quality and effect of the remote conference are closely related to the state of the listeners, in order to improve the transmission quality and effect of the remote conference, after the data of interest in the display file is annotated based on the annotation interaction information, the annotation interaction information of all listeners can be counted, so that the participants can obtain the annotation statistics information, such as Fig. 9 As shown, the annotation statistical information may include at least one of the following: the number of annotation interaction information corresponding to the display file, the display data position corresponding to the annotation interaction information, the identity of the participant corresponding to the annotation interaction information, and the like.

[0154] Step S802: Determine the conference hosting status of the presenter based on the marked statistical information.

[0155] Among them, the conference hosting status of the presenter may include: meeting the expected status (good conference hosting status), not meeting the expected status (poor conference hosting status), etc., and since different annotated statistical information may correspond to different conference hosting statuses, after obtaining the annotated statistical information, the annotated statistical information may be analyzed and processed to determine the conference hosting status of the presenter. In some instances, based on the annotated statistical information, determining the conference hosting status of the presenter may include: obtaining a machine learning model for analyzing and processing the conference hosting status, the machine learning model is trained to determine the conference hosting status of the presenter based on the annotated statistical information, and after obtaining the annotated statistical information, the annotated statistical information may be input into the machine learning model, so that the conference hosting status output by the machine learning model may be obtained.

[0156] In other instances, determining the conference hosting status of the speaker based on the marked statistical information may include: when the marked statistical information is less than a preset number, determining that the conference hosting status corresponding to the speaker does not meet the expected status; when the marked statistical information is greater than or equal to the preset number, determining that the conference hosting status corresponding to the speaker meets the expected status.

[0157] Specifically, a preset number for analyzing and processing the annotated statistical information (mainly referring to: the number of annotated interactive information corresponding to the display file) is pre-configured. After the annotated statistical information is obtained, the annotated statistical information can be analyzed and compared with the preset number. When the annotated statistical information is less than the preset number, it means that during the remote conference hosted by the speaker, the audience paid less attention to the content of the conference. At this time, it can be indirectly proved that the quality and effect of the remote conference hosted by the speaker are poor, and then it can be determined that the conference hosting status corresponding to the speaker does not meet the expected state. When the annotated statistical information is greater than or equal to the preset number, it means that during the remote conference hosted by the speaker, the audience paid more attention to the content of the conference. At this time, it can be indirectly proved that the quality and effect of the remote conference hosted by the speaker are good, and then it can be determined that the conference hosting status corresponding to the speaker meets the expected state.

[0158] In addition, after obtaining the annotation statistical information, the annotation statistical information can also be displayed to understand the participants' attention to the main content or specific issues through the number and concentration of avatar tags on the screen, thereby creating a heated discussion atmosphere, which is conducive to improving the quality and effectiveness of remote meetings.

[0159] Step S803: when the conference hosting status does not meet the expected status, an adjustment prompt message corresponding to the speaker is generated.

[0160] Specifically, when it is determined that the conference hosting status does not meet the expected status, in order to improve the quality and effect of the remote conference, adjustment prompt information corresponding to the speaker can be generated. The adjustment prompt information is used to prompt the speaker to adjust the hosting mode and presentation style of the remote conference to improve the quality and effect of the remote conference.

[0161] It should be noted that the method in this embodiment may further include: when the conference hosting status meets the expected status, there is no need to generate adjustment prompt information corresponding to the speaker, that is, the speaker can maintain the hosting status of the current remote conference status.

[0162] In this embodiment, the marked interaction information of all listeners is counted to obtain the marked statistical information, and then the conference hosting status of the speaker is determined based on the marked statistical information. When the conference hosting status does not meet the expected status, adjustment prompt information corresponding to the speaker is generated. This effectively realizes that when the hosting status of the remote conference is poor, the speaker can be reminded to adjust the speaking style and mode in time to improve the quality and effect of the remote conference, thereby further improving the practicality of the remote conference method.

[0163] Fig.10 A flowchart of another remote conference method provided by an embodiment of the present invention; based on the above embodiment, refer to the attached Fig.10 As shown, after the labeled statistical information is obtained and the labeled statistical information is greater than or equal to the preset quantity, the method in this embodiment may further include:

[0164] Step S1001: based on the annotation statistical information, determine the hotspot information corresponding to all listeners.

[0165] After statistics are collected on the annotated interaction information of all listeners and the annotated statistical information is obtained, the annotated statistical information can be analyzed and processed to determine the hot spots of interest corresponding to all listeners. In some instances, determining the hot spots of interest corresponding to all listeners based on the annotated statistical information may include: determining the number of corresponding annotated interaction information in the display file and the display data position corresponding to the annotated interaction information based on the annotated statistical information; when the number of annotated interaction information located in a preset area is greater than or equal to a preset number, the data in the preset area can be determined as the hot spots of interest corresponding to most listeners, thereby effectively ensuring the accuracy and reliability of the determination of the hot spots of interest.

[0166] Step S1002: Generate interactive prompt information based on the hot spot information, where the interactive prompt information is used to prompt the user whether to generate a communication group corresponding to the hot spot information based on the annotation statistical information.

[0167] After obtaining the hotspot information, the hotspot information can be analyzed and processed to generate interactive prompt information, which is used to prompt the user whether to generate a communication group corresponding to the hotspot information based on the marked statistical information. The interactive prompt information can be a pop-up prompt information, which can include a "confirmation control" for prompting the user to generate a communication group corresponding to the hotspot information based on the marked statistical information, and a "cancel control" for prompting the user not to generate a communication group corresponding to the hotspot information based on the marked statistical information.

[0168] Step S1003: In response to confirmation information of the interactive prompt information, a communication group corresponding to the hot spot information is generated.

[0169] When the user inputs and performs an operation on the "confirmation control" in the interactive prompt information, the user's confirmation information on the interactive prompt information is obtained, and then a communication group corresponding to the hot information can be generated based on the confirmation information. The communication group can include all the participant information corresponding to the hot information. For example, refer to the attached Fig.11 As shown, when there are three annotated interactive information corresponding to a certain position in the display file in the remote conference, it means that the data corresponding to the above display file position is the hot spot information. After obtaining the user's confirmation information on the interactive prompt information, a communication group corresponding to the above hot spot information can be generated based on the confirmation information. At this time, the communication group can include the participants and speakers corresponding to the above hot spot information. In the communication group, the participants and the speakers can quickly and effectively interact with the hot spot information.

[0170] In addition, the method in this embodiment may also include: when the user performs an operation on the "cancel control" input in the interactive prompt information, the user's cancellation information on the interactive prompt information is obtained. At this time, there is no need to generate a communication group corresponding to the hot spot information, thereby effectively realizing the flexibility of determining whether to establish a communication group based on user needs.

[0171] In this embodiment, the focus hotspot information corresponding to all listeners is determined based on the marked statistical information, and then interactive prompt information is generated based on the focus hotspot information, and in response to confirmation information of the interactive prompt information, a communication group corresponding to the focus hotspot information is generated, thereby effectively achieving that after the focus hotspot information is determined, a communication group can be generated based on the focus hotspot information, so that centralized and targeted communication and exchange operations on the focus hotspot information can be carried out quickly and effectively, thereby improving the transmission quality and efficiency of remote conferences.

[0172] Fig.12A flowchart of another remote conference method provided by an embodiment of the present invention; based on any of the above embodiments, refer to the attached Fig.12 As shown, the remote conference method in this embodiment can not only realize interactive operations in various operating modes, but also realize switching operations between various operating modes. At this time, in this embodiment, generating interactive information corresponding to the remote conference based on eye movement information and operating mode may include:

[0173] Step S1201: when the operation mode is the first mode, voice information is obtained.

[0174] The first mode may be any one of the following: lecture mode, dialogue mode, and discussion mode; when the operation mode is the first mode, voice information may be obtained, and the voice information may be the voice information sent by the speaker or the voice information sent by the participant. When the voice information is the voice information sent by the speaker, the voice information may be "adjust the operation mode of the remote conference to the second mode", "please ask student XX to share his or her views", etc.; when the voice information is the voice information sent by the participant, the voice information may be "for a certain position, I think...", etc.

[0175] Step S1202: Generate mode switching information corresponding to the remote conference based on the voice information and the eye movement information.

[0176] After acquiring the voice information and eye movement information, the voice information and eye movement information can be analyzed and processed to generate mode switching information corresponding to the remote conference, and the mode switching information is used to switch the remote conference from the first mode to the second mode, wherein the second mode can be another operating mode different from the first mode.

[0177] Step S1203: Switch the remote conference from the first mode to the second mode based on the mode switching information.

[0178] After the mode switching information is acquired, the mode switching information may be analyzed and processed to switch the remote conference from the first mode to the second mode based on the mode switching information, thereby effectively achieving a flexible switching operation of the operation mode of the remote conference.

[0179] Example 1: The operating mode of a remote conference can be switched by the control of the presenter. When the current operating mode of the remote conference is a lecture mode, if the presenter's voice information is obtained, for example, the voice information is "switch the operating mode of the remote conference to dialogue mode or discussion mode" or "please ask student XX to share his or her views", then based on the above voice information and eye movement information, mode switching information corresponding to the remote conference can be generated, and then the remote conference can be switched from lecture mode to dialogue mode or discussion mode based on the mode switching information.

[0180] Example 2: The operating mode of a remote conference can be automatically switched according to the voice information of the participants. When the current operating mode of the remote conference is the lecture mode, the voice information of multiple participants is obtained within a preset time period. When the voice information of two participants is obtained at the same time, the current operating mode of the remote conference can be switched from the lecture mode to the dialogue mode; when the voice information of multiple participants is obtained at the same time, the current operating mode of the remote conference can be switched from the lecture mode to the discussion mode, thereby effectively realizing the automatic and effective switching operation of the remote conference between different operating modes.

[0181] In this embodiment, when the operating mode of the remote conference is the first mode, voice information is obtained, and then mode switching information corresponding to the remote conference can be generated based on the voice information and eye movement information, and the remote conference is switched from the first mode to the second mode based on the mode switching information, thereby effectively realizing automatic or active mode switching operation of the operating mode of the remote conference, and further improving the flexibility and reliability of the use of the remote conference method.

[0182] In specific application, this application embodiment provides a remote conference method, which can implement an information interaction method for a remote conference based on eye tracking technology, and can allow participants to perform more natural human-computer interaction operations in a variety of different remote conference modes. In specific implementation, the executor for implementing the above-mentioned remote conference method can be a head-mounted display device implemented based on AR / VR technology, and can also be applied to a transmission client.

[0183] For example, a remote conference has speech mode, discussion mode and dialogue mode. The speech mode is used to achieve dynamic guidance of sight mark, the discussion mode is used to achieve multi-mark focus discussion hotspot, and the dialogue mode is used to achieve gaze-evoking dialogue relationship. Fig.13 As shown, the above-mentioned remote conference method may include the following steps:

[0184] Step 1: A remote conference room (which may be a virtual conference room) is formed through multiple remote conference rooms, and then each participant can enter the virtual conference room.

[0185] Step 2: Identify and number the participants.

[0186] Step 3: Identify the scene mode of the meeting, such as speech mode, conversation mode or discussion mode, through analysis of sound or environmental factors.

[0187] Step 4: Use eye movement recognition technology to locate the line of sight of one or more "speakers" (i.e., eye movement information) in real time.

[0188] Step 5: The position of the line of sight will be marked with a role-based interaction identifier on the video conference interface, or a menu function will be triggered (such as calling up the communication partner).

[0189] The technical solution provided by this application embodiment not only enables the speaker and the participants to interact naturally based on eye movement information, but also makes the rhythm of the remote conference more natural, flexible and reliable, thereby effectively ensuring the quality and effect of conference information transmission and further improving the practicality of the method.

[0190] Fig.14 A flow chart of a data interaction method provided by an embodiment of the present invention; see attached Fig.14 As shown, this embodiment provides a data interaction method, the execution subject of the method can be a data interaction device, and the data interaction device can be implemented as software, or a combination of software and hardware. Specifically, when the data interaction device is hardware, it can be various electronic devices with display screens and eye tracking devices, including but not limited to smart phones, tablet computers, personal computers PCs, conference room display devices, head-mounted display devices based on XR technology, etc. When the data interaction device is implemented as software, it can be installed in the electronic devices listed above. The data interaction method in this embodiment may include the following steps:

[0191] Step S1401: Acquire the data to be processed displayed in the display interface.

[0192] Among them, the data to be processed may include at least one of the following: image data, design data, research and development data, consumer tendency survey data, etc. The above-mentioned data to be processed may be uploaded by the user to the data interaction device, so that the data interaction device can obtain the data to be processed that needs to be displayed; or, the above-mentioned data to be processed may be stored in a preset area, and the data to be processed that needs to be displayed can be obtained by accessing the preset area.

[0193] After the data to be processed is acquired, the data to be processed may be displayed in a display interface, so that all persons who can view the display interface may perform data interaction operations based on the displayed data to be processed.

[0194] Step S1402: determining eye movement information of the data to be processed that is viewed by multiple persons respectively.

[0195] After the data to be processed is obtained and displayed, the eye movement information of multiple persons who respectively viewed the data to be processed can be determined, wherein the specific method of obtaining the eye movement information is similar to the implementation method of step S201 in the above embodiment, and will not be repeated here.

[0196] Step S1403: Generate interaction information corresponding to the data to be processed based on the eye movement information.

[0197] Among them, generating interactive information corresponding to the data to be processed based on eye movement information may include: in the data to be processed, determining the data of interest corresponding to each person based on the eye movement information; generating annotated interactive information corresponding to the data of interest corresponding to each person, and the annotated interactive information is used to annotate and display the data of interest.

[0198] Specifically, the implementation of the above steps in this embodiment is similar to the implementation of step S202 and step S302 in the above embodiment. For details, please refer to the above statements and will not be repeated here.

[0199] Step S1404: annotate and display the data to be processed based on the interactive information.

[0200] Specifically, the implementation method of the above steps in this embodiment is similar to the implementation method of step S203 in the above embodiment. For details, please refer to the above statements and will not be repeated here.

[0201] Example 1: When the data to be processed is design data or research and development data that needs to be analyzed and processed, after obtaining the above-mentioned design data or research and development data, the design data or research and development data can be displayed through a display interface, wherein the display interface can refer to a display interface shared by multiple data interaction devices, that is, the above-mentioned design data or research and development data can be displayed in the display interfaces corresponding to each of the multiple data interaction devices.

[0202] When a user views design data or research and development data through the display interface of a data interaction device, the eye movement information corresponding to each person viewing the design data or research and development data can be obtained through the eye tracking device on the data interaction device. The eye movement information may include: eye movement amplitude (or movement distance), movement path, movement direction (up, down, left, right, etc.), movement type (blinking, closing eyes, etc.), number of movements, length of stay in a preset area, eye gaze angle information, etc.

[0203] After obtaining the eye movement information of each person, the eye movement information can be analyzed and processed, so as to determine the data of interest corresponding to each person. The data of interest can be part of the design data or R&D data. It should be noted that the number of data of interest corresponding to a person can be one or more, and then the interactive information corresponding to the data of interest in the data to be processed can be generated. For example: when the design data is vehicle design data, the data of interest corresponding to user A can be the data of the front part of the vehicle, the data of interest corresponding to user B can be the data of the window part of the vehicle, the data of interest corresponding to user C can be the data of the headlight part of the vehicle, and so on.

[0204] After generating the above-mentioned interactive information, the data to be processed can be annotated and displayed based on the interactive information, mainly for the data of interest corresponding to each user. This makes it easy for all personnel who view the design data or R&D data to understand the parts of interest corresponding to other users, and then facilitate communication and discussion based on the marked parts of interest. For example: User A believes that the parameters of the front part data are inappropriate and need to be modified appropriately; User B believes that the size of the window part data needs to be adjusted, and User C believes that the outline of the headlight part data needs to be adjusted, etc. This effectively improves the quality and efficiency of communication and discussion on design data or R&D data, and further improves the practicality of the data interaction method.

[0205] Example 2: When the data to be processed is image data that needs to be analyzed and processed (for example, advertising images, promotional images, etc.) or consumer tendency survey data (electronic data corresponding to the items to be traded corresponding to a certain platform, for example, a model of the items to be traded corresponding to a certain supermarket), after obtaining the above-mentioned image data or consumer tendency survey data, the image data or consumer tendency survey data can be displayed through a display interface, wherein the display interface can refer to a display interface shared by multiple data interaction devices, that is, the above-mentioned image data or consumer tendency survey data can be displayed in the display interfaces corresponding to each of the multiple data interaction devices.

[0206] When a user views image data or consumer tendency survey data through the display interface of a data interaction device, the eye movement information corresponding to each person viewing the design data or R&D data can be obtained through the eye tracking device on the data interaction device. The eye movement information may include: eye movement amplitude (or movement distance), movement path, movement direction (up, down, left, right, etc.), movement type (blinking, closing eyes, etc.), number of movements, length of stay in a preset area, eye gaze angle information, etc.

[0207] After obtaining the eye movement information of each person, the eye movement information can be analyzed and processed, so as to determine the interested parts corresponding to each person. The interested parts can be part of the image data or the consumer preference survey data. It should be noted that the number of interested data corresponding to one person can be one or more, and then the interaction information corresponding to the interested parts can be generated. For example, when the image data is an advertisement image, based on the eye movement information of user A, it can be determined that the interested part corresponding to user A can be the upper half of the image. Based on the eye movement information of user B, it can be determined that the interested part corresponding to user B can be the upper half of the image. Based on the eye movement information of user C, it can be determined that the interested part corresponding to user C can be the middle part of the image, etc. Or, when the consumer preference survey data is the product model image corresponding to a certain trading platform, the purchase tendency of item a can be determined as P1, the purchase tendency of item b can be determined as P2, and the purchase tendency of item c can be determined as P3 based on the eye movement information of multiple users, where P1 < P2 < P3.

[0208] After generating the above interaction information, the data to be processed can be marked and displayed based on the interaction information, mainly by marking the interested parts corresponding to each user respectively. This is convenient for all personnel viewing the image data to understand the interested parts corresponding to other users, and then it is convenient to communicate and discuss based on the marked interested parts. For example, when user A and user B are interested in the upper half of the image, and user C is interested in the middle part of the image, at this time, it means that the attraction of the lower half of the image data is weak, and then the lower half of the image data can be adjusted, etc. This effectively improves the quality and efficiency of communicating and discussing the image data, and further improves the practicability of this data interaction method.

[0209] In addition, after marking the interested parts of each user in the consumer preference survey data, the purchase tendency of each user corresponding to each trading item can be intuitively obtained. For example, 15% of the users have a purchase tendency of P1 for item a, 10% of the users have a purchase tendency of P2 for item b, and 75% of the users have a purchase tendency of P3 for item c, where P1 < P2 < P3. After obtaining the number of users interested in a certain item and the purchase tendency above, the inventory quantity and the platform's pending transaction quantity of each item can be adjusted based on the purchase tendency corresponding to different items. This effectively realizes the timely and flexible adjustment operation of the inventory quantity and the platform's pending transaction quantity of trading items based on the consumer preference survey data, so as to not only meet the purchase needs of users, but also improve the transaction rate of goods, and further improve the practicability of this method.

[0210] It should be noted that the method in this embodiment can also execute Figure 3-Figure 13For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Figure 3-Figure 13 The implementation process and technical effects of this technical solution refer to Figure 3-Figure 13 The description in the illustrated embodiment will not be repeated here.

[0211] The data interaction method in this embodiment obtains the data to be processed displayed in the display interface, determines the eye movement information of multiple persons viewing the data to be processed respectively, and then generates interaction information corresponding to the data to be processed based on the eye movement information, and annotates and displays the data to be processed based on the interaction information, thereby effectively realizing the ability to interact with the data to be processed according to the eye movement information of each person, and also making the rhythm of processing the data to be processed more direct and reliable, which effectively guarantees the quality and effect of the data interaction method and further improves the practicability of the method.

[0212] Fig.15 A flow chart of another data interaction method provided by an embodiment of the present invention; see attached Fig.15 As shown, this embodiment provides another data interaction method, the execution subject of the method can be a data interaction device, and the data interaction device can be implemented as software, or a combination of software and hardware. Specifically, when the data interaction device is hardware, it can be various electronic devices with display screens and eye tracking devices. The electronic devices can mainly include head-mounted display devices based on augmented reality (AR), head-mounted display devices based on virtual reality (VR) or mixed reality (MR, or Hybrid Reality, HR) or cinematic reality (CR), etc. When the data interaction device is implemented as software, it can be installed in the electronic devices listed above. The data interaction method in this embodiment may include the following steps:

[0213] Step S1501: Acquire a preset virtual space generated by virtual reality technology.

[0214] Extended Reality (XR) technology refers to a combination of real and virtual, human-computer interactive environment generated by computer technology and wearable devices. XR can include Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR), Cinematic Reality (CR) and other forms. In other words, XR is actually a general term, including AR, VR, MR, and CR. In simple terms, XR can be divided into multiple levels, and can go from a virtual world with limited sensor input to a fully immersive virtual world.

[0215] In order to realize data interaction operations, when users need to perform data interaction operations, they can first use virtual reality technology and related data to generate a preset virtual space, so as to obtain the preset virtual space generated by virtual reality technology. In some instances, the preset virtual space can be a preset virtual conference room or a preset game space, etc.

[0216] Step S1502: Determine the eye movement information corresponding to each person participating in the preset virtual space.

[0217] Among them, the preset virtual space may include two or more persons. In order to realize data interaction operations, the eye movement information corresponding to each person participating in the preset virtual space can be determined. The specific method of obtaining the eye movement information corresponding to each person participating in the preset virtual space in this embodiment is similar to the implementation method of step S201 in the above embodiment. Please refer to the above statement for details, which will not be repeated here.

[0218] Step S1503: Generate interaction information corresponding to the preset virtual space based on the eye movement information.

[0219] Step S1504: performing an interactive operation corresponding to the preset virtual space based on the interactive information.

[0220] The specific implementation process and implementation effect of step S1503-step S1504 in this embodiment are similar to the specific implementation process and implementation effect of step S202-step S203 in the above embodiment. Please refer to the above statements for details, and no further details will be given here.

[0221] For example, when the preset virtual space is a game space realized by VR technology, the data interaction device at this time can be realized as a head-mounted display device realized by VR technology, and the user can obtain the user's eye movement information through the eye tracking device included in the head-mounted display device, and then the interaction information in the game space can be generated based on the eye movement information, and the interaction information may include: scene information of switching game space, information of responding to the interface displayed in the game space, information of interactive operation on virtual items in the game space, etc. After obtaining the user's interaction information, the interaction operation corresponding to the preset virtual space can be performed based on the interaction information, thereby realizing effective interaction operation in the preset virtual space through eye movement information, and further improving the practicality of the method.

[0222] The data interaction method provided in this embodiment obtains a preset virtual space generated by using virtual reality technology, determines the eye movement information corresponding to each person participating in the preset virtual space, and then generates interaction information corresponding to the preset virtual space based on the eye movement information, and performs interaction operations corresponding to the preset virtual space based on the interaction information, thereby effectively realizing the ability to perform interaction operations based on the eye movement information of each person in the preset virtual space, and also making the rhythm of interaction with the preset virtual space more flexible and reliable, thereby effectively ensuring the quality and effect of the data interaction method and further improving the practicability of the method.

[0223] Fig.16 A schematic diagram of another remote conference method provided by an embodiment of the present invention; Fig.16 As shown, this embodiment provides another remote conference method, the execution subject of the method can be a remote conference device, and the remote conference device can be implemented as software, or a combination of software and hardware. Specifically, when the remote conference device is implemented as hardware, it can be various electronic devices with display screens and eye tracking devices, including but not limited to smart phones, tablet computers, personal computers PCs, conference room display devices, head-mounted display devices implemented by augmented reality (AR), virtual reality (VR) or mixed reality (MR) technology, etc. When the remote conference device is implemented as software, it can be installed in the electronic devices listed above. Based on the above-mentioned remote conference device, the remote conference method in this embodiment may include the following steps:

[0224] Step S1601: Acquire conference authority information of each participating terminal in the remote conference.

[0225] Among them, a remote conference may include multiple different participating terminals. For different participating terminals in the conference, different participating terminals may correspond to different conference permission information, and the above-mentioned conference permission information can directly affect the display data of the participating terminals. Therefore, in order to ensure the security and reliability of data display, when conducting a remote conference, all participating terminals included in the remote conference can be obtained, and then the conference permission information of each participating terminal can be determined. The conference permission information is used to identify the data display permission corresponding to the participating terminal.

[0226] Specifically, this embodiment does not limit the specific implementation method for obtaining the conference permission information of each participating terminal in the remote conference. Technical personnel in this field can make settings according to specific application scenarios or application requirements. In some instances, a mapping relationship between user identity and conference permission information is pre-configured. When a user accesses a remote conference through a participating terminal, the user identity corresponding to each participating terminal can be obtained. Specifically, before the participating terminal enters the remote conference, an identity authentication operation can be performed on the user corresponding to the participating terminal, for example: asking the user to enter a user name, conference password, etc. After obtaining the user identity, the conference permission information corresponding to each participating terminal in the remote conference can be determined based on the user identity and the mapping relationship.

[0227] For example, the participant terminal corresponding to the presenter can connect to multiple other participant terminals through a preset network, and the other participant terminals include: participant terminal a, participant terminal b, and participant terminal c. For example, participant terminal a corresponds to user A, participant terminal b corresponds to user B, and participant terminal c corresponds to user C. Before multiple other participant terminals access the remote conference hosted by the participant terminal through the preset network, identity recognition operations can be performed on each participant terminal respectively. Specifically, pop-up window information for verifying the authority of each participant can be displayed in the display interface of each participant terminal. The pop-up window information can obtain the identity information of each participant, the remote conference entry password and other information.

[0228] After obtaining the identity information of each participant, the conference permission information corresponding to each participant terminal can be determined based on the identity information of each participant. For example: based on the identity information of user A, the conference permission information of participant terminal a can be determined to be conference permission 1, which has a higher authority; based on the identity information of user B, the conference permission information of participant terminal b can be determined to be conference permission 2, which has a lower authority than conference permission 1; based on the identity information of user C, the conference permission information of participant terminal c can be determined to be conference permission 3, which has a lower authority than conference permission 2.

[0229] Step S1602: determining conference data that can be displayed by each participating terminal based on the conference authority information, where the conference data includes at least a portion of a display file that needs to be presented in the remote conference.

[0230] Among them, since different conference permission information may correspond to different data display permissions, in order to enable the relevant data of the corresponding permissions to be displayed in each participating terminal, after obtaining the conference permission information of each participating terminal in the remote conference, the conference permission information can be analyzed and processed to determine the conference data that each participating terminal can display, wherein the conference data includes at least a part of the display file that needs to be displayed in the remote conference, and the conference data may include at least one of the following: two-dimensional display data, three-dimensional display data, and the like.

[0231] In some instances, determining the conference data that can be displayed by each participating terminal based on conference permission information may include: obtaining file display permissions corresponding to each part of the display file that needs to be displayed in the remote conference; determining the target file display permissions corresponding to the conference permission information; in the display file, determining all data that is less than or equal to the target file display permissions as conference data that can be displayed by each participating terminal. At this time, the conference data only includes data corresponding to the conference permission information of each participating terminal, and does not include other data. This effectively realizes the ability to determine the conference data that can be displayed by the participating terminals based on different conference permission information, thereby ensuring the accuracy and reliability of the determination of the conference data.

[0232] In other instances, determining the conference data that can be displayed by each participating terminal based on the conference permission information may include: in a display file, determining the in-authority data and out-of-authority data corresponding to each participating terminal based on the conference permission information; processing the out-of-authority data to obtain processed data that cannot be viewed; and obtaining the conference data that can be displayed by each participating terminal based on the processed data and the in-authority data.

[0233] Specifically, in order to accurately obtain the conference data that can be displayed by each participating terminal, the display file that needs to be displayed in the remote conference can be obtained first. For the data in the display file, different data can correspond to different conference permission information. Therefore, after obtaining the conference permission information, the in-permission data and out-of-permission data corresponding to each participating terminal can be determined based on the conference permission information, wherein the in-permission data can refer to data less than or equal to the conference permission information, and the out-of-permission data can refer to data greater than the conference permission information. It can be understood that for the same display file, different conference permission information can correspond to different in-permission data and out-of-permission data. Generally, the higher the priority of the conference permission information (for example: the conference permission information is conference permission 1), the more in-permission data and the less out-of-permission data it corresponds to. The lower the priority of the conference permission information (for example: the conference permission information is conference permission 3), the less in-permission data and the more out-of-permission data it corresponds to.

[0234] After obtaining the authorized data and the unauthorized data, since the unauthorized data cannot be displayed on the display interface of the corresponding conference terminal, in order to enable the participating terminals with different conference authority information to display the data of the corresponding authority without displaying any unauthorized data, after obtaining the unauthorized data, the unauthorized data can be processed. Specifically, the unauthorized data can be encoded, encrypted, deleted, etc., so that the processed data that cannot be viewed can be obtained. After obtaining the processed data, the processed data and the authorized data can be spliced ​​or combined, so that the conference data that can be displayed by each participating terminal can be obtained.

[0235] For example, when the presenter needs to conduct a project report, since the project includes multiple departments and different departments are responsible for managing different parts of the project, in order to avoid the progress and information between different departments affecting each other, different departments can be configured with different meeting permission information.

[0236] When the speaker holds a remote meeting with the heads of various departments, the meeting permission information corresponding to the participating terminals corresponding to the heads can be determined based on the identity information of the heads of various departments. For example, the participating terminal corresponding to the head of the first department is participating terminal a, the participating terminal corresponding to the head of the second department is participating terminal b, and the participating terminal corresponding to the head of the third department is participating terminal c. Through analysis, it can be determined that the meeting permission information corresponding to participating terminal a is meeting permission 1, the meeting permission information of participating terminal b is meeting permission 2, and the meeting permission information of participating terminal c is meeting permission 3.

[0237] Since the authority of conference authority 3 is lower than that of conference authority 2, and the authority of conference authority 2 is lower than that of conference authority 1, then based on the authority of conference authority 1, it can be determined that the data that participating terminal a can display is the entire display file, based on the authority of conference authority 2, it can be determined that the data that participating terminal b can display is a part of the display file, and based on the authority of conference authority 3, it can be determined that the data that participating terminal c can display is a smaller part of the display file, thereby effectively realizing the ability to accurately determine the conference data that each participating terminal can display based on the conference authority information.

[0238] Step S1603: using the participating terminals to display the corresponding conference data.

[0239] After obtaining the conference data that can be displayed by each participating terminal, the corresponding conference data can be displayed using the participating terminal, thereby effectively enabling users with different permissions to see conference data that matches their user permissions through the participating terminal, thereby effectively avoiding the risk of conference data leakage and ensuring the security and reliability of conference data display.

[0240] In some instances, when the conference data that needs to be displayed on the participating terminals is composed of authorized data and processed data, when displaying the conference data, in order to accurately distinguish between the authorized data and the processed data, identification information that cannot be displayed can be added to the part corresponding to the processed data. The identification information can be a "lock icon", "XX logo", etc., so that the user can intuitively know through the displayed identification information that there is other data that does not match the user's permissions in the currently displayed display document.

[0241] It should be noted that the method in this embodiment may also include the above Figure 1-Figure 13 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Figure 1-Figure 13 The implementation process and technical effects of this technical solution refer to Figure 1-Figure 13 The description in the illustrated embodiment will not be repeated here.

[0242] The remote conference method provided in this embodiment obtains the conference authority information of each participating terminal in the remote conference, and then determines the conference data that each participating terminal can display based on the conference authority information, and uses the participating terminal to display the corresponding conference data, thereby effectively achieving the goal of enabling each participating terminal to only display conference data that matches the conference authority information. This not only ensures the security and confidentiality of data display, but also avoids the risk of data leakage, and further improves the security and reliability of remote conferences.

[0243] Fig.17A schematic diagram of a remote conference device provided by an embodiment of the present invention; Fig.17 As shown, this embodiment provides a remote conference device, which is used to perform the above Figure 2 The remote conference method shown, specifically, the remote conference device may include:

[0244] A first acquisition module 11 is used to acquire eye movement information of participants participating in the remote conference;

[0245] A first generating module 12, configured to generate interaction information corresponding to the remote conference based on the eye movement information;

[0246] The first processing module 13 is used to perform an interactive operation corresponding to the remote conference based on the interactive information to assist the remote conference.

[0247] In some instances, when the first generating module 12 generates interaction information corresponding to the remote conference based on eye movement information, the first generating module 12 is used to execute: determining the operation mode of the remote conference; and generating interaction information corresponding to the remote conference based on the eye movement information and the operation mode.

[0248] In some examples, when the first generating module 12 determines the operation mode of the remote conference, the first generating module 12 is used to execute: obtaining sound configuration information corresponding to each participant participating in the remote conference; and determining the operation mode of the remote conference based on the sound configuration information.

[0249] In some instances, when the first generating module 12 determines the operation mode of the remote conference based on the sound configuration information, the first generating module 12 is used to execute: detecting whether there is a display file in the remote conference; and determining the operation mode of the remote conference based on the detection result of the display file and the sound configuration information.

[0250] In some instances, when the first generation module 12 determines the operating mode of the remote conference based on the detection result of the display file and the sound configuration information, the first generation module 12 is used to execute: based on the sound configuration information, counting the number of people who can perform voice interaction operations within a preset time period; when the detection result is that the display file exists and the number of people is one, determining that the operating mode is the lecture mode; when the detection result is that the display file exists and the number of people is at least two, determining that the operating mode is the discussion mode; when the detection result is that the display file does not exist and the number of people is at least two, determining that the operating mode is the dialogue mode.

[0251] In some examples, when the first generating module 12 generates interaction information corresponding to the remote conference based on the eye movement information and the operation mode, the first generating module 12 is used to perform: when the operation mode is the dialogue mode, generating dialogue interaction information corresponding to the participants in the remote conference based on the eye movement information, and the dialogue interaction information is used to determine the target participant who is about to have a dialogue with the presenter in the remote conference;

[0252] At this time, when the first processing module 13 performs interactive operations corresponding to the remote conference based on the interactive information, the first processing module 13 is used to perform: determining the target participant who is about to have a conversation with the speaker in the remote conference based on the dialogue interaction information; generating dialogue prompt information with the target participant, so that the target participant can have a conversation with the speaker based on the dialogue prompt information.

[0253] In some examples, when the first generating module 12 generates interaction information corresponding to the remote conference based on the eye movement information and the operation mode, the first generating module 12 is used to perform: when the operation mode is the lecture mode or the discussion mode, generating annotation interaction information corresponding to the display file in the remote conference based on the eye movement information;

[0254] When the first processing module 13 performs the interactive operation corresponding to the remote conference based on the interactive information, the first processing module 13 is used to perform: annotating and displaying the display file based on the annotated interactive information.

[0255] In some instances, when the first processing module 13 annotates and displays a display file based on the annotation interaction information, the first processing module 13 is used to execute: determining the conference identity of the participant corresponding to the eye movement information; when the conference identity is the speaker, dynamically annotating and / or dynamically displaying the data related to the conference progress in the display file based on the annotation interaction information; when the conference identity is the listener, annotating the data of interest in the display file based on the annotation interaction information.

[0256] In some examples, after the data of interest in the display file is annotated based on the annotation interaction information, the first acquisition module 11 and the first processing module 13 in this embodiment are used to perform the following steps:

[0257] A first acquisition module 11 is used to collect statistics of the annotation interaction information of all listeners to obtain annotation statistical information;

[0258] The first processing module 13 is used to determine the conference hosting status of the speaker based on the marked statistical information; when the conference hosting status does not meet the expected status, generate adjustment prompt information corresponding to the speaker.

[0259] In some instances, when the first processing module 13 determines the conference hosting status of the speaker based on the marked statistical information, the first processing module 13 is used to execute: when the marked statistical information is less than a preset number, it is determined that the conference hosting status corresponding to the speaker does not meet the expected state; when the marked statistical information is greater than or equal to the preset number, it is determined that the conference hosting status corresponding to the speaker meets the expected state.

[0260] In some instances, after the marked statistical information is greater than or equal to a preset number, the first processing module 13 in this embodiment is used to execute: based on the marked statistical information, determine the hot spot information corresponding to all listeners; based on the hot spot information, generate interactive prompt information, the interactive prompt information is used to prompt the user whether to generate a communication group corresponding to the hot spot information based on the marked statistical information; in response to confirmation information of the interactive prompt information, generate a communication group corresponding to the hot spot information.

[0261] In some instances, when the first generating module 12 generates interaction information corresponding to the remote conference based on the eye movement information and the operating mode, the first generating module 12 is used to execute: when the operating mode is the first mode, obtaining voice information; based on the voice information and the eye movement information, generating mode switching information corresponding to the remote conference; and switching the remote conference from the first mode to the second mode based on the mode switching information.

[0262] Fig.17 The device shown can perform Figure 1-Figure 13 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Figure 1-Figure 13 The implementation process and technical effects of this technical solution refer to Figure 1-Figure 13 The description in the illustrated embodiment will not be repeated here.

[0263] In one possible design, Fig.17 The structure of the remote conference device shown can be implemented as an electronic device, which can be a smart phone, a tablet computer, a personal computer PC, a conference room display device, etc. Fig.18 As shown, the electronic device may include: a first processor 21 and a first memory 22. The first memory 22 is used to store the corresponding electronic device to execute the above Figure 1-Figure 13 In the illustrated embodiment, the first processor 21 is configured to execute the program stored in the first memory 22 .

[0264] The program includes one or more computer instructions, wherein when one or more computer instructions are executed by the first processor 21, the following steps can be implemented: obtaining eye movement information of participants in the remote conference; generating interactive information corresponding to the remote conference based on the eye movement information; and performing interactive operations corresponding to the remote conference based on the interactive information to assist the remote conference.

[0265] Furthermore, the first processor 21 is also used to execute the aforementioned Figure 1-Figure 13 All or part of the steps in the illustrated embodiments.

[0266] The structure of the electronic device may further include a first communication interface 23 for the electronic device to communicate with other devices or a communication network.

[0267] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Figure 1-Figure 13 The procedures involved in the remote conference method in the method embodiment shown.

[0268] In addition, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the above Figure 1-Figure 13 Steps in the remote conferencing method shown.

[0269] Fig.19 A schematic diagram of a data interaction device provided by an embodiment of the present invention; Fig.19 As shown, this embodiment provides a data interaction device, which is used to perform the above Fig.14 The data interaction method shown, specifically, the data interaction device may include:

[0270] The second acquisition module 31 is used to acquire the data to be processed displayed in the display interface;

[0271] A second determination module 32 is used to determine eye movement information of multiple persons viewing the data to be processed respectively;

[0272] A second generating module 33, used to generate interaction information corresponding to the data to be processed based on the eye movement information;

[0273] The second processing module 34 is used to annotate and display the data to be processed based on the interactive information.

[0274] In some instances, when the second generating module 33 generates interaction information corresponding to the data to be processed based on the eye movement information, the second generating module 33 is used to execute: determining the data of interest corresponding to each person in the data to be processed based on the eye movement information; generating annotated interaction information corresponding to the data of interest corresponding to each person, and the annotated interaction information is used to annotate and display the data of interest.

[0275] Fig.19 The device shown can perform Fig.14 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Fig.14 The implementation process and technical effects of this technical solution refer to Fig.14 The description in the illustrated embodiment will not be repeated here.

[0276] In one possible design, Fig.19 The structure of the data interaction device shown can be implemented as an electronic device, which can be a smart phone, a tablet computer, a personal computer PC, a conference room display device, a head-mounted display device based on XR technology, and other devices. Fig. 20 As shown, the electronic device may include: a second processor 41 and a second memory 42. The second memory 42 is used to store the corresponding electronic device executing the above Fig.14 The program of the data interaction method in the illustrated embodiment, the second processor 41 is configured to execute the program stored in the second memory 42 .

[0277] The program includes one or more computer instructions, wherein when one or more computer instructions are executed by the second processor 41, the following steps can be implemented: obtaining the data to be processed displayed in the display interface; determining the eye movement information of multiple persons viewing the data to be processed respectively; based on the eye movement information, generating interactive information corresponding to the data to be processed; and annotating and displaying the data to be processed based on the interactive information.

[0278] Furthermore, the second processor 41 is also used to execute the aforementioned Fig.14 All or part of the steps in the illustrated embodiments.

[0279] The structure of the electronic device may further include a second communication interface 43 for the electronic device to communicate with other devices or a communication network.

[0280] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Fig.14 The procedures involved in the data interaction method in the method embodiment shown.

[0281] In addition, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the above Fig.14 The steps in the data interaction method shown.

[0282] Fig.21 A schematic diagram of another data interaction device provided by an embodiment of the present invention; see attached Fig.21 As shown, this embodiment provides another data interaction device, which is used to perform the above Fig.15 The data interaction method shown, specifically, the data interaction device may include:

[0283] A third acquisition module 51 is used to acquire a preset virtual space generated by virtual reality technology;

[0284] A third determination module 52 is used to determine eye movement information corresponding to each person participating in the preset virtual space;

[0285] A third generating module 53, used to generate interaction information corresponding to a preset virtual space based on the eye movement information;

[0286] The third processing module 54 is used to perform an interactive operation corresponding to the preset virtual space based on the interactive information.

[0287] Fig.21 The device shown can perform Fig.15 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Fig.15 The implementation process and technical effects of this technical solution refer to Fig.15 The description in the illustrated embodiment will not be repeated here.

[0288] In one possible design, Fig.21 The structure of the data interaction device shown can be implemented as an electronic device, which can be a wearable device. The wearable device can be: a head-mounted display device based on augmented reality (AR), a head-mounted display device based on virtual reality (VR) or mixed reality (MR), a head-mounted display device based on hybrid reality (HR) or cinematic reality (CR). Fig. 22 As shown, the electronic device may include: a third processor 61 and a third memory 62. The third memory 62 is used to store the corresponding electronic device executing the above Fig. 22The program of the data interaction method in the illustrated embodiment, the third processor 61 is configured to execute the program stored in the third memory 62 .

[0289] The program includes one or more computer instructions, wherein when one or more computer instructions are executed by the third processor 61, the following steps can be implemented: obtaining a preset virtual space generated by virtual reality technology; determining eye movement information corresponding to each person participating in the preset virtual space; based on the eye movement information, generating interaction information corresponding to the preset virtual space; and performing interaction operations corresponding to the preset virtual space based on the interaction information.

[0290] Furthermore, the third processor 61 is also used to execute the aforementioned Fig.15 All or part of the steps in the illustrated embodiments.

[0291] The structure of the electronic device may further include a third communication interface 63 for the electronic device to communicate with other devices or a communication network.

[0292] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Fig.15 The procedures involved in the data interaction method in the method embodiment shown.

[0293] In addition, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the above Fig.15 The steps in the data interaction method shown.

[0294] Fig.23 A schematic diagram of the structure of another remote conference device provided by an embodiment of the present invention; Fig.23 As shown, this embodiment provides another remote conference device, which is used to perform the above Fig.16 The remote conference method shown, specifically, the remote conference device may include:

[0295] The fourth acquisition module 71 is used to obtain the conference authority information of each participating terminal in the remote conference;

[0296] A fourth determining module 72, configured to determine conference data that can be displayed by each participating terminal based on the conference authority information, where the conference data includes at least a portion of a display file that needs to be displayed in the remote conference;

[0297] The fourth processing module 73 is used to display the corresponding conference data using the participating terminals.

[0298] In some instances, when the fourth determination module 72 determines the conference data that can be displayed by each participating terminal based on the conference permission information, the fourth determination module 72 can be used to execute: in the display file, determine the in-authority data and out-of-authority data corresponding to each participating terminal based on the conference permission information; process the out-of-authority data to obtain processed data that cannot be viewed; and obtain the conference data that can be displayed by each participating terminal based on the processed data and the in-authority data.

[0299] Fig.23 The device shown can perform Fig.16 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Fig.16 The implementation process and technical effects of this technical solution refer to Fig.16 The description in the illustrated embodiment will not be repeated here.

[0300] In one possible design, Fig.23 The structure of the remote conference device shown can be implemented as an electronic device, which can be a smart phone, a tablet computer, a personal computer PC, a conference room display device, etc. Fig.24 As shown, the electronic device may include: a fourth processor 81 and a fourth memory 82. The fourth memory 82 is used to store the corresponding electronic device executing the above Fig.16 The program of the remote conference method in the illustrated embodiment, the fourth processor 81 is configured to execute the program stored in the fourth memory 82.

[0301] The program includes one or more computer instructions, wherein when one or more computer instructions are executed by the fourth processor 81, the following steps can be implemented: obtaining conference permission information of each participating terminal in the remote conference; determining the conference data that can be displayed by each participating terminal based on the conference permission information, and the conference data includes at least a part of the display file that needs to be displayed in the remote conference; using the participating terminal to display the corresponding conference data.

[0302] Furthermore, the fourth processor 81 is also used to execute the aforementioned Fig.16 All or part of the steps in the illustrated embodiments.

[0303] The structure of the electronic device may further include a fourth communication interface 83 for the electronic device to communicate with other devices or a communication network.

[0304] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Fig.16 The procedures involved in the remote conference method in the method embodiment shown.

[0305] In addition, an embodiment of the present invention provides a computer program product, including: a computer program, when the computer program is executed by a processor of an electronic device, the processor executes the above Fig.16 Steps in the remote conferencing method shown.

[0306] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative effort.

[0307] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course can also be implemented by combining hardware and software. Based on such an understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present invention can be in the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0308] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to produce a machine, so that the instructions executed by the processor of the computer or other programmable device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0309] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0310] These computer program instructions may also be loaded onto a computer or other programmable device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0311] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0312] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0313] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0314] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A remote conference method, characterized in that: include: Obtain eye movement information of participants in remote conferences; Based on the eye movement information, generating interaction information corresponding to the remote conference; The step of generating interaction information corresponding to the remote conference based on the eye movement information includes: determining an operation mode of the remote conference; generating interaction information corresponding to the remote conference based on the eye movement information and the operation mode; Performing an interactive operation corresponding to the remote conference based on the interactive information to assist the remote conference; The method of generating interaction information corresponding to the remote conference based on the eye movement information and the operation mode includes: when the operation mode is the dialogue mode, generating dialogue interaction information corresponding to the participants in the remote conference based on the eye movement information, the dialogue interaction information being used to determine the target participant who is about to have a dialogue with the speaker in the remote conference; performing interaction operations corresponding to the remote conference based on the interaction information, including: determining the target participant who is about to have a dialogue with the speaker in the remote conference based on the dialogue interaction information; and generating dialogue prompt information with the target participant, so that the target participant can have a dialogue with the speaker based on the dialogue prompt information.

2. The method according to claim 1, characterized in that Determining an operation mode of the remote conference, including: Obtain the sound configuration information corresponding to each participant in the remote conference; Based on the sound configuration information, an operation mode of the remote conference is determined.

3. The method according to claim 2, characterized in that Determining an operation mode of the remote conference based on the sound configuration information includes: Detecting whether a display file exists in the remote conference; Based on the detection result of the display file and the sound configuration information, an operation mode of the remote conference is determined.

4. The method according to claim 3, characterized in that Determining the operation mode of the remote conference based on the detection result of the display file and the sound configuration information includes: Based on the sound configuration information, counting the number of people who can perform voice interaction operations within a preset time period; When the detection result is that the display file exists and the number of people is one, determining that the operation mode is the lecture mode; When the detection result is that the display file exists and the number of persons is at least two, determining that the operation mode is a discussion mode; When the detection result is that the display file does not exist and the number of persons is at least two, it is determined that the operation mode is the dialogue mode.

5. The method according to claim 1, characterized in that Based on the eye movement information and the operation mode, generating interaction information corresponding to the remote conference, including: When the operation mode is a lecture mode or a discussion mode, generating annotation interaction information corresponding to the display file in the remote conference based on the eye movement information; Performing an interactive operation corresponding to the remote conference based on the interactive information includes: The display file is annotated and displayed based on the annotation interaction information.

6. The method according to claim 5, characterized in that Annotating and displaying the display file based on the annotation interaction information includes: Determining the conference identity of the conference participant corresponding to the eye movement information; When the conference identity is the speaker, the data related to the conference progress in the display file is dynamically annotated and / or dynamically displayed based on the annotation interaction information; When the conference identity is a listener, the data of interest in the display file is marked based on the marked interaction information.

7. The method according to claim 6, characterized in that After annotating the data of interest in the display file based on the annotation interaction information, the method further includes: Collect statistics on the annotation interaction information of all listeners to obtain annotation statistics information; Determining the conference hosting status of the presenter based on the annotated statistical information; When the conference hosting status does not meet the expected status, adjustment prompt information corresponding to the speaker is generated.

8. The method according to claim 7, characterized in that Determining the conference hosting status of the presenter based on the annotated statistical information includes: When the annotated statistical information is less than a preset number, it is determined that the conference hosting status corresponding to the speaker does not meet the expected status; When the annotated statistical information is greater than or equal to a preset number, it is determined that the conference hosting status corresponding to the speaker meets the expected status.

9. The method according to claim 8, characterized in that After the annotated statistical information is greater than or equal to a preset number, the method further includes: Based on the annotated statistical information, determining the hotspot information corresponding to all listeners; Based on the hot spot information, generating interactive prompt information, the interactive prompt information is used to prompt the user whether to generate a communication group corresponding to the hot spot information based on the annotated statistical information; In response to confirmation information of the interaction prompt information, a communication group corresponding to the focus hotspot information is generated.

10. The method according to any one of claims 2 to 9, characterized in that: Based on the eye movement information and the operation mode, generating interaction information corresponding to the remote conference, including: When the operation mode is the first mode, acquiring voice information; Based on the voice information and the eye movement information, generating mode switching information corresponding to the remote conference; The remote conference is switched from the first mode to the second mode based on the mode switching information.

11. A data interaction method, characterized in that: include: Obtaining the data to be processed displayed in the display interface; Determining eye movement information of multiple persons respectively viewing the data to be processed; Based on the eye movement information, generating interaction information corresponding to the data to be processed; The data to be processed includes a remote conference, and generating interaction information corresponding to the data to be processed based on the eye movement information includes: determining an operation mode of the remote conference; generating interaction information corresponding to the remote conference based on the eye movement information and the operation mode; Annotating and displaying the data to be processed based on the interaction information; The method of generating interaction information corresponding to the data to be processed based on the eye movement information includes: when the operation mode is the dialogue mode, generating dialogue interaction information corresponding to the participants in the remote conference based on the eye movement information, and the dialogue interaction information is used to determine the target participant who is about to have a dialogue with the speaker in the remote conference; performing interaction operations corresponding to the remote conference based on the interaction information, including: determining the target participant who is about to have a dialogue with the speaker in the remote conference based on the dialogue interaction information; and generating dialogue prompt information with the target participant, so that the target participant can have a dialogue with the speaker based on the dialogue prompt information.

12. The method according to claim 11, characterized in that Based on the eye movement information, generating interaction information corresponding to the data to be processed, including: In the data to be processed, determining the data of interest corresponding to each person based on the eye movement information; Generate annotation interaction information corresponding to the data of interest corresponding to each person, and the annotation interaction information is used to annotate and display the data of interest.

13. A data interaction method, characterized in that: include: Obtaining a preset virtual space generated by virtual reality technology; Determine the eye movement information corresponding to each person participating in the preset virtual space; Based on the eye movement information, generating interaction information corresponding to the preset virtual space; The preset virtual space includes a remote conference, and the generating of interaction information corresponding to the preset virtual space based on the eye movement information includes: determining an operation mode of the remote conference; generating interaction information corresponding to the remote conference based on the eye movement information and the operation mode; performing an interactive operation corresponding to the preset virtual space based on the interactive information; The method of generating interaction information corresponding to the preset virtual space based on the eye movement information includes: when the operation mode is the dialogue mode, generating dialogue interaction information corresponding to the participants in the remote conference based on the eye movement information, and the dialogue interaction information is used to determine the target participant who is about to have a dialogue with the speaker in the remote conference; performing interaction operations corresponding to the remote conference based on the interaction information, including: determining the target participant who is about to have a dialogue with the speaker in the remote conference based on the dialogue interaction information; generating dialogue prompt information with the target participant, so that the target participant can have a dialogue with the speaker based on the dialogue prompt information.

14. An electronic device, characterized in that: include: A memory, a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the remote conferencing method as described in any one of claims 1-8.