Remote interaction method, device, system, electronic device and storage medium

By acquiring and processing user data of the first head-mounted display device and sending it to two head-mounted display devices, the boring problem caused by one-way transmission of audio and video information in remote interaction is solved, and the visual experience and interactivity are improved.

CN113672087BActive Publication Date: 2024-11-05GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110915592.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-10
Publication Date
2024-11-05
Estimated Expiration
2041-08-10

AI Technical Summary

Technical Problem

In the existing remote interaction technology, the one-way transmission of audio and video information leads to boring interaction and poor visual experience.

Method used

By acquiring the user data of the first head-mounted display device, and after processing, the data to be displayed is sent to the two head-mounted display devices, the two-way display of the data is realized.

Benefits of technology

Improves the visual experience during remote interaction and enhances the interactivity and experience of interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113672087B_ABST
    Figure CN113672087B_ABST
Patent Text Reader

Abstract

The present application discloses a remote interaction method, device, system, electronic device and storage medium, and relates to the field of data processing technology. The method includes: obtaining user data of a user corresponding to a first head-mounted display device as first user data, processing the first user data, obtaining first data to be displayed, sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed, and sending the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed. The present application obtains the data to be displayed through the user data of the user corresponding to the first head-mounted display device, and sends the data to be displayed to the first head-mounted display device and the second head-mounted display device for display, respectively, which can enhance the visual experience during interaction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of interactive technology, and more specifically, to a remote interactive method, device, system, electronic device and storage medium. Background Art

[0002] Due to the development of communication technology, remote interaction scenarios such as remote conferencing, remote assistance, and remote education have become more and more integrated into people's lives. However, in current remote interactions, the audio and video information of one party in the remote interaction is usually sent to the other party in the remote interaction. This interaction method will make the interaction boring and the visual experience of the interaction poor. Summary of the invention

[0003] In view of the above problems, the present application proposes a remote interaction method, device, system, electronic device and storage medium to solve the above problems.

[0004] In a first aspect, an embodiment of the present application provides a remote interaction method, which is applied to an electronic device, wherein the electronic device is connected to at least two head-mounted display devices, wherein the at least two head-mounted display devices include a first head-mounted display device and a second head-mounted display device, and the method includes: obtaining user data of a user corresponding to the first head-mounted display device as first user data; processing the first user data to obtain first data to be displayed; sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed; and sending the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed.

[0005] In a second aspect, an embodiment of the present application provides a remote interaction method, which is applied to a first head-mounted display device, wherein the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device, the method comprising: collecting user data of a user corresponding to the first head-mounted display device as first user data; sending the first user data to the electronic device to instruct the electronic device to process the first user data to obtain first data to be displayed, and sending the first data to be displayed to the first head-mounted display device for display and the second head-mounted display device for display, respectively; receiving the first data to be displayed sent by the electronic device, and displaying the first data to be displayed.

[0006] In a third aspect, an embodiment of the present application provides a remote interaction device, which is applied to an electronic device, and the electronic device is respectively connected to a first head-mounted display device and a second head-mounted display device, and the device includes: a user data acquisition module, used to acquire user data of a user corresponding to the first head-mounted display device as first user data; a to-be-displayed data acquisition module, used to process the first user data to obtain first to-be-displayed data; a first to-be-displayed data sending module, used to send the first to-be-displayed data to the first head-mounted display device to instruct the first head-mounted display device to display the first to-be-displayed data; and a second to-be-displayed data sending module, used to send the first to-be-displayed data to the second head-mounted display device to instruct the second head-mounted display device to display the first to-be-displayed data.

[0007] In a fourth aspect, an embodiment of the present application provides a remote interaction device, which is applied to a first head-mounted display device, wherein the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device, and the device includes: a user data acquisition module, used to acquire user data of a user corresponding to the first head-mounted display device as first user data; a user data sending module, used to send the first user data to the electronic device to instruct the electronic device to process the first user data to obtain first data to be displayed, and send the first data to be displayed to the first head-mounted display device for display and the second head-mounted display device for display respectively; a data display module, used to receive the first data to be displayed sent by the electronic device, and display the first data to be displayed.

[0008] In a fifth aspect, an embodiment of the present application provides a remote interaction system, comprising an electronic device and at least two head-mounted display devices, wherein the electronic device is connected to the at least two head-mounted display devices, wherein the at least two head-mounted display devices include a first head-mounted display device and a second head-mounted display device, wherein: the electronic device is used to obtain user data of a user corresponding to the first head-mounted display device as first user data; the electronic device is used to process the first user data to obtain first data to be displayed; the electronic device is used to send the first data to be displayed to the first head-mounted display device; the first head-mounted display device is used to display the first data to be displayed; the electronic device is used to send the first data to be displayed to the second head-mounted display device; the second head-mounted display device is used to display the first data to be displayed.

[0009] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.

[0010] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

[0011] The remote interaction method, apparatus, system, electronic device, and storage medium provided in the embodiments of the present application obtain user data of a user corresponding to a first head-mounted display device as first user data, process the first user data, obtain first data to be displayed, send the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed, and send the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed, thereby obtaining the data to be displayed through the user data of the user corresponding to the first head-mounted display device, and sending the data to be displayed to the first head-mounted display device and the second head-mounted display device for display, respectively, to enhance the visual experience during interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0013] Figure 1 A schematic diagram showing an application environment of the remote interaction method provided in an embodiment of the present application;

[0014] Figure 2 A schematic diagram showing another application environment of the remote interaction method provided in an embodiment of the present application is shown;

[0015] Figure 3 A schematic diagram of the use of the remote interaction method provided in the embodiment of the present application is shown.

[0016] Figure 4 A schematic diagram of a remote interaction method according to an embodiment of the present application is shown;

[0017] Figure 5 A schematic diagram showing a flow chart of a remote interaction method provided by another embodiment of the present application is shown;

[0018] Figure 6A schematic diagram of a scenario that can be used for the remote interaction method provided in an embodiment of the present application is shown;

[0019] Figure 7 This application shows Figure 5 The flowchart of step S201 of the remote interaction method shown is as follows;

[0020] Figure 8 A schematic diagram showing a flow chart of a remote interaction method provided in yet another embodiment of the present application is shown;

[0021] Fig. 9 A schematic diagram showing a remote conference scenario that can be used in an embodiment of the present application is shown;

[0022] Fig.10 A schematic diagram of a remote teaching scenario that can be used in an embodiment of the present application is shown;

[0023] Fig.11 A schematic diagram showing a flow chart of a remote interaction method provided by another embodiment of the present application is shown;

[0024] Fig.12 A schematic diagram showing a flow chart of a remote interaction method provided by yet another embodiment of the present application is shown;

[0025] Fig.13 Another schematic diagram that can be used in the remote teaching scenario provided in the embodiment of the present application is shown;

[0026] Fig.14 A schematic diagram showing a flow chart of a remote interaction method provided by yet another embodiment of the present application is shown;

[0027] Fig.15 A flowchart of a remote interaction method provided in yet another embodiment of the present application is shown;

[0028] Fig.16 A module block diagram of a remote interaction device provided by an embodiment of the present application is shown;

[0029] Fig.17 A module block diagram of a remote interaction device provided by another embodiment of the present application is shown;

[0030] Fig.18 A block diagram of an electronic device according to an embodiment of the present application for executing a remote interaction method according to an embodiment of the present application is shown;

[0031] Fig.19 A storage unit for storing or carrying program codes for implementing the remote interaction method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0033] At present, in remote interaction, the audio and video information of one party of the remote interaction is usually sent to the other party of the remote interaction. This interaction method will cause the interaction to be boring and the visual experience of the interaction is not good. In response to the above problems, the inventors have discovered after long-term research and proposed the remote interaction method, device, system, electronic device and storage medium provided in the embodiments of the present application. The data to be displayed is obtained through the user data of the user corresponding to the first head-mounted display device, and the data to be displayed is sent to the first head-mounted display device and the second head-mounted display device for display, respectively, which can improve the visual experience during the interaction. Among them, the specific remote interaction method is described in detail in the subsequent embodiments.

[0034] The following describes an application environment that can be used for the remote interaction method provided in an embodiment of the present application.

[0035] See also Figure 1 , Figure 1 A schematic diagram of an application environment of the remote interaction method provided in an embodiment of the present application is shown, and the application scenario includes: an electronic device 100, a first head-mounted display device 200, and a second head-mounted display device 300, wherein the electronic device 100 can be connected to at least two head-mounted display devices, wherein the at least two head-mounted display devices include the first head-mounted display device 200 and the second head-mounted display device 300. In this embodiment, the electronic device 100 is connected to the first head-mounted display device 200 and the second head-mounted display device 300, respectively, to realize data interaction between the electronic device 100 and the first head-mounted display device 200, and data interaction between the electronic device 100 and the second head-mounted display device 300. Among them, the number of the first head-mounted display device 200 can be one, and the number of the second head-mounted display device 300 can be one or more. Accordingly, the electronic device 100 can be connected to one first head-mounted display device 200 and one second head-mounted display device 300 respectively, and the electronic device 100 can also be connected to the first head-mounted display device 200 and multiple second head-mounted display devices 300 respectively.

[0036] See also Figure 2 , Figure 2A schematic diagram of another application environment of the remote interaction method provided in an embodiment of the present application is shown, and the application scenario includes: an electronic device 100, a first head-mounted display device 200, a second head-mounted display device 300, and a data acquisition device 40. The electronic device is connected to the first head-mounted display device 200, the second head-mounted display device 300, and the data acquisition device 400, respectively, to realize data interaction between the electronic device 100 and the first head-mounted display device 200, data interaction between the electronic device 100 and the second head-mounted display device 300, and data interaction between the electronic device 100 and the data acquisition device 400. Among them, the data acquisition device 400 can be composed of at least one smart home device, and the data acquisition device 400 is used to collect user data of the user corresponding to the first head-mounted display device 100, and send the collected user data to the electronic device 100.

[0037] In the embodiment of the present application, the electronic device 100 may be a device with data processing capabilities, such as a smart phone, a tablet computer, a desktop computer, a server, etc., which is not limited here.

[0038] In the embodiment of the present application, the first head-mounted display device 200 and the second head-mounted display device 300 may be head-mounted display devices, or mobile devices such as mobile phones and tablets. When the first head-mounted display device 200 and the second head-mounted display device 300 are head-mounted display devices, for example, head-mounted augmented reality devices or head-mounted virtual reality devices, the head-mounted display device may be an integrated head-mounted display device, and the first head-mounted display device 200 and the second head-mounted display device 300 may also be smart terminals such as mobile phones connected to an external head-mounted display device, that is, the first head-mounted display device 200 and the second head-mounted display device 300 may be used as processing and storage devices of the head-mounted display device, inserted into or connected to the external head-mounted display device, and display data (virtual objects) to be displayed are displayed in the head-mounted display device.

[0039] See also Figure 3 , Figure 3 A schematic diagram of the use of the remote interaction method provided in the embodiment of the present application is shown. Figure 3 As shown, the first head-mounted display device 200 can be worn by the first user, the second head-mounted display device 300 can be worn by the second user, and the first head-mounted display device 200 and the head-mounted display device 300 can remotely interact through the electronic device 100.

[0040] See also Figure 4 , Figure 4A flowchart of a remote interaction method provided by an embodiment of the present application is shown. The method is used to obtain data to be displayed through user data of a user corresponding to a first head-mounted display device, and send the data to be displayed to the first head-mounted display device and the second head-mounted display device for display, which can improve the visual experience during interaction. In a specific embodiment, the remote interaction method is applied to Fig.16 The remote interaction device 500 and the electronic device 100 ( Fig.18 ). The following will take an electronic device as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the electronic device can be a smart phone, a tablet computer, a desktop computer, a server, etc., which is not limited here. Figure 4 The process shown is described in detail. In this embodiment, the electronic device is connected to the first head-mounted display device and the second head-mounted display device respectively. The remote interaction method may specifically include the following steps:

[0041] Step S101: obtaining user data of a user corresponding to the first head mounted display device as first user data.

[0042] In this embodiment, the electronic device may obtain user data of a user corresponding to the first head mounted display device, and use the obtained user data of the user corresponding to the first head mounted display device as the first user data.

[0043] In some embodiments, the first head mounted display device may include a data acquisition module. The first head mounted display device may detect user data of the corresponding user through its data acquisition module and send the detected user data to the electronic device, and accordingly, the electronic device may obtain the user data sent by the first head mounted display device as the first user data.

[0044] For example, the data acquisition module may include a motion sensor and an audio sensor. The first head mounted display device may detect the posture information of the corresponding user through its motion sensor, and detect the voice information of the corresponding user through its audio sensor, and determine the detected posture information and voice information as the user data of the corresponding user and send them to the electronic device. Accordingly, the electronic device may obtain the user data sent by the first head mounted display device as the first user data.

[0045] As a way, the first head mounted display device is connected to the electronic device in a wireless manner, such as through a WiFi connection, and the first head mounted display device can send the detected user data to the electronic device based on a wireless transmission manner.

[0046] In some embodiments, a data acquisition device may be provided around the first head mounted display device. The data acquisition device may detect user data of a user corresponding to the first head mounted display device and send the detected user data to the electronic device. Accordingly, the electronic device may obtain the user data sent by the data acquisition device as the first user data.

[0047] For example, the data collection device is composed of at least one smart home device, wherein the smart home device may include a smart speaker, a smart computer, a smart TV, a camera, a door and window sensor, etc. The data collection device may collect voice information, posture information, image information, etc. of the user corresponding to the first head mounted display device, and then determine the detected voice information, posture information, image information, etc. as user data of the corresponding user and send it to the electronic device. Accordingly, the electronic device may obtain the user data sent by the data collection device as the first user data.

[0048] As a method, the data acquisition device is connected to the electronic device wirelessly, such as via WiFi, and the data acquisition device can send the detected user data to the electronic device based on wireless transmission.

[0049] In some embodiments, the electronic device may set a requirement for user data. When the requirement representation of the user data set by the electronic device does not require the complete image information of the user, the user data of the user may be collected through the first head mounted display device, and the user data collected by the first head mounted display device may be obtained as the first user data. When the requirement representation of the user data set by the electronic device requires the complete image information of the user (such as a full body image), the user data of the user may be collected through the data collection setting, and the user data collected by the data collection device may be obtained as the first user data.

[0050] Step S102: Process the first user data to obtain first data to be displayed.

[0051] In some implementations, after obtaining the first user data, the electronic device may process the first user data to obtain the data to be displayed as the first data to be displayed. For example, after obtaining the first user data, the electronic device may analyze, render, and optimize the first user data to obtain the data to be displayed as the first data to be displayed.

[0052] As a method, when the first user data is acquired by the first head-mounted display device, the first data to be displayed obtained by processing the first user data may include partial image information of the user corresponding to the first head-mounted display device or may not include image information of the user corresponding to the first head-mounted display device. Wherein, when the first data to be displayed includes partial image information of the user corresponding to the first head-mounted display device, the partial image information may include image information of the user's hand located within the viewing angle of the first head-mounted display device. At this time, the first data to be displayed may be presented as audio and video information including the user's hand presented in a certain scene (which may be a real scene or a virtual scene). Wherein, when the first data to be displayed does not include image information of the user corresponding to the first head-mounted display device, the first data to be displayed may be presented as audio and video information not including the user's image presented in a certain scene.

[0053] As a method, when the first user data is acquired by the data acquisition device, the first data to be displayed obtained by processing the first user data may include image information of the user's entire body. At this time, the first data to be displayed may be presented as audio and video information including the user's entire body presented in a certain scene (which may be a real scene or a virtual scene).

[0054] Step S103: sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed.

[0055] In this embodiment, after obtaining the first data to be displayed, the electronic device can send the first data to be displayed to the first head-mounted display device. Correspondingly, the first head-mounted display device can receive the first data to be displayed sent by the electronic device and display the first data to be displayed, so that the user corresponding to the first head-mounted display device can view his own data and make adjustments based on it to improve the interactive performance. The first data to be displayed can be a resource in the real world or a resource superimposed by a virtual object and the real world, which is not limited here.

[0056] Step S104: sending the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0057] In this embodiment, after obtaining the first data to be displayed, the electronic device can send the first data to be displayed to the second head-mounted display device. Correspondingly, the second head-mounted display device can receive the first data to be displayed sent by the electronic device and display the first data to be displayed, so that the user corresponding to the second head-mounted display device can view the data of the remote other party, thereby improving the interactive visual experience.

[0058] A remote interaction method provided by an embodiment of the present application obtains user data of a user corresponding to a first head-mounted display device as first user data, processes the first user data to obtain first data to be displayed, sends the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed, and sends the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed, thereby obtaining the data to be displayed through the user data of the user corresponding to the first head-mounted display device, and sending the data to be displayed to the first head-mounted display device and the second head-mounted display device respectively for display, thereby improving the visual experience during interaction.

[0059] See also Figure 5 , Figure 5 A flowchart of a remote interaction method provided by another embodiment of the present application is shown. The method is applied to the above-mentioned electronic device, which is respectively connected to the first head-mounted display device, the second head-mounted display device and the data acquisition device. Figure 5 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0060] Step S201: obtaining user data of a user corresponding to the first head mounted display device sent by the data acquisition device as the first user data.

[0061] In this embodiment, the user data of the user corresponding to the first head mounted display device can be collected by the data collection device, and the collected user data corresponding to the first head mounted display device can be sent to the electronic device. Accordingly, when the electronic device obtains the user data sent by the data collection device, the user data can be used as the first user data. The data collection device can include a smart home device, a smart terminal, a tablet computer, etc., which is not limited here.

[0062] See also Figure 6 , Figure 6 A schematic diagram of a scenario that can be used for the remote interaction method provided in the embodiment of the present application is shown. Figure 6 As shown, the user corresponding to the first head mounted display device 200 is located in a room, which includes a camera A1 and a television A2. The camera A1 can be used to collect image information and posture information of the user, and the television A2 can be used to collect voice information of the user.

[0063] See also Figure 7 , Figure 7 This application shows Figure 5The flowchart of step S201 of the remote interaction method is shown in FIG. 1 . In this embodiment, the data acquisition device is composed of at least one smart home device. Figure 7 The process shown is described in detail, and the method may specifically include the following steps:

[0064] Step S2011: Acquire at least one smart home device located within a preset range of the first head-mounted display device.

[0065] In some embodiments, the data collection device consists of at least one smart home device.

[0066] As a method, the electronic device may pre-set and store a preset range, wherein the preset range may be used to characterize the range in which user data can be effectively collected. That is, a smart home device whose distance to the first head-mounted display device is within the preset range may effectively collect user data of the user corresponding to the first head-mounted display device, and a smart home device whose distance to the first head-mounted display device is outside the preset range may not effectively collect user data of the user corresponding to the first head-mounted display device, for example, the user data of the user corresponding to the first head-mounted display device may not be collected, or the collected user data of the user corresponding to the first head-mounted display device may be inaccurate.

[0067] In this embodiment, at least one smart home device located within the preset range of the first head-mounted display device can be obtained. It can be understood that at least one smart home device located within the preset range of the first head-mounted display device can effectively collect user data of the user corresponding to the first head-mounted display device.

[0068] As one approach, a circle may be established with the position of the first head mounted display device as the origin and a preset range as the radius, and then at least one smart home device located within the circle may be acquired.

[0069] As another way, the room where the first head mounted display device is located can be obtained, and at least one smart home device in the room can be obtained. As an implementable way, the room where the first head mounted display device is located can be obtained, and the size of the room can be obtained. When the size of the room is not larger than the preset range, at least one smart home device in the room can be obtained. When the size of the room is larger than the preset range, at least one smart home device in the room within the preset range can be obtained.

[0070] Step S2012: When the at least one smart home device meets the preset data collection condition, user data of the user corresponding to the first head-mounted display device sent by the at least one smart home device is obtained as the first user data.

[0071] In some implementations, the electronic device may pre-set and store a preset data collection condition, which is used as a basis for determining the at least one smart home device. Therefore, in this embodiment, after obtaining at least one smart home device, the at least one smart home device may be compared with the preset data collection condition to determine whether the at least one smart home device meets the preset data collection condition.

[0072] Among them, when the judgment result indicates that the at least one smart home device meets the preset data collection conditions, it indicates that the at least one smart home device can effectively collect the required user data, and the user data of the user corresponding to the first head-mounted display device can be collected through the at least one smart home device, and the user data corresponding to the first head-mounted display device sent by the at least one smart home device can be obtained as the first user data.

[0073] Among them, when the judgment result indicates that the at least one smart home device does not meet the preset data collection conditions, it indicates that the at least one smart home device cannot effectively collect the required user data, and a prompt message can be output to the first head-mounted display device to prompt the user to change the location of the first head-mounted display device, or, it can be switched to collect user data through the first head-mounted display device, etc., which is not limited here.

[0074] In some embodiments, the preset data collection conditions may include: collection of image information, collection of audio information, and collection of posture information. Therefore, in this embodiment, after obtaining at least one smart home device, it can be determined whether the at least one home device can meet the collection of image information, audio information, and posture information. Among them, when at least one smart home device can meet the collection of image information, audio information, and posture information, it can be determined that the at least one smart home device meets the preset data collection conditions. For example, when at least one smart home device includes a camera (collection of image information), a smart phone (collection of posture information), a smart speaker (collection of voice information), etc., it can be determined that the at least one smart home device meets the preset conditions. Among them, when at least one smart home device does not meet at least one of the collection of image information, the collection of audio information, and the collection of posture information, it can be determined that the at least one smart home device does not meet the preset conditions.

[0075] Step S202: Process the first user data to obtain first data to be displayed.

[0076] Step S203: sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed.

[0077] Step S204: sending the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0078] For the detailed description of steps S202 to S204 , please refer to steps S102 to S104 , which will not be repeated here.

[0079] Another embodiment of the present application provides a remote interaction method, compared to Figure 3 In the remote interaction method shown, this embodiment also collects user data corresponding to the first head-mounted display device through a data collection device, and sends the collected user data to an electronic device, thereby improving the authenticity of the collected user data.

[0080] See also Figure 8 , Figure 8 The flowchart of the remote interaction method provided by another embodiment of the present application is shown. The method is applied to the above-mentioned electronic device, which is connected to the first head-mounted display device and the second head-mounted display device respectively. Figure 8 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0081] Step S301: obtaining user data of a user corresponding to the first head mounted display device as first user data.

[0082] Step S302: Process the first user data to obtain first data to be displayed.

[0083] Step S303: sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed.

[0084] Step S304: sending the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed.

[0085] For the detailed description of steps S301 to S304 , please refer to steps S101 to S104 , which will not be repeated here.

[0086] Step S305: receiving a virtual scene selection instruction sent by the first head mounted display device, wherein the virtual scene selection instruction is triggered by a user corresponding to the first head mounted display device.

[0087] In some embodiments, the user corresponding to the first head-mounted display device can also trigger a scene selection on the first head-mounted display device, and correspondingly, when the first head-mounted display device detects that the user triggers the scene selection, it can generate a virtual scene selection instruction in response to the scene selection triggered by the user. When the first head-mounted display device generates the virtual scene selection instruction, it can send the virtual scene selection instruction to the electronic device, and accordingly, the electronic device can receive the virtual scene selection instruction sent by the first head-mounted display device.

[0088] As a method, when the user needs to select a scene, the first head mounted display device can display multiple selectable virtual scenes for the user to select, and the user can select a desired scene from the displayed multiple virtual scenes, and the first head mounted display device can generate a virtual scene selection instruction based on the selection. For example, the multiple virtual scenes may include a remote conference scene, a remote teaching scene, a remote assistance scene, etc., which are not limited here.

[0089] As an implementable manner, when the user needs to select a scene, the first head mounted display device can display multiple selectable applications for the user to select, and each of the multiple applications corresponds to a virtual scene. As another implementable manner, when the user needs to select a scene, the first head mounted display device can start a target application and display multiple selectable virtual scenes in the target application for the user to select.

[0090] Step S306: responding to the virtual scene selection instruction, determining a target virtual scene from a plurality of virtual scenes.

[0091] In some embodiments, after receiving the virtual scene selection instruction, the electronic device may determine the target virtual scene from multiple virtual scenes in response to the virtual scene selection instruction. For example, assuming that the multiple virtual scenes include a remote conference scene, a remote teaching scene, and a remote assistance scene, and the virtual scene selection instruction indicates to select the remote conference scene, the remote conference scene may be determined as the target virtual scene from the remote conference scene, the remote teaching scene, and the remote assistance scene.

[0092] Step S307: sending the target virtual scene to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual scene.

[0093] In this embodiment, after obtaining the target virtual scene, the electronic device can send the target virtual scene to the first head-mounted display device. Correspondingly, the first head-mounted display device can receive the target virtual scene sent by the electronic device and display the target virtual scene, so that a user corresponding to the first head-mounted display device can be immersed in the corresponding scene.

[0094] For example, when the target virtual scene is a remote conference scene, the first head mounted display device may display a scene in which the user corresponding to the first head mounted display device is in a virtual conference room. Fig. 9 , Fig. 9 A schematic diagram of a remote conference scenario that can be used in an embodiment of the present application is shown. Fig. 9 As shown, when the target virtual scene is a remote conference scene, the content displayed by the first head mounted display device may include a scene in which the user B1 corresponding to the first head mounted display device is in a virtual conference room. Of course, the content displayed by the first head mounted display device may also include a scene in which the user B2 corresponding to the second head mounted display device is in a virtual conference room.

[0095] For another example, when the target virtual scene is a remote teaching scene, the first head mounted display device can display a scene in which the user corresponding to the first head mounted display device is in a virtual classroom. Fig.10 , Fig.10 A schematic diagram of a remote teaching scenario that can be used in the embodiments of the present application is shown. Fig.10 As shown, when the target virtual scene is a remote teaching scene, the content displayed by the first head-mounted display device may include a scene in which the user B1 corresponding to the first head-mounted display device is in a virtual classroom. Of course, the content displayed by the first head-mounted display device may also include a scene in which the user B2 corresponding to the second head-mounted display device is in a virtual classroom.

[0096] As one way, the electronic device can send the first data to be displayed and the target virtual scene to the first head-mounted display device respectively, and the first head-mounted display device can render the first data to be displayed and the target virtual scene for display. As another way, the electronic device can render the first data to be displayed and the target virtual scene and send them to the first head-mounted display device for display.

[0097] Step S308: receiving a virtual prop selection instruction sent by the first head mounted display device, wherein the virtual prop selection instruction is triggered by a user corresponding to the first head mounted display device in the target virtual scene.

[0098] In some embodiments, the user corresponding to the first head mounted display device can also trigger a virtual prop selection in the target virtual scene, and correspondingly, when the first head mounted display device detects that the user triggers a virtual prop selection, it can generate a virtual prop selection instruction in response to the virtual prop selection triggered by the user. When the first head mounted display device generates the virtual prop selection instruction, it can send the virtual prop selection instruction to the electronic device, and accordingly, the electronic device can receive the virtual prop selection instruction sent by the first head mounted display device.

[0099] As a method, when the user needs to select a virtual prop, the first head mounted display device can display multiple selectable virtual props for the user to select, and the user can select the desired virtual prop from the displayed multiple virtual props, and the first head mounted display device can generate a virtual prop selection instruction based on the selection. For example, when the target virtual scene is a remote conference scene, the multiple virtual props can include a virtual laser pen, a virtual projection screen, a virtual microphone, etc. When the target virtual scene is a remote teaching scene, the multiple virtual props can include a virtual writing board, a virtual writing pen, etc.

[0100] Step S309: In response to the virtual item selection instruction, a target virtual item is determined from a plurality of virtual items.

[0101] In some embodiments, after receiving the virtual prop selection instruction, the electronic device may determine the target virtual prop from multiple virtual props in response to the virtual prop selection instruction. For example, assuming that the target virtual scene is a remote conference scene, and the multiple virtual props include a virtual laser pen, a virtual projection screen, and a virtual microphone, when the virtual prop selection instruction indicates to select the virtual projection screen, the virtual projection screen may be determined as the target virtual prop from the virtual laser pen, the virtual projection screen, and the virtual microphone.

[0102] Step S310: sending the target virtual prop to the first head mounted display device to instruct the first head mounted display device to display the target virtual prop.

[0103] In this embodiment, after obtaining the target virtual props, the electronic device can send the target virtual props to the first head-mounted display device. Correspondingly, the first head-mounted display device can receive the target virtual props sent by the electronic device and display the target virtual props, so that the user corresponding to the first head-mounted display device can be immersed in the corresponding scene.

[0104] For example, when the target virtual scene is a remote conference scene and the target virtual prop is a virtual projection screen, the first head mounted display device can display a scene in which the user corresponding to the first head mounted display device is located in a virtual conference room with a virtual projection screen. Fig. 9 ,like Fig. 9 As shown, when the target virtual scene is a remote conference scene, the content displayed by the first head mounted display device may include a scene in which the user B1 corresponding to the first head mounted display device is located in a virtual conference room, and a virtual projection screen C1 is provided in the virtual conference room.

[0105] When the target virtual scene is a remote teaching scene and the target virtual prop is a virtual writing board, the first head mounted display device can display a scene in which the user corresponding to the first head mounted display device is in a virtual classroom with a virtual writing board. Fig.10 ,like Fig.10 As shown, when the target virtual scene is a remote teaching scene, the content displayed by the first head mounted display device may include a scene in which the user B1 corresponding to the first head mounted display device is located in a virtual classroom, and a virtual writing board C2 is provided in the virtual classroom.

[0106] As one way, the electronic device can send the first data to be displayed, the target virtual scene, and the target virtual props to the first head-mounted display device, and the first head-mounted display device can render the first data to be displayed, the target virtual scene, and the target virtual props for display. As another way, the electronic device can render the first data to be displayed, the target virtual scene, and the target virtual props and send them to the first head-mounted display device for display.

[0107] As an implementation manner, after obtaining the target virtual prop, the electronic device may render the target virtual prop based on the posture information of the user corresponding to the first head mounted display device, and then send the rendered target virtual prop to the first head mounted display device for display.

[0108] Among them, the posture information represents a view matrix, that is, when a user views an object in the real world or the virtual world through a head-mounted display device, the corresponding view is different from different directions or angles. Corresponding to this embodiment, the posture information represents the corresponding view when the user views the target virtual prop through the first head-mounted display device from the direction or angle corresponding to the posture information. Therefore, as an implementable method, the electronic device can render the target virtual prop based on the posture information, so as to obtain the display parameters corresponding to the target virtual prop under the posture information. Specifically, when the electronic device renders the target virtual prop, it will extract the texture of a frame image of the target virtual prop, and then build a 2D model. This 2D model will combine the posture information, put the extracted image texture on the 2D model, and then perform the corresponding rendering process to obtain the corresponding display parameters, and then perform the 2D to 3D coordinate conversion and send it to the first head-mounted display device for display.

[0109] Step S311: receiving input information sent by the first head mounted display device, wherein the input information is input on the target virtual prop by a user corresponding to the first head mounted display device.

[0110] In some embodiments, the user corresponding to the first head-mounted display device can also input information on the target virtual prop. Correspondingly, when the first head-mounted display device detects that the user inputs information on the target virtual prop, it can obtain the input information and send the input information to the electronic device. Accordingly, the electronic device can receive the input information sent by the first head-mounted display device. It is understandable that at this time, the virtual prop of the first head-mounted display device can display the input information accordingly.

[0111] As a method, when the target virtual prop is a virtual writing board, the input information can be written by the user on the virtual writing board; when the target virtual prop is a virtual projection screen, the input information can be triggered by the user to be delivered to the virtual projection screen.

[0112] Step S312: sending the input information to the second head mounted display device to instruct the second head mounted display device to display the input information and the target virtual props accordingly.

[0113] In this embodiment, after obtaining the input information sent by the first head-mounted display device, the electronic device can send the input information to the second head-mounted display device. Correspondingly, the second head-mounted display device can receive the input information sent by the electronic device and display the input information on the virtual props to achieve more instant interaction.

[0114] For example, taking the target virtual scene as a remote teaching scene, the user corresponding to the first head-mounted display device is a teacher, and the user corresponding to the second head-mounted display device is a student, the teacher can write on the virtual writing board, and accordingly, the content of the blackboard will be sent to the second head-mounted display device for the students to learn, thereby achieving more immediate learning.

[0115] Step S313: sending the target virtual prop to the second head mounted display device to instruct the second head mounted display device to display the target virtual prop.

[0116] In this embodiment, after obtaining the target virtual props, the electronic device can send the target virtual props to the second head-mounted display device. Correspondingly, the second head-mounted display device can receive the target virtual props sent by the electronic device and display the target virtual props, so that the user corresponding to the second head-mounted display device can be immersed in the corresponding scene, and the props of the first head-mounted display device and the second head-mounted display device can be shared to enhance the interactive experience.

[0117] For example, when the target virtual scene is a remote conference scene and the target virtual prop is a virtual projection screen, the second head-mounted display device can display the scene in which the user corresponding to the first head-mounted display device is located in a virtual conference room equipped with a virtual projection screen; when the target virtual scene is a remote teaching scene and the target virtual prop is a virtual writing board, the second head-mounted display device can display the scene in which the user corresponding to the first head-mounted display device is located in a virtual classroom equipped with a virtual writing board.

[0118] As one way, the electronic device can send the first data to be displayed, the target virtual scene, and the target virtual props to the second head-mounted display device, and the second head-mounted display device can render the first data to be displayed, the target virtual scene, and the target virtual props for display. As another way, the electronic device can render the first data to be displayed, the target virtual scene, and the target virtual props and send them to the second head-mounted display device for display.

[0119] As an implementation manner, after obtaining the target virtual prop, the electronic device may render the target virtual prop based on the posture information of the user corresponding to the second head mounted display device, and then send the rendered target virtual prop to the second head mounted display device for display.

[0120] Step S314: sending the target virtual scene to the second head-mounted display device to instruct the second head-mounted display device to display the target virtual scene.

[0121] In this embodiment, after obtaining the target virtual scene, the electronic device can send the target virtual scene to the second head-mounted display device. Accordingly, the second head-mounted display device can receive the target virtual scene sent by the electronic device and display the target virtual scene, so that a user corresponding to the second head-mounted display device can be immersed in the corresponding scene, and the scenes of the first head-mounted display device and the second head-mounted display device can be shared, thereby improving the interactive experience.

[0122] For example, when the target virtual scene is a remote conference scene, the second head-mounted display device can display the scene in which the user corresponding to the first head-mounted display device is in a virtual conference room; when the target virtual scene is a remote teaching scene, the second head-mounted display device can display the scene in which the user corresponding to the first head-mounted display device is in a virtual classroom.

[0123] As one way, the electronic device can send the first data to be displayed and the target virtual scene to the second head mounted display device respectively, and the second head mounted display device can render the first data to be displayed and the target virtual scene for display. As another way, the electronic device can render the first data to be displayed and the target virtual scene and send them to the second head mounted display device for display.

[0124] Another embodiment of the present application provides a remote interaction method, compared to Figure 3 In the remote interaction method shown, this embodiment also receives a virtual scene selection instruction sent by the first head-mounted display device, responds to the virtual scene selection instruction, determines a target virtual scene from multiple virtual scenes, and sends the target virtual scene to the first head-mounted display device and the second head-mounted display device for display, so as to select and interactively display scenes according to user needs, so as to enhance the experience of scene interaction. Furthermore, this embodiment also receives a virtual prop selection instruction sent by the first head-mounted display device, responds to the virtual prop selection instruction, determines a target virtual prop from multiple virtual props, and sends the target virtual prop to the first head-mounted display device and the second head-mounted display device for display, so as to select and interactively display props according to user needs, so as to enhance the experience of prop interaction. In addition, this embodiment also receives input information of the first head-mounted display device for display, so as to realize real-time interaction of input information and enhance the user's interactive experience.

[0125] See also Fig.11 , Fig.11 A flow chart of a remote interaction method provided by another embodiment of the present application is shown. The method is applied to the above-mentioned electronic device, which is connected to the first head-mounted display device and the second head-mounted display device respectively. Fig.11 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0126] Step S401: obtaining user data of a user corresponding to the first head mounted display device as first user data.

[0127] Step S402: Process the first user data to obtain first data to be displayed.

[0128] Step S403: sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed.

[0129] Step S404: sending the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0130] For the detailed description of steps S401 - S404 , please refer to steps S101 - S104 , which will not be repeated here.

[0131] Step S405: receiving a virtual scene selection instruction sent by the first head mounted display device, wherein the virtual scene selection instruction is triggered by a user corresponding to the first head mounted display device.

[0132] Step S406: responding to the virtual scene selection instruction, determining a target virtual scene from a plurality of virtual scenes.

[0133] Step S407: sending the target virtual scene to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual scene.

[0134] For the detailed description of steps S405 to S407, please refer to steps S305 to S307, which will not be repeated here.

[0135] Step S408: sending the target virtual scene to the second head-mounted display device to instruct the second head-mounted display device to display the target virtual scene.

[0136] The specific description of step S408 can be found in step S314 and will not be repeated here.

[0137] Step S409: receiving feedback information sent by the second head mounted display device, wherein the feedback information is triggered by a user corresponding to the second head mounted display device in the target virtual scene.

[0138] In some embodiments, the user corresponding to the second head-mounted display device can also trigger information feedback in the target virtual scene. Correspondingly, when the second head-mounted display device detects that the user triggers information feedback in the target virtual scene, it can obtain the feedback information and send the feedback information to the electronic device. Accordingly, the electronic device can receive the feedback information sent by the second head-mounted display device.

[0139] As one way, when the target virtual scene is a remote conference scene, the feedback information triggered and generated by the user corresponding to the second head mounted display device in the target virtual scene may include: question information, answer information, etc. As another way, when the target virtual scene is a remote teaching scene, the feedback information triggered and generated by the user corresponding to the second head mounted display device in the target virtual scene may include: hand raising information, question information, answer information, completed homework information, etc.

[0140] Step S410: Send the feedback information to the first head-mounted display device to instruct the first head-mounted display device to display the feedback information.

[0141] In this embodiment, after obtaining the feedback information sent by the second head-mounted display device, the electronic device can send the feedback information to the first head-mounted display device. Correspondingly, the first head-mounted display device can receive and display the feedback information sent by the electronic device to achieve more instant interaction.

[0142] For example, if the target virtual scene is a remote teaching scene, the user corresponding to the first head-mounted display device is a teacher, and the user corresponding to the second head-mounted display device is a student, the student can upload the completed homework as feedback information, and accordingly, the feedback information will be immediately sent to the first head-mounted display device for the teacher to review, thereby achieving more immediate learning. After the teacher completes the review, the reviewed homework can be sent back to the second head-mounted display device, which will not be repeated here.

[0143] Another embodiment of the present application provides a remote interaction method, compared to Figure 3 In the remote interaction method shown, this embodiment also receives a virtual scene selection instruction sent by the first head-mounted display device, responds to the virtual scene selection instruction, determines a target virtual scene from multiple virtual scenes, and sends the target virtual scene to the first head-mounted display device and the second head-mounted display device for display, so as to select and interactively display scenes according to user needs, so as to enhance the experience of scene interaction. In addition, this embodiment also receives feedback information from the second head-mounted display device, and sends the feedback information to the first head-mounted display device for display, so as to realize real-time interaction of feedback information and enhance the user's interactive experience.

[0144] See also Fig.12 , Fig.12 The flowchart of the remote interaction method provided by another embodiment of the present application is shown. The method is applied to the above-mentioned electronic device, which is connected to the first head-mounted display device and the second head-mounted display device respectively. Fig.12 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0145] Step S501: obtaining user data of a user corresponding to the first head mounted display device as first user data.

[0146] Step S502: Process the first user data to obtain first data to be displayed.

[0147] Step S503: sending the first data to be displayed to the first head mounted display device to instruct the first head mounted display device to display the first data to be displayed.

[0148] Step S504: sending the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0149] For the detailed description of steps S501 to S504 , please refer to steps S101 to S104 , which will not be repeated here.

[0150] Step S505: receiving a data adjustment instruction sent by the second head mounted display device, wherein the data adjustment instruction is triggered by a user corresponding to the second head mounted display device.

[0151] In the process of the second head-mounted display device displaying the first data to be displayed, the user corresponding to the second head-mounted display device can select a portion of the first data to be displayed that he or she is more concerned about, so that the second head-mounted display device can focus on displaying the portion of the second data. For example, the second head-mounted display device can enlarge the portion of the second data or improve the clarity of the portion of the second data, etc., which is not limited here. For example, the user corresponding to the first head-mounted display device can be selected from the first data to be displayed as the portion of the second data to be displayed, the explanation scene of the user corresponding to the first head-mounted display device can be selected from the first data to be displayed as the portion of the second data to be displayed, or the content demonstrated by the user corresponding to the first head-mounted display device can be selected from the first data to be displayed as the portion of the second data to be displayed, etc.

[0152] In some embodiments, the user corresponding to the second head-mounted display device can also trigger data adjustment on the second head-mounted display device, and correspondingly, when the second head-mounted display device detects that the user has triggered the data adjustment, it can generate a data adjustment instruction in response to the data adjustment triggered by the user. When the second head-mounted display device generates the data adjustment instruction, it can send the data adjustment instruction to the electronic device, and accordingly, the electronic device can receive the data adjustment instruction sent by the second head-mounted display device.

[0153] Step S506: adjusting the first data to be displayed in response to the data adjustment instruction to obtain second data to be displayed.

[0154] In this embodiment, after receiving the data adjustment instruction, the electronic device may adjust the first data to be displayed in response to the data adjustment instruction to obtain the second data to be displayed.

[0155] In some embodiments, after receiving the data adjustment instruction, the electronic device may analyze the data adjustment instruction to obtain the portion of the first data to be displayed that the user focuses on, and then based on the data adjustment instruction, the portion of the first data to be displayed that the user focuses on may be highlighted to obtain the second data to be displayed. Among them, highlighting the portion of the first data to be displayed that the user focuses on may include: enlarging the portion that the user focuses on, deleting the portion that the user does not focus on and retaining the portion that the user focuses on, shrinking the portion that the user does not focus on, etc., which is not limited here.

[0156] Step S507: sending the second data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the second data to be displayed.

[0157] In this embodiment, after obtaining the second data to be displayed, the electronic device can send the second data to be displayed to the second head-mounted display device. Accordingly, the second head-mounted display device can receive the second data to be displayed sent by the electronic device and display the second data to be displayed, so that a user corresponding to the second head-mounted display device can view the part that he or she focuses on, making the displayed content more targeted and personalized, thereby improving the user experience.

[0158] See also Fig.13 , Fig.13 Another schematic diagram that can be used in the remote teaching scenario provided in the embodiment of the present application is shown. Fig.13 As shown, when the target virtual scene is a remote teaching scene, the content displayed by the first head mounted display device may include a scene in which the user B1 corresponding to the first head mounted display device is in a virtual classroom, and a virtual writing board C2 is provided in the virtual classroom. Fig.10 The first data to be displayed is displayed, Fig.13 The third data to be displayed focuses on the teacher's lecture.

[0159] The present application provides a remote interaction method in another embodiment. Figure 3 The remote interaction method shown in this embodiment also receives a data adjustment instruction sent by a second head-mounted display device, and adjusts the first data to be displayed in response to the data adjustment instruction to obtain second data to be displayed, so that the user can select the data to be displayed that he or she personally focuses on according to his or her needs, with high selectivity and strong targeting.

[0160] See also Fig.14 , Fig.14The flowchart of the remote interaction method provided by another embodiment of the present application is shown. The method is applied to the above-mentioned electronic device, which is connected to the first head-mounted display device and the second head-mounted display device respectively. Fig.14 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0161] Step S601: obtaining user data of a user corresponding to the first head mounted display device as first user data.

[0162] Step S602: Process the first user data to obtain first data to be displayed.

[0163] Step S603: sending the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed.

[0164] For the detailed description of steps S601 to S603 , please refer to steps S101 to S103 , which will not be repeated here.

[0165] Step S604: receiving a user viewing instruction sent by the first head mounted display device, wherein the user viewing instruction is triggered by a user corresponding to the first head mounted display device.

[0166] In some embodiments, the user corresponding to the first head-mounted display device can also trigger the user viewing of the interactive party on the first head-mounted display device. Correspondingly, when the first head-mounted display device detects that the user has triggered the user viewing, it can generate a user viewing instruction in response to the user viewing triggered by the user. When the first head-mounted display device generates the user viewing instruction, it can send the user viewing instruction to the electronic device, and accordingly, the electronic device can receive the user viewing instruction sent by the first head-mounted display device.

[0167] Step S605: In response to the user viewing instruction, user data of the user corresponding to the second head mounted display device is obtained as second user data.

[0168] In some embodiments, after receiving the user viewing instruction sent by the first head mounted display device, the electronic device may respond to the user viewing instruction and obtain the user data of the user corresponding to the second head mounted display device as the second user data. As a method, the user data of the user corresponding to the second head mounted display device may be acquired by the second head mounted display device, or may be acquired by a data acquisition device (smart home device) located around the second head mounted display device, which is not limited here.

[0169] Step S606: Process the second user data to obtain third data to be displayed.

[0170] In some implementations, after obtaining the second user data, the electronic device may process the second user data to obtain the data to be displayed as the third data to be displayed. For example, after obtaining the second user data, the electronic device may analyze, render, and optimize the second user data to obtain the data to be displayed as the third data to be displayed.

[0171] Step S607: sending the third data to be displayed to the first head mounted display device to instruct the first head mounted display device to display the third data to be displayed.

[0172] In this embodiment, after obtaining the third data to be displayed, the electronic device can send the third data to be displayed to the first head-mounted display device. Correspondingly, the first head-mounted display device can receive the third data to be displayed sent by the electronic device and display the third data to be displayed, so that the user corresponding to the first head-mounted display device can view the data of the remote party, thereby improving the interactive visual experience. As a way, after receiving the third data to be displayed, the first head-mounted display device can simultaneously display the first data to be displayed and the third data to be displayed, or can replace the first data to be displayed with the third data to be displayed for display, which is not limited here.

[0173] For example, taking the target virtual scene as a remote teaching scene, the user corresponding to the first head-mounted display device is a teacher, and the user corresponding to the second head-mounted display device is a student, when the first head-mounted display device (teacher side) is displaying the third data to be displayed (student data), the teacher can also observe the students' learning status at any time, ask questions to the students, etc., to enhance the interactivity of the classroom.

[0174] Step S608: sending the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0175] The specific description of step S608 can be found in step S104 and will not be repeated here.

[0176] Another embodiment of the present application provides a remote interaction method, compared to Figure 3 The remote interaction method shown in this embodiment also receives a user viewing instruction sent by the first head-mounted display device, responds to the user viewing instruction, obtains user data of the user corresponding to the second head-mounted display device as the second user data, processes the second user data to obtain third data to be displayed, and sends the third data to be displayed to the first head-mounted display device for display, thereby improving the interactivity of the remote interaction.

[0177] See also Fig.15 , Fig.15 A flowchart of a remote interaction method provided by yet another embodiment of the present application is shown. The method is applied to a first head-mounted display device, the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device. Fig.15 The process shown is described in detail, and the remote interaction method may specifically include the following steps:

[0178] Step S701: collecting user data of a user corresponding to the first head mounted display device as first user data.

[0179] Step S702: Send the first user data to the electronic device to instruct the electronic device to process the first user data to obtain first data to be displayed, and send the first data to be displayed to the first head-mounted display device and the second head-mounted display device for display respectively.

[0180] Step S703: receiving the first data to be displayed sent by the electronic device, and displaying the first data to be displayed.

[0181] For the detailed description of steps S701 to S703 , please refer to steps S101 to S104 , which will not be repeated here.

[0182] Yet another embodiment of the present application provides a remote interaction method, in which a first head-mounted display device collects user data of a corresponding user as first user data, sends the first user data to an electronic device to instruct the electronic device to process the first user data to obtain first data to be displayed, and sends the first data to be displayed to the first head-mounted display device for display and the second head-mounted display device for display, respectively; receives the first data to be displayed sent by the electronic device, and displays the data, thereby obtaining data to be displayed through the user data of the user corresponding to the first head-mounted display device, and sending the data to be displayed to the first head-mounted display device and the second head-mounted display device for display, respectively, to enhance the visual experience during interaction.

[0183] See also Fig.16 , Fig.16 The module block diagram of the remote interaction device provided by an embodiment of the present application is shown. The remote interaction device 500 is applied to the above electronic device, and the electronic device is connected to the first head-mounted display device and the second head-mounted display device respectively. Fig.16The block diagram shown in FIG. 1 is used to illustrate that the remote interaction device 500 includes: a user data acquisition module 510, a to-be-displayed data acquisition module 520, a first to-be-displayed data sending module 530, and a second to-be-displayed data sending module 540, wherein:

[0184] The user data acquisition module 510 is used to acquire user data of a user corresponding to the first head mounted display device as first user data.

[0185] Furthermore, the electronic device is also connected to a data acquisition device, and the user data acquisition module 510 includes: a user data acquisition submodule, wherein:

[0186] The user data acquisition submodule is used to acquire the user data of the user corresponding to the first head-mounted display device sent by the data acquisition device as the first user data.

[0187] Furthermore, the data acquisition device is composed of at least one smart home device, and the user data acquisition submodule includes: a smart home device acquisition unit and a user data acquisition unit, wherein:

[0188] A smart home device acquisition unit is used to acquire at least one smart home device located within a preset range of the first head-mounted display device.

[0189] A user data acquisition unit is used to acquire user data of a user corresponding to the first head-mounted display device sent by the at least one smart home device as the first user data when the at least one smart home device meets a preset data collection condition.

[0190] The to-be-displayed data obtaining module 520 is configured to process the first user data to obtain first to-be-displayed data.

[0191] The first data to be displayed sending module 530 is configured to send the first data to be displayed to the first head mounted display device to instruct the first head mounted display device to display the first data to be displayed.

[0192] The second data to be displayed sending module 540 is configured to send the first data to be displayed to the second head mounted display device to instruct the second head mounted display device to display the first data to be displayed.

[0193] Furthermore, the remote interaction device 500 further includes: a virtual scene selection instruction receiving module, a target virtual scene determining module, a first target virtual scene sending module and a second target virtual scene sending module, wherein:

[0194] The virtual scene selection instruction receiving module is used to receive a virtual scene selection instruction sent by the first head-mounted display device, wherein the virtual scene selection instruction is triggered by a user corresponding to the first head-mounted display device.

[0195] The target virtual scene determination module is used to respond to the virtual scene selection instruction and determine the target virtual scene from multiple virtual scenes.

[0196] The first target virtual scene sending module is used to send the target virtual scene to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual scene.

[0197] The second target virtual scene sending module is used to send the target virtual scene to the second head-mounted display device to instruct the second head-mounted display device to display the target virtual scene.

[0198] Furthermore, the remote interaction device 500 further includes: a virtual item selection instruction receiving module, a target virtual item determining module, a first target virtual item sending module and a second target virtual item sending module, wherein:

[0199] The virtual prop selection instruction receiving module is used to receive the virtual prop selection instruction sent by the first head-mounted display device, wherein the virtual prop selection instruction is triggered by a user corresponding to the first head-mounted display device in the target virtual scene.

[0200] The target virtual prop determination module is used to respond to the virtual prop selection instruction and determine the target virtual prop from multiple virtual props.

[0201] The first target virtual prop sending module is used to send the target virtual prop to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual prop.

[0202] The second target virtual prop sending module is used to send the target virtual prop to the second head-mounted display device to instruct the second head-mounted display device to display the target virtual prop.

[0203] Furthermore, the remote interaction device 500 further includes: an input information receiving module and an input information sending module, wherein:

[0204] The input information receiving module is used to receive input information sent by the first head-mounted display device, wherein the input information is input on the target virtual prop by a user corresponding to the first head-mounted display device.

[0205] The input information sending module is used to send the input information to the second head-mounted display device to instruct the second head-mounted display device to display the input information and the target virtual props accordingly.

[0206] Furthermore, the remote interaction device 500 further includes: a feedback information receiving module and a feedback information sending module, wherein:

[0207] A feedback information receiving module is used to receive feedback information sent by the second head-mounted display device, wherein the feedback information is triggered by a user corresponding to the second head-mounted display device in the target virtual scene.

[0208] The feedback information sending module is used to send the feedback information to the first head-mounted display device to instruct the first head-mounted display device to display the feedback information.

[0209] Furthermore, the remote interaction device 500 further includes: a data adjustment instruction receiving module, a to-be-displayed data obtaining module and a third to-be-displayed data sending module, wherein:

[0210] The data adjustment instruction receiving module is used to receive the data adjustment instruction sent by the second head-mounted display device, wherein the data adjustment instruction is triggered by a user corresponding to the second head-mounted display device.

[0211] The to-be-displayed data obtaining module is used to adjust the first to-be-displayed data in response to the data adjustment instruction to obtain second to-be-displayed data.

[0212] The third to-be-displayed data sending module is configured to send the second to-be-displayed data to the second head-mounted display device to instruct the second head-mounted display device to display the second to-be-displayed data.

[0213] Furthermore, the remote interaction device 500 further includes: a user viewing instruction receiving module, a user viewing instruction responding module, a to-be-displayed data obtaining module, and a fourth to-be-displayed data sending module, wherein:

[0214] A user viewing instruction receiving module, configured to receive a user viewing instruction sent by the first head mounted display device, wherein the user viewing instruction is triggered by a user corresponding to the first head mounted display device;

[0215] The user viewing instruction response module is used to respond to the user viewing instruction and obtain user data of the user corresponding to the second head-mounted display device as second user data.

[0216] The module for obtaining data to be displayed is used to process the second user data to obtain third data to be displayed.

[0217] The fourth to-be-displayed data sending module is configured to send the third to-be-displayed data to the first head-mounted display device to instruct the first head-mounted display device to display the third to-be-displayed data.

[0218] See also Fig.17 , Fig.17 The module block diagram of the remote interaction device provided by another embodiment of the present application is shown. The remote interaction device 600 can be applied to the first head-mounted display device mentioned above, the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device. Fig.17 As shown in the block diagram, the remote interaction device 600 further includes: a user data acquisition module 610, a user data sending module 620 and a data display module 630, wherein:

[0219] The user data collection module 610 is used to collect user data of a user corresponding to the first head mounted display device as first user data.

[0220] The user data sending module 620 is used to send the first user data to the electronic device to instruct the electronic device to process the first user data to obtain first data to be displayed, and send the first data to be displayed to the first head-mounted display device and the second head-mounted display device for display respectively.

[0221] The data display module 630 is configured to receive the first data to be displayed sent by the electronic device, and display the first data to be displayed.

[0222] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0223] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0224] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0225] In some implementations, this embodiment further provides a remote interaction system, which includes an electronic device and at least two head-mounted display devices, wherein the electronic device is connected to the at least two head-mounted display devices, wherein the at least two head-mounted display devices include a first head-mounted display device and a second head-mounted display device. Among them: the electronic device is used to obtain user data of a user corresponding to the first head-mounted display device as the first user data; the electronic device is used to process the first user data to obtain first data to be displayed; the electronic device is used to send the first data to be displayed to the first head-mounted display device; the first head-mounted display device is used to display the first data to be displayed; the electronic device is used to send the first data to be displayed to the second head-mounted display device; the second head-mounted display device is used to display the first data to be displayed.

[0226] See also Fig.18 , which shows a structural block diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0227] Among them, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0228] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0229] See also Fig.19 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 700 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0230] The computer readable storage medium 700 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 700 includes a non-transitory computer-readable storage medium. The computer readable storage medium 700 has storage space for program code 710 that performs any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 710 can be compressed, for example, in an appropriate form.

[0231] In summary, the remote interaction method, apparatus, system, electronic device, and storage medium provided in the embodiments of the present application obtain user data of a user corresponding to a first head-mounted display device as first user data, process the first user data, obtain first data to be displayed, send the first data to be displayed to the first head-mounted display device to instruct the first head-mounted display device to display the first data to be displayed, and send the first data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the first data to be displayed, thereby obtaining the data to be displayed through the user data of the user corresponding to the first head-mounted display device, and sending the data to be displayed to the first head-mounted display device and the second head-mounted display device for display, respectively, to improve the visual experience during interaction.

[0232] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A remote interaction method, characterized in that: Applied to an electronic device, the electronic device is connected to at least two head-mounted display devices, wherein the at least two head-mounted display devices include a first head-mounted display device and a second head-mounted display device, the method comprising: Acquire user data of a user corresponding to the first head-mounted display device as first user data, where the first user data is collected by a data collection device of the first head-mounted display device itself or by a data collection device located around the first head-mounted display device; Processing the first user data to obtain first data to be displayed; Sending the first data to be displayed to the first head-mounted display device and the second head-mounted display device respectively, so as to instruct the first head-mounted display device to display the first data to be displayed and the second head-mounted display device to display the first data to be displayed; receiving a data adjustment instruction sent by the second head mounted display device, wherein the data adjustment instruction is triggered by an operation of a user corresponding to the second head mounted display device selecting a focused portion from the first data to be displayed; Based on the data adjustment instruction, retain the portion of the first data to be displayed that the user focuses on and delete the portion that the user does not focus on, to obtain second data to be displayed; sending the second data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the second data to be displayed; receiving a user viewing instruction sent by the first head-mounted display device, wherein the user viewing instruction is triggered by a user corresponding to the first head-mounted display device; In response to the user viewing instruction, user data of a user corresponding to the second head-mounted display device is acquired as second user data, where the second user data is acquired by a data acquisition device of the second head-mounted display device itself or by a data acquisition device located around the second head-mounted display device; Processing the second user data to obtain third data to be displayed; The third data to be displayed is sent to the first head mounted display device to instruct the first head mounted display device to display the third data to be displayed.

2. The method according to claim 1, characterized in that The electronic device is also connected to a data acquisition device, and the acquiring of user data of a user corresponding to the first head mounted display device as first user data includes: The user data of the user corresponding to the first head mounted display device sent by the data acquisition device is obtained as the first user data.

3. The method according to claim 2, characterized in that The data acquisition device is composed of at least one smart home device, and the acquiring, as the first user data, the user data of the user corresponding to the first head mounted display device sent by the data acquisition device includes: Acquire at least one smart home device located within a preset range of the first head mounted display device; When the at least one smart home device meets the preset data collection condition, user data of a user corresponding to the first head-mounted display device sent by the at least one smart home device is obtained as the first user data.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: receiving a virtual scene selection instruction sent by the first head mounted display device, wherein the virtual scene selection instruction is triggered by a user corresponding to the first head mounted display device; In response to the virtual scene selection instruction, determining a target virtual scene from a plurality of virtual scenes; Sending the target virtual scene to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual scene; The target virtual scene is sent to the second head-mounted display device to instruct the second head-mounted display device to display the target virtual scene.

5. The method according to claim 4, characterized in that After sending the target virtual scene to the first head mounted display device to instruct the first head mounted display device to display the target virtual scene, the method further includes: receiving a virtual prop selection instruction sent by the first head mounted display device, wherein the virtual prop selection instruction is triggered by a user corresponding to the first head mounted display device in the target virtual scene; In response to the virtual item selection instruction, determining a target virtual item from a plurality of virtual items; Sending the target virtual prop to the first head-mounted display device to instruct the first head-mounted display device to display the target virtual prop; The target virtual prop is sent to the second head mounted display device to instruct the second head mounted display device to display the target virtual prop.

6. The method according to claim 5, characterized in that After sending the target virtual prop to the first head mounted display device to instruct the first head mounted display device to display the target virtual prop, the method further includes: receiving input information sent by the first head mounted display device, wherein the input information is input by a user corresponding to the first head mounted display device on the target virtual prop; The input information is sent to the second head mounted display device to instruct the second head mounted display device to display the input information and the target virtual props accordingly.

7. The method according to claim 4, characterized in that After sending the target virtual scene to the second head mounted display device to instruct the second head mounted display device to display the target virtual scene, the method further includes: receiving feedback information sent by the second head mounted display device, wherein the feedback information is triggered by a user corresponding to the second head mounted display device in the target virtual scene; The feedback information is sent to the first head-mounted display device to instruct the first head-mounted display device to display the feedback information.

8. A remote interaction method, characterized in that: Applied to a first head-mounted display device, the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device, the method includes: Collecting user data of a user corresponding to the first head-mounted display device as first user data, where the first user data is collected by a data collection device of the first head-mounted display device itself or by a data collection device located around the first head-mounted display device; The first user data is sent to the electronic device to instruct the electronic device to perform the following operations: the first user data is processed to obtain first data to be displayed, and the first data to be displayed is sent to the first head-mounted display device and the second head-mounted display device for display respectively; a data adjustment instruction is received from the second head-mounted display device, wherein the data adjustment instruction is triggered by an operation of a user corresponding to the second head-mounted display device selecting a focused portion from the first data to be displayed; based on the data adjustment instruction, the focused portion of the user in the first data to be displayed is retained and the portion that the user does not focus on is deleted to obtain second data to be displayed; the second data to be displayed is sent to the second head-mounted display device, so that the second head-mounted display device displays the second data to be displayed; receiving the first data to be displayed sent by the electronic device, and displaying the first data to be displayed; A user viewing instruction triggered by a user corresponding to the first head-mounted display device is sent to the electronic device to instruct the electronic device to perform the following operations: receiving the user viewing instruction sent by the first head-mounted display device; in response to the user viewing instruction, obtaining user data of a user corresponding to the second head-mounted display device as second user data, wherein the second user data is collected by a data collection device of the second head-mounted display device itself or by a data collection device located around the second head-mounted display device; processing the second user data to obtain third data to be displayed; and sending the third data to be displayed to the first head-mounted display device; receiving third data to be displayed sent by the electronic device, and displaying the third data to be displayed.

9. A remote interaction device, characterized in that: Applied to an electronic device, the electronic device is connected to at least two head-mounted display devices, wherein the at least two head-mounted display devices include a first head-mounted display device and a second head-mounted display device, and the device includes: A user data acquisition module, configured to acquire user data of a user corresponding to the first head mounted display device as first user data, wherein the first user data is acquired by a data acquisition device of the first head mounted display device itself or by a data acquisition device located around the first head mounted display device; a module for obtaining data to be displayed, used for processing the first user data to obtain first data to be displayed; a first to-be-displayed data sending module, configured to send the first to-be-displayed data to the first head-mounted display device, so as to instruct the first head-mounted display device to display the first to-be-displayed data; a second data to be displayed sending module, configured to send the first data to be displayed to the second head mounted display device, so as to instruct the second head mounted display device to display the first data to be displayed; a data adjustment instruction receiving module, configured to receive a data adjustment instruction sent by the second head mounted display device, wherein the data adjustment instruction is triggered by an operation of a user corresponding to the second head mounted display device selecting a focused portion from the first data to be displayed; a module for obtaining data to be displayed, configured to retain the portion of the first data to be displayed that the user focuses on and delete the portion that the user does not focus on, based on the data adjustment instruction, to obtain second data to be displayed; a third to-be-displayed data sending module, configured to send the second to-be-displayed data to the second head-mounted display device, so as to instruct the second head-mounted display device to display the second to-be-displayed data; A user viewing instruction receiving module, configured to receive a user viewing instruction sent by the first head mounted display device, wherein the user viewing instruction is triggered by a user corresponding to the first head mounted display device; a user viewing instruction response module, configured to respond to the user viewing instruction and obtain user data of a user corresponding to the second head mounted display device as second user data, wherein the second user data is collected by a data collection device of the second head mounted display device itself or by a data collection device located around the second head mounted display device; a module for obtaining data to be displayed, used for processing the second user data to obtain third data to be displayed; The fourth to-be-displayed data sending module is configured to send the third to-be-displayed data to the first head-mounted display device to instruct the first head-mounted display device to display the third to-be-displayed data.

10. A remote interaction device, characterized in that: Applied to a first head-mounted display device, the first head-mounted display device is connected to an electronic device, and the electronic device is also connected to a second head-mounted display device, the apparatus comprises: A user data collection module, used to collect user data of a user corresponding to the first head-mounted display device as first user data, wherein the first user data is collected by a data collection device of the first head-mounted display device itself or by a data collection device located around the first head-mounted display device; A user data sending module, configured to send the first user data to the electronic device to instruct the electronic device to perform the following operations: process the first user data to obtain first data to be displayed, and send the first data to be displayed to the first head-mounted display device and the second head-mounted display device for display respectively; receive a data adjustment instruction sent by the second head-mounted display device, wherein the data adjustment instruction is triggered by an operation of a user corresponding to the second head-mounted display device selecting a focused part from the first data to be displayed; based on the data adjustment instruction, retain the focused part of the first data to be displayed by the user and delete the part that the user does not focus on, to obtain the second data to be displayed; send the second data to be displayed to the second head-mounted display device, so that the second head-mounted display device displays the second data to be displayed; a data display module, configured to receive the first data to be displayed sent by the electronic device, and display the first data to be displayed; A user viewing instruction triggered by a user corresponding to the first head-mounted display device is sent to the electronic device to instruct the electronic device to perform the following operations: receiving the user viewing instruction sent by the first head-mounted display device; in response to the user viewing instruction, obtaining user data of a user corresponding to the second head-mounted display device as second user data, wherein the second user data is collected by a data collection device of the second head-mounted display device itself or by a data collection device located around the second head-mounted display device; processing the second user data to obtain third data to be displayed; and sending the third data to be displayed to the first head-mounted display device; receiving third data to be displayed sent by the electronic device, and displaying the third data to be displayed.

11. A remote interactive system, characterized in that: The remote interaction system comprises an electronic device and at least two head-mounted display devices, wherein the electronic device is connected to the at least two head-mounted display devices, wherein the at least two head-mounted display devices comprise a first head-mounted display device and a second head-mounted display device, wherein: The electronic device is used to obtain user data of a user corresponding to the first head-mounted display device as first user data, wherein the first user data is collected by a data collection device of the first head-mounted display device itself or by a data collection device located around the first head-mounted display device; The electronic device is used to process the first user data to obtain first data to be displayed; The electronic device is used to send the first to-be-displayed data to the first head-mounted display device and the second head-mounted display device respectively; The first head mounted display device is used to display the first data to be displayed; The second head mounted display device is used to display the first data to be displayed; The electronic device is configured to receive a data adjustment instruction sent by the second head mounted display device, wherein the data adjustment instruction is triggered by an operation of a user corresponding to the second head mounted display device selecting a focused portion from the first data to be displayed; The electronic device is configured to retain the portion of the first data to be displayed that the user focuses on and delete the portion that the user does not focus on based on the data adjustment instruction, so as to obtain the second data to be displayed; The electronic device is used to send the second data to be displayed to the second head-mounted display device to instruct the second head-mounted display device to display the second data to be displayed; The electronic device is configured to receive a user viewing instruction sent by the first head mounted display device, wherein the user viewing instruction is triggered by a user corresponding to the first head mounted display device; The electronic device is used to respond to the user viewing instruction and obtain user data of a user corresponding to the second head-mounted display device as second user data, where the second user data is collected by a data collection device of the second head-mounted display device itself or by a data collection device located around the second head-mounted display device; The electronic device is used to process the second user data to obtain third data to be displayed; The electronic device is used to send the third data to be displayed to the first head mounted display device; The first head mounted display device is used to display the third data to be displayed.

12. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 7.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 7.