Method and apparatus for interaction, and device and storage medium

Abstract

According to the embodiments of the present disclosure, provided are a method and apparatus for interaction, and a device and a storage medium. The method provided herein comprises: at an electronic device associated with a first user, receiving from a second user an invitation to join a virtual scene; and on the basis of an acknowledgement of the invitation, the electronic device at least presenting a first image and a second image, which are associated with the virtual scene, wherein the first image corresponds to the first user, the second image corresponds to the second user, and the first image and the second image are presented at different positions relative to the first user. Thus, the embodiments of the present disclosure enable the enhancement of interaction between different users with respect to a virtual scene, thereby improving the interaction experience for the users.

Description

Method, device, apparatus and storage medium for interaction

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for interaction” and application number 2023112119985, filed on September 19, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure relate generally to the field of computers, and more particularly to methods, apparatuses, devices, and computer-readable storage media for interaction. Background Art

[0003] With the development of computing, various electronic devices have greatly enriched people's daily lives. For example, people can use electronic devices to interact in various virtual scenes. Therefore, how to improve people's interactive experience in virtual scenes has become a focus of attention.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, an interaction method is provided. The method includes: receiving, at an electronic device associated with a first user, an invitation from a second user to join a virtual scene; and upon confirmation of the invitation, presenting, by the electronic device, at least a first screen and a second screen associated with the virtual scene, wherein the first screen corresponds to the first user and the second screen corresponds to the second user, and wherein the first screen and the second screen are presented at different positions relative to the first user.

[0006] In a second aspect of the present disclosure, a device for interaction is provided. The device includes: a receiving module configured to receive, at an electronic device associated with a first user, an invitation from a second user to join a virtual scene; and a presenting module configured to, upon confirmation of the invitation, present, via the electronic device, at least a first screen and a second screen associated with the virtual scene, wherein the first screen corresponds to the first user and the second screen corresponds to the second user, and wherein the first screen and the second screen are presented at different positions relative to the first user.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0009] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] 2A to 2C show example schematic diagrams of interactions according to some embodiments of the present disclosure;

[0013] FIG3 shows a flow chart of an interactive method according to some embodiments of the present disclosure;

[0014] FIG4 shows a block diagram of an apparatus for interaction according to some embodiments of the present disclosure; and

[0015] FIG5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0016] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0017] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0018] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0019] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0020] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0021] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0022] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0023] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0024] As briefly mentioned above, people can already use various electronic devices to interact with virtual scenes. For example, people can join the same virtual scene and collaborate or compete with each other. Traditional virtual scene interaction typically provides users with a corresponding screen. However, this approach has significant limitations in multi-user interactive scenarios.

[0025] Embodiments of the present disclosure provide an interactive solution. According to this solution, an invitation to join a virtual scene can be received from a second user at an electronic device associated with a first user. Furthermore, based on confirmation of the invitation, the electronic device presents at least a first screen and a second screen associated with the virtual scene, wherein the first screen corresponds to the first user and the second screen corresponds to the second user, and the first screen and the second screen are presented at different positions relative to the first user.

[0026] Based on this approach, the embodiments of the present disclosure can initiate interaction among multiple people in a virtual scene through invitations between users, and can provide users with a better interactive experience by providing multiple screens.

[0027] Example embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0028] Sample Environment

[0029] 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. The example environment 100 includes a user 110 and an electronic device 120. The electronic device 120 may be configured to provide an interface 140 to the user.

[0030] In this example environment 100, the electronic device 120 may, for example, include an application installed and running that supports a virtual environment (hereinafter referred to as a control module), thereby supporting the provision of an interface 140 at the electronic device 120 or by the electronic device 120 to the user 110 in a virtual environment or an immersive environment.

[0031] In some embodiments, the electronic device 120 may include an extended reality (XR) device, for example. It should be understood that extended reality may include virtual reality (VR), augmented reality (AR), and mixed reality (MR).

[0032] As shown in Figure 1, the electronic device 120 may be a head-mounted XR device. When the user 110 wears the electronic device 120, the electronic device 120 may display a virtual environment for the user 110, which may include multiple virtual objects and representations of real objects in the real world.

[0033] In some embodiments, the electronic device 120 may also be other electronic devices, and the interface 140 is provided through a display device. Examples of such electronic devices may include, but are not limited to, mobile terminals, fixed terminals, or portable terminals, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, gaming devices, wearable devices, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the electronic device 120 may also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0034] As shown in Figure 1, the environment 100 optionally includes a remote device 130, and the electronic device 120 can communicate with the remote device 130. In some embodiments, the remote device 130 can be a cloud server.

[0035] It should be understood that the remote device 130 may include at least one of one or more servers, cloud computing platforms, and virtualization centers. It should also be understood that in some embodiments, the remote device 130 is a background service that supports virtual environment applications. In some embodiments, a specific process can be implemented collaboratively by the remote device 130 and the electronic device 120. For example, in some embodiments, the remote device 130 undertakes the primary computing work and the computing device 120 undertakes the secondary computing work. Alternatively, in other embodiments, the remote device 130 undertakes the secondary computing work and the electronic device 120 undertakes the primary computing work. Alternatively, in some embodiments, a specific process can be implemented independently by the remote device 130 or the electronic device 120.

[0036] In short, although in some embodiments, some operations are described as being implemented by the electronic device 120, these operations may be implemented at least in part by the remote device 130. Correspondingly, although some operations are described as being implemented by the remote device 130, these operations may be implemented at least in part by the electronic device 120. For the sake of brevity only, identical or similar descriptions will be omitted.

[0037] In some examples, electronic device 120 can receive information from remote device 130 and display the information accordingly. Taking a game scenario as an example, electronic device 120 can receive game screens from remote device 130 and display them accordingly. Furthermore, electronic device 120 can also transmit game control instructions to remote device 130, so that remote device 130 can update the screen accordingly based on the game control instructions.

[0038] In some embodiments, in an example where multiple electronic devices 120 participate in the interaction of a virtual scene, game control instructions of the multiple electronic devices 120 can also be sent to a specific electronic device 120 and processed uniformly by the specific electronic device 120.

[0039] For example, such a specific electronic device 120 may correspond to the host end, and other users' control instructions for the virtual scene may be sent to the electronic device 120 of the host end, and the electronic device 120 and the remote device 130 may interact in a unified manner to execute the control of the virtual scene and the generation of the corresponding screen.

[0040] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0041] Example Interaction

[0042] Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings: Figures 2A to 2C illustrate example interaction processes according to some embodiments of the present disclosure.

[0043] In some embodiments, a user who has already joined the interaction of a virtual scene can, for example, initiate an invitation to other users to join the virtual scene. Such a virtual scene can, for example, include a game interaction scene.

[0044] As shown in Figure 2, upon receiving the invitation, the electronic device 120 may present an interface 200A as shown in Figure 2A. The interface 200A may indicate that another user invites the user 110 to join the interaction in the virtual scene.

[0045] In some embodiments, the user who initiates the invitation may include, for example, a live broadcaster in a live broadcast room. The live broadcaster may, for example, initiate an invitation to other users to join the virtual scene during the live broadcast of the virtual scene.

[0046] In some embodiments, the user invited by the live broadcaster may include a viewer in the live broadcast room. Taking FIG. 2A as an example, user 110 may receive an invitation to join a virtual scene while watching live broadcast content 210.

[0047] Furthermore, the user 110 may confirm the invitation through the control 215 , or reject the invitation through the control 220 , for example.

[0048] It should be understood that although the interface 200A is shown as a virtual interface in an XR environment, this is merely an example embodiment. The interface 200A may also be provided by other appropriate electronic devices, for example.

[0049] Furthermore, after receiving confirmation of the invitation, the electronic device 120 may present an interface 200B as shown in Figure 2B. As shown in Figure 2B, the interface 200B may present, for example, multiple screens corresponding to multiple users.

[0050] For example, interface 200B may include screen 225-1 corresponding to user 110. Taking a game scene as an example, screen 225-1 may include the game screen corresponding to user 110. Furthermore, interface 200B may also include screen 225-2, which may correspond to the user who initiated the invitation. Taking the live broadcaster as an example, screen 225-2 may include the game screen corresponding to the live broadcaster.

[0051] Additionally, the interface 200B may further include one or more other screens, such as screen 225-3. Such screen 225-3 may correspond to a user who has received an invitation from the user 110 or other users who have already joined the virtual scene.

[0052] In this way, after being invited to join the interaction in the virtual scene, the user can simultaneously observe the images of other users who have already joined the virtual scene, thereby enhancing the user's interactive experience.

[0053] In some embodiments, the screen 225-1, the screen 225-2, and the screen 225-3 may be presented at different perspectives relative to the user 110. Taking FIG2B as an example, the screen 225-1, the screen 225-2, and the screen 225-3 may be presented at different locations in a virtual environment (also referred to as an XR environment) provided by an XR device.

[0054] Specifically, the XR device may render a virtual environment, and may further render the screen 225 - 1 , the screen 225 - 2 , and / or the screen 225 - 3 in the virtual environment.

[0055] In some embodiments, the XR device may generate a stitched screen corresponding to the screen 225 - 1 , the screen 225 - 2 , and the screen 225 - 3 , and render the stitched screen as a whole in the XR environment.

[0056] In some embodiments, the XR device can also render screen 225-1, screen 225-2, and screen 225-3 separately in the XR environment. For example, different screens 225-1 to 225-3 can correspond to different refresh rates or frame rates. Alternatively, if a particular screen 225-1 fails to be acquired, the rendering of other screens can continue without being affected.

[0057] In some embodiments, the display positions of screens 225-1 to 225-3 may also change dynamically. Taking FIG. 2B as an example, screen 225-1 may currently correspond to the middle position, screen 225-2 may correspond to the left position, and screen 225-3 may correspond to the right position.

[0058] In some embodiments, the XR device can change the display position of screens 225-1 to 225-3 based on user operations. For example, the user can adjust screen 225-2 or screen 225-* to the middle position by turning the head or pressing a button, so that the user can quickly switch to the screen they want to focus on.

[0059] As another example, the XR device may also periodically adjust the display positions of screens 225-1 to 225-3. Taking Figure 2B as an example, the XR device may, for example, adjust the display positions of screens 225-1 to 225-3 in a clockwise or counterclockwise direction. For example, after a predetermined duration, screen 225-1 may be adjusted to the left position for display, screen 225-3 may be adjusted to the middle position for display, and screen 225-2 may be adjusted to the right position for display. Subsequently, screen 225-1 may be adjusted to the right position for display, screen 225-3 may be adjusted to the left position for display, and screen 225-2 may be adjusted to the middle position for display. Such an adjustment process may be automatically performed by the XR device, or started or stopped based on user operation.

[0060] In this way, users can obtain the interactive perspectives of different users through immersive experience, thereby enhancing the user's interactive experience with the virtual scene.

[0061] In other embodiments, the screen 225 - 1 , the screen 225 - 2 , and the screen 225 - 3 may be provided by different display devices, or provided as different parts of a screen displayed by the same display device.

[0062] In some embodiments, such screens 225-1, 225-2, and 225-3 may be generated by the remote device 130 associated with the virtual scene based on the scene interaction behaviors of each user. Taking a game scene as an example, a cloud gaming server may generate a unified scene screen based on the interaction behaviors of each user, and the scene screen may include different parts corresponding to different users.

[0063] Furthermore, the user 110 may also interact with the virtual scene via the electronic device 120. The electronic device 120 may send the received interaction instruction to the remote device 130, so that the remote device 130 updates the scene screen, for example, screen 225-1, screen 225-2, and / or screen 225-3, according to the received interaction instruction.

[0064] In some embodiments, the screen 225-1, the screen 225-2, and / or the screen 225-3 may include two-dimensional screens associated with the virtual scene. For example, the screen 225-1, the screen 225-2, and / or the screen 225-3 may be provided as different virtual screens in the virtual environment.

[0065] In other embodiments, the screen 225-1, the screen 225-2, and / or the screen 225-3 may correspond to different three-dimensional parts used to constitute the virtual environment provided by the XR device. For example, the remote device 130 may determine the different three-dimensional parts corresponding to each user based on the corresponding position of each user in the virtual scene (e.g., the position of their corresponding avatar in the virtual scene), and stitch the different three-dimensional parts together.

[0066] As a result, users can, for example, obtain the real-time interaction of different users in a virtual scene as if they were there, thereby improving the user's interactive experience.

[0067] In some further embodiments, when at least one user joining the virtual scene is a live broadcaster, the electronic device 120 may, for example, use the live broadcast content about the virtual scene provided by the live broadcaster as its corresponding screen.

[0068] Taking FIG2C as an example, screen 225-1 provided by electronic device 120 may correspond to the live broadcast screen of the live broadcaster, screen 225-2 may correspond to the screen of user 110 interacting with the virtual scene, and screen 225-3 may correspond to the screen of other non-live broadcast users interacting with the virtual scene.

[0069] That is, the embodiments of the present disclosure can combine the live broadcast screen of the live broadcaster with the interactive screens of other users invited by the live broadcaster to join the virtual scene interaction, thereby enhancing the user's interactive experience and live broadcast viewing experience.

[0070] Thus, user 110 can interact with the virtual scene through screen 225-2 while obtaining real-time live content through screen 225-1. Additionally, user 110 can also use live screen 225-1 to interact appropriately with the live broadcast room, such as sending comments, sending virtual gifts, giving likes, etc.

[0071] 2B , such multiple screens 225-1, 225-2, and 225-3 may be presented at different positions relative to the user 110. Taking FIG2C as an example, the screens 225-1, 225-2, and 225-3 may be presented at different perspectives in the virtual environment provided by the XR device.

[0072] In this way, users can obtain the interactive perspectives of different users through immersive experience, thereby enhancing the user's interactive experience with the virtual scene.

[0073] In other embodiments, the screen 225 - 1 , the screen 225 - 2 , and the screen 225 - 3 may be provided by different display devices, or provided as different parts of a screen displayed by the same display device.

[0074] In this way, the embodiments of the present disclosure can enrich the interactive experience in the live broadcast room, so that viewers in the live broadcast room can participate in the interaction with the live broadcaster in the virtual scene while obtaining the live broadcast content.

[0075] In addition, by uniformly processing the interaction of virtual scenes, generating images, and / or stitching images by a remote device, the embodiments of the present disclosure can further reduce the hardware requirements for terminal devices (e.g., electronic device 120), thereby providing a unified interactive experience for more users.

[0076] Example Process

[0077] Figure 3 shows a flowchart of an interaction method 300 according to some embodiments of the present disclosure. Method 300 may be performed by electronic device 120 in Figure 1 . For ease of discussion, the following description uses electronic device 120 as an example. However, this is merely exemplary and does not limit the embodiments of the present disclosure in any way. It should be understood that embodiments of the present disclosure may also be performed by other appropriate electronic devices.

[0078] As shown in FIG. 3 , at block 310 , an invitation to join a virtual scene is received from a second user at an electronic device 120 associated with a first user.

[0079] In box 320, based on the confirmation of the invitation, the electronic device 120 presents at least a first screen and a second screen associated with the virtual scene, wherein the first screen corresponds to the first user and the second screen corresponds to the second user, wherein the first screen and the second screen are presented at different positions relative to the first user.

[0080] In some embodiments, the second user is a live broadcaster, who is configured to provide live broadcast content regarding the virtual scene.

[0081] In some embodiments, the second screen includes a live screen corresponding to the live content.

[0082] In some embodiments, presenting at least a first screen and a second screen associated with a virtual scene by an electronic device includes: presenting a scene screen by the electronic device, the scene screen being generated by a remote device associated with the virtual scene based on scene interaction behavior of a first user and a second user, and the scene screen including the first screen and the second screen.

[0083] In some embodiments, the first screen and the second screen are presented by the extended reality XR device such that the first screen and the second screen are presented at different perspectives relative to a current user of the extended reality XR device.

[0084] In some embodiments, the XR device is configured to: render a virtual environment; and render the first screen and the second screen in the virtual environment.

[0085] In some embodiments, rendering the first picture and the second picture in the virtual environment includes: rendering a spliced ​​picture composed of at least the first picture and the second picture in the virtual environment as a whole; or rendering the first picture and the second picture separately in the virtual environment.

[0086] In some embodiments, the XR device is configured to: render a stitched screen composed of at least the first screen and the second screen as a whole; or render the first screen and the second screen separately.

[0087] In some embodiments, process 300 further includes: changing the perspectives of the first and second pictures relative to the current user based on an operation of the current user; or periodically adjusting the perspectives of the first and second pictures relative to the current user.

[0088] In some embodiments, the first screen and the second screen include two-dimensional images corresponding to the virtual scene; and / or the first screen and the second screen correspond to the first three-dimensional part and the second three-dimensional part used to constitute the virtual environment rendered by the XR device.

[0089] In some embodiments, the first picture and the second picture are presented by different display devices.

[0090] In some embodiments, the method 300 further includes: receiving an interaction instruction of the first user regarding the virtual scene; and sending the interaction instruction to the remote device to obtain an updated first screen and / or second screen from the remote device.

[0091] In some embodiments, the electronic device further presents at least one third screen, where the at least one third screen corresponds to at least one third user invited by the first user and / or the second user to join the virtual scene.

[0092] Example devices and equipment

[0093] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 4 shows a block diagram of a device 400 for interacting in a virtual scene according to some embodiments of the present disclosure.

[0094] As shown in Figure 4, the device 400 includes a receiving module 410, which is configured to receive an invitation to join a virtual scene from a second user at an electronic device associated with the first user; and a presenting module 420, which is configured to present at least a first screen and a second screen associated with the virtual scene by the electronic device 120 based on confirmation of the invitation, wherein the first screen corresponds to the first user and the second screen corresponds to the second user, and the first screen and the second screen are presented at different positions relative to the first user.

[0095] In some embodiments, the second user is a live broadcaster, and the live broadcaster is used to provide live broadcast content about the virtual scene, and the second screen includes a live broadcast screen corresponding to the live broadcast content.

[0096] In some embodiments, the presentation module 420 is further configured to: present a scene picture by the electronic device, where the scene picture is generated by a remote device associated with the virtual scene based on the scene interaction behavior of the first user and the second user, and the scene picture includes the first picture and the second picture.

[0097] In some embodiments, the first screen and the second screen are presented by the extended reality XR device such that the first screen and the second screen are presented at different perspectives relative to a current user of the extended reality XR device.

[0098] In some embodiments, the XR device is configured to: render a virtual environment; and render the first screen and the second screen in the virtual environment.

[0099] In some embodiments, the XR device is further configured to: render a stitched screen consisting of at least the first screen and the second screen as a whole in the virtual environment; or render the first screen and the second screen separately in the virtual environment.

[0100] In some embodiments, the device 400 further includes an adjustment module configured to: change the perspectives of the first and second images relative to the current user based on the current user's operation; or periodically adjust the perspectives of the first and second images relative to the current user.

[0101] In some embodiments, the first screen and the second screen include two-dimensional images corresponding to the virtual scene; and / or the first screen and the second screen correspond to the first three-dimensional part and the second three-dimensional part used to constitute the virtual environment rendered by the XR device.

[0102] In some embodiments, the first picture and the second picture are presented by different display devices.

[0103] In some embodiments, the apparatus 400 further includes a control module configured to: receive an interaction instruction from the first user regarding the virtual scene; and send the interaction instruction to the remote device to obtain an updated first screen and / or second screen from the remote device.

[0104] In some embodiments, the electronic device further presents at least one third screen, where the at least one third screen corresponds to at least one third user invited by the first user and / or the second user to join the virtual scene.

[0105] The modules included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the modules in the device 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0106] FIG5 shows a block diagram of an electronic device / server 500 in which one or more embodiments of the present disclosure may be implemented. The electronic device 120 of FIG1 may be implemented, for example, by the electronic device / server 500 shown in FIG5 . It should be understood that the electronic device / server 500 shown in FIG5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein.

[0107] As shown in FIG5 , electronic device / server 500 is in the form of a general-purpose electronic device. Components of electronic device / server 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage device 530, one or more communication units 540, one or more input devices 560, and one or more output devices 560. Processing unit 510 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device / server 500.

[0108] The electronic device / server 500 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device / server 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk or any other medium, which can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device / server 500.

[0109] The electronic device / server 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5 , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0110] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device / server 500 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device / server 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0111] Input device 550 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 560 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device / server 500 may also communicate with one or more external devices (not shown) via communication unit 540, as needed. External devices such as storage devices, display devices, and the like may also be used to communicate with one or more devices that allow a user to interact with electronic device / server 500, or with any device that allows electronic device / server 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0112] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.

[0113] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0114] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0115] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0116] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0117] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An interactive method comprising: At an electronic device associated with the first user, receiving an invitation from a second user to join the virtual scene; as well as Based on confirmation of the invitation, the electronic device presents at least a first screen and a second screen associated with the virtual scene, wherein the first screen corresponds to the first user, and the second screen corresponds to the second user, and the first screen and the second screen are presented at different positions relative to the first user.

2. The method according to claim 1, wherein the second user is a live broadcaster, and the live broadcaster is used to provide live broadcast content about the virtual scene, and the second screen includes a live broadcast screen corresponding to the live broadcast content.

3. The method according to claim 1, wherein presenting, by the electronic device, at least a first screen and a second screen associated with the virtual scene comprises: The electronic device presents a scene picture, where the scene picture is generated by a remote device associated with the virtual scene based on scene interaction behaviors of the first user and the second user, and the scene picture includes the first picture and the second picture. 4 . The method according to claim 1 , wherein the first screen and the second screen are presented by an extended reality (XR) device such that the first screen and the second screen are presented at different perspectives relative to a current user of the extended reality (XR) device.

5. The method of claim 4, wherein the XR device is configured to: Rendering virtual environments; and The first picture and the second picture are rendered in the virtual environment.

6. The method according to claim 5, wherein rendering the first picture and the second picture in the virtual environment comprises: Rendering a spliced ​​picture consisting of at least the first picture and the second picture as a whole in the virtual environment; or The first picture and the second picture are separately rendered in the virtual environment.

7. The method according to claim 4, further comprising: Based on the operation of the current user, changing the perspectives of the first picture and the second picture relative to the current user; or The viewing angles of the first picture and the second picture relative to the current user are periodically adjusted.

8. The method according to claim 4, wherein the first picture and the second picture include two-dimensional images corresponding to the virtual scene; and / or The first screen and the second screen correspond to a first three-dimensional part and a second three-dimensional part used to constitute a virtual environment rendered by the XR device. 9 . The method according to claim 1 , wherein the first picture and the second picture are presented by different display devices respectively.

10. The method according to claim 1, further comprising: receiving an interaction instruction from the first user regarding the virtual scene; as well as The interaction instruction is sent to a remote device to obtain an updated first picture and / or second picture from the remote device.

11. The method according to claim 1, wherein the electronic device further presents at least one third screen, wherein the at least one third screen corresponds to at least one third user invited by the first user and / or the second user to join the virtual scene.

12. An interactive device comprising: A receiving module configured to receive, at an electronic device associated with the first user, an invitation from a second user to join the virtual scene; as well as A presentation module is configured to present, by the electronic device, at least a first screen and a second screen associated with the virtual scene based on confirmation of the invitation, wherein the first screen corresponds to the first user, and the second screen corresponds to the second user, wherein the first screen and the second screen are presented at different positions relative to the first user.

13. An electronic device comprising: at least one processing unit; as well as at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions When executed by the at least one processing unit, the electronic device is caused to perform the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 11.

Images