Virtual interaction method and apparatus, device and medium

By adding an independent second interactive space in the virtual live broadcast scene, the audience allows immersive interaction with the anchor, solving the problem of monotonous existing interaction methods, improving the interaction effect and enthusiasm, and improving the user experience.

WO2024230511A1PCT designated stage expired Publication Date: 2024-11-14BEIJING ZITIAO NETWORK TECH CO LTD

Patent Information

Application Number
PCT/CN2024/089880
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-05
Filing Date
2024-04-25
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

In the virtual live broadcast scenario, the interaction between the audience and the anchor is relatively monotonous, making it difficult to mobilize the audience's enthusiasm for interaction. The existing barrage chat and gift interaction effect are poor.

Method used

On the basis of the first interactive space, a second interactive space that is parallel and independent is added, so that the audience can interact immersively with the anchor in the second interactive space, and control the virtual object to enter the second interactive space through the interaction control information. Rich interactive methods such as voice or video interaction.

Benefits of technology

It improves the effect of virtual interaction and the audience's interactive enthusiasm, improves the interactive experience, provides a richer interactive method to meet users' immersive interaction needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024089880_14112024_PF_FP_ABST
    Figure CN2024089880_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present application are a virtual interaction method and apparatus, a device and a medium. The method comprises: displaying a video stream in a first interaction space, wherein the video stream comprises a target interaction subject; according to interaction control information, controlling at least one virtual object to enter a second interaction space, wherein the second interaction space and the first interaction space are independent of each other; and, in the second interaction space, each virtual object interacting with the target interaction subject.
Need to check novelty before this filing date? Find Prior Art

Description

Virtual interaction method, device, equipment and medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on the Chinese application with application number 202310501377.4 and application date May 5, 2023, and claims its priority. The disclosed content of the Chinese application is hereby introduced as a whole into this application. Technical Field

[0003] The embodiments of the present application relate to the field of human-computer interaction technology, and in particular to a virtual interaction method, apparatus, device, and medium. Background Art

[0004] With the continuous advancement of technology, the application of Extended Reality (XR) technology is becoming increasingly widespread, even becoming a new standard for theatrical presentation. XR technology integrates multiple forms such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It can not only meet the high production standards of stage scenes, but also provide users with an immersive experience.

[0005] Summary of the Invention

[0006] Embodiments of the present application provide a virtual interaction method, apparatus, device, and medium.

[0007] In a first aspect, an embodiment of the present application provides a virtual interaction method, comprising:

[0008] Displaying a video stream in a first interactive space, the video stream including: a target interactive object;

[0009] controlling at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space;

[0010] In the second interactive space, each of the virtual objects interacts with the target interactive object.

[0011] In a second aspect, an embodiment of the present application provides a virtual interactive device, comprising:

[0012] A display module is configured to display a video stream in a first interactive space, wherein the video stream includes: a target interactive object;

[0013] a control module, configured to control at least one virtual object to enter a second interactive space according to the interactive prompt information, wherein the second interactive space is independent of the first interactive space;

[0014] The interactive module is used to allow each virtual object to interact with the target interactive object in the second interactive space.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0016] A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the virtual interaction method described in the embodiment of the first aspect or its various implementations.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the virtual interaction method as described in the embodiment of the first aspect or its various implementations.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the virtual interaction method as described in the embodiment of the first aspect or its various implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] FIG1 is a flow chart of a virtual interaction method provided in an embodiment of the present application;

[0021] FIG2 is a schematic diagram of adding a second interactive space based on a first interactive space according to an embodiment of the present application;

[0022] FIG3 is a flow chart of another virtual interaction method provided in an embodiment of the present application;

[0023] FIG4a is a schematic diagram of displaying an interactive prompt pop-up window in a first interactive space according to an embodiment of the present application;

[0024] FIG4 b is a schematic diagram of selecting the “Go Now” interaction confirmation option in the interactive prompt pop-up window and interacting with the anchor according to an embodiment of the present application;

[0025] FIG5a is a schematic diagram of another embodiment of the present application showing an interactive prompt pop-up window in a first interactive space;

[0026] FIG5 b is a schematic diagram of selecting the “Abandon” interaction rejection option in the interaction prompt pop-up window to refuse interaction with the anchor, provided by an embodiment of the present application;

[0027] 6a to 6f are schematic diagrams of a method for screening target selection instructions and controlling a virtual object corresponding to the target selection instructions to enter a second interactive space, provided by an embodiment of the present application;

[0028] FIG7 is a schematic diagram showing the display of “interacting” identification information on virtual objects participating in interaction in a first interactive space according to an embodiment of the present application;

[0029] FIG8 is a flow chart of another virtual interaction method provided in an embodiment of the present application;

[0030] FIG9a is a schematic diagram of displaying a voice connection screen on an interactive screen in a second interactive space according to an embodiment of the present application;

[0031] FIG9 b is a schematic diagram of highlighting a host who is currently interacting via voice link on an interactive screen, provided by an embodiment of the present application;

[0032] FIG9c is a schematic diagram of another embodiment of the present application, providing a method of highlighting a host who is currently interacting via voice link on an interactive screen;

[0033] FIG10 is a schematic diagram of an interactive screen showing each virtual object and a target interactive object on a first display screen according to an embodiment of the present application;

[0034] FIG11 is a flow chart of another virtual interaction method provided in an embodiment of the present application;

[0035] FIG12a is a schematic diagram of displaying an abnormality prompt pop-up window in a second interactive space according to an embodiment of the present application;

[0036] FIG12b is a schematic diagram of a prompt screen displayed when leaving a second interactive space according to an embodiment of the present application;

[0037] FIG12c is a schematic diagram of another embodiment of the present application providing a pop-up window for displaying an abnormality prompt in the second interactive space;

[0038] FIG13 is a schematic diagram of a specific implementation method provided in an embodiment of the present application;

[0039] FIG14 is a schematic block diagram of a virtual interactive device provided in an embodiment of the present application;

[0040] FIG15 is a schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0042] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0043] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or solution described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or solutions. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0044] Currently, in virtual live streaming scenarios, the two main ways for viewers to interact with hosts are: first, barrage chat, where viewers type and send messages in a chat box, and the host responds accordingly. Second, gift interaction, where viewers send virtual gifts, either free or paid.

[0045] In the current virtual live broadcast scenario, the two interactive methods between viewers and hosts, namely, barrage chat or gift interaction, are relatively monotonous, with poor interactive effects and difficulty in mobilizing the audience's enthusiasm for interaction. This application provides a virtual interactive method, which adds a second interactive space that is parallel and independent to the existing first interactive space on the basis of the existing first interactive space, allowing viewers to interact with the host while immersed in the second interactive space, thereby improving the virtual interactive effect and enhancing the audience's interactive enthusiasm and interactive experience.

[0046] To facilitate understanding of the embodiments of the present application, before describing each embodiment of the present application, some concepts involved in all embodiments of the present application are first appropriately explained as follows:

[0047] 1) Virtual Reality (VR), a technology for creating and experiencing a virtual world, computationally generates a virtual environment, which is a multi-source information (the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.), realizing the fusion of virtual environments, interactive three-dimensional dynamic vision and simulation of entity behavior, allowing users to immerse themselves in a simulated virtual reality environment, and realizing applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0048] 2) Virtual reality devices (VR devices), terminals that achieve virtual reality effects, can usually be provided in the form of glasses, head-mounted displays (HMDs), or contact lenses to achieve visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this and can be further miniaturized or enlarged according to actual needs.

[0049] In some embodiments, the virtual reality devices described in the embodiments of the present application may include but are not limited to the following types:

[0050] 2.1) PC-based virtual reality (PCVR) devices use the PC to perform calculations and output data related to virtual reality functions. External PC-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

[0051] 2.2) Mobile VR devices support the configuration of mobile terminals (such as smartphones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations for VR functions and outputs data to the mobile VR device, such as viewing VR videos through the mobile terminal's app.

[0052] 2.3) All-in-one virtual reality devices have a processor for performing relevant calculations for virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom of use.

[0053] 3) Augmented Reality (AR): A technology that uses real-time calculations of the camera's pose parameters in the real world (also known as the 3D world or the real world) as the camera captures images. Based on these pose parameters, virtual elements are added to the captured image. Virtual elements include, but are not limited to, images, videos, and 3D models. The goal of AR technology is to overlay the virtual world on the real world for interactive viewing.

[0054] 4) Mixed Reality (MR): A simulated setting that integrates computer-generated sensory input (e.g., virtual objects) with sensory input from a physical setting, or its representation. In some MR settings, the computer-generated sensory input can adapt to changes in the sensory input from the physical setting. Additionally, some electronic systems used to render MR settings can monitor the orientation and / or position relative to the physical setting to enable virtual objects to interact with real objects (i.e., physical elements from the physical setting, or their representations). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

[0055] 5) Extended Reality (XR) refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices, including virtual reality (VR), augmented reality (AR) and mixed reality (MR).

[0056] 6) A virtual scene (also known as a virtual space) is a virtual scene displayed (or provided) when an application is running on an electronic device. The virtual scene can be a simulation of the real world, a semi-simulated and semi-fictitious virtual scene, or a purely fictitious virtual scene. The virtual scene can be any of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene. The embodiments of the present application do not limit the dimensions of the virtual scene. For example, the virtual scene can include the sky, land, ocean, etc., and the land can include environmental elements such as deserts and cities.

[0057] 7) Virtual objects: objects that interact in virtual scenes, are controlled by users or robot programs (for example, robot programs based on artificial intelligence), and can be still, move, and perform various behaviors in the virtual scene.

[0058] After introducing some concepts involved in the embodiments of the present application, a virtual interaction method, device, equipment and medium provided by the embodiments of the present application are described in detail with reference to the accompanying drawings.

[0059] Figure 1 is a flow chart of a virtual interaction method provided in an embodiment of the present application. The virtual interaction method provided in the present application can be performed by a virtual interaction device. The virtual interaction device can be composed of hardware and / or software and can be integrated into an electronic device. In the embodiment of the present application, the electronic device can be any hardware device that can provide a virtual space. For example, the electronic device can be, but is not limited to: VR device, AR device, MR device and XR device, etc. The present application does not specifically limit the type of electronic device.

[0060] As shown in FIG1 , the method may include the following steps:

[0061] S101: Display a video stream in a first interactive space, where the video stream includes a target interactive object.

[0062] In the embodiments of the present application, the first interactive space can be understood as a first virtual space, and this first virtual space can be a virtual scene simulated by an electronic device based on a live broadcast scene selected by a broadcaster. For example, if a broadcaster needs to create a live broadcast scene of the type "tropical forest", the electronic device can construct a corresponding virtual live broadcast scene based on this type, which serves as the first interactive space in the present application.

[0063] The first interactive space can display the host's video stream. In this application, the host's video stream is preferably a live video stream. Furthermore, the live video stream includes at least a target interactive object. In this application, the target interactive object can be understood as the host. For example, the target interactive object can be a performer at a concert.

[0064] Correspondingly, when the live video stream of the anchor is displayed in the first interactive space, the first interactive space can be understood as the virtual live broadcast room where the anchor is located.

[0065] It should be understood that a live broadcast room refers to a social networking platform, instant messaging platform, or other platform that brings together numerous online users. Users and hosts log into the live broadcast room through a client. Users exist within the live broadcast room as members, and the same live broadcast room can contain members with multiple identities, such as viewers. Users and hosts can join or exit the live broadcast room.

[0066] For example, user A selects any target live broadcast room from multiple live broadcast rooms displayed on the display screen of the electronic device through a controller such as a handle, and enters the target live broadcast room as a viewer, and then can watch the host performance in the target live broadcast room.

[0067] S102: Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.

[0068] The traditional way of interaction between users (audiences) and anchors is generally barrage chat or gift interaction. However, because the above two interactive methods are relatively monotonous, it is difficult to mobilize the user's enthusiasm for interaction. Therefore, on the basis of the first interactive space, this application adds a new virtual space (second interactive space) that is parallel and independent of the first interactive space, as shown in Figure 2. Furthermore, the second interactive space is used as an independent interactive space to realize virtual interaction, so that users and anchors can carry out various interactions in this independent interactive space, thereby enriching the interactive methods between users and anchors and improving the interactive enthusiasm between users and anchors.

[0069] It should be understood that the creation process of the above-mentioned second interactive space is similar to the creation process of the first interactive space. For example, the second interactive space may be created by default when the host creates the first interactive space, etc., which will not be described in detail here.

[0070] Typically, live streamers can make live content more interesting by interacting with viewers during a live broadcast. Therefore, during a live broadcast, the live streamer can send an interaction invitation to any viewer in the live broadcast room, inviting them to interact. Alternatively, viewers in the live broadcast room can proactively send an interaction request to the live streamer, requesting to interact with them.

[0071] In some embodiments, the host and the audience may establish an interactive connection in the following ways, including but not limited to:

[0072] The first way,

[0073] The host can set up at least one interactive session during the live broadcast. And, whenever an interactive session is reached, an interactive prompt pop-up window can be displayed in the live broadcast room, allowing users to participate in the interaction with the host based on the interactive prompt pop-up window.

[0074] Among them, users participate in the interaction based on the interactive prompt pop-up window. The specific implementation process can be to trigger the confirmation option in the interactive prompt pop-up window, so that the user's corresponding virtual object (such as a virtual character, Avatar) enters the second interactive space dedicated to various interactions, so that the user can interact with the anchor in the second interactive space.

[0075] In this application, the virtual object corresponding to each user in a live broadcast room can be automatically configured by the electronic device based on the user's personal information when entering the room. For example, when user S enters a live broadcast room, the obtained personal information of user S's gender column is male, and a male virtual object is configured for user S based on the male gender. For another example, when user W enters a live broadcast room, the obtained personal information of user W's gender column is female, and a female virtual object is configured for user W based on the female gender.

[0076] In addition, users can also create virtual objects that meet their own personalized needs through the virtual object creation function provided by the electronic device, and this application does not impose specific restrictions on this.

[0077] It should be understood that there may be multiple users in a live broadcast room. Therefore, based on the interactive prompt pop-up window displayed in the live broadcast room, when the user interacts with the anchor, the number of users participating in the interaction can be at least one.

[0078] Second method

[0079] During a live stream, interactive controls, such as the microphone connection control, will appear in the live studio. If any user wishes to interact with the host, they can trigger the microphone connection control within the live studio to send an interaction request to the host. If the host approves the interaction request, the virtual object corresponding to the user who sent the interaction request will enter a second interactive space dedicated to various interactions, where they can interact with the host.

[0080] It should be noted that in addition to users who have established an interactive connection with the anchor, there are other users in the anchor's live broadcast room (i.e., users who have not established an interactive connection with the anchor). Therefore, when the virtual object corresponding to the user who has established an interactive connection with the anchor is controlled to enter the second interactive space, the anchor's interactive space does not need to be switched. That is, the anchor remains in the first interactive space, allowing other users to continue watching the anchor's performance in the first interactive space.

[0081] Because users entering the second interactive space need to interact with the host, this application can use the first camera in the first interactive space to capture the host's real-time image and send it to the second interactive space. Furthermore, the host's real-time image is displayed in the second interactive space, allowing each virtual object in the second interactive space to interact with the host in various ways based on the host's real-time image.

[0082] The first camera in the first interactive space may be understood as a camera for realizing virtual interaction, and the first camera may be a 2D camera or other types of cameras, without any limitation thereto.

[0083] S103: In the second interactive space, each virtual object interacts with the target interactive object.

[0084] When at least one virtual object enters the second interactive space, each virtual object can interact with the target interactive object (anchor). In this application, the interaction can be voice interaction or video interaction.

[0085] Voice-based interaction primarily involves voice calls, while video-based interaction involves both voice and real-time video. This means that with voice-based interaction, only the voice data of both parties can be heard, but the real-time video of both parties cannot be seen. However, with video-based interaction, both the voice data of both parties can be heard, and the real-time video of both parties can be seen.

[0086] Video-linked interactions not only allow users to hear the voice data of both parties, but also to see the real-time images of both parties. Therefore, in this interactive mode, each virtual object can also interact with the target object in different ways.

[0087] In some embodiments, the different types of interactions may include at least one of talent interactions and game interactions.

[0088] Among them, talent interaction may include but is not limited to: the host and each virtual object singing the same song, or the host and each virtual object dancing, etc.

[0089] Among them, game interactions can include but are not limited to: guessing the song by looking at the lip movements, guessing the song title by listening to the prelude, and idiom chain games, etc.

[0090] The technical solution provided by the embodiments of this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space based on interactive control information, thereby allowing each virtual object to interact with a target interactive object in the second interactive space. By adding an independent second interactive space to the first interactive space, this application allows viewers to immersively interact with the host in the independent second interactive space, thereby enriching the virtual interaction methods, improving the virtual interaction effects, and enhancing the audience's interactive enthusiasm and interactive experience.

[0091] Based on the above embodiment, the present application further explains how to control at least one virtual object to enter the second interactive space according to the interactive control information. Please refer to FIG3 for details.

[0092] As shown in FIG3 , the method may include the following steps:

[0093] S201: Display a video stream in a first interactive space, where the video stream includes a target interactive object.

[0094] S202: If the current time is the interaction time, an interaction prompt pop-up window is displayed in the first interaction space, and the interaction prompt pop-up window at least includes: interaction prompt information and interaction confirmation options.

[0095] In some embodiments, before starting a live broadcast, the host can pre-set at least one interactive session and set a start time and end time for each interactive session. This allows the host to interact with users in the live broadcast room in an orderly manner according to the pre-set interactive sessions, and also better control the duration of the live broadcast.

[0096] After setting up the interactive session, the host can start the live broadcast. During the live broadcast, the electronic device will detect in real time whether the current time has reached the preset interactive session start time. If the current time is the interactive start time, an interactive prompt pop-up window will be displayed in the host's live broadcast room (i.e., the first interactive space), allowing users in the live broadcast room to choose whether to interact with the host based on the interactive prompt pop-up window.

[0097] The interactive prompt pop-up window includes: interactive prompt information, interaction confirmation option, and interaction rejection option. Therefore, users in the live broadcast room can participate in the interaction with the anchor by triggering the interaction confirmation option; or they can give up the interaction with the anchor by triggering the interaction rejection option.

[0098] For example, as shown in Figure 4a, the interactive prompt pop-up window displayed in the first interactive space includes the interactive prompt message "XX wants to interact with you," an option to confirm the interaction ("Go now"), and an option to reject the interaction ("Cancel"). If users W and T in the first interactive space want to participate in the interaction with the host, they can each select the "Go now" option to interact with the host using a controller (such as a gamepad), gestures, or voice commands, as shown in Figure 4b.

[0099] For another example, as shown in FIG5a, the interactive prompt pop-up window displayed in the first interactive space includes the interactive prompt information: "XX wants to have a voice chat with you", the interactive confirmation option "Go now" and the interactive rejection option "Give up", the host image and the interactive dynamic effect. If the user XX in the first interactive space does not want to participate in the interaction with the host, the user XX selects the "Give up" interactive rejection option through a controller such as a handle or voice to refuse to interact with the host, as shown in FIG5b. Among them, the host image can be a real image of the host or a virtual image of the host created based on the host, and there is no specific restriction on it here. In addition, the interactive dynamic effect can be selected as a ripple dynamic effect or other dynamic effect for establishing an interactive connection, and there is no restriction on it here.

[0100] S203 : In response to a selection instruction of the interaction confirmation option, controlling at least one virtual object to enter a second interaction space.

[0101] S204: In the second interactive space, each virtual object interacts with the target interactive object.

[0102] In some embodiments, a detection is performed to determine whether any user in the first interactive space has selected an interaction confirmation option in an interaction prompt pop-up window. If a selection is detected for the interaction confirmation option, it is determined that the user who sent the selection instruction wants to interact with the host. In this case, the virtual object corresponding to the user can be controlled to enter the second interactive space. This enables interaction between the host and the virtual object in the second interactive space.

[0103] Considering the limited duration of a live broadcast, in order to ensure the host's normal performance while enabling interaction with users, this application, in response to a selection instruction for the interaction confirmation option, controls the number of virtual objects entering the second interactive space when controlling at least one virtual object to enter the second interactive space, thereby ensuring that the interaction duration between the host and all virtual objects entering the second interactive space does not exceed the preset duration of the interaction session. The number of virtual objects entering the second interactive space can be flexibly adjusted based on the host's preset interaction session duration, for example, to 1, 3, or 4.

[0104] Based on the above reasons, this application first filters a target selection instruction from all the obtained selection instructions based on the filtering rules before controlling at least one virtual object to enter the second interactive space based on the selection instructions for all interaction confirmation options. Then, an operation is performed in response to the target selection instruction, controlling the virtual object corresponding to the target selection instruction to enter the second interactive space. Furthermore, the virtual object entering the second interactive space can interact with the host.

[0105] In this application, the screening rule can be any strategy or algorithm for screening target selection instructions from the obtained selection instructions, and there is no specific limitation on this. For example, the target selection instructions can be screened according to preset identification information, or the target selection instructions can be screened according to a preset ID, etc., and there is no specific limitation on this. Among them, identification information can be understood as information that uniquely identifies the user, such as the user name, user contact number, etc. The preset ID can be the user's ID number, etc.

[0106] In some embodiments, the present application filters target selection instructions from all the obtained selection instructions according to the screening rules, and can determine whether the virtual object identifier corresponding to each selection instruction is a preset identifier. If the virtual object identifier corresponding to any selection instruction is a preset identifier, then the selection instruction is determined to be the target selection instruction. If the selection object identifier corresponding to any selection instruction is not a preset identifier, then the selection instruction is determined not to be the target selection instruction.

[0107] In order to more clearly illustrate the process of filtering the target selection instruction from all selection instructions and controlling the virtual object corresponding to the target selection instruction to enter the second interactive space, specific examples are given below in conjunction with Figures 6a to 6f.

[0108] Specifically, assume that the interactive prompt pop-up window displayed in the first interactive space includes the interactive prompt information: "XX wants to have a voice chat with you", the interactive confirmation option "I want to sign up", the interactive rejection option "Cancel", the host image, interactive animation, and the dynamic prompt information "XXX people have signed up", as shown in Figure 6a. Among them, the dynamic prompt information "XXX people have signed up" will show a dynamic change effect as the number of registrants changes. The update frequency of this dynamic change effect can be flexibly set according to the live broadcast delay requirements. If the live broadcast delay requirement is low, it can be updated every 5 seconds. If the live broadcast delay requirement is high, it can be updated every 1 second, etc. This application does not impose specific restrictions on it.

[0109] As shown in Figure 6b, users 1, 2, 3, 4, 5, and 6 in the first interactive space all click on the "I want to sign up" interactive confirmation option, sending a selection instruction to the electronic device. When the "I want to sign up" interactive confirmation option is clicked, the electronic device and / or controller, such as a controller, outputs vibration feedback to the user, reminding the user that the "I want to sign up" interactive confirmation option has been selected.

[0110] Furthermore, when the electronic device receives the aforementioned selection instruction, it may display prompts such as "Registration successful" and "We will conduct a lottery for the registered audience and notify you of the results later" in the interactive prompt pop-up window within the first interactive space, as shown in FIG6c . In order to prevent the prompt from being displayed for a long time within the first interactive space and obscuring the host's performance, the present application may control the prompt to disappear after a preset display duration, thereby ensuring that the user can fully view the host's performance and avoiding the problem of a poor viewing experience caused by prolonged obstruction. In the present application, the preset duration may be flexibly set according to the live broadcast requirements, such as 2 seconds or 3 seconds.

[0111] If the preset interactive link can interact with up to 4 users, and the screening rule is to filter the target selection instructions according to the preset user name (user nickname), then the user names of User 1, User 2, User 3, User 4, User 5 and User 6 are respectively compared with the preset user names in the screening rule. If the user names of User 1, User 3, User 4 and User 5 are the preset user names, then the selection instructions corresponding to User 1, User 3, User 4 and User 5 are determined to be the target selection instructions. Then, the prompt messages "Congratulations on becoming a lucky audience" and "You are about to enter the dedicated interactive space" are displayed in the first interactive space corresponding to User 1, User 3, User 4 and User 5, as well as the note "Please make sure your network connection is unobstructed and you are in a quiet environment", as shown in Figure 6d. Among them, when the above prompt information and note instructions are displayed for a preset time, the prompt information and note instructions are controlled to disappear.

[0112] As shown in Figure 6e, after the prompt and notes disappear, a preset duration of space switching animation, such as an eye-opening or loading animation, can be displayed within the first interactive space. When the space switching animation reaches the preset duration, a second interactive space will appear in front of the corresponding virtual objects for User 1, User 3, User 4, and User 5, respectively. Users 1, User 3, User 4, and User 5 enter the second interactive space (see Figure 6f). Users 1, User 3, User 4, and User 5 can then engage in various interactions with the host.

[0113] It should be noted that after controlling at least one virtual object to enter the second interactive space, in some embodiments, "interacting" identification information is also displayed on the corresponding virtual object in the first interactive space, so that users in the first interactive space can know which users are interacting with the anchor, as shown in Figure 7.

[0114] In addition, the second interactive space can support interaction between users and anchors, and this interaction is different from the conventional barrage chat and gift giving methods in the first interactive space. Therefore, this application can limit the interactive functions in the second interactive space to distinguish the interaction in the second interactive space from the conventional interaction methods in the first interactive space. For example, in the second interactive space, only the permissions to turn on and off the microphone and the camera are provided to users. Moreover, the permissions to turn on and off the microphone and the camera can also be uniformly managed by the anchor end, so as to avoid some virtual objects from making inappropriate remarks or making indecent actions, thereby ensuring that the entire live broadcast process can proceed smoothly.

[0115] The technical solution provided by the embodiments of this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space based on interactive control information, thereby allowing each virtual object to interact with a target interactive object in the second interactive space. By adding an independent second interactive space to the first interactive space, this application allows viewers to immersively interact with the host in the independent second interactive space, thereby enriching the virtual interaction methods, improving the virtual interaction effects, and enhancing the audience's interactive enthusiasm and interactive experience.

[0116] In an optional implementation of this application, consider the presence of other users in the first interactive space who are not participating in the livestream interaction. Therefore, to ensure that these other users can both view the livestream's interactions with the livestreamer and the livestreamer's performance, in some embodiments, a first display screen is provided within the first interactive space. This allows the interaction between each virtual object and the target interactive object in the second interactive space to be displayed on the first display screen. The virtual interaction method provided in this embodiment of the application is further described below with reference to FIG8 .

[0117] As shown in FIG8 , the method may include the following steps:

[0118] S301: Display a video stream in a first interactive space, where the video stream includes a target interactive object.

[0119] S302: Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.

[0120] S303: In the second interactive space, each virtual object interacts with the target interactive object.

[0121] The virtual objects in the second interactive space can interact with the target interactive object through a live broadcast, specifically through video live broadcast or voice live broadcast (voice chat interaction). Therefore, after controlling at least one virtual object to enter the second interactive space, the present application can also display a third display screen (interactive screen) in the second interactive space, and display the live broadcast screen of each virtual object and the target interactive object through the interactive screen, so that other users in the first interactive space can watch the interaction process between the virtual objects in the second interactive space and the anchor.

[0122] For example, as shown in FIG9a , when there are two virtual objects in the second interactive space, namely virtual object 1 and virtual object 2, the voice connection screen of the host, virtual object 1 and virtual object 2 can be displayed on the interactive screen.

[0123] During the process of the host interacting with each virtual object, there is a period of time when the host is speaking or performing, and another period of time when the virtual object is speaking or performing. Therefore, in order to intuitively see whether it is the host or which virtual object is speaking or performing at the current moment, this application can display the interaction process between each virtual object and the target interactive object on the interactive screen, and first determine the target object that is interacting (that is, currently speaking or performing). If the target object being interacted is the host, the host is highlighted on the interactive screen. If the target object being interacted is any virtual object, the virtual object is highlighted on the interactive screen, so that the person who is currently speaking or performing can be determined based on the highlighted object.

[0124] Continuing with Figure 9a as an example, when it is detected that the target subject currently interacting with the live broadcaster via voice link is the live broadcaster, the live broadcaster is highlighted on the interactive screen, for example, by highlighting the border of the live broadcaster's image, as shown in Figure 9b. Another example is that only the live broadcaster's image is displayed on the interactive screen, that is, the target subject currently interacting with the live broadcaster is displayed in a single-person display mode, as shown in Figure 9c.

[0125] S304: Displaying an interaction screen between each virtual object and the target interactive object on a first display screen in the first interactive space.

[0126] It should be understood that the first display screen can be a secondary screen in addition to the main screen that displays the host's live video stream. Moreover, the secondary screen can be optionally a 2D screen.

[0127] In some embodiments, during the interaction process between each virtual object in the second interactive space and the target interactive object, the present application can display the interaction screen between each virtual object in the second interactive space and the target interactive object through the first display screen in the first interactive space, so that other users who are not participating in the interaction can see the interaction content between the host and the participating interactive users, and can also intuitively see the host's performance screen, as shown in Figure 10.

[0128] In this application, the interaction screen between each virtual object and the target interactive object in the second interactive space displayed on the first display screen in the first interactive space can be obtained by:

[0129] The first step is to obtain a target screen captured by a virtual camera in the second interactive space. The target screen is an interactive screen of each virtual object when interacting with a target interactive object.

[0130] In this application, a virtual camera is fixedly installed in the second interactive space. This virtual camera is used to capture real-time images of interactive virtual objects and transmit the captured real-time images to the second display screen of the first interactive space via real-time audio and video service (Real-Time Communication, abbreviated as RTC), laying the foundation for subsequent acquisition of the interactive images between each virtual object and the target interactive object in the second interactive space. The second display screen is specifically a large 2D screen on site.

[0131] It should be noted that the definition of the real-time image captured by the virtual camera is at least 1080p to ensure the clarity of the real-time image captured.

[0132] In other words, when a virtual object enters the second interactive space, the virtual camera in the second interactive space will capture the virtual object's image information in real time and transmit the image to the second display screen in the first interactive space in real time. The second display screen can then display the virtual object's interaction process in the second interactive space, allowing the host to respond to the virtual object's interaction.

[0133] The second step is to display the target screen on the second display screen, and capture the target screen displayed on the second display screen and the interactive screen of the target interactive object through the target camera, and the target camera corresponds to the first display screen and the target interactive object.

[0134] The third step is to generate an interaction screen between each virtual object and the target interactive object according to the target screen displayed on the second display screen and the interaction screen of the target interactive object.

[0135] The target camera may be a 2D camera.

[0136] In some embodiments, during the interaction process, the host is always in the first interactive space, and the second display screen in the first interactive space will display the real-time image of the virtual object in the second interactive space. Therefore, the present application can capture the host's interaction image and the target image displayed on the second display screen through the target camera in the first interactive space. Then, based on the host's interaction image captured by the target camera and the target image displayed on the second display screen, an interaction image between each virtual object and the target interactive object is generated.

[0137] As an optional implementation method, the host's interactive screen can be spliced ​​with the target screen displayed on the second display screen to generate an interactive screen between each virtual object and the target interactive object.

[0138] As another optional implementation method, the anchor area can be cut out from the anchor's interactive screen, and then the anchor area and the target screen displayed on the second display screen are spliced ​​to generate an interactive screen between each virtual object and the target interactive object.

[0139] In addition to the above two generation methods, the interaction screen between each virtual object and the target interactive object can also be generated by other methods, which are not specifically limited here.

[0140] It should be noted that when the host does not interact with the users in the first interactive space, the first display screen in the first interactive space can display a close-up performance of the host; or, display a close-up of the virtual object corresponding to any user in the first interactive space; or, display the background image and / or text information associated with the first interactive space, etc. There is no specific restriction on this here.

[0141] The technical solution provided by the embodiment of the present application displays a video stream in a first interactive space, and controls at least one virtual object to enter a second interactive space according to interactive control information, so that each virtual object in the second interactive space interacts with a target interactive object. This application adds an independent second interactive space on the basis of the first interactive space, so that the audience can interact immersively with the host in the independent second interactive space, thereby enriching the virtual interaction method, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience. In addition, by setting a first display screen in the first interactive space and displaying the interactive screen of each virtual object in the second interactive space and the target interactive object through the first display screen, other users who are not participating in the interaction can see the interactive content between the host and the participating interactive users, and can also intuitively see the host's performance screen, thereby meeting the different viewing needs of users in the process of watching video streams, thereby improving the user experience.

[0142] In another optional implementation of this application, any virtual object in the second interactive space may exit the second interactive space midway during interaction with the target interactive object due to network or personal reasons. To address this situation, this application can output an exception prompt to the participating user, allowing the user to understand the reason for exiting the interaction based on this prompt and make timely adjustments. The virtual interaction method provided in this embodiment of the application will be further described below with reference to Figure 11.

[0143] As shown in FIG11 , the method may include the following steps:

[0144] S401: Display a video stream in a first interactive space, where the video stream includes a target interactive object.

[0145] S402: Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.

[0146] S403: In the second interactive space, each virtual object interacts with the target interactive object.

[0147] S404: If an abnormality occurs in the interaction between any virtual object and the target interactive object, an abnormality prompt message is output.

[0148] In this application, abnormal interactions between any virtual object in the second interactive space and the target interactive object may include the following situations:

[0149] Scenario 1

[0150] During the interaction process, any virtual object exits the second interaction space.

[0151] For example, as shown in Figure 12a, during the interaction process, if virtual object 1 triggers an exit command by triggering the "Exit Interaction" control presented in the second interactive space, it is determined that the user corresponding to virtual object 1 intends to actively exit the second interactive space. At this time, an abnormal prompt pop-up window is displayed in the second interactive space. Among them, this abnormal prompt pop-up window may include: "Leave the second interactive space" retention theme message, "Are you sure you want to leave the current interaction?" retention prompt message, "Give up" control, and "Cruel Exit" control. If the user corresponding to virtual object 1 selects the "Cruel Exit" control, the second interactive space is left, and the prompt "Retracing to real time and space, please wait" is displayed, as shown in Figure 12b.

[0152] Scenario 2

[0153] During the interaction process, the network status of the terminal device corresponding to any virtual object is poor.

[0154] Considering that the network is unstable during actual use, resulting in poor network conditions of the terminal device corresponding to the virtual object during the interaction, affecting the interaction effect, at this time, an abnormal prompt message "Current network condition is poor" can be displayed in the second interactive space, as shown in Figure 12c.

[0155] Scenario 3

[0156] During the interaction, the network connection of the terminal device corresponding to any virtual object is disconnected.

[0157] The network used by the virtual object's corresponding terminal device may experience abnormal data connection termination, i.e., network disconnection, due to issues with the LAN router or line. This may cause the virtual object to exit the second interactive space. To address this, an exception prompt "An error has occurred and you have left the second interactive space" may be displayed in the first interactive space.

[0158] In another implementation, assuming no abnormalities occur during the entire interaction process, if the virtual object in the second interactive space and the target interactive object complete their interaction normally, the virtual object returns from the second interactive space to the first interactive space, and a prompt message indicating the end of the interaction is displayed in the first interactive space. The prompt message indicating the end of the interaction may include, but is not limited to, "Interaction has ended, we look forward to your next participation" or "Interaction has ended, thank you for your participation."

[0159] The technical solution provided by the embodiment of the present application displays a video stream in a first interactive space, and controls at least one virtual object to enter a second interactive space according to interactive control information, so that each virtual object in the second interactive space interacts with the target interactive object. By adding an independent second interactive space on the basis of the first interactive space, the present application allows the audience to interact immersively with the anchor in the independent second interactive space, thereby enriching the virtual interaction method, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience. In addition, when an abnormality is detected during the interaction process, by outputting an abnormal prompt information to the user, the user can make timely adjustments to ensure that the interaction can proceed normally, thereby ensuring the quality of the interaction.

[0160] In order to more clearly illustrate the virtual interaction method provided by this application, an exemplary description is given below in conjunction with FIG13 , as follows:

[0161] As shown in Figure 13, assuming that the live broadcast link is a solid line and the interactive link is a dotted line, then when user Q enters the first interactive space according to viewing needs, he can watch the host's performance on the main playback screen in the first interactive space. Among them, the host is performing on a real stage. In other words, the host's performance content displayed on the main playback screen can be acquired in real time by the XR camera in the first interactive space. When a certain interactive link is reached, after user Q participates and is selected, the virtual object of user Q will switch from the first interactive space to the second interactive space, that is, enter the second interactive space. Then, according to the host's interactive screen displayed on the 2D display screen (third display screen or interactive screen) in the second interactive space, interact with the host in the second interactive space. Among them, the host's interactive screen can be acquired in real time by the interactive dedicated 2D camera in the real stage scene and sent to the 2D display screen in the second interactive space.

[0162] During the interaction between the virtual object and the anchor, the virtual camera in the second interactive space will capture the interactive screen of the user Q corresponding to the virtual object in real time, and transmit the interactive screen to the on-site 2D large screen (second display screen) in the first interactive space in real time. Then, the anchor on the real stage can respond according to the interactive screen of the virtual object displayed on the on-site 2D large screen. At the same time, the secondary screen 2D camera corresponding to the secondary screen (first display screen) and the anchor in the real stage scene will capture the real-time screen of the anchor and the interactive screen of the virtual object on the on-site 2D large screen, and will generate the interactive content between the anchor and the participating user Q based on these two types of screens for display through the secondary screen.

[0163] Moreover, when the interaction ends, the virtual object of user Q can exit from the second interactive space and return to the first interactive space to continue watching the host's performance.

[0164] In other words, this application adds an independent second interactive space on the basis of the first interactive space, so that the audience can immersively interact with the anchor in the independent second interactive space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience.

[0165] A virtual interactive device according to an embodiment of the present application will be described below with reference to FIG14 . FIG14 is a schematic block diagram of a virtual interactive device according to an embodiment of the present application.

[0166] As shown in FIG. 14 , the virtual interactive device 500 includes a display module 510 , a control module 520 and an interactive module 530 .

[0167] The display module 510 is configured to display a video stream in the first interactive space, wherein the video stream includes: a target interactive object;

[0168] A control module 520 is configured to control at least one virtual object to enter a second interactive space according to the interactive prompt information, wherein the second interactive space is independent of the first interactive space;

[0169] The interaction module 530 is configured to enable each virtual object to interact with the target interactive object in the second interactive space.

[0170] In one or more optional implementations of the embodiment of the present application, the interactive module 530 is specifically configured to:

[0171] In the second interactive space, each of the virtual objects interacts with the target interactive object via voice communication;

[0172] or,

[0173] In the second interactive space, each of the virtual objects interacts with the target interactive object via video link.

[0174] In one or more optional implementations of the embodiments of the present application, the interactive module 530 is further used for: at least one of talent interaction and game interaction.

[0175] In one or more optional implementations of the embodiment of the present application, the control module 520 includes:

[0176] a pop-up window display unit, configured to display an interaction prompt pop-up window in the first interaction space if the current time is the interaction time, wherein the interaction prompt pop-up window includes at least interaction prompt information and an interaction confirmation option;

[0177] The response control unit is used to control at least one virtual object to enter the second interaction space in response to a selection instruction of the interaction determination option.

[0178] In one or more optional implementations of the embodiment of the present application, the control module 520 further includes:

[0179] An instruction screening unit, configured to screen a target selected instruction from all the acquired selected instructions, wherein the selected instruction is a selected instruction for the interactively determined option;

[0180] Accordingly, the response control unit is specifically configured to:

[0181] In response to the target selection instruction, a virtual object corresponding to the target selection instruction is controlled to enter a second interactive space.

[0182] In one or more optional implementations of the embodiments of the present application, the instruction screening unit is specifically configured to:

[0183] Determining whether the virtual object identifier corresponding to each selected instruction is a preset identifier;

[0184] If the virtual object identifier corresponding to any selected instruction is a preset identifier, the selected instruction is determined to be a target selected instruction.

[0185] In one or more optional implementations of the embodiment of the present application, a first display screen is provided in the first interactive space;

[0186] Accordingly, the apparatus 500 further includes:

[0187] The interactive display module is used to display the interactive screen between each virtual object and the target interactive object on the first display screen.

[0188] In one or more optional implementations of the embodiment of the present application, a second display screen is provided in the first interactive space;

[0189] Accordingly, the apparatus 500 further includes:

[0190] a picture acquisition module, configured to acquire a target picture captured by a virtual camera in the second interactive space, wherein the target picture is an interactive picture of each virtual object when interacting with the target interactive object;

[0191] a picture display module, configured to display the target picture on the second display screen, and capture an interactive picture between the target picture displayed on the second display screen and the target interactive object through a target camera, wherein the target camera corresponds to the first display screen;

[0192] The interaction generation module is used to generate an interaction screen between each virtual object and the target interactive object based on the target screen displayed on the second display screen and the interaction screen of the target interactive object.

[0193] In one or more optional implementations of the embodiment of the present application, the apparatus 500 further includes:

[0194] A screen display module, configured to display a third display screen in the second interactive space;

[0195] The interactive display module is further used to display the interactive screen between each virtual object and the target interactive object on the third display screen.

[0196] One or more optional implementations of the embodiments of the present application, the interactive display module is specifically configured to:

[0197] Determine a target object being interacted with, where the target object is the target interactive object or any virtual object;

[0198] On the third display screen, the target object is highlighted.

[0199] In one or more optional implementations of the embodiment of the present application, the apparatus 500 further includes:

[0200] The information output module is used to output abnormal prompt information if any abnormality occurs in the interaction between any of the virtual objects and the target interactive object.

[0201] In one or more optional implementations of the embodiments of the present application, the information output module is specifically configured to:

[0202] During the interaction process, any of the virtual objects exits the second interactive space;

[0203] or,

[0204] During the interaction, the network status of the terminal device corresponding to any of the virtual objects is poor;

[0205] or,

[0206] During the interaction, the network of the terminal device corresponding to any of the virtual objects is disconnected.

[0207] One or more optional implementations of the embodiments of this application,

[0208] The information output module is specifically configured to display interaction end prompt information in the first interaction space if the interaction between the virtual object and the target interactive object ends.

[0209] In one or more optional implementations of the embodiments of the present application, the video stream is a live video stream.

[0210] It should be understood that the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions can refer to the method embodiment. To avoid repetition, no further description is given here. Specifically, the device 500 shown in Figure 14 can execute the method embodiment corresponding to Figure 1, and the aforementioned and other operations and / or functions of each module in the device 500 are respectively for implementing the corresponding processes in each method in Figure 1. For the sake of brevity, no further description is given here.

[0211] The above describes the device 500 of the embodiment of the present application from the perspective of functional modules in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the first aspect method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the first aspect method disclosed in conjunction with the embodiment of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. Optionally, the software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the above-mentioned first aspect method embodiment in conjunction with its hardware.

[0212] FIG15 is a schematic block diagram of an electronic device provided in an embodiment of the present application. As shown in FIG15 , the electronic device 600 may include:

[0213] The memory 610 and the processor 620 are configured to store computer programs and transmit the program code to the processor 620. In other words, the processor 620 can call and run the computer program from the memory 610 to implement the virtual interaction method in the embodiment of the present application.

[0214] For example, the processor 620 may be configured to execute the aforementioned virtual interaction method embodiment according to instructions in the computer program.

[0215] In some embodiments of the present application, the processor 620 may include but is not limited to:

[0216] General-purpose processor, Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0217] In some embodiments of the present application, the memory 610 includes but is not limited to:

[0218] Volatile memory and / or non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0219] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 610 and executed by the processor 620 to implement the virtual interaction method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.

[0220] As shown in FIG15 , the electronic device 600 may further include:

[0221] The transceiver 630 may be connected to the processor 620 or the memory 610 .

[0222] The processor 620 may control the transceiver 630 to communicate with other devices. Specifically, the processor 620 may send information or data to other devices or receive information or data sent by other devices. The transceiver 630 may include a transmitter and a receiver. The transceiver 630 may further include one or more antennas.

[0223] It should be understood that the various components in the electronic device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0224] The present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the virtual interaction method described in the above method embodiment.

[0225] An embodiment of the present application further provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the virtual interaction method of the above method embodiment.

[0226] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0227] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0228] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0229] Modules described as separate components may or may not be physically separate, and components displayed as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network elements. Some or all of the modules may be selected based on actual needs to achieve the purpose of the present embodiment. For example, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module.

[0230] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A virtual interaction method, comprising: Displaying a video stream in a first interactive space, the video stream including: a target interactive object; Controlling at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space; In the second interactive space, each of the virtual objects interacts with the target interactive object.

2. The method according to claim 1, wherein: In the second interactive space, each of the virtual objects interacts with the target interactive object, including: In the second interactive space, each of the virtual objects interacts with the target interactive object via voice communication; or, In the second interactive space, each of the virtual objects interacts with the target interactive object via video link.

3. The method according to claim 2, wherein: In the second interactive space, each virtual object interacts with the target interactive object via video link, including at least one of talent interaction and game interaction.

4. The method according to any one of claims 1 to 3, wherein: The step of controlling at least one virtual object to enter the second interactive space according to the interactive control information includes: If the current time is the interaction time, an interaction prompt pop-up window is displayed in the first interaction space, and the interaction prompt pop-up window at least includes: interaction prompt information and interaction confirmation options; In response to a selection instruction of the interaction determination option, at least one virtual object is controlled to enter a second interaction space.

5. The method according to claim 4, wherein: Before the step of controlling at least one virtual object to enter the second interactive space in response to the selection instruction of the interaction determination option, the step further includes: Filtering a target selected instruction from all the obtained selected instructions, where the selected instruction is a selected instruction for the interactive determination option; The step of controlling at least one virtual object to enter the second interactive space in response to the selection instruction of the interaction determination option includes: In response to the target selection instruction, a virtual object corresponding to the target selection instruction is controlled to enter a second interactive space.

6. The method according to claim 5, wherein: The step of filtering target selected instructions from all the obtained selected instructions includes: Determine whether the virtual object identifier corresponding to each selected instruction is a preset identifier; If the virtual object identifier corresponding to any selected instruction is a preset identifier, the selected instruction is determined to be a target selected instruction. instruction.

7. The method according to any one of claims 1 to 6, wherein: A first display screen is provided in the first interactive space; The method further comprises: On the first display screen, an interaction screen between each of the virtual objects and the target interactive object is displayed.

8. The method according to claim 7, wherein: A second display screen is provided in the first interactive space; Before displaying the interaction screen between each virtual object and the target interactive object on the first display screen, the method further includes: Acquire a target screen captured by a virtual camera in the second interactive space, wherein the target screen is an interactive screen of each virtual object when interacting with the target interactive object; Displaying the target screen on the second display screen, and capturing the target screen displayed on the second display screen and the interactive screen of the target interactive object through a target camera, wherein the target camera corresponds to the first display screen; An interaction screen between each of the virtual objects and the target interactive object is generated according to the target screen displayed on the second display screen and the interaction screen of the target interactive object.

9. The method according to claim 7 or 8, wherein: After controlling at least one virtual object to enter the second interactive space according to the interactive control information, the method further includes: displaying a third display screen in the second interactive space; On the third display screen, an interaction screen between each of the virtual objects and the target interactive object is displayed.

10. The method according to claim 9, wherein: The step of displaying an interactive screen between each virtual object and the target interactive object on the third display screen includes: Determine a target object being interacted with, where the target object is the target interactive object or any virtual object; The target object is highlighted on the third display screen.

11. The method according to any one of claims 1 to 10, wherein: The method further comprises: If an abnormality occurs in the interaction between any of the virtual objects and the target interactive object, an abnormality prompt message is output.

12. The method according to claim 11, wherein: The interaction between any of the virtual objects and the target interactive object is abnormal, including one of the following: During the interaction, any of the virtual objects exits the second interactive space; During the interaction, the network status of the terminal device corresponding to any of the virtual objects is poor; or, During the interaction, the network of the terminal device corresponding to any of the virtual objects is disconnected.

13. The method according to any one of claims 1 to 12, wherein: The method further comprises: If the interaction between the virtual object and the target interactive object ends, interaction end prompt information is displayed in the first interactive space.

14. The method according to any one of claims 1 to 13, wherein: The video stream is a live video stream.

15. A virtual interactive device, wherein: include: A display module is used to display a video stream in a first interactive space, wherein the video stream includes: a target interactive object; A control module, configured to control at least one virtual object to enter a second interactive space according to the interactive prompt information, wherein the second interactive space is independent of the first interactive space; The interactive module is used to allow each of the virtual objects to interact with the target interactive object in the second interactive space.

16. An electronic device, comprising: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 14.

17. A computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 14.

18. A computer program product comprising program instructions, which, when executed on an electronic device, causes the electronic device to execute the method according to any one of claims 1 to 14.

19. A computer program, comprising program instructions, which, when executed on an electronic device, causes the electronic device to execute the method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Method and device for microphone connecting live broadcast

    CN109640191A

  • Virtual space operation method and device, electronic equipment and storage medium

    CN113467676A

  • Virtual object interaction method and device, storage medium and computer program product

    CN113691829A

  • Live broadcast interaction method and device, electronic equipment and storage medium

    CN114205679A

  • Virtual interaction method and device, equipment and medium

    CN116614543A

Cited By

  • Interface interaction method and device, equipment and storage medium

    CN119653156A