Virtual interaction method, apparatus, device, and medium

By adding a separate second interactive space to the first interactive space of a virtual live stream, and controlling virtual objects to enter for immersive interaction, the problem of monotonous interaction methods in virtual live streams is solved, and the audience's interactive enthusiasm and experience are enhanced.

CN116614543BActive Publication Date: 2026-01-13BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310501377.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-05-05
Publication Date
2026-01-13
Estimated Expiration
2043-05-05

AI Technical Summary

Technical Problem

In existing virtual live streaming scenarios, the interaction between viewers and streamers is relatively monotonous, resulting in poor interaction effects and making it difficult to motivate viewers to participate.

Method used

A parallel and independent second interactive space is added to the first interactive space, allowing viewers to have immersive interactions with the host. Viewers can control virtual objects to enter the second interactive space and engage in various interactions, including voice and video calls.

Benefits of technology

It has enriched the ways of virtual interaction, enhanced the audience's enthusiasm and experience for interaction, and improved the effect of virtual interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116614543B_ABST
    Figure CN116614543B_ABST
Patent Text Reader

Abstract

The application provides a virtual interaction method, device, equipment and medium, wherein the method comprises: displaying a video stream in a first interaction space, the video stream comprising: a target interaction object; controlling at least one virtual object to enter a second interaction space according to interaction control information, wherein the second interaction space is independent of the first interaction space; in the second interaction space, each virtual object interacts with the target interaction object. The application adds an independent interaction space, so that the audience can have immersive interaction with the host in the independent interaction space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and improving the interaction enthusiasm and experience of the audience.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of human-computer interaction, and in particular to a virtual interaction method, device, equipment and medium. BACKGROUND

[0002] With the continuous improvement of technical level, the application of extended reality (XR) technology is also more and more extensive, and even becomes a new standard of stage art presentation. XR technology integrates virtual reality (VR), augmented reality (AR), mixed reality (MR) and other forms, which can not only meet the high-standard production requirements of stage scenes, but also bring users an immersive experience.

[0003] At present, in a virtual live scene, the virtual interaction mode between the audience and the host is as follows: the first is a bullet chat, specifically, the audience inputs and sends chat content in a chat box, and then the host replies according to the chat content sent by the audience. The second is a gift interaction, specifically, the audience sends free or charged virtual gifts to the host. However, the above two virtual interaction modes are relatively monotonous, the interaction effect is poor, and it is difficult to mobilize the interaction enthusiasm of the audience. SUMMARY

[0004] Embodiments of the present application provide a virtual interaction method, device, equipment and medium, by adding an independent interaction space, so that the audience can have immersive interaction with the host in the independent interaction space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and improving the interaction enthusiasm and interaction experience of the audience.

[0005] In a first aspect, embodiments of the present application provide a virtual interaction method, comprising:

[0006] displaying a video stream in a first interaction space, the video stream comprising: a target interaction object;

[0007] controlling at least one virtual object to enter a second interaction space according to interaction control information, wherein the second interaction space is independent of the first interaction space;

[0008] in the second interaction space, each virtual object interacts with the target interaction object.

[0009] In a second aspect, embodiments of the present application provide a virtual interaction device, comprising:

[0010] a display module configured to display a video stream in a first interaction space, the video stream comprising: a target interaction object;

[0011] a control module, configured to control at least one virtual object to enter a second interaction space according to the interaction prompt information, wherein the second interaction space is independent of the first interaction space;

[0012] an interaction module, configured to interact each virtual object with the target interaction object in the second interaction space.

[0013] In a third aspect, an electronic device is provided, comprising:

[0014] a processor and a memory, the memory being configured to store a computer program, and the processor being configured to invoke and run the computer program stored in the memory, so as to execute the virtual interaction method in the first aspect or any implementation manner thereof.

[0015] In a fourth aspect, a computer readable storage medium is provided, configured to store a computer program, and the computer program causes a computer to execute the virtual interaction method in the first aspect or any implementation manner thereof.

[0016] In a fifth aspect, a computer program product containing program instructions is provided, and when the program instructions are run on an electronic device, the electronic device executes the virtual interaction method in the first aspect or any implementation manner thereof.

[0017] The technical solutions disclosed in the embodiments of the present application have at least the following beneficial effects:

[0018] By displaying a video stream in the first interaction space and controlling at least one virtual object to enter the second interaction space according to the interaction control information, and then interacting each virtual object with the target interaction object in the second interaction space, the present application adds an independent second interaction space based on the first interaction space, so that the audience can have immersive interaction with the host in the second interaction space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and improving the interaction enthusiasm and experience of the audience. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1 A flowchart of a virtual interaction method provided by the embodiments of the present application is shown;

[0021] Figure 2 A schematic diagram of adding a second interactive space on the basis of a first interactive space is provided for an embodiment of the present application;

[0022] Figure 3 A flowchart of another virtual interaction method is provided for an embodiment of the present application;

[0023] Figure 4a A schematic diagram of displaying an interactive prompt pop-up window in a first interactive space is provided for an embodiment of the present application;

[0024] Figure 4b A schematic diagram of selecting an “immediately go” interactive determination option in the interactive prompt pop-up window and interacting with the host is provided for an embodiment of the present application;

[0025] Figure 5a A schematic diagram of displaying another interactive prompt pop-up window in a first interactive space is provided for an embodiment of the present application;

[0026] Figure 5b A schematic diagram of selecting an “abandon” interactive rejection option in the interactive prompt pop-up window and rejecting to interact with the host is provided for an embodiment of the present application;

[0027] Figures 6a to 6f A schematic diagram of screening a target selection instruction and controlling a virtual object corresponding to the target selection instruction to enter a second interactive space is provided for an embodiment of the present application;

[0028] Figure 7 A schematic diagram of displaying “interacting” identification information on a virtual object participating in interaction in a first interactive space is provided for an embodiment of the present application;

[0029] Figure 8 A flowchart of still another virtual interaction method is provided for an embodiment of the present application;

[0030] Figure 9a A schematic diagram of displaying a voice call screen on an interactive screen in a second interactive space is provided for an embodiment of the present application;

[0031] Figure 9b A schematic diagram of highlighting a host being voice call interacted on an interactive screen is provided for an embodiment of the present application;

[0032] Figure 9c A schematic diagram of highlighting another host being voice call interacted on an interactive screen is provided for an embodiment of the present application;

[0033] Figure 10 A schematic diagram of displaying an interactive screen of each virtual object and a target interactive object on a first display screen is provided for an embodiment of the present application;

[0034] Figure 11 A flowchart illustrating yet another virtual interaction method provided in an embodiment of this application;

[0035] Figure 12a A schematic diagram illustrating the display of an error message pop-up in a second interactive space, provided as an embodiment of this application;

[0036] Figure 12b A schematic diagram of a prompt screen displayed when leaving a second interactive space, provided as an embodiment of this application;

[0037] Figure 12c A schematic diagram illustrating another method for displaying an error message pop-up in a second interactive space, provided as an embodiment of this application;

[0038] Figure 13 A schematic diagram illustrating a specific implementation of an embodiment of this application;

[0039] Figure 14 A schematic block diagram of a virtual interactive device provided in the embodiments of this application;

[0040] Figure 15 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0042] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0043] In this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or solution described as "exemplary" or "for example" in this application should not be construed as being better or more advantageous than other embodiments or solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0044] Currently, in virtual live streaming scenarios, the two main interaction methods between viewers and streamers—bullet chat or gift interaction—are rather monotonous, have poor interactive effects, and fail to motivate viewers. This application provides a virtual interaction method that adds a parallel and independent second interactive space to the existing first interactive space. This allows viewers to interact with the streamer immersively in the second interactive space, thereby improving the virtual interaction effect and enhancing viewer engagement and experience.

[0045] To facilitate understanding of the embodiments of this application, before describing the various embodiments, some concepts involved in all embodiments of this application will be appropriately explained as follows:

[0046] 1) Virtual Reality (VR) is a technology for creating and experiencing virtual worlds. It computationally generates a virtual environment, which is a multi-source information (virtual reality mentioned in this article includes at least visual perception, and may also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.) that realizes the fusion of virtual environment, interactive three-dimensional dynamic visual scenes and simulation of physical behavior, allowing users to immerse themselves in the simulated virtual reality environment, and realize applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0047] 2) Virtual reality devices (VR devices) are terminals that realize virtual reality effects. They can usually be provided in the form of glasses, head-mounted displays (HMDs), or contact lenses to realize visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to these, and they can be further miniaturized or enlarged according to actual needs.

[0048] Optionally, the virtual reality devices described in the embodiments of this application may include, but are not limited to, the following types:

[0049] 2.1) PC-based virtual reality (PCVR) devices utilize a PC for calculations and data output related to virtual reality functions. External PC-based virtual reality devices use the data output from the PC to achieve virtual reality effects.

[0050] 2.2) Mobile virtual reality devices support setting up mobile terminals (such as smartphones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations for virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.

[0051] 2.3) All-in-one virtual reality devices have processors for performing virtual functions, thus having independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal, and have a high degree of freedom of use.

[0052] 3) Augmented Reality (AR): A technology that calculates the camera's pose parameters in the real world (or 3D world, real world) in real time during image acquisition, and adds virtual elements to the captured images based on these parameters. Virtual elements include, but are not limited to, images, videos, and 3D models. The goal of AR technology is to overlay the virtual world onto the real world on a screen for interactive experiences.

[0053] 4) Mixed Reality (MR): A simulated scene that integrates computer-created sensory input (e.g., virtual objects) with sensory input or its representation from a physical setting. In some MR scenes, the computer-created sensory input can adapt to changes in sensory input from the physical setting. Additionally, some electronic systems used to present MR scenes can monitor orientation and / or position relative to the physical setting, enabling virtual objects to interact with real objects (i.e., physical elements from the physical setting or their representations). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

[0054] 5) Extended Reality (XR) refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices, including virtual reality (VR), augmented reality (AR), and mixed reality (MR).

[0055] 6) A virtual scene (also known as a virtual space) is a virtual scene displayed (or provided) by an application when it runs on an electronic device. This virtual scene can be a simulation of the real world, a semi-simulated / semi-fictional virtual scene, or a purely fictional virtual scene. A virtual scene can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual scene; this application does not limit the dimension of the virtual scene. For example, a virtual scene may include the sky, land, ocean, etc., and the land may include environmental elements such as deserts and cities.

[0056] 7) Virtual objects are objects that interact in a virtual scene, controlled by a user or a robot program (e.g., an AI-based robot program), and are able to remain still, move, and perform various behaviors in the virtual scene.

[0057] After introducing some concepts involved in the embodiments of this application, the following detailed description, in conjunction with the accompanying drawings, describes a virtual interaction method, apparatus, device, and medium provided by the embodiments of this application.

[0058] Figure 1 This is a flowchart illustrating a virtual interaction method provided in an embodiment of this application. The virtual interaction method provided in this application can be executed by a virtual interaction device. This virtual interaction device can consist of hardware and / or software and can be integrated into an electronic device. In this embodiment, the electronic device can be any hardware device capable of providing a virtual space. For example, the electronic device can be, but is not limited to, VR devices, AR devices, MR devices, and XR devices. This application does not specifically limit the type of electronic device.

[0059] like Figure 1 As shown, the method may include the following steps:

[0060] S101, Display a video stream in the first interactive space, wherein the video stream includes: the target interactive object.

[0061] In this application embodiment, the first interactive space can be understood as a first virtual space, and the first virtual space can be a virtual scene simulated by the electronic device for a certain live broadcast scene selected by any broadcaster. For example, when a broadcaster needs to build a live broadcast scene of the type of tropical forest, the electronic device constructs a corresponding virtual live broadcast scene based on this type, which serves as the first interactive space in this application.

[0062] The first interactive space can display the video stream from the broadcaster's end, which is preferably a live video stream in this application. Furthermore, the live video stream includes at least a target interactive object. In this application, the target interactive object can be understood as the broadcaster. For example, the target interactive object could be a performer at a concert.

[0063] Correspondingly, when the live video stream from the broadcaster's end is displayed in the first interactive space, the first interactive space can be understood as the virtual live broadcast room where the broadcaster is located.

[0064] It should be understood that a live streaming room refers to a social networking platform, instant messaging platform, or similar platform where numerous internet users are aggregated. Users and streamers enter the live streaming room by logging into the client. Users exist within the live streaming room as members, and the same live streaming room contains members with multiple identities, such as viewers. Users and streamers can join or leave the live streaming room.

[0065] For example, user A can select any target live streaming room from multiple live streaming rooms displayed on the screen of an electronic device using a controller such as a gamepad, and then enter the target live streaming room as a viewer to watch the host's performance in the target live streaming room.

[0066] S102, based on the interactive control information, control at least one virtual object to enter the second interactive space, wherein the second interactive space is independent of the first interactive space.

[0067] Traditionally, interactions between users (viewers) and streamers typically involve bullet comments or gift interactions. However, these methods are somewhat monotonous and fail to motivate users. Therefore, this application adds a new, parallel, and independent virtual space (the second interactive space) to the first interactive space, as follows: Figure 2 As shown. Furthermore, this second interactive space is used as an independent interactive space to realize virtual interaction, allowing users and broadcasters to engage in various interactions within this independent interactive space, thereby enriching the ways in which users and broadcasters interact and increasing their enthusiasm for interaction.

[0068] It should be understood that the creation process of the second interactive space is similar to that of the first interactive space. For example, the second interactive space can be created by default when the host creates the first interactive space. This will not be elaborated on here.

[0069] Typically, live streamers make their content more engaging by interacting with viewers. Therefore, during a live stream, the streamer can send interaction invitations to any viewer in the room; alternatively, viewers can proactively send interaction requests to the streamer to request interaction.

[0070] Optionally, the ways in which the host establishes an interactive connection with the audience may include, but are not limited to, the following:

[0071] The first method,

[0072] During a live stream, the host can set up at least one interactive segment. Furthermore, whenever an interactive segment is reached, an interactive prompt pop-up will be displayed in the live stream room, allowing users to participate in the interaction with the host based on this prompt.

[0073] In this process, users participate in the interaction based on the interactive prompt pop-up. Specifically, by triggering the confirmation option in the interactive prompt pop-up, the user's corresponding virtual object (such as a virtual character or avatar) enters a second interactive space specifically for various interactions, where they can interact with the streamer.

[0074] In this application, the virtual object corresponding to each user in the live streaming room can be automatically configured by the electronic device based on the user's personal information when entering the live streaming room. For example, when user S enters a live streaming room, if the gender field in user S's personal information is male, a male virtual object is configured for user S based on the gender. As another example, when user W enters a live streaming room, if the gender field in user W's personal information is female, a female virtual object is configured for user W based on the gender.

[0075] In addition, users can also create virtual objects that meet their own personalized needs through the virtual object creation function provided by electronic devices, and this application does not impose specific restrictions on this.

[0076] It should be understood that there may be multiple users in a live stream room. Therefore, based on the interactive prompt pop-ups displayed in the live stream room, the number of users participating in the interaction with the streamer can be at least one.

[0077] The second method

[0078] During a live stream, interactive controls, such as chat interaction controls, will be displayed in the live stream room. If any user wants to interact with the streamer, they can send an interaction request by triggering one of these controls. When the streamer approves the request, the virtual object corresponding to the user who sent the request will enter a second interactive space dedicated to various interactions, allowing them to interact with the streamer within that space.

[0079] It should be noted that, considering that in addition to users who have established an interactive connection with the streamer, there are other users in the live broadcast room (i.e., users who have not established an interactive connection with the streamer), when the virtual object corresponding to the user who has established an interactive connection with the streamer enters the second interactive space, the interactive space of the streamer does not need to be switched. That is, the streamer remains in the first interactive space, allowing other users to continue watching the streamer's performance in the first interactive space.

[0080] Furthermore, since users entering the second interactive space need to interact with the broadcaster, this application can capture the broadcaster's real-time image using a first camera in the first interactive space and send this image to the second interactive space. Then, the broadcaster's real-time image is displayed in the second interactive space, allowing each virtual object within the second interactive space to interact with the broadcaster based on this real-time image.

[0081] The first camera in the first interactive space can be understood as a camera that enables virtual interaction, and the first camera can be a 2D camera or other types of cameras, without any restrictions.

[0082] S103, in the second interactive space, each virtual object interacts with the target interactive object.

[0083] Once at least one virtual object enters the second interactive space, each virtual object can interact with the target interactive object (the broadcaster). In this application, the interaction can be either voice-based or video-based.

[0084] Voice-based interactive communication primarily involves voice calls. Video-based interactive communication, on the other hand, combines voice and live video feeds. In other words, voice-based interaction only allows you to hear the voice data of both parties, without seeing their live video feeds, while video-based interaction allows you to hear both their voice data and see their live video feeds.

[0085] Considering that video conferencing allows users to not only hear the voice data of both parties but also see their live video feeds, each virtual object can engage in different types of interactions with the target object within this interactive method.

[0086] Optionally, different types of interaction may include at least one of talent interaction and game interaction.

[0087] Talent interactions may include, but are not limited to: the streamer singing the same song with each virtual object, or the streamer dancing with each virtual object.

[0088] Interactive games may include, but are not limited to: guessing songs by reading lip movements, guessing song titles by listening to the intro, and playing word chain games.

[0089] The technical solution provided in this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space according to interactive control information. Then, each virtual object interacts with a target interactive object in the second interactive space. By adding an independent second interactive space to the first interactive space, this application allows viewers to engage in immersive interaction with the broadcaster within the independent second interactive space, thereby enriching virtual interaction methods, improving virtual interaction effects, and enhancing viewers' interactive enthusiasm and experience.

[0090] Based on the above embodiments, the method of controlling at least one virtual object to enter the second interactive space according to interactive control information in this application will be further explained and described. See details below. Figure 3 .

[0091] like Figure 3 As shown, the method may include the following steps:

[0092] S201, Display a video stream in the first interactive space. The video stream includes the target interactive object.

[0093] S202, if the current time is the interaction time, then display an interaction prompt pop-up in the first interaction space. The interaction prompt pop-up includes at least: interaction prompt information and interaction confirmation option.

[0094] Optionally, before starting the live stream, the host can pre-set at least one interactive segment, and will set the start and end times for each segment. This allows for orderly interaction with users in the live stream based on the pre-set segments, and also provides better control over the live stream duration.

[0095] After setting up the interactive elements, the streamer can start the live stream. During the live stream, the electronic device will continuously monitor whether the current time has reached the preset start time for the interactive element. If the current time is the start time for the interaction, an interactive prompt pop-up will be displayed in the streamer's live stream room (i.e., the first interactive space), allowing users in the live stream room to choose whether to interact with the streamer based on this interactive prompt pop-up.

[0096] Considering that the interactive prompt pop-up includes an interactive prompt message, an interactive confirmation option, and an interactive rejection option, users in the live stream can participate in the interaction with the streamer by triggering the interactive confirmation option; alternatively, they can also abandon the interaction by triggering the interactive rejection option.

[0097] For example, such as Figure 4aAs shown, the interactive prompt pop-up displayed in the first interactive space includes the interactive prompt message: "XX wants to interact with you," the "Go Now" interaction confirmation option, and the "Abandon" interaction rejection option. If users W and T in the first interactive space want to participate in the interaction with the host, users W and T can respectively select the "Go Now" interaction confirmation option to interact with the host through controllers such as gamepads, gestures, or voice, as shown below. Figure 4b As shown.

[0098] For example, such as Figure 5a As shown, the interactive prompt pop-up displayed in the first interactive space includes: the interactive prompt message "XX wants to voice chat with you," the "Go Now" interaction confirmation option, the "Abandon" interaction rejection option, the host's image, and interactive animations. If user XX in the first interactive space does not want to participate in the interaction with the host, user XX can select the "Abandon" interaction rejection option through a controller or voice commands to refuse interaction with the host. Figure 5b As shown. The anchor image can be a real image of the anchor or a virtual image created based on the anchor; there are no specific restrictions here. Additionally, the interactive animation effects can be ripple effects or other animation effects that establish interactive connections; there are no restrictions on these either.

[0099] S203, in response to the selection command of the interactive confirmation option, controls at least one virtual object to enter the second interactive space.

[0100] S204, In the second interactive space, each virtual object interacts with the target interactive object.

[0101] Optionally, it can detect whether any user within the first interactive space has selected the "confirm interaction" option in the interaction prompt pop-up. If the selection command is detected, it is determined that the user who sent the selection command wants to interact with the broadcaster. At this point, the virtual object corresponding to that user can be controlled to enter the second interactive space. Thus, interaction between the broadcaster and the virtual object can be realized in the second interactive space.

[0102] Considering the limited duration of a live stream, to ensure the streamer's performance while facilitating interaction between the streamer and users, this application, in response to the selection of the interaction confirmation option, controls the number of virtual objects entering the second interaction space when at least one virtual object enters. This ensures that the interaction duration between the streamer and all virtual objects entering the second interaction space does not exceed the preset duration of the interaction segment. The number of virtual objects entering the second interaction space can be flexibly adjusted according to the preset interaction segment duration, for example, it could be 1, 3, or 4.

[0103] For the reasons stated above, before controlling at least one virtual object to enter the second interactive space based on the selection instructions obtained from all interactive selection options, this application first filters the target selection instructions from all obtained selection instructions according to a filtering rule. Secondly, it performs a response operation on the target selection instruction, controlling the virtual object corresponding to the target selection instruction to enter the second interactive space. Furthermore, the virtual object entering the second interactive space can interact with the broadcaster.

[0104] In this application, the filtering rule can be any strategy or algorithm for filtering target selection instructions from the obtained selection instructions, and no specific restrictions are imposed here. For example, target selection instructions can be filtered according to preset identification information, or target selection instructions can be filtered according to preset ID, etc., and no specific restrictions are imposed here. Here, the identification information can be understood as information that uniquely identifies the user, such as the user's name, user's contact phone number, etc. The preset ID can be the user's ID card number, etc.

[0105] Optionally, this application filters the target selection instructions from all the obtained selection instructions according to the filtering rules, which can be done by determining whether the virtual object identifier corresponding to each selection instruction is a preset identifier. If the virtual object identifier corresponding to any selection instruction is a preset identifier, then the selection instruction is determined to be the target selection instruction. If the selection object identifier corresponding to any selection instruction is not a preset identifier, then the selection instruction is determined not to be the target selection instruction.

[0106] To more clearly explain the process of selecting a target selected instruction from all selected instructions and controlling the virtual object corresponding to the target selected instruction to enter the second interactive space, the following will combine... Figures 6a to 6f Let's illustrate with specific examples.

[0107] Specifically, assuming the interactive pop-up displayed in the first interactive space includes: the interactive prompt message "XX wants to voice chat with you", the interactive confirmation option "I want to sign up", the interactive rejection option "Cancel", the host image, interactive animation effects, and the dynamic prompt message "XXX people have signed up", such as... Figure 6a As shown. The dynamic notification message "XXX people have registered" will change dynamically as the number of registrants changes. The update frequency of this dynamic change can be flexibly set according to the live stream latency requirements. If the live stream latency requirement is low, it can update every 5 seconds; if the live stream latency requirement is high, it can update every 1 second, etc. This application does not impose specific restrictions on it.

[0108] like Figure 6bAs shown, users 1, 2, 3, 4, 5, and 6 in the first interactive space all clicked the "I want to register" interaction confirmation option, sending the selection command for the "I want to register" interaction confirmation option to the electronic device. When the "I want to register" interaction confirmation option is clicked, the electronic device and / or controllers such as gamepads will output vibration feedback to the user, reminding them that the "I want to register" interaction confirmation option has been selected.

[0109] Furthermore, when the electronic device receives the aforementioned selection instruction, it can display the messages "Registration successful" and "We will randomly select registered attendees; results will be announced later" in an interactive pop-up window within the first interactive space. Figure 6c As shown. To prevent the prompt message from obstructing the streamer's performance due to prolonged display within the first interactive space, this application allows the prompt message to disappear after a preset display duration. This ensures users can fully view the streamer's performance and avoids a poor viewing experience caused by prolonged obstruction. In this application, the preset duration can be flexibly set according to the live streaming needs, such as 2 seconds or 3 seconds.

[0110] If the preset interactive session allows interaction with a maximum of 4 users, and the filtering rule is to filter target selection instructions based on preset usernames (user nicknames), then the usernames of users 1, 2, 3, 4, 5, and 6 are compared with the preset usernames in the filtering rule. If the usernames of users 1, 3, 4, and 5 match the preset usernames, then the selection instructions corresponding to users 1, 3, 4, and 5 are determined as target selection instructions. Then, in the first interactive space corresponding to users 1, 3, 4, and 5, the messages "Congratulations on becoming a lucky audience member" and "You are about to enter a dedicated interactive space" are displayed, along with the note "Please ensure your network connection is stable and you are in a quiet environment," as detailed below. Figure 6d The aforementioned prompts and remarks will disappear after a preset duration.

[0111] like Figure 6e As shown, after the prompts and notes disappear, a space transition animation effect of a preset duration can be displayed in the first interactive space, such as an eye-opening / closing animation or a loading animation. When the space transition animation display duration reaches the preset duration, a second interactive space will appear in front of the corresponding virtual objects of users 1, 3, 4, and 5 respectively. That is, users 1, 3, 4, and 5 enter the second interactive space. See [link to documentation]. Figure 6f Furthermore, users 1, 3, 4, and 5 can interact with the streamer in various ways.

[0112] It should be noted that after controlling at least one virtual object to enter the second interactive space, an optional "Interacting" indicator can be displayed on the corresponding virtual object still in the first interactive space. This allows users in the first interactive space to know which users are interacting with the broadcaster. For example... Figure 7 As shown.

[0113] Furthermore, considering that the second interactive space supports interaction between users and the streamer, and that this interaction differs from the regular bullet screen chat and gift-giving methods in the first interactive space, this application can restrict the interactive functions within the second interactive space to differentiate it from the regular interaction methods in the first interactive space. For example, users can only be granted permissions to turn their microphone and camera on / off in the second interactive space. Moreover, these microphone and camera permissions can be centrally managed by the streamer to prevent virtual users from making inappropriate remarks or engaging in unseemly behavior, thus ensuring the smooth operation of the entire live stream.

[0114] The technical solution provided in this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space according to interactive control information. Then, each virtual object interacts with a target interactive object in the second interactive space. By adding an independent second interactive space to the first interactive space, this application allows viewers to engage in immersive interaction with the broadcaster within the independent second interactive space, thereby enriching virtual interaction methods, improving virtual interaction effects, and enhancing viewers' interactive enthusiasm and experience.

[0115] In one optional implementation of this application, it is considered that there are other users in the first interactive space who are not participating in the interaction with the broadcaster. Therefore, in order for these other users to see both the interaction content between the broadcaster and the user, and to also see the broadcaster's performance, this application optionally sets up a first display screen in the first interactive space. The interaction screen between each virtual object and the target interactive object in the second interactive space is then displayed on the first display screen. The following is combined with... Figure 8 The virtual interaction method provided in the embodiments of this application will be further described.

[0116] like Figure 8 As shown, the method may include the following steps:

[0117] S301, Display a video stream in the first interactive space. The video stream includes the target interactive object.

[0118] S302, based on the interactive control information, control at least one virtual object to enter the second interactive space, wherein the second interactive space is independent of the first interactive space.

[0119] S303, in the second interactive space, each virtual object interacts with the target interactive object.

[0120] Considering that virtual objects in the second interactive space can interact with the target interactive object via video or voice chat, this application can also display a third display screen (interactive screen) within the second interactive space after controlling at least one virtual object to enter the second interactive space. This interactive screen will display the interaction between each virtual object and the target interactive object, allowing other users in the first interactive space to watch the interaction between the virtual object and the host in the second interactive space.

[0121] For example, such as Figure 9a As shown, when there are two virtual objects in the second interactive space, namely virtual object 1 and virtual object 2, the voice interaction between the host, virtual object 1 and virtual object 2 can be displayed on the interactive screen.

[0122] Considering that during the live interaction between the host and various virtual objects, there are periods when the host speaks or performs, and periods when the virtual objects speak or perform. Therefore, to clearly see whether the host or a virtual object is speaking or performing at any given moment, this application can display the interaction process between each virtual object and the target interactive object on the interactive screen. First, the target object currently interacting (i.e., currently speaking or performing) can be identified. If the target object is the host, the host will be highlighted on the interactive screen. If the target object is any virtual object, that virtual object will be highlighted on the interactive screen, thus determining who is currently speaking or performing based on the highlighted object.

[0123] Continue with Figure 9a For example, when the target of the current voice chat interaction is detected as a broadcaster, the broadcaster is highlighted on the interactive screen, such as by highlighting the broadcaster's image border. See details below. Figure 9b For example, the interactive screen can display only the host's image, that is, display the target person who is interacting via voice chat in a single-person display mode, specifically as follows: Figure 9c As shown.

[0124] S304, on the first display screen in the first interactive space, the interaction screen between each virtual object and the target interactive object is displayed.

[0125] It should be understood that the first display screen can be a secondary screen in addition to the main screen displaying the live video stream of the broadcaster. Furthermore, this secondary screen can be a 2D screen.

[0126] Optionally, during the interaction between each virtual object and the target interactive object in the second interactive space, this application can display the interaction screen between each virtual object and the target interactive object in the second interactive space through the first display screen in the first interactive space. This allows other users who are not participating in the interaction to see the interaction content between the host and the participating users, and also to intuitively see the host's performance, for example... Figure 10 As shown.

[0127] In this application, the interaction between each virtual object and the target interactive object in the second interactive space, displayed on the first display screen within the first interactive space, can be obtained through the following methods:

[0128] The first step is to acquire the target image captured by the virtual camera in the second interactive space. This target image is the interactive image of each virtual object when interacting with the target interactive object.

[0129] In this application, a virtual camera is permanently installed in the second interactive space. This virtual camera is used to capture real-time images of the interactive virtual objects and transmits these images to a second display screen in the first interactive space via Real-Time Communication (RTC) service. This lays the foundation for subsequently acquiring the interaction footage between each virtual object and the target interactive object in the second interactive space. Specifically, the second display screen is a large 2D screen on-site.

[0130] It should be noted that the real-time images captured by the virtual camera must have a resolution of at least 1080p to ensure the clarity of the captured images.

[0131] In other words, once the virtual object enters the second interactive space, the virtual camera located in the second interactive space will capture the virtual object's image information in real time and transmit the image to the second display screen in the first interactive space. The second display screen can then show the interaction process of the virtual object within the second interactive space, allowing the broadcaster to respond to the virtual object's interactions.

[0132] The second step is to display the target image on the second display screen and capture the target image displayed on the second display screen and the interaction screen of the target interactive object through the target camera. The target camera corresponds to the first display screen and the target interactive object.

[0133] The third step is to generate an interaction screen between each virtual object and the target interactive object based on the target screen displayed on the second display screen and the interaction screen of the target interactive object.

[0134] The target camera can be a 2D camera.

[0135] Optionally, during the interaction, the host remains in the first interactive space, and a second display screen within the first interactive space shows the real-time image of the virtual object within the second interactive space. Therefore, this application can capture the host's interactive image and the target image displayed on the second display screen using a target camera within the first interactive space. Furthermore, based on the host's interactive image captured by the target camera and the target image displayed on the second display screen, an interactive image between each virtual object and the target interactive object is generated.

[0136] As an optional implementation, the host's interactive screen can be spliced ​​with the target screen displayed on the second display screen to generate an interactive screen between each virtual object and the target interactive object.

[0137] As an alternative implementation, the broadcaster area can be extracted from the broadcaster's interactive screen, and then the broadcaster area can be stitched together with the target screen displayed on the second display screen to generate the interactive screen between each virtual object and the target interactive object.

[0138] In addition to the two generation methods mentioned above, other methods can also be used to generate the interaction screen between each virtual object and the target interactive object, and no specific restrictions are imposed here.

[0139] It should be noted that when the host and the users in the first interactive space do not interact, the first display screen in the first interactive space may display a close-up performance of the host; or, display a close-up of any virtual object corresponding to any user in the first interactive space; or, display background images and / or text information associated with the first interactive space, etc., without specific restrictions here.

[0140] The technical solution provided in this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space according to interactive control information. Then, each virtual object interacts with a target interactive object in the second interactive space. This application adds an independent second interactive space to the first interactive space, allowing viewers to engage in immersive interaction with the broadcaster within this independent space. This enriches the virtual interaction methods, improves the virtual interaction effect, and enhances viewers' interaction enthusiasm and experience. Furthermore, by setting up a first display screen in the first interactive space and displaying the interaction between each virtual object and the target interactive object in the second interactive space, other users who are not participating in the interaction can see the interaction content between the broadcaster and participating users, and can also directly see the broadcaster's performance. This satisfies different viewing needs during the video stream viewing process, thereby improving the user experience.

[0141] In another optional implementation of this application, considering that any virtual object in the second interactive space may exit the second interactive space midway due to network or personal reasons during interaction with the target interactive object, this application can address this situation by outputting an error message to the user participating in the interaction, allowing the user to understand the reason for exiting the interaction and make timely adjustments. The following is a combination of... Figure 11 The virtual interaction method provided in the embodiments of this application will continue to be described.

[0142] like Figure 11 As shown, the method may include the following steps:

[0143] S401, Display a video stream in the first interactive space. The video stream includes the target interactive object.

[0144] S402, based on the interactive control information, control at least one virtual object to enter the second interactive space, wherein the second interactive space is independent of the first interactive space.

[0145] S403, in the second interactive space, each virtual object interacts with the target interactive object.

[0146] S404 If any virtual object encounters an abnormal interaction with the target interactive object, an error message will be output.

[0147] In this application, an anomaly in the interaction between any virtual object located in the second interaction space and the target interaction object may include the following situations:

[0148] Scenario 1

[0149] During the interaction, any virtual object exits the second interactive space.

[0150] For example, such as Figure 12a As shown, during the interaction, if virtual object 1 triggers an exit command by initiating the "Exit Interaction" control displayed in the second interactive space, it is determined that the user corresponding to virtual object 1 intends to actively exit the second interactive space. At this time, an error message pop-up is displayed in the second interactive space. This error message pop-up may include: a "Leave Second Interactive Space" retention message, a "Are you sure you want to leave the current interaction?" retention prompt, a "Give Up" control, and a "Cruelly Leave" control. If the user corresponding to virtual object 1 selects the "Cruelly Leave" control, they will leave the second interactive space, and a message "Rewinding from real time and space, please wait" will be displayed. Figure 12b As shown.

[0151] Scenario 2

[0152] During the interaction, the network condition of the terminal device corresponding to any virtual object is poor.

[0153] Considering the possibility of network instability during actual use, leading to poor network conditions on the terminal devices corresponding to virtual objects during interaction and affecting the interactive effect, a "Current network condition is poor" error message can be displayed in the second interactive space, such as... Figure 12c As shown.

[0154] Scenario 3

[0155] During the interaction, the network connection of the terminal device corresponding to any virtual object drops.

[0156] Considering the network used by the terminal device corresponding to the virtual object, issues such as LAN routers or lines may cause abnormal data connection termination, i.e., network disconnection. This would cause the virtual object to exit the second interactive space. To address this, a message "An issue has occurred; you have left the second interactive space" can be displayed in the first interactive space.

[0157] In another possible implementation, assuming no abnormalities occur during the entire interaction process, if the virtual object in the second interaction space successfully terminates its interaction with the target object, it returns to the first interaction space and displays an interaction termination message in the first interaction space. This message can be, but is not limited to, phrases such as: "Interaction has ended, we look forward to your next participation" or "Interaction has ended, thank you for your participation," etc.

[0158] The technical solution provided in this application displays a video stream in a first interactive space and controls at least one virtual object to enter a second interactive space according to interactive control information. Then, each virtual object interacts with a target interactive object in the second interactive space. By adding an independent second interactive space to the first interactive space, this application allows viewers to engage in immersive interaction with the broadcaster within this independent space, thereby enriching virtual interaction methods, improving virtual interaction effects, and enhancing viewer engagement and experience. Furthermore, when an anomaly is detected during the interaction, an anomaly prompt message is output to the user, allowing for timely adjustments to ensure normal interaction and thus guaranteeing interaction quality.

[0159] To more clearly illustrate the virtual interaction method provided in this application, the following will be combined with... Figure 13 An example is provided below:

[0160] like Figure 13As shown, assuming the live stream viewing link is a solid line and the interaction link is a dashed line, when user Q enters the first interactive space according to their viewing needs, they can watch the host's performance on the main playback screen within the first interactive space. The host performs on a real stage. That is, the host's performance content displayed on the main playback screen can be captured in real-time by an XR camera within the first interactive space. When reaching a certain interactive stage, after user Q participates and is selected, user Q's virtual object will switch from the first interactive space to the second interactive space, i.e., enter the second interactive space. Then, based on the host's interactive content displayed on the 2D display screen (third display screen or interactive screen) within the second interactive space, user Q can interact with the host. The host's interactive content can be captured in real-time by a dedicated 2D camera in the real stage scene and sent to the 2D display screen within the second interactive space.

[0161] During the interaction between the virtual object and the host, the virtual camera in the second interactive space captures the interaction footage of the virtual object corresponding to user Q in real time and transmits it to the live 2D screen (second display screen) in the first interactive space. The host on the real stage can then respond based on the virtual object interaction footage displayed on the live 2D screen. Simultaneously, the 2D camera on the secondary screen (corresponding to the host and the secondary screen on the real stage) captures both the host's real-time footage and the virtual object interaction footage displayed on the live 2D screen. Based on these two types of footage, the host generates interactive content between themselves and the participating user Q, which is then displayed on the secondary screen.

[0162] Furthermore, after the interaction ends, user Q's virtual object can exit from the second interactive space and return to the first interactive space to continue watching the host's performance.

[0163] In other words, this application adds an independent second interactive space to the first interactive space, allowing viewers to engage in immersive interaction with the streamer within this independent second interactive space. This enriches the virtual interaction methods, improves the virtual interaction effects, and enhances viewers' engagement and experience.

[0164] The following is a reference to the appendix. Figure 14 This application describes a virtual interactive device proposed in its embodiments. Figure 14 This is a schematic block diagram of a virtual interactive device provided in an embodiment of this application.

[0165] like Figure 14 As shown, the virtual interactive device 500 includes a display module 510, a control module 520, and an interactive module 530.

[0166] The display module 510 is used to display a video stream in the first interactive space, the video stream including: a target interactive object;

[0167] Control module 520 is used to control at least one virtual object to enter a second interactive space according to interactive prompt information, wherein the second interactive space is independent of the first interactive space;

[0168] The interaction module 530 is used to enable each of the virtual objects to interact with the target interactive object within the second interactive space.

[0169] One or more optional implementations of the embodiments of this application, the interactive module 530, is specifically used for:

[0170] Within the second interactive space, each virtual object engages in voice-based interaction with the target interactive object;

[0171] or,

[0172] Within the second interactive space, each virtual object engages in video chat interaction with the target interactive object.

[0173] In one or more optional implementations of the embodiments of this application, the interactive module 530 is also used for at least one of talent interaction and game interaction.

[0174] In one or more optional implementations of the embodiments of this application, the control module 520 includes:

[0175] A pop-up display unit is used to display an interaction prompt pop-up in the first interaction space if the current time is an interaction time. The interaction prompt pop-up includes at least: interaction prompt information and interaction confirmation options.

[0176] A response control unit is configured to control at least one virtual object to enter the second interactive space in response to a selection command of the interactive selection option.

[0177] In one or more optional implementations of the embodiments of this application, the control module 520 further includes:

[0178] The instruction filtering unit is used to filter the target selected instruction from all the selected instructions obtained, wherein the selected instruction is the selection instruction of the interactive confirmation option;

[0179] Accordingly, the response control unit is specifically used for:

[0180] In response to the target selection command, the virtual object corresponding to the target selection command is controlled to enter the second interactive space.

[0181] One or more optional implementations of the embodiments of this application, wherein the instruction filtering unit is specifically used for:

[0182] Determine whether the virtual object identifier corresponding to each selected instruction is a preset identifier;

[0183] If the virtual object identifier corresponding to any selection instruction is a preset identifier, then the selection instruction is determined to be the target selection instruction.

[0184] In one or more optional implementations of the embodiments of this application, a first display screen is provided in the first interactive space;

[0185] Accordingly, the device 500 further includes:

[0186] An interactive display module is used to display the interaction between each of the virtual objects and the target interactive object on the first display screen.

[0187] In one or more optional implementations of the embodiments of this application, a second display screen is provided in the first interactive space;

[0188] Accordingly, the device 500 further includes:

[0189] The image acquisition module is used to acquire the target image captured by the virtual camera in the second interactive space. The target image is the interaction image of each virtual object when interacting with the target interactive object.

[0190] The image display module is used to display the target image on the second display screen, and to capture the target image displayed on the second display screen and the interaction screen of the target interactive object through the target camera, wherein the target camera corresponds to the first display screen;

[0191] The interaction generation module is used to generate an interaction screen between each virtual object and the target interactive object based on the target screen displayed on the second display screen and the interaction screen of the target interactive object.

[0192] In one or more optional implementations of the embodiments of this application, the apparatus 500 further includes:

[0193] A screen display module for displaying a third display screen within the second interactive space;

[0194] The interactive display module is also used to display the interaction screen between each of the virtual objects and the target interactive object on the third display screen.

[0195] One or more optional implementations of the embodiments of this application, the interactive display module, are specifically used for:

[0196] Identify the target object being interacted with, where the target object is the target interactive object or any virtual object;

[0197] The target object is highlighted on the third display screen.

[0198] In one or more optional implementations of the embodiments of this application, the apparatus 500 further includes:

[0199] The information output module is used to output an error message if any of the virtual objects interact abnormally with the target interactive object.

[0200] One or more optional implementations of the embodiments of this application, the information output module, are specifically used for:

[0201] During the interaction, any of the virtual objects may exit the second interactive space;

[0202] or,

[0203] During the interaction, the network condition of the terminal device corresponding to any of the virtual objects is poor;

[0204] or,

[0205] During the interaction, the network connection of any terminal device corresponding to any of the virtual objects drops.

[0206] One or more optional implementations of the embodiments of this application,

[0207] The information output module is specifically used to display an interaction end prompt message in the first interaction space if the interaction between the virtual object and the target interactive object ends.

[0208] In one or more optional implementations of the embodiments of this application, the video stream is a live video stream.

[0209] It should be understood that the device embodiments and the foregoing method embodiments can correspond to each other, and similar descriptions can be referred to the method embodiments. To avoid repetition, further details will not be provided here. Specifically, Figure 14 The device 500 shown can perform Figure 1 The corresponding method embodiments, and the foregoing and other operations and / or functions of each module in device 500 are respectively implemented to achieve Figure 1 For the sake of brevity, the corresponding processes in each method are not described in detail here.

[0210] The apparatus 500 of this application embodiment has been described above from the perspective of functional modules in conjunction with the accompanying drawings. It should be understood that this functional module can be implemented in hardware, in software instructions, or in a combination of hardware and software modules. Specifically, the steps of the first aspect method embodiment in this application can be completed by integrated logic circuits in the processor's hardware and / or by software instructions. The steps of the first aspect method disclosed in this application embodiment can be directly embodied as being executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. Optionally, the software module can be located in a mature storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the first aspect method embodiment described above.

[0211] Figure 15 This is a schematic block diagram of an electronic device provided as an embodiment of this application. Figure 15 As shown, the electronic device 600 may include:

[0212] The system includes a memory 610 and a processor 620. The memory 610 stores computer programs and transfers the program code to the processor 620. In other words, the processor 620 can retrieve and run the computer programs from the memory 610 to implement the virtual interaction method in the embodiments of this application.

[0213] For example, the processor 620 can be used to execute the above-described virtual interaction method embodiments according to instructions in the computer program.

[0214] In some embodiments of this application, the processor 620 may include, but is not limited to:

[0215] General-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0216] In some embodiments of this application, the memory 610 includes, but is not limited to:

[0217] Volatile memory and / or non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DR RAM).

[0218] In some embodiments of this application, the computer program may be divided into one or more modules, which are stored in the memory 610 and executed by the processor 620 to complete the virtual interaction method provided in this application. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program in the electronic device.

[0219] like Figure 15 As shown, the electronic device 600 may further include:

[0220] Transceiver 630, which can be connected to processor 620 or memory 610.

[0221] The processor 620 can control the transceiver 630 to communicate with other devices; specifically, it can send information or data to other devices or receive information or data sent by other devices. The transceiver 630 may include a transmitter and a receiver. The transceiver 630 may further include antennas, and the number of antennas may be one or more.

[0222] It should be understood that the various components in the electronic device are connected through a bus system, which includes a data bus, a power bus, a control bus, and a status signal bus.

[0223] This application also provides a computer-readable storage medium for storing a computer program that causes a computer to perform the virtual interaction method described in the above method embodiments.

[0224] This application also provides a computer program product containing program instructions, which, when executed on an electronic device, cause the electronic device to perform the virtual interaction method described in the above method embodiments.

[0225] When implemented using software, it can be implemented entirely or partially as a computer program product. This computer program product includes one or more computer instructions. When these computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0226] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0227] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0228] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. For example, the functional modules in the various embodiments of this application may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0229] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A virtual interaction method, characterized in that, include: A video stream is displayed within a first interactive space, the video stream including: a target interactive object; According to the interactive control information, at least one virtual object is controlled to enter the second interactive space and the target interactive object is controlled to stay in the first interactive space, wherein the second interactive space is independent of the first interactive space, the virtual object is the virtual object corresponding to the audience who has established an interactive connection with the target interactive object, and the target interactive object is the anchor. The first camera in the first interactive space captures real-time images of the target interactive object and sends them to the second interactive space to display the real-time images in the second interactive space, so that each virtual object in the second interactive space can interact with the target interactive object based on the real-time images.

2. The method according to claim 1, characterized in that, Within the second interactive space, each of the virtual objects interacts with the target interactive object, including: Within the second interactive space, each virtual object engages in voice-based interaction with the target interactive object; or, Within the second interactive space, each virtual object engages in video chat interaction with the target interactive object.

3. The method according to claim 2, characterized in that, Within the second interactive space, each virtual object engages in video chat interaction with the target interactive object, including at least one of talent interaction and game interaction.

4. The method according to claim 1, characterized in that, The step of controlling at least one virtual object to enter the second interactive space based on interactive control information includes: If the current time is the interaction time, an interaction prompt pop-up window will be displayed in the first interaction space. The interaction prompt pop-up window will include at least: interaction prompt information and interaction confirmation option. In response to the selection command of the interaction confirmation option, at least one virtual object is controlled to enter the second interaction space.

5. The method according to claim 4, characterized in that, Before controlling at least one virtual object to enter the second interactive space in response to the selection instruction of the interaction determination option, the method further includes: From all the selected instructions obtained, filter the target selected instructions, where the selected instructions are the selection instructions for the interactive confirmation option; Accordingly, the step of controlling at least one virtual object to enter the second interactive space in response to the selection instruction of the interaction confirmation option includes: In response to the target selection command, the virtual object corresponding to the target selection command is controlled to enter the second interactive space.

6. The method according to claim 5, characterized in that, The step of filtering the target selection command from all the acquired selection commands includes: Determine whether the virtual object identifier corresponding to each selected instruction is a preset identifier; If the virtual object identifier corresponding to any selection instruction is a preset identifier, then the selection instruction is determined to be the target selection instruction.

7. The method according to claim 1, characterized in that, The first interactive space is equipped with a first display screen; Accordingly, the method further includes: On the first display screen, the interaction screen between each of the virtual objects and the target interactive object is displayed.

8. The method according to claim 7, characterized in that, A second display screen is installed in the first interactive space; Accordingly, before displaying the interaction screen between each virtual object and the target interactive object on the first display screen, the method further includes: Acquire the target image captured by the virtual camera in the second interactive space, wherein the target image is the interaction image of each virtual object when interacting with the target interactive object; The target image is displayed on the second display screen, and the target image displayed on the second display screen and the interactive screen of the target interactive object are captured by the target camera, wherein the target camera corresponds to the first display screen; Based on the target screen displayed on the second display screen and the interaction screen of the target interactive object, an interaction screen between each virtual object and the target interactive object is generated.

9. The method according to claim 7, characterized in that, After controlling at least one virtual object to enter the second interactive space based on the interactive control information, the method further includes: A third display screen is shown within the second interactive space; The third display screen shows the interaction between each of the virtual objects and the target interactive object.

10. The method according to claim 9, characterized in that, The step of displaying the interaction screen between each virtual object and the target interactive object on the third display screen includes: Identify the target object being interacted with, where the target object is the target interactive object or any virtual object; The target object is highlighted on the third display screen.

11. The method according to claim 1, characterized in that, The method further includes: If any of the virtual objects interact abnormally with the target interactive object, an error message will be output.

12. The method according to claim 11, characterized in that, An abnormal interaction occurs between any of the virtual objects and the target interactive object, including: During the interaction, any of the virtual objects may exit the second interactive space; or, During the interaction, the network condition of the terminal device corresponding to any of the virtual objects is poor; or, During the interaction, the network connection of any terminal device corresponding to any of the virtual objects drops.

13. The method according to claim 1, characterized in that, The method further includes: If the interaction between the virtual object and the target interactive object ends, an interaction end prompt message will be displayed in the first interactive space.

14. The method according to any one of claims 1-13, characterized in that, The video stream is a live video stream.

15. A virtual interactive device, characterized in that, include: A display module is used to display a video stream within a first interactive space, the video stream including: a target interactive object; The control module is used to control at least one virtual object to enter a second interactive space and control the target interactive object to stay in the first interactive space according to interactive control information, wherein the second interactive space is independent of the first interactive space, the virtual object is a virtual object corresponding to the audience who has established an interactive connection with the target interactive object, and the target interactive object is the anchor. The interaction module is used to send the real-time image of the target interactive object captured by the first camera in the first interaction space to the second interaction space, so as to display the real-time image in the second interaction space, so that each virtual object in the second interaction space can interact with the target interactive object based on the real-time image.

16. An electronic device, characterized in that, include: A processor and a memory, the memory being used to store a computer program, the processor being used to invoke and run the computer program stored in the memory to perform the method as described in any one of claims 1-14.

17. A computer-readable storage medium, characterized in that, Used to store a computer program that causes a computer to perform the method as described in any one of claims 1-14.

18. A computer program product containing program instructions, characterized in that, When the program instructions are executed on the electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-14.

Citation Information

Patent Citations

  • Method and device for microphone connecting live broadcast

    CN109640191A

  • Live broadcast interaction method and device, electronic equipment and storage medium

    CN114205679A