Live broadcast interaction method and device

By realizing the control of the target virtual studio and synchronizing the picture technology on the server side, the problem of single interactive scene in the existing live broadcast technology is solved, the user interaction scene is enriched, and the live broadcast effect and user stickiness are improved.

CN119364031APending Publication Date: 2025-01-24SHANGHAI BILIBILI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310852679.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-11
Publication Date
2025-01-24

AI Technical Summary

Technical Problem

In the existing live broadcast technology, the user interaction scenario is single and cannot meet the diverse interaction needs between users, resulting in poor live broadcast interaction effects and low user stickiness.

Method used

By implementing a live broadcast method on the server side, the target user controls the target virtual studio, generates and synchronizes the first screen to the display interface of each user, and supports multi -users to interact in the same virtual studio. The control method of the studio.

Benefits of technology

It has enriched the interactive scenarios between users, improved the effect of live broadcast interaction, enhanced the stickiness of users. Users can define the virtual studio without thresholds to meet different interactive needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119364031A_ABST
    Figure CN119364031A_ABST
Patent Text Reader

Abstract

The invention provides a live broadcast interaction method and device, and the method comprises the steps: receiving a control instruction of a target user for a target virtual studio, the target virtual studio being corresponding to at least one user, the target user being any one of the at least one user, and the control instruction carrying a studio content source; controlling the target virtual studio according to the studio content source, and generating a first picture of the target virtual studio; and synchronizing the first picture to a display interface of each user corresponding to the target virtual studio. Therefore, the target virtual studio can correspond to at least one user, the at least one user can realize interaction in the target virtual studio, and any user can control the target virtual studio, so that the control mode is relatively flexible, the interaction scene is enriched, the live broadcast interaction effect is improved, and the user stickiness is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of live broadcast technology, and more particularly to a live broadcast interactive method. The present application also relates to a live broadcast interactive device, a computing device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of computer technology, the live broadcast industry has developed rapidly, the live broadcast audience has continued to expand, and there are more and more types of live broadcasts. In order to meet people's interactive needs when watching live broadcasts, users can interact with other users on the live broadcast platform to improve the live broadcast effect.

[0003] In the prior art, different users can only interact with each other through microphone connection, and the audience in the user interface can only watch the microphone connection screen and interact with the users based on the microphone connection screen. The interactive scene is single and cannot meet the interactive needs between users and the viewing and interactive needs of the audience. The live broadcast interactive effect is poor and the user stickiness is low. Summary of the invention

[0004] In view of this, the embodiment of the present application provides a live interactive method. The present application also relates to a live interactive device, a computing device, and a computer-readable storage medium to solve the technical problems of single interactive scene and poor live interactive effect in the prior art.

[0005] According to a first aspect of an embodiment of the present application, a live broadcast interaction method is provided, which is applied to a server and includes:

[0006] Receiving a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content;

[0007] Control the target virtual studio according to the studio content source to generate a first picture of the target virtual studio;

[0008] The first picture is synchronized to the display interface of each user corresponding to the target virtual studio.

[0009] According to a second aspect of an embodiment of the present application, a live interactive method is provided, which is applied to a client and includes:

[0010] Receive and display the first picture of the target virtual studio synchronized by the server;

[0011] The target virtual studio corresponds to at least one user, the first screen of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

[0012] According to a third aspect of an embodiment of the present application, a live interactive device is provided, which is applied to a server and includes:

[0013] A first receiving module is configured to receive a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content;

[0014] A first generating module is configured to control the target virtual studio according to the studio content source and generate a first picture of the target virtual studio;

[0015] The first synchronization module is configured to synchronize the first picture to the user interface of each user corresponding to the target virtual studio.

[0016] According to a fourth aspect of an embodiment of the present application, a live interactive device is provided, which is applied to a client and includes:

[0017] A first display module is configured to receive and display a first picture of a target virtual studio synchronized by a server;

[0018] The target virtual studio corresponds to at least one user, the first screen of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

[0019] According to a fifth aspect of an embodiment of the present application, a computing device is provided, comprising a memory, a processor, and computer instructions stored in the memory and executable on the processor, wherein the processor implements the steps of the live interactive method when executing the computer instructions.

[0020] According to a sixth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer instructions, and when the computer instructions are executed by a processor, the steps of the live interactive method are implemented.

[0021] The live interactive method provided in the embodiment of the present application receives a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a studio content source; the target virtual studio is controlled according to the studio content source to generate a first screen of the target virtual studio; and the first screen is synchronized to a display interface of each user corresponding to the target virtual studio.

[0022] An embodiment of the present application realizes that a target virtual studio can correspond to at least one user, and the at least one user can interact in the target virtual studio, thereby enriching the interaction scenes between users; and, any user corresponding to the target virtual studio can control the target virtual studio, that is, when multiple users are in the same target virtual studio, any user can control the target virtual studio. The control method of the target virtual studio is relatively flexible, and users can define virtual studios without barriers, thereby meeting different interaction needs, enriching the interaction scenes, and improving the effect of live interaction, thereby improving user stickiness. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a flow chart of a live interactive method provided by an embodiment of the present application;

[0024] Figure 2a It is a schematic diagram of a virtual studio selection interface of a virtual broadcast application provided by an embodiment of the present application;

[0025] Figure 2b It is a schematic diagram of a virtual studio with a curved fish screen provided in one embodiment of the present application;

[0026] Figure 2c It is a schematic diagram of a virtual studio with waterfall curved corners and two screens provided in one embodiment of the present application;

[0027] Figure 2d It is a schematic diagram of a virtual studio with three right-angle screens provided in one embodiment of the present application;

[0028] Figure 2e is a schematic diagram of a virtual studio of a virtual living room TV scene provided by an embodiment of the present application;

[0029] Figure 2f It is a schematic diagram of a style configuration interface of a virtual broadcast application provided by an embodiment of the present application;

[0030] Figure 2g This is a schematic diagram of a target virtual studio provided by an embodiment of the present application;

[0031] Figure 2hThis is a schematic diagram of another target virtual studio provided by an embodiment of the present application;

[0032] Figure 2i It is a schematic diagram of a secondary control component in a target virtual studio provided by an embodiment of the present application;

[0033] Figure 2j This is a schematic diagram of remote control of a content delivery area in a target virtual studio provided by an embodiment of the present application;

[0034] Figure 2k This is a schematic diagram of a delivery component in a target virtual studio provided by an embodiment of the present application;

[0035] Figure 2l This is a schematic diagram of the delivery process in the first target virtual studio provided by an embodiment of the present application;

[0036] Figure 2m This is a schematic diagram of the delivery process in the second target virtual studio provided in an embodiment of the present application;

[0037] Figure 2n This is a schematic diagram of the delivery process in the third target virtual studio provided in an embodiment of the present application;

[0038] Figure 3 is a flow chart of another live interactive method provided by an embodiment of the present application;

[0039] Figure 4 This is an overall processing flow chart of a live interactive method provided by an embodiment of the present application;

[0040] Figure 5 It is a structural diagram of a live interactive device provided by an embodiment of the present application;

[0041] Figure 6 is a structural diagram of another live interactive device provided by an embodiment of the present application;

[0042] Figure 7 It is a structural block diagram of a computing device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0043] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0044] The terms used in one or more embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of the present application. The singular forms of "a" and "the" used in one or more embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more associated listed items.

[0045] It should be understood that, although the terms first, second, etc. may be used to describe various information in one or more embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0046] In the present application, a live broadcast interaction method is provided. The present application also relates to a live broadcast interaction device, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.

[0047] Figure 1 This is a flowchart of a live interactive method provided by an embodiment of the present application, which is applied to a server and specifically includes the following steps 102-106:

[0048] Step 102: receiving a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content.

[0049] It should be noted that the virtual studio refers to a virtual scene space in which users can place content and interact, etc. The target virtual studio refers to the currently displayed virtual studio, which can be a studio created by the target user himself or a virtual studio created by other users joined by the target user. The studio content source refers to the source of the content played by the target virtual studio, which is used to place content to the target virtual studio.

[0050] In actual implementation, the target virtual studio corresponds to at least one user, that is, at least one user can be in the same virtual studio, so as to realize interaction between multiple users in the virtual studio.

[0051] The user can be the host in the live broadcast platform or the audience in the live broadcast room. That is to say, the host can control the target virtual studio, and the audience watching the live broadcast can also control the target virtual studio, which enriches the interactive scenes and improves the user experience.

[0052] In an optional implementation of this embodiment, before the target user controls the target virtual studio, the user may also join the target virtual studio, that is, before receiving the control instruction of the target user for the target virtual studio, the method further includes:

[0053] receiving a trigger instruction from a first user for a target virtual studio, and controlling the first user to enter the target virtual studio;

[0054] A second picture of the target virtual studio is generated, and the second picture is synchronized to the user interface of the first user.

[0055] Specifically, the first user refers to any user of the live broadcast platform, and the user can be a host or a viewer. The first user and the target user can be the same user or different users. The second screen of the target virtual studio refers to the screen generated when the first user enters the target virtual studio.

[0056] It should be noted that during the live broadcast, the first user can create a target virtual studio or join a target virtual studio created by other users, so that the target virtual studio is displayed on the first user's user interface, allowing the first user to interact with other users in the target virtual studio. In addition, the first user can also create a virtual studio or join a virtual studio created by other users before the broadcast starts, and can directly watch the screen of the virtual studio after the broadcast starts.

[0057] In an optional implementation of this embodiment, the first user may call a virtual studio application in the live broadcast platform to create or join a target virtual studio, that is, to receive a trigger instruction from the first user for the target virtual studio and control the first user to enter the target virtual studio, including:

[0058] In response to a call request of a virtual studio application, a virtual studio selection interface is displayed, wherein the virtual studio selection interface includes at least one currently created virtual studio and a virtual studio creation component;

[0059] In the case of detecting a virtual studio joining instruction initiated by the first user, determining that a trigger instruction of a target virtual studio is received, and controlling the first user to join the target virtual studio, wherein the target virtual studio is any virtual studio currently created;

[0060] When it is detected that the virtual studio creation component is triggered, it is determined that a trigger instruction of the target virtual studio is received, a target virtual studio is created, and the first user is controlled to enter the created target virtual studio, wherein the target virtual studio is a virtual studio created by the first user.

[0061] In actual applications, the live broadcast platform can be provided with an entrance to the virtual studio application. If the first user triggers the entrance, a call request for the virtual studio application can be detected. In response to the call request, a virtual studio selection interface can be displayed. The virtual studio selection interface includes at least one currently created virtual studio and a virtual studio creation component. The at least one currently created virtual studio can be created for users other than the first user.

[0062] It should be noted that the virtual studio can be divided into multiple virtual scene types, such as virtual stage scene, virtual room scene, etc. The at least one virtual studio currently created can be a virtual studio of different types of virtual scenes, or a virtual studio created by different users under the same type of virtual scene.

[0063] Specifically, when at least one currently created virtual studio is displayed, studio attribute information such as the virtual studio name, scene category, thumbnail, and introduction may be included. The first user may choose to join the target virtual studio he or she needs based on at least one displayed virtual studio, i.e., trigger the trigger instruction of the target virtual studio. The target virtual studio may include the first user, the creating user, and other joined users.

[0064] In addition, if the first user does not want to join the currently created virtual studio, he can also create a target virtual studio by himself. Specifically, when it is detected that the virtual studio creation component is triggered, it is determined that a trigger instruction of the target virtual studio is received, and the target virtual studio is created.

[0065] For example, Figure 2a is a schematic diagram of a virtual studio selection interface of a virtual studio application provided by an embodiment of the present application, such as Figure 2a As shown in the figure, the currently created virtual studios include Studio 1, XXX Stage, XXX Museum, etc. The first user can select the virtual studio he wants to join from the displayed Studio 1, XXX Stage, and XXX Museum. Figure 2a As shown, the virtual studio selection interface also includes a virtual studio creation component for creating a new virtual studio.

[0066] In the embodiments of the present specification, the first user can call a virtual broadcast application in the live broadcast platform, add a target virtual studio created by other users to the virtual broadcast application, or create a target virtual studio by himself to interact with other users in the target virtual studio, enrich the interactive scenes, and have a low threshold and simple operation.

[0067] In addition, when creating a virtual studio, users can also configure permission information, which refers to whether the created virtual studio allows other users to join, whether other users need to verify when joining, etc. If no permission information is configured when creating a virtual studio, it means that the virtual studio is open to the public and any other user can join; if verification is configured when creating a virtual studio, it means that only users who meet the verification conditions can join the virtual studio, such as entering the correct verification code, being a user in the friend list, etc.; if joining is not allowed when creating a virtual studio, it means that only the created user and the corresponding audience of the user can enter the virtual studio and interact.

[0068] Virtual studios that are allowed to be joined can be displayed in the virtual studio selection interface for other users to choose; virtual studios that are not allowed to be joined can be not displayed, or displayed with a sign indicating that joining is not allowed, such as adding a "lock"-shaped sign to the virtual studio that is not allowed to join. The first user can only choose the virtual studio that is allowed to join, and for the virtual studio that requires verification to join, the first user can successfully join if the verification conditions are met. In this way, by configuring the joining permission when creating the virtual studio, the interactive order of the virtual studio can be guaranteed and confusion can be avoided.

[0069] In an optional implementation of this embodiment, when the target virtual studio is a virtual studio created by the first user, the first user can customize the style of the target virtual studio when creating the target virtual studio; that is, the target virtual studio is a virtual studio created by the first user, and the trigger instruction carries the style parameters of the target virtual studio, and generating the second screen of the target virtual studio includes:

[0070] Obtain the corresponding target studio style according to the style parameters;

[0071] The target virtual studio is rendered according to the target studio style to generate a second picture of the target virtual studio.

[0072] Specifically, when the first user triggers the target virtual studio, the style parameters of the target virtual studio can be carried in the trigger instruction. The style parameters are used to indicate the style of the target virtual studio to be created, and can include at least one of the virtual studio name, virtual scene type, and style information.

[0073] It should be noted that the virtual studio can be divided into multiple virtual scene types, such as virtual stage scenes, virtual room scenes, etc. Each virtual scene type can also include multiple style types for users to choose from. For example, in a virtual stage scene, the virtual studio can include a virtual stage. The stage styles of the virtual stage can be divided into three-sided right-angle screens, two-sided screens with waterfall corners, and curved fish screens for circular stages. In addition to the screen shape, the floor style, sky background, etc. can also be different; the virtual room scene can include a virtual living room TV scene, a virtual meeting scene, etc.

[0074] For example, Figure 2b is a schematic diagram of a virtual studio with an arc-shaped fish screen provided in an embodiment of the present application, such as Figure 2b As shown, the virtual stage in the virtual studio is a circular stage with three right-angled screens with curved fish screens. Figure 2c Schematic diagram of a virtual studio with waterfall curved corners and two screens provided in one embodiment of the present application. Figure 2c As shown, the stage in the virtual studio is a waterfall curved corner double-sided screen. Figure 2d is a schematic diagram of a virtual studio with three right-angle screens provided in one embodiment of the present application, such as Figure 2d As shown, the stage in the virtual studio is a three-sided right-angle screen. Figure 2e is a schematic diagram of a virtual studio of a virtual living room TV scene provided by an embodiment of the present application, such as Figure 2e As shown, the virtual studio is a virtual living room TV scene, and the virtual living room TV scene includes a TV.

[0075] In actual applications, if the first user does not want to join the currently created virtual studio, he or she can also create a target virtual studio by himself or herself. Specifically, the first user can trigger the virtual studio creation component to display the style configuration interface, which may include multiple configuration controls. The first user can use the configuration controls included in the style configuration interface to configure the style parameters of the target virtual studio to be created, initiate a trigger instruction, and then the virtual studio application can obtain the corresponding target studio style according to the style parameters carried in the trigger instruction, and render the target virtual studio according to the target studio style to generate the second screen of the target virtual studio. After that, the server can synchronize the second screen of the target virtual studio to the user interface of the first user, so that the screen of the target virtual studio can be viewed and interaction can be carried out in the target virtual studio.

[0076] In addition, after the first user creates the target virtual studio, other users can join the target virtual studio through the virtual studio application to interact with the first user in the target virtual studio. In other words, the target virtual studio currently includes the creating user (that is, the first user), and other users can subsequently join the target virtual studio created by the first user.

[0077] Using the above example, Figure 2f is a schematic diagram of a style configuration interface of a virtual studio application provided by an embodiment of the present application, wherein a first user triggers Figure 2a When creating a virtual studio component in the virtual studio selection interface shown in the figure, the following is displayed: Figure 2f The style configuration interface shown includes configuration controls such as the virtual studio name, virtual scene type, style type, etc. The user can select or enter style parameters in the configuration controls. After the configuration is completed, click the confirmation control to create the corresponding target virtual studio based on the style parameters.

[0078] In the embodiments of the present specification, the first user can also create a target virtual studio in the virtual studio application. When creating the target virtual studio, the user can customize the required virtual scene type, style type and other style parameters, as well as other required information (such as the name of the virtual studio, etc.), thereby customizing the virtual studio with a low operating threshold and simple operation.

[0079] In an optional implementation of this embodiment, in addition to customizing the studio style, the first user can also customize the camera movement mode in the target virtual studio, that is, generate a second screen of the target virtual studio, including:

[0080] Determining a target camera movement mode of the first user in a target virtual studio;

[0081] According to the target camera movement mode, a second picture of the target virtual studio is generated.

[0082] Specifically, the camera movement mode refers to the user's perspective in the target virtual studio. The camera movement mode may include fixed perspective and dynamic capture. For example, if the target virtual studio is a virtual stage scene, the user's perspective may be a fixed perspective such as the perspective from the stage to the audience, the perspective from the front of the stage to the stage, or the perspective from the left side of the stage to the stage; or it may be a dynamic capture camera movement that slides over the stage. The target camera movement mode refers to the camera movement mode currently configured by the first user, that is, the current perspective of the first user in the target virtual studio.

[0083] In the embodiments of the present specification, in addition to customizing the studio style, the first user can also customize the camera movement mode in the target virtual studio to generate a second picture of the target virtual studio. The custom-created target virtual studio has flexible configuration and easy operation.

[0084] In actual applications, in addition to being able to customize the camera movement mode and generate a second screen when the first user enters the target virtual studio, in the process of interacting based on the target virtual studio, each user corresponding to the target virtual studio can switch the current camera movement mode to change the viewing angle. Specifically, the target virtual studio can be provided with shortcut keys for camera movement modes, such as stage dynamic camera movement, front close-up, back view, side view, and other camera movement modes. Each user can switch the camera movement mode through shortcut keys, and the switched camera mode is the target camera movement mode. The viewing angle of the virtual studio is determined according to the target camera movement mode, and the screen of the target virtual studio corresponding to the viewing angle is generated and synchronized to the user interface of the corresponding user.

[0085] It should be noted that, in addition to the first user being able to customize the camera movement mode of the target virtual studio, each user corresponding to the target virtual studio can customize the switching of the camera movement mode of the target virtual studio. That is to say, the pictures of the target virtual studio seen by different users' user interfaces may be different, and are pictures observed from different perspectives. In addition, within the user interface of the same user, the user can also switch between different camera movement modes during the live broadcast process, and display the target virtual studio from different perspectives in the user interface. The user can customize and control the display perspective of the target virtual studio, making the picture of the target virtual studio rich and varied, enriching the interactive scene.

[0086] It should be noted that the target user is a user who currently has control authority over the target virtual studio. Each user corresponding to the target virtual studio may have control authority to control the display content of the target studio, thereby achieving interaction.

[0087] In actual implementation, the control authority determination rules can be pre-configured, such as obtaining the control authority setting time in sequence according to the joining order, obtaining the control authority setting time in sequence according to the user level, etc. In addition, at least one user corresponding to the target virtual studio can grab the control authority of the target virtual studio to enrich the interactive scene.

[0088] In an optional implementation of this embodiment, at least one user corresponding to the target virtual studio can seize the control authority of the target virtual studio based on the interactive parameters, that is, before receiving the control instruction of the target user for the target virtual studio, the method further includes:

[0089] Determining an interaction parameter of at least one user corresponding to the target virtual studio;

[0090] A target user is determined from at least one user according to the interaction parameter, wherein the target user obtains control authority of the target virtual studio.

[0091] Specifically, the interaction parameter refers to the interaction information corresponding to the target virtual studio, which may include interaction information between users, and if the user is a live streamer, it may also include interaction information of the audience in the live broadcast room, etc. For example, the interaction parameter may include competition information of games between users, or may also include bullet screen information and gift information sent by the audience in the live broadcast room of the user, etc. According to the interaction parameter of at least one user, the target user may be determined from at least one user, that is, the user who currently has control authority may be determined.

[0092] In actual applications, the virtual studio application and the live broadcast platform are connected to communicate. The virtual studio application can obtain interactive information such as bullet screens and gifts sent by the live broadcast audience of each user, calculate the audience interaction index based on the audience interaction information such as the number of times the bullet screen is sent, the number of times the gift is given, and the value of the gift, and select the user with the highest current audience interaction index as the target user who obtains the control authority. The target user can control the target virtual studio. Alternatively, each user can also play games in the virtual studio application, and determine the target user who will eventually compete for the control authority of the target virtual studio based on the game results. Alternatively, the audience interaction index and game results can be combined to jointly determine the target user who obtains the control authority of the target virtual studio.

[0093] It should be noted that when the target virtual studio corresponds to at least one user, the target user who currently has control authority can be automatically determined according to the control authority determination rules; alternatively, each user can also seize the control authority of the target virtual studio, thereby enriching the control method of the target virtual studio and further enriching the interactive scene.

[0094] In an optional implementation of this embodiment, the target virtual studio may be provided with a control entrance for the target user who obtains the control authority to control the target virtual studio, that is, before receiving the control instruction of the target user for the target virtual studio, the method further includes:

[0095] Setting a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component;

[0096] In response to a trigger instruction of a target primary control component, the target primary control component is controlled to include various secondary control components, wherein the target primary control component is any one of at least one primary control component, and the secondary control component is used to initiate a control instruction.

[0097] The set position is a pre-set position, which is any position in the current picture, such as the middle, the lower left, the upper left, etc.

[0098] In actual applications, a control entrance is set at the set position of the target virtual studio, and the control client displays the control entrance in the current screen of the target virtual studio. The control entrance includes at least one first-level control component, and the first-level control component is a collection of control components of a category. The target user can trigger a first-level control component in the control entrance through the client, that is, the target first-level control component. At this time, the server detects that the target first-level control component is triggered, and will control the client to display the target first-level control component including various second-level control components. The second-level control component is the component that actually executes the specific control function, so that the target user can initiate specific control instructions through the client.

[0099] It should be noted that the control entry may not be displayed in the current screen of the target virtual studio at the beginning, or the control entry may be displayed in a reduced size at other positions of the current screen. When the target user triggers it through the remote control, the client sends a trigger message to the server, and the server controls the addition of the control entry at the set position of the target virtual studio, and feeds the screen back to the client for display, thereby clearly displaying each primary control component to the target user for selection by the target user. After the target user selects the target primary control component, the client may send a selection instruction to the server, and the server controls the client to display the target primary control component including each secondary control component. The target user may select the required control function from each secondary control component and initiate a control instruction to control the target virtual studio.

[0100] In addition, after the target primary control component including each secondary control component is displayed, the target user can also exit the secondary control component and return to the primary control component by setting an exit operation. The set exit operation can be swiping left, clicking to close the control, exiting the shortcut key, or not detecting a selection operation within a set time.

[0101] Furthermore, if a selection instruction of a primary control component is detected within a set time period after the primary control component is returned to display, the control entry can be cancelled or reduced.

[0102] For example, Figure 2g is a schematic diagram of a target virtual studio provided by an embodiment of the present application, such as Figure 2g As shown, a control wheel (i.e., a control entrance) is displayed in the lower left corner of the target virtual studio screen. After the user triggers the control wheel, the following is displayed: Figure 2h The schematic diagram of the target virtual studio is shown in FIG. Figure 2hThis is a schematic diagram of another target virtual studio provided in an embodiment of the present application. A control wheel is enlarged in the middle of the screen of the target virtual studio (i.e., the set position). The control wheel includes three primary control components, namely expression control, action control, and remote control (in actual implementation, other primary control components can also be expanded).

[0103] In addition, the primary control component or the secondary control component can be triggered by the joystick, and the joystick can be driven forward, backward, left, and right by the keyboard or mouse to select the primary control component or the secondary control component in the wheel. Figure 2h As shown, the control wheel includes two circles, the inner circle is a joystick. When the mouse is operated to enter the joystick of the inner circle, no primary control component is selected and the secondary wheel is not entered; the outer circle is provided with at least one primary control component (such as expression control, action control and remote control). When the mouse controls the joystick to deviate in a certain direction, the primary control component in the direction is selected and the secondary wheel corresponding to the primary control component is entered, such as Figure 2h The action control is shown as selected, and the action control includes multiple actions, which can control the user virtual image of the target user to perform corresponding actions in the target virtual studio, such as Figure 2i As shown, it includes 8 secondary control components, each of which is an action, used to control the execution of the corresponding action. Figure 2i 1 is a schematic diagram of a secondary control component in a target virtual studio provided in an embodiment of the present application. The selection method of the secondary control component may be the same as or different from the selection method of the primary control component.

[0104] In addition, the expression control has the same logic as the above-mentioned action control. The expression options (that is, the secondary control components under the expression control) can be expanded to 10, and the selected implementation logic is the same as the above-mentioned action options. Furthermore, after the remote control is triggered, the secondary control components of the remote control can be displayed, such as the delivery content control, stage style switching, etc.; and the secondary control components can also include tertiary control components. For example, if the secondary control component is the delivery content control, it can also include tertiary control components such as stage close-up projection, on-demand, and default list playback.

[0105] Currently, in actual applications, primary control components, secondary control components, etc. can also be selected by other methods, such as mouse clicking, keyboard shortcut selection, etc., and this application does not limit this.

[0106] In an embodiment of the present specification, a control entrance can be added at a set position of the target virtual studio. The control entrance may include at least one first-level control component for the target user to select. The first-level control component also includes multiple second-level control components to achieve control of the target virtual studio. The control functions are rich and the control implementation method is flexible, which enriches the interactive scenes and improves the live broadcast effect.

[0107] In addition, in addition to the target user's client having control authority over the target virtual studio being able to display a control entrance for the target user to control the target virtual studio, the clients of each user corresponding to the target virtual studio can all display a simplified control entrance, which can be used by other users to perform their own related control operations, such as switching camera modes, controlling their own virtual images to perform corresponding actions, etc.

[0108] In an optional implementation of this embodiment, when the target virtual studio is a virtual room scene, the virtual room scene includes a playback device, and the control entrance can be triggered by close contact with the playback device, that is, the control entrance is set at a set position of the target virtual studio, including:

[0109] receiving a current location of a user avatar of a target user;

[0110] When the current position is within the set range corresponding to the playback device, a control entrance is added to the virtual room scene.

[0111] Specifically, the set range refers to a pre-set range around the playback device, indicating that the virtual image of the target user is relatively close to the playback device. The playback device refers to a device that can play multimedia resources, such as a motor, a computer monitor, etc.

[0112] It should be noted that, since the virtual room scene often includes a playback device, the target user can control the target user's user virtual image to walk in the virtual room scene by driving the mouse or keyboard. During the walking process, the target user's client can detect the current position of the target user's user virtual image in real time and send it to the server. If the current position is within the set range corresponding to the playback device, it means that the target user's user virtual image is close to the playback device and may need to perform certain control functions, so the display control entrance can be automatically triggered at this time. In addition, the server can also automatically locate the current position according to the operation of the target user driving the mouse or keyboard, and this application does not limit this.

[0113] In specific implementation, if no control entrance has been displayed before, triggering the display of the control entrance may mean enlarging and displaying the control entrance at a set position such as the lower middle, lower right, or lower left of the playback device; if a reduced control entrance has been displayed at other positions before, triggering the display of the control entrance means enlarging and displaying the control entrance at a set position in the playback device.

[0114] In addition, if it is detected that the current position of the user virtual image of the target user leaves the set range, it means that the user virtual image of the target user is far away from the playback device, and the display control entrance can be exited at this time.

[0115] In the embodiments of this specification, for the virtual room scene, the display or exit control entrance can be controlled by the target user's virtual image approaching or moving away from the playback device, thereby enriching the display method of the control entrance and thus enriching the interactive scene, making it more vivid and close to the real scene, and improving the live broadcast effect.

[0116] In addition, for the virtual room scene, if the user avatar of the target user is not facing the playback device, the location prompt information of the playback device can also be displayed to provide the target user with the opportunity to control his or her corresponding user avatar to turn toward the playback device.

[0117] Step 104: Control the target virtual studio according to the studio content source, and generate a first picture of the target virtual studio.

[0118] It should be noted that the first screen of the target virtual studio refers to the screen generated by the target user controlling the playback content. When the target user initiates a control instruction, the control instruction may carry the studio content source, and the playback content of the target virtual studio may be controlled according to the studio content source to generate the first screen.

[0119] In an optional implementation of this embodiment, the first screen of the target virtual studio includes at least one of a virtual stage close-up screen, a delivery video screen, a live broadcast screen in the live broadcast room, and a preset material screen. Among them, the close-up screen refers to the screen corresponding to the close-up of the virtual stage of the target virtual studio; the delivery video screen refers to the screen of the video delivered by the target user, and the live broadcast screen in the live broadcast room refers to the live broadcast screen delivered by the target user. The delivery video screen and the live broadcast screen in the live broadcast room are both multimedia resources delivered by the target user; the preset material screen refers to the selected material pre-configured by the virtual studio application, and the selected material can be a video or a static picture.

[0120] In an optional implementation of this embodiment, the target virtual studio includes a virtual stage, the virtual stage includes a content delivery area, the control instruction is a delivery instruction, and the studio content source includes a multimedia resource identifier to be delivered. At this time, controlling the target virtual studio according to the studio content source includes:

[0121] Obtaining a target multimedia resource corresponding to the multimedia resource identifier;

[0122] Deliver the target multimedia resources to the content delivery area.

[0123] Specifically, the content delivery area can play the target multimedia resources delivered by the target user, such as the content delivery area can be a display screen of a virtual stage. Multimedia resources can refer to resources such as videos and images.

[0124] In actual applications, a remote controller may be displayed in the screen of the target virtual studio. The remote controller may include a delivery component. When the delivery component is triggered, multimedia resources may be delivered to the content delivery area.

[0125] In specific implementation, the multimedia resources that can be delivered to the content delivery area can be divided into multiple types, such as delivering a close-up of the user's virtual image in the middle of the stage to the content delivery area of ​​the stage, on-demand video from other sources, and selection of material videos provided by a virtual studio application. Therefore, the delivery components can be divided into at least one, such as the delivery components can include close-up delivery, on-demand, selected material and other components.

[0126] The target user triggers the delivery control component of the content delivery area through the remote control, and the delivery components such as close-up delivery, on-demand, and selected materials are displayed in the screen of the target virtual studio. Assuming that the target user selects close-up delivery, the multimedia resource identifier to be delivered carried in the delivery instruction is the stage close-up identifier. At this time, the close-up picture of the user's virtual image in the middle of the stage can be delivered to the content delivery area.

[0127] Assuming that the target user selects on-demand, a data source input control may pop up at this time, and the target user may enter a multimedia resource identifier in the data source input control. The multimedia resource identifier may uniquely indicate the target multimedia resource to be delivered, such as a video identifier (such as a video number, video address, etc.), a user interface identifier (such as a user interface name, user interface address, etc.), etc. Based on the multimedia resource identifier, the corresponding target multimedia resource may be found and delivered to the content delivery area. For example, if the multimedia resource identifier is a video identifier, the corresponding video may be found and obtained as the target multimedia resource according to the video identifier; if the multimedia resource identifier is a user interface identifier, the content collected by the user terminal indicated by the user interface identifier may be obtained, and the content may be delivered to the content delivery area.

[0128] In addition, the target user can enter the multimedia resource identifier in the displayed data source input control, and then the virtual studio application can automatically resolve the corresponding resource address to obtain the target multimedia resource for delivery. For example, BV1*** will be resolved to https: / / …… / video / BV1***; 263***** will be resolved to https: / / …… / *****. The target multimedia resource can be a multimedia resource in the live broadcast platform or a multimedia resource from other application sources.

[0129] It should be noted that the virtual studio application can also be pre-set with multiple multimedia materials, which can be divided into multiple playlists, which can match different stage atmospheres. If the target user selects the delivery component of the selected material, the multimedia material provided by the virtual studio application can be played by default. The multimedia material can be played randomly, in sequence, etc., or the associated multimedia material can be selected based on the properties of the current virtual studio, or it can be selected by the target user. For example, the virtual studio application has 14 built-in default manuscripts, that is, the delivery content in the default state, and different default playlists can also be switched according to the stage style.

[0130] In addition, under the delivery component of the selected material, you can also display material switching controls, such as previous, next, pause, mute and other functional components, so that the target users can switch materials or control the delivered materials.

[0131] It should be noted that the screen projection function is added to the target virtual studio, and the content delivery area of ​​the virtual stage can be controlled by the target user through the remote control to deliver content (such as stage close-ups, on-demand videos, user-side captured images, etc.). The target multimedia resources are delivered to the content delivery area, and the generated target virtual studio images can be pushed to the user interface of each user for the user interface audience to watch.

[0132] For example, Figure 2j is a schematic diagram of remote control of a content delivery area in a target virtual studio provided by an embodiment of the present application, such as Figure 2j As shown, the "screen remote control" is displayed in the target virtual studio screen. When the target user triggers the "screen remote control", the following is displayed: Figure 2k The schematic diagram of the delivery component shown in the figure is as follows: Figure 2k It is a schematic diagram of a delivery component in a target virtual studio provided in an embodiment of the present application, and the delivery component includes "close-up delivery", "on-demand", "selected materials" and the like.

[0133] Figure 2l FIG. 1 is a schematic diagram of the delivery process in the first target virtual studio provided in an embodiment of the present application. Figure 2l As shown, the target user selects "close-up delivery", and a close-up image of the virtual user image on the stage is displayed in the content delivery area. Figure 2m FIG. 1 is a schematic diagram of the delivery process in the second target virtual studio provided in an embodiment of the present application. Figure 2mAs shown, the target user selects "On Demand", and the data source input control can be displayed to the target user. The target user can enter the multimedia resource identifier (video identifier, user interface identifier, etc.) in the data source input control and click "Load" to deliver the target multimedia resource indicated by the multimedia resource identifier to the content delivery area of ​​the virtual stage, such as the stage screen. Figure 2n is a schematic diagram of the delivery process in the third target virtual studio provided in an embodiment of the present application, such as Figure 2n As shown, the target user selects "Selected Materials". At this time, the material name in the playlist corresponding to the virtual stage can be displayed in the screen of the virtual studio, such as XXX manuscript. The right side of the material has control components such as previous, next, pause, etc. The number of the current material and the number of default materials, such as 12 / 14, can also be displayed to facilitate the target user to select and play the current material manuscript in the content delivery area.

[0134] In addition, a static picture group may be set in the virtual broadcast application. When no content is delivered in the content delivery area, the set static picture group is played.

[0135] It should be noted that when multiple users are in the same target virtual studio, the virtual studio application only needs to synchronize parameters to the user interface of each user terminal at the initialization and when the status of the content delivery area changes, so that the content delivery area can correctly determine the current status. The user interface screens of each user terminal can be fully synchronized or not. In the specific implementation, there is no content to be delivered in the black screen state, and it is only necessary to transmit the initial black screen state; in the carousel picture state, it is only necessary to synchronize the static picture group to each user end when entering the carousel, and the preset picture currently being automatically rotated does not need to be synchronized, and the user end executes the carousel locally; in the close-up delivery state, the current close-up target person needs to be synchronized, and the current camera configuration, that is, the camera movement mode, does not need to be synchronized, and the user end executes the close-up of the target locally; in the video on-demand state, who initiated the on-demand needs to be synchronized, which is used to display the current delivery controller, the current video identification that is being played needs to be synchronized, which is used for the user end to load the corresponding target video locally, and the current playback progress (seconds / percentage) needs to be synchronized, which is used for the user end to determine which progress to start playing at initialization; in the on-demand state of the user interface user screen, the current user interface identification that is being delivered needs to be synchronized, which is used for the user end to locally load the user interface push stream; in the wonderful material state, the material number that is currently being played needs to be synchronized, which is used for the user end to locally load the material manuscript, and the current playback progress (seconds / percentage) needs to be synchronized, which is used for the user end to determine which progress to start playing at initialization.

[0136] In the embodiments of the present specification, when multiple users are in the same virtual studio, any user can place multimedia resources into the content placement area on the virtual stage of the virtual studio and control the content source of the virtual studio. In other words, any user can manipulate and change the content source of the virtual studio, thereby enriching the forms and scenes of interaction.

[0137] In an optional implementation of this embodiment, the virtual stage also includes other visual surfaces in addition to the content delivery area. After the target multimedia resource is delivered to the content delivery area, the following steps are also included:

[0138] Determine the projection content of the multimedia content played in the content delivery area on other visual surfaces;

[0139] Render the projected content to other viewing surfaces.

[0140] It should be noted that in addition to the content delivery area, the virtual stage can also include other visual surfaces, such as the stage floor, stage side panels, floor decorations, light boxes, etc.

[0141] In actual implementation, after the target multimedia resource is placed in the content placement area, the projection content of the multimedia content played in the content placement area on other visual surfaces can also be determined, and the currently played multimedia resource can be projected on other visual surfaces by UV unfolding. Among them, UV is a two-dimensional texture coordinate with vertex component information of polygons and subdivided surface meshes. UV exists to define a two-dimensional texture coordinate system, called "UV texture space". UV texture space uses letters U and V to indicate axes in two-dimensional space. UV texture space helps to place image texture maps on 3D surfaces. The importance of UV is reflected in that they provide a connection between the surface mesh and how to map the image texture to the surface mesh, that is, UV is used as a marker point to control which points (pixels) on the texture map correspond to which points (vertices) on the mesh, so that the projection can be determined based on the UV unfolding method.

[0142] In the embodiments of this specification, other visual surfaces in the virtual stage except the content delivery area can render the same content as the content delivery area by projection, thereby ensuring that the stage playback effect is closer to the real scene and bringing a better visual experience to users.

[0143] In an optional implementation of this embodiment, the style of the stage can also be automatically adjusted according to the currently projected content, that is, after the projection content is rendered to other visual surfaces, it also includes:

[0144] Determine the corresponding target stage theme according to the attribute parameters of the target multimedia resource;

[0145] Updates the styles of other visual surfaces according to the target stage theme.

[0146] It should be noted that different delivery content may require different atmospheres. Therefore, after rendering the projected content to other visual surfaces, the attribute parameters of the target multimedia resources can also be obtained. The attribute parameters are used to indicate the attributes of the target multimedia resources, such as resource type, keywords, theme style, picture color (or main color), etc. Based on the pre-set parameters and theme correspondence table, the corresponding target stage theme can be determined, and then the style of other visual surfaces can be updated according to the determined target stage theme. The style may include other visual surface materials, shapes, background colors, etc.

[0147] In addition, in addition to updating the styles of other visual surfaces according to the attribute parameters of the target multimedia resource, the styles of other visual surfaces can also be updated based on the user interface keywords. Furthermore, in addition to updating other visual surfaces, the styles of the position, shape, etc. of the content delivery area can also be updated based on the target stage theme.

[0148] In the embodiments of this specification, the stage theme of the target virtual studio can be updated as the current content is changed, such as changing the theme color according to the current picture color, which enriches the interactive form, brings a better visual experience to users, and improves user stickiness.

[0149] In an optional implementation of this embodiment, the target virtual studio may further include virtual lighting, and after the target multimedia resource is placed in the content placement area, the following steps may be further included:

[0150] Determine audio information of target multimedia resource;

[0151] Determine the current lighting effect according to the audio information;

[0152] Control virtual lights based on lighting effects.

[0153] It should be noted that in addition to processing the virtual stage, the target virtual studio can often also set up virtual lighting to increase the stage atmosphere for stage effects.

[0154] In actual implementation, the audio information of the target multimedia resource to be delivered can be determined, and the current lighting effect can be determined based on the audio information to control the virtual lighting. The audio information can be the current volume, rhythm, audio waveform and other attribute information of the target multimedia resource. The virtual lighting can be controlled based on the volume, rhythm and other attribute information. For example, when the volume increases, the lighting brightness is controlled to increase, and the lighting changes color according to the audio rhythm. In other words, the display brightness of the virtual stage can be controlled based on the audio information, and the audio information can affect the lighting mask effect of the virtual stage.

[0155] In addition, a corresponding visualization waveform may be generated according to the audio information of the target multimedia resource, and the visualization waveform may be used as the target multimedia resource and delivered to the content delivery area or other visual surfaces outside the content delivery area.

[0156] In the embodiments of this specification, virtual lights can be controlled according to the audio information of the target multimedia resource to achieve dynamic lighting, that is, the lighting effect changes dynamically with the audio information, so that the audio information of the target multimedia resource (such as sound waveform and rhythm) can be projected onto the dynamic changes of the virtual lights, further enhancing the visual effect and improving the audience's viewing experience.

[0157] In addition, you can also determine the target screen of the target multimedia resource currently being played, sample the color blocks of the target screen, and generate a lighting effect with the corresponding atmosphere color. The color comes from the screen of the target multimedia resource, and the light rotation comes from the sound volume waveform. Furthermore, you can also specify the input line of the sound to create the auditory effect of the stage speaker. In this way, in addition to enriching the visual effect, you can also enrich the auditory effect, which greatly guarantees the user's viewing experience and improves user stickiness.

[0158] In an optional implementation of this embodiment, the method further includes:

[0159] Receiving an interactive request from an interactive user in a user interface of a second user, wherein the interactive request carries an interactive parameter, and the second user is any one of at least one user corresponding to the target virtual studio;

[0160] creating an interactive avatar of the interactive user in a target virtual studio;

[0161] Interaction parameters are displayed through interactive avatars.

[0162] Specifically, the second user can be the anchor, and the interactive user is any viewer in the live broadcast room corresponding to the anchor. The second user can also be a viewer, in which case the interactive user is a viewer in the same live broadcast room or in a different live broadcast room as the second user.

[0163] In actual implementation, each user corresponding to the target virtual studio, and when the user is the anchor, each audience in the live broadcast room can watch the screen of the target virtual studio and interact during the viewing process. In specific implementation, if the virtual broadcast application receives an interactive request initiated by an interactive user, an interactive virtual image of the interactive user can be created in the target virtual studio, such as a cartoon character, and the interactive parameters can be displayed through the interactive virtual image.

[0164] For example, assuming that the interactive user sends a barrage, a virtual character corresponding to the interactive user can be created in the target virtual studio, and the barrage information sent by the interactive user can be displayed above the head of the virtual character; assuming that the interactive user gives a gift to the second user, a virtual character corresponding to the interactive user can be created in the target virtual studio, and a dynamic animation of the gift moving from the virtual character to the virtual image of the second user can be displayed.

[0165] In specific implementation, after receiving the interaction request of the interactive user in the user interface of the second user, it is also possible to first determine whether a virtual image has been created for the interactive user in the target virtual studio. If it has been created, there is no need to create it again, and the interaction parameters are directly displayed based on the virtual image; if it has not been created, a virtual image is created for the interactive user.

[0166] A large number of virtual images may be preset in the virtual studio application, and a corresponding interactive virtual image may be randomly selected for the interactive user, or a corresponding interactive virtual image may be matched for the interactive user based on the attributes of the interactive user (such as age, gender, hobbies, etc.). The interactive virtual images of different users may be the same or different, and in order to distinguish different interactive users, the corresponding interactive user's identifier may be marked around the interactive virtual image.

[0167] It should be noted that in each user's user interface, each interactive user can transform into an interactive virtual image and enter the target virtual studio through interactive methods such as sending barrages and giving gifts, and act as a virtual audience under the stage, which enriches the form of interaction and enhances the audience's sense of participation.

[0168] In addition, the audience can also control the corresponding interactive virtual image to perform corresponding actions, such as jumping, malfunctioning, shouting, etc., by sending bullet comments, giving gifts, etc. The interactive users of each user in the same target virtual studio can be in the target virtual studio at the same time after their incarnations, so that the interactive users related to different users can interact in the same target virtual studio.

[0169] In an optional implementation of this embodiment, the interaction request may be a video-on-demand request, and the interaction parameters are displayed through the interactive virtual image, including:

[0170] Determine the request dwell time corresponding to the on-demand request;

[0171] displaying the on-demand request at a set position corresponding to the user avatar of the second user;

[0172] In response to a trigger instruction of the on-demand request, the on-demand content corresponding to the on-demand request is displayed.

[0173] Specifically, the on-demand request is used to request the second user to read the on-demand text content, or to request to play the on-demand multimedia resources in the content delivery area, where the on-demand text content can be text sent by the interactive user, an article, etc., and the on-demand multimedia resources can be a video clip, a picture, an audio clip, etc.

[0174] In one implementation, any interactive user can initiate the on-demand request; in another implementation, the on-demand request can be for advanced permissions, and only interactive users whose payment or membership level exceeds a level threshold can initiate the on-demand request.

[0175] In actual implementation, the duration of display of the on-demand request at the set position corresponding to the user avatar of the second user is different for different payment amounts and membership levels. The set position can be around the user avatar of the second user, such as the hand of the user avatar. After the second user responds to the on-demand request, the on-demand content identifier corresponding to the on-demand request can be identified, thereby obtaining the on-demand content for display. During the on-demand content display process, the second user can control the display progress at any time to ensure the smooth progress of the live broadcast.

[0176] It should be noted that interactive users who meet the conditions can initiate on-demand requests, parameterize the interactive process, and control the playback content of the target virtual studio, which increases user participation, enriches the interactive form, and improves the interactive effect.

[0177] In an optional implementation of this embodiment, the method further includes:

[0178] Creating a user virtual image of a third user in the target virtual studio, wherein the third user is any one of at least one user corresponding to the target virtual studio;

[0179] receiving an image control instruction from a third user, wherein the image control instruction carries an action to be performed;

[0180] Control the user's avatar to perform the action to be performed.

[0181] In actual implementation, each user corresponding to the target virtual studio can also issue a corresponding virtual image control instruction in the target virtual studio, and any user can initiate an image control instruction to control the corresponding user virtual image to perform the action to be performed. For example, if a user is an audience member under the stage, the user can initiate an image control instruction, and the image control instruction instructs the corresponding user virtual image to applaud, jump, and other actions.

[0182] In addition, if the user's virtual image is currently performing on the stage, the user can also control the movement of the user's virtual image on the stage by initiating image control instructions. During the movement, the lights on the stage floor can also be triggered to display the position where the light brightness increases.

[0183] It should be noted that any user in the target studio can control his or her own user virtual image to achieve interaction, enriching the interactive form and increasing the interactive experience.

[0184] Step 106: Synchronize the first picture to the display interface of each user corresponding to the target virtual studio.

[0185] It should be noted that the screen of the target virtual studio is synchronized to the user interface of each user corresponding to the target virtual studio, and each user can watch the target user's control over the target virtual studio, which enriches the interactive scene and improves the user's interactive experience.

[0186] In the live broadcast interactive method provided in the embodiment of the present application, the target virtual studio can correspond to at least one user, and the at least one user can interact in the target virtual studio, thereby enriching the interactive scenes between users; and, any user corresponding to the target virtual studio can control the target virtual studio, that is, when multiple users are in the same target virtual studio, any user can control the target virtual studio, and the control method of the target virtual studio is relatively flexible. Users can define virtual studios without barriers, meet different interactive needs, enrich interactive scenes, improve the effect of live broadcast interaction, and thus improve user stickiness.

[0187] Figure 3 This is a flow chart of another live interactive method provided by an embodiment of the present application, which is applied to a client and specifically includes the following steps:

[0188] Step 302: Receive and display the first picture of the target virtual studio synchronized by the server; wherein the target virtual studio corresponds to at least one user, the first picture of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

[0189] It should be noted that the client refers to the client used by the user, such as a mobile phone, tablet, TV, computer, etc. Any user can enter the target virtual studio through the client to interact with other users.

[0190] In actual implementation, the target virtual studio can correspond to at least one user, and any one of the at least one user can be used as the target user to obtain the control authority of the target virtual studio. The server can generate the first picture of the target virtual studio based on the studio content source configured by the target user, and synchronize the first picture to the client for display. In this way, each user can watch the target user's control over the target virtual studio, enriching the interactive scene and improving the user's interactive experience.

[0191] In an optional implementation of this embodiment, the first screen of the target virtual studio includes at least one of a virtual stage close-up screen, a delivery video screen, a live broadcast screen in the live broadcast room, and a preset material screen. Among them, the close-up screen refers to the screen corresponding to the close-up of the virtual stage of the target virtual studio; the delivery video screen refers to the screen of the video delivered by the target user, and the live broadcast screen in the live broadcast room refers to the live broadcast screen delivered by the target user. The delivery video screen and the live broadcast screen in the live broadcast room are both multimedia resources delivered by the target user; the preset material screen refers to the selected material pre-configured by the virtual studio application, and the selected material can be a video or a static picture.

[0192] In an optional implementation of this embodiment, before receiving and displaying the first picture of the target virtual studio synchronized by the server, the method further includes:

[0193] Receiving the studio content source configured by the target user for the target virtual studio;

[0194] Generate control instructions for the target virtual studio according to the studio content source, and send the control instructions to the server.

[0195] In actual implementation, the client can be the client of the target user, serving as the control terminal of the target virtual studio. The target user can configure the studio content source for the target virtual studio through the client he holds. At this time, the client can generate a control instruction for the target virtual studio based on the studio content source, and send the control instruction to the server. The server can control the display of the target virtual studio based on the control instruction. In this way, any user of the target virtual studio can control the content delivery of the target virtual studio, enriching the interactive scene.

[0196] In an optional implementation of this embodiment, before the target user controls the target virtual studio, the user may also join the target virtual studio, and before receiving and displaying the first picture of the target virtual studio synchronized by the server, the following may also be included:

[0197] Detecting a trigger instruction of the first user for a target virtual studio, wherein the trigger instruction is used to control the first user to enter the target virtual studio;

[0198] A second picture of the target virtual studio synchronized by the server is received and displayed, wherein the second picture of the target virtual studio is a picture generated when the first user enters the target virtual studio.

[0199] It should be noted that the client can be the client of the first user, and as a common participating terminal of the target virtual studio, enter the target virtual studio. During the live broadcast process, the first user can create a target virtual studio or join a target virtual studio created by other users, so that the second screen of the target virtual studio is displayed on the client of the first user, so that the first user can interact with other users in the target virtual studio.

[0200] In an optional implementation of this embodiment, the trigger instruction is a creation instruction; detecting the trigger instruction of the first user for the target virtual studio includes:

[0201] Receiving style parameters configured by a first user;

[0202] A trigger instruction is generated according to the style parameters, wherein the trigger instruction is used to instruct the server to create a target virtual studio, and the second picture of the target virtual studio is rendered according to the target studio style corresponding to the style parameters.

[0203] In the embodiments of the present specification, the first user can also create a target virtual studio in the virtual studio application. When creating the target virtual studio, the user can customize the required virtual scene type, style type and other style parameters, as well as other required information (such as the name of the virtual studio, etc.), thereby customizing the virtual studio with a low operating threshold and simple operation.

[0204] In an optional implementation of this embodiment, after detecting the trigger instruction of the first user for the target virtual studio, the method further includes:

[0205] Receiving a camera movement configuration operation of a first user for a target virtual studio;

[0206] A target camera movement mode indicated by the camera movement configuration operation is obtained, and the target camera movement mode is sent to a server, wherein the target camera movement mode is used to instruct the server to generate a second picture of the target virtual studio.

[0207] In the embodiments of the present specification, in addition to customizing the studio style, the first user can also customize the camera movement mode in the target virtual studio to generate a second picture of the target virtual studio. The custom-created target virtual studio has flexible configuration and easy operation.

[0208] In actual applications, in addition to being able to customize the camera movement mode and generate a second picture when the first user enters the target virtual studio, during the interaction based on the target virtual studio, each user corresponding to the target virtual studio can switch the current camera movement mode to change the viewing angle.

[0209] It should be noted that, in addition to the first user being able to customize the camera movement mode of the target virtual studio, each user corresponding to the target virtual studio can customize the switching of the camera movement mode of the target virtual studio. That is to say, the pictures of the target virtual studio seen by different users' user interfaces may be different, and are pictures observed from different perspectives. In addition, within the user interface of the same user, the user can also switch between different camera movement modes during the live broadcast process, and display the target virtual studio from different perspectives in the user interface. The user can customize and control the display perspective of the target virtual studio, making the picture of the target virtual studio rich and varied, enriching the interactive scene.

[0210] In an optional implementation of this embodiment, the target virtual studio includes a virtual stage, and the virtual stage includes a content delivery area; receiving a studio content source configured by a target user for the target virtual studio includes:

[0211] Receive the multimedia resource identifier configured by the target user, and use the multimedia resource identifier as the studio content source, wherein the multimedia resource identifier is used to indicate the target multimedia resource, and the target multimedia resource is used to be delivered to the content delivery area.

[0212] In the embodiment of this specification, the target user can configure a multimedia resource identifier as the studio content source to carry in the control instruction and send it to the server, so that the server can control the content played in the content delivery area based on the multimedia resource identifier. In this way, when multiple users are in the same virtual studio, any user can deliver multimedia resources to the content delivery area on the virtual stage of the virtual studio and control the content source of the virtual studio, that is, any user can control and change the content source of the virtual studio, enriching the interactive form and interactive scene.

[0213] In an optional implementation of this embodiment, the method further includes:

[0214] Receiving an interactive parameter configured by an interactive user in a user interface of a second user, wherein the second user is any one of at least one user corresponding to the target virtual studio;

[0215] An interactive request is generated according to the interactive parameters, and the interactive request is sent to the server, wherein the interactive request is used to instruct the server to create an interactive virtual image of the interactive user in the target virtual studio, and display the interactive parameters through the interactive virtual image.

[0216] It should be noted that each user corresponding to the target virtual studio, as well as each audience in the live broadcast room when the user is the anchor, can watch the screen of the target virtual studio and interact as an interactive user during the viewing process. In this way, each interactive user in the user interface of each user can enter the target virtual studio as an interactive virtual image through interactive methods such as sending bullet comments and giving gifts, and act as a virtual audience under the stage, which enriches the interactive form and improves the audience's sense of participation.

[0217] In addition, the audience can also control the corresponding interactive virtual image to perform corresponding actions, such as jumping, malfunctioning, shouting, etc., by sending bullet comments, giving gifts, etc. The interactive users of each user in the same target virtual studio can be in the target virtual studio at the same time after their incarnations, so that the interactive users related to different users can interact in the same target virtual studio.

[0218] In an optional implementation of this embodiment, the method further includes:

[0219] receiving an action to be executed configured by a third user, wherein the third user is any one of at least one user corresponding to the target virtual studio;

[0220] An image control instruction is generated according to the action to be executed, and the image control instruction is sent to the server, wherein the image control instruction is used to instruct the server to control the user's virtual image to execute the action to be executed, and the user's virtual image is the virtual image corresponding to the third user in the target virtual studio.

[0221] Each user corresponding to the target virtual studio can also issue a corresponding avatar control instruction in the target virtual studio. Any user can issue an image control instruction to control the corresponding user avatar to perform the action to be performed. For example, if a user is an audience member under the stage, the user can issue an image control instruction, which instructs the corresponding user avatar to applaud, jump, and other actions.

[0222] In addition, if the user's virtual image is currently performing on the stage, the user can also control the movement of the user's virtual image on the stage by initiating image control instructions. During the movement, the lights on the stage floor can also be triggered to display the position where the light brightness increases.

[0223] It should be noted that any user in the target studio can control his or her own user virtual image to achieve interaction, enriching the interactive form and increasing the interactive experience.

[0224] In an optional implementation of this embodiment, before receiving and displaying the first picture of the target virtual studio synchronized by the server, the method further includes:

[0225] Displaying a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component;

[0226] A trigger instruction of a target primary control component is received, and the target primary control component is displayed to include various secondary control components, wherein the target primary control component is any one of at least one primary control component, and the secondary control component is used to control the target virtual studio.

[0227] It should be noted that the client can display the control entrance at the set position of the target virtual studio, and then when the trigger instruction of the target first-level control component is detected, the target first-level control component including each second-level control component is displayed without server control. When the trigger of the second-level control component is detected, the corresponding control instruction will be generated, and the control instruction will be sent to the server at this time, so that the server controls the target virtual studio according to the control instruction. In this way, the display of the control entrance and the conversion of the first-level control component to the second-level control component can be controlled by the client, reducing the processing resources of the server.

[0228] Of course, in actual applications, when the user triggers the control entrance through the client, a trigger message can also be sent to the server, and the server controls the addition of a control entrance at the set position of the target virtual studio, and then feeds the picture back to the client for display. This application does not impose any restrictions on this.

[0229] In an optional implementation of this embodiment, the target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; a control entrance is displayed at a set position of the target virtual studio, including:

[0230] Detecting a current location of a user avatar of a target user;

[0231] When the current position is within the set range corresponding to the playback device, the control entrance is displayed.

[0232] It should be noted that the client can detect the current position of the target user's user avatar to determine whether to display the control entrance. Each user's client determines whether to display the control entrance by itself without the need for server control, thus saving server processing resources.

[0233] Of course, in actual applications, the client can also detect the current position of the target user's user virtual image and send it to the server. If the server determines that the current position is within the set range corresponding to the playback device, the client is controlled to display the control entrance. This application does not limit this.

[0234] In the live broadcast interactive method provided in the embodiment of the present application, the target virtual studio can correspond to at least one user, and the at least one user can interact in the target virtual studio, thereby enriching the interactive scenes between users; and, any user corresponding to the target virtual studio can control the target virtual studio, that is, when multiple users are in the same target virtual studio, any user can control the target virtual studio, and the control method of the target virtual studio is relatively flexible. Users can define virtual studios without barriers, meet different interactive needs, enrich interactive scenes, improve the effect of live broadcast interaction, and thus improve user stickiness.

[0235] The above is a schematic scheme of a live interactive method of this embodiment. It should be noted that the technical solution of the live interactive method is a client implementation solution, which is different from the above Figure 1 The technical solution of the live broadcast interactive method on the server side shown belongs to the same concept. For details not described in detail in the technical solution of the live broadcast interactive method on the client side, please refer to the description of the technical solution of the live broadcast interactive method on the server side mentioned above.

[0236] Figure 4 This is an overall processing flow chart of a live interactive method provided by an embodiment of the present application, which is applied to a server of a live broadcast platform and is described by taking the host end controlling a virtual studio as an example, and specifically includes the following steps:

[0237] Step 402: In response to the call request of the virtual studio application, a virtual studio selection interface is displayed.

[0238] The virtual studio selection interface includes at least one currently created virtual studio and a virtual studio creation component.

[0239] Step 404: when a virtual studio joining instruction initiated by the first anchor is detected, it is determined that a trigger instruction of a target virtual studio is received, and the target virtual studio is joined.

[0240] The target virtual studio is any virtual studio that has been created currently.

[0241] Step 406: When it is detected that the virtual studio creation component is triggered, it is determined that a trigger instruction of the target virtual studio is received, and the trigger instruction carries style parameters of the target virtual studio; the corresponding target studio style is obtained according to the style parameters, and the target virtual studio is rendered according to the target studio style.

[0242] Step 408: Determine the target camera movement mode of the first anchor in the target virtual studio, generate the image of the target virtual studio according to the target camera movement mode, and synchronize the image of the target virtual studio to the live broadcast room of the first anchor.

[0243] Among them, the first anchor is any one of the anchors corresponding to the target virtual studio.

[0244] Step 410: Determine the live broadcast interaction parameters of at least one anchor corresponding to the target virtual studio, and determine the target anchor from the at least one anchor according to the live broadcast interaction parameters.

[0245] Among them, the target anchor obtains the control authority of the target virtual studio.

[0246] Step 412: Display a control entrance at a set position of the target virtual studio, the control entrance including at least one primary control component; in response to a trigger instruction of the target primary control component, display the target primary control component including various secondary control components.

[0247] The target first-level control component is any one of at least one first-level control component, and the second-level control component is used to initiate a control instruction.

[0248] In an optional implementation of this embodiment, the target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; a control entrance is displayed at a set position of the virtual studio, including:

[0249] Detect the current position of the target anchor's avatar;

[0250] When the current position is within the set range corresponding to the playback device, the control entrance is displayed.

[0251] Step 414: Receive a control instruction from the target anchor, where the control instruction carries a multimedia resource identifier.

[0252] Step 416: Acquire the target multimedia resource corresponding to the multimedia resource identifier, and place the target multimedia resource into the content placement area.

[0253] Step 418: Determine the projection content of the multimedia content played in the content delivery area on other visual surfaces, and render the projection content to the other visual surfaces.

[0254] Step 420: Determine the corresponding target stage theme according to the attribute parameters of the target multimedia resource, and update the styles of other visual surfaces according to the target stage theme.

[0255] Step 422: Determine the audio information of the target multimedia resource, determine the current lighting effect according to the audio information, and control the virtual lighting according to the lighting effect.

[0256] Step 424: receiving an interactive request from a target audience in the live broadcast room of the second anchor, the interactive request carrying interactive parameters; creating a virtual image of the target audience in the target virtual studio; if the interactive request is an on-demand request, determining a request dwell time corresponding to the on-demand request; displaying the on-demand request at a set position corresponding to the virtual image of the second anchor; and displaying the on-demand content corresponding to the on-demand request in response to a trigger instruction of the on-demand request.

[0257] The second anchor is any one of the at least one anchor corresponding to the target virtual studio.

[0258] Step 426: Create a virtual image of the third anchor in the target virtual studio, receive an image control instruction of the third anchor, the image control instruction carries the action to be executed; and control the virtual image of the anchor to execute the action to be executed.

[0259] Among them, the third anchor is any one of the at least one anchor corresponding to the target virtual studio.

[0260] In the live broadcast interaction method provided in the embodiment of the present application, the target virtual studio can correspond to at least one anchor, and the at least one anchor can interact in the target virtual studio, enriching the interaction scenes between the anchors. The audience in the live broadcast room of each anchor can watch the screen of the target virtual studio and interact in the target virtual studio, which also enriches the viewing content and interaction form of the audience; and any anchor corresponding to the target virtual studio can control the target virtual studio, that is, when multiple anchors are in the same target virtual studio, any anchor can control the target virtual studio. The control method of the target virtual studio is relatively flexible. The anchor can define the virtual studio without any threshold, meet different interaction needs, enrich the interaction scenes, improve the effect of live broadcast interaction, and thus improve user stickiness.

[0261] Corresponding to the above method embodiment, the present application also provides a live interactive device embodiment, Figure 5 is a structural diagram of a live interactive device provided by an embodiment of the present application, which is applied to a server, such as Figure 5 As shown, the device comprises:

[0262] The first receiving module 502 is configured to receive a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content;

[0263] The first generating module 504 is configured to control the target virtual studio according to the studio content source and generate a first picture of the target virtual studio;

[0264] The first synchronization module 506 is configured to synchronize the first picture to the user interface of each user corresponding to the target virtual studio.

[0265] Optionally, the device further includes a second synchronization module configured to:

[0266] receiving a trigger instruction from a first user for a target virtual studio, and controlling the first user to enter the target virtual studio;

[0267] A second picture of the target virtual studio is generated, and the second picture is synchronized to the user interface of the first user.

[0268] Optionally, the second synchronization module is further configured to:

[0269] In response to a call request of a virtual studio application, a virtual studio selection interface is displayed, wherein the virtual studio selection interface includes at least one currently created virtual studio and a virtual studio creation component;

[0270] In the case of detecting a virtual studio joining instruction initiated by the first user, determining that a trigger instruction of a target virtual studio is received, and controlling the first user to join the target virtual studio, wherein the target virtual studio is any virtual studio currently created;

[0271] When it is detected that the virtual studio creation component is triggered, it is determined that a trigger instruction of the target virtual studio is received, a target virtual studio is created, and the first user is controlled to enter the created target virtual studio, wherein the target virtual studio is a virtual studio created by the first user.

[0272] Optionally, the target virtual studio is a virtual studio created by the first user, and the trigger instruction carries style parameters of the target virtual studio;

[0273] The second synchronization module is further configured to:

[0274] Obtain the corresponding target studio style according to the style parameters;

[0275] The target virtual studio is rendered according to the target studio style to generate a second picture of the target virtual studio.

[0276] Optionally, the second synchronization module is further configured to:

[0277] Determining a target camera movement mode of the first user in a target virtual studio;

[0278] According to the target camera movement mode, a second picture of the target virtual studio is generated.

[0279] Optionally, the device further includes a determination module configured to:

[0280] Determining an interaction parameter of at least one user corresponding to the target virtual studio;

[0281] A target user is determined from at least one user according to the interaction parameter, wherein the target user obtains control authority of the target virtual studio.

[0282] Optionally, the target virtual studio includes a virtual stage, the virtual stage includes a content delivery area, the control instruction is a delivery instruction, and the studio content source includes a multimedia resource identifier to be delivered;

[0283] The first generating module 504 is further configured to:

[0284] Obtaining a target multimedia resource corresponding to the multimedia resource identifier;

[0285] Deliver the target multimedia resources to the content delivery area.

[0286] Optionally, the virtual stage also includes other visual surfaces in addition to the content delivery area; the first generation module 504 is further configured to:

[0287] Determine the projection content of the multimedia content played in the content delivery area on other visual surfaces;

[0288] Render the projected content to other viewing surfaces.

[0289] Optionally, the first generating module 504 is further configured to:

[0290] Determine the corresponding target stage theme according to the attribute parameters of the target multimedia resource;

[0291] Updates the styles of other visual surfaces according to the target stage theme.

[0292] Optionally, the target virtual studio also includes virtual lighting; the first generating module 504 is further configured to:

[0293] Determine audio information of target multimedia resource;

[0294] Determine the current lighting effect according to the audio information;

[0295] Control virtual lights based on lighting effects.

[0296] Optionally, the device further includes a second display module configured to:

[0297] Receiving an interactive request from an interactive user in a user interface of a second user, wherein the interactive request carries an interactive parameter, and the second user is any one of at least one user corresponding to the target virtual studio;

[0298] creating an interactive avatar of the interactive user in a target virtual studio;

[0299] Interaction parameters are displayed through interactive avatars.

[0300] Optionally, the interactive request is a video-on-demand request; and the second display module is further configured to:

[0301] Determine the request dwell time corresponding to the on-demand request;

[0302] displaying the on-demand request at a set position corresponding to the user avatar of the second user;

[0303] In response to a trigger instruction of the on-demand request, the on-demand content corresponding to the on-demand request is displayed.

[0304] Optionally, the device further includes an execution module configured to:

[0305] Creating a user virtual image of a third user in the target virtual studio, wherein the third user is any one of at least one user corresponding to the target virtual studio;

[0306] receiving an image control instruction from a third user, wherein the image control instruction carries an action to be performed;

[0307] Control the user's avatar to perform the action to be performed.

[0308] Optionally, the device further comprises a control module configured to:

[0309] Setting a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component;

[0310] In response to a trigger instruction of a target primary control component, the target primary control component is controlled to include various secondary control components, wherein the target primary control component is any one of at least one primary control component, and the secondary control component is used to initiate a control instruction.

[0311] Optionally, the target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; the control module is configured to:

[0312] receiving a current location of a user avatar of a target user;

[0313] When the current position is within the set range corresponding to the playback device, a control entrance is added to the virtual room scene.

[0314] Optionally, the first picture of the target virtual studio includes at least one of a virtual stage close-up picture, a projection video picture, a live broadcast picture of the live broadcast room, and a preset material picture.

[0315] In the live interactive device provided in the embodiment of the present application, the target virtual studio can correspond to at least one user, and the at least one user can interact in the target virtual studio, enriching the interactive scenes between users; and, any user corresponding to the target virtual studio can control the target virtual studio, that is, when multiple users are in the same target virtual studio, any user can control the target virtual studio, and the control method of the target virtual studio is relatively flexible. Users can define virtual studios without barriers, meet different interactive needs, enrich interactive scenes, improve the effect of live interactive broadcast, and thus improve user stickiness.

[0316] The above is a schematic scheme of a live interactive device of this embodiment. It should be noted that the technical scheme of the live interactive device and the technical scheme of the live interactive method described above are of the same concept, and the details of the technical scheme of the live interactive device that are not described in detail can be found in the description of the technical scheme of the live interactive method described above.

[0317] Corresponding to the above method embodiment, the present application also provides a live interactive device embodiment, Figure 6 is a structural diagram of another live interactive device provided by an embodiment of the present application, which is applied to a client, such as Figure 6 As shown, the device comprises:

[0318] The first display module 602 is configured to receive and display a first picture of a target virtual studio synchronized by a server;

[0319] The target virtual studio corresponds to at least one user, the first screen of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

[0320] Optionally, the device includes a second generating module configured to:

[0321] Receiving the studio content source configured by the target user for the target virtual studio;

[0322] Generate control instructions for the target virtual studio according to the studio content source, and send the control instructions to the server.

[0323] Optionally, the device further includes a third display module configured to:

[0324] Detecting a trigger instruction of the first user for a target virtual studio, wherein the trigger instruction is used to control the first user to enter the target virtual studio;

[0325] A second picture of the target virtual studio synchronized by the server is received and displayed, wherein the second picture of the target virtual studio is a picture generated when the first user enters the target virtual studio.

[0326] Optionally, the trigger instruction is a creation instruction; the third display module is further configured to:

[0327] Receiving style parameters configured by a first user;

[0328] A trigger instruction is generated according to the style parameters, wherein the trigger instruction is used to instruct the server to create a target virtual studio, and the second picture of the target virtual studio is rendered according to the target studio style corresponding to the style parameters.

[0329] Optionally, the device further includes an acquisition module configured to:

[0330] Receiving a camera movement configuration operation of a first user for a target virtual studio;

[0331] A target camera movement mode indicated by the camera movement configuration operation is obtained, and the target camera movement mode is sent to a server, wherein the target camera movement mode is used to instruct the server to generate a second picture of the target virtual studio.

[0332] Optionally, the target virtual studio includes a virtual stage, and the virtual stage includes a content delivery area; the second generating module is further configured to:

[0333] Receive the multimedia resource identifier configured by the target user, and use the multimedia resource identifier as the studio content source, wherein the multimedia resource identifier is used to indicate the target multimedia resource, and the target multimedia resource is used to be delivered to the content delivery area.

[0334] Optionally, the first picture of the target virtual studio includes at least one of a virtual stage close-up picture, a projection video picture, a live broadcast picture of the live broadcast room, and a preset material picture.

[0335] Optionally, the device further includes a first sending module, configured to:

[0336] Receiving an interactive parameter configured by an interactive user in a user interface of a second user, wherein the second user is any one of at least one user corresponding to the target virtual studio;

[0337] An interactive request is generated according to the interactive parameters, and the interactive request is sent to the server, wherein the interactive request is used to instruct the server to create an interactive virtual image of the interactive user in the target virtual studio, and display the interactive parameters through the interactive virtual image.

[0338] Optionally, the device further includes a second sending module, configured to:

[0339] receiving an action to be executed configured by a third user, wherein the third user is any one of at least one user corresponding to the target virtual studio;

[0340] An image control instruction is generated according to the action to be executed, and the image control instruction is sent to the server, wherein the image control instruction is used to instruct the server to control the user's virtual image to execute the action to be executed, and the user's virtual image is the virtual image corresponding to the third user in the target virtual studio.

[0341] Optionally, the device further includes a fourth display module configured to:

[0342] Displaying a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component;

[0343] A trigger instruction of a target primary control component is received, and the target primary control component is displayed to include various secondary control components, wherein the target primary control component is any one of at least one primary control component, and the secondary control component is used to control the target virtual studio.

[0344] Optionally, the target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; the fourth display module is further configured as follows:

[0345] Detecting a current location of a user avatar of a target user;

[0346] When the current position is within the set range corresponding to the playback device, the control entrance is displayed.

[0347] In the live interactive device provided in the embodiment of the present application, the target virtual studio can correspond to at least one user, and the at least one user can interact in the target virtual studio, enriching the interactive scenes between users; and, any user corresponding to the target virtual studio can control the target virtual studio, that is, when multiple users are in the same target virtual studio, any user can control the target virtual studio, and the control method of the target virtual studio is relatively flexible. Users can define virtual studios without barriers, meet different interactive needs, enrich interactive scenes, improve the effect of live interactive broadcast, and thus improve user stickiness.

[0348] The above is a schematic scheme of a live interactive device of this embodiment. It should be noted that the technical scheme of the live interactive device and the technical scheme of the live interactive method described above are of the same concept, and the details of the technical scheme of the live interactive device that are not described in detail can be found in the description of the technical scheme of the live interactive method described above.

[0349] Figure 77 is a block diagram of a computing device provided in an embodiment of the present application. The components of the computing device 700 include but are not limited to a memory 710 and a processor 720. The processor 720 is connected to the memory 710 via a bus 730, and the database 750 is used to store data.

[0350] The computing device 700 also includes an access device 740 that enables the computing device 700 to communicate via one or more networks 760. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 740 may include one or more of any type of network interface (e.g., a network interface card (NIC)) whether wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a World Wide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, a near field communication (NFC) interface, and the like.

[0351] In one embodiment of the present application, the above components of the computing device 700 and Figure 7 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 7 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of the present application. Those skilled in the art may add or replace other components as needed.

[0352] The computing device 700 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or PC. The computing device 700 may also be a mobile or stationary server.

[0353] Among them, the processor 720 implements the steps of the above-mentioned live interactive method when executing computer instructions.

[0354] The above is a schematic scheme of a computing device of this embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the above live interactive method belong to the same concept, and the details of the technical scheme of the computing device that are not described in detail can be found in the description of the technical scheme of the above live interactive method.

[0355] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions, and when the computer instructions are executed by a processor, the steps of the live interactive method as described above are implemented.

[0356] The above is a schematic scheme of a computer-readable storage medium of this embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the live interactive method described above belong to the same concept, and the details not described in detail in the technical scheme of the storage medium can be found in the description of the technical scheme of the live interactive method described above.

[0357] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0358] Computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate form, etc. Computer readable media may include: any entity or device capable of carrying computer program codes, recording media, USB flash drives, mobile hard disks, magnetic disks, optical disks, computer memories, read-only memories (ROM), random access memories (RAM), electric carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the contents of computer readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media do not include electric carrier signals and telecommunication signals.

[0359] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0360] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0361] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The optional embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the present application. The present application selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present application, so that those skilled in the art can understand and use the present application well. The present application is only limited by the claims and their full scope and equivalents.

Claims

1. A live interactive method, characterized in that: Applied to a server, the method comprises: Receiving a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content; Control the target virtual studio according to the studio content source to generate a first picture of the target virtual studio; The first picture is synchronized to the display interface of each user corresponding to the target virtual studio.

2. The live interactive method according to claim 1, characterized in that: Before receiving the control instruction of the target user for the target virtual studio, the method further includes: receiving a trigger instruction from a first user for the target virtual studio, and controlling the first user to enter the target virtual studio; A second picture of the target virtual studio is generated, and the second picture is synchronized to the user interface of the first user.

3. The live interactive method according to claim 2, characterized in that: The receiving a trigger instruction from a first user for the target virtual studio and controlling the first user to enter the target virtual studio includes: In response to a call request of a virtual studio application, a virtual studio selection interface is displayed, wherein the virtual studio selection interface includes at least one currently created virtual studio and a virtual studio creation component; In the case of detecting a virtual studio joining instruction initiated by the first user, determining that a trigger instruction of the target virtual studio is received, and controlling the first user to join the target virtual studio, wherein the target virtual studio is any virtual studio currently created; When it is detected that the virtual studio creation component is triggered, it is determined that the trigger instruction of the target virtual studio is received, the target virtual studio is created, and the first user is controlled to enter the created target virtual studio, wherein the target virtual studio is a virtual studio created by the first user.

4. The live interactive method according to claim 3, characterized in that: The target virtual studio is a virtual studio created by the first user, and the trigger instruction carries style parameters of the target virtual studio; The generating of the second picture of the target virtual studio comprises: Acquire the corresponding target studio style according to the style parameters; The target virtual studio is rendered according to the target studio style to generate a second picture of the target virtual studio.

5. The live interactive method according to claim 2, characterized in that: The generating of the second picture of the target virtual studio comprises: Determine a target camera movement mode of the first user in the target virtual studio; A second picture of the target virtual studio is generated according to the target camera movement mode.

6. The live interactive method according to any one of claims 1 to 4, characterized in that: Before receiving the control instruction of the target user for the target virtual studio, the method further includes: Determining an interaction parameter of at least one user corresponding to the target virtual studio; The target user is determined from the at least one user according to the interaction parameter, wherein the target user obtains control authority of the target virtual studio.

7. The live interactive method according to any one of claims 1 to 4, characterized in that: The target virtual studio includes a virtual stage, the virtual stage includes a content delivery area, the control instruction is a delivery instruction, and the studio content source includes a multimedia resource identifier to be delivered; The controlling the target virtual studio according to the studio content source comprises: Acquire the target multimedia resource corresponding to the multimedia resource identifier; The target multimedia resource is delivered to the content delivery area.

8. The live interactive method according to claim 7, characterized in that: The virtual stage also includes other visual surfaces except the content delivery area; after delivering the target multimedia resource to the content delivery area, it also includes: Determine the projection content of the multimedia content played in the content delivery area on the other visual surface; The projected content is rendered to the other visual surface.

9. The live interactive method according to claim 8, characterized in that: After rendering the projection content to the other visual surface, the method further includes: Determining a corresponding target stage theme according to the attribute parameters of the target multimedia resource; The styles of the other visual surfaces are updated according to the target stage theme.

10. The live interactive method according to claim 7, characterized in that: The target virtual studio also includes virtual lighting; after the target multimedia resource is placed in the content placement area, the method further includes: Determining audio information of the target multimedia resource; Determine the current lighting effect according to the audio information; The virtual light is controlled according to the light effect.

11. The live interactive method according to any one of claims 1 to 4, characterized in that: The method further comprises: Receiving an interactive request from an interactive user in a user interface of a second user, wherein the interactive request carries an interactive parameter, and the second user is any one of at least one user corresponding to the target virtual studio; Creating an interactive virtual image of the interactive user in the target virtual studio; The interactive parameters are displayed through the interactive virtual image.

12. The live interactive method according to claim 11, characterized in that: The interactive request is a video-on-demand request; The displaying of the interactive parameter by the interactive virtual image includes: Determine a request dwell time corresponding to the on-demand request; Displaying the on-demand request at a set position corresponding to the user avatar of the second user; In response to a trigger instruction of the on-demand request, the on-demand content corresponding to the on-demand request is displayed.

13. The live interactive method according to any one of claims 1 to 4, characterized in that: The method further comprises: Creating a user avatar of a third user in the target virtual studio, wherein the third user is any one of at least one user corresponding to the target virtual studio; receiving an image control instruction from the third user, wherein the image control instruction carries an action to be executed; Control the user virtual image to execute the action to be executed.

14. The live interactive method according to any one of claims 1 to 4, characterized in that: Before receiving the control instruction of the target user for the target virtual studio, the method further includes: Setting a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component; In response to a trigger instruction of a target primary control component, the control displays that the target primary control component includes various secondary control components, wherein the target primary control component is any one of the at least one primary control component, and the secondary control component is used to initiate the control instruction.

15. The live interactive method according to claim 14, characterized in that: The target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; the control entrance is set at a set position of the target virtual studio, including: Receiving a current location of the user avatar of the target user; When the current position is within the set range corresponding to the playback device, the control entrance is added to the virtual room scene.

16. The live interactive method according to any one of claims 1 to 4, characterized in that: The first picture of the target virtual studio includes at least one of a virtual stage close-up picture, a projection video picture, a live broadcast picture of the live broadcast room, and a preset material picture.

17. A live interactive method, characterized in that: Applied to a server, the method comprises: Receive and display the first picture of the target virtual studio synchronized by the server; The target virtual studio corresponds to at least one user, the first screen of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

18. The live interactive method according to claim 17, characterized in that: Before receiving and displaying the first picture of the target virtual studio synchronized by the server, the method further includes: Receiving a studio content source configured by a target user for the target virtual studio; A control instruction for the target virtual studio is generated according to the studio content source, and the control instruction is sent to a server.

19. The live interactive method according to claim 17, characterized in that: Before receiving and displaying the first picture of the target virtual studio synchronized by the server, the method further includes: Detecting a trigger instruction of a first user for the target virtual studio, wherein the trigger instruction is used to control the first user to enter the target virtual studio; Receive and display a second picture of the target virtual studio synchronized by the server, wherein the second picture of the target virtual studio is a picture generated when the first user enters the target virtual studio.

20. The live interactive method according to claim 19, characterized in that: The trigger instruction is a creation instruction; The detecting a trigger instruction of the first user for the target virtual studio includes: receiving the style parameters configured by the first user; The trigger instruction is generated according to the style parameters, wherein the trigger instruction is used to instruct the server to create the target virtual studio, and the second screen of the target virtual studio is rendered according to the target studio style corresponding to the style parameters.

21. The live interactive method according to claim 19, characterized in that: After detecting the trigger instruction of the first user for the target virtual studio, the method further includes: receiving a camera movement configuration operation of the first user for the target virtual studio; A target camera movement mode indicated by the camera movement configuration operation is obtained, and the target camera movement mode is sent to the server, wherein the target camera movement mode is used to instruct the server to generate a second picture of the target virtual studio.

22. The live interactive method according to claim 18, characterized in that: The target virtual studio includes a virtual stage, and the virtual stage includes a content delivery area; The receiving source of the studio content configured by the target user for the target virtual studio includes: Receive the multimedia resource identifier configured by the target user, and use the multimedia resource identifier as the studio content source, wherein the multimedia resource identifier is used to indicate the target multimedia resource, and the target multimedia resource is used to be delivered to the content delivery area.

23. The live interactive method according to any one of claims 17 to 21, characterized in that: The first picture of the target virtual studio includes at least one of a virtual stage close-up picture, a projection video picture, a live broadcast picture of the live broadcast room, and a preset material picture.

24. The live interactive method according to any one of claims 17 to 21, characterized in that: The method further comprises: Receiving an interactive parameter configured by an interactive user in a user interface of a second user, wherein the second user is any one of at least one user corresponding to the target virtual studio; An interaction request is generated according to the interaction parameters, and the interaction request is sent to a server, wherein the interaction request is used to instruct the server to create an interactive virtual image of the interactive user in the target virtual studio, and display the interaction parameters through the interactive virtual image.

25. The live interactive method according to any one of claims 17 to 21, characterized in that: The method further comprises: receiving an action to be executed configured by a third user, wherein the third user is any one of at least one user corresponding to the target virtual studio; An image control instruction is generated according to the action to be executed, and the image control instruction is sent to a server, wherein the image control instruction is used to instruct the server to control the user virtual image to execute the action to be executed, and the user virtual image is the virtual image corresponding to the third user in the target virtual studio.

26. The live interactive method according to any one of claims 17 to 21, characterized in that: Before receiving and displaying the first picture of the target virtual studio synchronized by the server, the method further includes: Displaying a control entrance at a set position of the target virtual studio, wherein the control entrance includes at least one primary control component; Receive a trigger instruction of a target first-level control component, and display that the target first-level control component includes various second-level control components, wherein the target first-level control component is any one of the at least one first-level control component, and the second-level control component is used to control the target virtual studio.

27. The live interactive method according to claim 26, characterized in that: The target virtual studio is a virtual room scene, and the virtual room scene includes a playback device; the display control entrance at the set position of the target virtual studio includes: Detecting a current position of the user avatar of the target user; When the current position is within the set range corresponding to the playback device, the control entry is displayed.

28. A live interactive device, characterized in that: Applied to a server, the device comprises: A first receiving module is configured to receive a control instruction from a target user for a target virtual studio, wherein the target virtual studio corresponds to at least one user, the target user is any one of the at least one user, and the control instruction carries a source of studio content; A first generating module is configured to control the target virtual studio according to the studio content source and generate a first picture of the target virtual studio; The first synchronization module is configured to synchronize the first picture to the user interface of each user corresponding to the target virtual studio.

29. A live interactive device, characterized in that: Applied to a client, the device comprises: A first display module is configured to receive and display a first picture of a target virtual studio synchronized by a server; The target virtual studio corresponds to at least one user, the first screen of the target virtual studio is generated by the server according to the studio content source, the studio content source is configured for the target user, and the target user is any one of the at least one user.

30. A computing device, characterized in that It includes a memory, a processor, and computer instructions stored in the memory and executable on the processor, and is characterized in that when the processor executes the computer instructions, the steps of the live interactive method described in any one of claims 1-16 or 17-27 are implemented.

31. A computer-readable storage medium, characterized in that: It stores computer instructions, characterized in that when the computer instructions are executed by a processor, the steps of the live interactive method described in any one of claims 1-16 or 17-27 are implemented.