Interactive method and device in live broadcast, storage medium, and electronic device

Abstract

The present disclosure belongs to the field of video live broadcast technology, and relates to an interactive method and device, storage medium, and electronic device in live broadcast. The method includes: determining a target interactive element among multiple interactive elements through the audience end, and obtaining the interactive parameters of the audience end and the motion function corresponding to the target interactive element; driving the target interactive element to move according to the interactive parameters and the motion function, and displaying it on the audience end. The present disclosure provides a functional solution entry for a strong interactive connection between the anchor and the audience by providing multiple interactive elements in a virtual live broadcast scene. Furthermore, by driving the movement of the target interactive element through interactive parameters and motion functions, the audience's participation in the live broadcast process is deepened, the audience's live viewing experience is enhanced, and the multi-person viewing atmosphere in the live broadcast room is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of video live broadcasting, and in particular to an interactive method and interactive device in live broadcasting, a computer-readable storage medium, and an electronic device. Background Art

[0002] Game live broadcast interaction is an important scenario in live broadcast platforms. Users can watch the host's game operations in the live broadcast room, listen to the host's explanations, and participate in other interactive gameplay in the live broadcast room, such as lucky draws or live shopping.

[0003] However, in the current game live broadcasting scenario, the live broadcast content and live broadcasting methods and functions of the anchor are relatively separated. Usually, the anchor plays the game, and the user pays for gifts. There is a lack of strong interactive connection between the anchor and the user related to the live broadcast content, which makes the user's live broadcast viewing experience poor.

[0004] In view of this, there is an urgent need in the art to develop a new interactive method and device in live broadcasting.

[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0006] The purpose of the present disclosure is to provide an interactive method in live broadcast, an interactive device in live broadcast, a computer-readable storage medium and an electronic device, so as to at least overcome the technical problem of weak interactive connection between the anchor and the audience due to the limitations of related technologies to a certain extent.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0008] According to a first aspect of an embodiment of the present invention, a method for interaction in live broadcast is provided, wherein a plurality of interactive elements are provided in a virtual live broadcast scene, and the method comprises:

[0009] Determining a target interactive element from the plurality of interactive elements through the audience terminal, and acquiring the interactive parameters of the audience terminal and a motion function corresponding to the target interactive element;

[0010] The target interactive element is driven to move according to the interactive parameter and the motion function, and is displayed on the audience end.

[0011] In an exemplary embodiment of the present invention, determining the target interactive element from the multiple interactive elements by the audience terminal includes:

[0012] The identification information of the multiple interactive elements is obtained, and a target interactive element is determined among the multiple interactive elements through the audience terminal and the identification information.

[0013] In an exemplary embodiment of the present invention, the step of obtaining the interaction parameter of the audience terminal and the motion function corresponding to the target interactive element includes:

[0014] Acquire the operation position information and operation behavior information of the audience terminal, and determine the interaction parameters according to the operation position information;

[0015] A motion function corresponding to the target interactive element is determined according to the operation behavior information.

[0016] In an exemplary embodiment of the present invention, determining the interaction parameter according to the operation position information includes:

[0017] Acquire element position information of the target interactive element, and perform mapping conversion processing on the element position information to obtain conversion position information;

[0018] Performing operation validity judgment on the operation position information and the conversion position information to obtain an operation judgment result;

[0019] The operation summary processing is performed according to the operation judgment result to obtain the interaction parameter.

[0020] In an exemplary embodiment of the present invention, the step of performing operation aggregation processing according to the operation judgment result to obtain the interaction parameter includes:

[0021] If the target interactive element is the first interactive element, performing an operation summation process according to the operation judgment result and the identification information to obtain an interactive parameter;

[0022] If the target interactive element is the second interactive element, direction fitting processing is performed on the operation position information according to the operation judgment result to obtain interaction parameters.

[0023] In an exemplary embodiment of the present invention, determining the motion function corresponding to the target interactive element according to the operation behavior information includes:

[0024] Acquire a preset function corresponding to the identification information, and acquire a standard operating curve of the preset function;

[0025] An actual operation curve is generated according to the operation behavior information, and a curve fitting process is performed on the standard operation curve and the actual operation curve to obtain a motion function.

[0026] In an exemplary embodiment of the present invention, the method further comprises:

[0027] Obtaining a live broadcast mode identifier, and obtaining scene element information in a virtual live broadcast scene according to the live broadcast mode identifier;

[0028] Acquire live streaming data, and display a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information.

[0029] In an exemplary embodiment of the present invention, displaying a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information includes:

[0030] Performing space model recognition on the scene element information to obtain a model recognition result;

[0031] If the model recognition result is that the scene element information includes vacant space model information, the model position in the vacant space model information is determined, and a live screen corresponding to the live streaming data is displayed at the model position in the virtual live scene.

[0032] In an exemplary embodiment of the present invention, the method further comprises:

[0033] If the model recognition result is that the scene element information does not include vacant model information, the virtual live broadcast scene is grayed out.

[0034] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function includes:

[0035] Acquire an initial parameter corresponding to the interaction parameter, and perform a parameter difference calculation on the interaction parameter and the initial parameter to obtain a parameter difference value;

[0036] Acquire a difference threshold value corresponding to the parameter difference value, and compare the parameter difference value with the difference threshold value to obtain a comparison result;

[0037] Based on the comparison result, the target interactive element is driven to move according to the interaction parameter and the motion function.

[0038] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function based on the comparison result includes:

[0039] If the comparison result is that the parameter difference is greater than the difference threshold, obtaining a smoothing function corresponding to the parameter difference;

[0040] The target interactive element is driven to move according to the interactive parameter, the motion function and the smoothing function.

[0041] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter, the motion function and the smoothing function includes:

[0042] Acquire the field of view information of the live broadcast screen, and perform field of view matching on the element position information and the field of view information to obtain a field of view matching result;

[0043] If the field of view matching result is that the field of view range information includes the element position information, the target interactive element is driven to move according to the interaction parameter, the motion function and the smoothing function.

[0044] In an exemplary embodiment of the present invention, the method further comprises:

[0045] If the field of view matching result is that the field of view range information does not include the element position information, the target interactive element is kept stationary.

[0046] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function includes:

[0047] If there are multiple target interactive elements, the target interactive elements are driven to move in different directions according to the interactive parameters and the motion function.

[0048] In an exemplary embodiment of the present invention, the method further comprises:

[0049] If there are multiple target interactive elements, the virtual live broadcast scene is updated according to the target interactive elements.

[0050] According to a second aspect of an embodiment of the present invention, there is provided an interactive device in a live broadcast, which provides a plurality of interactive elements in a virtual live broadcast scene, including:

[0051] A data acquisition module is configured to determine a target interactive element from the plurality of interactive elements through the audience terminal, and acquire the interactive parameters of the audience terminal and a motion function corresponding to the target interactive element;

[0052] The element driving module is configured to drive the target interactive element to move according to the interactive parameter and the motion function, and display it on the audience end.

[0053] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor and a memory; wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the interactive method in live broadcast in any of the above exemplary embodiments is implemented.

[0054] According to a fourth aspect of an embodiment of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the interactive method in live broadcast in any of the above exemplary embodiments is implemented.

[0055] It can be seen from the above technical solutions that the interactive method in live broadcast, the interactive device in live broadcast, the computer storage medium and the electronic device in the exemplary embodiments of the present disclosure have at least the following advantages and positive effects:

[0056] In the method and device provided by the exemplary embodiments of the present disclosure, multiple interactive elements are provided in the virtual live broadcast scene, providing a functional solution entry for a strong interactive connection between the anchor and the audience. Furthermore, the target interactive element is driven to move through the interactive parameters and motion functions, which deepens the audience's participation in the live broadcast process, enhances the audience's live broadcast viewing experience, and improves the multi-person viewing atmosphere in the live broadcast room.

[0057] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0059] Figure 1 A schematic diagram schematically illustrates a flow chart of an interactive method in a live broadcast in an exemplary embodiment of the present disclosure;

[0060] Figure 2 A schematic diagram schematically shows a flow chart of a method for displaying a live broadcast picture in a virtual live broadcast scene in an exemplary embodiment of the present disclosure;

[0061] Figure 3 A schematic diagram schematically shows a flow chart of a method for further displaying a live broadcast picture in a virtual live broadcast scene in an exemplary embodiment of the present disclosure;

[0062] Figure 4 A schematic diagram schematically shows a flow chart of a method for obtaining interaction parameters and motion functions in an exemplary embodiment of the present disclosure;

[0063] Figure 5 A schematic diagram schematically shows a flow chart of a method for obtaining interaction parameters in an exemplary embodiment of the present disclosure;

[0064] Figure 6A schematic diagram schematically shows a flow chart of a method for further acquiring interaction parameters in an exemplary embodiment of the present disclosure;

[0065] Figure 7 A schematic diagram of a flow chart of a method for obtaining a motion function in an exemplary embodiment of the present disclosure is schematically shown;

[0066] Figure 8 A schematic diagram schematically shows a flow chart of a method for driving a target interactive element to move in an exemplary embodiment of the present disclosure;

[0067] Fig. 9 A schematic diagram schematically shows a flow chart of a method for further driving the movement of a target interactive element in an exemplary embodiment of the present disclosure;

[0068] Fig.10 A schematic diagram of a process of driving a target interactive element to move according to an interactive parameter, a motion function and a smoothing function in an exemplary embodiment of the present disclosure is schematically shown;

[0069] Fig.11 A schematic diagram of the structure of an interactive device in a live broadcast in an exemplary embodiment of the present disclosure is shown;

[0070] Fig.12 An electronic device for implementing an interactive method in a live broadcast in an exemplary embodiment of the present disclosure is schematically shown;

[0071] Fig.13 A computer-readable storage medium for implementing an interactive method in a live broadcast in an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0072] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0073] The terms "a", "an", "the" and "said" are used in this specification to indicate the presence of one or more elements / components / etc.; the terms "including" and "having" are used to express an open-ended inclusion and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first" and "second" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0074] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings represent the same or similar parts, and their repeated descriptions will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities.

[0075] Game live broadcast interaction is an important scenario in live broadcast platforms. Users can watch the host's game operations in the live broadcast room, listen to the host's explanations, and participate in other interactive gameplay in the live broadcast room, such as lucky draws or live shopping.

[0076] However, in the current game live broadcasting scenario, the live broadcast content and live broadcasting methods and functions of the anchor are relatively separated. Usually, the anchor plays the game, and the user pays for gifts. There is a lack of strong interactive connection between the anchor and the user related to the live broadcast content, which makes the user's live broadcast viewing experience poor.

[0077] In view of the problems existing in the related art, the present disclosure proposes an interactive method in live broadcast, which provides multiple interactive elements in a virtual live broadcast scene. Figure 1 A flowchart of the interactive method in live broadcast is shown. Figure 1 As shown, the interactive method in live broadcasting includes at least the following steps:

[0078] Step S110: Determine a target interactive element from among multiple interactive elements through the audience end, and obtain the interactive parameters of the audience end and the motion function corresponding to the target interactive element.

[0079] Step S120: Drive the target interactive element to move according to the interactive parameters and the motion function, and display it on the audience side.

[0080] In the exemplary embodiment of the present disclosure, multiple interactive elements are provided in the virtual live broadcast scene, providing a functional solution entry for the strong interactive connection between the anchor and the audience. Furthermore, the target interactive element is driven to move through the interactive parameters and motion functions, which deepens the audience's participation in the live broadcast process, enhances the audience's live broadcast viewing experience, and improves the multi-person viewing atmosphere in the live broadcast room.

[0081] The following is a detailed description of each step of the interactive method in live broadcast.

[0082] In step S110, a target interactive element is determined among a plurality of interactive elements by the audience end, and the interactive parameters of the audience end and the motion function corresponding to the target interactive element are obtained.

[0083] In an exemplary embodiment of the present disclosure, the anchor terminal completes the virtual broadcast through the existing virtual broadcast function of the live broadcast software and is in the virtual broadcast state.

[0084] Specifically, the UE (Unreal Engine) instance runs on the host's PC (Personal Computer) broadcast terminal. The host selects a virtual scene through the UE instance, which is rendered by the engine of the UE instance. In addition, the host sits in front of a green screen, collects the host's video through a video acquisition device such as a camera, and performs cutout processing on the collected host video to obtain the host's portrait, so as to display the host's portrait in continuous frames in the constructed virtual scene. In addition, the host can also set other parameters such as beauty and makeup to complete the virtual broadcast.

[0085] The advantage of virtual live broadcast is that the scenes are changeable, and the elements within the virtual live broadcast are theoretically interactive.

[0086] Among them, the UE instance is a game development engine launched by the American company Epic Games. It has powerful rendering effects and uses a physical material system. It is widely used in technical fields such as game design, interior design, and virtual reality.

[0087] Compared with other engines, Unreal Engine has fully reached the level of 3A games, especially the powerful lighting and physical rendering effects. In addition, the UE blueprint system also allows game planners to edit code, and a variety of official plug-ins are complete, so developers no longer need to compile third-party plug-ins and worry about compatible interfaces. More importantly, for virtual reality games, UE instances also provide good support for handles and VR (Virtual Reality) controllers. Therefore, UE instances are not only efficient and versatile, but also can directly preview development effects, giving developers stronger capabilities.

[0088] Correspondingly, the audience can enter the live broadcast room of the anchor who is virtually broadcasting, and watch the live broadcast images and use the functions in the live broadcast room.

[0089] After the anchor completes the virtual broadcast, the current live game screen can be embedded in the specified position of the virtual live scene. Therefore, when the anchor starts the broadcast, he needs to select a virtual live scene where the live screen can be embedded.

[0090] In an alternative embodiment, Figure 2A flow chart of a method for displaying a live broadcast picture in a virtual live broadcast scene is shown. Figure 2 As shown, the method includes at least the following steps: in step S210, a live broadcast mode identifier is obtained, and scene element information in a virtual live broadcast scene is obtained according to the live broadcast mode identifier.

[0091] When the anchor selects the game live broadcast mode, the instruction of the live broadcast mode identification corresponding to the game live broadcast mode can be sent to the anchor end UE instance.

[0092] After receiving the instruction corresponding to the live broadcast mode identifier, the host UE instance can traverse all scenes in the current game live broadcast mode to read the scene element information in the virtual live broadcast scene. The scene element information is the three-dimensional model information of the elements in the selected virtual live broadcast scene.

[0093] In step S220, the live streaming data is obtained, and the live screen corresponding to the live streaming data is displayed in the virtual live scene according to the scene element information.

[0094] Push streaming refers to the process of transmitting the packaged content in the acquisition stage to the server. In fact, it is the process of transmitting the live video signal to the network. Therefore, the live streaming data is the packaged current game data of the anchor.

[0095] In an alternative embodiment, Figure 3 A schematic diagram of a method for further displaying a live broadcast picture in a virtual live broadcast scene is shown. Figure 3 As shown, the method at least includes the following steps: In step S310, empty space model recognition is performed on scene element information to obtain a model recognition result.

[0096] Since the vacancy model of the preset live broadcast screen has a corresponding identifier, that is, the vacancy model information, the model recognition result can be obtained by judging whether the identifier of the vacancy model is included in the scene element information.

[0097] In step S320, if the model recognition result is that the scene element information includes vacant space model information, the model position in the vacant space model information is determined, and a live screen corresponding to the live streaming data is displayed at the model position of the virtual live scene.

[0098] When the model recognition result is that the scene element includes vacant space model information, that is, an identifier of the vacant space model, it can be determined that a live broadcast screen can be preset in the virtual live broadcast scene.

[0099] Furthermore, since the vacancy model information also includes the position to be preset when presetting the live broadcast screen, that is, the model position, the live broadcast screen corresponding to the live broadcast streaming data can be displayed in the virtual live broadcast scene according to the model position in the vacancy model information.

[0100] Specifically, the host UE instance can filter the elements in the virtual live scene according to the vacancy model information to determine the vacancy model, and obtain the three-dimensional coordinate data of the four vertices of the vacancy model. In addition, the live streaming data is placed on the plane formed by the four vertices of the vacancy model to complete the combination of the virtual live scene and the live screen of the game, thereby completing the virtual broadcast process.

[0101] In addition, the virtual live broadcast scene can also be grayed out according to the model recognition results.

[0102] In an optional embodiment, if the model recognition result is that the scene element information does not include vacant position model information, the virtual live broadcast scene is grayed out.

[0103] When the model recognition result is that the scene element does not include vacant model information, that is, the identifier of the vacant model, it indicates that the live screen cannot be preset in the virtual live scene, so the UE instance on the anchor side can return unavailable information to the anchor end.

[0104] After receiving the unavailable information, the host end grays out the unavailable virtual live broadcast scene to prompt the host that the virtual live broadcast scene cannot be selected.

[0105] In this exemplary embodiment, virtual live scenes that can preset live screens are filtered through scene element information. The filtering method is simple and accurate, and the display form of the live screen is enriched, bringing a better viewing experience to the audience.

[0106] In addition, the anchor can also perform a pre-broadcast detection on the live screen to determine the current game process, and determine whether the live screen contains interfaces for interactive elements for subsequent interactions and a map vision system that is easy to control, etc., to support the subsequent movement of corresponding target interactive elements driven by interactive parameters and motion functions.

[0107] After completing the virtual broadcast, the host UE instance sends the live broadcast image after the broadcast to the client of each viewer currently in the live broadcast room through the live broadcast platform server.

[0108] Therefore, the live broadcast screen of the current live game includes a virtual live broadcast scene, an embedded live broadcast screen, a virtual image / real image character of the host and multiple interactive elements.

[0109] Among them, the virtual live broadcast scene is the underlying picture and the basis for the entire virtual live broadcast construction. It can include skybox, basic terrain, lighting and other information.

[0110] The embedded live screen is used to present the game screen. It is usually a given reserved position in the virtual live scene. Figure 2 The determination process shown is then embedded in the virtual live broadcast scene.

[0111] The anchor virtual image / real image character is an optional display item, which is used to display the current anchor's character image or operation action, etc. Generally, the anchor virtual image / real image character can be displayed on the left or right side of the embedded live broadcast screen, or can be displayed in other positions, which is not particularly limited in this exemplary embodiment.

[0112] The interactive element is an element that can be used for subsequent process interaction. Therefore, the interactive element can be a model prop associated with the virtual live scene, such as a team flag flying in the virtual live scene, or a preset model prop or operation control specifically used to carry the current live game, such as an interactive control for switching the battle perspective of each anchor or a circular or other arbitrarily shaped player seat, etc. This exemplary embodiment does not make special restrictions on this.

[0113] The host-side UE instance can obtain element data of multiple interactive elements in the virtual live broadcast scene, which may include element position information, model information or material information of the interactive elements, etc. This exemplary embodiment does not specifically limit this.

[0114] After identifying multiple interactive elements, the host-side UE instance can send the element ID (Identity Document) to the game client and server.

[0115] After receiving the element ID, the game client and the game server can obtain the corresponding element data in the game according to the element ID, such as the element position information, model information or material information of the interactive element.

[0116] In an optional embodiment, identification information of multiple interactive elements is obtained, and a target interactive element is determined among the multiple interactive elements through the audience terminal and the identification information.

[0117] When the audience is watching the live broadcast in the live broadcast room of the virtual live broadcast of the game, the audience can determine the target interactive element among the interactive elements in the video stream area of ​​the client of the audience through trigger operations such as click operations.

[0118] For example, when the viewer clicks on the team flag in the video area through a clicking operation, the battle flag is determined to be the target interactive element; when the viewer drags the interactive control such as the control wheel for switching the host's battle perspective through a sliding operation, the control wheel for switching the host's battle perspective is determined to be the target interactive element.

[0119] This identification information is the element ID.

[0120] Specifically, the click or drag position of the viewer is obtained, and the identification information of the currently active interactive element is determined based on the click or drag position and the element ID. Further, the identification information of the currently active interactive element is matched with the identification information of all interactive elements, so as to determine that the interactive element corresponding to the identification information of the currently active interactive element is the target interactive element based on the matching result.

[0121] After the target interactive element is determined, the motion function corresponding to the target interactive element and the interactive parameters of the audience end may be obtained.

[0122] In an alternative embodiment, Figure 4 A flow chart of a method for obtaining interaction parameters and motion functions is shown, such as Figure 4 As shown, the method includes at least the following steps: In step S410, the operation position information and operation behavior information of the audience end are obtained, and the interaction parameters are determined according to the operation position information.

[0123] The operation position information may be position information of a triggering operation such as a click operation or a slide operation performed by the viewer in the video stream area of ​​the client.

[0124] For example, when the audience determines that the team flag in the video area is the target interactive element through a click operation, the coordinate point of the click operation is the operation position information; when the audience determines that the interactive control such as the control panel for dragging to switch the host's battle perspective is the target interactive element through a sliding operation, the coordinate point of the dragging operation is the operation position information.

[0125] The operation behavior information may include the frequency of viewers' operations on the team flag and the number of viewers who performed the operations within the same time period, or the operation direction of interactive controls such as a control panel for switching the host's battle perspective. It may also include other information, which is not specifically limited in this exemplary embodiment.

[0126] The client of the audience end of the live broadcast platform can send the operation position information and the operation behavior information to the server end of the live broadcast platform, so that the server end of the live broadcast platform determines the interaction parameters and the motion function after receiving the operation position information and the operation behavior information.

[0127] In an alternative embodiment, Figure 5 A flow chart of a method for obtaining interactive parameters is shown, such as Figure 5 As shown, the method at least includes the following steps: In step S510, the element position information of the target interactive element is obtained, and the element position information is mapped and converted to obtain conversion position information.

[0128] After determining the target interactive element, the host-side UE instance can also obtain the coordinates of the target interactive element in the three-dimensional virtual live broadcast scene, that is, the element position information.

[0129] Furthermore, the coordinates of the element position information in the three-dimensional scene are mapped to the two-dimensional plane to obtain the converted position information.

[0130] For example, assuming that the coordinates of the element position information in the three-dimensional scene are A(x′, y′, z′), the converted position information in the two-dimensional plane is A′(x, y).

[0131] x=x′+x′*cosβ-y′*sinα(α,β∈(0,,90°))

[0132] z=z′+x′*sinβ-y′*cosα(α,β∈(0,90°))

[0133] In addition, there may be other methods for converting element position information from coordinates in a three-dimensional scene to conversion position information in a two-dimensional plane, which is not particularly limited in this exemplary embodiment.

[0134] In step S520, an operation validity judgment is performed on the operation position information and the conversion position information to obtain an operation judgment result.

[0135] After the conversion position information is obtained, it is possible to calculate whether the viewer's operation position information falls within the area represented by the conversion position information to obtain an operation judgment result.

[0136] In step S530, operation summary processing is performed according to the operation judgment result to obtain interaction parameters.

[0137] In an alternative embodiment, Figure 6 A flow chart of a method for further obtaining interaction parameters is shown, such as Figure 6 As shown, the method includes at least the following steps: In step S610, if the target interactive element is the first interactive element, the operation is summed up according to the operation judgment result and the identification information to obtain the interactive parameter.

[0138] When the operation determination result is that the operation position information of the viewer falls within the area represented by the conversion position information, it is determined that the click operation or slide operation of the viewer is valid.

[0139] Therefore, when the target interactive element is the first interactive element, the operation and summation process may be performed according to the identification information.

[0140] Among them, the first interactive element can be a team flag.

[0141] After obtaining valid operation instructions, for the interactive case of the team flag fluttering, the live broadcast platform server can distinguish different team flags to correspond to different teams. In addition, the valid operation instructions for clicking on the same team flag within a unit time threshold, such as within 1 second, are merged to obtain the interactive parameters of the first interactive element of the same team flag. For example, the interactive parameters can be in the form of (flag A, 100), etc., which is not specifically limited in this exemplary embodiment.

[0142] In step S620, if the target interactive element is the second interactive element, direction fitting processing is performed on the operation position information according to the operation judgment result to obtain interactive parameters.

[0143] When the operation determination result is that the operation position information of the viewer falls within the area represented by the conversion position information, it is determined that the click operation or slide operation of the viewer is valid.

[0144] Among them, the second interactive element can be an interactive control such as a control panel for switching the host's combat perspective.

[0145] After obtaining valid operation instructions, for the interactive case of controlling the viewing angle, the live broadcast platform server can perform correlation fitting processing on the operation position information in the operation direction.

[0146] Specifically, when the viewer's operation position information includes (1, 2), and 100 viewers perform operations on the operation position information, 100 is used as the weight of the operation position information (1, 2) to perform weighted calculation to obtain (100, 200).

[0147] In addition, the audience's operation position information also includes (-2, -1), and 100 audiences also operate on the operation position information. Therefore, 100 is used as the weight of the operation position information (-2, -1) for weighted calculation to obtain (-200, -100).

[0148] Furthermore, the weighted calculations of (100, 200) and (-200, -100) are summed to obtain (-100, 100), so the direction represented by the position information is 45° in the upper left direction, that is, (upper left, 45° angle).

[0149] In order to simplify the moving distance of (upper left, 45° angle), a unit moving distance d can be set, and the unit moving distance can be set to 100, so the final interaction parameter is (upper left, 1d). The unit moving distance can also be set to other values ​​according to actual needs, and this exemplary embodiment does not make any special limitation on this.

[0150] It is worth noting that, in order to perform directional fitting processing on the operation position information, eight major directions can be set to obtain the final interaction parameters, such as (upper left, 80d), etc., and this exemplary embodiment does not make any special limitation to this.

[0151] In this exemplary embodiment, through effective operation judgment and operation aggregation processing, the operation position information of multiple audience terminals in the same live broadcast room can be merged to obtain interaction parameters, thereby ensuring the effectiveness of the interaction method and the accuracy of driving the movement of the target interactive elements.

[0152] In step S420, a motion function corresponding to the target interactive element is determined according to the operation behavior information.

[0153] In an alternative embodiment, Figure 7 A schematic diagram of a method for obtaining a motion function is shown in FIG. Figure 7 As shown, the method includes at least the following steps: In step S710, a preset function corresponding to the identification information is obtained, and a standard operating curve of the preset function is obtained.

[0154] The preset function may be a preset interactive form for interactive elements represented by different identification information.

[0155] Specifically, when the interactive element is a team flag, the team flag can create a strong wind blowing effect according to the frequency of the audience's click operation. In addition, the more viewers participate in the interaction of the same team flag or the higher the frequency of the audience's click, the greater the movement of the team flag.

[0156] Assume that the preset function of the team flag movement is f(x)=K*f(y)+D. Among them, f(y) is the final data output by the interactive behavior of the audience, that is, the operation position information and operation behavior information. Therefore, the mapping relationship that needs to be established on the game server side is the function represented by this formula.

[0157] A certain parameter is obtained through the input of the audience end, and the interaction result of the interactive element is obtained according to the output parameter.

[0158] For the interactive case of the team flag fluttering, the f(x) value of the preset function will be limited to limit the movement range of the team flag or the movement acceleration to not exceed the preset limit value. Otherwise, the team flag will be inserted into the flagpole, etc.

[0159] When the interactive element is an interactive case of changing the game perspective, the established preset function f(x) will also be limited. Since the game map cannot be infinitely large, the mapping range of f(x) is the upper and lower limits of the coordinates of the game map.

[0160] After completing the construction of the preset function, the game server will send the constructed mapped preset function to the host UE instance for use in subsequent processes.

[0161] After receiving the preset function, the host-side UE instance can construct the input and output parameters of the function f(x) according to the acquired element data of the multiple interactive elements.

[0162] Get the upper and lower thresholds of the preset function f(x), and simulate the input and output values ​​to obtain the corresponding standard operating curve.

[0163] In step S720, an actual operation curve is generated according to the operation behavior information, and a curve fitting process is performed on the standard operation curve and the actual operation curve to obtain a motion function.

[0164] The interactive instructions of the audience end that trigger the current in-game interaction are obtained, where the interactive instructions include clicks or slides, etc., to generate an actual operation curve according to the user's operation behavior information.

[0165] When the interactive instruction of the audience is triggered by a click operation, the actual operation curve is a discrete broken line curve.

[0166] Furthermore, a quadratic curve fitting is performed based on the standard operation curve and the actual operation curve. When the click operation is a nonlinear operation, the input is a discrete point for fitting, that is, the actual operation curve in the broken line style and the continuous and smooth standard operation curve are fitted.

[0167] When the sliding operation is a continuous linear operation, correlation fitting may be performed between two continuous and smooth standard operation curves and the actual operation curve.

[0168] Finally, a target curve can be obtained by fitting the standard operating curve and the actual operating curve, and a function characterizing the target curve is determined as a motion function.

[0169] Therefore, the fitted new f(x) is output as the motion function of the interactive elements in the virtual live broadcast scene on the UE side for use in subsequent processes.

[0170] It is worth noting that this motion function only illustrates the processing methods in two specific interaction cases. In actual applications, each interactive element will be classified and customized, and the mapping function will also be different to ensure the effect of implementation.

[0171] In this exemplary embodiment, the motion function of the interactive element is obtained by performing curve fitting processing on the standard operation curve and the actual operation curve, which provides theoretical support for driving the target interactive element to move and ensures the motion effect of the target interactive element.

[0172] In step S120, the target interactive element is driven to move according to the interactive parameter and the motion function, and is displayed on the audience side.

[0173] In an exemplary embodiment of the present disclosure, after completing the association mapping between the interactive elements in the virtual live broadcast scene and the game logic in the game process or the interactive elements in the game, the next process can be entered.

[0174] After obtaining the interaction parameters, the live broadcast platform server can send the obtained interaction parameters to the anchor UE instance.

[0175] After receiving the interaction parameters, the live broadcast end UE instance can determine the target interaction element by matching the first example of the interaction parameters, such as Zhanqi A, with the existing interaction elements in the virtual live broadcast scene.

[0176] According to the second column of the interactive parameters and the motion function f(x), the corresponding parameters are grouped and input to obtain the output value f(x), which is the final position to which the current battle flag and perspective need to move.

[0177] Furthermore, the target interactive element can be driven to move according to the motion function and the interaction parameters.

[0178] In an alternative embodiment, Figure 8 A flow chart of a method for driving a target interactive element to move is shown, such as Figure 8 As shown, the method includes at least the following steps: in step S810, initial parameters corresponding to the interaction parameters are obtained, and parameter difference calculation is performed on the interaction parameters and the initial parameters to obtain parameter difference values.

[0179] The initial parameter may be the position information of the previous live broadcast picture frame, or may be other parameters, and this exemplary embodiment does not specifically limit this.

[0180] At this time, the interactive parameter can be obtained by grouping and inputting the corresponding parameters according to the second column of the interactive parameter and the motion function f(x) to obtain the output value f(x).

[0181] After the initial parameters are obtained, the initial parameters and the interactive parameters can be subjected to parameter difference processing. Specifically, the interactive parameters and the initial parameters can be subjected to difference calculation to obtain the required local variation, that is, the parameter difference.

[0182] In step S820, a difference threshold corresponding to the parameter difference is obtained, and the parameter difference is compared with the difference threshold to obtain a comparison result.

[0183] After the parameter difference is calculated, a difference threshold corresponding to the parameter difference may be obtained. The difference threshold may be a value used to limit the amount of change this time.

[0184] Therefore, the parameter difference and the difference threshold may be compared to obtain a comparison result.

[0185] In step S830 , based on the comparison result, the target interactive element is driven to move according to the interactive parameter and the motion function.

[0186] In an alternative embodiment, Fig. 9 A flow chart of a method for further driving the target interactive element to move is shown, such as Fig. 9 As shown, the method at least includes the following steps: In step S910, if the comparison result is that the parameter difference is greater than the difference threshold, a smoothing function corresponding to the parameter difference is obtained.

[0187] When the comparison result is that the parameter difference is greater than the difference threshold, it indicates that the change this time exceeds a constant value, so a smooth transition effect needs to be added.

[0188] Based on this, a smoothing function corresponding to the parameter difference may be obtained, and the smoothing function may be another function different from the motion function.

[0189] In step S920 , the target interactive element is driven to move according to the interactive parameter, the motion function and the smoothing function.

[0190] In an alternative embodiment, Fig.10 A flow chart of a method for driving the target interactive element to move according to the interactive parameter, the motion function and the smoothing function is shown, as shown in FIG. Fig.10 As shown, the method includes at least the following steps: in step S1010, the field of view information of the live broadcast screen is obtained, and the field of view matching is performed on the element position information and the field of view information to obtain a field of view matching result.

[0191] After receiving the identification information of the target interactive element, the motion function and the interaction instruction from the audience, the game client and the server may determine whether to drive the target interactive element.

[0192] The host UE instance can obtain the field of view information of the current live broadcast screen. The field of view information can be the range information of the game map that the host can observe.

[0193] Furthermore, it is determined according to the identification information of the target interactive element whether the element position information of the target interactive element is located in the area represented by the visual range information to obtain a visual field matching result.

[0194] In step S1020, if the field of view matching result is that the field of view range information includes element position information, the target interactive element is driven to move according to the interactive parameter, the motion function and the smoothing function.

[0195] When the field of view matching result is that the field of view range information includes element position information, it indicates that the element position information of the target interactive element is located in the area represented by the field of view range information. Therefore, the target interactive element can be driven to move according to the interaction parameters, motion function and smoothing function.

[0196] For the interactive case of the team flag fluttering, when several flags belonging to different camps in the game are clicked and interacted with by the audience, they will flutter in the wind. Moreover, the higher the frequency of the audience's clicks, or the more people in a unit of time, the greater the fluttering amplitude of the team flag.

[0197] For the interactive case of switching game perspective, the audience camera in the game will move at a given direction angle with a given value.

[0198] In this exemplary embodiment, the target interactive element is driven only when it enters the field of view, which can reduce the computing cost and rendering cost while ensuring the interactive effect in the live broadcast room, and alleviate the computing pressure on the server, audience and anchor. In addition, the virtual live broadcast screen displayed on the audience side makes the live broadcast audience more immersed.

[0199] In addition, when the target interactive element is not located within the current field of view, the target interactive element may not be driven.

[0200] In an optional embodiment, if the field of view matching result is that the field of view range information does not include element position information, the target interactive element is kept stationary.

[0201] When the field of view matching result is that the field of view range information does not include element position information, it indicates that the element position information of the target interactive element is not located in the area represented by the field of view range information. Therefore, the interaction parameters can be discarded and the target interactive element is not driven.

[0202] After successfully driving the target interactive elements in the virtual live broadcast scene, the host-side UE instance can send f(x) to the game client and server.

[0203] Through this process, the target interactive elements in the virtual live broadcast scene can be driven smoothly, and the driving method is basically the same as the display form in the game.

[0204] After completing the driving of the target interactive elements in the game, the game client can return a success mark to the host UE instance.

[0205] After receiving the success identifier, the host-side UE instance can send the final combined picture to the viewer side through the live broadcast platform server to complete the picture update.

[0206] Therefore, the picture that the audience sees on the client includes the live picture effect created by the interaction between virtual live broadcast and in-game elements.

[0207] When using the interaction parameters and motion functions to drive the target interactive elements to move, differentiated driving can also be performed according to different target interactive elements.

[0208] In an optional embodiment, if there are multiple target interactive elements, the target interactive elements are driven to move in different directions according to the interaction parameters and the motion function.

[0209] In the case of team flag interaction, many viewers belonging to different team camps can click on their own team flags to cheer for the corresponding home team. At this time, the corresponding battle flags in the game can produce different fluttering effects.

[0210] For example, when there are two target interactive elements of team flags, and the two team flags are flag A and flag B, at this time, the audience who support through flag A is more than the audience who support through flag B, so the interactive rising and falling movement effect of flag A rising and flag B falling can be presented.

[0211] In addition, the virtual live scene can also be updated according to multiple target interactive elements.

[0212] In an optional embodiment, if there are multiple target interactive elements, the virtual live broadcast scene is updated according to the target interactive elements.

[0213] For example, when there are two target interactive elements of team flags, and the two team flags are flag A and flag B, the audience who supports through flag A is more than the audience who supports through flag B. Moreover, flag A is red and located on the left side of the game screen, and flag B is blue and located on the right side of the game screen, so the virtual live scene can be updated by making the red background area on the left side of the virtual live scene larger than the blue background area on the right side.

[0214] By using interactive parameters and motion functions to drive the target interactive elements to move in different directions and update the virtual live broadcast scene, it can cooperate with the interaction within the game to create a viewing atmosphere.

[0215] Furthermore, through the solution disclosed in the present invention, the host can control the game in the virtual live broadcast mode, and the audience can directly interact with the video area of ​​the virtual live broadcast, thereby simultaneously changing the virtual scene and the interactive element effects within the game, thereby improving the live viewing experience.

[0216] The technical solution disclosed in the present invention is based on the data intercommunication between the virtual live broadcast room and the UE instance on the anchor side, the game data on the anchor side and the user operation behavior. When the anchor uses the virtual live broadcast to broadcast a game, the user enters the live broadcast room and can directly interact with the video stream to change the state of related interactive element props in the virtual scene, and interoperate with the game data, ultimately affecting the effect in the game process, such as changing the state of the interactive elements in the game or switching the game perspective, etc., thereby enhancing the viewing experience of the game live broadcast and improving the atmosphere of multi-person viewing.

[0217] Specifically, the host's UE instance can obtain the host's current game process, associate and map it with the relevant interactive elements and props in the scene, and complete the virtual game broadcast. Therefore, the host can use the virtual game broadcast to complete an immersive broadcast screen presentation with a virtual scene, game live screen, and host's virtual image.

[0218] The live broadcast platform client can normally display the screen after the virtual broadcast, which includes virtual scenes, game screens, anchor image, etc.

[0219] Users can initiate interactive commands for virtual live scenes and game processes by clicking or dragging in the video stream. The live platform client can respond to the interactive commands of users in the video stream area and send them to the live platform server.

[0220] The live broadcast platform server can obtain relevant data about the virtual scene in the UE instance of the anchor side and the game data on the game process side, and combine the game element interaction template to determine the interaction effects in the game and virtual scene to be triggered.

[0221] After the judgment is completed, the host-side UE instance can dynamically change the status of relevant interactive element props in the virtual scene after receiving the interactive effect generation instruction, and forward the interactive instruction to the game client.

[0222] After receiving the interactive effect generation instruction, the game client can dynamically change the status of relevant interactive elements in the game or switch the game viewing angle, etc., and update the live broadcast client of the virtual game broadcast, thereby completing an interactive process in the present disclosure.

[0223] For the interactive case of the team flag fluttering, when several flags belonging to different camps in the game are clicked and interacted with by the audience, they will flutter in the wind. Moreover, the higher the frequency of the audience's clicks, or the more the audience in a unit time, the greater the fluttering amplitude of the team flag.

[0224] For the interactive case of switching game perspective, the audience camera in the game will move at a given direction angle with a given value.

[0225] The interactive method in live broadcast in the exemplary embodiment of the present disclosure provides a functional solution entry for a strong interactive connection between the anchor and the audience by providing multiple interactive elements in the virtual live broadcast scene. Furthermore, the target interactive element is driven to move through interactive parameters and motion functions, which deepens the audience's participation in watching the live broadcast, enhances the audience's live broadcast viewing experience, and improves the multi-person viewing atmosphere in the live broadcast room.

[0226] In addition, in an exemplary embodiment of the present disclosure, an interactive device in a live broadcast is also provided, which provides multiple interactive elements in a virtual live broadcast scene. Fig.11 A schematic diagram of the structure of the interactive device in the live broadcast is shown. Fig.11 As shown, the interactive device 1100 in live broadcast may include: a data acquisition module 1110 and an element driving module 1120. Among them:

[0227] The data acquisition module 1110 is configured to determine a target interactive element from the plurality of interactive elements through the audience terminal, and acquire the interactive parameters of the audience terminal and a motion function corresponding to the target interactive element;

[0228] The element driving module 1120 is configured to drive the target interactive element to move according to the interactive parameter and the motion function, and display it on the audience end.

[0229] In an exemplary embodiment of the present invention, determining the target interactive element from the multiple interactive elements by the audience terminal includes:

[0230] The identification information of the multiple interactive elements is obtained, and a target interactive element is determined among the multiple interactive elements through the audience terminal and the identification information.

[0231] In an exemplary embodiment of the present invention, the step of obtaining the interaction parameter of the audience terminal and the motion function corresponding to the target interactive element includes:

[0232] Acquire the operation position information and operation behavior information of the audience terminal, and determine the interaction parameters according to the operation position information;

[0233] A motion function corresponding to the target interactive element is determined according to the operation behavior information.

[0234] In an exemplary embodiment of the present invention, determining the interaction parameter according to the operation position information includes:

[0235] Acquire element position information of the target interactive element, and perform mapping conversion processing on the element position information to obtain conversion position information;

[0236] Performing operation validity judgment on the operation position information and the conversion position information to obtain an operation judgment result;

[0237] The operation summary processing is performed according to the operation judgment result to obtain the interaction parameter.

[0238] In an exemplary embodiment of the present invention, the step of performing operation aggregation processing according to the operation judgment result to obtain the interaction parameter includes:

[0239] If the target interactive element is the first interactive element, performing an operation summation process according to the operation judgment result and the identification information to obtain an interactive parameter;

[0240] If the target interactive element is the second interactive element, direction fitting processing is performed on the operation position information according to the operation judgment result to obtain interaction parameters.

[0241] In an exemplary embodiment of the present invention, determining the motion function corresponding to the target interactive element according to the operation behavior information includes:

[0242] Acquire a preset function corresponding to the identification information, and acquire a standard operating curve of the preset function;

[0243] An actual operation curve is generated according to the operation behavior information, and a curve fitting process is performed on the standard operation curve and the actual operation curve to obtain a motion function.

[0244] In an exemplary embodiment of the present invention, the method further comprises:

[0245] Obtaining a live broadcast mode identifier, and obtaining scene element information in a virtual live broadcast scene according to the live broadcast mode identifier;

[0246] Acquire live streaming data, and display a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information.

[0247] In an exemplary embodiment of the present invention, displaying a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information includes:

[0248] Performing space model recognition on the scene element information to obtain a model recognition result;

[0249] If the model recognition result is that the scene element information includes vacant space model information, the model position in the vacant space model information is determined, and a live screen corresponding to the live streaming data is displayed at the model position in the virtual live scene.

[0250] In an exemplary embodiment of the present invention, the method further comprises:

[0251] If the model recognition result is that the scene element information does not include vacant model information, the virtual live broadcast scene is grayed out.

[0252] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function includes:

[0253] Acquire an initial parameter corresponding to the interaction parameter, and perform a parameter difference calculation on the interaction parameter and the initial parameter to obtain a parameter difference value;

[0254] Acquire a difference threshold value corresponding to the parameter difference value, and compare the parameter difference value with the difference threshold value to obtain a comparison result;

[0255] Based on the comparison result, the target interactive element is driven to move according to the interaction parameter and the motion function.

[0256] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function based on the comparison result includes:

[0257] If the comparison result is that the parameter difference is greater than the difference threshold, obtaining a smoothing function corresponding to the parameter difference;

[0258] The target interactive element is driven to move according to the interactive parameter, the motion function and the smoothing function.

[0259] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter, the motion function and the smoothing function includes:

[0260] Acquire the field of view information of the live broadcast screen, and perform field of view matching on the element position information and the field of view information to obtain a field of view matching result;

[0261] If the field of view matching result is that the field of view range information includes the element position information, the target interactive element is driven to move according to the interaction parameter, the motion function and the smoothing function.

[0262] In an exemplary embodiment of the present invention, the method further comprises:

[0263] If the field of view matching result is that the field of view range information does not include the element position information, the target interactive element is kept stationary.

[0264] In an exemplary embodiment of the present invention, the step of driving the target interactive element to move according to the interaction parameter and the motion function includes:

[0265] If there are multiple target interactive elements, the target interactive elements are driven to move in different directions according to the interactive parameters and the motion function.

[0266] In an exemplary embodiment of the present invention, the method further comprises:

[0267] If there are multiple target interactive elements, the virtual live broadcast scene is updated according to the target interactive elements.

[0268] The specific details of the above-mentioned live broadcast interaction device 1100 have been described in detail in the corresponding live broadcast interaction method, so they will not be repeated here.

[0269] It should be noted that although several modules or units of the interactive device 1100 in the live broadcast are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0270] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0271] Refer to the following Fig.12 1200 according to this embodiment of the present invention is described. Fig.12 The electronic device 1200 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0272] like Fig.12 As shown, the electronic device 1200 is in the form of a general computing device. The components of the electronic device 1200 may include, but are not limited to: the at least one processing unit 1210, the at least one storage unit 1220, a bus 1230 connecting different system components (including the storage unit 1220 and the processing unit 1210), and a display unit 1240.

[0273] The storage unit stores program codes, which can be executed by the processing unit 1210, so that the processing unit 1210 executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0274] The storage unit 1220 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 1221 and / or a cache memory unit 1222 , and may further include a read-only memory unit (ROM) 1223 .

[0275] The storage unit 1220 may also include a program / utility 1224 having a set (at least one) of program modules 1225, such program modules 1225 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0276] Bus 1230 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0277] The electronic device 1200 may also communicate with one or more external devices 1400 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1200, and / or communicate with any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1250. Furthermore, the electronic device 1200 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 1260. As shown, the network adapter 1260 communicates with other modules of the electronic device 1200 via a bus 1230. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0278] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0279] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0280] refer to Fig.13 As shown, a program product 1300 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0281] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0282] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0283] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0284] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0285] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

Claims

1. A method for interaction in live broadcast, characterized in that: A plurality of interactive elements are provided in a three-dimensional virtual live broadcast scene, wherein the interactive elements are preset model props or operation controls specifically used to carry the game currently being broadcasted, and the method comprises: Obtain identification information of the multiple interactive elements, and determine identification information of the currently active interactive element among multiple interactive elements in the video stream area of ​​the client of the viewer end through a trigger operation of the viewer end and the identification information; match the identification information of the currently active interactive element with identification information of all interactive elements, and determine the interactive element corresponding to the identification information of the currently active interactive element as the target interactive element according to the matching result; Acquiring operation position information and operation behavior information of the audience terminal; Acquire element position information of the target interactive element, and perform mapping conversion processing on the element position information to obtain conversion position information; the element position information is the coordinates of the target interactive element in the three-dimensional virtual live broadcast scene; Performing operation validity judgment on the operation position information and the conversion position information to obtain an operation judgment result; Performing operation summary processing according to the operation judgment result to obtain interaction parameters; Determine a motion function corresponding to the target interactive element according to the operation behavior information; When the target interactive element enters the field of view, the target interactive element is driven to move according to the interaction parameter and the motion function, and is displayed on the audience side; the field of view is the range of the game map observed by the host side.

2. The interactive method in live broadcast according to claim 1, characterized in that: The step of performing operation aggregation processing according to the operation judgment result to obtain the interaction parameter includes: If the target interactive element is the first interactive element, performing an operation summation process according to the operation judgment result and the identification information to obtain an interactive parameter; If the target interactive element is the second interactive element, direction fitting processing is performed on the operation position information according to the operation judgment result to obtain interaction parameters.

3. The interactive method in live broadcast according to claim 1, characterized in that: The determining, according to the operation behavior information, a motion function corresponding to the target interactive element comprises: Acquire a preset function corresponding to the identification information, and acquire a standard operating curve of the preset function; An actual operation curve is generated according to the operation behavior information, and a curve fitting process is performed on the standard operation curve and the actual operation curve to obtain a motion function.

4. The interactive method in live broadcast according to claim 1, characterized in that: The method further comprises: Obtaining a live broadcast mode identifier, and obtaining scene element information in a virtual live broadcast scene according to the live broadcast mode identifier; Acquire live streaming data, and display a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information.

5. The interactive method in live broadcast according to claim 4, characterized in that: The displaying a live screen corresponding to the live streaming data in the virtual live scene according to the scene element information includes: Performing space model recognition on the scene element information to obtain a model recognition result; If the model recognition result is that the scene element information includes vacant space model information, the model position in the vacant space model information is determined, and a live screen corresponding to the live streaming data is displayed at the model position in the virtual live scene.

6. The interactive method in live broadcast according to claim 5, characterized in that: The method further comprises: If the model recognition result is that the scene element information does not include vacant model information, the virtual live broadcast scene is grayed out.

7. The interactive method in live broadcast according to claim 1, characterized in that: The step of driving the target interactive element to move according to the interactive parameter and the motion function includes: Acquire an initial parameter corresponding to the interaction parameter, and perform a parameter difference calculation on the interaction parameter and the initial parameter to obtain a parameter difference value; Acquire a difference threshold value corresponding to the parameter difference value, and compare the parameter difference value with the difference threshold value to obtain a comparison result; Based on the comparison result, the target interactive element is driven to move according to the interaction parameter and the motion function.

8. The interactive method in live broadcast according to claim 7, characterized in that: The step of driving the target interactive element to move based on the comparison result and the interaction parameter and the motion function includes: If the comparison result is that the parameter difference is greater than the difference threshold, obtaining a smoothing function corresponding to the parameter difference; The target interactive element is driven to move according to the interactive parameter, the motion function and the smoothing function.

9. The interactive method in live broadcast according to claim 1, characterized in that: The method further comprises: If the target interactive element is not within the field of view, the target interactive element is kept stationary.

10. The interactive method in live broadcast according to claim 1, characterized in that: The step of driving the target interactive element to move according to the interactive parameter and the motion function includes: If there are multiple target interactive elements, the target interactive elements are driven to move in different directions according to the interactive parameters and the motion function.

11. The interactive method in live broadcast according to claim 1, characterized in that: The method further comprises: If there are multiple target interactive elements, the virtual live broadcast scene is updated according to the target interactive elements.

12. An interactive device in live broadcast, characterized in that: A plurality of interactive elements are provided in a three-dimensional virtual live broadcast scene, wherein the interactive elements are preset model props or operation controls specifically used to carry the game currently being broadcast, including: A data acquisition module is configured to acquire identification information of the plurality of interactive elements, and determine identification information of a currently active interactive element among a plurality of interactive elements in a video stream area of ​​a client of the audience end through a trigger operation of the audience end and the identification information; match the identification information of the currently active interactive element with identification information of all interactive elements, and determine the interactive element corresponding to the identification information of the currently active interactive element as a target interactive element according to the matching result; acquire operation position information and operation behavior information of the audience end; acquire element position information of the target interactive element, and map and transform the element position information to obtain transformation position information; the element position information is the coordinate of the target interactive element in the three-dimensional virtual live broadcast scene; perform effective operation judgment on the operation position information and the transformation position information to obtain an operation judgment result; perform operation summary processing according to the operation judgment result to obtain interaction parameters; determine a motion function corresponding to the target interactive element according to the operation behavior information; The element driving module is configured to drive the target interactive element to move according to the interaction parameters and the motion function when the target interactive element enters the field of view, and display it on the audience end; the field of view is the range of the game map observed by the anchor end.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interactive method in live broadcast described in any one of claims 1-11 is implemented.

14. An electronic device, characterized in that: include: processor; A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the interactive method in live broadcast described in any one of claims 1-11 by executing the executable instructions.

Images