Information display method, system, device, electronic device and storage medium

Abstract

The present disclosure relates to an information display method, system, device, electronic device, storage medium and computer program product, the method comprising: in the process of live video broadcast, in response to an interactive request for a target virtual resource triggered by a content consumption account, obtaining first display data of a first virtual image corresponding to a content production account, second display data of a second virtual image corresponding to a content consumption account and third display data of a target virtual resource; generating interactive special effect data based on a pre-stored interactive special effect display strategy, first display data, second display data and third display data; displaying and sending a live data stream containing interactive special effect data and live video broadcast data. The live data stream is used for content consumption accounts to consume interactive special effect data and live video broadcast data. The present method provides interactive display flexibility.

Description

Technical Field

[0001] The present disclosure relates to the field of Internet technology, and in particular to information display methods, systems, devices, electronic devices, storage media and computer program products. Background Art

[0002] With the development of Internet live broadcast technology, local user accounts can broadcast live videos through electronic devices, that is, local user accounts are also called content production accounts. During the live video broadcast process, the content production account interacts with the user account watching the live video (also called content consumption account) through the virtual space of the live video broadcast.

[0003] During the current live video broadcasting process, the form of interaction between the content production account and the content consumption account is usually through a pre-set interactive display effect, such as a preset video or picture, which is output and displayed in a virtual space. For example, a content consumption account gives a virtual resource to a local user account, and an interactive display is performed to the content consumption account based on the resource display effect corresponding to the virtual resource.

[0004] However, in the current video live broadcast process, the interactive display form between the content production account and the content consumption account is relatively simple, and most of the interactive display forms are output displays of pre-set display effects, which makes the display flexibility of this interactive display form poor. Summary of the invention

[0005] The present disclosure provides an information display method, system, device, electronic device, storage medium and computer program product to at least solve the problem of single interactive display form and poor display flexibility in related technologies. The technical solution of the present disclosure is as follows:

[0006] According to a first aspect of an embodiment of the present disclosure, there is provided an information display method, the method being applied to a client of a content production account, the method comprising:

[0007] During the live video broadcast, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource are obtained;

[0008] Generate interactive special effect data based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data;

[0009] Display and send a live data stream containing the interactive special effect data and the live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data.

[0010] In one exemplary embodiment, the virtual image includes a plurality of virtual elements, and the method further includes:

[0011] Displaying a virtual image editing page, wherein the virtual image editing page includes an original virtual image corresponding to the content production account;

[0012] In response to an edit triggering operation on a virtual element in the original virtual image, displaying a candidate list of the virtual element;

[0013] In response to a triggering operation on a target virtual element in the candidate list, the original virtual image is updated according to the target virtual element to obtain a first virtual image corresponding to the content production account.

[0014] In one exemplary embodiment, the method further comprises:

[0015] Displaying a virtual image editing page, wherein the virtual image editing page includes a virtual image generation option;

[0016] In response to a trigger operation for a virtual image generation option, capturing a facial image of the content production account through a camera device;

[0017] The facial image is sent to a facial recognition server, and a first virtual image generated by the facial recognition service based on the facial image is received.

[0018] In one exemplary embodiment, in response to an interaction request for a target virtual resource triggered by a content consumption account, obtaining first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource includes:

[0019] In response to an interaction request sent by the live broadcast service end, parsing identification information of a first virtual image corresponding to the content production account, identification information of a second virtual image corresponding to the content consumption account, and identification information of a target virtual resource carried in the interaction request;

[0020] Sending a virtual resource acquisition request to a virtual resource platform, wherein the virtual resource acquisition request carries identification information of the first virtual image, identification information of the second virtual image, and identification information of a target virtual resource;

[0021] The first display data of the first virtual image, the second display data of the second virtual image, and the third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource acquisition request are received.

[0022] In one exemplary embodiment, the generating of the interactive special effect data based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data includes:

[0023] According to the correspondence between the virtual resources and the interactive actions, determining the target interactive action corresponding to the target virtual resource, and acquiring display data of the target interactive action;

[0024] Special effect rendering is performed based on the display data of the target interactive action, the first display data, the second display data, and the third display data to generate interactive special effect data.

[0025] In one exemplary embodiment, the method further comprises:

[0026] In response to a trigger display operation on a user's personal page, sending a request for obtaining a local virtual image to the virtual resource platform;

[0027] The first display data of the first virtual image fed back by the virtual resource platform in response to the local virtual image acquisition request is received, and the first virtual image is displayed on the user personal page based on the first display data.

[0028] According to a second aspect of an embodiment of the present disclosure, there is provided an information display device, the information display device being applied to a client of a content production account, the device further comprising:

[0029] an acquisition unit configured to execute, during the video live broadcast, in response to an interaction request for a target virtual resource triggered by a content consumption account, to acquire first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource;

[0030] A generating unit configured to generate interactive special effect data based on a pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data;

[0031] The display and sending unit is configured to perform display and send a live data stream containing the interactive special effect data and the live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data.

[0032] In one exemplary embodiment, the virtual image includes a plurality of virtual elements, and the device further includes:

[0033] A first display unit is configured to display a virtual image editing page, wherein the virtual image editing page includes an original virtual image corresponding to the content production account;

[0034] A display unit configured to display a candidate list of virtual elements in response to an edit trigger operation on the virtual elements in the original virtual image;

[0035] The updating unit is configured to execute a trigger operation in response to a target virtual element in the candidate list, update the original virtual image according to the target virtual element, and obtain a first virtual image corresponding to the content production account.

[0036] In one exemplary embodiment, the apparatus further comprises:

[0037] A second display unit is configured to display a virtual image editing page, wherein the virtual image editing page includes a virtual image generation option;

[0038] A unit configured to execute, in response to a trigger operation for a virtual image generation option, collecting a facial image of the content production account through a camera device;

[0039] The method is configured to send the facial image to a facial recognition server and receive a first virtual image generated by the facial recognition server based on the facial image.

[0040] In one exemplary embodiment, the acquisition unit further includes:

[0041] The parsing subunit is configured to execute, in response to the interaction request sent by the live broadcast server, parsing the identification information of the first virtual image corresponding to the content production account, the identification information of the second virtual image corresponding to the content consumption account, and the identification information of the target virtual resource carried in the interaction request;

[0042] A sending subunit is configured to execute sending a virtual resource acquisition request to a virtual resource platform, wherein the virtual resource acquisition request carries identification information of the first virtual image, identification information of the second virtual image, and identification information of a target virtual resource;

[0043] The receiving subunit is configured to receive first display data of the first virtual image, second display data of the second virtual image and third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource acquisition request.

[0044] In one exemplary embodiment, the generating unit further comprises:

[0045] A determination subunit is configured to determine the target interactive action corresponding to the target virtual resource according to the correspondence between the virtual resource and the interactive action, and obtain display data of the target interactive action;

[0046] The generating subunit is configured to perform special effect rendering based on the display data of the target interactive action, the first display data, the second display data and the third display data to generate interactive special effect data.

[0047] In one exemplary embodiment, the apparatus further comprises:

[0048] a sending unit, configured to execute, in response to a trigger display operation on a user's personal page, sending a local virtual image acquisition request to the virtual resource platform;

[0049] The receiving and displaying unit is configured to receive first display data of the first virtual image fed back by the virtual resource platform in response to the local virtual image acquisition request, and display the first virtual image on the user personal page based on the first display data.

[0050] According to a third aspect of an embodiment of the present disclosure, there is provided an information display system, the system comprising:

[0051] The client of the content consumption account is used to send interactive instructions for the target virtual resource to the server;

[0052] The server is configured to send an interaction request for a target virtual resource triggered by the content consumption account to a client of the content production account in response to the interaction instruction;

[0053] The client of the content production account is used to obtain, during the process of live video broadcast, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource in response to an interactive request for a target virtual resource triggered by a content consumption account; generate interactive special effect data based on a pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data; and display and send a live data stream containing the interactive special effect data and live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data.

[0054] In one of the exemplary embodiments, the server includes a live broadcast server and a virtual resource platform; the live broadcast server is further used to respond to an interaction instruction for the target virtual resource triggered by a client of the content consumption account, and send the interaction request for the target virtual resource to the client of the content production account, wherein the interaction request carries identification information of a first virtual image corresponding to the content production account, identification information of a second virtual image corresponding to the content consumption account, and identification information of the target virtual resource;

[0055] The virtual resource platform is used to receive a virtual resource acquisition request sent by the client of the content production account in response to the interactive request for the target virtual resource, and based on the virtual resource acquisition request, feedback to the client of the content production account first display data of the first virtual image corresponding to the content production account, second display data of the second virtual image corresponding to the content consumption account, and third display data of the target virtual resource.

[0056] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0057] processor;

[0058] a memory for storing instructions executable by the processor;

[0059] The processor is configured to execute the instructions to implement the information display method as described in any one of the first aspects above.

[0060] According to a fifth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute an information display method as described in any one of the first aspects above.

[0061] According to a sixth aspect of an embodiment of the present disclosure, a computer program product is provided. When the instructions are executed by a processor of an electronic device, the electronic device is enabled to execute the information display method described in any one of the first aspects above.

[0062] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0063] By adopting this method, during the live video broadcast process, based on the interactive request sent by the live broadcast server, the resource information of the virtual images of the content production account and the content consumption account and the resource information of the target virtual resources transmitted between the content production account and the content consumption account are obtained, and interactive special effect data is generated. The interactive special effect data includes the personalized virtual images that can reflect the content production account and the content consumption account. Therefore, when the live broadcast data stream including the interactive special effect data and the video live broadcast data is displayed, personalized interactive special effects can be displayed, thereby improving the display flexibility.

[0064] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0066] Figure 1 The present invention is a flowchart of an information display method according to an exemplary embodiment.

[0067] Figure 2 The figure is a flowchart showing steps of configuring a first virtual image according to an exemplary embodiment.

[0068] Figure 3 is a flowchart showing steps of configuring a first virtual image according to another exemplary embodiment.

[0069] Figure 4 The figure is a flowchart showing a step of obtaining various display data according to an exemplary embodiment.

[0070] Figure 5 The present invention is a flowchart showing a method of generating interactive special effect data according to display data according to an exemplary embodiment.

[0071] Figure 6 The present invention is a flowchart showing a method of displaying a first virtual image on a user's personal page according to an exemplary embodiment.

[0072] Figure 7 It is a block diagram of an information display system according to an exemplary embodiment.

[0073] Figure 8 The invention is a block diagram of an information display device according to an exemplary embodiment.

[0074] Fig. 9 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0075] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0076] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0077] It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0078] Figure 1 This is a flowchart of an information display method according to an exemplary embodiment. The information display method is applied to a client of a content production account (the client of the content production account is referred to as a local client in this disclosure, and the term will not be explained later). The local client is deployed on an electronic device and implemented by a computer program through the electronic device. Figure 1 Specifically, the information display method includes the following steps:

[0079] In step S110, during the live video broadcast, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource are obtained.

[0080] Among them, the first virtual image is configured by the content production account, so the first virtual image is highly matched with the content production account, and the first virtual image can be controlled by the content production account, for example, the content production account controls the first virtual image to display pre-configured interactive actions. Optionally, the first virtual image can also be controlled by the content consumption account. For example, after the content production account configures the first virtual image, the first virtual image is pushed to the content consumption account for control, and the content consumption account controls the first virtual image to display interactive actions, thereby realizing the interaction between the content production account and the content consumption account. The second virtual image is configured by the content consumer, and the second virtual image is highly matched with the content consumption account. Optionally, the second virtual image can be controlled by the content consumption account, or configured by the content production account. The embodiment of the present disclosure does not limit the display control scenarios of the first virtual image and the second virtual image.

[0081] In implementation, the local user corresponding to the content production account can initiate a live video broadcast through the local client and transmit the live video broadcast address to the live broadcast server. If other users want to watch the live video broadcast, they can establish a long connection relationship for the live video broadcast process through the live video broadcast address provided by the live broadcast server, thereby obtaining the live data stream of the live video broadcast to realize the consumption of the live video broadcast content. During the live video broadcast process, the content production account can interact with the content consumption account through the live video content. The content consumption account can establish an interactive connection with the content production account by transferring virtual resources to the content production account. Therefore, when the content consumption account transfers the target virtual resource to the content production account, the content consumption account triggers an interactive request for the target virtual resource, and the local client responds to the interactive request to obtain the first display data of the first virtual image corresponding to the content production account, the second display data of the second virtual image corresponding to the content consumption account, and the third display data of the target virtual resource.

[0082] In step S120, interactive special effect data is generated based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data.

[0083] In implementation, an interactive special effect display strategy is pre-stored in the local client. Based on the interactive special effect display strategy, the local client performs special effect rendering on the first display data, the second display data, and the third display data to generate interactive special effect data. The interactive special effect data includes information about the interactive special effect images of the first virtual image, the second virtual image, and the target virtual resource. The interactive special effect data is used for displaying the corresponding interactive special effect images when the content production account and the content consumption account consume the content corresponding to the interactive special effect data.

[0084] In step S130, a live data stream including interactive special effect data and live video data is displayed and sent.

[0085] Among them, the live broadcast data stream is used for content consumption accounts to consume interactive special effects data and video live broadcast data.

[0086] During implementation, the local client generates a live data stream including interactive special effect data and live video data. Then, the local client reads the live data stream and outputs it in the display interface of the local client. At the same time, the local client can push the obtained live data stream to the live server, and distribute and transmit it via the CDN (Content Delivery Network) of the live server. The live data stream is pushed to the clients of each content consumption account. The clients of each content consumption account display the live video content and interactive special effects contained in the live data stream, thereby realizing the consumption of the live video content and interactive special effects by the content consumption account.

[0087] In the above information display method, during the video live broadcast process, the local client responds to the interactive request for the target virtual resource triggered by the content consumption account, and obtains the first display data of the first virtual image corresponding to the content production account, the second display data of the second virtual image corresponding to the content consumption account, and the third display data of the target virtual resource. Then, the local client generates interactive special effect data based on the pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data. The local client displays and sends a live data stream containing interactive special effect data and video live broadcast data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the video live broadcast data. With this method, during the video live broadcast process, based on the interactive request sent by the live broadcast service end, the resource information of the virtual image of the content production account and the content consumption account and the resource information of the target virtual resource transmitted between the content production account and the content consumption account are obtained, and the interactive special effect data is generated, and the interactive special effect data contains the personalized virtual image that can reflect the content production account and the content consumption account. Therefore, when the live data stream containing the interactive special effect data and the video live broadcast data is displayed, personalized interactive special effects can be displayed, thereby improving the display flexibility.

[0088] In an exemplary embodiment, each user account corresponds to a virtual image that reflects the personalized image characteristics of the user. In order to realize the personalization of each virtual image, the virtual images of different accounts can be pre-configured through the client of the corresponding account. The first virtual image corresponding to the content production account is taken as an example to illustrate the configuration process of the virtual image. The configuration process of the virtual images of other user accounts is similar to this process, and the embodiment of the present disclosure will not be repeated. Specifically, Figure 2 As shown, each virtual image includes multiple virtual elements, and the information display method further includes:

[0089] In step S201, a virtual image editing page is displayed.

[0090] Among them, the virtual image editing page contains the original virtual image corresponding to the content production account.

[0091] In implementation, when the content production account pre-configures the original virtual image, the local client displays the virtual image editing page in the display interface in response to the operation of editing the original virtual image triggered by the content production account. The virtual image editing page has a virtual image preview area, and the virtual image preview area can be used to display the original virtual image corresponding to the content production account. The original virtual image is an initial virtual image obtained based on the default virtual elements and the initial virtual elements.

[0092] In step S202 , in response to an edit triggering operation on a virtual element in the original virtual image, a candidate list of virtual elements is displayed.

[0093] In implementation, each virtual image includes multiple feature components, such as the character's face shape, facial features (i.e., eyebrows, eyes, nose, mouth, ears), hair, clothing, accessories, etc. Each feature component can be displayed by a corresponding virtual element. Therefore, in response to the edit trigger operation of the virtual element of a feature component in the original virtual image, the local client displays a candidate list of virtual elements of different display forms corresponding to the feature component. For example, for the feature component of hair in the virtual image, a candidate list of virtual elements of multiple different hair display forms is displayed in the candidate list of hair, so that the display form of the feature component of hair can be selected. For example, the candidate list includes brown wavy hair, black straight hair, blond short hair, etc.

[0094] In step S203, in response to a trigger operation on a target virtual element in the candidate list, the original virtual image is updated according to the target virtual element to obtain a first virtual image corresponding to the content production account.

[0095] In implementation, for virtual elements in various display forms provided in the candidate list, the content production account can select the display form of one of the target virtual elements through the local client, and the local client responds to the trigger operation on the target virtual element in the candidate list, updates the original virtual image based on the target virtual element, and obtains the first virtual image corresponding to the updated content production account. The first virtual image is pre-configured by the local client and has a high degree of matching with the content production account.

[0096] In this embodiment, by providing an editing interface for each virtual element in the virtual image, the content production account can freely customize its own virtual image, so that the generated first virtual image is highly matched with the content production account.

[0097] In an exemplary embodiment, there is also provided an automatic customization function for the facial virtual elements in the virtual image of the user account, that is, based on the facial information of the user account, a virtual image that fits the face of the user account is generated. This is illustrated by taking a content production account as an example. Figure 3 As shown, the information display method also includes:

[0098] In step S301, a virtual image editing page is displayed.

[0099] The avatar editing page includes an avatar generation option, which is used to trigger the automatic generation of the avatar of the content production account.

[0100] In implementation, when the content production account pre-configures the original virtual image, the local client displays the virtual image editing page in the display interface in response to the operation of editing the original virtual image triggered by the content production account.

[0101] In step S302, in response to a trigger operation for a virtual image generation option, a facial image of the content production account is captured through a camera device.

[0102] In implementation, the local client responds to the trigger operation of the virtual image generation option in the virtual image editing page, turns on the camera device, and collects the face image of the content production account through the camera device. Optionally, the face image can be a frontal face image collected under natural light, and the embodiment of the present disclosure does not limit the collection standard of the face image.

[0103] In step S303, the face image is sent to a face recognition server, and a first virtual image generated by the face recognition service based on the face image is received.

[0104] In implementation, the local client sends the collected face image to the face recognition server, which is pre-set with an AI (Artificial Intelligence) recognition algorithm, specifically, for example, a computer vision recognition algorithm, etc. The face image is recognized and processed by the computer vision recognition algorithm to obtain face feature information, which may include but is not limited to face shape information, facial features (including facial feature size, facial feature shape and facial feature position information), face skin color information, etc. Then, the face recognition server generates a corresponding first virtual image based on the preset virtual image generation algorithm and facial feature information, and the face recognition server sends the generated first virtual image to the local client. The first virtual image is a virtual image that is highly matched with the content production account.

[0105] In this embodiment, the facial image of the content production account is captured by a camera device, and the facial feature information of the facial image is identified by a facial recognition server. A first virtual image is generated based on the facial feature information, so that the first virtual image received by the client of the content production account is highly consistent with the facial features of the user of the content production account, and the first virtual image is highly matched with the content production account.

[0106] In an exemplary embodiment, if Figure 4 As shown, in step S110, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource are obtained, which is specifically implemented by the following steps:

[0107] In step S401, in response to an interaction request sent by the live broadcast server, identification information of a first virtual image corresponding to a content production account, identification information of a second virtual image corresponding to a content consumption account, and identification information of a target virtual resource carried in the interaction request are parsed.

[0108] In implementation, when the client of the content consumption account sends an interactive instruction for the target virtual resource to the live broadcast server, the live broadcast server generates an interactive request containing identification information based on the interactive instruction. The identification information carried in the interactive request may include, but is not limited to, identification information of the first virtual image corresponding to the content production account, identification information of the second virtual image corresponding to the content consumption account, and identification information of the target virtual resource. Then, the live broadcast server sends the interactive request to the local client, and the local client responds to the interactive request for the target virtual resource and parses out the identification information of the first virtual image corresponding to the content production account, identification information of the second virtual image corresponding to the content consumption account, and identification information of the target virtual resource carried in the interactive request.

[0109] In step S402, a virtual resource acquisition request is sent to the virtual resource platform.

[0110] The virtual resource acquisition request carries identification information of the first virtual image, identification information of the second virtual image, and identification information of the target virtual resource.

[0111] In implementation, the virtual resource platform pre-stores the correspondence between identification information and display data of the virtual image. In addition, the display form of the display data stored in the virtual resource platform may include but is not limited to maps, texture information, videos, etc., and the disclosed embodiment does not limit the form of the display data. On this basis, the local client sends a virtual resource acquisition request to the virtual resource platform (wherein the virtual resource platform is also a resource middle platform) based on the parsed identification information of each virtual image and virtual resource, so as to obtain the display data corresponding to the identification information of the corresponding virtual image and the target virtual resource based on the correspondence in the virtual resource platform.

[0112] In step S403, first display data of the first virtual image, second display data of the second virtual image, and third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource acquisition request are received.

[0113] In implementation, the local client receives first display data of the first virtual image, second display data of the second virtual image, and third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource request.

[0114] In this embodiment, the local client obtains the display data of the virtual image and the target virtual resource through interaction with the virtual resource platform, and then can generate the corresponding virtual image and the target virtual resource based on the display data of the virtual image and the target virtual resource, thereby improving the display flexibility of the virtual image.

[0115] In an exemplary embodiment, if Figure 5 As shown, in step S120, based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data, the specific processing process of generating the interactive special effect data includes the following steps:

[0116] In step S501, according to the correspondence between virtual resources and interactive actions, a target interactive action corresponding to a target virtual resource is determined, and display data of the target interactive action is obtained.

[0117] In implementation, a matching strategy for the correspondence between different virtual resources and interactive actions is pre-stored in the local client. Then, based on the corresponding matching strategy, the local client determines the target interactive action corresponding to the target virtual resource, and then obtains the display data of the target interactive action.

[0118] Optionally, the live broadcast server pre-stores a matching strategy for the correspondence between virtual resources and interactive actions. Then, after receiving the interactive instruction for the target virtual resource sent by the client of the content consumption account, the live broadcast server can determine the target interactive action corresponding to the target virtual resource based on the information of the target virtual resource carried in the interactive instruction based on the matching strategy. Then, the live broadcast server sends the information of the target interactive action corresponding to the determined target virtual resource to the local client, and the local client obtains the display data of the target interactive action from the virtual resource platform based on the information of the target interactive action. Therefore, the embodiment of the present disclosure does not limit the execution subject of the matching logic of the target interactive action, and it can be specifically set according to the actual business needs.

[0119] In step S502, special effect rendering is performed based on the display data of the target interactive action, the first display data, the second display data, and the third display data to generate interactive special effect data.

[0120] In implementation, a special effect rendering engine is pre-set in the local client, and the display data of the target interactive action, the first display data, the second display data, and the third display data are subjected to special effect rendering processing by a special effect rendering model in the special effect rendering engine to obtain interactive special effect data. The special effect rendering engine may be a 3D (Dimensions) special effect rendering engine.

[0121] In this embodiment, the interactive feature data is rendered on the local client of the content production account to reduce the processing pressure on the server. At the same time, the local account side performs special effect rendering on the customized first display data, second display data and third display data. The generated interactive special effect data can realize the individual display of the content production account and the content consumption client that initiates the virtual resource interaction request, thereby improving the display flexibility.

[0122] In an exemplary embodiment, in addition to being used for interactive applications during the live video broadcast, the avatar corresponding to each user account can also be displayed on the user's personal homepage of each user account to increase the personalization of each user account's personal homepage. Specifically, take the content production account as an example. Figure 6 As shown, the information display method also includes:

[0123] In step S601, in response to a trigger display operation on a user's personal page, a request for obtaining a local virtual image is sent to a virtual resource platform.

[0124] During implementation, when a content production account needs to enter a user's personal page, the user corresponding to the content production account triggers display of the user's personal page, and the local client responds to the trigger display operation for the user's personal page by sending a local virtual image acquisition request to the virtual resource platform, wherein the virtual image acquisition request is used to instruct the virtual resource platform to respond to the local virtual image acquisition request and feedback the first display data of the first virtual image corresponding to the local content production account.

[0125] In step S602, first display data of a first virtual image fed back by the virtual resource platform in response to a local virtual image acquisition request is received, and the first virtual image is displayed on a user personal page based on the first display data.

[0126] In the implementation, the local client receives the first display data of the first virtual resource fed back by the virtual resource platform for the local virtual image acquisition request. Then, based on the first display data, the local client performs special effect rendering in a preset special effect rendering engine to obtain the first virtual image corresponding to the first display data, and outputs and displays the first virtual image on the user's personal page while displaying the user's personal page.

[0127] In this embodiment, by displaying the first virtual image corresponding to the content production account on the user personal page of the content production account, the personalization of the user personal page of the content production account is improved, and the display flexibility of the virtual image is improved.

[0128] In one embodiment, Figure 7 As shown, an information display system 700 is provided, which includes: a client 710 of a content consumption account, a server 720 and a client 730 of a content production account; wherein,

[0129] The client 710 of the content consumption account is used to send an interactive instruction for a target virtual resource to the live broadcast server;

[0130] The server 720 is used to send an interaction request for a target virtual resource triggered by a content consumption account to a client of the content production account in response to the interaction instruction;

[0131] The client 730 of the content production account is used to obtain, during the process of live video broadcast, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource in response to an interactive request for a target virtual resource triggered by a content consumption account; the first virtual image is configured by the content production account; the second virtual image is configured by the content consumer; based on a pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data, interactive special effect data is generated; and a live data stream containing the interactive special effect data and live video data is displayed and sent, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data.

[0132] In one embodiment, the server includes a live broadcast server and a virtual resource platform, and the live broadcast server is further used to respond to an interactive instruction for a target virtual resource triggered by a client of a content consumption account, and send an interactive request for the target virtual resource to a client of a content production account, wherein the interactive request carries identification information of a first virtual image corresponding to the content production account, identification information of a second virtual image corresponding to the content consumption account, and identification information of the target virtual resource;

[0133] A virtual resource platform is used to receive a virtual resource acquisition request sent by a client of a content production account in response to an interaction request for a target virtual resource, and based on the virtual resource acquisition request, feedback first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource to the client of the content production account.

[0134] It should be understood that although Figure 1-Figure 6 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-Figure 6 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0135] It can be understood that the same / similar parts between the various embodiments of the above method in this specification can refer to each other, and each embodiment focuses on the differences from other embodiments. For related points, please refer to the description of other method embodiments.

[0136] Figure 8 is a block diagram of an information display device according to an exemplary embodiment. Figure 8 The device 800 includes an acquisition unit 801, a generation unit 802, and a display and sending unit 803.

[0137] The acquisition unit 801 is configured to execute, during the live video broadcast, in response to an interaction request for a target virtual resource triggered by a content consumption account, to acquire first display data of a first virtual image corresponding to a content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource; the first virtual image is configured by the content production account; and the second virtual image is configured by the content consumer.

[0138] The generating unit 802 is configured to generate interactive special effect data based on a pre-stored interactive special effect display strategy, first display data, second display data, and third display data.

[0139] The display sending unit 803 is configured to perform display and send a live data stream containing interactive special effect data and live video data, wherein the live data stream is used for content consumption accounts to consume interactive special effect data and live video data.

[0140] In an exemplary embodiment, the virtual image includes a plurality of virtual elements, and the device 800 further includes:

[0141] A first display unit is configured to display a virtual image editing page, wherein the virtual image editing page includes an original virtual image corresponding to a content production account;

[0142] A display unit configured to display a candidate list of virtual elements in response to an edit trigger operation on the virtual elements in the original virtual image;

[0143] The updating unit is configured to execute a trigger operation in response to a target virtual element in the candidate list, update the original virtual image according to the target virtual element, and obtain a first virtual image corresponding to the content production account.

[0144] In an exemplary embodiment, the apparatus 800 further includes:

[0145] A second display unit is configured to display a virtual image editing page, wherein the virtual image editing page includes a virtual image generation option;

[0146] A unit configured to execute, in response to a trigger operation for a virtual image generation option, to capture a facial image of a content production account through a camera device;

[0147] The method is configured to send the facial image to a facial recognition server and receive a first virtual image generated by the facial recognition service based on the facial image.

[0148] In an exemplary embodiment, the acquiring unit 801 further includes:

[0149] The parsing subunit is configured to execute in response to the interactive request sent by the live broadcast server, and parse the identification information of the first virtual image corresponding to the content production account, the identification information of the second virtual image corresponding to the content consumption account, and the identification information of the target virtual resource carried in the interactive request;

[0150] A sending subunit is configured to execute sending a virtual resource acquisition request to the virtual resource platform, where the virtual resource acquisition request carries identification information of the first virtual image, identification information of the second virtual image, and identification information of the target virtual resource;

[0151] The receiving subunit is configured to receive first display data of the first virtual image, second display data of the second virtual image and third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource acquisition request.

[0152] In an exemplary embodiment, the generating unit 802 further includes:

[0153] A determination subunit is configured to determine a target interactive action corresponding to a target virtual resource according to a correspondence between the virtual resource and the interactive action, and obtain display data of the target interactive action;

[0154] The generating subunit is configured to perform special effect rendering on the display data based on the target interactive action, the first display data, the second display data and the third display data to generate interactive special effect data.

[0155] In one exemplary embodiment, the apparatus 800 further includes:

[0156] A sending unit, configured to execute, in response to a trigger display operation on a user's personal page, sending a local virtual image acquisition request to a virtual resource platform;

[0157] The receiving and displaying unit is configured to receive first display data of a first virtual image fed back by the virtual resource platform in response to a request for obtaining a local virtual image, and display the first virtual image on a user personal page based on the first display data.

[0158] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0159] Fig. 9 1 is a block diagram of an electronic device 900 for an information display method according to an exemplary embodiment. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0160] Reference Fig. 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0161] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0162] The memory 904 is configured to store various types of data to support operations on the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk, an optical disk, or a graphene memory.

[0163] The power supply component 906 provides power to the various components of the electronic device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0164] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0165] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting an audio signal.

[0166] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0167] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the electronic device 900, the relative positioning of the components, such as the display and keypad of the electronic device 900, and the sensor assembly 914 can also detect the position change of the electronic device 900 or the electronic device 900 components, the presence or absence of contact between the user and the electronic device 900, the orientation or acceleration / deceleration of the device 900 and the temperature change of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0168] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0169] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0170] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the above instructions can be executed by the processor 920 of the electronic device 900 to perform the above method. For example, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0171] In an exemplary embodiment, a computer program product is further provided. The computer program product includes instructions. The instructions can be executed by the processor 920 of the electronic device 900 to complete the above method.

[0172] It should be noted that the above-mentioned devices, electronic devices, computer-readable storage media, computer program products, etc. may also include other implementation methods according to the description of the method embodiments. The specific implementation methods can refer to the description of the relevant method embodiments, which will not be described one by one here.

[0173] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0174] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An information display method, characterized in that: The method is applied to a client of a content production account, and the method includes: During the live video broadcast, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource are obtained; Generate interactive special effect data based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data; Displaying and sending a live data stream including the interactive special effect data and the live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data; The first virtual image is matched with the content production account, and the method further includes: After the content production account is configured to obtain the first virtual image, the first virtual image is pushed to the content consumption account for control, so that the content consumption account controls the first virtual image to display interactive actions.

2. The information display method according to claim 1, characterized in that: The virtual image includes a plurality of virtual elements. Before obtaining, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource, the method further includes: Displaying a virtual image editing page, wherein the virtual image editing page includes an original virtual image corresponding to the content production account; In response to an edit triggering operation on a virtual element in the original virtual image, displaying a candidate list of the virtual element; In response to a triggering operation on a target virtual element in the candidate list, the original virtual image is updated according to the target virtual element to obtain a first virtual image corresponding to the content production account.

3. The information display method according to claim 1, characterized in that: Before obtaining, in response to an interactive request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource, the method further includes: Displaying an avatar editing page, wherein the avatar editing page includes an avatar generation option; In response to a trigger operation for a virtual image generation option, capturing a facial image of the content production account through a camera device; The facial image is sent to a facial recognition server, and a first virtual image generated by the facial recognition service based on the facial image is received.

4. The information display method according to claim 1, characterized in that: The step of obtaining, in response to an interaction request for a target virtual resource triggered by a content consumption account, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource comprises: In response to an interaction request sent by the live broadcast service end, parsing identification information of a first virtual image corresponding to the content production account, identification information of a second virtual image corresponding to the content consumption account, and identification information of a target virtual resource carried in the interaction request; Sending a virtual resource acquisition request to a virtual resource platform, wherein the virtual resource acquisition request carries identification information of the first virtual image, identification information of the second virtual image, and identification information of a target virtual resource; The first display data of the first virtual image, the second display data of the second virtual image, and the third display data of the target virtual resource fed back by the virtual resource platform in response to the virtual resource acquisition request are received.

5. The information display method according to claim 1, characterized in that: The generating interactive special effect data based on the pre-stored interactive special effect display strategy, the first display data, the second display data and the third display data includes: According to the correspondence between the virtual resources and the interactive actions, the target interactive action corresponding to the target virtual resource is determined, and the display data of the target interactive action is obtained; Special effect rendering is performed based on the display data of the target interactive action, the first display data, the second display data, and the third display data to generate interactive special effect data.

6. The information display method according to claim 1, characterized in that: The method further comprises: In response to a trigger display operation on a user's personal page, sending a request for obtaining a local virtual image to the virtual resource platform; The first display data of the first virtual image fed back by the virtual resource platform in response to the local virtual image acquisition request is received, and the first virtual image is displayed on the user personal page based on the first display data.

7. An information display system, characterized in that: The system comprises: The client of the content consumption account is used to send interactive instructions for the target virtual resource to the server; The server is configured to send an interaction request for a target virtual resource triggered by the content consumption account to a client of the content production account in response to the interaction instruction; The client of the content production account is used to obtain, during the live video broadcast, first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource in response to an interactive request for a target virtual resource triggered by a content consumption account; generate interactive special effect data based on a pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data; display and send a live data stream containing the interactive special effect data and live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data; and after the content production account is configured with the first virtual image, the first virtual image is pushed to the content consumption account for control, so that the content consumption account controls the first virtual image to display interactive actions.

8. The information display system according to claim 7, characterized in that: The server includes a live broadcast server and a virtual resource platform; the live broadcast server is also used to respond to an interactive instruction for the target virtual resource triggered by the client of the content consumption account, and send the interactive request for the target virtual resource to the client of the content production account, wherein the interactive request carries the identification information of the first virtual image corresponding to the content production account, the identification information of the second virtual image corresponding to the content consumption account, and the identification information of the target virtual resource; The virtual resource platform is used to receive a virtual resource acquisition request sent by the client of the content production account in response to the interactive request for the target virtual resource, and based on the virtual resource acquisition request, feedback to the client of the content production account first display data of the first virtual image corresponding to the content production account, second display data of the second virtual image corresponding to the content consumption account, and third display data of the target virtual resource.

9. An information display device, characterized in that: The device is applied to a client of a content production account, and includes: an acquisition unit configured to execute, during the video live broadcast, in response to an interaction request for a target virtual resource triggered by a content consumption account, to acquire first display data of a first virtual image corresponding to the content production account, second display data of a second virtual image corresponding to the content consumption account, and third display data of the target virtual resource; A generating unit, configured to generate interactive special effect data based on a pre-stored interactive special effect display strategy, the first display data, the second display data, and the third display data; A display and sending unit, configured to perform display and send a live data stream containing the interactive special effect data and the live video data, wherein the live data stream is used for the content consumption account to consume the interactive special effect data and the live video data; The first virtual image is matched with the content production account, and the device further includes: The control module is used to push the first virtual image to the content consumption account for control after the content production account is configured to obtain the first virtual image, so that the content consumption account controls the first virtual image to display interactive actions.

10. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the information display method as described in any one of claims 1 to 6.

11. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the information display method as claimed in any one of claims 1 to 6.

12. A computer program product, comprising instructions, characterized in that: When the instruction is executed by a processor of an electronic device, the electronic device is enabled to execute the information display method as described in any one of claims 1 to 6.

Images