Digital human-based live streaming method, device, storage medium and program product

Abstract

Embodiments of the present application provide a live broadcast method and device based on a digital person, a storage medium and a program product. In the embodiments of the present application, the server can create a private streaming process for any client, and push a public live broadcast picture to the any client through the private streaming process. In addition, when the any client initiates target question information related to the target theme content currently broadcasted through the question entry of the live broadcast room, the server can also push a private live broadcast picture to the any client through the private streaming process, so that the any client switches from the public live broadcast picture to the private live broadcast picture, thereby realizing answering the question raised by any user in the form of a private live broadcast picture, achieving the purpose of different faces for different people, and improving the user's experience in the live broadcast room and promoting the conversion rate of the live broadcast. At the same time, the advantages of the digital person in the efficiency of the live broadcast can be fully utilized to improve the efficiency of the live broadcast.

Description

Technical Field

[0001] This application relates to the field of Internet live streaming technology, and in particular to a live streaming method, device, storage medium and program product based on digital humans. Background Technology

[0002] With the continuous development of mobile internet, live streaming technology has also advanced rapidly. Among the many live streaming modes currently available, live streaming with real people has always been the mainstream. However, with the development of artificial intelligence technology, virtual anchors have become an important part of internet activities. Virtual anchors consist of digital humans / virtual humans (hereinafter collectively referred to as digital humans). Specifically, when the set start time of the live stream arrives, the digital human is controlled to simulate a real person's live stream based on a preset image, voice, and scene, introducing products and responding to questions from viewers. The live stream ends when the set end time arrives.

[0003] However, the current live streaming format based on digital humans is relatively monotonous for users and cannot effectively provide personalized live streaming services, resulting in a low conversion rate. Therefore, it is necessary to develop different live streaming methods based on digital humans to provide personalized live streaming services to users with a higher probability, thereby improving the conversion rate. Summary of the Invention

[0004] This application provides a method, device, storage medium, and program product for live streaming based on digital humans, which addresses the problems of the limited live streaming format of digital humans, the inability to provide personalized live streaming services to users, and the low conversion rate of live streaming. It aims to achieve different live streaming methods based on digital humans, provide personalized live streaming services to users with a higher probability, and thus improve the conversion rate of live streaming.

[0005] This application provides a live streaming method based on digital humans, applied to a server. The method includes: publishing a viewing link for a live streaming task, the live streaming task including a public live stream of audio and video explanations of at least one topic based on a digital human; responding to a live streaming viewing request initiated by any client at any time through the viewing link, creating a private streaming process for any client, and using the private streaming process to stream the public live stream to any client so that any client can play the public live stream in the live stream room, which also includes a question entry point; receiving target question information related to the currently streamed target topic content sent by any client, the target question information being sent by any client in response to a question initiated by a user through the question entry point; generating target answer information corresponding to the target question information using an artificial intelligence (AI) model, and generating a private live stream of audio and video broadcasting the target answer information based on the target answer information using a digital human; using the private streaming process to stream the private live stream to any client so that any client can switch from the public live stream to the private live stream to play the private live stream in the live stream room, and continuing to play the public live stream after the private live stream ends.

[0006] This application also provides a live streaming device based on a digital human, comprising: a live streaming task publishing module for publishing a viewing link for a live streaming task, wherein the live streaming task includes a public live stream of audio and video explanations of at least one topic based on a digital human; a private process creation module for responding to a live streaming viewing request initiated by any client at any time through the viewing link, creating a private push streaming process for any client, and using the private push streaming process to push the public live stream to any client so that any client can play the public live stream in the live streaming room, which also includes a question entry point; and a question information receiving module for receiving questions sent by any client related to the current live stream. The system includes: a target question information related to the target topic content, which is sent by any client in response to a user's question-asking action through the question entry; a content generation module, which uses an artificial intelligence (AI) model to generate target answer information corresponding to the target question information, and generates a private live stream based on the target answer information, which is then broadcast in audio and video by a digital human; and a streaming module, which uses a private streaming process to stream the private live stream to any client, allowing any client to switch from the public live stream to the private live stream to play the private live stream in the live stream room, and to continue playing the public live stream after the private live stream has finished playing.

[0007] This application also provides an electronic device, including: a memory and a processor; the memory for storing a computer program; and the processor, coupled to the memory, for executing the computer program to implement the steps in the above-described digital human-based live streaming method.

[0008] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the steps in the live streaming method based on digital humans.

[0009] This application also provides a computer program product, which includes a computer program / instructions that, when executed by a processor, enable the processor to implement the steps in the above-described live streaming method for digital humans.

[0010] In this embodiment, the live stream is divided into a public live stream and a private live stream. After the server publishes the viewing link for the live stream task, for any client's live stream viewing request initiated through the link at any time, the server can create a private streaming process for that client and push the public live stream to that client via the private streaming process, allowing the client to watch the public live stream in the live stream room, thus achieving the user's goal of watching the public live stream. Furthermore, when any client initiates a question related to the currently broadcast topic through the question entry in the live stream room, the server can also provide a private live stream with audio playback of the target answer, and push the private live stream to that client using the private streaming process, allowing the client to switch from the public live stream to the private live stream, and to continue playing the public live stream after the private live stream ends. This achieves personalized answers to any user's questions through private live streams, realizing a personalized experience for each user, thereby improving the user's experience in the live stream room and promoting live stream conversion rates. Simultaneously, it can fully leverage the advantages of digital humans in terms of live stream efficiency, improving live stream efficiency. Attached Figure Description

[0011] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0012] Figure 1 A schematic diagram of a live streaming system based on digital humans provided as an exemplary embodiment of this application;

[0013] Figure 2a A schematic diagram of a live broadcast screen provided for an exemplary embodiment of this application;

[0014] Figure 2b A schematic diagram of another live broadcast screen provided for another exemplary embodiment of this application;

[0015] Figure 2cA schematic diagram of yet another live broadcast screen provided for yet another exemplary embodiment of this application;

[0016] Figure 2d A schematic diagram of yet another live broadcast screen provided for yet another exemplary embodiment of this application;

[0017] Figure 3 A flowchart illustrating a live streaming method based on digital humans, provided as an exemplary embodiment of this application;

[0018] Figure 4 A schematic diagram of the structure of a live streaming device based on a digital human, provided as an exemplary embodiment of this application;

[0019] Figure 5 A flowchart illustrating another digital human-based live streaming method provided as another exemplary embodiment of this application;

[0020] Figure 6 A schematic diagram of another digital human-based live streaming device provided as another exemplary embodiment of this application;

[0021] Figure 7 This is a schematic diagram of the structure of an electronic device provided as an exemplary embodiment of this application. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0023] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0024] To address the technical issues of the aforementioned digital human live streaming format being too simplistic, failing to provide personalized live streaming services, and resulting in low conversion rates, this application embodiment divides the live streaming screen into a public live streaming screen and a private live streaming screen. Specifically, after the server publishes the viewing link for the live streaming task, for any client's live streaming viewing request initiated through the viewing link at any time, the server can create a private streaming process for that client and push the public live streaming screen to that client through the private streaming process, allowing the client to play the public live streaming screen in the live streaming room, thereby achieving the user's goal of watching the public live streaming screen. Additionally, for any client's question-and-answer entry point in the live streaming room... When dealing with target questions related to the current live stream's topic, the server can provide a private live stream with audio playback of the target answer. This private live stream can be pushed to any client via a private streaming process, allowing the client to switch from the public live stream to the private one, and to continue playing the public live stream after the private one finishes. This personalized approach allows for customized answers to any user's questions, achieving a truly personalized experience and improving the user experience in the live stream, thus boosting conversion rates. Simultaneously, it fully leverages the advantages of digital humans in terms of live stream efficiency, thereby enhancing overall efficiency.

[0025] The following describes in detail a solution provided by an embodiment of this application, with reference to the accompanying drawings.

[0026] Figure 1 A schematic diagram of a digital human live streaming system provided as an exemplary embodiment of this application. (See diagram below.) Figure 1 As shown, the system includes: client 101 and server 102, which can communicate with each other.

[0027] In this embodiment, client 101 can be a terminal device for user use. For example, client 101 can be a smart handheld device, such as a smartphone, tablet, laptop, or desktop computer, etc.; or client 101 can also be a smart wearable device, such as a smartwatch, smart bracelet, etc.; or client 101 can also be various smart home appliances with display screens, such as smart TVs, smart large screens, or smart robots, etc. Furthermore, various applications can be installed on client 101. Applications can be standalone apps or mini-programs that rely on standalone apps to run; there is no limitation on this. For example, applications can be shopping applications, ride-hailing applications, video playback applications, etc. In addition, applications can also have live streaming capabilities. For example, a live stream can explain the services or products offered by the application, allowing users to learn about and order the services or products displayed in the live stream.

[0028] In this embodiment, the implementation form of the server 102 is not limited. The server 102 can be a physical server, a cloud server, a server cluster, etc.

[0029] In this embodiment, the communication connection between client 101 and server 102 can be a wireless communication connection or a wired communication connection, depending on the implementation of server 102. When server 102 is implemented as a physical server, either wireless or wired communication can be used. When server 102 is implemented as a cloud server, wireless communication can be used. Optionally, wireless communication can be achieved through a mobile network. The mobile network standard can be any of 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax, or a future network standard. Additionally, when client 101 and server 102 are located on the same local area network, they can also achieve wireless communication connection via Bluetooth, WiFi, infrared, Zigbee, or NFC. Furthermore, server 102 can also establish a communication connection with client 101 by creating a streaming process.

[0030] In practical applications of digital human live streaming, the entire live stream is a public broadcast, typically pushed to users watching the same stream via a shared streaming process. These viewers share the same live stream room throughout the entire broadcast. Furthermore, each user can see any question asked by another user, as well as audio and video clips of the digital human explaining those questions. However, this format of digital human live streaming is relatively monotonous for users, failing to provide personalized live streaming services effectively, resulting in a low conversion rate.

[0031] To address the aforementioned technical issues, this embodiment divides the live stream into a public live stream and a private live stream. For any client 101 that initiates a live stream viewing request at any time through a viewing link of a live stream task published by the server 102, the server 102 can create a streaming process and push the public live stream to that client 101 for playback in the live stream room. When any client 101 initiates a question related to the currently broadcast topic through the question entry in the live stream room, the server 102 can also provide a private live stream with audio playback of the target answer, and push the private live stream to that client 101 using the streaming process. This allows the client 101 to switch from the public live stream to the private live stream, thereby providing personalized answers to any user's questions through a private live stream, achieving a personalized experience for each user, improving the user experience in the live stream room, and increasing the live stream conversion rate.

[0032] In this embodiment, before publishing the viewing link for the live streaming task, the server 102 needs to create the live streaming task. Typically, each live stream corresponds to one live streaming task, and each live streaming task has its own theme content. The live streaming task includes a public live streaming screen where a digital human provides audio and video explanations of at least one theme content. The public live streaming screen is a screen publicly accessible to all users, and the content seen by each user is identical. The public screen includes at least one audio and video segment corresponding to at least one theme content. Correspondingly, the private live streaming screen is a private screen that provides audio and video answers to questions raised by each user. The private screen includes audio and video segments explaining the answers to questions raised by any user. The theme content refers to the core content and topics to be discussed and presented during the live stream, and the theme content is usually provided by a theme content provider. Furthermore, the implementation form of the digital human in the live streaming screen can be 2D or 3D, without limitation.

[0033] Optionally, creating a live streaming task includes: the topic content provider submitting the creation requirement information for the live streaming task, which includes at least the topic content to be live streamed; and creating the live streaming task based on the creation requirement information.

[0034] In this embodiment, the topic content of the live stream is not limited. In practical applications, the topic content will vary depending on the technical field of the topic content provider. For example, if the topic content provider is in the rental field, the topic content of the live stream task can be a general term for various rental services that need to be live streamed, such as vehicle rental; or, a type of rental vehicle can also be a topic content, so the live stream task can have multiple topics, such as crane rental, articulated boom truck rental, forklift rental, etc. As another example, if the topic content provider is in the e-commerce field, the topic content of the live stream task can be a general term for various goods that need to be live streamed, such as food, clothing, accessories, etc.; or, a type of goods can also be a topic content, so the live stream task can have multiple topics, such as T-shirts, skirts, pants, etc. For example, if the content provider is in the real estate sector, the live-streaming task could be a general term for housing information, such as housing rentals; or, a type of housing information could be considered a single topic, allowing for multiple topics in the live-streaming task, such as storefronts, residential apartments, office space rentals, etc.; or, any room within the same type of housing information could also be considered a single topic, allowing for multiple topics in the live-streaming task, such as master bedroom, secondary bedroom, living room rentals, etc. Similarly, if the content provider is in the domestic services sector, the content could be a general term for various domestic services information to be introduced in the live stream, such as domestic services; or, a type of domestic service information could be considered a single topic, allowing for multiple topics in the live-streaming task, such as cleaning, nannies, tutors, etc.

[0035] Optionally, based on the creation requirements of the live streaming task, a live streaming task is created, including: generating an audio signal to explain at least one topic based on the creation requirements of the live streaming task; recording multiple action frames corresponding to the digital human, adding attribute tags to each action frame, the attribute tags being used to identify the content attributes suitable for the action frame; selecting a first target action frame that matches each topic from multiple action frames based on the attribute information of each topic and the attribute tags of each action frame; and, according to the order of explaining at least one topic, driving the digital human in the first target action frame that matches each topic with sound based on the audio signal explaining each topic, to obtain a public live streaming frame.

[0036] Optionally, based on the live streaming task creation requirements, an audio signal for explaining at least one topic is generated, including: determining detailed information related to at least one topic based on the live streaming content; extracting text from the detailed information related to at least one topic to obtain text information of the detailed information related to at least one topic; and using a text-to-speech model to convert the text information related to at least one topic into audio to obtain an audio signal for explaining at least one topic.

[0037] For example, assuming that at least one topic of the live stream is "crane rental", then based on the topic "crane rental", detailed information related to "crane rental" can be determined. The detailed information can at least include multiple rental methods for cranes, the rental fee for each rental method, and the usage time. Further, the text information of the above "crane rental" details is extracted to obtain the text information of the above details. Then, the text information of the above details is converted into audio to generate an audio signal explaining the topic of "crane rental".

[0038] Optionally, multiple action frames corresponding to the digital human are recorded, including: determining multiple themes for the live stream; recording the actions of a live streamer under each theme using a camera, resulting in multiple action frames; and using these recorded actions as the digital human's corresponding action frames. Furthermore, to obtain more accurate action frames for the digital human, a motion frame generation model can be used to learn and generate target action frames corresponding to each theme, based on the live streamer's actions captured under each theme, and these target action frames can be used as the action frames displayed during the digital human's live stream.

[0039] In this embodiment, each action frame has an attribute tag, and each topic content has attribute information. The attribute tags and attribute information can be the type attributes of the topic content. The attribute tags and attribute information have a one-to-one correspondence, so as to select the first target action frame that matches each topic content from multiple action frames based on the attribute information of each topic content and the attribute tags of each action frame.

[0040] Optionally, based on the attribute information of each topic content and the attribute tags of each action frame, a first target action frame that is compatible with each topic content is selected from multiple action frames, including: based on the attribute information of each topic content, selecting an attribute tag that is compatible with the attribute information of each topic content from the attribute tags of multiple action frames, and using the action frame corresponding to the tag as the first target action frame that is compatible with the topic content.

[0041] In addition, at least one topic in the current live streaming task has a presentation order. Based on this, the digital human in the first target motion frame adapted to each topic can be voice-driven according to the audio signal of the presentation of at least one topic, in order to obtain the public live streaming screen.

[0042] In this embodiment, after creating a live streaming task, the server 102 can publish a viewing link for the live streaming task, allowing users to trigger an operation on the viewing link at any time. Specifically, any client 101 responds to a user's trigger operation on the viewing link at any time by sending a live streaming viewing request to the server 102. Correspondingly, the server 102 responds to the live streaming viewing request initiated by any client 101 at any time via the viewing link by creating a streaming process for the client 101 and using the streaming process to stream the public live stream to the client 101. Accordingly, the client 101 receives the public live stream sent by the server 102 through the streaming process and plays the public live stream in the live streaming room; that is, at this time, the client 101 is in public live streaming mode. In this system, server 102 responds to any live streaming request initiated by client 101 at any time via a viewing link, creates a streaming process for client 101, and uses this process to stream the public live stream to client 101. This can be understood as the live stream starting from the beginning of the live stream after a user enters the live stream room. In contrast, traditional live streams have fixed start and end times, with the live stream starting from the time the user enters the live stream room. Compared to traditional live streams, this system allows users to see the entire live stream at any time they enter the live stream room, providing personalized live stream services for each user and improving the viewing experience.

[0043] It should be noted that this embodiment does not limit the streaming process used for public and private live streams. Any implementation that can push public and private live streams to each corresponding client 101 is applicable to this embodiment. Optionally, public live streams of different clients 101 can share the same streaming process, i.e., the public streaming process, and the public live stream is pushed to each client 101 through the public streaming process; for private live streams, the private live stream can also be pushed to the client 101 that needs the private live stream through the public streaming process. Optionally, public live streams of different clients 101 can share the same streaming process, and the public live stream is pushed to each client 101 through the public streaming process; while for private live streams, the private live stream can be pushed to the corresponding client 101 through the private streaming process corresponding to each client 101. However, when using the public streaming process to push public live streams, it is not possible to enable or disable the live stream for the current user at any time. More preferably, the public and private live stream screens of each client 101 are pushed to the corresponding client 101 through the private live stream process of each client 101. Different processes push the stream to the client 101 of different users. The live stream can start at any time according to the time when the user enters the live stream room and can be closed at any time when the user leaves the live stream room. No matter when the user enters the live stream room, the user can see the entire live stream process, giving the user more opportunities to participate in the live stream interaction, and thus more opportunities to provide personalized live stream services to users, thereby improving the live stream conversion rate.

[0044] It should be noted that the following embodiments focus on the fact that the public live broadcast screen and private live broadcast screen of each client 101 are pushed to the corresponding client 101 through the private live broadcast process corresponding to each client 101.

[0045] Figure 2a This is an exemplary live stream screenshot. The live stream screenshot includes a live stream background image, a live stream name display area, a user viewing area, a avatar display area, a comment display area, a contact information display area, and a full service window display area. This embodiment does not limit the display hierarchy of the above-mentioned components of the live stream screenshot. Optionally, the live stream background image can be displayed as a floating layer at the bottom layer, and the live stream name display area, user viewing area, avatar display area, comment area, contact information display area, and full service window display area can be simultaneously displayed on top of the live stream background image with a preset transparency. In addition, the comment display area can be displayed on top of the live stream background image and the avatar display area with a preset transparency.

[0046] The following is a detailed description of each component of the live stream. It should be noted that the settings and functions of the various components of the live stream in this embodiment are merely illustrative and do not constitute a limitation.

[0047] The live stream background image can display multiple themes and their service attributes in text format. For example, the themes could be "machinery and equipment, furniture and appliances, celebration equipment, building materials, clothing rental, outdoor equipment, etc."; and the service attributes could be "covering multiple merchants; various rental categories; one-on-one service, rapid response, etc."

[0048] Live Stream Name Display Area. The live stream name display area can be located in the upper left corner of the live stream screen. This area can include the live stream name, logo, and functional controls. One such control is a "Follow" control, which allows users to follow the live stream and become its fans. Fans of the live stream can enjoy preset privileges, such as live stream reminders and discounts on products sold during the live stream.

[0049] A user display area for live stream viewers. This area can be located in the upper right corner of the live stream screen and is used to display users currently watching the live stream. This embodiment does not limit the implementation of displaying users currently watching the live stream; for example, it can display user avatars, username tags, etc. Additionally, user avatars can have control attributes, meaning that clicking on a user avatar can take you to the corresponding user's homepage.

[0050] Digital Human Showcase Area. This area showcases digital humans currently live-streaming. These live-streaming digital humans have preset expressions and actions, essentially acting as the host in the showcase. In addition to being a host, the digital humans can also act as assistants. Assistants reply to user questions in the comment section using the format "@ + username of the user who asked the question + answer information".

[0051] Lead generation card display area. This area displays lead generation cards, allowing users to conduct in-depth inquiries and thus improve the conversion rate of the live stream. Detailed information about lead generation cards can be found in the relevant descriptions of the following embodiments, and will not be repeated here.

[0052] The All Services window display area showcases all service windows. Each service window has control properties; selecting any service window will display the All Services page, which contains multiple topic content items. Each topic content item also has control properties; selecting any topic content item will display its corresponding details page, allowing users to easily access detailed information about each item.

[0053] Comment Display Area. The comment display area can be used to display questions raised by users corresponding to the currently playing live stream client 101, as well as combinations of one or more of the following question types: questions raised by all other users in the live stream, questions raised by users at a preset level in the live stream, preset questions provided by server 102 for users to refer to, etc. The preset questions provided by server 102 can be hot topics obtained by server 102 from historical live streams with a frequency exceeding a set frequency threshold; or, the preset questions provided by server 102 can also be hot topics obtained from historical live streams and those obtained in the current live stream with a frequency exceeding a set frequency threshold, etc. The preset questions provided by server 102 can be displayed in a certain order in the comment display area, for example, by frequency, and displayed sequentially from bottom to top. Additionally, identifier controls can be added to the preset questions provided by server 102 (the identifier controls can be considered as the implementation of the question control included in the question entry in the following embodiments). For example, "+1" or "ask a question" controls can be added to the preset questions. Correspondingly, in response to the selection operation of the identifier control for any question, the question will be displayed again in the comment area to prompt that the question has been asked again by the user. Accordingly, the comment display area is also used to display the answer information corresponding to the question asked. This embodiment is not limited to the way of replying to the answer information corresponding to the above question in the comment area. For example, it can be displayed in the comment display area in the form of "@ + the user name who asked the question + the answer information" in a bottom-to-top sliding format by a digital human playing the role of an assistant; or, the answer link can be displayed in the comment display area, and the user can obtain the answer information by viewing the content contained in the link, etc. Preferably, the comment area is only used to display the questions asked by the user corresponding to the client 101 currently playing the live broadcast, the hot questions provided by server 102, and the corresponding answer information, thereby achieving the purpose of providing personalized live broadcast services to users.

[0054] In this embodiment, the live streaming room also includes a question-asking entry point, which allows users to ask questions during the live stream. This embodiment does not limit the implementation of the question-asking entry point; it can be interactive visual information displayed on the client 101 interface, such as a voice input control, a text input box, a question shortcut key, a question link, etc. Figure 2a As shown, the text input box displays the text "Say hello." In response to the user's interaction with the text input box, an input keyboard appears, including both voice and text input controls. Users can ask questions in the live stream by using the voice input control to input voice messages or the text input control to input text messages. Correspondingly, the user's questions are displayed in the comment section so that the host or assistant can recognize them.

[0055] Optionally, the question entry point also includes a question control displayed in the live stream that is associated with specific question information. The specific question information includes high-frequency question information with a question frequency exceeding a set frequency threshold and / or category question information involving a specific category; wherein, the specific categories corresponding to different clients 101 may be the same or different. Based on this, in this embodiment, high-frequency question information with a question frequency exceeding a set frequency threshold and / or category question information involving a specific category can be obtained from the question information from each client 101 as specific question information; the specific question information and the question control are pushed to any client 101 using a private streaming process, so that any client 101 can display the specific question information and its associated question control during the playback of the public live stream or the private live stream.

[0056] Furthermore, in response to a user's questioning action initiated through the questioning portal, target question information related to the currently live-streamed target topic content is sent to the server 102, including: responding to the user's triggering action on any question control, obtaining the target question information according to the type of specific question information associated with any question control; sending the target question information to the server 102, and displaying the target question information in the question area of ​​the live-streaming room using a display method adapted to the type of specific question information associated with any question control.

[0057] Optionally, based on the type of specific question information associated with any question control, the target question information is obtained, including: if the specific question information associated with any question control is high-frequency question information, the specific question information associated with any question control is used as the target question information; if the specific question information associated with any question control is category question information, a question input interface is displayed, the user's input operation in the question input interface is responded to, and the extended question entered by the user is obtained as the target question information.

[0058] Optionally, a display method adapted to the type of specific question information associated with any question control is adopted to display the target question information in the question area of ​​the live broadcast room. This includes: if the specific question information associated with any question control is a high-frequency question, displaying the target question information and the associated question control in the area above or below the specific question information associated with any question control in the question area; if the specific question information associated with any question control is a category question, displaying the target question information as the latest question information in the top or bottom area of ​​the question area according to the scrolling direction of the question information in the question area. Specifically, if the scrolling direction is from top to bottom, the target question information is displayed as the latest question information in the top area of ​​the question area; if the scrolling direction is from bottom to top, the target question information is displayed as the latest question information in the bottom area of ​​the question area.

[0059] Optionally, to allow users watching the public live stream to have priority in replying and improve the conversion rate of the live stream, the question entry point can also include a privilege card icon displayed in the live stream, such as... Figure 2b As shown, the rights card icon corresponds to a rights card, which represents the priority response and highlighting rights for target question information from any client 101.

[0060] In this embodiment, the benefit card has certain issuance conditions, and a benefit card is issued to any client 101 when the conditions are met. Optionally, after the public live broadcast is pushed to any client 101, it can be determined whether the user meets the benefit card issuance conditions based on the user account information bound to any client 101 and / or the duration information of the public live broadcast played by any client 101. The duration information of the public live broadcast played by any client 101 is the duration information of the user watching the live broadcast.

[0061] Specifically, determining whether a user meets the eligibility criteria for a benefits card based on the user account information bound to any client 101 and / or the duration of public live stream playback on any client 101 includes: determining whether a user meets the eligibility criteria for a benefits card based on the user account information bound to any client 101; or, determining whether a user meets the eligibility criteria for a benefits card based on the duration of public live stream playback on any client 101; or, determining whether a user meets the eligibility criteria for a benefits card based on the user account information bound to any client 101 and the duration of public live stream playback on any client 101.

[0062] Optionally, based on the user account information bound to any client 101, determine whether the user meets the conditions for issuing the benefit card, including: determining whether the user account information bound to any client 101 meets the preset level; if the user account information bound to any client 101 meets the preset level, determine that the user meets the conditions for issuing the benefit card; otherwise, determine that the user does not meet the conditions for issuing the benefit card.

[0063] Optionally, based on the duration information of the public live broadcast played by any client 101, it is determined whether the user meets the conditions for issuing the rights card, including: determining whether the duration information of the public live broadcast played by any client 101 meets the preset duration; if the duration information of the public live broadcast played by any client 101 meets the preset duration, it is determined that the user meets the conditions for issuing the rights card; otherwise, it is determined that the user does not meet the conditions for issuing the rights card.

[0064] Optionally, based on the user account information bound to any client 101 and the duration of the public live broadcast played by any client 101, it is determined whether the user meets the conditions for receiving a rights card, including: determining whether the user account information bound to any client 101 meets the preset level and whether the duration of the public live broadcast played by any client 101 meets the preset duration; if the user account information bound to any client 101 meets the preset level and the duration of the public live broadcast played by any client 101 meets the preset duration, the user is determined to meet the conditions for receiving a rights card; if the user account information bound to any client 101 does not meet the preset level or the duration of the public live broadcast played by any client 101 does not meet the preset duration, the user is determined not to meet the conditions for receiving a rights card.

[0065] For example: Suppose the conditions for issuing the privilege card are "the user corresponding to any client 101 is a VIP user and / or the user does not perform any operation in the live broadcast room within 20 seconds of any client 101 playing the public live broadcast". Then, the user's eligibility for the privilege card is determined based on whether the user corresponding to any client 101 is a VIP user and / or whether the user performs any operation in the live broadcast room within 20 seconds of any client 101 playing the public live broadcast.

[0066] Furthermore, if the above-mentioned conditions for issuing benefit cards are met, the server 102 allocates a benefit card to any client 101 that meets the conditions for issuing benefit cards, and sends the benefit card icon to any client 101 so that any client 101 can display the benefit card icon in the live broadcast room.

[0067] It should be noted that the privilege cards can be issued during either a public or private live stream, and typically one privilege card is issued to each user. Each privilege card allows the user to ask one question. In practice, if a user needs multiple privilege cards, they can comment "multiple privilege cards" in the comment section, and Digital Human will issue multiple privilege cards to the user at its discretion based on their specific circumstances.

[0068] In this embodiment, during the playback of a public live stream in the live streaming room, any client 101 can receive a rights card icon sent by the server 102 if the user meets the conditions for issuing the rights card; such as Figure 2c As shown, the privilege card icon is displayed at a first size in the first area of ​​the live broadcast room. When the display time of the privilege card icon reaches a set time threshold, the privilege card icon is displayed at a second size in the second area of ​​the live broadcast room by dynamically shrinking from the first area to the second area. The second size is smaller than the first size. The first area can be the center area, and the second area can be the lower left corner, lower right corner, upper left corner, or upper right corner, etc. The dynamic shrinking method of the privilege card aims to attract the user's visual information.

[0069] Following the aforementioned embodiment including a question-asking entry point in the live streaming room, after a user initiates a question through the question-asking entry point, client 101 responds to the user's question-asking operation by sending target question information related to the currently live-streamed target topic content to server 102. Correspondingly, server 102 receives target question information related to the currently live-streamed target topic content sent by any client 101. After receiving target question information related to the currently live-streamed target topic content sent by any client 101, server 102 can also utilize an artificial intelligence (AI) model to generate target answer information corresponding to the target question information, and generate a private live streaming screen based on a digital human to broadcast the target answer information via audio and video; the private live streaming screen is then pushed to any client 101 using a private streaming process. Correspondingly, any client 101 receives a private live stream image sent by the server 102 using a private streaming process, switches from the public live stream image to the private live stream image to play the private live stream image in the live stream room, and continues to play the public live stream image after the private live stream image finishes playing. Through the private live stream image, personalized answers are provided to questions raised by any user, achieving a personalized experience for each individual, thereby improving the user experience in the live stream room and promoting live stream conversion rates. For questions raised by users during the live stream, based on the use of a private process for streaming, questions can be answered individually through a private live stream image, achieving a personalized experience for each individual, improving the user experience in the live stream room, and promoting live stream conversion rates; at the same time, the advantages of digital humans in terms of live stream efficiency are fully utilized, improving live stream efficiency.

[0070] The AI ​​model can be a multimodal Large Language Model (LLM), possessing deep semantic understanding and generation capabilities across modalities and languages. In generating the target answer information, it can employ at least one method, such as natural language processing, searching in a database, and / or content creation based on semantic understanding, to generate the target answer information for the target question. Large language models can be, but are not limited to, models from the GLM (Generated Linear Model) series, the Qwen series, etc.

[0071] Optionally, any client 101 responds to a user's question-asking operation initiated through the question entry point by sending target question information related to the currently live-streamed target topic content to the server 102. This includes: responding to a user's trigger operation on the benefit card icon, changing the display status of the benefit card icon to a used state or a reduced quantity state; responding to a user's question-asking operation, obtaining target question information related to the currently live-streamed target topic content, and sending the target question information to the server 102; and highlighting the target question information in the question area of ​​the live stream, and dehighlighting the target question information when the live stream is playing a private live stream. The highlighting methods for the target question information include, but are not limited to, pinning to the top, flashing, etc.; the corresponding methods for dehighlighting the target question information are: no longer pinning to the top or flashing, and the target question information begins to scroll as other question information appears, which may eventually scroll outside the question area.

[0072] Optionally, the display state of the benefit card icon includes an on state and a grayed-out state. The on state indicates that the benefit card is unused, and the grayed-out state indicates that it is used. Accordingly, in response to a user's trigger operation on the benefit card icon, the display state of the benefit card icon is changed to the used state or the quantity decreases. Optional implementations include: in response to a user's trigger operation on the benefit card icon, changing the display state of the benefit card icon from the on state to the grayed-out state. Alternatively, the benefit card icon has a quantity indicator. Accordingly, in response to a user's trigger operation on the benefit card icon, the display state of the benefit card icon is changed to the quantity decreases. Optional implementations include: in response to a user's trigger operation on the benefit card icon, decrementing the quantity indicator of the benefit card icon by 1.

[0073] Optionally, any client 101 responds to a user's questioning action and obtains target question information related to the currently broadcast target topic content, including: responding to the user's input action in the comment section of the live broadcast room and obtaining the user's input question information related to the currently broadcast target topic content as target question information; and / or, displaying at least one candidate question information in the live broadcast room, responding to the user's selection action on at least one candidate question information, and using the selected candidate question information as target question information; at least one candidate question information is associated with the currently broadcast target topic content.

[0074] In some embodiments, generating a private live broadcast based on the target answer information and audio / video playback of the target answer information by a digital human includes: converting the target answer information into a target audio signal using a text-to-speech model; selecting a second target action screen that matches the target answer information from a variety of action screens corresponding to the digital human; and driving the digital human in the second target action screen with sound according to the target audio signal to obtain the private live broadcast.

[0075] Optionally, from the various action frames corresponding to the digital human, a second target action frame that matches the target answer information is selected, including: extracting keywords from the target answer information, where the keywords can reflect the target theme content corresponding to the target answer information; obtaining attribute tags from the various action frames corresponding to the digital human; selecting tags from the attribute tags of the various action frames corresponding to the digital human whose matching degree with the keywords of the target answer information meets the matching degree threshold as target attribute tags; and using the action frames corresponding to the target attribute tags as the second target action frames that match the target answer information.

[0076] It should be noted that, in order to improve the timeliness of the digital human's response to user answers and enhance user experience, in this embodiment, the target answer information can be displayed as text in the comment display area in addition to being broadcast audio and video by the digital human. Specifically, the server 102 sends the target answer information as part of the private live stream screen to any client 101. Correspondingly, any client 101 receives the target answer information sent by the server 102, incorporates the target answer information as part of the private live stream screen, and, while controlling the digital human to broadcast the target answer information audio and video in the live stream, simultaneously displays the target answer information corresponding to the target question information as text in the live stream. For example, displaying the target answer information as text in the live stream can be done by replying in the comment display area in the form of "@ + the user name who asked the question + the answer information".

[0077] In this embodiment, to improve the conversion rate of the live stream, the server 102 adds a first lead generation card to the public live stream screen and a second lead generation card to the private live stream screen. Correspondingly, for the client 101, the first lead generation card is displayed on the public live stream screen, and the second lead generation card is displayed on the private live stream screen. The first lead generation card is a general lead generation card unrelated to the product category, while the second lead generation card is a specific lead generation card related to the target product category involved in the target question information.

[0078] Optionally, the first and second contact cards have display attributes such as display style and content. The first and second contact cards can have the same or different display styles. Figure 2a and 2d As shown, the first and second contact cards can be displayed in a fixed-shape pop-up window on the live stream screen. Furthermore, the content displayed on the first and second contact cards will differ. For example... Figure 2a As shown, the first contact card is displayed on the public live stream screen, but it does not display any content related to the product category. For example... Figure 2d The second contact card shown is displayed in a private live stream room, and it displays content related to the category corresponding to the private live stream room. Furthermore, the customer service phone numbers associated with the first and second contact cards are different; the first contact card is associated with general customer service, while the second contact card is associated with a specific customer service number corresponding to the product category.

[0079] Optionally, the public or private live stream screen of any client 101 may also include: a voice prompt guiding the user to initiate a consultation through the first or second contact card, so that the user can trigger an action on the first or second contact card. For example, the voice prompt could be "Welcome to use the contact card for in-depth consultation" or "Using the contact card can get a more detailed introduction," etc.

[0080] Optionally, in response to a user's triggering action on a target contact card, either client 101 sends a consultation request to server 102. The target contact card can be either a first contact card or a second contact card. Correspondingly, server 102 receives the consultation request from either client 101. If the target contact card is the first contact card, it selects a target resource provider based on the currently playing target topic content; if the target contact card is the second contact card, it selects a target resource provider based on the target product category. Based on the target interaction mode associated with the target contact card, a target interaction channel is established between either client 101 and the target resource provider, allowing either client 101 to interact with the target resource provider through this channel. Correspondingly, either client 101 displays an interactive interface associated with the target interaction channel, allowing the user to consult with the target resource provider through the target interaction channel.

[0081] In this embodiment, the type of the target interaction channel is not limited. For example, the target interaction channel can be an audio / video call channel. Specifically, in response to the user's selection operation of the "one-to-one" interactive control on the contact card, the audio / video call function of the client 101 is invoked, and an audio / video call channel is created between the client 101 and the customer service representative, enabling audio / video calls between the user and the customer service representative. As another example, the target interaction channel can also be an instant messaging application (such as WeChat, DingTalk, or QQ) channel. Specifically, in response to the user's selection operation of the "one-to-one" interactive control on the contact card, the instant messaging application of the client 101 is invoked, and an instant messaging channel is created between the instant messaging application and the customer service representative, enabling instant communication between the user and the customer service representative.

[0082] In this embodiment, the live stream is divided into a public live stream and a private live stream. After the server publishes the viewing link for the live stream task, for any client's live stream viewing request initiated through the link at any time, the server can create a private streaming process for that client and push the public live stream to that client via the private streaming process, allowing the client to watch the public live stream in the live stream room, thus achieving the user's goal of watching the public live stream. Furthermore, when any client initiates a question related to the currently broadcast topic through the question entry in the live stream room, the server can also provide a private live stream with audio playback of the target answer, and push the private live stream to that client using the private streaming process, allowing the client to switch from the public live stream to the private live stream, and to continue playing the public live stream after the private live stream ends. This achieves personalized answers to any user's questions through private live streams, realizing a personalized experience for each user, thereby improving the user's experience in the live stream room and promoting live stream conversion rates. Simultaneously, it can fully leverage the advantages of digital humans in terms of live stream efficiency, improving live stream efficiency.

[0083] Figure 3 This is a flowchart illustrating a live streaming method based on a digital human, provided as an exemplary embodiment. Figure 3 As shown, this method is applied to the server side and includes:

[0084] 301. Publish the viewing link for the live broadcast task. The live broadcast task includes a public live broadcast screen in which a digital human provides audio and video explanation of at least one topic. The public live broadcast screen includes at least one audio and video segment corresponding to at least one topic.

[0085] 302. Respond to any client's live streaming request initiated by the viewing link at any time, create a private streaming process for any client, and use the private streaming process to push the public live stream to any client so that any client can play the public live stream in the live stream room. The live stream room also includes a question entry point.

[0086] 303. Receive target question information related to the currently live-streamed target topic content sent by any client. The target question information is sent by any client in response to a user's questioning action initiated through the question entry.

[0087] 304. Use artificial intelligence (AI) models to generate target answer information corresponding to target question information, and generate a private live broadcast of audio and video broadcast of the target answer information based on a digital human;

[0088] 305. Utilize a private streaming process to stream a private live stream to any client, allowing any client to switch from the public live stream to the private live stream to play the private live stream in the live stream room, and to continue playing the public live stream after the private live stream has finished playing.

[0089] Optionally, before publishing the viewing link for the live streaming task, the process further includes: generating an audio signal to explain at least one topic based on the live streaming task creation requirement information; recording multiple action frames corresponding to the digital human, adding attribute tags to each action frame, the attribute tags being used to identify the content attributes suitable for the action frame; selecting a first target action frame that matches each topic from multiple action frames based on the attribute information of each topic and the attribute tags of each action frame; and, according to the order in which at least one topic is explained, driving the digital human in the first target action frame that matches each topic with sound based on the audio signal explaining each topic, to obtain a public live streaming frame.

[0090] Optionally, a private live broadcast screen is generated based on the target answer information, which is then broadcast by a digital human to the target answer information. This includes: using a text-to-speech model to convert the target answer information into a target audio signal; selecting a second target action screen that matches the target answer information from a variety of action screens corresponding to the digital human; and driving the digital human in the second target action screen with sound based on the target audio signal to obtain the private live broadcast screen.

[0091] Further optionally, it also includes: adding a first lead generation card to the public live stream screen and adding a second lead generation card to the private live stream screen; wherein the first lead generation card is a general lead generation card unrelated to the product category, and the second lead generation card is a specific lead generation card related to the target product category involved in the target question information.

[0092] Optionally, the method further includes: receiving an inquiry request sent by any client, wherein the inquiry request is sent by any client in response to a user's triggering operation on a target contact card, and the target contact card is either a first contact card or a second contact card; if the target contact card is the first contact card, selecting a target resource provider based on the currently played target topic content; if the target contact card is the second contact card, selecting a target resource provider based on the target product category; and establishing a target interaction channel between any client and the target resource provider based on the target interaction mode associated with the target contact card, so that any client can interact with the target resource provider through the target interaction channel.

[0093] Further, optionally, it also includes: sending the target answer information as part of the private live stream to any client, so that any client can control the digital human to broadcast the target answer information in audio and video while displaying the target answer information in text form during the live stream.

[0094] Optionally, the question entry point includes a privilege card icon displayed in the live stream room. The privilege card icon corresponds to a privilege card, and the privilege card represents the priority reply and highlighting privilege for the target question information from any client. Optionally, after the public live stream is pushed to any client, it can also be determined whether the user meets the conditions for issuing privilege cards based on the user account information bound to any client and / or the duration information of the public live stream played by any client. If the conditions for issuing privilege cards are met, a privilege card is assigned to any client, and the privilege card icon is sent to any client so that the privilege card icon can be displayed in the live stream room.

[0095] Optionally, based on the question information from various clients, high-frequency question information with a question frequency higher than a set frequency threshold and / or category question information involving a specific category can be obtained as specific question information; wherein, the specific categories corresponding to different clients may be the same or different; the specific question information and question control are pushed to any client using a private streaming process, so that any client can display the specific question information and its associated question control during the playback of public live broadcast or private live broadcast.

[0096] The detailed implementation methods and beneficial effects of each step provided in the embodiments of this application have been described in detail in the foregoing embodiments, and will not be elaborated here.

[0097] Figure 4 This is a schematic diagram of the structure of a live streaming device based on a digital human, provided as an exemplary embodiment of this application. Figure 4 As shown, the device includes:

[0098] The live streaming task publishing module 41 is used to publish the viewing link of the live streaming task. The live streaming task includes a public live streaming screen in which a digital human provides audio and video explanation of at least one topic.

[0099] The private process creation module 42 is used to respond to any client's live streaming request initiated by the viewing link at any time, create a private push process for any client, and use the private push process to push the public live stream to any client so that any client can play the public live stream in the live room. The live room also includes a question entry.

[0100] The question information receiving module 43 is used to receive target question information related to the target topic content currently being broadcast by any client. The target question information is sent by any client in response to a question initiated by a user through the question entry.

[0101] The content generation module 44 is used to generate target answer information corresponding to the target question information using an artificial intelligence (AI) model, and to generate a private live broadcast screen based on the target answer information, which is a digital human broadcasting the target answer information in audio and video.

[0102] The streaming module 45 is used to push the private live stream to any client using a private streaming process, so that any client can switch from the public live stream to the private live stream to play the private live stream in the live stream room, and continue playing the public live stream after the private live stream ends.

[0103] Optionally, before the live streaming task publishing module publishes the viewing link for the live streaming task, the module further includes: a generation module, used to generate an audio signal explaining at least one topic based on the live streaming task creation requirement information; a recording module, used to record multiple action frames corresponding to the digital human, and add attribute tags to each action frame, the attribute tags being used to identify the content attributes suitable for the action frame; a selection module, used to select a first target action frame that matches each topic based on the attribute information of each topic and the attribute tags of each action frame; and a driving module, used to drive the digital human in the first target action frame that matches each topic based on the audio signal explaining each topic, in the order of explaining at least one topic, to obtain a public live streaming frame.

[0104] Optionally, when the content generation module generates a private live broadcast of the target answer information based on the target answer information, it specifically performs the following steps: using a text-to-speech model to convert the target answer information into a target audio signal; selecting a second target action screen that matches the target answer information from a variety of action screens corresponding to the digital human; and driving the digital human in the second target action screen with sound based on the target audio signal to obtain the private live broadcast.

[0105] Optionally, it also includes an adding module for adding a first lead generation card on a public live stream screen and a second lead generation card on a private live stream screen; wherein the first lead generation card is a general lead generation card unrelated to the product category, and the second lead generation card is a specific lead generation card related to the target product category involved in the target question information.

[0106] Optionally, the system further includes an interaction channel module for receiving consultation requests sent by any client. The consultation request is sent by any client in response to a user's triggering action on a target contact card, which may be a first contact card or a second contact card. If the target contact card is the first contact card, a target resource provider is selected based on the currently played target topic content. If the target contact card is the second contact card, a target resource provider is selected based on the target product category. Based on the target interaction mode associated with the target contact card, a target interaction channel is established between any client and the target resource provider, enabling any client to interact with the target resource provider through the target interaction channel.

[0107] Optionally, it also includes a sending module for sending the target answer information as part of the private live stream to any client, so that any client can control the digital human to broadcast the target answer information in audio and video while displaying the target answer information in text form in the live stream.

[0108] Optionally, the question entry point includes a privilege card icon displayed in the live stream room. The privilege card icon corresponds to a privilege card, and the privilege card represents the priority reply and highlighting privilege for the target question information from any client. Optionally, after the streaming module pushes the public live stream to any client, it can also be used to determine whether the user meets the conditions for issuing privilege cards based on the user account information bound to any client and / or the duration information of any client playing the public live stream. If the conditions for issuing privilege cards are met, a privilege card is assigned to any client, and the privilege card icon is sent to any client so that any client can display the privilege card icon in the live stream room.

[0109] Optionally, it also includes an acquisition module, used to acquire high-frequency question information with a question frequency higher than a set frequency threshold and / or category question information involving a specific category from the question information from each client as specific question information; wherein the specific categories corresponding to different clients are the same or different; and to push the specific question information and question control to any client using a private streaming process, so that any client can display the specific question information and its associated question control during the playback of public live broadcast or private live broadcast.

[0110] The detailed implementation methods and beneficial effects of each module provided in the embodiments of this application have been described in detail in the foregoing embodiments, and will not be elaborated here.

[0111] Figure 5 A flowchart illustrating another live streaming method based on digital humans, provided as another exemplary embodiment of this application. Figure 5 As shown, this method is applied to any client and includes:

[0112] 501. Respond to the user's trigger operation at any time for viewing the live task's viewing link, and send a live viewing request for the live task to the server. The live task includes a public live broadcast screen in which a digital human provides audio and video explanations of at least one topic.

[0113] 502. Receive the public live stream image sent by the server through the private push stream process corresponding to any client, and play the public live stream image in the live stream room, which also includes a question entry point;

[0114] 503. Respond to the user's questioning operation initiated through the questioning portal, send the target question information related to the target topic content currently being broadcast to the server, so that the server can generate and return a private live broadcast screen based on the digital human to broadcast the target answer information corresponding to the target question information in audio and video.

[0115] 504. Receive the private live stream screen sent by the server using the private push stream process, switch from the public live stream screen to the private live stream screen to play the private live stream screen in the live stream room, and continue playing the public live stream screen after the private live stream screen finishes playing.

[0116] Optionally, the public live stream screen includes a first lead generation card, and the private live stream screen includes a second lead generation card; the first lead generation card is a general lead generation card unrelated to the product category, and the second lead generation card is a specific lead generation card related to the target product category involved in the target question information; correspondingly, in response to the user's trigger operation on the target lead generation card, a consultation request is sent to the server, so that the server can establish a target interaction channel between any client and the target resource party based on the target interaction mode associated with the target lead generation card; the target lead generation card is either the first lead generation card or the second lead generation card; an interactive interface associated with the target interaction channel is displayed, so that the user can consult the target resource party through the target interaction channel.

[0117] Optionally, the public or private live stream may also include: voice prompts from a digital human guiding the user to initiate a consultation through a first or second contact card, so that the user can trigger an action on the first or second contact card.

[0118] Optionally, it also includes: receiving target answer information sent by the server, using the target answer information as part of the private live broadcast screen; and while controlling the digital human to broadcast the target answer information in audio and video in the live broadcast room, displaying the target answer information corresponding to the target question information in text form in the live broadcast room.

[0119] Optionally, the question entry point includes a privilege card icon displayed in the live stream room. The privilege card icon corresponds to a privilege card, which represents the priority reply and prominent display rights for target question information from any client. Responding to a user's questioning action through the question entry point, the system sends target question information related to the currently broadcast target topic to the server. This includes: responding to a user's triggering action on the privilege card icon, changing the display status of the privilege card icon to a used state or a reduced quantity state; responding to a user's questioning action, obtaining target question information related to the currently broadcast target topic, and sending the target question information to the server; and highlighting the target question information in the question area of ​​the live stream room, and de-highlighting the target question information when the live stream room is playing a private live stream.

[0120] Optionally, in response to a user's questioning action, target question information related to the currently broadcast target topic content is obtained, including: in response to a user's input action in the comment section of the live stream, obtaining the user's input question information related to the currently broadcast target topic content as target question information; and / or, displaying at least one candidate question information in the live stream, and in response to a user's selection action on at least one candidate question information, using the selected candidate question information as target question information; at least one candidate question information is associated with the currently broadcast target topic content.

[0121] Optionally, before responding to a user's trigger operation on the benefits card icon, the method further includes: during the playback of a public live stream in the live stream room, receiving a benefits card icon sent by the server when the user meets the conditions for issuing benefits cards; displaying the benefits card icon in a first area of ​​the live stream room at a first size, and when the display duration of the benefits card icon reaches a set duration threshold, displaying the benefits card icon in a second area of ​​the live stream room at a second size, where the second size is smaller than the first size, by dynamically shrinking from the first area to the second area of ​​the live stream room.

[0122] Optionally, the specific question information includes high-frequency question information with a question frequency exceeding a set frequency threshold and / or category question information involving a specific category; wherein, the specific categories corresponding to different clients may be the same or different; in response to a user's questioning operation initiated through the question entry, target question information related to the target topic content currently being broadcast is sent to the server, including: in response to a user's triggering operation on any question control, obtaining the target question information according to the type of specific question information associated with any question control; sending the target question information to the server, and displaying the target question information in the question area of ​​the live broadcast room using a display method adapted to the type of specific question information associated with any question control.

[0123] Optionally, based on the type of specific question information associated with any question control, the target question information is obtained, including: if the specific question information associated with any question control is high-frequency question information, the specific question information associated with any question control is used as the target question information; if the specific question information associated with any question control is category question information, a question input interface is displayed, the user's input operation in the question input interface is responded to, and the extended question entered by the user is obtained as the target question information.

[0124] Optionally, a display method adapted to the type of specific question information associated with any question control is adopted to display the target question information in the question area of ​​the live broadcast room, including: if the specific question information associated with any question control is high-frequency question information, displaying the target question information and the associated question control in the area above or below the specific question information associated with any question control in the question area; if the specific question information associated with any question control is category question information, displaying the target question information as the latest question information in the top or bottom area of ​​the question area according to the scrolling direction of the question information in the question area.

[0125] The detailed implementation methods and beneficial effects of each step provided in the embodiments of this application have been described in detail in the foregoing embodiments, and will not be elaborated here.

[0126] Figure 6 A schematic diagram of the structure of another live streaming device based on a digital human, provided as another exemplary embodiment of this application. (See diagram below.) Figure 6 As shown, the device includes:

[0127] The live streaming task sending module 61 is used to respond to the trigger operation initiated by the user at any time for the viewing link of the live streaming task, and send the live streaming viewing request of the live streaming task to the server. The live streaming task includes a public live streaming screen in which audio and video explanation of at least one topic based on a digital human.

[0128] The live stream receiving module 62 is used to receive the public live stream sent by the server through the private push process corresponding to any client, and to play the public live stream in the live stream room. The live stream room also includes a question entry point.

[0129] The question information sending module 63 is used to respond to the question operation initiated by the user through the question entry and send the target question information related to the target topic content currently being broadcast to the server, so that the server can generate and return a private live broadcast screen based on the digital human to broadcast the target answer information corresponding to the target question information in audio and video.

[0130] The live stream switching module 64 is used to receive the private live stream screen sent by the server using the private push stream process, switch from the public live stream screen to the private live stream screen to play the private live stream screen in the live stream room, and continue playing the public live stream screen after the private live stream screen finishes playing.

[0131] Optionally, the public live stream screen includes a first lead generation card, and the private live stream screen includes a second lead generation card; the first lead generation card is a general lead generation card unrelated to the product category, and the second lead generation card is a specific lead generation card related to the target product category involved in the target question information; correspondingly, it also includes a triggering module, used to respond to the user's triggering operation on the target lead generation card and send an inquiry request to the server, so that the server can establish a target interaction channel between any client and the target resource party based on the target interaction mode associated with the target lead generation card; the target lead generation card is either the first lead generation card or the second lead generation card; a display module is used to display the interactive interface associated with the target interaction channel, so that users can inquire about questions with the target resource party through the target interaction channel.

[0132] Optionally, the public or private live stream may also include: voice prompts from a digital human guiding the user to initiate a consultation through a first or second contact card, so that the user can trigger an action on the first or second contact card.

[0133] Optionally, the live stream receiving module is also used to receive the target answer information sent by the server and use the target answer information as part of the private live stream; and while controlling the digital human to broadcast the target answer information in audio and video in the live stream, the display module displays the target answer information corresponding to the target question information in the live stream in text form.

[0134] Optionally, the question entry point includes a privilege card icon displayed in the live stream room. Each privilege card icon corresponds to a privilege card, which represents the priority and prominent display rights for target question information from any client. Correspondingly, the question information sending module, when responding to a user's question-asking operation through the question entry point and sending target question information related to the currently broadcast target topic to the server, specifically performs the following: responding to a user's trigger operation on the privilege card icon, changing the display status of the privilege card icon to a used state or a reduced quantity state; responding to a user's question-asking operation, obtaining target question information related to the currently broadcast target topic and sending the target question information to the server; and highlighting the target question information in the question area of ​​the live stream room, and de-highlighting the target question information when the live stream room is playing private live stream footage.

[0135] Optionally, when the question information sending module responds to a user's questioning action and obtains target question information related to the currently broadcast target topic content, it is specifically used to: respond to the user's input action in the comment section of the live broadcast room, and obtain the user's input question information related to the currently broadcast target topic content as the target question information; and / or, display at least one candidate question information in the live broadcast room, respond to the user's selection action on at least one candidate question information, and use the selected candidate question information as the target question information; at least one candidate question information is associated with the currently broadcast target topic content.

[0136] Optionally, before responding to the user's trigger operation on the benefit card icon, the problem information sending module is also used to receive the benefit card icon sent by the server when the user meets the conditions for benefit card issuance during the playback of the public live broadcast in the live broadcast room; display the benefit card icon in the first area of ​​the live broadcast room at a first size, and when the display duration of the benefit card icon reaches a set duration threshold, display the benefit card icon in the second area of ​​the live broadcast room at a second size by dynamically shrinking from the first area to the second area of ​​the live broadcast room, the second size being smaller than the first size.

[0137] Optionally, the specific question information includes high-frequency question information whose frequency exceeds a set frequency threshold and / or category question information involving a specific category; wherein, the specific categories corresponding to different clients may be the same or different. When the question information sending module responds to a user's questioning operation initiated through the question entry and sends target question information related to the currently live-streamed target topic content to the server, it specifically performs the following: responds to the user's triggering operation on any question control; obtains the target question information according to the type of specific question information associated with any question control; sends the target question information to the server; and displays the target question information in the question area of ​​the live-streaming room using a display method adapted to the type of specific question information associated with any question control.

[0138] Optionally, when the question information sending module is used to obtain target question information based on the type of specific question information associated with any question control, it is specifically used to: if the specific question information associated with any question control belongs to high-frequency question information, use the specific question information associated with any question control as the target question information; if the specific question information associated with any question control belongs to category question information, display the question input interface, respond to the user's input operation in the question input interface, and obtain the extended question input by the user as the target question information.

[0139] Optionally, when the question information sending module displays the target question information in the question area of ​​the live broadcast room using a display method adapted to the type of specific question information associated with any question control, it specifically performs the following: if the specific question information associated with any question control is a high-frequency question, it displays the target question information and the associated question control in the area above or below the specific question information associated with any question control in the question area; if the specific question information associated with any question control is a category question, it displays the target question information as the latest question information in the top or bottom area of ​​the question area according to the scrolling direction of the question information in the question area.

[0140] The detailed implementation methods and beneficial effects of each module provided in the embodiments of this application have been described in detail in the foregoing embodiments, and will not be elaborated here.

[0141] Figure 7 This is a schematic diagram of the structure of an electronic device provided for an exemplary embodiment of this application. For example... Figure 7 As shown, it includes: a memory 70a and a processor 70b; the memory 70a is used to store computer programs; the processor 70b, coupled to the memory 70a, is used to execute the computer programs to implement the steps in the above method embodiments. Specifically, when the electronic device is implemented as an electronic device, it executes... Figure 3 The steps in the method embodiment shown are as follows: When the electronic device is implemented as a server, the following steps are executed. Figure 5 The steps in the method embodiment shown.

[0142] Furthermore, such as Figure 7 As shown, the server also includes other components such as a communication component 70c, a display 70d, a power supply component 70e, and an audio component 70f. Figure 7 The diagram only shows some components and does not mean that the electronic device includes only these components. Figure 7 The components shown.

[0143] The detailed implementation methods and beneficial effects of the electronic devices provided in this application have been described in detail in the foregoing embodiments, and will not be elaborated further here.

[0144] Exemplary embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the steps in the above-described method embodiments.

[0145] An exemplary embodiment of this application also provides a computer program product comprising a computer program / instructions that, when executed by a processor, enable the processor to perform the steps described in the above method embodiments.

[0146] The aforementioned memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random-Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0147] The aforementioned communication components are configured to facilitate wired or wireless communication between the device containing the communication components and other devices. The device containing the communication components can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G / LTE, 5G, or combinations thereof. In one exemplary embodiment, the communication components receive broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication components also include a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IRDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.

[0148] The aforementioned display includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation.

[0149] The aforementioned power supply components provide power to various components within the device in which they reside. These power supply components may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device in which they reside.

[0150] The aforementioned audio component can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC) configured to receive external audio signals when the device containing the audio component is in an operating mode, such as call mode, recording mode, or voice recognition mode. The received audio signals can be further stored in memory or transmitted via a communication component. In some embodiments, the audio component also includes a speaker for outputting audio signals.

[0151] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-readable storage media (including, but not limited to, disk storage, compact disk read-only memory (CD-ROM), optical storage, etc.) containing computer-usable program code.

[0152] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0153] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0154] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0155] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0156] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory. Memory is an example of computer-readable media.

[0157] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), and electrically erasable programmable read-only memory.

[0158] EEPROM, flash memory or other memory technologies, CD-ROM, Digital Video Disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium, may be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0159] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0160] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A live broadcast method based on a digital person, characterized in that, The method applied to a server comprises: publishing a viewing link of a live broadcast task, the live broadcast task comprising a public live broadcast picture of audio and video explanation of at least one theme content based on a digital human, the public live broadcast picture comprising at least one audio and video segment corresponding to the at least one theme content; in response to a live broadcast viewing request of any client initiated through the viewing link at any time, creating a private push stream process for the any client, and pushing the public live broadcast picture to the any client by using the private push stream process, so that the any client plays the public live broadcast picture from a starting point of the public live broadcast picture in a live broadcast room, wherein different private push stream processes are created for different clients, so that each client can independently watch the complete public live broadcast picture from the time when the client enters the live broadcast room, and the live broadcast room further comprises a question entry; each user watching the public live broadcast picture sees the same content of the public live broadcast picture, and the question entry is directed to each user; receiving target question information related to a target theme content currently broadcast live by the any client, the target question information being sent by the any client in response to a question operation of a user initiated through the question entry; generating target answer information corresponding to the target question information by using an artificial intelligence (AI) model, and generating a private live broadcast picture based on audio and video broadcasting of the target answer information by the digital human according to the target answer information; pushing the private live broadcast picture to the any client by using the private push stream process, so that the any client switches from the public live broadcast picture to the private live broadcast picture to play the private live broadcast picture in the live broadcast room, wherein the private live broadcast picture is pushed to the any client initiating the target question information through the private push stream process; and continuing to play the public live broadcast picture after the private live broadcast picture is played, the private live broadcast picture and the public live broadcast picture being two independent pictures.

2. The method of claim 1, wherein, Before publishing the viewing link of the live broadcast task, the method further comprises: generating an audio signal for explaining the at least one theme content according to live broadcast task creation demand information; recording a plurality of action pictures corresponding to the digital human, and adding an attribute label to each action picture, the attribute label being used to identify a content attribute suitable for the action picture; selecting a first target action picture adapted to each theme content from the plurality of action pictures according to attribute information of each theme content and the attribute label of each action picture; driving the digital human in the first target action picture adapted to each theme content by sound according to the audio signal for explaining each theme content in a sequence of explaining the at least one theme content, to obtain the public live broadcast picture.

3. The method of claim 1, wherein, Generating a private live broadcast picture based on audio and video broadcasting of the target answer information by the digital human according to the target answer information comprises: converting the target answer information into a target audio signal by using a text-to-speech model; selecting a second target motion picture corresponding to the target answer information from a plurality of motion pictures corresponding to the digital human; driving the digital human in the second target motion picture according to the target audio signal to obtain the private live picture.

4. The method of claim 1, wherein, Further comprising: adding a first leave card to the public live picture and adding a second leave card to the private live picture; wherein the first leave card is a general leave card irrelevant to the commodity category, and the second leave card is a specific leave card related to a target commodity category involved in the target question information.

5. The method of claim 4, wherein, Further comprising: receiving a consultation request sent by any client, the consultation request being sent by any client in response to a user's triggering operation on a target leave card, the target leave card being the first leave card or the second leave card; if the target leave card is the first leave card, selecting a target resource party based on a target theme content currently played, and if the target leave card is the second leave card, selecting a target resource party based on the target commodity category; based on a target interaction mode associated with the target leave card, establishing a target interaction channel between any client and the target resource party, so that any client interacts with the target resource party through the target interaction channel.

6. The method of claim 1, wherein, Further comprising: sending the target answer information as part of the private live picture to any client, so that any client displays the target answer information in the form of text while the digital human controlled by any client in the live room reports the target answer information through audio and video.

7. The method according to any one of claims 1 to 6, characterized in that, The question entry includes a benefit card icon displayed in the live room, the benefit card icon corresponds to a benefit card, and the benefit card represents target question information from any client with priority reply and highlight display benefits; After pushing the public live picture to any client, the method further comprises: determining whether a user meets a benefit card issuance condition according to user account information bound by any client and / or time length information of any client playing the public live picture; in the case of meeting the benefit card issuance condition, allocating a benefit card to any client and sending the benefit card icon to any client for displaying the benefit card icon in the live room.

8. The method according to any one of claims 1 to 6, characterized in that, The question entry includes a question control associated with specific question information displayed in the live room; the method further comprises: According to the question information from each client, high-frequency question information with a question frequency higher than a set frequency threshold and / or category question information related to a specific category are obtained as specific question information; wherein the specific categories corresponding to different clients are the same or different; using the private push process to push the specific question information and the question control to any client, so that any client displays the specific question information and its associated question control during playing the public live picture or private live picture.

9. A live streaming apparatus based on a digital human, characterized in that, including: The live broadcast task publishing module is configured to publish a viewing link of a live broadcast task, the live broadcast task including a public live broadcast picture based on a digital human giving an audio and video explanation on at least one theme content. The private process creating module is configured to create a private streaming process for any client in response to a live broadcast viewing request of the any client initiated through the viewing link at any time, and to push the public live broadcast picture to the any client by using the private streaming process, so that the any client plays the public live broadcast picture from a starting point of the public live broadcast picture in a live broadcast room. The question information receiving module is configured to receive target question information related to a target theme content currently broadcasted by the any client, the target question information being sent by the any client in response to a question initiation operation of a user through the question entry. The content generating module is configured to generate target answer information corresponding to the target question information by using an artificial intelligence (AI) model, and to generate a private live broadcast picture based on the digital human giving an audio and video broadcast of the target answer information. The streaming module is configured to push the private live broadcast picture to the any client by using the private streaming process, so that the any client switches from the public live broadcast picture to the private live broadcast picture to play the private live broadcast picture in the live broadcast room.

10. An electronic device, comprising: The computer program product includes computer programs / instructions, which, when executed by a processor, enable the processor to implement the steps in the method of any one of claims 1-8. The computer program product includes computer programs / instructions, which, when executed by a processor, enable the processor to implement the steps in the method of any one of claims 1-8. The computer program product includes computer programs / instructions, which, when executed by a processor, enable the processor to implement the steps in the method of any one of claims 1-8.

11. A computer readable storage medium storing a computer program, characterized in that, ​ 12. A computer program product, characterised in that, ​

Images