Live streaming method and device, electronic equipment and storage medium

Abstract

The present disclosure provides a live broadcast method and device, electronic equipment and storage medium, belonging to the technical field of artificial intelligence. The method comprises: displaying an auxiliary live broadcast entry on a live broadcast configuration page, the live broadcast configuration page being used to provide a configuration function for a target live broadcast event; in response to a triggering operation on the auxiliary live broadcast entry, displaying a plurality of live broadcast modes based on artificial intelligence; wherein different live broadcast modes are used to live broadcast the target live broadcast event in different auxiliary live broadcast modes during the live broadcast process; and in response to a selection operation on any one of the live broadcast modes, displaying a live broadcast page based on the selected live broadcast mode after the live broadcast starts. The present disclosure enables the host to randomly select a live broadcast mode suitable for himself among a plurality of live broadcast modes, which not only meets the needs of different hosts, but also greatly reduces the live broadcast cost and difficulty due to the implementation of auxiliary live broadcast. In addition, the emergence of the auxiliary live broadcast function also ensures the quality of the live broadcast content.

Description

Technical Field

[0001] This disclosure relates to the field of artificial intelligence technology, and in particular to a live streaming method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid development of internet technology, applications with live streaming capabilities (such as short video apps) are becoming increasingly popular. This allows streamers to create live streaming rooms simply by using these applications. Correspondingly, viewers can enter other people's live streaming rooms to watch the broadcasts.

[0003] Typically, livestreamers need to write a script before starting a broadcast, allowing them to follow the script throughout the stream. However, this places high demands on the broadcaster's skills and professional expertise, making it costly and difficult for ordinary people. Therefore, reducing the cost and difficulty of livestreaming while ensuring content quality has become a pressing issue for those in the know. Summary of the Invention

[0004] This disclosure provides a live streaming method, apparatus, electronic device, and storage medium. The technical solution of this disclosure is as follows:

[0005] According to a first aspect of the present disclosure, a live streaming method is provided, comprising:

[0006] An auxiliary live streaming entry is displayed on the live streaming configuration page, which provides configuration functions for the target live streaming event;

[0007] In response to the triggering operation of the auxiliary live streaming entry, multiple AI-based live streaming modes are displayed; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0008] In response to the selection of any live streaming mode, the live streaming page is displayed based on the selected live streaming mode after the live stream starts.

[0009] In some embodiments, the display of multiple live streaming modes includes:

[0010] Display two or more of the first live streaming mode, the second live streaming mode, or the third live streaming mode;

[0011] The first live streaming mode refers to assisting the first broadcaster in live streaming by displaying live streaming text on the live streaming page; the first broadcaster is used to broadcast the target live streaming event.

[0012] The second live streaming mode refers to assisting the first broadcaster by playing live audio in the live streaming room; the live audio is obtained by converting the live streaming script into speech.

[0013] The third live streaming mode refers to broadcasting the target live event through a digital virtual human in the live streaming room.

[0014] In other embodiments, the method further includes:

[0015] Display at least one historical live stream record; wherein, the historical live stream record is used to describe historical live stream events;

[0016] In response to the reuse operation of the first historical live broadcast record, the live broadcast page is displayed based on the configuration data of the historical live broadcast events described in the first historical live broadcast record;

[0017] In response to an editing operation on the second historical live stream record, the live stream page is displayed based on the configuration data after editing the historical live stream events described in the second historical live stream record.

[0018] In other embodiments, when the second live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes:

[0019] A prompting control is displayed on the live streaming page;

[0020] In response to the triggering operation of the prompting control, a live broadcast script matching the current live broadcast progress is displayed on the live broadcast page.

[0021] In other embodiments, displaying live stream text matching the current live stream progress on the live stream page includes:

[0022] If the current live stream progress indicates that the first streamer is explaining an item, the explanation text for the item currently being explained is displayed on the live stream page; or,

[0023] If the current live stream progress indicates that the live stream has started, display the live stream opening text on the live stream page; or,

[0024] When the current live stream progress indicates that the first streamer is providing interactive guidance, interactive guidance text is displayed on the live stream page; or,

[0025] If the current live stream progress indicates that the live stream has ended, a message indicating the end of the live stream will be displayed on the live stream page.

[0026] In other embodiments, when the second live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes:

[0027] Audio playback controls are displayed on the live streaming page;

[0028] In response to a triggering operation on the audio playback control, a playback control for at least one live audio stream is displayed on the live streaming page;

[0029] In response to a trigger operation on the playback control of any live audio, the selected live audio is played in the live room.

[0030] In other embodiments, when the second live streaming mode is selected, the method further includes:

[0031] Display at least one sound option; wherein different sound options are used to provide sample sounds with different acoustic characteristics;

[0032] In response to a sound playback operation based on any sound option, play the selected sample sound;

[0033] In response to a sound selection operation based on any sound option, the live broadcast script is converted from text to speech based on the acoustic features of the selected sample sound to obtain the live broadcast audio.

[0034] In other embodiments, when the second live streaming mode is selected, the method further includes:

[0035] Obtain the input sample sound;

[0036] Based on the acoustic features of the input sample sound, the live broadcast script is converted from text to speech to obtain the live broadcast audio.

[0037] In other embodiments, the live audio includes at least one of the following: audio explaining the item to be displayed, audio at the start of the live stream, audio for interactive guidance, or audio at the end of the live stream; the method further includes:

[0038] In response to a listening operation on any of the generated live audio clips, the live audio clips are played.

[0039] In other embodiments, when the first live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes:

[0040] A prompting control is displayed on the live streaming page;

[0041] In response to the triggering operation of the prompting control, a live broadcast script matching the current live broadcast progress is displayed on the live broadcast page.

[0042] In other embodiments, when the third live streaming mode is selected, the method further includes:

[0043] Display at least one voice option and at least one image option; wherein, different voice options are used to provide sample voices with different acoustic characteristics; and different image options are used to provide digital virtual humans with different images;

[0044] In response to the selection of any sound option and any image option, a live video is generated; wherein the live video includes a digital virtual human for broadcasting the live script, and the digital virtual human has the same acoustic characteristics as the sample voice.

[0045] In other embodiments, the method further includes:

[0046] In response to the selection of any live streaming mode, configuration options are displayed; wherein the configuration options are used to indicate at least one of the following: live streaming duration, live streaming style, or item category to be displayed in the live streaming room;

[0047] Based on at least one of the configured live stream duration, live stream style, or item category, a list of recommended items is displayed; wherein, the items in the list of recommended items are displayed after the live stream begins.

[0048] In other embodiments, the display of settings options in response to selecting any live streaming mode includes:

[0049] In response to the selection of any live streaming mode option, a first settings control is displayed on the live streaming settings page;

[0050] In response to a triggering operation on the first settings control, the settings options are displayed.

[0051] In other embodiments, the method further includes:

[0052] An edit control that displays the recommended item list; wherein, when triggered, the edit control is used to perform at least one of the following operations;

[0053] Delete the item from the item recommendation list;

[0054] Add new items to the item recommendation list;

[0055] Adjust the sorting of items included in the recommended item list.

[0056] In other embodiments, the method further includes:

[0057] Based on the item recommendation list and the set live streaming style, the generated live streaming script is displayed.

[0058] In response to the editing operation of the live broadcast script, the edited live broadcast script is displayed.

[0059] In other embodiments, the method further includes:

[0060] During the generation of the live stream script, in response to an exit operation, the current page content is saved; or,

[0061] During speech synthesis, in response to a page exit operation, the current page content is saved.

[0062] In other embodiments, the step of converting the live stream script to speech based on the acoustic features of the selected sample sounds to obtain live stream audio includes at least one of the following:

[0063] Based on the selected sample speech, the explanatory text of the item to be displayed is converted into speech to obtain an explanatory audio with the same acoustic features as the selected sample speech.

[0064] Based on the selected sample speech, the live broadcast opening text is converted into speech to obtain the live broadcast opening audio with the same acoustic features as the selected sample speech.

[0065] Based on the selected sample speech, the interactive guidance text is converted from text to speech to obtain interactive guidance audio with the same acoustic features as the selected sample speech.

[0066] Based on the selected sample speech, the live broadcast ending text is converted from text to speech to obtain the live broadcast ending audio with the same acoustic features as the selected sample speech.

[0067] In other embodiments, the method further includes:

[0068] In response to a video playback operation based on any avatar option, play a sample broadcast video of the selected digital virtual human.

[0069] In other embodiments, the method further includes:

[0070] Configure the start time of the target live event;

[0071] The method of displaying the live streaming page based on the selected live streaming mode includes:

[0072] After the scheduled start time is reached, the live video will be played on the live streaming page.

[0073] According to a second aspect of the present disclosure, a live streaming method is provided, the method comprising:

[0074] In response to receiving a live streaming configuration request, live streaming configuration data is generated; the live streaming configuration request is sent by the terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered.

[0075] The terminal sends the live streaming configuration data to the terminal; wherein the terminal is used to display multiple AI-based live streaming modes based on the live streaming configuration data, and different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0076] In response to the selection of any live streaming mode, a live streaming page is generated based on the selected live streaming mode and sent to the terminal.

[0077] In some embodiments, the method further includes:

[0078] The number of items that can be displayed during the live stream is determined based on the configured live stream duration.

[0079] Based on the configured item categories and multi-dimensional data related to the first streamer object, a first candidate item list is generated; wherein, the first streamer object is used to broadcast the target live event; the multi-dimensional data includes item data and object data;

[0080] Under the constraint of a certain number of items, the first candidate item list is filtered to select the items with the highest recommended values, which are ranked in the top preset number, to obtain the second candidate item list; wherein, for any item, the recommended value is used to reflect the degree of suitability of the item for display in the live broadcast room of the first streamer.

[0081] Based on the item filtering rules, the items in the second candidate item list are filtered to obtain an item recommendation list, which is then sent to the terminal.

[0082] In other embodiments, the item data includes at least one of the following:

[0083] Resource transfer data of items displayed historically within the live stream;

[0084] The attribute data of the historically displayed items;

[0085] The second streamer object is the item-based resource transfer data; wherein, the second streamer object is a peer streamer, a streamer of the same scale, or a streamer of the same style as the first streamer object;

[0086] The object data includes at least one of the following:

[0087] The resource transfer object data of the historical display items;

[0088] The follower data of the first broadcaster;

[0089] The item category that matches the second object.

[0090] According to a third aspect of the present disclosure, a live streaming device is provided, comprising:

[0091] The first display module is configured to display an auxiliary live streaming entry on the live streaming configuration page, which is used to provide configuration functions for the target live streaming event;

[0092] The second display module is configured to display multiple AI-based live streaming modes in response to a trigger operation on the auxiliary live streaming entry; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0093] The third display module is configured to respond to the selection of any live streaming mode and display the live streaming page based on the selected live streaming mode after the live streaming starts.

[0094] In some embodiments, the second display module is configured to:

[0095] Display two or more of the first live streaming mode, the second live streaming mode, or the third live streaming mode;

[0096] The first live streaming mode refers to assisting the first broadcaster in live streaming by displaying live streaming text on the live streaming page; the first broadcaster is used to broadcast the target live streaming event.

[0097] The second live streaming mode refers to assisting the first broadcaster by playing live audio in the live streaming room; the live audio is obtained by converting the live streaming script into speech.

[0098] The third live streaming mode refers to broadcasting the target live event through a digital virtual human in the live streaming room.

[0099] In other embodiments, the device further includes:

[0100] The fourth display module is configured to display at least one historical live stream record; wherein the historical live stream record is used to describe historical live stream events;

[0101] The fourth display module is also configured to display the live page in response to a reuse operation of the first historical live record, based on the configuration data of the historical live events described in the first historical live record;

[0102] The fourth display module is also configured to display the live page in response to an editing operation on the second historical live record, based on the configuration data after editing the historical live events described in the second historical live record.

[0103] In other embodiments, when the second live streaming mode is selected, the third display module is configured to display a prompting control on the live streaming page; in response to a triggering operation on the prompting control, a live streaming script matching the current live streaming progress is displayed on the live streaming page.

[0104] In other embodiments, the third display module is configured as follows:

[0105] If the current live stream progress indicates that the first streamer is explaining an item, the explanation text for the item currently being explained is displayed on the live stream page; or,

[0106] If the current live stream progress indicates that the live stream has started, display the live stream opening text on the live stream page; or,

[0107] When the current live stream progress indicates that the first streamer is providing interactive guidance, interactive guidance text is displayed on the live stream page; or,

[0108] If the current live stream progress indicates that the live stream has ended, a message indicating the end of the live stream will be displayed on the live stream page.

[0109] In other embodiments, when the second live streaming mode is selected, the third display module is configured to display an audio playback control on the live streaming page; in response to a trigger operation on the audio playback control, display a playback control for at least one live audio stream on the live streaming page; and in response to a trigger operation on the playback control for any one live audio stream, play the selected live audio stream in the live streaming room.

[0110] In other embodiments, when the second live streaming mode is selected, the device further includes:

[0111] The fifth display module is configured to display at least one sound option; wherein different sound options are used to provide sample sounds with different acoustic characteristics; in response to a sound playback operation based on any sound option, the selected sample sound is played; in response to a sound selection operation based on any sound option, the live script is converted from text to speech based on the acoustic characteristics of the selected sample sound to obtain live audio.

[0112] In other embodiments, when the second live streaming mode is selected, the fifth display module is further configured to acquire input sample sound; based on the acoustic features of the input sample sound, the live streaming text is converted into speech to obtain live streaming audio.

[0113] In other embodiments, the live audio includes at least one of the following: audio explaining the item to be displayed, audio at the start of the live stream, audio for interactive guidance, or audio at the end of the live stream; the device further includes:

[0114] The playback module is configured to play the live audio in response to a listening operation on any generated live audio.

[0115] In other embodiments, when the first live streaming mode is selected, the third display module is configured to display a prompting control on the live streaming page; in response to a triggering operation on the prompting control, a live streaming script matching the current live streaming progress is displayed on the live streaming page.

[0116] In other embodiments, when the third live streaming mode is selected, the device further includes:

[0117] The sixth display module is configured to display at least one sound option and at least one image option; wherein different sound options are used to provide sample sounds with different acoustic characteristics; different image options are used to provide digital virtual humans with different images; in response to the selection of any sound option and any image option, a live video is generated; wherein the live video includes a digital virtual human for broadcasting the live script, the digital virtual human having the same acoustic characteristics as the sample sound.

[0118] In other embodiments, the device further includes:

[0119] The seventh display module is configured to display configuration options in response to the selection of any live streaming mode; wherein the configuration options are used to indicate at least one of configuring the live streaming duration, live streaming style, or item category to be displayed in the live streaming room; and to display an item recommendation list based on at least one of the configured live streaming duration, live streaming style, or item category; wherein the items in the item recommendation list are displayed after the live streaming starts.

[0120] According to a fourth aspect of the present disclosure, a live streaming device is provided, comprising:

[0121] The first generation module is configured to generate live streaming configuration data in response to receiving a live streaming configuration request; the live streaming configuration request is sent by the terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered.

[0122] The sending module is configured to send the live streaming configuration data to the terminal; wherein the terminal is used to display multiple AI-based live streaming modes based on the live streaming configuration data, and different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0123] The second generation module is configured to generate a live streaming page based on the selected live streaming mode in response to any live streaming mode being selected.

[0124] The sending module is also configured to send the live streaming page to the terminal.

[0125] In some embodiments, the apparatus further includes:

[0126] The determination module is configured to determine the number of items that can be displayed during the live stream based on the configured live stream duration;

[0127] The third generation module is configured to generate a first candidate item list based on the configured item category and multi-dimensional data related to the first broadcaster object; wherein, the first broadcaster object is used to broadcast the target live event; the multi-dimensional data includes item data and object data;

[0128] The filtering module is configured to filter items from the first candidate item list that have the highest recommended value within a predetermined number of positions, under the constraint of a certain number of items, to obtain a second candidate item list; wherein, for any item, the recommended value is used to reflect the degree of suitability of the item for display in the live broadcast room of the first streamer.

[0129] The filtering module is configured to filter items in the second candidate item list based on item filtering rules to obtain an item recommendation list;

[0130] The sending module is also configured to send the item recommendation list to the terminal.

[0131] In other embodiments, the item data includes at least one of the following:

[0132] Resource transfer data of items displayed historically within the live stream;

[0133] The attribute data of the historically displayed items;

[0134] The second streamer object is the item-based resource transfer data; wherein, the second streamer object is a peer streamer, a streamer of the same scale, or a streamer of the same style as the first streamer object;

[0135] The object data includes at least one of the following:

[0136] The resource transfer object data of the historical display items;

[0137] The follower data of the first broadcaster object;

[0138] The item category that matches the second object.

[0139] According to a fifth aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0140] One or more processors;

[0141] Memory used to store the executable program code of the processor;

[0142] The processor is configured to execute the program code to implement the aforementioned live streaming method.

[0143] According to a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein program code in the computer-readable storage medium is executed by a processor of an electronic device, enabling the electronic device to perform the above-described live streaming method.

[0144] According to a seventh aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor of an electronic device, implements the above-described live streaming method.

[0145] This disclosure provides multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can access various live streaming modes by triggering an operation entry point. This allows the broadcaster to freely choose the mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast, which not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming functionality. In addition, the auxiliary live streaming function also ensures the quality of the live streaming content.

[0146] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0147] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0148] Figure 1 This is a schematic diagram illustrating the implementation environment of a live streaming method according to an exemplary embodiment.

[0149] Figure 2 This is a flowchart illustrating a live streaming method according to an exemplary embodiment.

[0150] Figure 3 This is a schematic diagram illustrating a type of live broadcast script according to an exemplary embodiment.

[0151] Figure 4 This is a schematic diagram of a page according to an exemplary embodiment.

[0152] Figure 5 This is another schematic diagram of a page according to an exemplary embodiment.

[0153] Figure 6 This is another schematic diagram of a page according to an exemplary embodiment.

[0154] Figure 7 This is another schematic diagram of a page according to an exemplary embodiment.

[0155] Figure 8 This is a flowchart illustrating another live streaming method according to an exemplary embodiment.

[0156] Figure 9 This is another schematic diagram of a page according to an exemplary embodiment.

[0157] Figure 10 This is another schematic diagram of a page according to an exemplary embodiment.

[0158] Figure 11 This is another schematic diagram of a page according to an exemplary embodiment.

[0159] Figure 12 This is another schematic diagram of a page according to an exemplary embodiment.

[0160] Figure 13 This is another schematic diagram of a page according to an exemplary embodiment.

[0161] Figure 14 This is another schematic diagram of a page according to an exemplary embodiment.

[0162] Figure 15 This is another schematic diagram of a page according to an exemplary embodiment.

[0163] Figure 16 This is another schematic diagram of a page according to an exemplary embodiment.

[0164] Figure 17 This is another schematic diagram of a page according to an exemplary embodiment.

[0165] Figure 18This is another schematic diagram of a page according to an exemplary embodiment.

[0166] Figure 19 This is another schematic diagram of a page according to an exemplary embodiment.

[0167] Figure 20 This is another schematic diagram of a page according to an exemplary embodiment.

[0168] Figure 21 This is another schematic diagram of a page according to an exemplary embodiment.

[0169] Figure 22 This is another schematic diagram of a page according to an exemplary embodiment.

[0170] Figure 23 This is a flowchart illustrating another live streaming method according to an exemplary embodiment.

[0171] Figure 24 This is a flowchart illustrating a method for generating a list of recommended items, according to an exemplary embodiment.

[0172] Figure 25 This is an interactive flowchart illustrating an example of a broadcaster's client, a viewer's client, and a server.

[0173] Figure 26 This is a schematic diagram of a server-side scheduling process according to an exemplary embodiment.

[0174] Figure 27 This is a block diagram illustrating a live streaming device according to an exemplary embodiment.

[0175] Figure 28 This is a block diagram illustrating another live streaming device according to an exemplary embodiment.

[0176] Figure 29 This is a block diagram illustrating a terminal according to an exemplary embodiment.

[0177] Figure 30 This is a block diagram illustrating a server according to an exemplary embodiment. Detailed Implementation

[0178] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0179] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0180] The information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by the parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0181] Figure 1 This is a schematic diagram illustrating the implementation environment of a live streaming method according to an exemplary embodiment.

[0182] See Figure 1 The implementation environment includes a first terminal 101, a second terminal 102, and a server 103. Terminal 101 is an electronic device used by the user. In this embodiment, a target application is installed on both the first terminal 101 and the second terminal 102. This target application is an application with live streaming functionality. For example, the target application may be an instant messaging application, such as a short video application; this disclosure does not limit the scope of the application.

[0183] In some embodiments, the first terminal 101 is a terminal used by the broadcaster, and the second terminal 102 is a terminal used by the audience. The broadcaster has registered a first user account on the target application, and the audience has registered a second user account on the target application. Accordingly, the broadcaster logs in to the target application installed on the first terminal 101 using the first user account, and the audience logs in to the target application installed on the second terminal 102 using the second user account.

[0184] In other embodiments, the first terminal 101 and the second terminal 102 are devices such as smartphones or tablets. Figure 1 The first terminal 101 and the second terminal 102 are used as examples of smartphones for illustration only.

[0185] Furthermore, those skilled in the art will understand that the number of the aforementioned second terminals can be more or less. For example, there may be only a few second terminals, or dozens or hundreds of devices, or even more. This disclosure does not limit the number or type of the second terminals.

[0186] In other embodiments, server 103 provides background services for the target application. Server 103 can be a standalone physical server, a server cluster consisting of multiple physical servers, a distributed file system, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0187] Additionally, server 103 is connected to the first terminal 101 and the second terminal 102 via a wireless network or a wired network. Furthermore, the server involved in this embodiment may also include other functional servers to provide more comprehensive and diversified services.

[0188] In other embodiments, server 103 undertakes the main computing work and first terminal 101 undertakes the secondary computing work; or, server 103 undertakes the secondary computing work and first terminal 101 undertakes the main computing work; or, server 103 or first terminal 101 can each undertake computing work independently.

[0189] The live streaming solution provided in this disclosure will be described in detail below through the following embodiments.

[0190] Figure 2 This is a flowchart illustrating a live streaming method according to an exemplary embodiment, such as... Figure 2 As shown, this live streaming method is applied to electronic devices, such as... Figure 1 The live streaming method, shown in the first terminal 101, includes the following steps:

[0191] In 201, electronic devices display an auxiliary live streaming entry on the live streaming configuration page, which provides configuration functions for the target live streaming event.

[0192] Among them, the target live streaming event refers to a live stream that the streamer needs to start within a certain period of time in the future.

[0193] Figure 3 and Figure 4 This is a schematic diagram illustrating a live streaming configuration page according to an exemplary embodiment. For example... Figure 3 and Figure 4As shown, during the live stream preparation phase, the streamer can select products and configure live stream settings, which are not limited in this disclosure. Specifically, during product selection, the streamer can configure items to be automatically listed after the live stream begins.

[0194] In this embodiment of the disclosure, the auxiliary live streaming entry is used to enable the intelligent live streaming function after being triggered, also known as the auxiliary live streaming function or the assistive broadcasting function.

[0195] As an example, such as Figure 3 As shown, the electronic device will display prompt message 1 on the live streaming configuration page to remind the broadcaster to use the smart live streaming function during the live streaming preparation stage, thereby assisting the broadcaster in starting the broadcast. Next, in response to the broadcaster's confirmation action based on prompt message 1, such as triggering "Try it" in prompt message 1, the electronic device will display an auxiliary live streaming entry on the live streaming configuration page, for example... Figure 4 The smart live streaming entry point 2 is shown in the image.

[0196] In 202, in response to the triggering operation of the auxiliary live streaming entry, the electronic device displays multiple AI-based live streaming modes; among them, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process.

[0197] In this embodiment of the disclosure, different live streaming modes can provide different intelligent live streaming capabilities to assist the broadcaster in starting the broadcast. The live streaming script is no longer limited to text format; it can also be... Figure 5 The system supports various audio and even video formats, providing a complete set of semi-automatic or fully automatic intelligent broadcasting solutions for different broadcasters. This allows broadcasters to choose the intelligent live streaming capabilities that best suit their abilities. Several intelligent live streaming capabilities are listed below.

[0198] As an example, the streamer object is triggered for the first time. Figure 4 After entering the Smart Live Streaming entry point 2 as shown, you will enter the Smart Live Streaming page, as follows: Figure 6 As shown, the page displays three intelligent live streaming capabilities: Teach Me to Speak, Help Me to Speak, and Help Me to Broadcast.

[0199] The smart live streaming page is essentially used for live streaming settings, and therefore is another form of live streaming configuration page. The only difference is that the content of the live streaming configuration page used to display the auxiliary live streaming entrance is different from that of the live streaming configuration page used to display multiple live streaming modes.

[0200] 1. This is also referred to as the first live streaming mode in this article. The first live streaming mode refers to assisting the streamer by displaying live streaming text on the live streaming page.

[0201] This live streaming mode is suitable for hosts with certain explanation abilities. The server side will use AI technology to write the script for the live stream, such as the opening script, product description text, interactive prompts, or closing script, etc., which are not limited in this disclosure. After the live stream starts, it can automatically prompt the host based on the progress of the live stream and / or the actions performed by the host, thereby intelligently helping the host improve the quality of their delivery.

[0202] 2. This is also referred to as the second live streaming mode in this article. The second live streaming mode refers to supplementing the live stream by playing live audio within the live streaming room (including the broadcaster's and viewers' ends). The live audio is obtained by converting the live stream script into speech.

[0203] This live streaming mode is suitable for beginners who are not good at explaining or for broadcasters who have difficulty with verbal delivery. In this mode, in addition to providing the script mentioned in point 1, the server uses AI technology to convert the script into audio, allowing the broadcaster to choose whether to deliver the script verbally but with prompts, or to play the audio directly after starting the broadcast. This mode solves the broadcaster's practical difficulties with verbal delivery while improving the quality of the live streaming content.

[0204] 3. This is also referred to as the third live streaming mode in this article. The third live streaming mode refers to the live streaming of a target event by a digital virtual person in the live streaming room.

[0205] In this live streaming mode, the server uses AI technology to generate live video, enabling a digital virtual human to perform the entire live stream. For example, it allows for uninterrupted, 24 / 7 live streaming where the virtual human can continue broadcasting even after the main broadcaster has ended. This auxiliary live streaming method significantly reduces the cost of live streaming.

[0206] In summary, by providing three intelligent live streaming capabilities—teaching me to speak, helping me to speak, and helping me to broadcast—live streamers can freely choose the live streaming mode that suits them best, thus meeting the needs of different live streamers.

[0207] In 203, in response to the selection of any live streaming mode, the electronic device displays the live streaming page based on the selected live streaming mode after the live streaming starts.

[0208] It should be noted that if the broadcaster triggers the smart broadcast entry for the first time, or if the broadcaster has no historical broadcast records assisted by the smart broadcast function, the electronic device will display as follows: Figure 6 The page shown. If this broadcaster has a history of live broadcasts assisted by the smart broadcasting function, the electronic device will display something like this. Figure 7The page shown illustrates this. The intelligent live streaming function automatically stores the N most recent live stream records of this streamer for easy reuse or quick editing. For example, the streamer can... Figure 7 On the page shown, select the historical live stream record you want to reuse or edit.

[0209] Accordingly, the method provided in this disclosure further includes: displaying at least one historical live stream record; wherein the historical live stream record is used to describe the historical live stream events of the broadcaster; in response to the reuse operation of the first historical live stream record, during the live stream phase, displaying a live stream page based on the configuration data of the historical live stream events described in the first historical live stream record; in response to the editing operation of the second historical live stream record, during the live stream phase, displaying a live stream page based on the edited configuration data of the historical live stream events described in the second historical live stream record.

[0210] In summary, the embodiments of this disclosure provide multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can view various live streaming modes by triggering an operation entry point. This allows the broadcaster to freely choose the live streaming mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast, which not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming capabilities. In addition, the intelligent broadcasting function also ensures the quality of the live streaming content.

[0211] In addition, if the broadcaster has a history of live streaming records assisted by the intelligent broadcasting function, these records can be displayed on the intelligent broadcasting page. This allows the broadcaster to directly reuse or quickly edit these records to complete the relevant configurations for the target live streaming event, thus improving the efficiency of human-computer interaction.

[0212] The above Figure 2 The diagram shown is merely the basic process of this disclosure. The following section will further elaborate on the solution provided in this disclosure based on a specific implementation method. Figure 8 This is a flowchart illustrating another live streaming method according to an exemplary embodiment, such as... Figure 8 As shown, this live streaming method is applied to electronic devices, such as... Figure 1 The live streaming method, shown in the first terminal 101, includes the following steps:

[0213] In 801, during the live broadcast preparation phase, electronic devices display an auxiliary live broadcast entry on the live broadcast configuration page, which provides configuration functions for the target live broadcast event.

[0214] This step can be referred to step 201 above, and will not be repeated here.

[0215] In 802, in response to the triggering operation of the auxiliary live streaming entry, the electronic device displays a first live streaming mode, a second live streaming mode, and a third live streaming mode; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process.

[0216] This step can be referred to step 202 above, and will not be repeated here.

[0217] In 803, in response to the selection of the first live streaming mode, the electronic device displays the live streaming page based on the first live streaming mode during the live streaming phase.

[0218] After the streamer selects any live streaming mode, the electronic device will display something like this. Figure 9 The page shown guides you through the steps of selecting a style, choosing items, and defining your message. Each step is explained below.

[0219] In response to the selection of any live streaming mode, during the live streaming preparation phase, the electronic device will display the first settings controls on the live streaming settings page, such as... Figure 9 The control is located between the style selection title and the item selection title; in response to a triggering action on the first settings control, the electronic device displays, for example... Figure 10 The configuration options are shown. See also... Figure 10 This configuration option is used to specify the live stream duration, live stream style, and the categories of items to be displayed in the live stream. As an example, in... Figure 10 In the example, the host sets the live stream duration to 2 hours, the live stream style to be enthusiastic and energetic, and the category of items to be displayed to be women's clothing.

[0220] Next, the electronic device will display, based on the configured live stream duration, live stream style, and item category, things like... Figure 11 The provided item recommendation list is shown. Items in this list are in an "on-demand" state after the live stream begins, also known as a "displayed state." In other words, based on the selection made in the previous step, the electronic device will automatically display items intelligently combined by the server using AI technology, suitable for the broadcaster. This embodiment of the disclosure achieves rapid product selection based on the broadcaster's configuration operations by recommending items to the broadcaster, saving time and manpower costs, and demonstrating high efficiency in human-computer interaction.

[0221] In addition, such as Figure 12 As shown, this embodiment of the disclosure also supports the broadcaster object triggering a second setting control, such as... Figure 9The control located between the item title selection and the script title allows users to view the item recommendation list, manually add new items, delete items from the item recommendation list, or adjust the order of items in the item recommendation list. This disclosure does not limit the scope of the control.

[0222] Accordingly, the method provided in this disclosure also includes:

[0223] An edit control that displays a list of recommended items; wherein the edit control is used to perform at least one of the following operations when triggered;

[0224] Remove items from the item recommendation list;

[0225] Add new items to the item recommendation list;

[0226] Adjust the order of items included in the item recommendation list.

[0227] In other embodiments, after generating the item recommendation list and obtaining the live streaming style configured by the streamer, the server side will also automatically generate the live streaming script based on AI technology. Additionally, embodiments of this disclosure also support the streamer triggering a third-party settings control, such as... Figure 9 The control located below the title of the script allows you to view or edit the generated live stream script.

[0228] Accordingly, the method provided in this disclosure also includes:

[0229] The generated live stream script is displayed based on the item recommendation list and the configured live stream style;

[0230] In response to editing the live stream script, the edited live stream script is displayed.

[0231] As an example, such as Figure 13 As shown, the live stream script includes the opening script (also known as the opening remarks), product description script (including the description of promotional items and the description of the main items), interactive guidance script (also known as the script to guide interaction), and live stream closing script (also known as the closing remarks, not shown in the image). Figure 13 (in Chinese). Interaction methods include, but are not limited to, following, liking, or joining a fan page, and this disclosure does not limit these methods.

[0232] In other embodiments, during the generation of the live stream script, in response to a page exit operation, the electronic device saves the current page content so that the broadcaster can directly operate on it the next time they enter the page. In other words, the broadcaster can exit the page while waiting for the live stream script to be generated, and the electronic device will automatically cache all content for direct operation the next time they enter.

[0233] The first point to note is that the above description of the setup steps applies to all three live streaming modes.

[0234] The second point that needs to be explained is, see [link / reference] Figure 14 When setting up a live stream, you can also choose whether to enable or disable prompting. If the streamer chooses to enable prompting, the prompts will be displayed on the live stream page during the live stream. As an example, this embodiment of the disclosure can comprehensively judge and display the corresponding prompts based on the streamer's current behavior and / or the live stream progress, so as to adjust the streamer's spoken content.

[0235] In other embodiments, when a first live streaming mode is selected, during the live streaming phase, a live streaming page is displayed based on the selected live streaming mode, including: during the live streaming phase, displaying a prompting control on the live streaming page; and in response to a triggering operation on the prompting control, the electronic device displays live streaming text on the live streaming page that matches the current live streaming progress.

[0236] For example, after completing the live streaming settings, the broadcaster triggers... Figure 15 The "Start Live Stream" control shown indicates that live streaming is manually started; this disclosure does not limit this method. Additionally, the broadcaster can trigger... Figure 16 The prompting control 3 shown can control the electronic device to display live stream text on the live stream page that matches the current live stream progress. Figure 17 This illustrates one possible display format of the live stream script on the live stream page. That is, the live stream script is displayed as a pop-up window on the live stream page, but this disclosure does not limit this to a specific format.

[0237] In summary, once the host selects the first live streaming mode during the preparation phase, the electronic device can display prompts that match the current live streaming progress based on the host's actions after the broadcast begins. This auxiliary live streaming method can significantly improve the quality of the host's spoken delivery, thereby ensuring the quality of the live streaming content.

[0238] In other embodiments, the live stream page displays live stream text that matches the current live stream progress, including:

[0239] If the current live stream progress indicates that the first streamer is explaining an item, display the description of the item being explained on the live stream page; or,

[0240] If the current live stream progress indicates that the live stream has started, display the opening text on the live stream page; or,

[0241] If the current live stream progress indicates that the primary host is providing interactive guidance, display the interactive guidance text on the live stream page; or,

[0242] When the current live stream progress indicates that the live stream has ended, display the message "Live stream ended" on the live stream page.

[0243] In summary, the embodiments of this disclosure enable prompting for the broadcaster at various stages of the live stream, further improving the quality of the broadcaster's delivery and thus ensuring the quality of the live stream content. Furthermore, because the prompts are determined and displayed based on the broadcaster's current behavior and the progress of the live stream, the accuracy of the prompts is ensured.

[0244] In error 804, in response to the selection of the second live streaming mode, the electronic device displays the live streaming page based on the second live streaming mode during the live streaming phase.

[0245] In some embodiments, when the second live streaming mode is selected, during the live streaming phase, the live streaming page is displayed based on the selected live streaming mode, including:

[0246] 8041. During the live stream, a prompting control is displayed on the live stream page; in response to the triggering operation of the prompting control, a live stream script matching the current live stream progress is displayed on the live stream page.

[0247] In other words, when the second live streaming mode is selected, the host can still choose to speak but be prompted after starting the broadcast. This self-selection method is more flexible and is no longer limited to playing live audio. It helps the host to broadcast more effectively and has a wider range of applications.

[0248] 8042. During the live broadcast, display an audio playback control on the live broadcast page; in response to a trigger operation on the audio playback control, display a playback control for at least one live audio on the live broadcast page; in response to a trigger operation on the playback control for any live audio, play the selected live audio in the live broadcast room.

[0249] The live stream audio includes at least one of the following: audio explaining the items to be showcased, audio at the start of the live stream, audio guiding interactive activities, or audio ending the live stream. As an example, when the second live stream mode is selected, the host can click on the following after starting the live stream: Figure 18 The audio playback control 4 shown is clicked, and a window will appear on the live stream page as shown. Figure 19 The half-screen page shown. This half-screen page displays at least one playback control for live audio, such as... Figure 19 The document shows playback controls for three audio descriptions of items, used to explain items 1 through 3 respectively. In response to triggering the playback control for the first audio description, the electronic device begins playing the audio description for item 1, completing the explanation of item 1 in conjunction with the anchor's camera display of item 1.

[0250] It's worth noting that the server-side uses technical means to insert AI-generated live audio into the existing broadcast audio, enabling the simultaneous delivery of both the broadcaster's microphone recordings and the AI-generated audio to the viewers. Furthermore, the AI-generated audio will also play on the broadcaster's device, allowing the audience to hear the content and experience the presentation in real time.

[0251] In summary, the embodiments of this disclosure support the broadcaster to switch to playing live audio in the live broadcast room with a single click. This live broadcast mode not only solves the practical difficulties of the broadcaster in verbally delivering content, but also improves the quality of the live broadcast content. Furthermore, it is simple to operate and has high human-computer interaction efficiency.

[0252] In other embodiments, when the second live streaming mode is selected, during the live streaming preparation phase, such as... Figure 20 As shown, the electronic device displays at least one sound option. Different sound options are used to provide sample sounds with different acoustic characteristics. Exemplarily, the acoustic characteristics include, but are not limited to, timbre, and this disclosure does not limit them.

[0253] In response to a sound playback operation based on any sound option, the electronic device will play the selected sample sound. Figure 20 The document shows five sound options, each corresponding to an avatar and a selection control. As an example, the sound playback operation described above represents a click operation by the broadcaster object on any of the avatars; this disclosure does not limit this to specific actions.

[0254] In response to a sound selection operation based on any sound option, the electronic device performs text-to-speech conversion on the live broadcast script based on the acoustic characteristics of the selected sample sound, thus obtaining the live broadcast audio. As another example, the aforementioned sound selection operation is a click operation by the broadcaster object on any selection control; this disclosure does not limit this. Furthermore, as... Figure 20 As shown, when the selected control is clicked, the display format will switch to "in use". This disclosure does not limit this as well.

[0255] In summary, the embodiments of this disclosure allow users to freely select sample sounds to synthesize live audio, making it more intelligent and flexible, with better human-computer interaction, thereby improving the quality of live content. Furthermore, the sample sounds also support previewing, ensuring that the broadcaster can quickly select suitable sample sounds, resulting in high human-computer interaction efficiency and high information transmission rate.

[0256] In other embodiments, based on the acoustic features of selected sample sounds, the live broadcast script is converted from text to speech to obtain live broadcast audio, including at least one of the following:

[0257] Based on the selected sample speech, the explanatory text of the item to be displayed is converted into speech to obtain an explanatory audio with the same acoustic features as the selected sample speech.

[0258] Based on the selected sample speech, the live broadcast opening text is converted into speech to obtain the live broadcast opening audio with the same acoustic features as the selected sample speech.

[0259] Based on the selected sample speech, the interactive guidance text is converted from text to speech to obtain interactive guidance audio with the same acoustic features as the selected sample speech.

[0260] Based on the selected sample speech, the live broadcast ending text is converted from text to speech to obtain the live broadcast ending audio with the same acoustic features as the selected sample speech.

[0261] In other embodiments, when the second live streaming mode is selected, the live audio can also be synthesized as follows: during the live streaming preparation stage, an input sample sound is acquired; based on the acoustic features of the input sample sound, the live script is converted from text to speech to obtain the live audio. In other words, embodiments of this disclosure also support the upload of an audio clip by the broadcaster to clone the broadcaster's voice features. This ensures that after the synthesized live video is broadcast in the live streaming room, the viewer will not be aware that the broadcast has switched from the broadcaster's verbal delivery to a "help me broadcast" message, thus guaranteeing the quality of the live stream.

[0262] Furthermore, the ability to clone one's own voice can be enabled for all broadcasters or for a subset of broadcasters; this disclosure does not impose any limitations on this. Additionally, the uploaded audio can be approximately 20 seconds long; this disclosure does not impose any limitations on this either.

[0263] In other embodiments, during speech synthesis, in response to a page exit operation, the electronic device saves the current page content so that the broadcaster can directly operate it upon the next entry. In other words, the broadcaster can exit the current page while waiting for audio synthesis, and the electronic device will automatically cache all content for direct operation upon the next entry.

[0264] In other embodiments, the electronic device plays the live audio in response to a listening operation on any of the generated live audio clips. For example... Figure 20 As shown, the current page displays audio explanations for items 1 through 4, along with corresponding preview controls. In response to triggering the preview control for item 1, the electronic device will play the audio explanation for item 1. Additionally, as... Figure 20 As shown, when the audio preview control is clicked, its display format will switch to "pause control" to facilitate the broadcaster to perform a pause playback operation. This disclosure does not limit this.

[0265] In summary, because the generated live audio supports previewing, this ensures that the broadcaster can know the playback effect of the live audio in advance, resulting in a high rate of information transmission.

[0266] Additionally, see Figure 21 When setting up a live stream, you can also configure whether to enable automatic muting during smart narration. If the host selects to enable automatic muting during smart narration, the host's microphone will be muted during the playback of the live audio to avoid unnecessary interference.

[0267] In 805, in response to the selection of the third live streaming mode, the electronic device displays the live streaming page based on the third live streaming mode during the live streaming phase.

[0268] In some embodiments, when the third live streaming mode is selected, the electronic device displays at least one sound option and at least one avatar option during the live streaming preparation phase. The different sound options are used to provide sample sounds with different acoustic characteristics; the different avatar options are used to provide digital virtual humans with different appearances.

[0269] For example, Figure 22 The interface displays four sound options, labeled Sound 1 through Sound 4. Additionally, the broadcaster can preview sample sounds by triggering the playback control corresponding to each sound option. Figure 22 The system also displays four avatar options, labeled Anchor A through Anchor D. Furthermore, by triggering the playback control corresponding to each avatar option, the user can browse sample broadcast videos of the corresponding digital virtual human. In other words, in response to a video playback operation based on any avatar option, the electronic device will play a sample broadcast video of the selected digital virtual human.

[0270] Next, in response to the selection of either the sound option or the image option, the electronic device requests the server to generate a live video; the live video includes a digital virtual human used to read the live script, and this digital virtual human has the same acoustic characteristics as the selected sample voice.

[0271] In summary, the embodiments disclosed herein allow users to freely select sample voices and digital virtual humans to synthesize live streaming videos, which is more intelligent and flexible, with better human-computer interaction, thereby improving the quality of live streaming content.

[0272] In other embodiments, the broadcaster can also be scheduled to start broadcasting at a set time. This means that after the above operations are completed, a scheduled broadcast can be set, and the broadcast will automatically start at the set time, completing the live stream based on the digital virtual person selected by the broadcaster. Accordingly, the method provided in this disclosure also includes: configuring the start time of the target live stream event;

[0273] During the live stream, the live stream page is displayed based on the selected live stream mode, including: playing the live stream video on the live stream page after the start time; wherein the live stream video includes a digital virtual human used to read the live stream script, and the digital virtual human has the same acoustic characteristics as the selected sample voice.

[0274] In summary, the embodiments of this disclosure provide multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can view various live streaming modes by triggering an operation entry point. This allows the broadcaster to freely choose the live streaming mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast, which not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming capabilities. In addition, the intelligent broadcasting function also ensures the quality of the live streaming content.

[0275] Furthermore, for broadcasters, this solution significantly reduces live streaming costs and effectively improves pre-broadcast preparation and live streaming efficiency. Additionally, for viewers, the intelligent broadcasting function helps broadcasters better explain products or guide audience interaction, thus providing a better viewing experience.

[0276] Figure 23 This is a flowchart illustrating another live streaming method according to an exemplary embodiment, such as... Figure 23 As shown, this live streaming method is applied to electronic devices, such as... Figure 1 The live streaming method, shown in server 103, includes the following steps:

[0277] In 2301, in response to receiving a live streaming configuration request, the server generates live streaming configuration data; wherein, the live streaming configuration request is sent by the first terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered.

[0278] This configuration page refers to Figure 6 The image shows the Smart Live Streaming page. Essentially, the Smart Live Streaming page is used for live streaming settings, and therefore is another form of live streaming configuration page. The only difference is that the content of the live streaming configuration page displaying the auxiliary live streaming entry differs from that of the live streaming configuration page displaying multiple live streaming modes.

[0279] In 2302, the server sends live streaming configuration data to the first terminal; the first terminal is used to display multiple AI-based live streaming modes based on the live streaming configuration data, wherein different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process.

[0280] During the live stream preparation phase, the first terminal displays a list of recommended items. These items are listed as available or displayed once the live stream begins. In other words, after obtaining the live stream duration, style, and item categories configured by the first streamer, the server uses AI technology to intelligently combine items suitable for that streamer; therefore, the aforementioned item recommendation list is generated by the server.

[0281] In some embodiments, see Figure 24 The server generates the item recommendation list in the following way:

[0282] 1. The server generates a list of first candidate items based on the configured item categories and multi-dimensional data related to the first streamer. For example, Figure 24 The results of large-scale item pre-sorting are shown in the figure.

[0283] The aforementioned multi-dimensional data includes item data and object data.

[0284] For example, the above-mentioned item data includes at least one of the following:

[0285] A. Resource transfer data of items displayed in the live broadcast room in the past, also known as transaction data.

[0286] The aforementioned transaction data reflects the streamer's historical sales performance. For example, this data includes information on various items the streamer has previously sold, such as the type of item sold, quantity sold, sales amount, and return rate. This data reflects the streamer's sales ability and performance on different items, helping the algorithm determine which items the streamer is better at promoting and which items may be less popular. For example, such as... Figure 24 As shown, the multimodal data feature real-time calculation engine can extract item transaction features based on the above transaction data.

[0287] B. Attribute data of items displayed in history.

[0288] For example, such as Figure 24 As shown, the multimodal data feature real-time calculation engine can extract item attribute features based on the above attribute data.

[0289] C. Resource transfer data based on items for second-level broadcasters similar to the first broadcaster, also known as item transaction data. The second-level broadcaster refers to broadcasters in the same industry as the first broadcaster, broadcasters of similar size, or broadcasters with the same style.

[0290] For example, based on the aforementioned item transaction data, it is possible to recommend items from other live streams of similar size and industry scale to the first streamer, which also have relatively high transaction volumes and whose categories match the first streamer's. Additionally, as... Figure 24 As shown, the multimodal data feature real-time calculation engine can extract features related to items sold in live streams by peers and items sold by similar users based on the above item transaction data.

[0291] For example, the object data mentioned above includes at least one of the following:

[0292] D. Resource transfer object data for historically displayed items. These resource transfer objects are also known as transaction objects. For example, transaction object data could be profile data of the transaction objects. For instance, such as... Figure 24 As shown, the multimodal data feature real-time calculation engine can extract user profile features based on the aforementioned transaction object data.

[0293] E. Data on the followed objects of the first broadcaster. These followed objects are also known as fan objects. For example, fan object data could be profile data of the fan objects. For instance, such as... Figure 24 As shown, the multimodal data feature real-time calculation engine can also extract user profile features based on the aforementioned fan object data.

[0294] F. Item category matching the second object. For example, such as... Figure 24 As shown, the multimodal data feature real-time calculation engine can extract features related to user interest categories based on the above item categories.

[0295] The user interest categories can be configured by the second object itself, or they can be inferred by the server based on the historical behavior of the second object. This disclosure does not limit this.

[0296] 2. During the live broadcast preparation phase, the server determines the number of items that can be displayed during the live broadcast based on the live broadcast duration configured for the broadcaster.

[0297] 3. Under the constraint of a certain number of items, the server side filters the items with the highest recommended value in the first candidate item list to obtain the second candidate item list.

[0298] For any given item, the recommendation value reflects how well the item is suited to be displayed in the live stream of the first streamer.

[0299] In summary, steps 1-3 involve comprehensively matching multi-dimensional data with the item categories selected by the first streamer, then calculating the number of items based on the livestream duration set by the first streamer, to generate the most suitable item combination for the streamer to sell in this livestream, such as recommending the N items with the highest matching degree. Here, N is a positive integer.

[0300] 4. The server filters the items in the second candidate item list based on the item filtering rules to obtain the item recommendation list, and then sends the item recommendation list to the terminal.

[0301] This step involves platform strategy intervention to filter items. For example, integrating price comparison and item diagnostic systems. By integrating a price comparison system, the platform can obtain real-time price information for similar items. This helps understand the price levels of items across different channels, providing a price reference for recommending items that match the streamer's preferences and ensuring that recommended items are competitively priced. The item diagnostic system primarily assesses various aspects of an item, including quality, authenticity, and reputation. Through comprehensive item diagnostics, the platform can filter out reliable and reputable items, providing strong support for streamers to recommend high-quality products. Furthermore, the platform can accurately recommend item categories and price ranges that match the streamer's style and target audience. This improves the fit between items and streamers. In summary, by integrating price comparison and item diagnostic systems, and by recommending high-quality categories and price ranges, the platform can effectively guarantee the quality of streamers' products.

[0302] It should be noted that the server distinguishes between merchant accounts and influencer accounts when generating the item recommendation list.

[0303] For example, when generating item combinations suitable for a merchant's livestream to sell in the current livestream, both merchant and influencer accounts first achieve large-scale item interest recall based on user profile features, item attribute features, and item transaction features. Then, based on features related to items sold in competitor livestreams, items sold by similar users, and user interest categories, real-time multi-dimensional item recall is achieved. Next, based on the large-scale item interest recall and the real-time multi-dimensional item recall, a large-scale item pre-ranking result is generated. Afterwards, considering factors such as livestream duration and through platform policy intervention, item filtering is implemented, ultimately generating an item recommendation list. Throughout this process, merchant accounts, often closely linked to specific brands and item categories, may focus more on item combinations and series when composing items. Influencer accounts, on the other hand, may be more flexible in composing items, able to combine items according to the livestream theme and fan needs.

[0304] In summary, the embodiments of this disclosure comprehensively recommend item combinations based on the live broadcast duration configured for the broadcaster, multi-dimensional data related to the broadcaster, and platform strategies. This recommendation method is more accurate and can improve the accuracy of item recommendations. Furthermore, the multi-dimensional data covers a wide range of data types, providing a comprehensive description of information related to the broadcaster. Therefore, accurate item combinations can be generated based on this data, ensuring the accuracy of item recommendations.

[0305] In 2303, in response to the selection of any live streaming mode, the server generates a live streaming page based on the selected live streaming mode during the live streaming phase and sends the generated live streaming page to the first terminal.

[0306] Regarding the second live streaming mode, the following will be combined with... Figure 25 This will introduce the complete process from the start of the live broadcast to audio processing and push notifications.

[0307] Live Stream Start-up Process: When the live stream begins, the broadcaster sends a start-up message to the server, which then generates a live stream ID. The server then matches the newly generated item explanation task, queries the associated live stream ID, organizes the explanation steps for the item explanation task and writes them to the cache, and finally pre-pushes N sorted audio files to the broadcaster via a long connection.

[0308] The broadcaster's audio processing workflow is as follows: The broadcaster parses the audio file, performs external playback and local mixing, and then transmits the processed audio to the CDN through the live streaming origin server, and finally pushes it to the audience.

[0309] Audio playback event handling flow: On the server side, when an audio playback start event occurs, it determines whether it is an item explanation task. If so, it calls the item explanation start interface. If so, it determines whether it is an audio playback end event; if so, it continues to determine whether it is an item explanation task. If so, it calls the item explanation start interface. If not, it updates the step ID status cache corresponding to the audio and retrieves the next explanation step. When the total duration of the audio file exceeds 1 minute, it combines the audio push data and pre-pushes one sorted audio file via a long connection.

[0310] Regarding the second live streaming mode, the following will be combined with... Figure 26 This section will introduce the management steps and audio push scheduling in the live streaming process.

[0311] Live Streaming Narration Step Status Management: During the live stream, each live stream ID is associated with multiple narration steps. Each narration step includes a broadcast status and a pending broadcast status. Each narration step contains information such as status, duration, and CDN. New narration steps (such as narration step M and narration step N) can be inserted into the pending broadcast queue.

[0312] Audio playback and push scheduling: When the audio playback is completed normally, the system retrieves the next explanation step. If the step duration exceeds 1 minute, the data of the steps to be played will be combined and pushed through a long connection, and the push record will be recorded; if the step duration does not exceed 1 minute, the next explanation step will be retrieved directly.

[0313] Synchronization verification mechanism: The client periodically reports the playback progress, and the system verifies and synchronizes the playback progress, checking the consistency of the currently playing audio and the reasonableness of the progress. If the check result is normal, the normal process continues; if it is abnormal, the system obtains the next explanation step, combines the data of the step to be played, and returns the data to the client for updating.

[0314] Active request mechanism: When the live stream has not ended and the client's cached playlist is empty, the client will actively request the playlist to be played, and the system will return the corresponding data according to the request.

[0315] In summary, the embodiments of this disclosure provide multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can access multiple live streaming modes issued by the server by triggering an operation entry point. This allows the broadcaster to freely choose the live streaming mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast process. This not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming. Additionally, the intelligent broadcasting function ensures the quality of the live streaming content. Moreover, from the server side's perspective, the content undergoes security risk control during the auxiliary live streaming process, guaranteeing the quality of the live streaming content.

[0316] Figure 27 This is a block diagram illustrating a live streaming device according to an exemplary embodiment. (Refer to...) Figure 27 The device includes:

[0317] The first display module 2701 is configured to display an auxiliary live streaming entry on the live streaming configuration page, wherein the live streaming configuration page is used to provide configuration functions for the target live streaming event;

[0318] The second display module 2702 is configured to display multiple AI-based live streaming modes in response to a trigger operation on the auxiliary live streaming entry; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0319] The third display module 2703 is configured to display the live streaming page based on the selected live streaming mode after the live streaming starts, in response to the selection of any live streaming mode.

[0320] In summary, the embodiments of this disclosure provide multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can view various live streaming modes by triggering an operation entry point. This allows the broadcaster to freely choose the live streaming mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast, which not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming capabilities. In addition, the intelligent broadcasting function also ensures the quality of the live streaming content.

[0321] In some embodiments, the second display module is configured to:

[0322] Display two or more of the first live streaming mode, the second live streaming mode, or the third live streaming mode;

[0323] The first live streaming mode refers to assisting the first broadcaster in live streaming by displaying live streaming text on the live streaming page; the first broadcaster is used to broadcast the target live streaming event.

[0324] The second live streaming mode refers to assisting the first broadcaster by playing live audio in the live streaming room; the live audio is obtained by converting the live streaming script into speech.

[0325] The third live streaming mode refers to broadcasting the target live event through a digital virtual human in the live streaming room.

[0326] In other embodiments, the device further includes:

[0327] The fourth display module is configured to display at least one historical live stream record; wherein the historical live stream record is used to describe historical live stream events;

[0328] The fourth display module is also configured to display the live page in response to a reuse operation of the first historical live record, based on the configuration data of the historical live events described in the first historical live record;

[0329] The fourth display module is also configured to display the live page in response to an editing operation on the second historical live record, based on the configuration data after editing the historical live events described in the second historical live record.

[0330] In other embodiments, when the second live streaming mode is selected, the third display module is configured to display a prompting control on the live streaming page; in response to a triggering operation on the prompting control, a live streaming script matching the current live streaming progress is displayed on the live streaming page.

[0331] In other embodiments, the third display module is configured as follows:

[0332] If the current live stream progress indicates that the first streamer is explaining an item, the explanation text for the item currently being explained is displayed on the live stream page; or,

[0333] If the current live stream progress indicates that the live stream has started, display the live stream opening text on the live stream page; or,

[0334] When the current live stream progress indicates that the first streamer is providing interactive guidance, interactive guidance text is displayed on the live stream page; or,

[0335] If the current live stream progress indicates that the live stream has ended, a message indicating the end of the live stream will be displayed on the live stream page.

[0336] In other embodiments, when the second live streaming mode is selected, the third display module is configured to display an audio playback control on the live streaming page; in response to a trigger operation on the audio playback control, display a playback control for at least one live audio stream on the live streaming page; and in response to a trigger operation on the playback control for any one live audio stream, play the selected live audio stream in the live streaming room.

[0337] In other embodiments, when the second live streaming mode is selected, the device further includes:

[0338] The fifth display module is configured to display at least one sound option; wherein different sound options are used to provide sample sounds with different acoustic characteristics; in response to a sound playback operation based on any sound option, the selected sample sound is played; in response to a sound selection operation based on any sound option, the live script is converted from text to speech based on the acoustic characteristics of the selected sample sound to obtain live audio.

[0339] In other embodiments, when the second live streaming mode is selected, the fifth display module is further configured to acquire input sample sound; based on the acoustic features of the input sample sound, the live streaming text is converted into speech to obtain live streaming audio.

[0340] In other embodiments, the live audio includes at least one of the following: audio explaining the item to be displayed, audio at the start of the live stream, audio for interactive guidance, or audio at the end of the live stream; the device further includes:

[0341] The playback module is configured to play the live audio in response to a listening operation on any generated live audio.

[0342] In other embodiments, when the first live streaming mode is selected, the third display module is configured to display a prompting control on the live streaming page; in response to a triggering operation on the prompting control, a live streaming script matching the current live streaming progress is displayed on the live streaming page.

[0343] In other embodiments, when the third live streaming mode is selected, the device further includes:

[0344] The sixth display module is configured to display at least one sound option and at least one image option; wherein different sound options are used to provide sample sounds with different acoustic characteristics; different image options are used to provide digital virtual humans with different images; in response to the selection of any sound option and any image option, a live video is generated; wherein the live video includes a digital virtual human for broadcasting the live script, the digital virtual human having the same acoustic characteristics as the sample sound.

[0345] In other embodiments, the device further includes:

[0346] The seventh display module is configured to display configuration options in response to the selection of any live streaming mode; wherein the configuration options are used to indicate at least one of configuring the live streaming duration, live streaming style, or item category to be displayed in the live streaming room; and to display an item recommendation list based on at least one of the configured live streaming duration, live streaming style, or item category; wherein the items in the item recommendation list are displayed after the live streaming starts.

[0347] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0348] Figure 28 This is a block diagram illustrating another live streaming device according to an exemplary embodiment. (Refer to...) Figure 28 The device includes:

[0349] The first generation module 2801 is configured to generate live streaming configuration data in response to receiving a live streaming configuration request; the live streaming configuration request is sent by the terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered.

[0350] The sending module 2802 is configured to send the live streaming configuration data to the terminal; wherein, the terminal is used to display multiple artificial intelligence-based live streaming modes based on the live streaming configuration data, and different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process;

[0351] The second generation module 2803 is configured to generate a live streaming page based on the selected live streaming mode in response to any live streaming mode being selected.

[0352] The sending module 2802 is also configured to send the live page to the terminal.

[0353] In summary, the embodiments of this disclosure provide multiple live streaming modes to assist broadcasters in starting their broadcasts. Specifically, during the live streaming preparation phase, the broadcaster can access multiple live streaming modes issued by the server by triggering an operation entry point. This allows the broadcaster to freely choose the live streaming mode that suits them best. Furthermore, different live streaming modes are used to employ different auxiliary live streaming methods during the broadcast, which not only meets the needs of different broadcasters but also significantly reduces live streaming costs and difficulties due to the intelligent and diversified auxiliary live streaming capabilities. In addition, the intelligent broadcasting function also ensures the quality of the live streaming content.

[0354] In some embodiments, the apparatus further includes:

[0355] The determination module is configured to determine the number of items that can be displayed during the live stream based on the configured live stream duration;

[0356] The third generation module is configured to generate a first candidate item list based on the configured item category and multi-dimensional data related to the first broadcaster object; wherein, the first broadcaster object is used to broadcast the target live event; the multi-dimensional data includes item data and object data;

[0357] The filtering module is configured to filter items from the first candidate item list that have the highest recommended value within a predetermined number of positions, under the constraint of a certain number of items, to obtain a second candidate item list; wherein, for any item, the recommended value is used to reflect the degree of suitability of the item for display in the live broadcast room of the first streamer.

[0358] The filtering module is configured to filter items in the second candidate item list based on item filtering rules to obtain an item recommendation list;

[0359] The sending module is also configured to send the item recommendation list to the terminal.

[0360] In other embodiments, the item data includes at least one of the following:

[0361] Resource transfer data of items displayed historically within the live stream;

[0362] The attribute data of the historically displayed items;

[0363] The second streamer object is the item-based resource transfer data; wherein, the second streamer object is a peer streamer, a streamer of the same scale, or a streamer of the same style as the first streamer object;

[0364] The object data includes at least one of the following:

[0365] The resource transfer object data of the historical display items;

[0366] The follower data of the first broadcaster object;

[0367] The item category that matches the second object.

[0368] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0369] It should be noted that the live streaming device provided in the above embodiments is only illustrated by the division of the above functional units. In practical applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device can be divided into different functional units to complete all or part of the functions described above. In addition, the live streaming device and the live streaming method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0370] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0371] In some embodiments, an electronic device is also provided, the electronic device comprising:

[0372] One or more processors;

[0373] Memory used to store the executable program code of the processor;

[0374] The processor is configured to execute the program code to implement the above-described live streaming method.

[0375] In response to the electronic device being provided as a terminal, Figure 29 This is a block diagram illustrating a terminal 2900 according to an exemplary embodiment.

[0376] Typically, terminal 2900 includes a processor 2901 and a memory 2902.

[0377] Processor 2901 includes one or more processing cores, such as a 4-core processor or an 8-core processor. Processor 2901 is implemented using at least one of the following hardware forms: DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Alternatively, processor 2901 includes a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state.

[0378] In some embodiments, processor 2901 integrates a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 2901 also includes an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0379] The memory 2902 includes one or more computer-readable storage media, which are non-transitory. The memory 2902 also includes high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 2902 are used to store at least one program code, which is executed by the processor 2901 to implement the live streaming method provided in the method embodiments of this disclosure.

[0380] In some embodiments, the terminal 2900 further includes a peripheral device interface 2903 and at least one peripheral device. The processor 2901, memory 2902, and peripheral device interface 2903 are connected via a bus or signal line. Each peripheral device is connected to the peripheral device interface 2903 via a bus, signal line, or circuit board. The peripheral device includes at least one of the following: a radio frequency circuit 2904, a display screen 2905, a camera assembly 2906, an audio circuit 2907, and a power supply 2908.

[0381] Peripheral device interface 2903 is used to connect at least one I / O (Input / Output) related peripheral device to processor 2901 and memory 2902. In some embodiments, processor 2901, memory 2902 and peripheral device interface 2903 are integrated on the same chip or circuit board; in other embodiments, any one or two of processor 2901, memory 2902 and peripheral device interface 2903 are implemented on separate chips or circuit boards, which is not limited in this disclosure.

[0382] The radio frequency (RF) circuit 2904 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 2904 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 2904 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. In some embodiments, the RF circuit 2904 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 2904 communicates with other terminals via at least one wireless communication protocol. Wireless communication protocols include, but are not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 2904 also includes circuitry related to NFC (Near Field Communication), which is not limited in this disclosure.

[0383] Display screen 2905 is used to display a UI (User Interface). The UI includes graphics, text, icons, videos, and any combination thereof. When display screen 2905 is a touch display, it also has the ability to collect touch signals on or above its surface. These touch signals are input as control signals to processor 2901 for processing. In this case, display screen 2905 also provides virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there is one display screen 2905, disposed on the front panel of terminal 2900; in other embodiments, there are at least two display screens 2905, disposed on different surfaces of terminal 2900 or in a folded design; in still other embodiments, display screen 2905 is a flexible display screen, disposed on a curved or folded surface of terminal 2900. Alternatively, display screen 2905 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 2905 is made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0384] The camera assembly 2906 is used to acquire images or videos. In some embodiments, the camera assembly 2906 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In other embodiments, the camera assembly 2906 also includes a flash. The flash is a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, used for light compensation at different color temperatures.

[0385] The audio circuit 2907 includes a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting them into electrical signals that are input to the processor 2901 for processing, or to the radio frequency circuit 2904 for voice communication. Multiple microphones are used for stereo sound acquisition or noise reduction, positioned at different locations on the terminal 2900. Alternatively, the microphones may be array microphones or omnidirectional microphones. The speaker is used to convert electrical signals from the processor 2901 or the radio frequency circuit 2904 into sound waves. The speaker may be a conventional thin-film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 2907 also includes a headphone jack.

[0386] Power supply 2908 is used to power the various components in terminal 2900. Power supply 2908 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. If power supply 2908 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is charged via a wired line, while a wireless rechargeable battery is charged via a wireless coil. The rechargeable battery also supports fast charging technology.

[0387] Those skilled in the art will understand that Figure 29 The structure shown does not constitute a limitation on terminal 2900 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0388] In some embodiments, when the electronic device is provided as a server Figure 30 This is a block diagram illustrating a server 3000 according to an embodiment of the present disclosure. The server 3000 can vary considerably depending on its configuration or performance, and includes one or more Central Processing Units (CPUs) 3001 and one or more memories 3002. The memories 3002 store at least one line of program code, which is loaded and executed by the processor 3001 to implement the live streaming methods provided in the various method embodiments described above. Of course, the server also has wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server 3000 also includes other components for implementing device functions, which will not be elaborated upon here.

[0389] In some embodiments, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, which are executed by a processor of an electronic device to implement the above-described live streaming method. In other embodiments, the computer-readable storage medium is a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0390] In some embodiments, a computer program product is also provided, including a computer program that, when executed by a processor of an electronic device, implements the above-described live streaming method.

[0391] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0392] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A live streaming method, characterized in that, The method includes: An auxiliary live streaming entry is displayed on the live streaming configuration page, which provides configuration functions for the target live streaming event; In response to the triggering operation of the auxiliary live streaming entry, multiple AI-based live streaming modes are displayed; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process; If the first streamer has no historical streaming records, in response to the selection of any streaming mode, configuration options are displayed. These configuration options indicate at least one of the following: streaming duration, streaming style, or item category to be displayed in the streaming room. After the streaming starts, a streaming page is displayed based on the selected streaming mode, and an item recommendation list conforming to item filtering rules is displayed based on the configured streaming duration, item category, multi-dimensional data related to the first streamer, and the type of user account used by the first streamer during the streaming. Items in the item recommendation list are displayed after the streaming starts. The first streamer is used to stream the target streaming event. If the first broadcaster has a history of broadcasting, at least one historical broadcast record is displayed; wherein, the historical broadcast record is used to describe historical broadcast events; in response to the reuse operation of the first historical broadcast record, after the broadcast starts, the broadcast page is displayed based on the configuration data of the historical broadcast events described in the first historical broadcast record; in response to the editing operation of the second historical broadcast record, after the broadcast starts, the broadcast page is displayed based on the edited configuration data of the historical broadcast events described in the second historical broadcast record.

2. The live streaming method according to claim 1, characterized in that, The display shows multiple AI-based live streaming modes, including: Display two or more of the first live streaming mode, the second live streaming mode, or the third live streaming mode; The first live streaming mode refers to assisting the first broadcaster in live streaming by displaying live streaming text on the live streaming page; the first broadcaster is used to broadcast the target live streaming event. The second live streaming mode refers to assisting the first broadcaster by playing live audio in the live streaming room; the live audio is obtained by converting the live streaming script into speech. The third live streaming mode refers to broadcasting the target live event through a digital virtual human in the live streaming room.

3. The live streaming method according to claim 2, characterized in that, When the second live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes: A prompting control is displayed on the live streaming page; In response to the triggering operation of the prompting control, a live broadcast script matching the current live broadcast progress is displayed on the live broadcast page.

4. The live streaming method according to claim 3, characterized in that, The live stream text displayed on the live stream page that matches the current live stream progress includes: If the current live stream progress indicates that the first streamer is explaining an item, the explanation text for the item currently being explained is displayed on the live stream page; or, If the current live stream progress indicates that the live stream has started, display the opening text of the live stream on the live stream page; or, When the current live stream progress indicates that the first streamer is providing interactive guidance, interactive guidance text is displayed on the live stream page; or, If the current live stream progress indicates that the live stream has ended, a message indicating the end of the live stream will be displayed on the live stream page.

5. The live streaming method according to claim 2, characterized in that, When the second live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes: Audio playback controls are displayed on the live streaming page; In response to a triggering operation on the audio playback control, a playback control for at least one live audio stream is displayed on the live streaming page; In response to a trigger operation on the playback control of any live audio, the selected live audio is played in the live room.

6. The live streaming method according to claim 2, characterized in that, When the second live streaming mode is selected, the method further includes: Display at least one sound option; wherein different sound options are used to provide sample sounds with different acoustic characteristics; In response to a sound playback operation based on any sound option, play the selected sample sound; In response to a sound selection operation based on any sound option, the live broadcast script is converted from text to speech based on the acoustic features of the selected sample sound to obtain the live broadcast audio.

7. The live streaming method according to claim 2, characterized in that, When the second live streaming mode is selected, the method further includes: Obtain the input sample sound; Based on the acoustic features of the input sample sound, the live broadcast script is converted from text to speech to obtain the live broadcast audio.

8. The live streaming method according to claim 6 or 7, characterized in that, The live stream audio includes at least one of the following: audio explaining the item to be displayed, audio at the start of the live stream, audio for interactive guidance, or audio at the end of the live stream; the method further includes: In response to a listening operation on any of the generated live audio clips, the live audio clips are played.

9. The live streaming method according to claim 2, characterized in that, When the first live streaming mode is selected, displaying the live streaming page based on the selected live streaming mode includes: A prompting control is displayed on the live streaming page; In response to the triggering operation of the prompting control, a live broadcast script matching the current live broadcast progress is displayed on the live broadcast page.

10. The live streaming method according to claim 2, characterized in that, When the third live streaming mode is selected, the method further includes: Display at least one voice option and at least one image option; wherein, different voice options are used to provide sample voices with different acoustic characteristics; and different image options are used to provide digital virtual humans with different images; In response to the selection of any sound option and any image option, a live video is generated; wherein the live video includes a digital virtual human for broadcasting the live script, and the digital virtual human has the same acoustic characteristics as the sample voice.

11. A live streaming method, characterized in that, The method includes: In response to receiving a live streaming configuration request, live streaming configuration data is generated; the live streaming configuration request is sent by the terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered. The terminal sends the live streaming configuration data to the terminal; wherein the terminal is used to display multiple AI-based live streaming modes based on the live streaming configuration data, and different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process; In response to the selection of any live streaming mode, a live streaming page is generated based on the selected live streaming mode, and the live streaming page and the item recommendation list are sent to the terminal. The terminal is configured to, in the event that the first streamer has no historical streaming records, display configuration options in response to the selection of any streaming mode. These configuration options indicate at least one of the following: streaming duration, streaming style, or item category to be displayed in the streaming room. After the streaming starts, the terminal displays a streaming page based on the selected streaming mode and, based on the configured streaming duration, item category, multi-dimensional data related to the first streamer, and the type of user account used by the first streamer during the streaming, displays an item recommendation list that conforms to item filtering rules. Items in the item recommendation list are displayed after the streaming starts. The first broadcaster object is used to broadcast the target live event; or, the terminal is used to display at least one historical live broadcast record when the first broadcaster object has historical broadcast records; wherein, the historical live broadcast record is used to describe historical live events; in response to the reuse operation of the first historical live broadcast record, after the live broadcast starts, the live broadcast page is displayed based on the configuration data of the historical live broadcast events described in the first historical live broadcast record; in response to the editing operation of the second historical live broadcast record, after the live broadcast starts, the live broadcast page is displayed based on the edited configuration data of the historical live broadcast events described in the second historical live broadcast record.

12. The live streaming method according to claim 11, characterized in that, The method further includes: The number of items that can be displayed during the live stream is determined based on the configured live stream duration. Based on the configured item categories and multi-dimensional data related to the first streamer object, a first candidate item list is generated; the multi-dimensional data includes item data and object data. Under the constraint of a certain number of items, the first candidate item list is filtered to select the items with the highest recommended values, which are ranked in the top preset number, to obtain the second candidate item list; wherein, for any item, the recommended value is used to reflect the degree of suitability of the item for display in the live broadcast room of the first streamer. Based on the item filtering rules, the items in the second candidate item list are filtered to obtain the item recommendation list.

13. The live streaming method according to claim 12, characterized in that, The item data includes at least one of the following: Resource transfer data of items displayed historically within the live stream; The attribute data of the historically displayed items; The second streamer object is the item-based resource transfer data; wherein, the second streamer object is a peer streamer, a streamer of the same scale, or a streamer of the same style as the first streamer object; The object data includes at least one of the following: The resource transfer object data of the historical display items; The follower data of the first broadcaster; The item category that matches the second streamer object.

14. A live streaming device, characterized in that, The device includes: The first display module is configured to display an auxiliary live streaming entry on the live streaming configuration page, which is used to provide configuration functions for the target live streaming event; The second display module is configured to display multiple AI-based live streaming modes in response to a trigger operation on the auxiliary live streaming entry; wherein, different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process; The third display module is configured to respond to the selection of any live streaming mode and display the live streaming page based on the selected live streaming mode after the live streaming starts. The seventh display module is configured to, in response to the selection of any live streaming mode, display configuration options when the first streamer has no historical live streaming records; wherein, the configuration options are used to indicate at least one of the following: live streaming duration, live streaming style, or item category to be displayed in the live streaming room; based on the configured live streaming duration, item category, multi-dimensional data related to the first streamer, and the type of user account used by the first streamer during the live stream, display an item recommendation list that conforms to item filtering rules; the items in the item recommendation list are displayed after the live stream starts; the first streamer is used to live stream the target live streaming event; The fourth display module is configured to display at least one historical live stream record when the first broadcaster object has historical broadcast records; wherein the historical live stream record is used to describe historical live stream events; in response to the reuse operation of the first historical live stream record, after the live stream starts, the live stream page is displayed based on the configuration data of the historical live stream events described in the first historical live stream record; in response to the editing operation of the second historical live stream record, the live stream page is displayed based on the edited configuration data of the historical live stream events described in the second historical live stream record.

15. A live streaming device, characterized in that, The device includes: The first generation module is configured to generate live streaming configuration data in response to receiving a live streaming configuration request; the live streaming configuration request is sent by the terminal after the auxiliary live streaming entry on the live streaming configuration page is triggered. The sending module is configured to send the live streaming configuration data to the terminal; wherein the terminal is used to display multiple AI-based live streaming modes based on the live streaming configuration data, and different live streaming modes are used to broadcast the target live streaming event using different auxiliary live streaming methods during the live streaming process; The second generation module is configured to generate a live streaming page based on the selected live streaming mode in response to any live streaming mode being selected. The sending module is also configured to send the live streaming page and the item recommendation list to the terminal; The terminal is configured to, in the event that the first streamer has no historical streaming records, display configuration options in response to the selection of any streaming mode. These configuration options indicate at least one of the following: streaming duration, streaming style, or item category to be displayed in the streaming room. After the streaming starts, the terminal displays a streaming page based on the selected streaming mode and, based on the configured streaming duration, item category, multi-dimensional data related to the first streamer, and the type of user account used by the first streamer during the streaming, displays an item recommendation list that conforms to item filtering rules. Items in the item recommendation list are displayed after the streaming starts. The first broadcaster object is used to broadcast the target live event; or, the terminal is used to display at least one historical live broadcast record when the first broadcaster object has historical broadcast records; wherein, the historical live broadcast record is used to describe historical live events; in response to the reuse operation of the first historical live broadcast record, after the live broadcast starts, the live broadcast page is displayed based on the configuration data of the historical live broadcast events described in the first historical live broadcast record; in response to the editing operation of the second historical live broadcast record, after the live broadcast starts, the live broadcast page is displayed based on the edited configuration data of the historical live broadcast events described in the second historical live broadcast record.

16. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the live streaming method as described in any one of claims 1 to 10; or, the live streaming method as described in any one of claims 11 to 13.

17. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of an electronic device, the electronic device is enabled to perform the live streaming method as described in any one of claims 1 to 10; or, the live streaming method as described in any one of claims 11 to 13.

18. A computer program product, characterized in that, It includes a computer program that, when executed by a processor of an electronic device, implements the live streaming method as described in any one of claims 1 to 10; or, the live streaming method as described in any one of claims 11 to 13.

Images