Live video stream generation method and process driving device

Abstract

The present invention discloses a method for generating a live video stream and a process driving device, which relates to the field of computer technology and can improve the data organization efficiency in the process of forming a live broadcast room. The method is applied to a process driving device in a live broadcast system, and the live broadcast system also includes a content expression device and a live broadcast data generation device connected to the process driving device. The method includes: the process driving device obtains the process requirement data of the service object; the process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process requirement data according to the process requirement data; the process driving device sends the live broadcast process data and live broadcast rule data to the live broadcast data generation device, so that the live broadcast data generation device generates a live video stream for live broadcast based on the live broadcast process data, the live broadcast rule data and the live broadcast content data from the content expression device.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a live video stream generation method and a process driving device. Background Art

[0002] With the development of live broadcast technology, online live broadcasting is gradually being chosen by more and more users to achieve different purposes, such as real-time live broadcasting of games, videos or selling products.

[0003] At present, the planning and implementation of the live broadcast room of online live broadcast at least include designing the live broadcast process of the live broadcast room, forming a live broadcast team, setting up the background of the live broadcast room, collecting the image and voice of the anchor, etc. It can be seen that the implementation process of live broadcast is relatively complicated, and the types of data involved in live broadcast (for example, audio data, image data, etc.) are relatively large. It is difficult to organize multiple types of data efficiently, resulting in low data organization efficiency. Summary of the invention

[0004] The present invention provides a live video stream generation method and a process driving device to solve the problem of low data organization efficiency in the live broadcast room formation process in the prior art. Specifically, the embodiment of the present application discloses the following technical solutions:

[0005] In the first aspect, the present application provides a method for generating a live video stream, which is applied to a process-driven device in a live broadcast system, and the live broadcast system also includes a content expression device and a live broadcast data generation device connected to the process-driven device. The method includes: the process-driven device obtains process requirement data of a service object; the process-driven device determines the live broadcast process data and live broadcast rule data corresponding to the process requirement data according to the process requirement data; the process-driven device sends the live broadcast process data and live broadcast rule data to the live broadcast data generation device, so that the live broadcast data generation device generates a live video stream for live broadcast based on the live broadcast process data, live broadcast rule data and live broadcast content data from the content expression device.

[0006] In a possible implementation of the first aspect, the process requirement data includes process characteristic data and rule characteristic data; the process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process requirement characteristics based on the process requirement data, including: the process driving device determines the live broadcast process data matching the process characteristic data from the process library, and determines the live broadcast rule data matching the rule characteristic data from the rule library; the process library includes a correspondence between multiple process characteristic data and multiple live broadcast process data, and the rule library includes a correspondence between multiple rule characteristic data and multiple live broadcast rule data.

[0007] In a possible implementation of the first aspect, the process requirement data includes a live broadcast type; the process driving device determines the live broadcast process data and the live broadcast rule data corresponding to the process requirement characteristics according to the process requirement data, including: the process driving device determines the live broadcast process data matching the live broadcast type from the process library according to the live broadcast type, and determines the live broadcast rule data matching the live broadcast type from the rule library; the process library includes a correspondence between multiple live broadcast types and multiple live broadcast process data, and the rule library includes a correspondence between multiple live broadcast types and multiple live broadcast rule data.

[0008] In a possible implementation of the first aspect, the method also includes: a process-driven device receives a first operation of a service object; the process-driven device determines, in response to the first operation, process adjustment information corresponding to the first operation; and the process-driven device adjusts the live broadcast process data according to the process adjustment information.

[0009] In a possible implementation of the first aspect, the method also includes: a process-driven device receives a second operation of the service object; the process-driven device determines rule adjustment information corresponding to the second operation in response to the second operation; and the process-driven device adjusts the live broadcast rule data according to the rule adjustment information.

[0010] In a possible implementation of the first aspect, the live video stream includes live image data and live audio data, and the method also includes: a process-driven device receives a third operation of the service object; the process-driven device responds to the third operation, switching the live audio data in the live video stream to target audio data, and the target audio data is audio data collected in real time by an audio collection device.

[0011] On the second aspect, the present application also provides a process-driven device, including: an acquisition module, used to acquire process requirement data of a service object; a processing module, used to determine live broadcast process data and live broadcast rule data corresponding to process requirement characteristics based on the process requirement data acquired by the acquisition module; a sending module, used to send the live broadcast process data and live broadcast rule data obtained by the processing module to a live broadcast data generation device, so that the live broadcast data generation device generates a live video stream for live broadcast based on the live broadcast process data, live broadcast rule data and live broadcast content data from a content expression device.

[0012] In a third aspect, the present application provides an electronic device, comprising a processor and a memory; the memory is used to store computer instructions, and when the electronic device is running, the processor executes the computer instructions stored in the memory to enable the electronic device to implement the method for generating a live video stream as provided in the first aspect above.

[0013] In a fourth aspect, the present application also provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is executed on an electronic device, the electronic device implements the method for generating a live video stream as provided in the first aspect above.

[0014] In a fifth aspect, the present application also provides a computer program product comprising computer instructions, which, when executed on an electronic device, enables the electronic device to implement the method for generating a live video stream as provided in the first aspect above.

[0015] In this application, the above names do not limit the devices or functional modules themselves. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those of this application, they fall within the scope of the claims of this application and their equivalent technologies.

[0016] These and other aspects of the present application will become more apparent from the following description.

[0017] The technical solution provided by the present application is that the process-driven device can determine the live broadcast process data and live broadcast rule data corresponding to the process demand data after obtaining the user's process demand data. Afterwards, the process-driven device can send the live broadcast process data and live broadcast rule data to the live broadcast data generation device, so that the live broadcast data generation device generates a live video stream based on the live broadcast process data, live broadcast rule data, and live broadcast content data from the content expression device. Applying the technical solution disclosed in the present invention, the process-driven device automatically determines the live broadcast process data and live broadcast rule data corresponding to the live broadcast video stream based on the process demand data of the service object, and then smoothly combines the live broadcast content data to generate a live video stream for live broadcast. In this technical solution, there is no need for the service object to organize the live broadcast process data, which reduces the problem of complex data organization in the existing live broadcast room formation process and improves data organization efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A schematic diagram of a structure of an implementation environment provided for an embodiment of the present application;

[0020] Figure 2 A schematic diagram of the structure of a live broadcast system provided in an embodiment of the present application;

[0021] Figure 3A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 1 ;

[0022] Figure 4 A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 2 ;

[0023] Figure 5 A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 3 ;

[0024] Figure 6 A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 4 ;

[0025] Figure 7 A schematic diagram of a scenario for a speech editing operation provided in an embodiment of the present application;

[0026] Figure 8 A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 5 ;

[0027] Fig. 9 A schematic diagram of a scenario of a rule adjustment operation provided in an embodiment of the present application;

[0028] Fig.10 A flow chart of a method for generating a live video stream provided in an embodiment of the present application Figure 6 ;

[0029] Fig.11 A schematic diagram of the structure of a process driving device provided in an embodiment of the present application;

[0030] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, and to make the above-mentioned purposes, features and advantages of the embodiments of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments of the present application, other embodiments obtained by ordinary technicians in this field without making creative work belong to the protection scope of the present application.

[0032] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0033] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0034] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0035] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0036] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0037] The term "live video stream" refers to a sequence of digitally encoded data that is used to transmit from a live broadcast system to any live broadcast platform or terminal without significant delay to broadcast live video. Therefore, as used in this disclosure, a live video stream includes data transmission from one computing device to another computing device (or to multiple computing devices) (including a server or server group). Live video streaming also includes a one-way broadcast of data from a live broadcast system (or server group) to a live broadcast platform or user terminal (or to multiple viewer devices).

[0038] The implementation process of existing online live broadcast rooms is relatively complicated, involving many types of data (for example, audio data, image data, etc.), and multiple types of data are difficult to be organized efficiently, resulting in low data organization efficiency.

[0039] In response to the above problems, an embodiment of the present application provides a method for generating a live video stream, in which a process-driven device can determine the live process data and live rule data corresponding to the process demand data after obtaining the process demand data of the user. Afterwards, the process-driven device can send the live process data and live rule data to the live data generation device, so that the live data generation device generates a live video stream based on the live process data, the live rule data, and the live content data from the content expression device. Applying the technical solution disclosed in the present invention, the process-driven device automatically determines the live process data and live rule data corresponding to the live video stream based on the process demand data of the service object, and then smoothly combines the live content data to generate a live video stream for live broadcast. In this technical solution, there is no need for the service object to organize the live process data, which reduces the problem of complex data organization in the existing live broadcast room formation process and improves data organization efficiency.

[0040] The technical solution provided in the embodiments of the present application can be applied to Figure 1 In the implementation environment shown, the implementation environment may include a live broadcast system 01, a live broadcast platform 02 and a user terminal 03. The live broadcast system 01 and the live broadcast platform 02 may communicate with each other via a wired or wireless communication method, and the live broadcast platform 02 and the user terminal 03 may also communicate with each other via a wired or wireless communication method.

[0041] The live broadcast system 01 is mainly used to generate a live video stream and push the live video stream to the live broadcast platform 02 for live broadcast. In the embodiment of the present application, there may be one or more live broadcast platforms 02. Figure 1 Only one live broadcast platform 02 is used as an example, and no specific limitation is made to it.

[0042] The live broadcast platform 02 is mainly used to push the live broadcast data stream to the user terminal 03 according to specific rules after receiving the live broadcast video stream from the live broadcast system 01, so that the user terminal 03 plays the live broadcast data corresponding to the live broadcast video stream for the user to watch. In the embodiment of the present application, there can be one or more user terminals 03. The user terminal 03 can be an electronic device installed with the live broadcast application corresponding to the live broadcast platform 02.

[0043] Figure 1 In the figure, only user terminal 03 - 1 , user terminal 03 - 2 and user terminal 03 - 3 are used as examples of user terminals 03 , and the number of user terminals 03 is not specifically limited.

[0044] Reference Figure 2As shown, the live broadcast system 01 provided in the embodiment of the present application may specifically include a process driving device 011, a live broadcast data generating device 012, and a content expression device 013. Among them, wired or wireless communication can be performed between the process driving device 011 and the live broadcast data generating device 012. Wired or wireless communication can also be performed between the live broadcast data generating device 012 and the content expression device.

[0045] The process driving device 011 can be used to obtain the process demand data of the user and determine the live process data and live rule data corresponding to the process demand data. Afterwards, the process driving device 011 can send the live process data and live rule data to the live data generating device 012, so that the live data generating device 012 generates a live video stream for live broadcast based on the live process data and live rule data, as well as the live content data from the content expression device.

[0046] It should be noted that in the present application, the process driving device 011, the live data generating device 012 and the content expression device 013 can be separate devices or different parts of the same device, or modules that implement different functions in the data center, depending on actual needs, and the present application does not impose any specific restrictions on this.

[0047] Based on the above live broadcast system, refer to Figure 3 As shown, the embodiment of the present application provides a method for generating a live video stream, which may specifically include S301-S303:

[0048] S301. The process driving device obtains process requirement data of the service object.

[0049] In the embodiment of the present application, the process requirement data may be feature content used to reflect the service object's requirements for the process and rules of the live broadcast room, for example, "selling goods", "mother and baby products", "milk powder", "setting the atmosphere", "interaction", "warming up the scene" and "pampering fans".

[0050] In some embodiments, the service object can directly provide the process requirement data to the process driving device. For example, the service object can input the process requirement data on its own service terminal or process driving device so that the process driving device can obtain the process requirement data. Of course, the service object can input the process requirement data in any feasible way, such as keyboard input, voice input, etc. This application does not make specific restrictions on this.

[0051] In another possible implementation, referring to Figure 2 As shown, the live broadcast system may also include a data sensing device 014. The process driving device may obtain the process demand data of the service object through the data sensing device.

[0052] In some embodiments, the data sensing device may include an order system. The service object may publish a process requirement description on the order system, such as "I want a live broadcast process for selling maternal and child products. It is best to interact with viewers and welcome new viewers during the live broadcast." The data sensing device may obtain the process requirement description of the service object through the order system. After obtaining the process requirement description of the service object, the data sensing device may pre-process the process requirement description of the service object to obtain the process requirement data corresponding to the process requirement description.

[0053] Generally, the service object can input the process requirement description in the order system in a variety of different forms. For example, the service object can input the process requirement description in the order system in the form of text. Or, the service object can input the process requirement description in the order system in the form of audio. Or, the service object can select the process requirement description from multiple requirement options provided by the order system.

[0054] Since the service object can input the process requirement description in the order system in a variety of different forms, the way in which the data perception device preprocesses the process requirement description of the service object will also be adjusted according to the form in which the service object inputs the process requirement description. For example, if the service object inputs the process requirement description in the form of text, the data perception device preprocesses the process requirement description of the service object by performing semantic analysis on the text and outputting the semantic result corresponding to the text, that is, obtaining the process requirement data. For another example, if the service object inputs the process requirement description in the form of audio, the data perception device preprocesses the process requirement description of the service object by first converting the audio into text, then performing semantic analysis on the text, and outputting the semantic result corresponding to the text, that is, obtaining the process requirement data. For another example, if the service object selects the process requirement description from the multiple requirement options provided by the order system, the data perception device can obtain the process requirement data based on the selected requirement option.

[0055] For example, the process requirement description input by the service object is "I want a live broadcast process for selling maternal and infant products. It would be best if I could interact with viewers and welcome new viewers during the live broadcast." The data sensing device preprocesses the process requirement description of the service object and outputs the process requirement data of "live broadcast room for selling goods", "maternal and infant products", "interaction" and "welcome". After the process requirement data is obtained, the process requirement data can be sent to the process driving device. Based on the process requirement data, the process driving device determines the corresponding live broadcast process data and live broadcast rule data.

[0056] In some possible embodiments, the process requirement description of the service object can be directly the process requirement data. In this case, the preprocessing of the data perception device can be no processing or deduplication and other processing operations that do not affect the content.

[0057] S302. The process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process demand data according to the process demand data.

[0058] In the embodiment of the present application, the live broadcast process data may include information about the process stages of the entire live broadcast. For example, the entire live broadcast may include the following processes in chronological order: opening, warm-up, stocking, pampering fans, and ending. The process information may serve as a guide for the digital human anchor's speech during the entire live broadcast, instructing the digital human anchor to speak the corresponding speech within a specific process time period.

[0059] The live broadcast rule data may include the live broadcast rules in the entire live broadcast process. For example, the rule information may include the timing selection rules for the digital human anchor to promote products (which may be referred to as promotion rules), the timing selection rules for the digital human anchor to guide the viewing users to buy products (which may be referred to as interaction rules), the rules for the digital human anchor to answer the viewing users' questions (which may be referred to as answering rules), the timing selection rules for the digital human anchor to explain the products (which may be referred to as explanation rules), and the response rules for bullet screen events and / or traffic events (such as events where the number of likes reaches a threshold or the number of bullet screens reaches a threshold).

[0060] In some embodiments, the specific implementation of the live broadcast rules included in the live broadcast rule data can be implemented by an artificial intelligence (AI) robot (specifically an AI device or an AI module). After the process-driven device determines the live broadcast rule data, the live broadcast rule data can be sent to the AI ​​robot or AI device. The AI ​​robot can perform a response operation based on the rules in the live broadcast rule data during the live broadcast of the live broadcast data stream. For example, if a rule is "if the barrage asks about the price, the product price will be displayed in the barrage", the AI ​​robot will instruct the live broadcast device to display the product price when the question of asking the price appears in the live broadcast barrage. In practice, the AI ​​robot can be an artificial intelligence program or a functional module with an artificial intelligence program. In the embodiment of the present application, the AI ​​robot can be a part of the process-driven device, or it can be a device (or a part thereof) separate from the process-driven device, and the present application does not make specific restrictions on this. In the case where the AI ​​robot does not belong to the process-driven device, the AI ​​robot or the device where the AI ​​robot is located can communicate with the process-driven device so that the process-driven device can use the function of the AI ​​robot.

[0061] Live streaming process data can help make the live streaming sessions in the live streaming room more in line with user expectations, thereby increasing the popularity of the live streaming room. Live streaming rule data can help increase the interactivity of the live streaming room and improve the retention rate of users in the live streaming room.

[0062] After the process driving device obtains the process requirement data, the difference in the process requirement data determines the way in which the process driving device obtains the live broadcast process data and live broadcast rule data, which can be specifically the following two ways:

[0063] In the first possible implementation, if the process requirement data includes process feature data and rule feature data, then Figure 3 , refer to Figure 4 As shown, S302 may specifically include S302A:

[0064] S302A, the process driving device determines the live broadcast process data matching the process feature data from the process library, determines the live broadcast process data and the live broadcast rule data, and determines the live broadcast rule data matching the rule feature data from the rule library.

[0065] The process feature data may be data related to the live broadcast process, such as "warming up the audience", "selling goods", "good atmosphere", etc. The rule feature data may be data related to the rules during the live broadcast, such as "timely response", "timely welcome", "enhancing the atmosphere", etc. The process requirement data may include multiple process feature data and multiple rule feature data.

[0066] In the embodiment of the present application, in order to facilitate the process driving device to be able to drive the process according to the process characteristic data and the rule characteristic data, the process driving device may include a process library and a rule library.

[0067] Among them, the process library includes multiple live broadcast processes (i.e. live broadcast process data), such as opening process data, welfare broadcast process data, warm-up process data, product introduction process data, interactive lottery process data, selling process data, ending process data, etc. The process library also includes the correspondence between multiple process feature data and multiple live broadcast process data, and each live broadcast process data includes multiple live broadcast processes. For example, the live broadcast process data corresponding to the process feature data "warm-up" is the warm-up process, and the live broadcast process data corresponding to the process feature data "selling goods" is the selling process, etc.

[0068] The rule base may include a variety of rules (i.e., live broadcast rule data), and different rules target different specific contents. For example, rules set for the number of online users, rules set for live broadcast duration, rules set for keywords, rules set for newly added attention, rules set for barrage, rules set for newly added gifts, rules set for newly added browsing, rules set for newly added likes, rules set for scheduled broadcasts, rules set for sales volume, and so on. The rule base also includes the correspondence between a variety of rule feature data and a plurality of live broadcast rule data. For example, the live broadcast rule data corresponding to the rule feature data "barrage interaction" is the rule set for barrage, and the live broadcast rule data corresponding to the rule feature data "timely welcome" is the rule set for newly added likes, and so on.

[0069] Based on the technical solution corresponding to the above S032A, based on the process library and rule library, the process-driven device can obtain the live broadcast process data and live broadcast rule data that meet the needs of the service object, providing data support for the subsequent generation of live video streams.

[0070] In the second possible implementation, if the process requirement data includes the live broadcast type, then Figure 3 , refer to Figure 5 As shown, S302 may specifically include S302B:

[0071] S302B, the process driving device determines the live broadcast process data matching the live broadcast type from the process library according to the live broadcast type, and determines the live broadcast rule data matching the live broadcast type from the rule library.

[0072] The process library includes multiple live broadcast processes (i.e., live broadcast process data), such as opening process data, welfare broadcast process data, warm-up process data, product introduction process data, interactive lottery process data, sales process data, ending process data, etc. The process library also includes the corresponding relationship between multiple live broadcast types and multiple live broadcast process data.

[0073] The rule library may include multiple rules (i.e., live broadcast rule data), and different rules target different specific contents. For example, rules set for the number of online users, rules set for live broadcast duration, rules set for keywords, rules set for newly added attention, rules set for bullet screens, rules set for newly added gifts, rules set for newly added browsing, rules set for newly added likes, rules set for scheduled broadcasts, rules set for sales volume, etc. The rule library also includes the correspondence between multiple live broadcast types and multiple live broadcast rule data.

[0074] Generally, the types of live broadcasts in the live broadcast market can include daily chat live broadcasts, game live broadcasts (used to show game playing), e-commerce live broadcasts (used to sell and convert products) and knowledge sharing live broadcasts (used to illustrate knowledge and skills in a certain field or share on a certain topic and sell certain books).

[0075] Since the live broadcast process and live broadcast rules of the live broadcast rooms corresponding to different live broadcast types are slightly different, the live broadcast process data and live broadcast rule data of several common types of live broadcast rooms can be sorted out in advance, and then multiple live broadcast types and the live broadcast process data corresponding to each live broadcast type can be stored in the process library, and multiple live broadcast types and the live broadcast rule data corresponding to each live broadcast type can be stored in the rule library.

[0076] When the process driving device needs to determine the live broadcast process data and live broadcast rule data corresponding to the corresponding process requirement data, the live broadcast process data and live broadcast rule data corresponding to the live broadcast type can be selected in the process library and the rule library according to the live broadcast type included in the process requirement data. Exemplarily, the process library includes at least the live broadcast process data corresponding to daily chat type live broadcast, the live broadcast process data corresponding to game live broadcast, the live broadcast process data corresponding to e-commerce live broadcast with goods, and the live broadcast process data corresponding to knowledge sharing type live broadcast. The rule library includes at least the live broadcast rule data corresponding to daily chat type live broadcast, the live broadcast rule data corresponding to game live broadcast, the live broadcast rule data corresponding to e-commerce live broadcast with goods, and the live broadcast rule data corresponding to knowledge sharing type live broadcast.

[0077] Exemplarily, taking the live broadcast type included in the process demand data as "e-commerce selling live broadcast" as an example, the process driving device can determine the live broadcast process data corresponding to the e-commerce live broadcast with goods from the process library, which can specifically include: opening process data, warm-up process data, selling process data, fan-loving process data, and ending process data. Among them, each type of process data may include attribute information of the corresponding process, such as start time, duration, end time, process-specific words, etc. For example, the opening process data may include the opening words and the opening start time, opening duration, and opening end time. The warm-up process data includes the warm-up start time, warm-up duration, and warm-up end time of the warm-up words. The selling process data includes the selling start time, selling duration, and selling end time. The rest of the processes are similar.

[0078] The process-driven device can also determine the live broadcast rule data corresponding to the e-commerce live broadcast with goods from the rule library. For example, the live broadcast rule data corresponding to the power plant live broadcast with goods may include welcome rules corresponding to the number of online people. The specific content of the rule may be: when the number of online people reaches 100, the anchor is triggered to say the welcome words.

[0079] Based on the technical solution corresponding to the above S032B, based on the process library and rule library, the process-driven device can obtain the live broadcast process data and live broadcast rule data that meet the needs of the service object, providing data support for the subsequent generation of live video streams.

[0080] S303: The process driving device sends the live broadcast process data and live broadcast rule data to the live broadcast data generating device.

[0081] After S303, the live data generating device can generate a live video stream for live broadcast based on the live process data, live rule data and live content data from the content expression device (specifically, the live video stream can be pushed to the live platform so that the live platform pushes the live video stream to the user terminal for live broadcast, thereby displaying the live room for viewing users). The live video stream can include live image data and live content data.

[0082] In the embodiment of the present application, the live broadcast content data may include all the specific contents of the live broadcast room required by the service object, such as anchor information, speech information, live broadcast room background information, product information, etc.

[0083] In the embodiment of the present application, in order to prevent the anchor from being affected by the external environment and causing adverse effects on the live broadcast, the anchor can be a digital human anchor. The anchor information can include the image information and sound information of the digital human anchor. The image information can include the expression, movement, clothing, body features, facial features and other information of the digital human anchor. The sound information can include the sound features of the digital human anchor (such as timbre, etc.).

[0084] The speech information may include the speech that the digital human anchor says in different live broadcast processes and the speech corresponding to the interactive rules. For example, the speech corresponding to the live broadcast process may include opening speech, warm-up speech, angry speech, fan-loving speech, ending speech, etc. The speech corresponding to the interactive rules may include: promotional speech (used to promote products), guiding speech (users guide users to buy products), explanation speech (used to explain products), interactive speech (used to improve the atmosphere of the live broadcast room), barrage response speech (used to respond to barrage questions, etc.), event response speech (used to respond to specific live broadcast events), etc. Taking interactive speech as an example, the interactive speech can be specifically for the case where the user watching the live broadcast room requests to send benefits, and the digital human anchor can say such words as "Please like more, the more likes, the anchor can apply for more benefits for everyone".

[0085] The live broadcast room background information may include the background features of the entire live broadcast room. For example, the live broadcast room background information may include: specific background content (such as a kitchen background in the form of a sticker), background lighting parameters (brightness, direction, etc.), background music, and background ornament parameters (position, size, etc.).

[0086] Product information may include content related to the product for sale, such as the product's corresponding sales pitch and product materials (product pictures, product videos, product inspection reports), etc.

[0087] In some other embodiments, when a live broadcast room needs to be created for a service object, the process driving device can provide the user with all process-related content required to create the live broadcast room, such as multiple live broadcast process data and multiple live broadcast rule data. The service object can filter out target live broadcast process data and target live broadcast rule data from the multiple live broadcast process data and multiple live broadcast rule data provided by the process driving device according to demand, and then the live broadcast data generating device can generate the final live broadcast video stream based on the filtered target live broadcast process data and target live broadcast rule data, and the live broadcast content data from the content expression device.

[0088] In the technical solution provided by the embodiment of the present application, the process-driven device can determine the live broadcast process data and live broadcast rule data corresponding to the process demand data after obtaining the process demand data of the user. Afterwards, the process-driven device can send the live broadcast process data and live broadcast rule data to the live broadcast data generation device, so that the live broadcast data generation device generates a live video stream based on the live broadcast process data, live broadcast rule data and live broadcast content data from the content expression device. Applying the technical solution of the present disclosure, the process-driven device automatically determines the live broadcast process data and live broadcast rule data corresponding to the live broadcast video stream based on the process demand data of the service object, and then smoothly combines the live broadcast content data to generate a live video stream for live broadcast. In this technical solution, there is no need for the service object to organize the live broadcast process data, which reduces the problem of complex data organization in the existing live broadcast room formation process and improves data organization efficiency.

[0089] In some embodiments, after the process driving device receives the live process data, the process driving device can display the live process data in any way and allow the user to adjust the live process data. Afterwards, the live process data can be adjusted according to the adjustment operation to achieve the effect of improving the user experience of the service object. Based on this, refer to Figure 6 As shown, the live video stream generation method also includes S601-S603:

[0090] S601: A process driving device receives a first operation of a service object.

[0091] Exemplarily, the first operation may be a process deletion operation, a process adjustment operation, a process creation operation, etc. For example, the process deletion operation may be to delete the first process (e.g., the warm-up process) in the live process data. The process adjustment operation may be to adjust the second process (e.g., the fan welfare process) in the live process data to before and / or after the third process (e.g., the stocking process). The process creation operation may be to add a new process to the original live process data, such as adding a lottery process before the end process.

[0092] S602: The process driving device determines, in response to a first operation, process adjustment information corresponding to the first operation.

[0093] The process adjustment information may be specific content corresponding to the first operation.

[0094] For example, if the first operation is to delete the first process (for example, the warm-up process) in the live broadcast process data, the process adjustment information corresponding to the first operation is to delete the first process, or to instruct the relevant instructions to delete the first process (for example, the delete instruction).

[0095] S603: The process driving device adjusts the live broadcast process data according to the process adjustment information.

[0096] For example, if the process adjustment information is to delete the first process in the live broadcast process data, the first process is deleted according to the process adjustment information.

[0097] For example, the first operation is to edit the process script. The process script editing operation can be to edit the script of the opening ice-breaking process, such as adding scripts, modifying scripts, exporting scripts, etc. The process driving device responds to the service object's editing operation of the script of the opening ice-breaking process, and determines the process adjustment information corresponding to the script editing operation. According to the process adjustment information, adjust the script of the opening ice-breaking process. Among them, the operable objects of the process script editing operation are detailed in Figure 7 The content shown.

[0098] Based on the above technical solution, before generating the live video stream, the service object can make any changes and adjustments to the live process data according to its own needs, so that the final live video stream better meets the needs of the service object and improves the service object's user experience.

[0099] In some embodiments, after the process driving device receives the live process data, the process driving device can display the live process data in any way and allow the user to adjust the live process data. Afterwards, the live process data can be adjusted according to the adjustment operation to achieve the effect of improving the user experience of the service object. Based on this, refer to Figure 8As shown, the live video stream generation method also includes S801-S803:

[0100] S801. The process driving device receives a second operation of a service object.

[0101] Exemplarily, the first operation may include any one or more of the following: a rule deletion operation, a rule adjustment operation, and a rule creation operation.

[0102] For example, the rule deletion operation may be to delete the first rule in the live broadcast rule data (e.g., the barrage event response rule). The rule adjustment operation may be to adjust the second rule in the live broadcast rule data (e.g., change the welcome speech of the digital human host when a like appears to the welcome speech of the digital human host when five likes are accumulated). The rule creation operation may be to add a new rule to the original live broadcast rule data, such as adding the retention speech of the digital human host when the event of decreased attention appears.

[0103] S802: The process driving device determines rule adjustment information corresponding to the second operation in response to the second operation.

[0104] Among them, the rule adjustment information may be the specific content corresponding to the second operation. For example, if the second operation is to delete the first rule in the live broadcast rule data (for example, the barrage event response rule), then the rule adjustment information corresponding to the second operation is specifically to delete the first rule, or to instruct to delete the related instructions of the first rule (for example, the delete instruction).

[0105] S803. The process driving device adjusts the live broadcast rule data according to the rule adjustment information.

[0106] For example, the second operation is a new rule creation operation, and the new rule is: when the number of new users entering the live broadcast room exceeds 10, the digital human anchor is triggered to say a welcome speech. The process driving device can respond to the user's new rule creation operation, determine that the live broadcast rule data corresponding to the new rule creation operation is new rule data, and then create new live broadcast rule data. That is, the live broadcast rule data adds the rule "when the number of new users entering the live broadcast room exceeds 10, the digital human anchor is triggered to say a welcome speech".

[0107] For example, Fig. 9 As shown, the process driving device can receive the user's rule adjustment operation, which is specifically to adjust the rules of the live broadcast room, such as creating a new rule and modifying a rule. In response to the service object's rule adjustment operation on the rules in the live broadcast room, the rule adjustment information corresponding to the rule adjustment operation is determined. According to the rule adjustment information, the rules of the live broadcast room are adjusted. Among them, the operable objects of the rule adjustment operation are detailed in Fig.10 The content shown.

[0108] Based on the above technical solution, before generating the live video stream, the service object can arbitrarily change and adjust the live broadcast rule data according to its own needs, so that the final live video stream is more in line with user needs, thereby improving the service object's user experience.

[0109] Since there may be various emergencies during the live broadcast, if only the pre-configured scripts are used for live broadcast, it may not be possible to cope with all emergencies. Therefore, in some embodiments, the process driving device provided in the embodiment of the present application should also provide the service object with the ability to switch the audio data in the live video stream at any time. Figure 3 , refer to Fig.10 As shown, the live video stream generation method also includes S101 and S102:

[0110] S101. The process driving device receives a third operation of a user.

[0111] S102: In response to the third operation, the process driving device switches the live audio data in the live video stream to target audio data, where the target audio data is audio data collected in real time by an audio collection device.

[0112] Among them, the third operation can specifically be an audio switching operation, and the switching object of the audio switching operation is the live audio data in the live video stream. Taking the process-driven device having a display function as an example, the process-driven device can display a switching control while the live video stream is being broadcast live. If the service object needs to switch the audio data in the live data stream, a trigger operation (i.e., the third operation) can be implemented on the switching control. In response to the trigger operation, the process-driven device can switch the live audio data in the live video stream to the target audio data.

[0113] Based on the above technical solution, during the live broadcast process, the service object can promptly use the real-time collected target audio data to replace the originally set fixed audio data when an emergency occurs, which provides a powerful means for handling emergencies during the live broadcast and improves the user experience of the service object.

[0114] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0115] The embodiment of the present application can divide the functional modules of the process-driven device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0116] The embodiments of the present application can also divide the process-driven device mentioned in the above embodiments into functional modules according to the different functions of the device. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0117] The embodiment of the present application provides a process driving device. The process driving device is used to implement the aforementioned method for generating a video data stream. The function of the process driving device can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0118] When the process-driven equipment is divided into functional modules, Fig.11 A possible scenario of a process driven device is shown. Fig.11 As shown, the process driving device includes an acquisition module 111 , a processing module 112 and a sending module 113 .

[0119] Specifically, the acquisition module 111 is used to acquire the process requirement data of the service object; the processing module 112 is used to determine the live broadcast process data and live broadcast rule data corresponding to the process requirement characteristics based on the process requirement data acquired by the acquisition module 111; the sending module 113 is used to send the live broadcast process data and live broadcast rule data obtained by the processing module 112 to the live broadcast data generating device, so that the live broadcast data generating device generates a live video stream for live broadcast based on the live broadcast process data, the live broadcast rule data and the live broadcast content data from the content expression device.

[0120] Optionally, the process requirement data includes process characteristic data and rule characteristic data; the processing module 112 is specifically used to: determine the live broadcast process data that matches the process characteristic data from the process library, and determine the live broadcast rule data that matches the rule characteristic data from the rule library; the process library includes the correspondence between multiple process characteristic data and multiple live broadcast process data, and the rule library includes the correspondence between multiple rule characteristic data and multiple live broadcast rule data.

[0121] Optionally, the process requirement data includes the live broadcast type; the processing module 112 is specifically used to: determine the live broadcast process data that matches the live broadcast type from the process library according to the live broadcast type, and determine the live broadcast rule data that matches the live broadcast type from the rule library; the process library includes the correspondence between multiple live broadcast types and multiple live broadcast process data, and the rule library includes the correspondence between multiple live broadcast types and multiple live broadcast rule data.

[0122] Optionally, the acquisition module 111 is also used to receive a first operation of the service object; the processing module 112 is also used to determine the process adjustment information corresponding to the first operation in response to the first operation received by the acquisition module 111; the processing module 112 is also used to adjust the live broadcast process data according to the process adjustment information.

[0123] Optionally, the acquisition module 111 is also used to receive a second operation of the service object; the processing module 112 is also used to determine the rule adjustment information corresponding to the second operation in response to the second operation received by the acquisition module 111; the processing module 112 is also used to adjust the live broadcast rule data according to the rule adjustment information.

[0124] Optionally, the live video stream includes live image data and live audio data, and the acquisition module 111 is also used to receive a third operation of the service object; the processing module 112 is also used to switch the live audio data in the live video stream to target audio data in response to the third operation received by the acquisition module 111, and the target audio data is audio data collected in real time by an audio acquisition device.

[0125] The effects that can be achieved by the above-mentioned process driving device can refer to the effects of the related content of the live video stream generation method in the above-mentioned embodiment, which will not be repeated here.

[0126] Fig.12 A structural diagram of an electronic device provided in an embodiment of the present application, such as Fig.12 As shown, the electronic device 1200 includes one or more processors 1201 and a memory 1202. The electronic device may be the process driving device in the aforementioned embodiment, or may also be a device carrying a live broadcast system.

[0127] The processor 1201 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 1200 to perform desired functions.

[0128] The memory 1202 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 1201 may execute the program instructions to implement the above-mentioned methods for generating live video streams, methods for processing live parameter data, and / or other desired functions of the various embodiments of the present disclosure.

[0129] In one example, the electronic device 1200 may further include: an input device 1203 and an output device 1204 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0130] Of course, to simplify, Fig.12 Only some of the components related to the present disclosure in the electronic device 1200 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 1200 may also include any other appropriate components.

[0131] In addition to the above-mentioned method and device, the embodiment of the present disclosure may also be a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, the processor executes the method for generating a live video stream in the above-mentioned embodiment.

[0132] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0133] In addition, the embodiments of the present disclosure may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the method for generating a live video stream in the aforementioned embodiments.

[0134] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0135] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0136] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0137] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0138] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0139] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A method for generating a live video stream, applied to a process driving device in a live broadcast system, wherein the live broadcast system further comprises a content expression device and a live broadcast data generating device connected to the process driving device, characterized in that: The method comprises: The process driving device obtains process demand data of the service object; The process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process demand data according to the process demand data; the process demand data includes process feature data and rule feature data; The process driving device sends the live broadcast process data and the live broadcast rule data to the live broadcast data generating device, so that the live broadcast data generating device generates a live broadcast video stream for live broadcast based on the live broadcast process data, the live broadcast rule data and the live broadcast content data from the content expression device; The process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process requirement characteristics according to the process requirement data, including: The process driving device determines the live broadcast process data matching the process characteristic data from the process library, and determines the live broadcast rule data matching the rule characteristic data from the rule library; the process library includes the correspondence between multiple process characteristic data and multiple live broadcast process data, and the rule library includes the correspondence between multiple rule characteristic data and multiple live broadcast rule data.

2. The method according to claim 1, characterized in that The process requirement data includes a live broadcast type; the process driving device determines the live broadcast process data and live broadcast rule data corresponding to the process requirement characteristics according to the process requirement data, including: The process-driven device determines the live broadcast process data matching the live broadcast type from the process library according to the live broadcast type, and determines the live broadcast rule data matching the live broadcast type from the rule library; the process library includes the correspondence between multiple live broadcast types and multiple live broadcast process data, and the rule library includes the correspondence between multiple live broadcast types and multiple live broadcast rule data.

3. The method according to any one of claims 1 to 2, characterized in that: The method further comprises: The process driving device receives a first operation of the service object; The process driving device determines, in response to the first operation, process adjustment information corresponding to the first operation; The process driving device adjusts the live broadcast process data according to the process adjustment information.

4. The method according to any one of claims 1 to 2, characterized in that: The method further comprises: The process driving device receives a second operation of the service object; The process driving device determines, in response to the second operation, rule adjustment information corresponding to the second operation; The process driving device adjusts the live broadcast rule data according to the rule adjustment information.

5. The method according to claim 3, characterized in that: The live video stream includes live image data and live audio data, and the method further includes: The process driving device receives a third operation of the service object; In response to the third operation, the process driving device switches the live audio data in the live video stream to target audio data, where the target audio data is audio data collected in real time by an audio collection device.

6. A process driving device, applied to a live broadcast system, wherein the live broadcast system further comprises a content expression device and a live broadcast data generation device connected to the process driving device, characterized in that: The device comprises: The acquisition module is used to obtain the process requirement data of the service object; A processing module, configured to determine, according to the process requirement data acquired by the acquisition module, live broadcast process data and live broadcast rule data corresponding to the process requirement characteristics; the process requirement data includes process characteristic data and rule characteristic data; A sending module, configured to send the live broadcast process data and live broadcast rule data obtained by the processing module to the live broadcast data generating device, so that the live broadcast data generating device generates a live broadcast video stream for live broadcast based on the live broadcast process data, the live broadcast rule data and the live broadcast content data from the content expression device; The processing module is also used to determine the live broadcast process data that matches the process feature data from the process library, and to determine the live broadcast rule data that matches the rule feature data from the rule library; the process library includes the correspondence between multiple process feature data and multiple live broadcast process data, and the rule library includes the correspondence between multiple rule feature data and multiple live broadcast rule data.

7. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to execute the method for generating a live video stream as described in any one of claims 1 to 5 when executing the computer program.

8. A computer-readable storage medium, characterized in that: It includes at least one instruction, and when the at least one instruction is executed on an electronic device, the electronic device executes the method for generating a live video stream as described in any one of claims 1-5.

9. A live broadcast system, characterized in that: Comprising the process driving device as claimed in claim 6 or the electronic device as claimed in claim 7.

Images