Group control live broadcast method and device, electronic equipment and storage medium

By obtaining and utilizing existing live audio in the digital human live broadcast room, the complexity of the construction of live broadcast speech is reduced, the efficiency of the digital human live broadcast room and the ability to quickly generate multiple live broadcast rooms are improved, and the existing technology is solved The complex problem of live broadcasting techniques has improved the effectiveness of live broadcasting operations.

CN118945383APending Publication Date: 2024-11-12NANJING SILICON INTELLIGENCE TECH CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202310517356.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The construction of live broadcasting techniques in digital people's live broadcast rooms is complex, which leads to low efficiency in building live broadcast rooms and makes it difficult to quickly generate multiple different live broadcast rooms.

Method used

Through the first client, the push stream request is sent to the client to which the second digital person live broadcast room belongs, the target live broadcast audio is obtained, and the live broadcast rendering server is sent to the live broadcast rendering server to generate live video data, thereby establishing the digital person live broadcast room and reducing live broadcast The individual construction requirements of speech.

Benefits of technology

It has improved the efficiency and complexity of the construction of digital people's live broadcast rooms, achieved rapid generation of multiple live broadcast rooms based on the same live broadcasting technique, and improved the live broadcast operation effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945383A_ABST
    Figure CN118945383A_ABST
Patent Text Reader

Abstract

The invention provides a group control live broadcast method and device, electronic equipment and a storage medium, relates to the technical field of network live broadcast, and can reduce the construction complexity of a digital human live broadcast room. The method comprises the following steps: a first client sends a stream pushing request to a second client to which a second digital human live broadcast room belongs; the stream pushing request is used for requesting a target live audio of the second digital human live room; the second client receives the stream pushing request, and sends the target live audio to the first client in response to the stream pushing request; the first client receives the target live audio; the first client sends a rendering request to the live broadcast rendering server; the rendering request carries a target live audio, and the rendering request is used for requesting to generate first live video data of the first digital human live room based on the target live audio; and the first client receives the first live broadcast video data from the live broadcast rendering server, and establishes a first digital human live broadcast room for live broadcast based on the live broadcast video data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of network live broadcasting, and in particular to a group control live broadcasting method and device, an electronic device and a storage medium. Background Art

[0002] With the development of Internet technology, more and more people like to enrich their spare time by watching live broadcasts, and live broadcasts are becoming more and more popular among young people. As a product of the combination of information science and life science, digital humans do not have the practical limitations of real anchors (such as fatigue and emotional instability), so they can be used as anchors in the live broadcast room to broadcast uninterruptedly.

[0003] The live broadcast effect of the digital human live broadcast room built by users will be mainly affected by the live broadcast words (specifically the live broadcast audio), so the construction of the live broadcast words is also the most complicated content in the construction process of the digital human live broadcast room. Based on this, how to reduce the construction of the live broadcast words in the digital human live broadcast room is an urgent problem to be solved in the process of the digital human live broadcast room. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a group control live broadcast method and device, an electronic device and a storage medium.

[0005] The technical solution of this application is as follows:

[0006] In a first aspect, the present application provides a group-controlled live broadcast method, the method comprising: a first client sends a streaming request to a second client to which a second digital human live broadcast room belongs; the streaming request is used to request a target live audio of the second digital human live broadcast room; the second client receives the streaming request, and sends the target live audio to the first client in response to the streaming request; the first client receives the target live audio; the first client sends a rendering request to a live broadcast rendering server; the rendering request carries the target live audio, and the rendering request is used to request generation of first live video data of the first digital human live broadcast room based on the target live audio; the first client receives the first live video data from the live broadcast rendering server, and establishes a first digital human live broadcast room based on the first live video data for live broadcast.

[0007] In a possible implementation of the first aspect, before the first client sends a streaming request to the second client to which the second digital human live broadcast room belongs, the method also includes: the first client obtains at least one digital human live broadcast room that is broadcasting live; and the first client sends a streaming request to the second client to which the second digital human live broadcast room belongs in response to a user's selection operation on the second digital human live broadcast room.

[0008] In a possible implementation of the first aspect, the second client receives a streaming request, and sends a target live audio to the first client in response to the streaming request, including: the second client receives the streaming request, sends the target live audio to the audio relay server in response to the streaming request, and sends first indication information to the first client; the first indication information is used to indicate that the second client has sent the target live audio to the audio relay server; the first client receives the target live audio, including: the first client receives the first indication information, and obtains the target live audio from the audio relay server in response to the first indication information.

[0009] In a possible implementation of the first aspect, after the first client receives the target live audio and before the first client sends a rendering request to the live rendering server, the method further includes: the first client sends first indication information to the live rendering server; the first indication information is at least used to indicate the digital human information and live background information in the first digital human live room.

[0010] In a possible implementation of the first aspect, the first client sends first indication information to the live rendering server, including: when the first client determines that there are available rendering resources in the first rendering resources that meet the rendering requirements of the target live video, the first client sends the first indication information to the live rendering server; the first rendering resource is a rendering resource in the live rendering server corresponding to the first client.

[0011] In a possible implementation of the first aspect, the method further includes: when the first client determines that there are no available rendering resources in the first rendering resources that meet the rendering requirements of the target live video, outputting second indication information; the second indication information is used to indicate that the available rendering resources are insufficient.

[0012] The second aspect provides a group control live broadcast method, which is applied to a first client, and the method includes: sending a push stream request to a second client to which a second digital human live broadcast room belongs; the push stream request is used to request the target live broadcast audio of the second digital human live broadcast room; receiving the target live broadcast audio from the second client; sending a rendering request to a live broadcast rendering server; the rendering request carries the target live broadcast audio, and the rendering request is used to request to generate the first live broadcast video data of the first digital human live broadcast room based on the target live broadcast audio; receiving the first live broadcast video data from the live broadcast rendering server, and establishing the first digital human live broadcast room based on the first live broadcast video data for live broadcast.

[0013] In a third aspect, the present application provides a group-controlled live broadcast device, which includes: a sending module, used to send a streaming request to a second client to which a second digital human live broadcast room belongs; the streaming request is used to request the target live audio of the second digital human live broadcast room; a receiving module, used to receive the target live audio from the second client; the sending module is also used to send a rendering request to a live broadcast rendering server; the rendering request carries the target live audio received by the receiving module, and the rendering request is used to request to generate the first live video data of the first digital human live broadcast room based on the target live audio; the receiving module is also used to receive the first live video data from the live broadcast rendering server; a processing module is used to establish the first digital human live broadcast room for live broadcast based on the first live video data received by the receiving module.

[0014] In a fourth aspect, the present application provides an electronic device, comprising a processor and a memory; the memory is used to store computer instructions, and when the electronic device is running, the processor executes the computer instructions stored in the memory, so that the electronic device implements the group control live broadcast method provided in the second aspect above.

[0015] In a fifth aspect, the present application also provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is executed on an electronic device, the electronic device implements the group control live broadcast method provided in the second aspect above.

[0016] In a sixth aspect, the present application also provides a computer program product comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device implements the group control live broadcast method provided in the second aspect above.

[0017] In this application, the above names do not limit the devices or functional modules themselves. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those of this application, they fall within the scope of the claims of this application and their equivalent technologies.

[0018] These and other aspects of the present application will become more apparent from the following description.

[0019] In the technical solution provided by the present application, when the first client needs to establish the first digital human live broadcast room, it can request the target live audio (or target live speech) of the second digital human live broadcast room from the second client corresponding to the second digital human live broadcast room. After obtaining the target live audio, the first client can send the target live audio to the live broadcast rendering server to obtain the first live video data, and then establish the first digital human live broadcast room for live broadcast. It can be seen that based on this technical solution, when creating a digital human live broadcast room, the live video can be obtained based on the live audio corresponding to the live speech in the already constructed digital human live broadcast room, so that the construction process of the digital human live broadcast room does not need to be separately constructed for the most complex live speech, which reduces the construction complexity of the digital human live broadcast room and improves the construction efficiency of the digital human live broadcast room. Furthermore, based on this technical solution, multiple digital human live broadcast rooms can be constructed for the same live speech. For users who have constructed the live speech, multiple different digital human live broadcast rooms can be quickly generated to achieve cluster live broadcast of large-scale speech and improve the live operation effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A schematic diagram of a structure of an implementation environment provided for an embodiment of the present application;

[0023] Figure 2 A schematic diagram of the structure of a live broadcast system provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the structure of a group control live broadcast system provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 1 ;

[0026] Figure 5 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 2 ;

[0027] Figure 6 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 3 ;

[0028] Figure 7 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 4 ;

[0029] Figure 8 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 5 ;

[0030] Fig. 9 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 6 ;

[0031] Fig.10 A schematic diagram of a group control live broadcast method provided in an embodiment of the present application Figure 7 ;

[0032] Fig.11 A schematic diagram of the structure of a group control live broadcast device provided in an embodiment of the present application;

[0033] Fig.12 A schematic diagram of the structure of another group control live broadcast device provided in an embodiment of the present application;

[0034] Fig.13 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0036] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.

[0037] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0038] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0039] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0040] In the existing digital human live broadcast room construction process, the construction of live broadcasting scripts is also the most complicated content in the construction process of digital human live broadcast rooms. Based on this, how to reduce the construction of live broadcasting scripts in digital human live broadcast rooms is an urgent problem to be solved in the process of digital human live broadcast rooms.

[0041] In view of the above problems, the embodiment of the present application provides a group control live broadcast method, in which the first client can request the target live audio (or target live speech) of the second digital human live broadcast room from the second client corresponding to the second digital human live broadcast room that is already live. After obtaining the target live audio, the first client can send the target live audio to the live rendering server to obtain the first live video data, and then establish the first digital human live broadcast room for live broadcast. It can be seen that based on this technical solution, when creating a digital human live broadcast room, the live video can be obtained based on the live audio corresponding to the live speech in the already constructed digital human live broadcast room, so that the construction process of the digital human live broadcast room does not need to be separately constructed for the most complex live speech, which reduces the construction complexity of the digital human live broadcast room and improves the construction efficiency of the digital human live broadcast room. Furthermore, based on this technical solution, multiple digital human live broadcast rooms can be constructed for the same live speech. For users who have constructed the live speech, multiple different digital human live broadcast rooms can be quickly generated to achieve cluster live broadcast of scale speech and improve the live broadcast operation effect.

[0042] The technical solution provided in the embodiments of the present application can be applied to Figure 1 In the implementation environment shown, the implementation environment may include a live broadcast system 01, a live broadcast platform 02, and a user terminal 03. The live broadcast system 01 and the live broadcast platform 02 may communicate with each other via a wired or wireless communication method, and the live broadcast platform 02 and the user terminal 03 may also communicate with each other via a wired or wireless communication method.

[0043] The live broadcast system 01 is mainly used to generate live broadcast videos and push the live broadcast videos to the live broadcast platform 02 for live broadcast. In the embodiment of the present application, there may be one or more live broadcast platforms 02. Figure 1 Only one live broadcast platform 02 is used as an example, and this application does not make any specific restrictions on this.

[0044] The live broadcast platform 02 is mainly used to push the live broadcast data to the user terminal 03 according to specific rules after receiving the live broadcast video from the live broadcast system 01, so that the user terminal 03 plays the live broadcast data corresponding to the live broadcast video for the user to watch. In the embodiment of the present application, there can be one or more user terminals 03. The user terminal 03 can be an electronic device with a live broadcast application corresponding to the live broadcast platform 02 installed.

[0045] Reference Figure 2 As shown, in the present application, the live broadcast system 01 may include a decision-making device 011 , a process driving device 012 , a content expression device 013 and a live broadcast data generating device 014 .

[0046] Among them, the decision-making device 011 can establish a communication connection with the process driving device 012 and the content expression device 013, and the process driving device 012 and the content expression device 013 can establish a communication connection with the live broadcast data generation device 014.

[0047] It should be noted that in the present application, the decision device 011, the process driving device 012, the content expression device 013 and the live broadcast data generation device 014 can be separate devices or different parts of the same device, or modules that implement different functions in the data center, depending on actual needs. This application does not impose specific restrictions on this. Among them, the process driving device 012 can obtain the user's process demand data, and generate live broadcast process data and live broadcast rule data based on the user's process demand data. The content expression device 013 can obtain the user's content demand data, and generate live broadcast content data based on the user's content demand data. Among them, the live broadcast content data can include audio data. The live broadcast data generation device 014 can generate live video based on the live broadcast process data, live broadcast rule data and live broadcast content data.

[0048] The decision device 011 can generate live broadcast decision data according to the playback data of the live broadcast video, and adjust the live broadcast process data and live broadcast rule data generated by the process driving device 012 based on the live broadcast decision data, and / or adjust the live broadcast content data generated by the content expression device 013.

[0049] The live broadcast system corresponding to the embodiment of the present application may have a corresponding live broadcast application, which can be installed in the user's electronic device, which can be called a client. The client can have the functions of the process driving device 012 and the content expression device 013 in the aforementioned embodiment. When the user uses the client to set up a live broadcast room, the client can generate live audio in response to user operations, and finally obtain the live video that can be broadcast in the digital human live broadcast room through the live broadcast rendering server that has or carries the function of the live broadcast data generation device 014.

[0050] In some embodiments, reference Figure 3 As shown, the technical solution provided in the embodiment of the present application can be used as a group control live broadcast system. Figure 3 As shown, it can specifically include a master control client 31, a slave control client 32, a signaling server 33, an audio relay server 34 and a live rendering server 35. The master control client 31 and the slave control client 32 are both connected to the signaling server 33, the control client 31 and the slave control client 32 are both connected to the audio relay server 34, and the signaling server 33 is connected to the live rendering server 35.

[0051] In the embodiment of the present application, the master client 31 and the slave client 32 can be a tablet computer, an ultra-mobile personal computer (UMPC), a netbook, a desktop computer, a laptop computer, a small laptop computer, an ultrabook, a personal digital assistant (PDA), etc., which can install the application corresponding to the live broadcast system. In the embodiment of the present application, the slave client 32 can be a plurality of or a cluster composed of a plurality of clients, depending on the actual needs, and the present application does not make any specific restrictions on this.

[0052] The signaling server 33, the audio relay server 34 and the live broadcast rendering server 35 can all be a separate server or a server cluster composed of multiple servers or a cloud computing service center, and this application does not impose any specific restrictions on this.

[0053] Among them, the master control client 31 and the slave control client 32 are installed with applications corresponding to the live broadcast system, and can have the functions of the process driving device 012 and the content expression device 013 in the above-mentioned embodiment. The master control client 31 may have a first digital human live broadcast room that has been created. When the slave control client 32 needs to use the target live audio in the first digital human live broadcast room to generate a digital human live broadcast room, the slave control client 32 can request the master control client 31 to push the target live audio through the signaling server 33. After receiving the request from the slave client 32, the master control client 32 can push the target live audio to the audio relay server 34, and inform the slave control client 32 of this situation through the signaling server 33. After knowing this situation, the slave control client 32 can actively obtain the target live audio from the audio relay server 34. After that, the slave control client 32 can inform the live broadcast rendering server 35 of the need to establish a digital human live broadcast room through the signaling server 33, and then send the target live audio to the live broadcast rendering server 35, so as to obtain the live video that can finally establish the digital human live broadcast room.

[0054] The group control live broadcast method provided by the embodiment of the present application is described below. A person skilled in the art will know that with the development of technology and the emergence of new scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0055] Based on Figure 1-Figure 3 The implementation environment and architecture shown in the present application embodiment provide a group control live broadcast method, which can be specifically applied to Figure 3 In the group control live broadcast system shown in FIG. , take the master control client as the second client and the slave control client as the first client as an example. Figure 4 As shown, the method may include S401-S408:

[0056] S401, the first client sends a streaming request to the second client to which the second digital human live broadcast room belongs.

[0057] The streaming request is used to request the target live audio of the second digital human live broadcast room.

[0058] In the embodiment of the present application, if a digital human live broadcast room configured by a client is not broadcasting live, then the first client cannot know whether the digital human live broadcast room exists, and cannot request the corresponding target live broadcast audio. Therefore, in the present application, the second digital human live broadcast room is the live broadcast room that is broadcasting live.

[0059] It should be noted that in the embodiments of the present application, only one first client is used to illustrate the technical solution provided by the present application. In practice, for a second client, there may be multiple corresponding first clients, or a first client cluster composed of multiple first clients. The method for implementing group control live broadcast between each first client and the second client can refer to the embodiments provided by the present application.

[0060] In some embodiments, the first client may select which digital human live broadcast room to request the corresponding live audio, which may be determined by the user to whom the first client belongs. Figure 4 , refer to Figure 5 As shown, in the method, before S401, S501 and S502 may also be included:

[0061] S501. The first client obtains at least one digital human live broadcast room that is broadcasting live.

[0062] In a possible implementation, the first client may obtain at least one digital human live broadcast room by using the http (hyper text transfer protocol) service provided by the network to search for at least one digital human live broadcast room that is broadcasting live.

[0063] Specifically, the first client can use its own application programming interface (Application Programming Interface, API) corresponding to the http service to request the http service to obtain the live broadcast room that is being broadcast.

[0064] After receiving the request from the first client, the http service can feed back the information of at least one live broadcast room of the digital human being to the first client through the same API. The specific feedback form can be a list or multiple live broadcast screens, and the specific form is not specifically limited in this application.

[0065] S502: The first client determines a second digital human live broadcast room in response to a selection operation of the user.

[0066] After acquiring at least one digital human live broadcast room that is broadcasting live, the first client can display relevant information of the at least one digital human live broadcast room, for example, display a list of at least one digital human live broadcast room or display a live broadcast screen of at least one digital human live broadcast room.

[0067] Afterwards, the user can select the relevant information of at least one digital human live broadcast room based on his / her own needs, and then determine the second digital human live broadcast room required by the user. In response to the user's selection, the first client can send a streaming request to the second client to which the second digital human live broadcast room belongs. The streaming request can carry the identifier of the second digital human live broadcast room, such as the live broadcast room number.

[0068] Based on the technical solutions corresponding to S501 and S502, the user of the first client can obtain the target live audio required by him / her, thereby improving the user experience.

[0069] In some embodiments, there is no communication connection established between the first client and the second client, so the first client and the second client cannot communicate directly. Therefore, the first client sends a streaming request to the second client through a signaling server that has a pre-established communication connection (or a communication channel) with both clients. In addition, since the first client and the second client can be any client in reality and their addresses are uncontrollable, using a signaling server with a fixed address can also ensure that any first client and second client can successfully complete the signaling interaction. Based on this, combined with Figure 5 , refer to Figure 6 As shown, S502 may specifically include S601-S603:

[0070] S601: A first client sends a streaming request to a signaling server.

[0071] S602: The signaling server receives a streaming request.

[0072] After receiving the streaming request from the first client, the signaling server can determine the second client based on the information indicating the second digital human live broadcast room in the streaming request, and then send the streaming request to the second client, that is, execute S602.

[0073] S603: The signaling server sends a streaming request to the second client.

[0074] In this way, the first client can complete the purpose of sending a streaming request to the second client, so that the second client can send the target live audio to the first client for use.

[0075] S402: The second client receives a streaming request.

[0076] S403: The second client sends the target live audio to the first client in response to the streaming request.

[0077] In the embodiment of the present application, after receiving the streaming request, the second client can extract the corresponding target live audio from the live video file of the second digital human live room being broadcasted, and then send it to the first client.

[0078] S404: The first client receives the target live audio.

[0079] In some embodiments, the first client and the second client may be in networks or local area networks in different regions. For example, the first client is in Shanghai and the second client is in Lanzhou. In this case, the first client and the second client may not be able to communicate data directly, but need to use an audio relay server that has established a communication connection with the first client and the second client to complete the interaction of audio data between the first client and the second client. Figure 4 , refer to Figure 7 As shown, S403 may specifically include S701 and S702, and S404 may specifically include S703 and S704:

[0080] S701. The second client sends a target live audio to the audio relay server in response to a streaming request.

[0081] In some embodiments, the target live audio of the second digital human live broadcast room broadcast on the second client may have been requested by multiple other clients, that is, the second client may have sent the target live audio to the audio relay server before the first client requested the target live audio. Based on this, when the second client receives the push stream request, it can first determine whether the target live audio has been sent to the audio relay server. If it has been sent, the audio relay server will have the target live audio, and then directly send the first indication information to the first client, that is, do not execute S701 and directly execute S702. If it has not been sent, execute S701 and S702. Of course, in order to ensure that the audio relay server has sufficient storage resources available, the audio relay server can regularly clear the audio data that has been stored for a preset duration and has not been used, so after receiving the push stream request, the second client can determine whether the target live audio has been sent to the audio relay server within a certain duration before the current moment, and then determine whether to send the first indication information directly to the first client.

[0082] S702: The second client sends completion indication information to the first client.

[0083] Among them, the completion indication information is used to indicate that the second client has sent the target live audio to the audio relay server.

[0084] S703: The first client receives completion indication information.

[0085] S704. The first client obtains the target live audio from the audio relay server in response to the completion indication information.

[0086] The specific method for the first client to obtain the target live audio from the audio relay server can be that the first client sends a request for the target live audio to the audio relay server, and the audio relay server returns it to the first client based on the request; it can also be that the first client directly searches for the target live audio from the audio relay server and extracts it.

[0087] Based on the technical solutions corresponding to S701-S704, the second client can successfully send the target live audio to the first client, so that the first client can construct the first digital human live room based on the target live audio, reducing the complexity of the first client constructing the digital human live room.

[0088] S405: The first client sends a rendering request to the live broadcast rendering server.

[0089] The rendering request carries the target live audio, and the rendering request is used to request to generate the first live video data of the first digital human live room based on the target live audio.

[0090] The purpose of the first client sending a rendering request to the live broadcast rendering server is to obtain the first live broadcast video data of the first digital human live broadcast room. However, to obtain the first live broadcast video data, the first client should also inform the live broadcast rendering server of the relevant parameters of the digital human in the first digital human live broadcast room and the relevant parameters of the live broadcast background, so that the live broadcast rendering server can generate the first live broadcast video data according to these parameters and the target live broadcast audio. Based on this, combined with Figure 4 , refer to Figure 8 As shown, before S404 and S405, the method further includes S801:

[0091] S801. A first client sends first instruction information to a live broadcast rendering server.

[0092] The first indication information is at least used to indicate the digital human information and live broadcast background information in the first digital human live broadcast room.

[0093] In the embodiment of the present application, when the user needs to use the first client to build the first digital human live broadcast room, the digital human and live broadcast background in the first digital human live broadcast room can be configured or selected through the application corresponding to the live broadcast system installed on the first client. The specific configuration method or selection method can be any feasible method, and the present application does not make any specific restrictions on this.

[0094] The first client may generate the first indication information based on the user's configuration or selection of the digital human and the live broadcast background in the first digital human live broadcast room.

[0095] In some embodiments, for the user corresponding to the first client (specifically a certain user account), the processing resources that the live rendering server can provide are limited. If the first client determines that there are available rendering resources in the first rendering resources that meet the rendering requirements of the target live video, the first client can send a first indication information to the live rendering server; the first rendering resource is the rendering resource corresponding to the first client in the live rendering server.

[0096] If the first client determines that there is no available rendering resource in the first rendering resource that meets the rendering requirements of the target live video, it may not send the first indication information to the live rendering server, but output the second indication information; the second indication information is used to indicate that the available rendering resources are insufficient. Specifically, the first client may output the second indication information by displaying the second indication information. Exemplarily, the second indication information may be "Your rendering resources are insufficient, please wait for a while and try to render again."

[0097] In some embodiments, the client installed with the live broadcast system is not fixed, so the client and the live broadcast rendering server with the live broadcast data generating device capability of the live broadcast system have not established a wireless communication connection in advance, so the first client and the live broadcast rendering server need to establish a communication channel based on a signaling server with which both have a communication connection to complete the interaction of the first indication information. Based on this, combined with Figure 8 , refer to Fig. 9 As shown, S801 may specifically include S901-S908:

[0098] S901. The first client sends a live broadcast start instruction to a signaling server.

[0099] The start live broadcast instruction carries the first indication information. The start live broadcast instruction is used to request to prepare to process the target live broadcast audio to obtain the first live broadcast video data.

[0100] S902: The signaling server receives an instruction to start live broadcasting.

[0101] S903: The signaling server sends a live broadcast start instruction to the live broadcast rendering server.

[0102] S904: The live broadcast rendering server receives a live broadcast start instruction.

[0103] S905: The live broadcast rendering server sends a start live broadcast response to the signaling server.

[0104] When the live broadcast rendering server receives the start live broadcast instruction and is ready to process the target live broadcast audio, the live broadcast rendering server can send a start live broadcast response to the first client through the signaling server. The start live broadcast response is used to indicate the relevant information of the live broadcast rendering server and that the target live broadcast video can be started. The relevant information of the live broadcast rendering server can be used by the first client to establish a communication channel with the live broadcast rendering service.

[0105] S906: The signaling server receives a live broadcast start response.

[0106] S907: The signaling server sends a live broadcast start response to the first client.

[0107] S908: The first client receives a live broadcast start response and establishes a communication channel with the live broadcast rendering server.

[0108] Exemplarily, the communication channel between the first client and the live broadcast rendering server may be a Web real-time communications (WebRTC) channel.

[0109] After the first client establishes the web real-time communication channel, the first client can send the target live audio to the live rendering server based on the channel, that is, implement S405.

[0110] It should be noted that, in the embodiment of the present application, before the first client requests the target live audio from the second client, the process of the second client generating the second digital human live room is similar to that of the first client. Fig. 9 , refer to Fig.10 As shown, the process of the second client generating the second digital human live broadcast room may include: S1001-S1012:

[0111] S1001. The second client sends a live broadcast start instruction to the signaling server.

[0112] The start live broadcast instruction carries third indication information; the third indication information is at least used to indicate the digital human information and live broadcast background information in the second digital human live broadcast room.

[0113] S1002: The signaling server receives an instruction to start live broadcasting.

[0114] S1003. The signaling server sends a live broadcast start instruction to the live broadcast rendering server.

[0115] S1004: The live broadcast rendering server receives a live broadcast start instruction.

[0116] S1005. The live broadcast rendering server sends a start live broadcast response to the signaling server.

[0117] When the live broadcast rendering server receives the start live broadcast instruction and is ready to process the target live broadcast audio, the live broadcast rendering server can send a start live broadcast response to the second client through the signaling server. The start live broadcast response is used to indicate the relevant information of the live broadcast rendering server and that the target live broadcast video can be started. The relevant information of the live broadcast rendering server can be used by the second client to establish a communication channel with the live broadcast rendering service.

[0118] S1006: The signaling server receives a live broadcast start response.

[0119] S1007. The signaling server sends a start live broadcast response to the second client.

[0120] S1008. The second client receives a live broadcast start response and establishes a communication channel with the live broadcast rendering server.

[0121] Exemplarily, the communication channel between the second client and the live broadcast rendering server may be a Web real-time communications (WebRTC) channel.

[0122] S1009. The second client sends a rendering request to the live broadcast rendering server.

[0123] The rendering request carries the target live audio, and is used to request generation of second live video data in the second digital human live room based on the target live audio.

[0124] S1010. The live broadcast rendering server receives a rendering request, and generates the second live broadcast video data based on the target live broadcast audio in response to the rendering request.

[0125] S1011. The live broadcast rendering server sends second live broadcast video data to the second client.

[0126] S1012: The second client receives the second live video data, and establishes the first digital human live broadcast room based on the second live video data for live broadcast.

[0127] S406: The live broadcast rendering server receives the rendering request, and generates the first live broadcast video data based on the target live broadcast audio in response to the rendering request.

[0128] Specifically, the live rendering server can generate the first live video data based on the first indication information from the first client and the target live audio. The specific generation method can be any feasible method, and this application does not impose any specific restrictions on this.

[0129] S407: The live broadcast rendering server sends the first live broadcast video data to the first client.

[0130] S408: The first client receives the first live video data from the live rendering server, and establishes a first digital human live broadcast room based on the first live video data for live broadcast.

[0131] In the technical solution provided by the embodiment of the present application, when the first client needs to establish the first digital human live broadcast room, it can request the target live audio (or target live speech) of the second digital human live broadcast room from the second client corresponding to the second digital human live broadcast room. After obtaining the target live audio, the first client can send the target live audio to the live rendering server to obtain the first live video data, and then establish the first digital human live broadcast room for live broadcast. It can be seen that based on this technical solution, when creating a digital human live broadcast room, the live video can be obtained based on the live audio corresponding to the live speech in the already constructed digital human live broadcast room, so that the construction process of the digital human live broadcast room does not need to be separately constructed for the most complex live speech, which reduces the construction complexity of the digital human live broadcast room and improves the construction efficiency of the digital human live broadcast room. Furthermore, based on this technical solution, multiple digital human live broadcast rooms can be constructed for the same live speech. For users who have constructed the live speech, multiple different digital human live broadcast rooms can be quickly generated to achieve cluster live broadcast of large-scale speech and improve the live operation effect.

[0132] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0133] The embodiment of the present application can divide the functional modules of the first client according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0134] Corresponding to the method in the aforementioned embodiment, the embodiment of the present application further provides a group control live broadcast device, which is used to implement the steps implemented by the first client in the aforementioned group control live broadcast method. The group control live broadcast device can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0135] For example, Fig.11 FIG. 1 shows a schematic diagram of the structure of a group control live broadcast device 110, which may be the first client or a part of the first client in the above-mentioned embodiment. Fig.11 As shown, the group control live broadcast device may include: a sending module 111, a receiving module 112 and a processing module 113. The sending module 111 is used to send a push stream request to the second client to which the second digital human live broadcast room belongs; the push stream request is used to request the target live broadcast audio of the second digital human live broadcast room; the receiving module 112 is used to receive the target live broadcast audio from the second client; the sending module 111 is also used to send a rendering request to the live broadcast rendering server; the rendering request carries the target live broadcast audio received by the receiving module 112, and the rendering request is used to request to generate the first live broadcast video data of the first digital human live broadcast room based on the target live broadcast audio; the receiving module 112 is also used to receive the first live broadcast video data from the live broadcast rendering server; the processing module 113 is used to establish the first digital human live broadcast room for live broadcast based on the live broadcast video data received by the receiving module 112.

[0136] The embodiment of the present application also provides a structural schematic diagram of another group control live broadcast device, which can be the second client or a part of the second client in the above embodiment. The group control live broadcast device is used to implement the steps implemented by the second client in the above group control live broadcast method. The group control live broadcast device can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0137] For example, Fig.12 FIG. 1 shows a schematic diagram of the structure of a group control live broadcast device 120, which may be the first client or a part of the first client in the above-mentioned embodiment. Fig.12As shown, the group control live broadcast device may include: a receiving module 121 and a sending module 122. The receiving module 121 is used to receive a push stream request from the first client. The push stream request is used to request the target live broadcast audio of the second digital human live broadcast room. The sending module 122 is used to send the target live broadcast audio to the first client in response to the push stream request received by the receiving module 121.

[0138] The effects that can be achieved by the above-mentioned group control live broadcast device can refer to the effects of the relevant contents of the group control live broadcast method in the aforementioned embodiment, and will not be repeated here.

[0139] Fig.13 A structural diagram of an electronic device provided in an embodiment of the present disclosure, such as Fig.13 As shown, the electronic device includes one or more processors 1301 and a memory 1302 .

[0140] The processor 1301 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.

[0141] The memory 1302 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 1301 may run the program instructions to implement the steps corresponding to the first client or the second client in the group control live broadcast method of each embodiment of the present disclosure above or other desired functions.

[0142] In one example, the electronic device may further include: an input device 1303 and an output device 1304 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0143] Of course, to simplify, Fig.13 Only some of the components related to the present disclosure in the electronic device are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device may further include any other appropriate components.

[0144] In addition to the above-mentioned methods and devices, the embodiments of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps in the group control live broadcast method provided in the aforementioned embodiments of this specification.

[0145] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0146] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps corresponding to the first client or the second client in the group control live broadcast method provided in the aforementioned embodiments of this specification.

[0147] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0148] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0149] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0150] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0151] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0152] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A group control live broadcast method, characterized in that: include: The first client sends a streaming request to the second client to which the second digital human live broadcast room belongs; The streaming request is used to request the target live audio of the second digital human live broadcast room; The second client receives the streaming request, and sends the target live audio to the first client in response to the streaming request; The first client receives the target live audio; The first client sends a rendering request to the live broadcast rendering server; The rendering request carries the target live audio, and the rendering request is used to request to generate the first live video data of the first digital human live room based on the target live audio; The first client receives the first live video data from the live rendering server, and establishes a first digital human live broadcast room for live broadcast based on the first live video data.

2. The method according to claim 1, characterized in that Before the first client sends a streaming request to the second client to which the second digital human live broadcast room belongs, the method further includes: The first client obtains at least one digital human live broadcast room that is broadcasting live; The first client determines the second digital human live broadcast room in response to a selection operation of the user.

3. The method according to claim 1 or 2, characterized in that: The second client receives the streaming request, and sends the target live audio to the first client in response to the streaming request, including: The second client receives the streaming request, sends the target live audio to the audio relay server in response to the streaming request, and sends first indication information to the first client; the first indication information is used to indicate that the second client has sent the target live audio to the audio relay server; The first client receives the target live audio, including: The first client receives the first indication information, and obtains the target live audio from the audio relay server in response to the first indication information.

4. The method according to any one of claims 1 to 3, characterized in that: After the first client receives the target live audio, and before the first client sends a rendering request to the live rendering server, the method further includes: The first client sends first indication information to the live broadcast rendering server; the first indication information is at least used to indicate the digital human information and live broadcast background information in the first digital human live broadcast room.

5. The method according to claim 4, characterized in that The first client sends first indication information to the live broadcast rendering server, including: When the first client determines that there is an available rendering resource in the first rendering resource that meets the rendering requirements of the target live video, the first client sends the first indication information to the live rendering server; the first rendering resource is a rendering resource in the live rendering server corresponding to the first client.

6. The method according to claim 5, characterized in that The method further comprises: When the first client determines that there are no available rendering resources in the first rendering resources that meet the rendering requirements of the target live video, the first client outputs second indication information; the second indication information is used to indicate that the available rendering resources are insufficient.

7. A group control live broadcast method, applied to a first client, characterized in that: include: Sending a streaming request to the second client to which the second digital human live broadcast room belongs; The streaming request is used to request the target live audio of the second digital human live broadcast room; Receiving the target live audio from the second client; Send a rendering request to the live rendering server; The rendering request carries the target live audio, and the rendering request is used to request to generate the first live video data of the first digital human live room based on the target live audio; The first live broadcast video data is received from the live broadcast rendering server, and a first digital human live broadcast room is established based on the first live broadcast video data for live broadcast.

8. A group control live broadcast device, characterized in that: include: A sending module, used for sending a streaming request to a second client to which the second digital human live broadcast room belongs; The streaming request is used to request the target live audio of the second digital human live broadcast room; A receiving module, used for receiving the target live audio from the second client; The sending module is also used to send rendering requests to the live rendering server; The rendering request carries the target live audio received by the receiving module, and the rendering request is used to request to generate the first live video data of the first digital human live room based on the target live audio; The receiving module is further used to receive the first live video data from the live rendering server; The processing module is used to establish a first digital human live broadcast room for live broadcast based on the live broadcast video data received by the receiving module.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to execute the group control live broadcast method as described in claim 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: It includes at least one instruction, which, when executed on an electronic device, enables the electronic device to execute the group control live broadcast method as described in claim 7.

Citation Information

Patent Citations

  • Video studio creating method and service device

    CN104394432A

  • Virtual live broadcast method and device, electronic equipment and storage medium

    CN110691279A

  • Live broadcast method and device of virtual anchor, computer equipment and storage medium

    CN111970521A

  • Virtual anchor generation method and device and terminal equipment

    CN113095206A

  • Virtual image driving method and device, electronic equipment and readable storage medium

    CN113313797A