Game live broadcast method, device, system, electronic device and readable storage medium

Abstract

The game live broadcast method, device, system, electronic device and readable storage medium provided by the present invention are applied to the host side. The method includes: providing preset live broadcast protocol information to at least one terminal, where the live broadcast protocol information is used to instruct at least one terminal to start the camera on the terminal and perform video acquisition through the camera; sending a game video stream to the server, so that the server synthesizes the game video stream with the camera video stream of the terminal and pushes the synthesized target video stream to the viewer side. By providing the live broadcast protocol information to at least one terminal through the host side, this application uses the live broadcast protocol information to instruct the terminal to start the camera carried by itself for real-time picture acquisition, and then synthesizes the game video stream and the camera video stream through the server, and sends the synthesized target video stream to the viewer side. The operation is simple and the cost is low. The viewer side can not only watch the game live broadcast, but also watch the live broadcast of the host user or other scenarios.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, and in particular, to a game live broadcast method, device, system, electronic device and readable storage medium. Background Art

[0002] With the development of mobile communication technology, various video live broadcast applications have emerged. The anchor can live broadcast mobile games through the live broadcast application on the mobile phone.

[0003] Currently, when the anchor conducts game live broadcast on a smart phone, only the game screen can be live broadcast singly. If the game screen and the camera screen need to be live broadcast simultaneously, the mobile phone needs to be connected to a computer, and the anchor's screen is live broadcast through the computer. Such operation is troublesome and the live broadcast cost is relatively high. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide a game live broadcast method, device, system, electronic device and readable storage medium, so as to simplify the operation process and reduce the live broadcast cost in the scenario of realizing simultaneous live broadcast of the game screen and the camera screen.

[0005] In order to achieve the above purpose, the technical solutions adopted in the embodiments of the present invention are as follows:

[0006] In the first aspect, the present invention provides a game live broadcast method, which is applied to the anchor side. The method includes: providing preset live broadcast protocol information to at least one terminal, where the live broadcast protocol information is used to instruct at least one terminal to start the camera on the terminal for video acquisition, and send the acquired video stream to the server; sending a game video stream to the server, so that the server synthesizes the game video stream with the camera video stream of the terminal, and pushes the synthesized target video stream to the viewer side.

[0007] In the second aspect, the present invention provides a game live broadcast method, which is applied to the server side. The method includes: obtaining a game video stream of the anchor side and camera video streams of at least one terminal; wherein, the camera video stream is a video stream acquired by the camera on the terminal when the terminal obtains the live broadcast protocol information, and the live broadcast protocol information is provided by the anchor side; synthesizing the game video stream and the camera video streams to obtain a target video stream; pushing the target video stream to the viewer side, so that the viewer side displays the game screen of the game video stream and the screen of the camera video stream.

[0008] In a third aspect, the present invention provides a game live streaming method, which is applied to a terminal having a camera. The method includes: obtaining live streaming protocol information provided by a host terminal; starting the camera according to the live streaming protocol information, and collecting a camera video stream through the camera; sending the camera video stream to a server, so that the server synthesizes the camera video stream and the game video stream of the host terminal, and pushes the synthesized target video stream to an audience terminal.

[0009] In a fourth aspect, the present invention provides a game live streaming device, including: an interaction module, configured to provide live streaming protocol information to at least one terminal, where the live streaming protocol information is used to instruct the at least one terminal to start the camera on the terminal for video collection and send the collected video stream to a server; a sending module, configured to send a game video stream to the server, so that the server synthesizes the game video stream and the camera video stream of the terminal, and pushes the synthesized target video stream to an audience terminal.

[0010] In a fifth aspect, the present invention provides a game live streaming device, including: an acquisition module, configured to acquire a game video stream of a host terminal and a camera video stream of at least one terminal; wherein, the camera video stream is a video stream collected by the camera on the terminal when the terminal obtains the live streaming protocol information, and the live streaming protocol information is provided by the host terminal; a synthesis module, configured to synthesize the game video stream and the camera video stream to obtain a target video stream; a sending module, configured to push the target video stream to an audience terminal, so that the audience terminal displays the game screen and the screen collected by the camera.

[0011] In a sixth aspect, the present invention provides a game live streaming device, including: an acquisition module, configured to obtain live streaming protocol information in response to a user operation instruction, where the live streaming protocol information is provided by a host terminal; a collection module, configured to start the camera according to the live streaming protocol information and obtain a camera video stream; a sending module, configured to send the camera video stream to a server, so that the server synthesizes the camera video stream and the game video stream of the host terminal, and pushes the synthesized target video stream to an audience terminal.

[0012] In a seventh aspect, the present invention provides a game live streaming system, including a host end, a server end, and at least one terminal; the host end is configured to provide live streaming protocol information to at least one terminal and send a game video stream to the server end; the live streaming protocol information is used to instruct at least one terminal to start the camera on the terminal for video capture and send the captured video stream to the server end; the terminal is configured to respond to a user operation instruction, obtain the live streaming protocol information, start the camera according to the live streaming protocol information, capture a camera video stream through the camera, and send the camera video stream to the server end; the server end is configured to synthesize the game video stream and the camera video stream to obtain a target video stream and push the target video stream to the viewer end.

[0013] In an eighth aspect, the present invention provides an electronic device, including a processor and a memory, where the memory stores machine-executable instructions that can be executed by the processor, and the processor can execute the machine-executable instructions to implement the method described in the first aspect, or implement the method described in the second aspect, or implement the method described in the third aspect.

[0014] In a ninth aspect, the present invention provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the method described in the first aspect, or implements the method described in the second aspect, or implements the method described in the third aspect.

[0015] A game live streaming method, device, system, electronic device, and readable storage medium provided by the present invention are applied to the host end. The method includes: providing preset live streaming protocol information to at least one terminal, where the live streaming protocol information is used to instruct at least one terminal to start the camera on the terminal and perform video capture through the camera; sending a game video stream to the server end so that the server end synthesizes the game video stream and the camera video stream of the terminal and pushes the synthesized target video stream to the viewer end. The difference from the prior art is that in the prior art, in order for the viewer end to simultaneously view the game screen and the real-time screen of the host user or other scenarios, it is necessary to connect the host end to the PC end, which is not only complex but also costly. In order to solve this problem and enable the viewer end to simultaneously view the game screen and the real-time screen of the host user or other scenarios, the present application provides live streaming protocol information from the host end to at least one terminal, uses the live streaming protocol information to instruct the terminal to start the camera carried by itself for real-time screen capture, and then synthesizes the game video stream and the camera video stream through the server end, and sends the synthesized target video stream to the viewer end. In this way, the viewer end can watch both the game live stream and the live stream of the host user or other scenarios, with simple operation and low cost.

[0016] To make the above objects, features, and advantages of the present invention more obvious and understandable, the following specifically enumerates preferred embodiments and, in conjunction with the accompanying drawings, provides a detailed description as follows. Description of the Drawings

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for use in the embodiments. It should be understood that the following drawings only show certain embodiments of the present invention and should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other relevant drawings can also be obtained based on these drawings.

[0018] Figure 1 It is an architecture diagram of a game live broadcast system provided by an embodiment of the present application;

[0019] Figure 2 It is a schematic flowchart of a game live broadcast method in an embodiment provided by an embodiment of the present application;

[0020] Figure 3 It is a scene example diagram of the user interface of the host side provided by an embodiment of the present application;

[0021] Figure 4A and Figure 4B It is a schematic scene diagram provided by an embodiment of the present application shown;

[0022] Figure 5 It is a schematic flowchart of another game live broadcast method in an embodiment provided by an embodiment of the present application;

[0023] Figure 6 It is an example diagram of the user interface of the host side provided by an embodiment of the present application;

[0024] Figure 7A and Figure 7B It is another schematic scene diagram provided by an embodiment of the present application shown;

[0025] Figure 8 It is a schematic flowchart of another game live broadcast method in an embodiment provided by an embodiment of the present application;

[0026] Figure 9 It is a schematic flowchart of another game live broadcast method in an embodiment provided by an embodiment of the present application;

[0027] Figure 10 It is another example diagram of the user interface of the host side provided by an embodiment of the present application;

[0028] Figure 11 It is a schematic flowchart of a game live broadcast method in another embodiment provided by an embodiment of the present application;

[0029] Figure 12 A schematic flowchart of a game live broadcast method in another embodiment provided by the embodiments of the present application;

[0030] Figure 13 A functional module diagram of a game live broadcast device provided by the embodiments of the present invention;

[0031] Figure 14 A functional module diagram of another game live broadcast device provided by the embodiments of the present invention;

[0032] Figure 15 A functional module diagram of another game live broadcast device provided by the embodiments of the present invention;

[0033] Figure 16 A structural block diagram of an electronic device provided by the embodiments of the present invention. Detailed implementation manners

[0034] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Usually, the components of the embodiments of the present invention described and illustrated here can be arranged and designed in various different configurations.

[0035] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed present invention, but merely represents selected embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0036] It should be noted that relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0037] With the development of mobile communication technology, various video live broadcast applications have emerged. Users can use the video live broadcast applications installed on terminal devices to live broadcast entertainment activities such as living status and game competitions.

[0038] In the game live broadcast scenario, due to terminal system limitations, the host side cannot start the camera in the background, so both the audience side and the host side can only display the game screen, and the audience cannot see the host's status. Therefore, the interactivity between the host user and the audience user is poor. In addition, in order to prevent the camera from automatically starting to take pictures and infringe on user privacy, current mobile terminals have system limitations. Therefore, if you want to display the game screen and the host user's real-time picture at the same time, you need to connect the terminal to the PC and then broadcast the host's real-time picture on the PC. This operation is not only troublesome and increases the cost of live broadcasting, but also has the problem of geographical restrictions.

[0039] In order to solve the above problems, the present invention first provides a game live broadcast system. Figure 1 , Figure 1 An architecture diagram of a game live broadcast system provided for an embodiment of the present application, including a host terminal 10, a terminal 30 and a server terminal 20, which are interconnected and maintain communication through a network.

[0040] Among them, the anchor terminal 10 is an electronic device used by the anchor user for live broadcast. In the embodiment of the present application, the anchor terminal 10 can be used to live broadcast mobile phone games (referred to as mobile games). The anchor terminal 10 is but not limited to: laptop computers, tablet computers, smart phones and other terminal devices.

[0041] In an embodiment of the present application, the host end 10 can send the game video stream to the server end 20 for video processing during the live broadcast, and the server end 20 pushes the processed game video stream to the audience end.

[0042] Terminal 30 is an electronic device used by an anchor user or a non-anchor user to collect video streams of the anchor user or the non-anchor user, and is equipped with a video acquisition device. Terminal 30 may be, but is not limited to, a mobile phone or a tablet computer, and the video acquisition device may be, but is not limited to, a camera on a mobile terminal such as a mobile phone or a tablet computer.

[0043] In an embodiment of the present application, the terminal 30 can obtain the live broadcast protocol information from the anchor terminal 10, and start the video acquisition device to perform video acquisition under the instruction of the live broadcast protocol information, and send the acquired camera video stream to the server terminal 20. The server terminal 20 synthesizes the obtained game video stream and camera video stream, and pushes the synthesized video stream to the audience terminal. Finally, the audience terminal can provide both the game screen and the acquired anchor screen or other scene screen.

[0044] The server 20 can be implemented as an independent cloud server or a server cluster composed of multiple servers. The server 20 can transmit the game video stream from the anchor terminal 10 and the camera video stream from the terminal 30.

[0045] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a game live broadcast method in an embodiment provided by the present application. This method can be applied to Figure 1 the host terminal 10 shown in

[0046] S105: Provide preset live broadcast protocol information to at least one terminal. The live broadcast protocol information is used to instruct at least one terminal to start the camera on the terminal for video capture and send the captured video stream to the server.

[0047] It can be understood that the host terminal can send the live broadcast protocol information to at least one terminal, and can also display the live broadcast protocol information in various visual forms on the user interface. The host user or other non-host users can obtain the live broadcast protocol information through the terminal 30.

[0048] In a possible implementation manner, the host terminal can display a device connection interface, and this interface can be as shown in Figure 3 . Figure 3 which is a scenario example diagram of the user interface of the host terminal provided by the present application. The live broadcast protocol information is displayed in the form of a two-dimensional code on the device connection interface. The host user or other non-host users can scan the two-dimensional code information through the terminal and start the camera of the terminal by reading the preset parameters in the two-dimensional code information, and collect the video stream of the host user or other non-host users through the camera.

[0049] In some possible embodiments, the live broadcast protocol information may further include temporary live room parameters. After the terminal obtains the temporary live room parameters, it jumps to the corresponding temporary live room, and operations such as video editing can be performed in the temporary live room, providing a rich live broadcast environment for the host user or other non-host users and improving user stickiness and participation.

[0050] It can be understood that after the host user starts the game live broadcast, if it is determined to display the real-time picture of himself to the audience user, the device connection function can be triggered on the function page of the live room, so that the host terminal displays the two-dimensional code information of the live broadcast protocol information or directly sends the live broadcast protocol information to the target terminal.

[0051] S107: Send the game video stream to the server, so that the server synthesizes the game video stream with the camera video stream of the terminal and pushes the synthesized target video stream to the audience terminal.

[0052] In a possible implementation manner, after the host user starts the game live broadcast, the live broadcast application wakes up the screen recording service of the host terminal, obtains the video frames captured by the screen recording through the screen recording service, and then pushes the encoded video frames to the server.

[0053] In some possible embodiments, after the server obtains the game video stream and the camera video stream, it can use the Open Graphics Library (OpenGL for short) to draw the two on the same video frame according to the preset position parameters and size parameters, and then encode all the drawn video frames, and then forward the encoded target video stream to the viewer side.

[0054] It can be understood that the above position parameters may include: the mixing layer level. The larger the mixing number is, the higher layer it is drawn on. In the embodiments of the present application, the level of the picture captured by the camera is greater than that of the game picture, and the layer of the picture captured by the camera is located above the layer of the game picture; it also includes the left margin, right margin, upper margin and lower margin of the picture captured by the camera relative to the game picture. The size parameters may include: the position and size of the game picture based on the size of the captured picture and the finally drawn picture based on the game picture.

[0055] Through the above implementation process, finally, both the host side and the viewer side can display the game picture and the picture captured by the camera, as Figure 4A and Figure 4B shown in a schematic diagram of a scenario provided by an embodiment of the present application. Figure 4A is an example diagram of the user interface of the host side. Figure 4B is an example diagram of the user interface of the viewer side. It can be seen that whether it is the user interface of the host side or the user interface of the viewer side, both can display the game picture and the picture captured by the camera at the same time. The picture captured by the camera can be the real-time picture of the host user himself or the picture of other scenarios, which is not limited here.

[0056] It should be noted that there is no execution sequence between step S105 and step S107. They can be carried out simultaneously, or step S105 can be executed first and then step S107, or step S107 can be executed first and then step S105, which is not limited here.

[0057] It should also be noted that the above at least one terminal and the host side can span different regions. For example, the host side and at least one terminal are located in different cities, or the host side and the terminal are located in different areas of the same city, thereby overcoming the defect that the host side and the PC side must be in the same live broadcast position in the prior art and improving the flexibility of the scenario.

[0058] From the above content, it can be seen that the game live broadcast method provided by the embodiment of the present application is different from the prior art in that, in order for the audience end to simultaneously view the game screen and the real-time screen of the anchor user or other scenes, the prior art needs to connect the anchor end to the PC end. This operation is not only complicated but also costly. In order to solve this problem, the present application can simultaneously view the game screen and the real-time screen of the anchor user or other scenes on the audience end. The anchor end provides live broadcast protocol information to at least one terminal, and uses the live broadcast protocol information to instruct the terminal to start the camera it carries to collect real-time images, and then synthesizes the game video stream and the camera video stream through the server end, and sends the synthesized target video stream to the audience end. In this way, the audience end can watch both the game live broadcast and the live broadcast of the anchor user or other scenes, with simple operation and low cost.

[0059] It can also be understood that the game live broadcast method provided in the embodiment of the present application is different from the prior art in that the mobile terminal responsible for live broadcasting of mobile games and the mobile terminal responsible for collecting videos of the anchor or other scenes in the embodiment of the present application do not have geographical restrictions. For example, a anchor can broadcast a game live through the anchor terminal in city A, and another user can give a game explanation through the terminal in city B, which overcomes the defect in the prior art that the mobile terminal and the PC terminal must be in the same location.

[0060] From the above content, it can be seen that at least two mobile terminals are required in the embodiment of the present application, one for game live broadcast and the other for video capture. This is because: in order to prevent the application from automatically starting the camera in the background to take pictures secretly and infringe on the user's privacy, there is a system limitation problem in the mobile terminal of the anchor user. That is, the mobile terminal that is performing game live broadcast cannot automatically start the camera to capture the anchor's video. It is foreseeable that if the mobile terminal opens the system interface and removes the above system limitations, the game live broadcast provided by the embodiment of the present application can be executed using only one mobile terminal, that is, the mobile terminal can both broadcast the game live and start the camera to capture the video. For example, during the process of broadcasting the game live, the mobile terminal can obtain the QR code logo corresponding to the live broadcast protocol information through the scan function, and then start the camera on the mobile terminal for video capture according to the obtained live broadcast protocol information, and send the captured video stream to the server.

[0061] Optionally, from Figure 4A It can be seen that there is an area for selection on the right side of the anchor's user interface. This area is the selection area for the live template. The purpose is to provide the audience with game images while also providing real-time videos of more than one user or scene. Therefore, Figure 1 Based on this, an implementation method is given, see Figure 5 , Figure 5Schematic flowchart of another game live broadcast method in an embodiment provided by the present application. The method may further include:

[0062] S101, display a selection interface for live broadcast templates.

[0063] Among them, the live broadcast template includes the position information and size information of the game screen and the captured screen of the camera. The selection interface is as Figure 6 shown. Figure 6 It is an example diagram of the user interface of the host side provided by the embodiment of the present application. Among them, it may include a single-camera capture live broadcast template and a multi-camera capture live broadcast template. The single-camera capture live broadcast template includes the position information and size information of a captured screen of a camera and the game screen. The multi-camera capture live broadcast template includes the position information and size information of multiple captured screens of cameras and the game screen.

[0064] For example, please continue to refer to Figure 4A . Figure 4A shows the display screen of the single-camera capture live broadcast template. It can be seen that on the user interface of the host side, the layer of the captured screen of the camera is above the layer of the game screen, and the size of the captured screen of the camera is smaller than the size of the game screen.

[0065] In some possible embodiments, the live broadcast template may further include screen element information, that is, other page design elements are displayed in the screen to enrich the content of the live broadcast screen.

[0066] S102, in response to the selection instruction on the selection interface, generate task information according to the selected target live broadcast template, and send the task information to the server.

[0067] Among them, the task information is used to instruct the server to perform a mixing process on the target live broadcast template and the game video stream. In some possible embodiments, the above task information may be a mixed painting task JSON. After obtaining the task information, the server may perform a mixing process on the target live broadcast template and the game video stream.

[0068] It can be understood that from Figure 4A and Figure 4B it can be seen that when the host user selects the single-camera capture live broadcast template, it can be displayed on the host side or the viewer side. When the multi-camera capture live broadcast template is selected, the user interfaces of the host side and the user side may be as Figure 7A and Figure 7B shown. Figure 7A and Figure 7B shown, which are schematic diagrams of another scenario provided by the embodiment of the present application. From Figure 7AIt can be seen that the target live broadcast template is a live broadcast template collected by two cameras. The layers of the images collected by these two cameras are located above the layer of the game image, and the size of the images collected by the cameras is smaller than the size of the game image. Moreover, the images collected by these two cameras are respectively located in the lower left corner area and the lower right corner area of the game image.

[0069] Optionally, since the server needs to perform mixed painting processing on the game video stream and the live broadcast template, in order to facilitate the server to accurately distinguish the game video stream and the camera video stream, an implementation method for generating stream identifiers for different video streams is given below. Please refer to Figure 8 , Figure 8 which is a schematic flowchart of another game live broadcast method in an embodiment provided by the present application. The method further includes:

[0070] S103, generating a stream identifier corresponding to the game video stream according to the identifier information of the host end and the time information generated by the game video stream.

[0071] S104, sending the stream identifier to the terminal so that the terminal generates a stream identifier corresponding to the camera video stream according to the stream identifier and the identifier information of the terminal.

[0072] It can be understood that after the host end or the terminal generates the corresponding video stream, a fixed stream name can be generated as the unique identifier of the video stream. The rule for the host end to generate the fixed stream name can be: generating a stream identifier according to the identifier information of the host end and the time information generated by the game video stream. The rule for the terminal to generate the fixed stream name can be the stream identifier of the host end plus the identifier information of the terminal.

[0073] For example, if the identifier information of the host end is uid and guid-1, and the identifier information of the terminal is guid-2, then the stream identifier can be uid*guid-1*timestamp, and the stream identifier of the terminal is uid*guid-1*timestamp*guid-2.

[0074] Optionally, in order to provide a flexible live broadcast environment for users so that the host user can change the terminal at any time during the live broadcast, an implementation method is given below. Please refer to Figure 9 , Figure 9 which is a schematic flowchart of another game live broadcast method in an embodiment provided by the present application. The method further includes:

[0075] S108, when an addition instruction is received on the interface of the connected device, generating and displaying the live broadcast protocol information;

[0076] wherein the interface is used to display at least one terminal connected to the host end.

[0077] S109. When a disconnection instruction is received on the interface, send a message to stop pushing the stream to the terminal.

[0078] For ease of understanding, please refer to Figure 10 , Figure 10 FIG. is an example diagram of another user interface of the host end provided by an embodiment of the present application, where the terminals 30-1 and 30-2 are terminals that have been connected to the host end, that is, their own cameras have been started for video acquisition. The host user can click to add a terminal, and at this time, a device connection interface as shown in Figure 3 will pop up. The live protocol information newly generated is displayed on this interface; when the host user clicks the disconnection button, the host end can send a message to stop pushing the stream to the connected terminals, and the terminals can stop pushing the stream after receiving this message.

[0079] Based on the same inventive concept, an embodiment of the present application further provides a game live broadcast method, which can be applied to the Figure 1 server 20 shown in, please refer to Figure 11 , Figure 11 FIG. is a schematic flowchart of the game live broadcast method in another embodiment provided by an embodiment of the present application. The method may include:

[0080] S201. Obtain the game video stream of the host end and the camera video streams of at least one terminal.

[0081] Among them, the camera video stream is a video stream collected by the camera on the terminal when the terminal obtains the live protocol information; the live protocol information is provided by the host end, and the live protocol information is used to instruct at least one terminal to start the camera on the terminal for video acquisition and send the collected video stream to the server.

[0082] S204. Synthesize the game video stream and the camera video streams to obtain a target video stream.

[0083] S207. Push the target video stream to the viewer end so that the viewer end can display the game screen of the game video stream and the screen of the camera video stream.

[0084] It can be understood that the server can push the target video stream to the content distribution server, and then the content distribution server sends the target video stream to the viewer end. Alternatively, the server pushes the target video stream to the content distribution server and sends the video information of the target video stream to the terminal. The video information includes information such as the video, audio encoding information, video encoding size, bit rate, video encoding format, channel information (for example, 1 represents mono, 2 represents stereo), sampling rate, stream name, etc. of the target video stream. The viewer end can pull the target video stream by this name and decode the video according to the above video information to obtain the playback screen.

[0085] Optionally, to mix the game video stream and the live broadcast template, the method may further include: obtaining task information of the host end, where the task information includes the live broadcast template; wherein, the live broadcast template is determined according to the selection operation received on the live broadcast template selection interface at the host end; performing a mixing process on the live broadcast template and the game video stream to obtain a mixed game video stream.

[0086] Optionally, to obtain the audio of the game and the collected audio, an implementation manner is given below. The method may further include: synthesizing the audio stream of the host end and the camera audio streams of at least one terminal to obtain a target audio stream; pushing the target audio stream to the viewer end.

[0087] Based on the same inventive concept, an embodiment of the present application further provides a game live broadcast method, which can be applied to Figure 1 the terminal 30 shown in Figure 12 , Figure 12 which is a schematic flowchart of the game live broadcast method in another embodiment provided by the embodiment of the present application. The method may include:

[0088] S301, obtaining the live broadcast protocol information provided by the host end.

[0089] Wherein, the live broadcast protocol information is used to instruct at least one terminal to start the camera on the terminal for video acquisition and send the acquired video stream to the server.

[0090] S302, starting the camera according to the live broadcast protocol information and acquiring a camera video stream through the camera;

[0091] S303, sending the camera video stream to the server, so that the server synthesizes the camera video stream and the game video stream of the host end and pushes the synthesized target video stream to the viewer end.

[0092] Optionally, to facilitate the server to distinguish the camera video stream and the live video stream, an implementation manner is given below. The method may include: obtaining a stream identifier corresponding to the game video stream, where the stream identifier is determined according to the identifier information of the host end and the time information generated by the game video stream; generating a stream identifier corresponding to the camera video stream according to the stream identifier and the identifier information of the terminal.

[0093] To execute the steps of the game live broadcast method in each of the above embodiments of the live broadcast end and each possible manner, an implementation manner of a game live broadcast device is given below. Please refer to Figure 13 , Figure 13 which is a functional module diagram of a game live broadcast device provided by an embodiment of the present invention.

[0094] It should be noted that the game live broadcast device provided in this embodiment has the same basic principle and technical effects as those in the above embodiments. For the sake of brief description, for the parts not mentioned in this embodiment, reference can be made to the corresponding content in the above embodiments. The game live broadcast device 40 includes:

[0095] An interaction module 41, configured to provide live broadcast protocol information to at least one terminal, where the live broadcast protocol information is used to instruct at least one terminal to start the camera on the terminal for video acquisition and send the acquired video stream to the server;

[0096] A sending module 42, configured to send a game video stream to the server, so that the server synthesizes the game video stream with the camera video stream of the terminal and pushes the synthesized target video stream to the viewer side.

[0097] Optionally, the interaction module 41 is configured to display a device connection interface, and the device connection interface is used to provide the live broadcast protocol information.

[0098] Optionally, the game live broadcast device 40 further includes a generation module. The interaction module 41 is further configured to display a selection interface for live broadcast templates; wherein, the live broadcast template includes position information and size information of the game screen and the captured screen of the camera; in response to a selection instruction on the selection interface, the generation module is configured to generate task information according to the selected target live broadcast template and send the task information to the server; the task information is used to instruct the server to perform a mixing process on the target live broadcast template and the game video stream.

[0099] Optionally, the generation module is further configured to generate a stream identifier corresponding to the game video stream according to the identification information of the host side and the time information generated by the game video stream; send the stream identifier to the terminal, so that the terminal generates a stream identifier corresponding to the camera video stream according to the stream identifier and the identification information of the terminal.

[0100] Optionally, the interaction module and the generation module are also cooperatively configured to: when an addition instruction is received on the interface of the connected device, generate and display the live broadcast protocol information; the interface is used to display at least one terminal connected to the host side; the interaction module and the sending module 42 are also cooperatively configured to when a disconnection instruction is received on the interface, send information for stopping the stream pushing to the terminal.

[0101] In order to execute the steps of the game live broadcast method in each of the above embodiments of the server and each possible manner, an implementation manner of a game live broadcast device is given below. Please refer to Figure 14 , Figure 14 which is a functional module diagram of another game live broadcast device provided in an embodiment of the present invention.

[0102] It should be noted that the game live broadcast device provided in this embodiment has the same basic principle and technical effects as those in the above embodiments. For the sake of brief description, for the parts not mentioned in this embodiment, reference can be made to the corresponding content in the above embodiments. The game live broadcast device 50 includes:

[0103] An acquisition module 51, configured to acquire a game video stream of the host end and a camera video stream of at least one terminal;

[0104] Wherein, the camera video stream is a video stream collected by the camera on the terminal when the terminal obtains the live broadcast protocol information; the live broadcast protocol information is provided by the host end;

[0105] A synthesis module 52, configured to synthesize the game video stream and the camera video stream to obtain a target video stream;

[0106] A sending module 53, configured to push the target video stream to the viewer end so that the viewer end can display the game screen and the screen captured by the camera.

[0107] Optionally, the acquisition module 51 is configured to obtain the task information of the host end, where the task information includes a live broadcast template; wherein, the live broadcast template is determined by the host end according to the selection operation received on the live broadcast template selection interface; mix the live broadcast template and the game video stream to obtain the mixed game video stream.

[0108] Optionally, the synthesis module 52 is further configured to synthesize the audio stream of the host end and the camera audio stream of at least one terminal to obtain a target audio stream; the sending module 53 is configured to push the target audio stream to the viewer end.

[0109] To execute the steps of the game live broadcast method in each of the above terminal embodiments and each possible manner, the following gives an implementation manner of a game live broadcast device. Please refer to Figure 15 , Figure 15 which is a functional module diagram of another game live broadcast device provided by the embodiment of the present invention.

[0110] It should be noted that the game live broadcast device provided in this embodiment has the same basic principle and technical effects as those in the above embodiments. For the sake of brief description, for the parts not mentioned in this embodiment, reference can be made to the corresponding content in the above embodiments. The game live broadcast device 60 includes:

[0111] An acquisition module 61, configured to respond to a user operation instruction to obtain live broadcast protocol information, where the live broadcast protocol information is provided by the host end;

[0112] The acquisition module 62 is configured to start the camera according to the live broadcast protocol information and obtain a camera video stream;

[0113] The sending module 63 is configured to send the camera video stream to a server, so that the server synthesizes the camera video stream and the game video stream of the host side, and pushes the synthesized target video stream to the viewer side.

[0114] Optionally, the game live broadcast device 60 further includes a generation module. The acquisition module 61 is further configured to obtain a stream identifier corresponding to the game video stream, where the stream identifier is determined according to the identifier information of the host side and the time information generated by the game video stream; the generation module is configured to generate a stream identifier corresponding to the camera video stream according to the stream identifier and the identifier information of the terminal.

[0115] An embodiment of the present invention further provides an electronic device, such as Figure 16 , Figure 16 is a structural block diagram of an electronic device provided by an embodiment of the present invention. Among them, the electronic device may be Figure 1 any one of the host side 10, the server side 20, or the terminal 30 shown.

[0116] The electronic device 70 includes a communication interface 71, a processor 72, and a memory 73. The processor 72, the memory 73, and the communication interface 71 are directly or indirectly electrically connected to each other to realize data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines. The memory 73 can be used to store software programs and modules, such as program instructions / modules corresponding to any game live broadcast method provided by an embodiment of the present invention. The processor 72 executes various functional applications and data processing by executing the software programs and modules stored in the memory 73. The communication interface 71 can be used to communicate signals or data with other node devices. In the present invention, the electronic device 70 can have multiple communication interfaces 71.

[0117] Among them, the memory 73 can be, but is not limited to, a random access memory (Random Access Memory, RAM), a read only memory (Read Only Memory, ROM), a programmable read only memory (Programmable Read-Only Memory, PROM), an erasable programmable read only memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable programmable read only memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.

[0118] The processor 72 may be an integrated circuit chip with signal processing capability. The processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0119] Optionally, the above modules can be stored in the form of software or firmware. Figure 16 The memory shown in the figure may be fixed in the operating system (OS) of the electronic device and may be Figure 16 Meanwhile, the data and program codes required for executing the above modules can be stored in the memory.

[0120] The embodiment of the present invention provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, a game live broadcast method as described in any of the above embodiments is implemented. The readable storage medium can be, but is not limited to, a U disk, a mobile hard disk, a ROM, a RAM, a PROM, an EPROM, an EEPROM, a magnetic disk, or an optical disk, and other media that can store program codes.

[0121] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions, and operations of devices, methods, and computer program products according to multiple embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0122] In addition, in each embodiment of the present invention, the functional modules can be integrated together to form an independent part, or each module can exist alone, or two or more modules can be integrated to form an independent part.

[0123] If the above functions are implemented in the form of software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present invention.

[0124] The above is only the preferred embodiment of the present invention and is not used to limit the present invention. For those skilled in the art, the present invention can have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A game live broadcast method, characterized in that, Applied to the host side, the method includes: Providing preset live broadcast protocol information to at least one terminal. Specifically, trigger the device connection function on the function page of the live broadcast room and directly send the live broadcast protocol information to the at least one terminal. The live broadcast protocol information is used to instruct the at least one terminal to read the preset parameters in the live broadcast protocol information, start the camera on the terminal to collect video of other non-host users, and send the collected video stream to the server. Among them, the host side and at least one terminal are located in different cities, or the host side and the terminal are located in different regions of the same city; Send the game video stream to the server, so that the server synthesizes the game video stream with the camera video stream of the terminal and pushes the synthesized target video stream to the viewer side, and synchronously broadcasts the game screen of the host side and the camera screen of the other non-host users on the viewer side.

2. The game live broadcast method according to claim 1, characterized in that Providing the live broadcast protocol information to at least one terminal includes: Displaying a device connection interface, and the device connection interface is used to provide the live broadcast protocol information.

3. The game live broadcast method according to claim 1, wherein Before providing the preset live broadcast protocol information to at least one terminal, the method further includes: Displaying a selection interface for live broadcast templates; among them, the live broadcast template includes the position information and size information of the game screen and the captured screen of the camera. Respond to the selection instruction on the selection interface, generate task information according to the selected target live broadcast template, and send the task information to the server; the task information is used to instruct the server to perform a mixing process on the target live broadcast template and the game video stream.

4. The game live streaming method according to claim 3, wherein After sending the task information to the server, the method further includes: Generate a stream identifier corresponding to the game video stream according to the identification information of the host side and the time information generated by the game video stream. Send the stream identifier to the terminal, so that the terminal generates a stream identifier corresponding to the camera video stream according to the stream identifier and the identification information of the terminal.

5. The game live broadcast method according to claim 1, wherein, The method further includes: When an addition instruction is received on the interface of the connected device, generate and display the live broadcast protocol information; the interface is used to display at least one terminal connected to the host side. When a disconnection instruction is received on the interface, send a stop pushing stream message to the terminal.

6. A game live broadcast method, characterized in that, Applied to the server side, the method includes: Obtain the game video stream of the host side and the camera video streams of at least one terminal. Among them, the camera video stream is that when the terminal obtains the live broadcast protocol information, it reads the preset parameters in the live broadcast protocol information, starts the camera on the terminal, and collects the video stream of other non-host users through the camera on the terminal. The live broadcast protocol information is provided by the host side. Specifically, trigger the device connection function on the function page of the live broadcast room and directly send the live broadcast protocol information to the at least one terminal. Among them, the host side and at least one terminal are located in different cities, or the host side and the terminal are located in different regions of the same city; Synthesize the game video stream and the camera video stream to obtain a target video stream. Push the target video stream to the viewer side so that the viewer side can display the game screen of the game video stream of the host side and the screen of the camera video stream of the other non-host users.

7. The game live broadcast method according to claim 6, wherein Before synthesizing the game video stream and the camera video stream to obtain the target video stream, the method further includes: Obtain the task information of the host side, where the task information includes a live broadcast template; wherein, the live broadcast template is determined by the host side based on the selection operation received on the live broadcast template selection interface; Mix the live broadcast template and the game video stream to obtain the mixed game video stream.

8. The game live broadcast method according to claim 6, wherein The method further includes: Synthesize the audio stream of the host side and the camera audio stream of at least one terminal to obtain the target audio stream; Push the target audio stream to the viewer side.

9. A game live streaming method, characterized in that, Applied to a terminal, the terminal has a camera; the method includes: Obtain the live broadcast protocol information provided by the host side; the live broadcast protocol information is provided by the host side, specifically: trigger the device connection function on the function page of the live broadcast room and directly send the live broadcast protocol information to at least one terminal; wherein, the host side and at least one terminal are located in different cities, or the host side and the terminal are located in different areas of the same city; According to the live broadcast protocol information, read the preset parameters in the live broadcast protocol information, start the camera, and collect the camera video stream of other non-host users through the camera; Send the camera video stream to the server side so that the server side synthesizes the camera video stream and the game video stream of the host side, and pushes the synthesized target video stream to the viewer side, and synchronously broadcasts the game screen of the host side and the camera screen of the other non-host users on the viewer side.

10. The game live broadcast method according to claim 9, wherein Before sending the camera video stream to the server side, the method further includes: Obtain the stream identifier corresponding to the game video stream, wherein the stream identifier is determined according to the identifier information of the host side and the time information generated by the game video stream; Generate the stream identifier corresponding to the camera video stream according to the stream identifier and the identifier information of the terminal.

11. A game live broadcast device, characterized in that, Includes: An interaction module for providing live broadcast protocol information to at least one terminal, specifically: trigger the device connection function on the function page of the live broadcast room and directly send the live broadcast protocol information to the at least one terminal; The live broadcast protocol information is used to instruct at least one terminal to read the preset parameters in the live broadcast protocol information, start the camera on the terminal to collect video streams of other non-host users, and send the collected video streams to the server side; wherein, the host side and at least one terminal are located in different cities, or the host side and the terminal are located in different areas of the same city; A sending module for sending the game video stream to the server side so that the server side synthesizes the game video stream and the camera video stream of the terminal, and pushes the synthesized target video stream to the viewer side, and synchronously broadcasts the game screen of the host side and the camera screen of the other non-host users on the viewer side.

12. A game live broadcast device, characterized in that An acquisition module, configured to acquire a game video stream of the host end and camera video streams of at least one terminal; Among them, the camera video stream is that when the terminal obtains the live broadcast protocol information, it reads the preset parameters in the live broadcast protocol information, starts the camera on the terminal, and collects the video streams of other non-host users through the camera on the terminal; the live broadcast protocol information is provided by the host end, specifically: triggering the device connection function on the function page of the live broadcast room, and directly sending the live broadcast protocol information to the at least one terminal; among them, the host end and the at least one terminal are located in different cities, or the host end and the terminal are located in different areas of the same city; A synthesis module, configured to synthesize the game video stream and the camera video stream to obtain a target video stream; A sending module, configured to push the target video stream to the viewer end, so that the viewer end displays the game screen of the host end and the screen captured by the camera of the non-host user.

13. A game live broadcast device, characterized in that, It includes: An acquisition module, configured to acquire live broadcast protocol information, and the live broadcast protocol information is provided by the host end; Specifically: triggering the device connection function on the function page of the live broadcast room, and directly sending the live broadcast protocol information to at least one terminal; among them, the host end and the at least one terminal are located in different cities, or the host end and the terminal are located in different areas of the same city; An acquisition module, configured to read the preset parameters in the live broadcast protocol information according to the live broadcast protocol information, start the camera, and collect the camera video streams of other non-host users through the camera; A sending module, configured to send the camera video stream to the server, so that the server synthesizes the camera video stream and the game video stream of the host end, and pushes the synthesized target video stream to the viewer end, and synchronously broadcasts the game screen of the host end and the camera screen of the other non-host users on the viewer end.

14. A game live broadcast system, characterized in that, It includes a host end, a server, and at least one terminal; The host end is configured to provide live broadcast protocol information to at least one terminal, specifically: triggering the device connection function on the function page of the live broadcast room, and directly sending the live broadcast protocol information to the at least one terminal; Send the game video stream to the server; the live broadcast protocol information is used to instruct at least one terminal to start the terminal to read the preset parameters in the live broadcast protocol information, start the camera on the terminal to collect the video streams of other non-host users, and send the collected video streams to the server; among them, the host end and the at least one terminal are located in different cities, or the host end and the terminal are located in different areas of the same city; The terminal is configured to respond to a user operation instruction, obtain live broadcast protocol information, start the camera according to the live broadcast protocol information, collect a camera video stream through the camera, and send the camera video stream to the server; The server is configured to synthesize the game video stream and the camera video stream to obtain a target video stream, push the target video stream to the viewer end, and synchronously broadcast the game screen of the host end and the camera screen of the other non-host users on the viewer end.

15. An electronic device, characterized in that, It includes a processor and a memory, and the memory stores machine-executable instructions that can be executed by the processor. The processor can execute the machine-executable instructions to implement the method according to any one of claims 1-5, or implement the method according to any one of claims 6-8, or implement the method according to any one of claims 9-10.

16. A readable storage medium storing a computer program thereon, characterized in that, When the computer program is executed by a processor, it implements the method according to any one of claims 1-5, or implements the method according to any one of claims 6-8, or implements the method according to any one of claims 9-10.

Images