Processing method for game live broadcast and related devices

Abstract

The present invention provides a processing method for game live broadcast and related devices; applied to a user terminal device, the method includes: in response to an entry instruction for a target live broadcast room, displaying a controlled virtual character controlled by the host in the target live broadcast room in a first game live broadcast screen in the game scene of the target game; in response to a preset perspective connection operation, collecting device sensor data of the user terminal device and displaying a second game live broadcast screen corresponding to the device sensor data; the second game live broadcast screen is a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data. In this method, it is possible to display a perspective screen corresponding to the perspective changed based on the device sensor data on the user terminal device, so that the actions generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

Description

Technical Field

[0001] The present invention relates to the field of game technology, and in particular to a method for processing game live broadcast and related equipment. Background Art

[0002] With the advancement and acceleration of network technology and the development of virtual reality technology (VR), the live broadcast of VR games has been significantly developed and applied. Live broadcast interaction and participation are important touchpoints in the live broadcast process, and are an important medium for establishing connections between anchors and users to specific conversions.

[0003] However, in the current game live broadcast process, the live broadcast room plays the scene images seen by the virtual object controlled by the anchor in the game scene. For the audience, they can only passively watch the images and perform simple interactive operations such as sending barrages and sending gifts. This leads to weak interactivity between the audience and the anchor in the game live broadcast, and weak audience participation and immersion. Summary of the invention

[0004] In view of this, the purpose of the present invention is to provide a method and related equipment for processing game live broadcasts, which can display the corresponding perspective image after the perspective is transformed based on the device sensor data on the user-end device, so that the user's behavior in the live broadcast room can actively interact directly with the live broadcast content, thereby improving the interactivity between the audience and the anchor in the game live broadcast, as well as the audience's sense of participation and immersion.

[0005] In a first aspect, an embodiment of the present invention provides a method for processing game live broadcast, which is applied to a user-end device. The method for processing game live broadcast includes: responding to an entry instruction for a target live broadcast room, displaying a first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is: a perspective screen of a controlled virtual character controlled by a host end corresponding to the target live broadcast room in a game scene of a target game; in response to a preset perspective connection operation, collecting device sensor data of the user-end device, and displaying a second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is: a corresponding perspective screen after the perspective is changed based on the device sensor data.

[0006] In response to a preset perspective connection operation, collect device sensor data of the client device and display a second game live broadcast screen corresponding to the device sensor data; wherein, the step of the second game live broadcast screen being: a perspective screen corresponding to the perspective after being transformed based on the device sensor data includes: in response to a preset perspective connection operation, collect device sensor data generated in real time by rotating the client device and display a second game live broadcast screen corresponding to the perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live broadcast screen is: a perspective screen corresponding to the perspective after the controlled virtual character is transformed based on the perspective data, or a perspective screen corresponding to the game scene of the target game after being transformed based on the perspective data.

[0007] The above method further includes: in response to a display instruction for a perspective screen, display a perspective screen with a reduced host viewport on the display interface of the currently displayed game live broadcast screen.

[0008] The above method further includes: in response to a touch operation of a user on the interface, generate special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a slide operation; in response to a display instruction for the special effect data, display a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: a perspective screen corresponding to the perspective after the special effect data is displayed in the display manner of the special effect data.

[0009] The step of the above in response to a touch operation of a user on the interface and generating special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a slide operation includes: in response to a click operation, a touch operation, or a slide operation on a control of a special effect virtual item, generate special effect data corresponding to the special effect virtual item; in response to an information input operation or a click operation on an input box, generate corresponding text information to obtain special effect data.

[0010] The step of the above in response to a display instruction for the special effect data and displaying a third game live broadcast screen corresponding to the special effect data includes: in response to a display instruction for the special effect data, display a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: a perspective screen corresponding to the perspective after the special effect data is displayed in a displacement animation manner, or a perspective screen corresponding to the perspective after the special effect data is displayed in a perspective following manner, or a perspective screen corresponding to the perspective after the special effect data is displayed in a perspective non-following manner.

[0011] Second aspect, an embodiment of the present invention provides a method for processing game live broadcasts, which is applied to a host device. The method for processing game live broadcasts includes: running a target game and generating a game screen of the target game; wherein, the game screen is a screen generated at the current position of a controlled virtual character controlled by the host corresponding to a target live broadcast room in the game scene of the target game; in response to a live broadcast start instruction for the target game, collecting the game screen to generate a game live broadcast screen for the target game; sending the game live broadcast screen to a user device communicatively connected to the host device so that the user device displays the game live broadcast screen; in response to a perspective connection instruction sent by a target user device, obtaining perspective data of the target user device based on device sensor data, collecting a perspective screen corresponding to the perspective data through a virtual camera in the target game, and sending it to the target user device.

[0012] The above step of, in response to a perspective connection instruction sent by a target user device, obtaining perspective data of the target user device based on device sensor data, collecting a perspective screen corresponding to the perspective data through a virtual camera in the target game, and sending it to the target user device includes: in response to a perspective connection instruction sent by a target user device, obtaining perspective data of the target user device based on device sensor data, controlling the perspective change of the controlled virtual character based on the perspective data, generating a perspective screen corresponding to the perspective change, and collecting a perspective screen corresponding to the perspective data through a virtual camera in the target game, or, controlling the perspective change of the game scene of the target game based on the perspective data, generating a perspective screen corresponding to the perspective change, collecting the corresponding perspective screen through a virtual camera in the target game, and sending it to the target user device.

[0013] The above step of running a target game and generating a game screen of the target game includes: running a target game, obtaining the current position of a controlled virtual character controlled by the host corresponding to a target live broadcast room in the game scene of the target game; generating a game screen of the 360° panoramic space of the target game based on the current position.

[0014] The above method further includes: obtaining special effect data sent by the user device and the display method of the special effect data; displaying the special effect data on the current game screen of the 360° panoramic space in the display method of the special effect data, and collecting the corresponding perspective screen to obtain a third game live broadcast screen.

[0015] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display mode of the special effect data, and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display mode of the special effect data is the displacement animation display mode, collect the perspective screen of the game screen in the current 360° panoramic space, and display the special effect data on the collected perspective screen in the displacement animation display mode to obtain the third game live broadcast screen; If the display mode of the special effect data is the non-perspective-following display mode, generate the special effect data at a preset position on the game screen in the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display mode of the special effect data is the perspective-following display mode, generate the special effect data at a preset position on the display interface corresponding to the game screen in the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0016] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display mode of the special effect data, and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display mode of the special effect data is the displacement animation display mode, collect the perspective screen of the game screen in the current 360° panoramic space, and display the special effect data on the collected perspective screen in the displacement animation display mode and preset limitation conditions to obtain the third game live broadcast screen; If the display mode of the special effect data is the non-perspective-following display mode, generate the special effect data at a preset position on the game screen in the current 360° panoramic space with preset limitation conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display mode of the special effect data is the perspective-following display mode, generate the special effect data at a preset position on the display interface corresponding to the game screen in the current 360° panoramic space with preset limitation conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0017] After the steps of obtaining the special effect data sent by the client and the display mode of the special effect data, the following is also included: executing a corresponding prompt task; wherein, the prompt task is used to prompt the host device for receiving the special effect data in a sound effect or vibration prompt manner.

[0018] In a third aspect, an embodiment of the present invention provides a game live broadcast processing method, which is applied to a live broadcast platform server. The game live broadcast processing method includes: in response to a perspective connection instruction sent by a target client, collecting device sensor data of the target client, processing the device sensor data, obtaining perspective data corresponding to the processed device sensor data, and sending the perspective data to the host device.

[0019] The steps of processing the device sensor data and obtaining the perspective data corresponding to the processed device sensor data described above include: collecting the device sensor data of the user terminal device in real time, correcting the relative angle of the device sensor data of the user terminal device to obtain the corrected device sensor data; smoothing the values of the corrected device sensor data to obtain the processed device sensor data; obtaining the perspective data corresponding to the processed device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles.

[0020] The above method further includes: receiving the special effect data sent by the target user terminal, determining the special effect data based on the preset trigger device interaction rule and the preset trigger special effect rule to obtain a determination result; determining the display mode of the special effect data based on the determination result, and sending the special effect data and the display mode of the special effect data to the host terminal device.

[0021] The steps of determining the display mode of the special effect data based on the determination result and sending the special effect data and the display mode of the special effect data to the host terminal device described above include: if the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determining the display mode of the special effect data as a displacement animation mode, and sending the special effect data and the display mode of the special effect data to the host terminal device; if the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determining the display mode of the special effect data as a non-perspective-following display mode or a perspective-following mode, and sending the special effect data and the display mode of the special effect data to the host terminal device.

[0022] In a fourth aspect, an embodiment of the present invention provides a game live broadcast processing device, which is applied to a user terminal device. The game live broadcast processing device includes: a first display module, configured to respond to an entry instruction for a target live broadcast room and display a first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is: a perspective screen of a controlled virtual character controlled by a host terminal corresponding to the target live broadcast room in a game scene of a target game; a second display module, configured to collect device sensor data of the user terminal device in response to a preset perspective connection operation and display a second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is: a perspective screen corresponding after changing the perspective based on the device sensor data.

[0023] Fifth aspect, an embodiment of the present invention provides a processing device for game live broadcast, which is applied to the host device. The processing device for game live broadcast includes: a first generation module, configured to run a target game and generate a game screen of the target game; wherein, the game screen is a screen generated based on the current position of a controlled virtual character controlled by the host of the target live broadcast room in the game scene of the target game; a first acquisition module, configured to respond to a start broadcast instruction for the target game, acquire the game screen, and generate a game live broadcast screen for the target game; a first sending module, configured to send the game live broadcast screen to a user device communicatively connected to the host device, so that the user device displays the game live broadcast screen; a second sending module, configured to respond to a perspective connection instruction sent by a target user device, acquire perspective data of the target user device based on device sensor data, collect a perspective screen corresponding to the perspective data through a virtual camera in the target game, and send it to the target user device.

[0024] Sixth aspect, an embodiment of the present invention provides a processing device for game live broadcast, which is applied to a live broadcast platform server. The processing device for game live broadcast includes: a processing module, configured to respond to a perspective connection instruction sent by a target user device, collect device sensor data of the target user device, perform data processing on the device sensor data, acquire perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device.

[0025] Seventh aspect, an embodiment of the present invention provides a user device, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0026] Eighth aspect, an embodiment of the present invention provides a host device, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0027] Ninth aspect, an embodiment of the present invention provides a live broadcast platform server, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0028] Tenth aspect, an embodiment of the present invention provides a game live broadcast processing system. The game live broadcast processing includes a user device, a live broadcast platform server, and a host device;

[0029] The client device is configured to respond to an entry instruction for a target live streaming room and display a first game live streaming screen of the target live streaming room; wherein, the first game live streaming screen is a perspective screen of a controlled virtual character controlled by a host device corresponding to the target live streaming room in a game scene of a target game; in response to a preset perspective connection operation, collect device sensor data of the client device and display a second game live streaming screen corresponding to the device sensor data; wherein, the second game live streaming screen is a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data.

[0030] The host device is configured to run a target game and generate a game screen of the target game; wherein, the game screen is a screen generated based on the current position of a controlled virtual character controlled by a host device corresponding to the target live streaming room in a game scene of the target game; in response to a live broadcast start instruction for the target game, collect the game screen to generate a game live streaming screen for the target game; send the game live streaming screen to a client device communicatively connected to the host device, so that the client device displays the game live streaming screen; in response to a perspective connection instruction sent by a target client device, obtain perspective data of the target client device based on device sensor data, collect a perspective screen corresponding to the perspective data through a virtual camera in the target game, and send it to the target client device.

[0031] The live streaming platform server is configured to, in response to a perspective connection instruction sent by a target client device, collect device sensor data of the target client device, process the device sensor data, obtain perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device.

[0032] In a tenth aspect, an embodiment of the present invention provides a machine-readable storage medium storing machine-executable instructions, which, when called and executed by a processor, cause the processor to implement the above-mentioned game live streaming processing method.

[0033] The embodiments of the present invention bring the following beneficial effects:

[0034] The above-mentioned game live broadcast processing method and related devices are applied to a user device. In response to an entry instruction for a target live broadcast room, a first game live broadcast screen of the target live broadcast room is displayed; wherein, the first game live broadcast screen is a perspective screen of a controlled virtual character controlled by the host device corresponding to the target live broadcast room in the game scene of a target game; in response to a preset perspective connection operation, device sensor data of the user device is collected, and a second game live broadcast screen corresponding to the device sensor data is displayed; wherein, the second game live broadcast screen is a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data. In this method, it is possible to display on the user device a perspective screen of a controlled virtual character controlled by the host device corresponding to the target live broadcast room in the game scene of the target game or a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data, so that the actions generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0035] Other features and advantages of the present invention will be described in the following specification, and, in part, will be obvious from the specification, or will be understood by implementing the present invention. The objectives and other advantages of the present invention are realized and obtained by the structures specifically pointed out in the specification, claims, and drawings.

[0036] To make the above objectives, features, and advantages of the present invention more obvious and understandable, the following specific preferred embodiments are given and described in detail in conjunction with the accompanying drawings as follows. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the description of the specific embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative efforts.

[0038] Figure 1 Schematic diagram of an embodiment of the game live broadcast processing method provided by an embodiment of the present invention;

[0039] Figure 2 Schematic diagram of another embodiment of the game live broadcast processing method provided by an embodiment of the present invention;

[0040] Figure 3 Schematic diagram of an embodiment in which a user clicks on a VR connection icon to link to a game perspective;

[0041] Figure 4Schematic diagram of an embodiment provided by an embodiment of the present invention for displaying a perspective view of a reduced viewport of a host end on a set position on a display interface of a currently displayed game live broadcast screen;

[0042] Figure 5 Schematic diagram of an embodiment provided by an embodiment of the present invention for a display method in which the perspective does not follow;

[0043] Figure 6 Schematic diagram of an embodiment provided by an embodiment of the present invention for a display method in which the perspective follows;

[0044] Figure 7 Schematic diagram of a processing device for game live broadcast applied to a user end device provided by an embodiment of the present invention;

[0045] Figure 8 Schematic diagram of a processing device for game live broadcast applied to a host end device provided by an embodiment of the present invention;

[0046] Figure 9 Schematic diagram of a processing device for game live broadcast applied to a live broadcast platform server provided by an embodiment of the present invention;

[0047] Figure 10 Schematic diagram of a processing system for game live broadcast provided by an embodiment of the present invention;

[0048] Figure 11 Schematic diagram of a user end device provided by an embodiment of the present invention;

[0049] Figure 12 Schematic diagram of a host end device provided by an embodiment of the present invention;

[0050] Figure 13 Schematic diagram of a live broadcast platform server provided by an embodiment of the present invention. Detailed implementation manners

[0051] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0052] In the network live broadcast of VR games, usually only the host plays the game and gives explanations at the same time. The perspective screen seen by the virtual object controlled by the host in the game scene is played in the live broadcast room. For the audience, they can only passively watch the screen and perform simple interactive operations such as sending barrage and sending gifts. Moreover, in the current game live broadcast interaction process, the behaviors generated by the audience in the live broadcast room are difficult to directly interact with the live broadcast content, resulting in weak interactivity between the audience and the host in the game live broadcast, and weak sense of participation and immersion of the audience.

[0053] Based on the above, an embodiment of the present invention provides a processing method and related device for game live broadcast.

[0054] In one embodiment of the present invention, the processing method of game live broadcast can run on a terminal device or a server. Among them, the terminal device can be a local terminal device. When the processing method of game live broadcast runs on the server, the method can be implemented and executed based on a cloud interaction system, where the cloud interaction system includes a server and a client device.

[0055] In an optional real-time mode, various cloud applications can run under the cloud interaction system, such as cloud live broadcast. Taking cloud live broadcast as an example, cloud live broadcast refers to an enterprise live broadcast application system built based on leading content access, distribution network, and large-scale distributed real-time transcoding technology, providing convenient access, high-definition, smooth, low-latency, and high-concurrency audio and video live broadcast services. In the operation mode of cloud live broadcast, the running entity of the live broadcast program and the game screen presentation entity are separated. The storage and operation of the processing method of game live broadcast are completed on the cloud live broadcast server. The role of the client device is to receive, send data, and present the game screen. For example, the client device can be a display device with data transmission function near the user side, such as a mobile terminal, a television, a computer, a palm computer, etc.; however, the terminal device for information processing is the cloud live broadcast server in the cloud. When performing the processing operation of game live broadcast, the user operates the client device to send an operation instruction to the cloud live broadcast server. The cloud live broadcast server runs the game according to the operation instruction, encodes and compresses data such as the game screen, returns it to the client device through the network, and finally, the client device decodes and outputs the game screen.

[0056] In an optional embodiment, the terminal device may be a local terminal device. Taking game live streaming as an example, the local terminal device stores a game live streaming program and is used to present the live game screen. The local terminal device is used to interact with the host through a graphical user interface, that is, conventionally, the live streaming program is downloaded and installed on an electronic device and run. The ways for the local terminal device to provide the graphical user interface to the audience may include various methods. For example, it can be rendered and displayed on the display screen of the terminal, or provided to the audience through holographic projection. For example, the local terminal device may include a display screen and a processor. The display screen is used to present the graphical user interface, which includes the game live streaming screen. The processor is used to run the game, generate the graphical user interface, and control the display of the graphical user interface on the display screen.

[0057] In a possible embodiment, an embodiment of the present invention provides a processing method for game live streaming. Among them, the terminal device may be the aforementioned local terminal device or the client device in the aforementioned cloud interaction system.

[0058] See Figure 1 As shown in the schematic diagram of an embodiment of a processing method for game live streaming, the processing method for game live streaming includes the following steps:

[0059] Step S101: Run the target game and generate the game screen of the target game; wherein, the game screen is a screen generated at the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game;

[0060] Applied to the host side device. The host side device runs the target game and calls the virtual camera corresponding to the host side in the game scene of the target game to capture the game scene at the current position of the controlled virtual character controlled by the host side in the game scene of the target game, and generates the corresponding game screen. Among them, the target game may be a 2.5D game, a 3D game, or a VR game, which is not limited here.

[0061] It should be noted that there are at least two virtual cameras set in the target game on the host side. The at least two virtual cameras include the virtual camera corresponding to the host side and the virtual camera corresponding to the user side. The virtual cameras are in one-to-one correspondence with the host side and the user side, that is, one virtual camera corresponds to the host side and one virtual camera corresponds to one user side. For example, when the number of user sides connected to the target live broadcast room is one, the number of at least two virtual cameras is two. One of the virtual cameras is the virtual camera corresponding to the host side, and the other virtual camera is the virtual camera corresponding to the user side connected to the target live broadcast room.

[0062] Step S102: In response to the live broadcast instruction for the target game, collect the game screen to generate a game live broadcast screen for the target game;

[0063] Applied to the host device. The host device completes the live broadcast through the live broadcast function of the target game on the live broadcast platform, and the target game and the host device have open permissions to connect to the live broadcast platform server and are in the game live broadcast state. When the host device responds to the live broadcast instruction for the target game, it collects the game screen to generate a game live broadcast screen for the target game and displays the game screen through the corresponding display screen to generate a game live broadcast screen for the target game.

[0064] Step S103: Send the game live broadcast screen to the client device communicatively connected to the host device so that the client device can display the game live broadcast screen;

[0065] Applied to the host device. The host device sends the game live broadcast screen to the live broadcast platform server so that the live broadcast platform server can send the game live broadcast screen to the client device communicatively connected to the host device so that the client device can display the game live broadcast screen. The perspective of this game live broadcast screen is the perspective in the perspective screen of the controlled virtual character controlled by the host in the game scene of the target game, and this perspective can be the default perspective set by the host device.

[0066] Step S104: In response to the entry instruction for the target live broadcast room, play the first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is: the perspective screen of the controlled virtual character controlled by the host corresponding to the target live broadcast room in the game scene of the target game;

[0067] Applied to the client device. The client device obtains the perspective connection information and device connection information by responding to the touch operation on the connection icon (icon) of the target live broadcast room (target live broadcast room application), connects to the corresponding perspective based on the perspective connection information, and the live broadcast platform server detects the device connection information and connects to the corresponding device after the detection passes.

[0068] The client device triggers the entry instruction for the target live broadcast room through the icon touch operation of the target live broadcast room (target live broadcast room application). When responding to the entry instruction for the target live broadcast room, an additional camera capture screen is generated for the target game on the host side, that is, the first game live broadcast screen. The first game live broadcast screen is the perspective screen of the controlled virtual character controlled by the host corresponding to the target live broadcast room in the game scene of the target game. The first game live broadcast screen is sent to the client device through the live broadcast platform server, and the client device displays the first game live broadcast screen of the target live broadcast room on the display screen. Among them, the spatial information corresponding to the perspective of the first game live broadcast screen played by the client device is the same as the host default perspective.

[0069] Step S105, in response to a preset perspective connection operation, collect device sensor data of the client device and display a second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is: the perspective screen corresponding to the perspective after transformation based on the device sensor data.

[0070] Applied to the client device. When the user (viewer) corresponding to the client device rotates the perspective of the observed screen (i.e., the first game live broadcast screen), the client device responds to a preset perspective connection operation and collects the corresponding device sensor data. The device sensor data generated by the client device when the user corresponding to the client device rotates the perspective of the observed screen (i.e., the first game live broadcast screen). Among them, the sensor corresponding to the device sensor data is used to generate a change in perspective, which can be an angle sensor, an inclination sensor, a displacement sensor, etc., and is not limited here.

[0071] The client device sends the device sensor data to the live broadcast platform server. The live broadcast platform server processes the device sensor data and sends it to the target game corresponding to the host device. The screen in the target game changes in real time based on the perspective corresponding to the device sensor data, generating a corresponding second game live broadcast screen. The target game sends, through the live broadcast platform server, the perspective screen corresponding to the perspective data (the perspective corresponding to the device sensor data) collected by the virtual camera in the target game, that is, the second game live broadcast screen, to the client device. The client device receives the second game live broadcast screen sent through the live broadcast platform server and displays the second game live broadcast screen. The second game live broadcast screen is: the perspective screen corresponding to the perspective after transformation based on the device sensor data. Among them, the second game live broadcast screen can be the perspective screen corresponding to the transformation of the rotated perspective or the perspective screen corresponding to the transformation of the moved perspective. The rotated perspective is used to indicate the perspective after the controlled virtual character rotates, and the moved perspective is used to indicate the perspective after the scene position of the target game moves. The implementation means of the transformation of the moved perspective can be a sliding touch operation (for example, finger sliding on the screen) or a displacement touch operation (for example, displacement movement of the client device), etc., and is not limited here.

[0072] Among them, after the client device displays the second game live broadcast screen, the user (viewer) corresponding to the client device can rotate the client device to observe the current second game live broadcast screen at an angle conversion. It should be noted that the client device cannot control the actions of the controlled virtual character in the target game and game functions such as interactions with the target game. What the client device can operate is to watch and perform angle conversion on the perspective screen in the game scene corresponding to the target game.

[0073] Step S106, in response to the perspective connection instruction sent by the target client, collect the device sensor data of the target client, process the device sensor data, obtain the perspective data corresponding to the processed device sensor data, and send the perspective data to the host device;

[0074] Applied to the live streaming platform server. The live streaming platform server is used for data transfer and sending between the client device and the host device, performs corresponding data processing on the data between the client device and the host device, and conducts data interaction with the host.

[0075] When the client device, in response to the perspective connection instruction sent by the target client, collects the device sensor data of the target client, the live streaming platform server collects the device sensor data of the client device, performs corresponding data processing on the collected device sensor data of the client device, obtains the perspective data corresponding to the processed device sensor data, and sends the perspective data to the host device, so that the host device performs corresponding screen processing based on the perspective data.

[0076] Step S107, in response to the perspective connection instruction sent by the target client, obtain the perspective data of the target client based on the device sensor data, collect the perspective screen corresponding to the perspective data through the virtual camera in the target game, and send it to the target client.

[0077] Applied to the host device. The client device of the target client sends a perspective connection instruction to the host device through the live streaming platform server. When the host device receives the perspective connection instruction sent by the target client, in response to the perspective connection instruction sent by the target client, obtain the perspective data of the target client by receiving the perspective data of the target client based on the device sensor data sent by the live streaming platform server, where the perspective data can be the degrees of freedom of multiple rotation angles, for example, the X value, Y value, and Z value of the rotation axis.

[0078] After the host device obtains the perspective data of the target client, collect the perspective screen corresponding to the perspective data through the virtual camera in the target game, and send it to the target client, where the virtual camera is the virtual camera corresponding to the client successfully connected to the host, that is, the virtual camera corresponding to the client device corresponding to the device sensor data.

[0079] The above method for processing game live broadcasts is applied to a user device. In response to an entry instruction for a target live broadcast room, it displays a first game live broadcast screen of a controlled virtual character controlled by the host side in the game scene of a target VR game. In response to a preset perspective connection operation, it collects device sensor data of the user device and displays a second game live broadcast screen corresponding to the device sensor data. The second game live broadcast screen is a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data. In this method, it is possible to display a perspective screen corresponding to the perspective changed based on the device sensor data on the user device, so that the actions generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the audience's sense of participation and immersion.

[0080] The above method for processing game live broadcasts is applied to a host device. It runs a target game and generates a game screen of the target game. Among them, the game screen is a screen generated based on the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game. In response to a start broadcast instruction for the target game, it collects the game screen to generate a game live broadcast screen for the target game, and sends the game live broadcast screen to the user device communicatively connected to the host device, so that the user device can display the game live broadcast screen. In response to a perspective connection instruction sent by a target user device, it obtains the perspective data of the target user device based on the device sensor data, collects the perspective screen corresponding to the perspective data through a virtual camera in the target game, and sends it to the target user device. In this method, it is possible to collect the perspective screen corresponding to the perspective data through the virtual camera in the host device, so that the actions generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the audience's sense of participation and immersion.

[0081] The above method for processing game live broadcasts is applied to a live broadcast platform server. In response to a perspective connection instruction sent by a target user device, it collects the device sensor data of the target user device, processes the device sensor data, obtains the perspective data corresponding to the device sensor data after data processing, and sends the perspective data to the host device. In this method, through the live broadcast platform server to realize data transmission between the user device and the host device, it can make the actions generated by the user in the live broadcast room actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the audience's sense of participation and immersion.

[0082] See Figure 2 Another schematic diagram of an embodiment of a method for processing game live broadcasts as shown. The processing of this game live broadcast includes the following steps:

[0083] For the convenience of description and understanding, by way of example rather than limitation, the user-side device includes a user client and a user VR device. The user client can be a mobile terminal (e.g., a mobile phone), a television, a computer (e.g., a personal computer), a personal digital assistant, etc. The target game can be a 2.5D game, a 3D game, or a VR game. The host-side device includes a host client and a host VR device. The host client can be a mobile terminal (e.g., a mobile phone), a television, a computer (e.g., a personal computer), a personal digital assistant, etc. In the implementation of the present invention, the user client is a user's mobile phone, and the host client is a host's personal computer. The following takes the user client as the user's mobile phone, the host client as the host's personal computer, the target game as the target VR game, and the device sensor data as the gyroscope data as an example for illustration.

[0084] Step S201: Run the target game and generate a game screen of the target game; wherein, the game screen is a screen generated based on the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game.

[0085] Applied to the host-side device. The host-side device runs the target VR game and calls the virtual camera corresponding to the host side in the game scene of the target VR game to capture the game scene at the current position of the controlled virtual character controlled by the host side in the game scene of the target game, and generates a corresponding game screen.

[0086] Specifically, the step of running the target game and generating a game screen of the target game includes: running the target game, obtaining the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; generating a game screen of the 360° panoramic space of the target game based on the current position.

[0087] The host-side device runs the target VR game, obtains the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; generates a game screen of the 360° panoramic space of the target game based on the current position. By generating a game screen of the 360° panoramic space, the effect of the user side observing the target game in 360° panoramic view can be achieved, and the game immersion of the user is improved.

[0088] Step S202: Respond to the live broadcast instruction for the target game, collect the game screen, and generate a game live broadcast screen for the target game.

[0089] Applied to the host device. The host device completes the live broadcast through the live broadcast function of the target VR game on the live broadcast platform, and the target VR game and the host device (the host personal computer and the host VR device) have open permissions to connect to the live broadcast platform server and are in the game live broadcast state. When the host device responds to the live broadcast instruction for the target VR game, it captures the game screen through the camera on the host side to generate the game live broadcast screen for the target VR game, that is, the first game live broadcast screen, and displays the game live broadcast screen of the target VR game through the display screen corresponding to the host personal computer.

[0090] Step S203: Send the game live broadcast screen to the client device communicatively connected to the host device so that the client device can display the game live broadcast screen.

[0091] Applied to the host device. The host device sends the game live broadcast screen, that is, the first game live broadcast screen, to the live broadcast platform server so that the live broadcast platform server can send the first game live broadcast screen to the client device. The perspective of this game live broadcast screen is the perspective in the perspective screen of the controlled virtual character controlled by the host side in the game scene of the target VR game, which can be the default perspective set by the host device.

[0092] Step S204: Respond to the entry instruction for the target live broadcast room and display the first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is the perspective screen of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game.

[0093] Applied to the client device. The user's mobile phone responds to the touch operation on the VR connection icon icon of the target live broadcast room (the target live broadcast room application). By way of example and not limitation, as Figure 3 shown, the user clicks on the VR connection icon icon to link the game perspective, obtains the VR perspective connection information and the device connection information, connects to the corresponding VR perspective based on the VR perspective connection information, and the live broadcast platform server detects the device connection information. After the detection is passed, it connects to the corresponding device and determines whether the connection is successful. If the connection is successful, the client device can transmit the gyroscope data that the live broadcast platform server can recognize, and the target VR game on the host side can also access this data. For example, only receive the data between 0° and 360° of the XYZ rotation axes. Among them, the device can include the user VR device and / or the host device.

[0094] The user's mobile phone triggers an entry instruction for the target live broadcast room through a touch operation on the icon of the target live broadcast room (the target live broadcast room application). When responding to the entry instruction for the target live broadcast room, the target VR game on the host side generates an additional camera capture screen, that is, the first game live broadcast screen. The first game live broadcast screen is the perspective screen of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target VR game. The first game live broadcast screen is sent to the user client and the user VR device through the live broadcast platform server. The user's mobile phone and the user VR device display the first game live broadcast screen of the target live broadcast room on the display screen. Among them, the spatial information of the first game live broadcast screen displayed by the user's mobile phone and the user VR device is the same as that of the host's default perspective.

[0095] It should be noted that the first scene screen can be a 360° panoramic space scene screen. After successful connection, no matter what angle the user's mobile phone or the user VR device is, the displayed screen will be in the middle of the 360° panoramic view, and the rotation value (i.e., the corresponding perspective data) is (0, 0, 0). Therefore, as long as any user's client device has the same data (rotation value), the corresponding observed screen (the first game live broadcast screen) is the same.

[0096] Specifically, in response to the display instruction for the perspective screen, a perspective screen after the host side viewport is reduced is displayed on the display interface of the currently displayed game live broadcast screen.

[0097] Among them, the above-mentioned currently displayed game live broadcast screen is the user perspective screen. The currently displayed game live broadcast screen can be understood as the first game live broadcast screen or the second game live broadcast screen or other game live broadcast screens displayed on the user client and / or the user VR device. In addition to displaying the currently displayed game live broadcast screen on the display interface of the user client and / or the user VR device, a perspective screen after the host side viewport is reduced is also displayed. This facilitates the switching between the user perspective screen and the host perspective screen on the user side, as well as the simultaneous viewing of the user perspective screen and the host perspective screen, improving the convenience of viewing the screen.

[0098] In a feasible implementation manner, in response to the display instruction for the perspective screen, a perspective screen after the host side viewport is reduced is displayed at a set position on the display interface of the currently displayed game live broadcast screen. For the beauty and convenience of viewing the perspective screen, by way of example rather than limitation, the set position in this embodiment is preferably the lower left corner of the display interface of the currently displayed game live broadcast screen. By way of example rather than limitation, as Figure 4 shown, Figure 4 the user perspective screen in is the currently displayed game live broadcast screen, and the host perspective screen is the perspective screen after the host side viewport is reduced. This is convenient for observing multiple screens.

[0099] Step S205: In response to a preset perspective connection operation, collect the device sensor data generated in real time by rotating the user device, and display a second game live broadcast screen corresponding to the perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live broadcast screen is: the perspective screen corresponding to the controlled virtual character after changing the perspective based on the perspective data, or the perspective screen corresponding to the game scene of the target game after changing the perspective based on the perspective data;

[0100] Applied to the user device. The user can observe the in-game screen of the target VR game by rotating the user's mobile phone or the user's VR device. After the user's mobile phone successfully connects to the corresponding user VR device and / or the host device, the user's mobile phone and the user's VR device are monitored in real time. When the user's mobile phone or the user's VR device detects being rotated or moved, the gyroscope data (i.e., device sensor data) generated when the user's mobile phone or the user's VR device is rotated or moved is collected in real time, and the gyroscope data is sent to the live broadcast platform server. The live broadcast platform server processes the gyroscope data to obtain the corresponding perspective data, and obtains the perspective screen corresponding to the perspective data collected by the virtual camera in the target game sent by the host device through the live broadcast platform server, that is, the second game live broadcast screen, and displays the second game live broadcast screen on the user's VR device and / or the user's mobile phone. By playing the second game live broadcast scene screen corresponding to the perspective data generated based on the device sensor gyroscope data, it realizes the user's rotation angle or movement angle to observe the target game, and realizes the viewing of game live broadcast screens with various perspective transformations.

[0101] Among them, the perspective screen corresponding to the controlled virtual character after changing the perspective based on the perspective data can be understood as the perspective screen after rotating the perspective, that is, the surrounding scene screen of the controlled virtual character in the target game after rotation. The perspective screen corresponding to the game scene of the target game after changing the perspective based on the perspective data includes the perspective screen corresponding to the controlled virtual character, which can be understood as the perspective screen after moving the perspective, and can be understood as the screen of other scenes except the surrounding scene screen of the controlled virtual character in the target game after rotation.

[0102] The perspective screen generally refers to the game screen presented on the device screen; specifically, it is to shoot the game scene through a virtual camera set in the game scene, and the game scene content within the shooting range is the game screen presented on the screen. Further, there are two types of situations for the setting position of the virtual camera: One is: set behind and above the head of the game character (controlled virtual), shooting forward (the virtual camera can pan and rotate); the other is set above the head of the game character or at the eye position, shooting forward (the virtual camera can pan and rotate).

[0103] It should be noted that after successful connection, no matter what angle the user's mobile phone or the user's VR device is at, the displayed picture will be in the center of the 360-degree panoramic view, and the rotation value (i.e., the corresponding viewing angle data) will be (0, 0, 0). Therefore, as long as the client devices corresponding to any user have the same data (viewing angle data), the pictures (the second game live broadcast pictures) observed will be the same.

[0104] Step S206: In response to the viewing angle connection instruction sent by the target client device, collect the device sensor data of the target client device, process the device sensor data, obtain the viewing angle data corresponding to the processed device sensor data, and send the viewing angle data to the host device.

[0105] Applied to the live broadcast platform server. Specifically, the live broadcast platform server collects the device sensor data of the client device in real time, performs relative angle correction on the device sensor data of the client device to obtain the corrected device sensor data; performs numerical smoothing on the corrected device sensor data to obtain the processed device sensor data; obtains the viewing angle data corresponding to the processed device sensor data; among them, the viewing angle data includes degrees of freedom of multiple rotation angles. Through relative angle correction, the authenticity of the experience is improved; through numerical smoothing, the accuracy and stability of the processed device sensor data are improved.

[0106] The live broadcast platform server collects the gyroscope data (i.e., the device sensor data) of the client device (the user's mobile phone or the user's VR device) in real time. The live broadcast platform server performs relative angle correction of the game space on the gyroscope data of the client device according to the gyroscope space. For example, if the user's mobile phone or the user's VR device is rotated 30° in the real space, the game space in the target VR game will be rotated 360° based on the gyroscope data of the client device, so as to obtain the corrected gyroscope data to improve the authenticity of the experience of the 360-degree panoramic space scene picture. It should be noted that the rotation angles of the client device and the game are in one-to-one correspondence, and it is also for a more real experience, that is, through relative angle correction, the authenticity of the experience is improved.

[0107] The live broadcast platform server performs numerical smoothing on the corrected gyroscope data through a preset numerical smoothing algorithm to obtain the processed device sensor data. The preset numerical smoothing algorithm can be a moving window least squares polynomial smoothing algorithm, a roughness penalty algorithm, a kernel algorithm, a moving average algorithm, an exponential moving average algorithm, or an SG (Savitzky Golay) filtering algorithm, etc., which is not limited here. Through numerical smoothing, the accuracy and stability of the processed device sensor data are improved.

[0108] After the live streaming platform server obtains the device sensor data after data processing, it acquires the perspective data corresponding to the device sensor data after data processing. After the live streaming platform server obtains the device sensor data after data processing, it acquires the perspective data corresponding to the device sensor data after data processing, and sends the perspective data to the host device. Among them, the perspective data can be the game space angle corresponding to the gyroscope data after data processing, and the rotation value of the corresponding rotation axis. The perspective data can be the degrees of freedom of multiple rotation angles (for example, the degrees of freedom of 3 free rotation angles 3dof; the degrees of freedom of 6 free rotation angles 6dof, in addition to including 3dof, 6dof also includes 3 degrees of freedom related to position (up and down, left and right, front and back)), that is, the rotation value corresponding to the rotation axis. By way of example and not limitation, the degrees of freedom of multiple rotation angles in the embodiments of the present invention are preferably the degrees of freedom of 3 free rotation angles, for example, (20, 10, 30).

[0109] Step S207, in response to the perspective connection instruction sent by the target user device, acquire the perspective data of the target user device based on the device sensor data, collect the perspective image corresponding to the perspective data through the virtual camera in the target game, and send it to the target user device;

[0110] Applied to the host device. The host device responds to the perspective connection instruction sent by the target user device to receive the perspective data sent by the live streaming platform server. Collect the perspective image corresponding to the perspective data through the virtual camera in the target VR game of the host device, that is, the second game scene image, and send it to the user mobile phone and / or the user VR device (i.e., the target user device).

[0111] Specifically, in response to the perspective connection instruction sent by the target user device, acquire the perspective data of the target user device based on the device sensor data, control the perspective change of the controlled virtual character based on the perspective data, generate the perspective image corresponding to the perspective change, and collect the perspective image corresponding to the perspective data through the virtual camera in the target game, or control the perspective change of the game scene of the target game based on the perspective data, generate the perspective image corresponding to the perspective change, collect the corresponding perspective image through the virtual camera in the target game, and send it to the target user device.

[0112] Among them, after the controlled virtual character changes its perspective based on the perspective data, the corresponding perspective screen can be understood as the perspective screen after rotating the perspective, that is, the scene screen around the controlled virtual character after rotation in the target game. After the game scene of the target game changes its perspective based on the perspective data, the corresponding perspective screen includes the perspective screen corresponding to the controlled virtual character, which can be understood as the perspective screen after moving the perspective, and can be understood as the screen of other scenes except the scene screen around the controlled virtual character after rotation in the target game. Through the perspective changes of the rotation angle and the movement angle, a variety of perspective-transformed game live broadcast screens are realized for the user side to watch.

[0113] Step S208, in response to a touch operation of the user on the interface, generate special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a swipe operation;

[0114] It is applied to the user-side device. Specifically, the user-side device generates special effect data corresponding to the special effect virtual item in response to a click operation, a touch operation, or a swipe operation on the control of the special effect virtual item; and generates corresponding text information in response to an information input operation or a click operation on the input box to obtain special effect data.

[0115] When the user (audience) corresponding to the user side watches the displayed first game live broadcast screen or the second game live broadcast screen, and performs a touch operation such as a click operation, a touch operation, an information input operation, and a swipe operation on the user's mobile phone, the user-side device responds to the touch operation of the user on the interface, and the user's mobile phone generates special effect data.

[0116] Among them, the click operation may include, but is not limited to, click operations on controls, icons, and text characters, etc.; the touch operation may include, but is not limited to, touch operations on controls, icons, and text characters, etc.; the information input operation may include, but is not limited to, operations of inputting information into the input box and click operations on text characters; the swipe operation may include swipe operations on controls, icons, and text characters, etc. By way of example and not limitation, the above click operation may be clicking on an icon (or button) on the interface, and the information input operation may be inputting interactive information in the corresponding input box, which is not limited here.

[0117] The above special effect data may include barrage data and / or gift data during the live broadcast. The special effect virtual item can be understood as a gift sent in the live broadcast room, and the text information can be understood as barrage information or comment information sent in the live broadcast room. The user's mobile phone and / or the user's VR device send the special effect data to the live broadcast platform server.

[0118] Step S209, receive the special effect data sent by the target user side, and make a determination on the special effect data based on the preset trigger device interaction rules and the preset trigger special effect rules to obtain a determination result;

[0119] Applied to the live streaming platform server. Among them, the above-mentioned preset trigger device interaction rule is a preset trigger VR device interaction rule, and the device connection information of the client device is marked in the special effect data. The preset trigger VR device interaction rule is used to determine whether the client device is a VR device or a device that can provide gyroscope data, that is, the live streaming platform server can determine whether the client device corresponding to the device connection information for sending bullet screen data and / or gift data in the special effect data is a successfully connected VR client device, so as to perform the determination operation of the special effect data based on the preset trigger VR device interaction rule. If so, it is determined that the special effect data conforms to the preset trigger VR device interaction rule; if not, it is determined that the special effect data does not conform to the preset trigger VR device interaction rule, thereby obtaining the corresponding determination result;

[0120] The above-mentioned preset trigger special effect rule is used to determine whether the special effect data of the client device can be displayed in the form of special effects on the user's VR device or the host's VR device.

[0121] The operation sequence of determining the special effect data based on the preset trigger VR device interaction rule and the preset trigger special effect rule is not limited here. By way of example and not limitation, preferably, the operation sequence in the embodiments of the present invention is to first perform the determination of the preset trigger VR device interaction rule, and then perform the determination of the preset trigger special effect rule.

[0122] Step S210, determine the display mode of the special effect data based on the determination result, and send the special effect data and the display mode of the special effect data to the host device;

[0123] By displaying the corresponding perspective screen based on the determination between the special effect data and the trigger device interaction rule and the preset trigger special effect rule, the perspective screen can be displayed in a multifunctional and targeted manner.

[0124] Applied to the live streaming platform server. Specifically, the step of the live streaming platform server determining the display mode of the special effect data based on the determination result and sending the special effect data and the display mode of the special effect data to the host device includes: if the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determine the display mode of the special effect data as the way of displacement animation, and send the special effect data and the display mode of the special effect data to the host device; if the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determine the display mode of the special effect data as the display mode of non-following perspective or the way of following perspective, and send the special effect data and the display mode of the special effect data to the host device.

[0125] If the determination result is used to indicate that the special effect data does not conform to the preset VR device interaction rules, or the special effect data conforms to the preset VR device interaction rules but does not conform to the preset special effect rules, then determine the display mode of the special effect data as the displacement animation mode, that is, it can be understood that the special effect data is displayed in the normal display form of the bullet screen, and the special effect data is normally displayed on the live public screen.

[0126] Specific copywriting of special effect data (bullet screen data, gift data) is preset in advance, that is, which special effect data (bullet screen data, gift data) are preset as special effect data of the non-visual movement following type (viewpoint not following), that is, which special effect data (bullet screen data, gift data) conform to the special effect data that triggers the non-visual movement following condition, and which special effect data (bullet screen data, gift data) are of the visual movement following type (viewpoint following), that is, which special effect data (bullet screen data, gift data) conform to the special effect data that triggers the visual movement following condition. If the live platform server detects that the special effect data sent by the user device is special effect data of the non-visual movement following type, then determine the display mode of the special effect data as the display mode with the viewpoint not following. If the live platform server detects that the special effect data sent by the user device is special effect data of the visual movement following type, then the display mode of the special effect data is the display mode with the viewpoint following.

[0127] Furthermore, the above-mentioned preset special effect rules are used to determine whether the special effect data is special effect data that conforms to the condition of triggering non-visual movement following. Specifically, it is achieved by the live platform server making a determination on whether the special effect data conforms to the preset special effect rules. For example, the "treasure chest" bullet screen is special effect data that triggers the non-visual movement following condition. When the live platform server detects that the bullet screen data in the special effect data is the "treasure chest" bullet screen, it determines that the special effect data conforms to the preset special effect rules and determines the display mode of the special effect data as the display mode with the viewpoint not following. Among them, "non-visual movement following" can be understood as generating special effect data at the position observed by the user in the scene picture of the 360-degree panoramic space (that is, the position corresponding to the viewpoint data of the user device in the scene picture). When the anchor moves the viewpoint to this position, the special effect data can be observed.

[0128] Step S211, obtain the special effect data sent by the user device and the display mode of the special effect data;

[0129] Applied to the anchor device. The anchor device receives the special effect data sent by the user device through the live platform server, with the display mode of the special effect data determined by the live platform server based on the special effect data sent by the user device.

[0130] Step S212, display the special effect data on the game picture of the current 360° panoramic space in the display mode of the special effect data, and collect the corresponding viewpoint picture to obtain the third game live picture;

[0131] By displaying the special effect data on the game screen of the current 360° panoramic space through various display methods based on the special effect data, it is realized that while the user observes the game panoramically at 360°, the corresponding special effect data can be displayed on the game live broadcast screen in a multifunctional and targeted manner, improving efficiency and reducing the computing burden, enhancing the interactivity between the audience and the anchor, as well as the audience's sense of participation and immersion, and enabling the display of the special effect data of the game screen on the anchor side.

[0132] Applied to the anchor device. Specifically, if the display method of the special effect data is the display method of displacement animation, the perspective screen of the game screen in the current 360° panoramic space is collected, and the special effect data is displayed on the collected perspective screen in the display method of displacement animation to obtain the third game live broadcast screen; if the display method of the special effect data is the display method of non-perspective following, the special effect data is generated at a preset position on the game screen in the current 360° panoramic space, and the perspective screen after generating the special effect data is collected to obtain the third game live broadcast screen; if the display method of the special effect data is the display method of perspective following, the special effect data is generated at a preset position on the display interface corresponding to the game screen in the current 360° panoramic space, and the perspective screen after generating the special effect data is collected to obtain the third game live broadcast screen.

[0133] It can play and display the game live broadcast screen with special effect data in a multifunctional and targeted manner, improving efficiency and reducing the computing burden, enhancing the interactivity between the audience and the anchor, as well as the audience's sense of participation and immersion.

[0134] By way of example and not limitation, the display positions of the bullet screen data and gift data (special effect data) in the third game live broadcast screen are at the center of the screen under the position determined by the spatial rotation data.

[0135] The above-mentioned display of the special effect data on the collected perspective screen in the display method of displacement animation can be understood as that when the target live broadcast room is live, the bullet screen data and / or gift data are normally displayed on the live public screen, and the display forms of the bullet screen data and / or gift data on the live public screen are the same as the existing display forms of the bullet screen and gifts on the live public screen.

[0136] The above-mentioned non-perspective following can be understood as that the special effect data is fixedly generated at a preset position on the game screen in the current 360° panoramic space based on the user's perspective data and will not change due to the change of the user's perspective. As Figure 5 shown, Figure 5The content corresponding to the bullet screen data in it is "Anchor, look at this ()", the gift data corresponds to the gift screen, the bullet screen and the gift screen are fixed at the preset position (the exact center of the game screen), and the black dot is used as a reference object for the perspective change corresponding to the game screen. From the left picture to the right picture, it means that the perspective of the game screen changes as the user's perspective changes.

[0137] The above perspective following can be understood as that the special effect data changes due to the change of the user's perspective. As Figure 6 shown, Figure 6 The content corresponding to the bullet screen data in it is "Anchor, look at this ()", the gift data corresponds to the gift screen. From the left picture to the right picture, it means that the perspective of the controlled virtual character is changed based on the perspective data, and the bullet screen data and the gift data follow the perspective movement.

[0138] The above preset position can be the central position, that is, the exact center position of the game screen in the current 360° panoramic space, and the exact center position of the display interface corresponding to the game screen in the current 360° panoramic space.

[0139] In a feasible implementation manner, the steps of displaying the special effect data on the game screen in the current 360° panoramic space in the display manner of the special effect data and collecting the corresponding perspective screen to obtain the third game live broadcast screen further include: if the display manner of the special effect data is the display manner of the displacement animation, collect the perspective screen of the game screen in the current 360° panoramic space, and display the special effect data on the collected perspective screen in the display manner of the displacement animation and the preset limitation conditions to obtain the third game live broadcast screen; if the display manner of the special effect data is the display manner of non-perspective following, generate the special effect data at the preset position in the game screen in the current 360° panoramic space with the preset limitation conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; if the display manner of the special effect data is the display manner of perspective following, generate the special effect data at the preset position on the display interface corresponding to the game screen in the current 360° panoramic space with the preset limitation conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0140] The above preset limitation conditions are used to limit the quantity of special effect data displayed to prevent the influence of a large amount of special effect data on the picture display. The above preset limitation conditions can be sequence data screening and / or panoramic space area division. The above preset limitation conditions can also be other set conditions for limiting the display of special effect data, which are not limited herein. By way of example and not limitation, when the preset limitation condition is sequence data screening, the implementation manner of sequence data screening is as follows: Sort the special effect data based on the release time sequence or other set conditions to obtain a special effect data sequence, and extract target special effect data from the special effect data sequence according to the preset display quantity. Generate the target special effect data at a preset position based on the perspective data in the current 360° panoramic space game picture, so as to obtain a third game live broadcast picture.

[0141] By way of example and not limitation, when the preset limitation condition is panoramic space area division, the implementation manner of panoramic space area division is as follows: Divide the game picture of the current 360° panoramic space of the target VR game to obtain the divided areas, and match the display density corresponding to the divided areas. Screen and classify the special effect data according to the divided areas and the display density corresponding to the divided areas to obtain the special effect data classified by area. Generate the special effect data at a preset position based on the perspective data in the divided areas, so as to obtain a third game live broadcast picture.

[0142] By way of example and not limitation, when the preset limitation conditions are sequence data screening and panoramic space area division, the implementation manners of sequence data screening and panoramic space area division are as follows: Sort the special effect data based on the release time sequence or other set conditions to obtain a special effect data sequence, and extract target special effect data from the special effect data sequence according to the preset display quantity. Divide the game picture of the current 360° panoramic space of the target VR game to obtain the divided areas, and match the display density corresponding to the divided areas. Screen and classify the target special effect data according to the divided areas and the display density corresponding to the divided areas to obtain the special effect data classified by area. Generate the special effect data at a preset position based on the perspective data in the divided areas, so as to obtain a third game live broadcast picture.

[0143] It should be noted that the host client on the host side can set the display conditions of the special effect data, that is, the preset limitation conditions.

[0144] Through the display modes of displacement animation, non-following perspective and following perspective, and the preset limitation conditions, the quantity of special effect data displayed can be limited to prevent the influence of a large amount of special effect data on the picture display, prompt the special effect data timely and effectively, enhance the beauty of the scene picture, improve the viewing convenience of the scene picture, improve the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0145] In a feasible implementation manner, after the step of obtaining the special effect data sent by the client and the display mode of the special effect data, the following steps are further included: performing a corresponding prompting task; wherein, the prompting task is used to prompt the host device to receive the special effect data in a sound effect or vibration prompting manner.

[0146] The host VR device can prompt the host with functions such as sound effects and vibrations for the special effect data. The special effect data prompting on the host side and the content feedback of the interaction between the host side and the game are realized.

[0147] Step S213, for the display instruction of the special effect data, display the third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: the perspective screen after displaying the special effect data in the display mode of the special effect data.

[0148] Applied to the client device, specifically, for the display instruction of the special effect data, display the third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: the perspective screen after displaying the special effect data in the form of a displacement animation, or the perspective screen after displaying the special effect data in the form of perspective following, or the perspective screen after displaying the special effect data in the form of non-perspective following.

[0149] Through various display modes based on the special effect data, the corresponding special effect data can be displayed on the game live broadcast screen in a multi-functional and targeted manner, improving efficiency and reducing the computing burden, enhancing the interactivity between the audience and the host, as well as the sense of participation and immersion of the audience.

[0150] The above-mentioned game live broadcast processing method is applied to a user terminal device. In response to an entry instruction for a target live broadcast room, it displays a first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is a perspective screen of a controlled virtual character controlled by the host terminal corresponding to the target live broadcast room in the game scene of the target game; in response to a preset perspective connection operation, it collects device sensor data generated in real time by rotating the user terminal device and displays a second game live broadcast screen corresponding to the perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live broadcast screen is a perspective screen corresponding to the controlled virtual character after changing the perspective based on the perspective data, or a perspective screen corresponding to the game scene of the target game after changing the perspective based on the perspective data; in response to a touch operation of the user on the interface, it generates special effect data; wherein, the touch operation includes click operation, touch operation, information input operation and sliding operation; in response to a display instruction for the special effect data, it displays a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is a perspective screen after displaying the special effect data in the display manner of the special effect data. In this method, it is possible to display a perspective screen corresponding to the perspective changed based on the device sensor data and special effect data on the user terminal device, so that the behaviors generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0151] The above-mentioned game live broadcast processing method is applied to a host terminal device. It runs the target game and generates a game screen of the target game; wherein, the game screen is a screen generated based on the current position of a controlled virtual character controlled by the host terminal corresponding to the target live broadcast room in the game scene of the target game; in response to a live broadcast start instruction for the target game, it collects the game screen to generate a game live broadcast screen for the target game; it sends the game live broadcast screen to a user terminal communicatively connected to the host terminal device for the user terminal to display the game live broadcast screen; in response to a perspective connection instruction sent by a target user terminal, it obtains the perspective data of the target user terminal based on the device sensor data, collects the perspective screen corresponding to the perspective data through a virtual camera in the target game, and sends it to the target user terminal; it obtains the special effect data sent by the user terminal and the display manner of the special effect data; it displays the special effect data on the game screen of the current 360° panoramic space in the display manner of the special effect data, and collects the corresponding perspective screen to obtain a third game live broadcast screen. In this method, it is possible to collect the perspective screen corresponding to the perspective data and special effect data through a virtual camera in the host terminal device, so that the behaviors generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0152] The above method for processing game live broadcasts is applied to a live broadcast platform server. In response to a perspective connection instruction sent by a target user device, it collects the device sensor data of the target user device, processes the device sensor data, obtains the perspective data corresponding to the processed device sensor data, and sends the perspective data to the host device. It receives the special effect data sent by the target user device, determines the special effect data based on a preset trigger device interaction rule and a preset trigger special effect rule to obtain a determination result, determines the display method of the special effect data based on the determination result, and sends the special effect data and the display method of the special effect data to the host device. In this method, the data transmission between the user device and the host device is realized through the live broadcast platform server, enabling the actions generated by the user in the live broadcast room to directly interact with the live broadcast content actively, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0153] Corresponding to the above method embodiment, applied to the user device, refer to Figure 7 the schematic diagram of a processing device for game live broadcasts shown in

[0154] The first display module 701 is used to respond to an entry instruction for a target live broadcast room and display the first game live broadcast screen of the target live broadcast room; wherein, the first game live broadcast screen is: the perspective screen of the controlled virtual character controlled by the host of the target live broadcast room in the game scene of the target game. The second display module 702 is used to respond to a preset perspective connection operation, collect the device sensor data of the user device, and display the second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is: the perspective screen corresponding after the perspective is changed based on the device sensor data.

[0155] The above processing device for game live broadcasts is applied to the user device. It responds to an entry instruction for a target live broadcast room and displays the first game live broadcast screen of the controlled virtual character controlled by the host corresponding to the target live broadcast room in the game scene of the target VR game. It responds to a preset perspective connection operation, collects the device sensor data of the user device, and displays the second game live broadcast screen corresponding to the device sensor data; the second game live broadcast screen is the perspective screen corresponding after the perspective is changed based on the device sensor data. In this method, it can display the perspective screen corresponding after the perspective is changed based on the device sensor data on the user device, enabling the actions generated by the user in the live broadcast room to directly interact with the live broadcast content actively, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0156] The second display module 702 is further configured to: in response to a preset perspective connection operation, collect device sensor data generated in real time by rotating the user terminal device, and display a second game live broadcast screen corresponding to perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live broadcast screen is: the perspective screen corresponding to the controlled virtual character after changing the perspective based on the perspective data, or the perspective screen corresponding to the game scene of the target game after changing the perspective based on the perspective data.

[0157] The above game live broadcast processing device further includes: a third display module 703, configured to, in response to a display instruction for the perspective screen, display a reduced perspective screen of the host end viewport on the display interface of the currently displayed game live broadcast screen.

[0158] The above game live broadcast processing device further includes: a second generation module 704, configured to generate special effect data in response to a touch operation of a user on the interface; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a swipe operation; a fourth display module 705, configured to, in response to a display instruction for the special effect data, display a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: the perspective screen corresponding to the special effect data after being displayed in the display mode of the special effect data.

[0159] The second generation module 704 is further configured to: in response to a click operation, a touch operation, or a swipe operation on a control of a special effect virtual item, generate special effect data corresponding to the special effect virtual item; in response to an information input operation or a click operation on an input box, generate corresponding text information to obtain special effect data.

[0160] The fourth display module 705 is further configured to: in response to a display instruction for the special effect data, display a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: the perspective screen corresponding to the special effect data after being displayed in a displacement animation mode, or the perspective screen corresponding to the special effect data after being displayed in a perspective following mode, or the perspective screen corresponding to the special effect data after being displayed in a perspective non-following mode.

[0161] Corresponding to the above method embodiment, applied to the host device, refer to Figure 8 the schematic diagram of a game live broadcast processing device shown in

[0162] The first generation module 801 is used to run the target game and generate the game screen of the target game; wherein, the game screen is: a screen generated at the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; the acquisition module 802 is used to respond to the live broadcast instruction for the target game, acquire the game screen and generate the game live broadcast screen for the target game; the first sending module 803 is used to send the game live broadcast screen to the client device communicatively connected to the host side device, so that the client device can display the game live broadcast screen; the second sending module 804 is used to respond to the perspective connection instruction sent by the target client device, obtain the perspective data of the target client device based on the device sensor data, acquire the perspective screen corresponding to the perspective data through the virtual camera in the target game, and send it to the target client device.

[0163] The above game live broadcast processing device is applied to the host side device, runs the target game, and generates the game screen of the target game; wherein, the game screen is: a screen generated at the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; responds to the live broadcast instruction for the target game, acquires the game screen and generates the game live broadcast screen for the target game; sends the game live broadcast screen to the client device communicatively connected to the host side device, so that the client device can display the game live broadcast screen; responds to the perspective connection instruction sent by the target client device, obtains the perspective data of the target client device based on the device sensor data, acquires the perspective screen corresponding to the perspective data through the virtual camera in the target game, and sends it to the target client device. In this method, the perspective screen corresponding to the perspective data can be acquired through the virtual camera in the target game on the host side device, so that the behavior generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0164] The second sending module 804 is further used to: respond to the perspective connection instruction sent by the target client device, obtain the perspective data of the target client device based on the device sensor data, control the perspective change of the controlled virtual character based on the perspective data, generate the perspective screen corresponding to the perspective change, and acquire the perspective screen corresponding to the perspective data through the virtual camera in the target game, or, control the perspective change of the game scene of the target game based on the perspective data, generate the perspective screen corresponding to the perspective change, acquire the corresponding perspective screen through the virtual camera in the target game, and send it to the target client device.

[0165] The first generation module 801 is further used to: run the target game, obtain the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; generate the game screen of the 360° panoramic space of the target game based on the current position.

[0166] The processing device for the above game live broadcast further includes: an acquisition module 805, configured to acquire the special effect data sent by the user terminal and the display mode of the special effect data; a second acquisition module 806, configured to display the special effect data on the game screen of the current 360° panoramic space in the display mode of the special effect data, and acquire the corresponding perspective screen to obtain a third game live broadcast screen.

[0167] The second acquisition module 806 is further configured to: if the display mode of the special effect data is the display mode of displacement animation, acquire the perspective screen of the game screen of the current 360° panoramic space, and display the special effect data on the acquired perspective screen in the display mode of displacement animation to obtain a third game live broadcast screen; if the display mode of the special effect data is the display mode of non-perspective following, generate the special effect data at a preset position on the game screen of the current 360° panoramic space, and acquire the perspective screen after generating the special effect data to obtain a third game live broadcast screen; if the display mode of the special effect data is the display mode of perspective following, generate the special effect data at a preset position on the display interface corresponding to the game screen of the current 360° panoramic space, and acquire the perspective screen after generating the special effect data to obtain a third game live broadcast screen.

[0168] The second acquisition module 806 is further configured to: if the display mode of the special effect data is the display mode of displacement animation, acquire the perspective screen of the game screen of the current 360° panoramic space, and display the special effect data on the acquired perspective screen in the display mode of displacement animation and with preset limiting conditions to obtain a third game live broadcast screen; if the display mode of the special effect data is the display mode of non-perspective following, generate the special effect data at a preset position on the game screen of the current 360° panoramic space with preset limiting conditions, and acquire the perspective screen after generating the special effect data to obtain a third game live broadcast screen; if the display mode of the special effect data is the display mode of perspective following, generate the special effect data at a preset position on the display interface corresponding to the game screen of the current 360° panoramic space with preset limiting conditions, and acquire the perspective screen after generating the special effect data to obtain a third game live broadcast screen.

[0169] The processing device for the above game live broadcast further includes: a prompt module 807, configured to execute corresponding prompt tasks; wherein, the prompt tasks are used to prompt the host device to receive the special effect data in a prompt manner of sound effect or vibration.

[0170] Corresponding to the above method embodiment, applied to a live broadcast platform server, refer to Figure 9 the schematic diagram of a processing device for a game live broadcast shown in

[0171] The processing module 901 is configured to collect the device sensor data of the target client in response to a perspective connection instruction sent by the target client, process the device sensor data, obtain the perspective data corresponding to the processed device sensor data, and send the perspective data to the host device.

[0172] The above-mentioned processing device for game live broadcast is applied to a live broadcast platform server. In response to a perspective connection instruction sent by a target client, it collects the device sensor data of the target client, processes the device sensor data, obtains the perspective data corresponding to the processed device sensor data, and sends the perspective data to the host device. In this method, the data transmission between the client and the host is realized through the live broadcast platform server, which enables the actions generated by the user in the live broadcast room to directly interact with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the audience's sense of participation and immersion.

[0173] The processing module 901 is further configured to: collect the device sensor data of the client device in real time, perform relative angle correction on the device sensor data of the client device to obtain the corrected device sensor data; perform numerical smoothing on the corrected device sensor data to obtain the processed device sensor data; obtain the perspective data corresponding to the processed device sensor data; wherein the perspective data includes degrees of freedom of multiple rotation angles.

[0174] The above-mentioned processing device for game live broadcast further includes: a determination module 902, configured to receive the special effect data sent by the target client, and determine the special effect data based on a preset trigger device interaction rule and a preset trigger special effect rule to obtain a determination result; a third sending module 903, configured to determine the display mode of the special effect data based on the determination result, and send the special effect data and the display mode of the special effect data to the host device.

[0175] The third sending module 903 is further configured to: if the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determine the display mode of the special effect data as a displacement animation mode, and send the special effect data and the display mode of the special effect data to the host device; if the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determine the display mode of the special effect data as a non-perspective-following display mode or a perspective-following mode, and send the special effect data and the display mode of the special effect data to the host device.

[0176] Corresponding to the above method embodiment, refer to Figure 10 the schematic diagram of a processing system for game live broadcast shown in

[0177] The processing of game live streaming includes a user device 1001, a live streaming platform server 1002, and a host device 1003;

[0178] The user device 1001 is used to respond to an entry instruction for a target live streaming room and display a first game live streaming screen of the target live streaming room; wherein, the first game live streaming screen is: a perspective screen of a controlled virtual character controlled by the host corresponding to the target live streaming room in the game scene of the target game; in response to a preset perspective connection operation, collect device sensor data of the user device and display a second game live streaming screen corresponding to the device sensor data; wherein, the second game live streaming screen is: a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data;

[0179] The host device 1003 is used to run the target game and generate a game screen of the target game; wherein, the game screen is: a screen generated based on the current position of the controlled virtual character controlled by the host corresponding to the target live streaming room in the game scene of the target game; in response to a live broadcast start instruction for the target game, collect the game screen to generate a game live streaming screen for the target game; send the game live streaming screen to the user device communicatively connected to the host device so that the user device can display the game live streaming screen; in response to a perspective connection instruction sent by the target user device, obtain the perspective data of the target user device based on the device sensor data, collect a perspective screen corresponding to the perspective data through a virtual camera in the target game, and send it to the target user device;

[0180] The live streaming platform server 1002 is used to, in response to a perspective connection instruction sent by the target user device, collect the device sensor data of the target user device, process the device sensor data, obtain perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device 1003.

[0181] The structures and functions of the user device 1001, the live streaming platform server 1002, and the host device 1003 are similar to those of the user device, the live streaming platform server, and the host device described in the above game live streaming processing method, and will not be elaborated here.

[0182] The above game live streaming processing system, through the user device, the live streaming platform server, and the host device, can enable the behaviors generated by the user in the live streaming room to actively interact directly with the live streaming content, improving the interactivity between the audience and the host in game live streaming, as well as the sense of participation and immersion of the audience.

[0183] This embodiment also provides a user device, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above game live streaming processing method. This user device can be a server or a terminal device.

[0184] See Figure 11 As shown, the client device includes a processor 1100 and a memory 1101. The memory 1101 stores machine-executable instructions that can be executed by the processor 1100, and the processor 1100 executes the machine-executable instructions to implement the above-mentioned processing method for game live broadcast.

[0185] Furthermore, Figure 11 The client device shown further includes a bus 1102 and a communication interface 1103. The processor 1100, the communication interface 1103, and the memory 1101 are connected through the bus 1102.

[0186] Among them, the memory 1101 may include a high-speed random access memory (RAM, Random Access Memory), and may also include a non-volatile memory, such as at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 1103 (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 1102 can be an ISA bus, a PCI bus, an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity of representation, Figure 11 only a single bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0187] The processor 1100 may be an integrated circuit chip with the ability to process signals. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in the processor 1100 or the instructions in the form of software. The above-mentioned processor 1100 may be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it may also be a digital signal processor (DSP for short), an application specific integrated circuit (ASIC for short), a field-programmable gate array (FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present invention can be directly embodied as being executed and completed by the hardware decoding processor, or executed and completed by a combination of the hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory 1101, and the processor 1100 reads the information in the memory 1101 and combines its hardware to complete the following steps:

[0188] In response to an entry instruction for a target live streaming room, display a first game live streaming screen of a controlled virtual character controlled by the host side corresponding to the target live streaming room in the game scene of the target VR game; in response to a preset perspective connection operation, collect device sensor data of the user terminal device and display a second game live streaming screen corresponding to the device sensor data; the second game live streaming screen is the perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data.

[0189] It is possible to display a perspective screen corresponding to the perspective changed based on the device sensor data on the user terminal device, so that the actions generated by the user in the live streaming room can actively interact directly with the live streaming content, improving the interactivity between the audience and the host in the game live streaming, as well as the sense of participation and immersion of the audience.

[0190] In response to a preset perspective connection operation, collect device sensor data of the client device and display a second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is a perspective screen corresponding to the perspective after the perspective is changed based on the device sensor data, and the steps include: in response to a preset perspective connection operation, collect device sensor data generated by rotating the client device in real time, and display a second game live broadcast screen corresponding to the perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live broadcast screen is a perspective screen corresponding to the perspective after the controlled virtual character changes the perspective based on the perspective data, or a perspective screen corresponding to the game scene of the target game after the perspective is changed based on the perspective data.

[0191] By playing a second game live broadcast scene screen corresponding to the perspective data generated based on the device sensor gyroscope data, it realizes the user's observation of the target game at a rotation angle or a movement angle at the client side, and realizes the viewing of game live broadcast screens with various perspective transformations.

[0192] The client device can also be used to: in response to a display instruction for the perspective screen, display a perspective screen with the viewport of the host side reduced on the display interface of the currently displayed game live broadcast screen.

[0193] It facilitates the switching between the user's perspective screen and the host's perspective screen at the client side, as well as the simultaneous viewing of the user's perspective screen and the host's perspective screen, improving the convenience of viewing the screen.

[0194] The client device can also be used to: in response to a touch operation of the user on the interface, generate special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a sliding operation; in response to a display instruction for the special effect data, display a third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is a perspective screen corresponding to the special effect data after the special effect data is displayed in the display mode of the special effect data.

[0195] Through the display of special effect data in the game live broadcast screen, it realizes the direct interaction between the client side and the host side. The host can see the barrage in time and interact with the audience through the host device, improving the interaction between the user and the host, and enhancing the sense of participation and immersion of the audience.

[0196] The above steps of generating special effect data in response to a touch operation of the user on the interface, wherein the touch operation includes a click operation, a touch operation, an information input operation, and a sliding operation, include:

[0197] In response to a click operation, a touch operation, or a sliding operation on the control of the special effect virtual item, generate special effect data corresponding to the special effect virtual item; in response to an information input operation or a click operation on the input box, generate corresponding text information to obtain special effect data.

[0198] The above display instruction for special effect data, the step of displaying the third game live broadcast screen corresponding to the special effect data, includes: for the display instruction of the special effect data, displaying the third game live broadcast screen corresponding to the special effect data; wherein, the third game live broadcast screen is: the perspective screen corresponding to the special effect data displayed in the form of a displacement animation, or the perspective screen corresponding to the special effect data displayed in the form of perspective following, or the perspective screen corresponding to the special effect data displayed in the form of non-perspective following.

[0199] Through various display methods based on special effect data, it is possible to display the corresponding special effect data on the game live broadcast screen in a multifunctional and targeted manner, improving efficiency and reducing the computational burden, enhancing the interactivity between the audience and the anchor, as well as the audience's sense of participation and immersion.

[0200] This embodiment further provides a host device, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method. The host device can be a server or a terminal device.

[0201] See Figure 12 As shown, the host device includes a processor 1200 and a memory 1201. The memory 1201 stores machine-executable instructions that can be executed by the processor 1200, and the processor 1200 executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0202] Furthermore, Figure 12 The host device shown further includes a bus 1202 and a communication interface 1203. The processor 1200, the communication interface 1203, and the memory 1201 are connected through the bus 1202.

[0203] Among them, the memory 1201 may include a high-speed random access memory (RAM, Random Access Memory), and may also include a non-volatile memory, such as at least one disk memory. Through at least one communication interface 1203 (which can be wired or wireless), a communication connection is achieved between this system network element and at least one other network element, and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 1202 can be an ISA bus, a PCI bus, an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of representation, Figure 12 only a bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0204] The processor 1200 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit in the hardware of the processor 1200 or instructions in the form of software. The above-mentioned processor 1200 may be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it may also be a digital signal processor (DSP for short), an application specific integrated circuit (ASIC for short), a field-programmable gate array (FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present invention can be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory 1201, and the processor 1200 reads the information in the memory 1201 and combines its hardware to complete the following steps:

[0205] Run the target game and generate a game screen of the target game; wherein, the game screen is: a screen generated based on the current position of a controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; in response to a live broadcast instruction for the target game, collect the game screen to generate a game live broadcast screen for the target game; send the game live broadcast screen to a user side communicatively connected to the host side device so that the user side can display the game live broadcast screen; in response to a perspective connection instruction sent by the target user side, obtain the perspective data of the target user side based on the device sensor data, collect the perspective screen corresponding to the perspective data through a virtual camera in the target game, and send it to the target user side.

[0206] It is possible to collect the perspective screen corresponding to the perspective data through the virtual camera in the target game on the host side device, so that the behavior generated by the user in the live broadcast room can actively interact directly with the live broadcast content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0207] The steps of obtaining the perspective data of the target client based on the device sensor data in response to the perspective connection instruction sent by the target client, collecting the perspective screen corresponding to the perspective data through the virtual camera in the target game, and sending it to the target client include: in response to the perspective connection instruction sent by the target client, obtaining the perspective data of the target client based on the device sensor data, controlling the perspective change of the controlled virtual character based on the perspective data, generating the corresponding perspective screen after the perspective change, and collecting the perspective screen corresponding to the perspective data through the virtual camera in the target game, or controlling the perspective change of the game scene of the target game based on the perspective data, generating the corresponding perspective screen after the perspective change, collecting the corresponding perspective screen through the virtual camera in the target game, and sending it to the target client.

[0208] Through the perspective changes of the rotation angle and the movement angle, the viewing of the game live broadcast screen with multiple perspective transformations on the client side is realized.

[0209] The steps of running the target game and generating the game screen of the target game include: running the target game, obtaining the current position of the controlled virtual character controlled by the host client corresponding to the target live broadcast room in the game scene of the target game; generating the game screen of the 360° panoramic space of the target game based on the current position.

[0210] By generating the game screen of the 360° panoramic space, the effect of the user on the client side observing the target game panoramically at 360° can be realized, and the immersion of the user in the game is improved.

[0211] The host client device can also be used to: obtain the special effect data sent by the client and the display method of the special effect data;

[0212] Display the special effect data on the current game screen of the 360° panoramic space in the display method of the special effect data, and collect the corresponding perspective screen to obtain the third game live broadcast screen.

[0213] By displaying the special effect data on the current game screen of the 360° panoramic space based on various display methods of the special effect data, it is realized that while the user observes the game panoramically at 360°, the corresponding special effect data can be displayed on the game live broadcast screen in a multi-functional and targeted manner, improving the efficiency and reducing the calculation burden, enhancing the interactivity between the audience and the host, as well as the sense of participation and immersion of the audience, and enabling the display of the special effect data of the game screen on the host client.

[0214] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display manner of the special effect data and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display manner of the special effect data is the display manner of displacement animation, collect the perspective screen of the game screen of the current 360° panoramic space, and display the special effect data on the collected perspective screen in the display manner of displacement animation to obtain the third game live broadcast screen; If the display manner of the special effect data is the display manner of non-following perspective, generate the special effect data at the preset position of the game screen of the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display manner of the special effect data is the display manner of following perspective, generate the special effect data at the preset position on the display interface corresponding to the game screen of the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0215] The game live broadcast screen that can play and display the special effect data multifunctionally and pertinently improves the efficiency and reduces the computing burden, and enhances the interactivity between the audience and the anchor, as well as the sense of participation and immersion of the audience.

[0216] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display manner of the special effect data and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display manner of the special effect data is the display manner of displacement animation, collect the perspective screen of the game screen of the current 360° panoramic space, and display the special effect data on the collected perspective screen in the display manner of displacement animation and preset limiting conditions to obtain the third game live broadcast screen; If the display manner of the special effect data is the display manner of non-following perspective, generate the special effect data at the preset position of the game screen of the current 360° panoramic space with the preset limiting conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display manner of the special effect data is the display manner of following perspective, generate the special effect data at the preset position on the display interface corresponding to the game screen of the current 360° panoramic space with the preset limiting conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0217] Through the display manners of displacement animation, non-following perspective and following perspective, and the preset limiting conditions, the quantity of the displayed special effect data can be restricted to prevent the influence of a large amount of special effect data on the screen display, prompt the special effect data timely and effectively, enhance the beauty of the scene screen, improve the viewing convenience of the scene screen, improve the interactivity between the audience and the anchor in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0218] After the steps of obtaining the special effect data sent by the client and the display method of the special effect data, the following steps are further included: performing a corresponding prompting task; wherein, the prompting task is used to prompt the host device to receive the special effect data in a sound effect or vibration prompting manner.

[0219] The special effect data prompting of the host side and the content feedback of the interaction between the host side and the game are realized.

[0220] This embodiment further provides a live broadcast platform server, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0221] See Figure 13 As shown, the live broadcast platform server includes a processor 1300 and a memory 1301. The memory 1301 stores machine-executable instructions that can be executed by the processor 1300, and the processor 1300 executes the machine-executable instructions to implement the above-mentioned game live broadcast processing method.

[0222] Furthermore, Figure 13 The live broadcast platform server shown further includes a bus 1302 and a communication interface 1303. The processor 1300, the communication interface 1303, and the memory 1301 are connected through the bus 1302.

[0223] Among them, the memory 1301 may include a high-speed random access memory (RAM, Random Access Memory), and may also include a non-volatile memory, such as at least one disk memory. Through at least one communication interface 1303 (which can be wired or wireless), the communication connection between this system network element and at least one other network element can be realized, and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 1302 can be an ISA bus, a PCI bus, an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, Figure 11 only one bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0224] The processor 1300 may be an integrated circuit chip with the ability to process signals. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in the processor 1300 or the instructions in the form of software. The above-mentioned processor 1300 may be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it may also be a digital signal processor (DSP for short), an application specific integrated circuit (ASIC for short), a field-programmable gate array (FPGA for short), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute various methods, steps and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present invention can be directly embodied as being executed and completed by the hardware decoding processor, or executed and completed by the combination of the hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory 1301, and the processor 1300 reads the information in the memory 1301 and combines its hardware to complete the following steps:

[0225] In response to the perspective connection instruction sent by the target user terminal, collect the device sensor data of the target user terminal, process the device sensor data, obtain the perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host terminal device.

[0226] Enabling data transmission between the user terminal and the host terminal through the live broadcast platform server can enable the behaviors generated by the user in the live broadcast room to directly interact with the live broadcast content actively, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0227] The step of processing the device sensor data and obtaining the perspective data corresponding to the device sensor data after data processing includes: collecting the device sensor data of the user terminal device in real time, performing relative angle correction on the device sensor data of the user terminal device to obtain the corrected device sensor data; performing numerical smoothing on the corrected device sensor data to obtain the device sensor data after data processing; obtaining the perspective data corresponding to the device sensor data after data processing; wherein the perspective data includes degrees of freedom of multiple rotation angles.

[0228] Through relative angle correction, the authenticity of the experience is improved; through numerical smoothing, the accuracy and stability of the device sensor data after data processing are improved.

[0229] The above live platform server is further configured to: receive the special effect data sent by the target user terminal, determine the special effect data based on the preset trigger device interaction rule and the preset trigger special effect rule to obtain a determination result; determine the display mode of the special effect data based on the determination result, and send the special effect data and the display mode of the special effect data to the host terminal device.

[0230] By displaying the corresponding perspective screen based on the determination between the special effect data and the trigger device interaction rule and the preset trigger special effect rule, the perspective screen can be displayed in a multifunctional and targeted manner.

[0231] The step of determining the display mode of the special effect data based on the determination result and sending the special effect data and the display mode of the special effect data to the host terminal device includes: if the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determine the display mode of the special effect data as the way of displacement animation, and send the special effect data and the display mode of the special effect data to the host terminal device; if the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determine the display mode of the special effect data as the display mode of non-perspective following or the way of perspective following, and send the special effect data and the display mode of the special effect data to the host terminal device.

[0232] This embodiment also provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions cause the processor to implement the following steps:

[0233] In response to an instruction to enter a target live streaming room, display a first game live streaming screen of a controlled virtual character controlled by the host side corresponding to the target live streaming room in the game scene of the target VR game; in response to a preset perspective connection operation, collect device sensor data of the user side device, and display a second game live streaming screen corresponding to the device sensor data; the second game live streaming screen is a perspective screen corresponding to the perspective after the perspective is transformed based on the device sensor data.

[0234] It is possible to display a perspective screen corresponding to the perspective transformed based on the device sensor data on the user side device, so that the actions generated by the user in the live streaming room can actively interact directly with the live streaming content, improving the interactivity between the audience and the host in the game live streaming, as well as the sense of participation and immersion of the audience.

[0235] The above-mentioned step of collecting device sensor data of the user side device in response to a preset perspective connection operation and displaying a second game live streaming screen corresponding to the device sensor data; where the second game live streaming screen is: the perspective screen corresponding to the perspective after the perspective is transformed based on the device sensor data, includes: in response to a preset perspective connection operation, collect device sensor data generated in real time by rotating the user side device, and display a second game live streaming screen corresponding to the perspective data generated based on the device sensor data; where the perspective data includes degrees of freedom of multiple rotation angles, and the second game live streaming screen is: the perspective screen corresponding to the perspective after the controlled virtual character transforms the perspective based on the perspective data, or the perspective screen corresponding to the perspective after the game scene of the target game transforms the perspective based on the perspective data.

[0236] By playing a second game live streaming scene screen corresponding to the perspective data generated based on the device sensor gyroscope data, it realizes the observation of the target game at the rotation angle or movement angle of the user side, and realizes the viewing of game live streaming screens with various perspective transformations.

[0237] The user side device can also be used to: in response to a display instruction for a perspective screen, display a perspective screen with the host side viewport reduced on the display interface of the currently displayed game live streaming screen.

[0238] It is convenient for the user side to switch between the user perspective screen and the host perspective screen, and to view the user perspective screen and the host perspective screen simultaneously, improving the convenience of viewing the screen.

[0239] The user side device can also be used to: in response to a touch operation of the user on the interface, generate special effect data; where the touch operation includes click operation, touch operation, information input operation and sliding operation; in response to a display instruction for the special effect data, display a third game live streaming screen corresponding to the special effect data; where the third game live streaming screen is: the perspective screen corresponding to the perspective after the special effect data is displayed in the display mode of the special effect data.

[0240] Through the display of special effect data in the game live broadcast screen, direct interaction between the user side and the anchor side is realized. The anchor can timely see the barrage and interact with the audience through the anchor side device, improving the interactivity between the user and the anchor, as well as the sense of participation and immersion of the audience.

[0241] The above steps of generating special effect data in response to the user's touch operation on the interface, where the touch operation includes click operation, touch operation, information input operation, and sliding operation, include: generating special effect data corresponding to the special effect virtual item in response to a click operation, touch operation, or sliding operation on the control of the special effect virtual item; generating corresponding text information in response to an information input operation or click operation on the input box to obtain special effect data.

[0242] The above steps of displaying the third game live broadcast screen corresponding to the special effect data according to the display instruction of the special effect data include: displaying the third game live broadcast screen corresponding to the special effect data according to the display instruction of the special effect data; where the third game live broadcast screen is: the perspective screen corresponding to the special effect data after being displayed in the form of a displacement animation, or the perspective screen corresponding to the special effect data after being displayed in the form of perspective following, or the perspective screen corresponding to the special effect data after being displayed in the form of non-perspective following.

[0243] Through various display methods based on special effect data, the corresponding special effect data can be displayed on the game live broadcast screen in a multifunctional and targeted manner, improving efficiency and reducing the calculation burden, as well as enhancing the interactivity between the audience and the anchor, and the sense of participation and immersion of the audience.

[0244] Run the target game and generate the game screen of the target game; where the game screen is: the screen generated at the current position of the controlled virtual character controlled by the anchor side corresponding to the target live broadcast room in the game scene of the target game; in response to the start broadcast instruction for the target game, collect the game screen to generate the game live broadcast screen for the target game; send the game live broadcast screen to the user side communicatively connected to the anchor side device so that the user side can display the game live broadcast screen; in response to the perspective connection instruction sent by the target user side, obtain the perspective data of the target user side based on the device sensor data, collect the perspective screen corresponding to the perspective data through the virtual camera in the target game, and send it to the target user side.

[0245] It is possible to collect the perspective screen corresponding to the perspective data through the virtual camera in the target game on the anchor side device, so that the behavior generated by the user in the live broadcast room can actively have direct interaction with the live broadcast content, improving the interactivity between the audience and the anchor in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0246] The steps of obtaining the perspective data of the target client based on device sensor data in response to the perspective connection instruction sent by the target client, collecting the perspective screen corresponding to the perspective data through the virtual camera in the target game, and sending it to the target client include: in response to the perspective connection instruction sent by the target client, obtaining the perspective data of the target client based on device sensor data, controlling the perspective change of the controlled virtual character based on the perspective data, generating the corresponding perspective screen after the perspective change, and collecting the perspective screen corresponding to the perspective data through the virtual camera in the target game, or controlling the perspective change of the game scene of the target game based on the perspective data, generating the corresponding perspective screen after the perspective change, collecting the corresponding perspective screen through the virtual camera in the target game, and sending it to the target client.

[0247] Through the perspective changes of the rotation angle and the movement angle, the game live broadcast screen with various perspective transformations of the client is realized.

[0248] The steps of running the target game and generating the game screen of the target game include: running the target game, obtaining the current position of the controlled virtual character controlled by the host client corresponding to the target live broadcast room in the game scene of the target game; generating the game screen of the 360° panoramic space of the target game based on the current position.

[0249] By generating the game screen of the 360° panoramic space, the effect of the user client observing the target VR game panoramically at 360° can be realized, and the game immersion of the user is improved.

[0250] The host client device can also be used to: obtain the special effect data sent by the user client and the display method of the special effect data; display the special effect data on the current game screen of the 360° panoramic space in the display method of the special effect data, and collect the corresponding perspective screen to obtain the third game live broadcast screen.

[0251] By displaying the special effect data on the current game screen of the 360° panoramic space based on various display methods of the special effect data, it is realized that while the user observes the game panoramically at 360°, the corresponding special effect data can be displayed on the game live broadcast screen in a multi-functional and targeted manner, improving the efficiency and reducing the calculation burden, enhancing the interactivity between the audience and the host, as well as the sense of participation and immersion of the audience, and enabling the display of the special effect data of the game screen on the host client.

[0252] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display mode of the special effect data and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display mode of the special effect data is the display mode of displacement animation, collect the perspective screen of the game screen in the current 360° panoramic space, and display the special effect data on the collected perspective screen in the display mode of displacement animation to obtain the third game live broadcast screen; If the display mode of the special effect data is the display mode of non-following perspective, generate the special effect data at the preset position of the game screen in the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display mode of the special effect data is the display mode of following perspective, generate the special effect data at the preset position on the display interface corresponding to the game screen in the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0253] The game live broadcast screen that can play and display the special effect data in a multifunctional and targeted manner can improve the efficiency and reduce the computing burden, and improve the interactivity between the audience and the anchor, as well as the sense of participation and immersion of the audience.

[0254] The steps of displaying the special effect data on the game screen of the current 360° panoramic space in the above-mentioned display mode of the special effect data and collecting the corresponding perspective screen to obtain the third game live broadcast screen include: If the display mode of the special effect data is the display mode of displacement animation, collect the perspective screen of the game screen in the current 360° panoramic space, and display the special effect data on the collected perspective screen in the display mode of displacement animation and preset limiting conditions to obtain the third game live broadcast screen; If the display mode of the special effect data is the display mode of non-following perspective, generate the special effect data at the preset position of the game screen in the current 360° panoramic space with the preset limiting conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen; If the display mode of the special effect data is the display mode of following perspective, generate the special effect data at the preset position on the display interface corresponding to the game screen in the current 360° panoramic space with the preset limiting conditions, and collect the perspective screen after generating the special effect data to obtain the third game live broadcast screen.

[0255] Through the display modes of displacement animation, non-following perspective and following perspective, and preset limiting conditions, the quantity of the displayed special effect data can be restricted to prevent the influence of a large amount of special effect data on the screen display, prompt the special effect data in a timely and effective manner, enhance the beauty of the scene screen, improve the viewing convenience of the scene screen, improve the interactivity between the audience and the anchor in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0256] After the steps of obtaining the special effect data sent by the client and the display method of the special effect data, the following steps are further included: performing a corresponding prompt task; wherein, the prompt task is used to prompt the host device to receive the special effect data in a sound effect or vibration prompt manner.

[0257] The special effect data prompt of the host side and the content feedback of the interaction between the host side and the game are realized.

[0258] In response to the perspective connection instruction sent by the target client, collect the device sensor data of the target client, process the device sensor data, obtain the perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device.

[0259] Through the live platform server to realize the data transmission between the client and the host side, it can enable the behavior generated by the user in the live room to actively interact directly with the live content, improving the interactivity between the audience and the host in the game live broadcast, as well as the sense of participation and immersion of the audience.

[0260] The steps of processing the device sensor data to obtain the perspective data corresponding to the device sensor data after data processing include:

[0261] Real-time collect the device sensor data of the client device, perform relative angle correction on the device sensor data of the client device to obtain the corrected device sensor data; perform numerical smoothing on the corrected device sensor data to obtain the device sensor data after data processing; obtain the perspective data corresponding to the device sensor data after data processing; wherein, the perspective data includes multiple degrees of freedom of rotation angles.

[0262] Through relative angle correction, the authenticity of the experience is improved; through numerical smoothing, the accuracy and stability of the device sensor data after data processing are improved.

[0263] The above-mentioned live platform server is further used for: receiving the special effect data sent by the target client, judging the special effect data based on the preset trigger device interaction rule and the preset trigger special effect rule to obtain a judgment result; determining the display method of the special effect data based on the judgment result, and sending the special effect data and the display method of the special effect data to the host device. By displaying the corresponding perspective screen based on the judgment between the special effect data and the trigger device interaction rule and the preset trigger special effect rule, it can display the perspective screen in a multifunctional and targeted manner.

[0264] The step of determining the display mode of the special effect data based on the determination result and sending the special effect data and the display mode of the special effect data to the host device includes: if the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determine the display mode of the special effect data as the displacement animation mode, and send the special effect data and the display mode of the special effect data to the host device; if the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determine the display mode of the special effect data as the non-viewpoint-following display mode or the viewpoint-following mode, and send the special effect data and the display mode of the special effect data to the host device.

[0265] The computer program product of the game live broadcast processing method and related devices provided by the embodiments of the present invention includes a computer-readable storage medium storing program codes, and the instructions included in the program codes can be used to execute the methods described in the foregoing method embodiments. For specific implementation, reference can be made to the method embodiments, which will not be elaborated herein.

[0266] Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems and devices described above can refer to the corresponding processes in the foregoing method embodiments, which will not be elaborated herein.

[0267] In addition, in the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

[0268] If the above functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.

[0269] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation to the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance.

[0270] Finally, it should be noted that the above embodiments are only specific embodiments of the present invention, used to illustrate the technical solutions of the present invention, rather than limiting it. The protection scope of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art within the technical scope disclosed by the present invention can still modify the technical solutions recorded in the foregoing embodiments or easily conceive of changes, or make equivalent replacements for some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A processing method for game live broadcast, applied to a user terminal device, characterized in that, The method includes: In response to an entry instruction for a target live streaming room, display a first game live streaming screen of the target live streaming room; wherein, the first game live streaming screen is a perspective screen of a controlled virtual character controlled by a host side corresponding to the target live streaming room in a game scene of a target game; In response to a preset perspective connection operation, collect device sensor data of the user terminal device and display a second game live streaming screen corresponding to the device sensor data; wherein, the second game live streaming screen is a perspective screen corresponding to the perspective after transformation based on the device sensor data; Wherein, the method further includes: In response to a display instruction for a perspective screen, display a perspective screen with a reduced host side viewport on the display interface of the currently displayed game live streaming screen.

2. The method according to claim 1, characterized in that The step of, in response to a preset perspective connection operation, collecting device sensor data of the user terminal device and displaying a second game live streaming screen corresponding to the device sensor data; wherein, the second game live streaming screen is a perspective screen corresponding to the perspective after transformation based on the device sensor data, includes: In response to a preset perspective connection operation, collect device sensor data generated by rotating the user terminal device in real time and display a second game live streaming screen corresponding to perspective data generated based on the device sensor data; wherein, the perspective data includes degrees of freedom of multiple rotation angles, and the second game live streaming screen is a perspective screen corresponding to the perspective after transformation of the controlled virtual character based on the perspective data, or a perspective screen corresponding to the perspective after transformation of the game scene of the target game based on the perspective data.

3. The method according to claim 1, wherein The method further includes: In response to a touch operation of a user on the interface, generate special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a slide operation; In response to a display instruction for the special effect data, display a third game live streaming screen corresponding to the special effect data; wherein, the third game live streaming screen is a perspective screen corresponding to the special effect data after being displayed in the display mode of the special effect data.

4. The method according to claim 3, characterized in that, The step of, in response to a touch operation of a user on the interface, generating special effect data; wherein, the touch operation includes a click operation, a touch operation, an information input operation, and a slide operation, includes: In response to a click operation, a touch operation, or a slide operation on a control of a special effect virtual item, generate special effect data corresponding to the special effect virtual item; In response to an information input operation or a click operation on an input box, generate corresponding text information to obtain special effect data.

5. The method according to claim 3, characterized in that The step of, in response to a display instruction for the special effect data, displaying a third game live streaming screen corresponding to the special effect data, includes: In response to a display instruction for the special effect data, display a third game live streaming screen corresponding to the special effect data; wherein, the third game live streaming screen is a perspective screen corresponding to the special effect data after being displayed in a displacement animation mode, or a perspective screen corresponding to the special effect data after being displayed in a perspective following mode, or a perspective screen corresponding to the special effect data after being displayed in a perspective non-following mode.

6. A processing method for game live broadcast, applied to the host device, characterized in that The method includes: Run the target game and generate a game screen of the target game; wherein, the game screen is: a screen generated at the current position of a controlled virtual character controlled by a host terminal corresponding to a target live broadcast room in the game scene of the target game; Respond to a live broadcast instruction for the target game, collect the game screen to generate a game live broadcast screen for the target game; Send the game live broadcast screen to a user terminal communicatively connected to the host terminal device, so that the user terminal displays the game live broadcast screen; Respond to a perspective connection instruction sent by a target user terminal, obtain perspective data of the target user terminal based on device sensor data, collect a perspective screen corresponding to the perspective data through a virtual camera in the target game, and send it to the target user terminal; Wherein, the method further includes: Obtain the special effect data sent by the user terminal and the display mode of the special effect data; Display the special effect data on the game screen of the current 360° panoramic space in the display mode of the special effect data, and collect the corresponding perspective screen to obtain a third game live broadcast screen.

7. The method according to claim 6, wherein The step of responding to a perspective connection instruction sent by a target user terminal, obtaining perspective data of the target user terminal based on device sensor data, collecting a perspective screen corresponding to the perspective data through a virtual camera in the target game, and sending it to the target user terminal includes: Respond to a perspective connection instruction sent by a target user terminal, obtain perspective data of the target user terminal based on device sensor data, control the perspective change of the controlled virtual character based on the perspective data, generate a perspective screen corresponding to the perspective change, and collect the perspective screen corresponding to the perspective data through a virtual camera in the target game, or control the perspective change of the game scene of the target game based on the perspective data, generate a perspective screen corresponding to the perspective change, collect the corresponding perspective screen through a virtual camera in the target game, and send it to the target user terminal.

8. The method according to claim 6, characterized in that, The step of running the target game and generating a game screen of the target game includes: Run the target game, and obtain the current position of the controlled virtual character controlled by the host terminal corresponding to the target live broadcast room in the game scene of the target game; Generate a game screen of the 360° panoramic space of the target game based on the current position.

9. The method according to claim 6, wherein The step of displaying the special effect data on the game screen of the current 360° panoramic space in the display mode of the special effect data, and collecting the corresponding perspective screen to obtain a third game live broadcast screen includes: If the display mode of the special effect data is the display mode of displacement animation, collect the perspective screen of the game screen of the current 360° panoramic space, display the special effect data on the collected perspective screen in the display mode of displacement animation, and obtain a third game live broadcast screen; If the display mode of the special effect data is the display mode where the perspective does not follow, generate the special effect data at a preset position on the game screen of the current 360° panoramic space, and collect the perspective screen after generating the special effect data to obtain a third game live broadcast screen; If the display mode of the special effects data is a perspective-following display mode, the special effects data is generated at a preset position on the display interface corresponding to the game screen of the current 360° panoramic space, and the perspective screen after the special effects data is generated is collected to obtain a third game live broadcast screen.

10. The method according to claim 6, wherein The step of displaying the special effect data on the current 360° panoramic game screen in the display mode of the special effect data, and collecting the corresponding viewing angle screen to obtain the third game live broadcast screen includes: If the display mode of the special effect data is a displacement animation display mode, then a perspective picture of the current 360° panoramic game screen is collected, and the special effect data is displayed on the collected perspective picture in a displacement animation display mode and preset restriction conditions to obtain a third game live broadcast picture; If the display mode of the special effect data is a non-viewing display mode, the special effect data is generated at a preset position of the game screen in the current 360° panoramic space according to the preset restriction conditions, and the viewing angle screen after the special effect data is generated is collected to obtain a third game live broadcast screen; If the display mode of the special effects data is a perspective-following display mode, the special effects data is generated at a preset position on the display interface corresponding to the game screen of the current 360° panoramic space according to preset restriction conditions, and the perspective screen after the special effects data is generated is collected to obtain a third game live broadcast screen.

11. The method according to claim 6, wherein After the step of obtaining the special effect data sent by the user terminal and the display mode of the special effect data, the method further includes: Execute the corresponding prompt task; wherein, the prompt task is used to prompt the anchor end device to receive the special effect data in the form of sound or vibration prompts.

12. A processing method for game live broadcast, applied to a live broadcast platform server, characterized in that The method comprises: In response to a view connection instruction sent by a target user terminal, collecting device sensor data of the target user terminal, processing the device sensor data, obtaining view data corresponding to the processed device sensor data, and sending the view data to the host terminal device; The step of processing the device sensor data and obtaining the viewing angle data corresponding to the processed device sensor data includes: Collecting device sensor data of the user terminal device in real time, and performing relative angle correction of the device sensor data of the user terminal device in the game space according to the gyroscope space to obtain corrected device sensor data; performing numerical smoothing on the corrected device sensor data to obtain data-processed device sensor data; Obtaining viewing angle data corresponding to the device sensor data after the data processing; wherein the viewing angle data includes a plurality of degrees of freedom of rotation angles.

13. The method according to claim 12, wherein The method further comprises: Receive special effect data sent by the target user terminal, and determine the special effect data based on the preset trigger device interaction rules and the preset trigger special effect rules to obtain a determination result; The display mode of the special effect data is determined based on the determination result, and the special effect data and the display mode of the special effect data are sent to the anchor terminal device.

14. The method according to claim 13, wherein The step of determining the display mode of the special effect data based on the determination result and sending the special effect data and the display mode of the special effect data to the host device includes: If the determination result is used to indicate that the special effect data does not conform to the preset trigger device interaction rule, or the special effect data conforms to the preset trigger device interaction rule but does not conform to the preset trigger special effect rule, then determine the display mode of the special effect data as a displacement animation mode, and send the special effect data and the display mode of the special effect data to the host device; If the determination result is used to indicate that the special effect data conforms to the preset trigger device interaction rule and conforms to the preset trigger special effect rule, then determine the display mode of the special effect data as a non - perspective - following display mode or a perspective - following mode, and send the special effect data and the display mode of the special effect data to the host device.

15. A processing device for game live broadcast, applied to a user terminal device, characterized in that, The device includes: A first display module, configured to respond to an entry instruction for a target live - broadcast room and display a first game live - broadcast image of the target live - broadcast room; wherein, the first game live - broadcast image is: a perspective image of a controlled virtual character controlled by the host of the target live - broadcast room in the game scene of a target game; A second display module, configured to respond to a preset perspective connection operation, collect device sensor data of the user device, and display a second game live - broadcast image corresponding to the device sensor data; wherein, the second game live - broadcast image is: a perspective image corresponding to the perspective after transformation based on the device sensor data; Wherein, the device further includes: A third display module, configured to respond to a display instruction for a perspective image and display a reduced - size perspective image of the host viewport on the display interface of the currently displayed game live - broadcast image.

16. A processing device for game live broadcast, which is applied to the host device, is characterized in that The device includes: A first generation module, configured to run a target game and generate a game image of the target game; wherein, the game image is: an image generated based on the current position of a controlled virtual character controlled by the host corresponding to the target live - broadcast room in the game scene of the target game; A first collection module, configured to respond to a live - broadcast start instruction for the target game, collect the game image to generate a game live - broadcast image for the target game; A first sending module, configured to send the game live - broadcast image to a user device communicatively connected to the host device, so that the user device displays the game live - broadcast image; A second sending module, configured to respond to a perspective connection instruction sent by a target user device, obtain perspective data of the target user device based on device sensor data, collect a perspective image corresponding to the perspective data through a virtual camera in the target game, and send it to the target user device; Wherein, the device further includes: An acquisition module, configured to acquire special effect data sent by the user device and the display mode of the special effect data; A second collection module, configured to display the special effect data on the game image in the current 360° panoramic space in the display mode of the special effect data, collect the corresponding perspective image, and obtain a third game live - broadcast image.

17. A processing device for game live broadcast, which is applied to a live broadcast platform server, is characterized in that The device includes: A processing module, configured to collect device sensor data of a target client in response to a perspective connection instruction sent by the target client, process the device sensor data, obtain perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device; wherein, the step of processing the device sensor data to obtain perspective data corresponding to the device sensor data after data processing includes: collecting device sensor data of the client device in real time, performing relative angle correction of the game space on the device sensor data of the client device according to the gyroscope space to obtain the corrected device sensor data; performing numerical smoothing on the corrected device sensor data to obtain the device sensor data after data processing; obtaining perspective data corresponding to the device sensor data after data processing; wherein, the perspective data includes degrees of freedom of multiple rotation angles.

18. A client device, characterized in that, It includes a processor and a memory, the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the processing method of game live broadcast according to any one of claims 1-5.

19. A host device, characterized in that, It includes a processor and a memory, the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the processing method of game live broadcast according to any one of claims 6-11.

20. A live streaming platform server, characterized in that, It includes a processor and a memory, the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the processing method of game live broadcast according to any one of claims 12-14.

21. A processing system for game live broadcast, characterized in that, The processing of the game live broadcast includes a client device, a live broadcast platform server, and a host device; The client device is configured to display a first game live broadcast screen of the target live broadcast room in response to an instruction to enter the target live broadcast room; wherein, the first game live broadcast screen is: a perspective screen of a controlled virtual character controlled by the host of the target live broadcast room in the game scene of the target game; in response to a preset perspective connection operation, collect device sensor data of the client device and display a second game live broadcast screen corresponding to the device sensor data; wherein, the second game live broadcast screen is: a perspective screen corresponding to the changed perspective based on the device sensor data; in response to a display instruction for the perspective screen, display a reduced perspective screen of the host viewport on the display interface of the currently displayed game live broadcast screen. The host device is used to run the target game and generate the game screen of the target game; wherein, the game screen is: a screen generated based on the current position of the controlled virtual character controlled by the host side corresponding to the target live broadcast room in the game scene of the target game; in response to the live broadcast instruction for the target game, collect the game screen to generate the game live broadcast screen for the target game; send the game live broadcast screen to the user device communicatively connected to the host device, so that the user device displays the game live broadcast screen; in response to the perspective connection instruction sent by the target user device, obtain the perspective data of the target user device based on the device sensor data, collect the perspective screen corresponding to the perspective data through the virtual camera in the target game, and send it to the target user device; obtain the special effect data sent by the user device and the display method of the special effect data; display the special effect data on the game screen of the current 360° panoramic space in the display method of the special effect data, and collect the corresponding perspective screen to obtain the third game live broadcast screen. The live broadcast platform server is used to, in response to the perspective connection instruction sent by the target user device, collect the device sensor data of the target user device, process the device sensor data, obtain the perspective data corresponding to the device sensor data after data processing, and send the perspective data to the host device; wherein, the step of processing the device sensor data to obtain the perspective data corresponding to the device sensor data after data processing includes: collecting the device sensor data of the user device in real time, performing relative angle correction of the game space on the device sensor data of the user device according to the gyroscope space to obtain the corrected device sensor data; performing numerical smoothing on the corrected device sensor data to obtain the device sensor data after data processing; obtaining the perspective data corresponding to the device sensor data after data processing; wherein, the perspective data includes degrees of freedom of multiple rotation angles.

22. A machine-readable storage medium, characterized in that, The machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by the processor, the machine-executable instructions cause the processor to implement the game live broadcast processing method according to any one of claims 1-14.

Images