Data Processing Method and Device for Event Live Broadcast
By using Beidou positioning and sports data, combined with the geographical environment library and digital human model, the environment and sports images of outdoor event scenes are generated, and the problem of insufficient live broadcast screen information in the existing technology is solved and the audience experience is improved.
Patent Information
- Application Number
- CN202411189671.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2044-08-28
AI Technical Summary
In the prior art, due to the lack of conventional network signal coverage or unstable signal in the outdoor event activity area, the live broadcast screen containing athletes' sports images and surrounding intuitive environmental images cannot be formed, resulting in low richness of live broadcast screen information and poor viewing experience for the audience.
By obtaining the current Beidou positioning and motion data of the target contestant, when the player is detected to enter the shooting area without a network camera, the target environment image and motion image are determined using the geographical environment library and digital human model to generate a live broadcast screen that presents the current live situation.
It realizes a live broadcast picture containing characters and environment that directly presents the on-site situation without networking, which improves the richness of the live broadcast picture information and the viewing experience of the audience.
Smart Images

Figure CN119052554B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of information processing technologies, and particularly relates to a data processing method and device for live sports events. Background Art
[0002] Currently, in many outdoor sports event areas, there are problems of lack of conventional network signal coverage or unstable network signals. In the prior art, when there is no stable coverage of conventional network signals, the situation of the sports event site is presented through a stadium map and athlete positioning icons. However, since a live broadcast screen containing the moving images of athletes and the surrounding intuitive environmental images cannot be formed, the information richness presented by the live broadcast screen is low, and the viewing experience of the audience is not good. Summary of the Invention
[0003] This application proposes a data processing method and device for live sports events to solve the problems of low information richness presented by the live broadcast screen and poor viewing experience of the audience, and improve the information richness presented by the live broadcast screen and the viewing experience of the audience.
[0004] In a first aspect, an embodiment of this application provides a data processing method for live sports events, which is applied to a server of a live sports event system. The method includes:
[0005] Obtain the current Beidou positioning and current motion data of a target competition athlete. The current Beidou positioning is used to represent the current position of the target competition athlete, and the current motion data is used to represent the current physical motion situation of the target competition athlete;
[0006] When it is detected that the target competition athlete enters an area without an Internet-connected camera, determine a target environmental image according to the current Beidou positioning and a geographical environment library. The geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition athlete, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning;
[0007] Determine a target motion image according to the current motion data and a target digital human. The target digital human is used to represent the image of the target competition athlete when performing a target event. The target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target competition athlete when the physical motion situation is the current motion data;
[0008] Determine a target live broadcast screen according to the target environmental image and the target motion image. The target live broadcast screen is used to represent the on-site situation of the target competition athlete at the current Beidou positioning.
[0009] In a second aspect, an embodiment of this application provides a data processing device for live sports events, which is applied to a server of a live sports event system. The device includes:
[0010] A first receiving unit, configured to obtain the current Beidou positioning and current motion data of a target competition player, where the current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion condition of the target competition player;
[0011] A first processing unit, configured to, when detecting that the target competition player enters an area where there is no networked camera for shooting, determine a target environmental image according to the current Beidou positioning and a geographical environment library, where the geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning; determine a target motion image according to the current motion data and a target digital human, where the target digital human is used to represent the image of the target competition player when performing a target event, the target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target competition player when the physical motion condition is the current motion data; determine a target live broadcast screen according to the target environmental image and the target motion image, where the target live broadcast screen is used to represent the on-site situation of the target competition player at the current Beidou positioning.
[0012] In a third aspect, an embodiment of the present application provides a server, including a processor, a memory, and one or more programs, where the one or more programs are stored in the memory and are configured to be executed by the processor, and the programs include instructions for performing the steps in the method according to any one of the first aspects.
[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which computer programs / instructions are stored, and when the computer programs / instructions are executed by a processor, the steps of the method according to any one of the first aspects are implemented.
[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, including computer programs / instructions, and when the computer programs / instructions are executed by a processor, some or all of the steps of the method according to any one of the first aspects of the embodiments of the present application are implemented.
[0015] It can be seen that in this application, the server obtains the current Beidou positioning and current motion data of the target competition player. The current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion situation of the target competition player. When it is detected that the target competition player enters the area without an internet-connected camera, the target environmental image is determined according to the current Beidou positioning and the geographical environment library. The geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning. The target motion image is determined according to the current motion data and the target digital human. The target digital human is used to represent the image of the target competition player when performing the target event. The target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target competition player when the physical motion situation is the current motion data. The target live broadcast screen is determined according to the target environmental image and the target motion image. The target live broadcast screen is used to represent the on-site situation of the target competition player at the current Beidou positioning. Since the environmental image of the surrounding environment where the target competition player is currently located and the current motion image are determined according to the current Beidou positioning and the current motion data of the target competition player when the target competition player is in the area without an internet-connected camera, and thus the target live broadcast screen presenting the current on-site situation is obtained accordingly. In this way, compared with the prior art of presenting the event site through the stadium map and the player positioning icon, this application can simulate a live broadcast screen containing people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast screen presentation and the viewing experience of the audience. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0017] Figure 1 is a schematic structural diagram of a competition live broadcast system provided by an embodiment of the present application;
[0018] Figure 2 is a schematic structural diagram of a server in a competition live broadcast system provided by an embodiment of the present application;
[0019] Figure 3 is a schematic flowchart of a data processing method for competition live broadcast provided by an embodiment of the present application;
[0020] Figure 4 is a schematic diagram of a scenario of a data processing method for competition live broadcast provided by an embodiment of the present application;
[0021] Figure 5 It is a block diagram of the functional units of a data processing device for live sports events provided by an embodiment of the present application;
[0022] Figure 6 It is a block diagram of the functional units of another data processing device for live sports events provided by an embodiment of the present application;
[0023] Figure 7 It is a block diagram of the structure of a server provided by an embodiment of the present application. Detailed implementation manners
[0024] In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present application.
[0025] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products or devices.
[0026] Referring to "embodiments" in this context means that the specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.
[0027] The "and / or" in the embodiments of the present application describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent the following three situations: A exists alone; both A and B exist simultaneously; B exists alone. Among them, A and B can be singular or plural.
[0028] In the embodiments of the present application, the symbol " / " can represent an "or" relationship between the associated objects before and after. In addition, the symbol " / " can also represent a division sign, that is, perform a division operation. For example, A / B can represent A divided by B.
[0029] The "at least one (piece)" or its similar expression in the embodiments of the present application refers to any combination of these items, including any combination of a single item (piece) or multiple items (pieces), which means one or more, and multiple means two or more. For example, at least one (piece) of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.
[0030] In the embodiments of the present application, "equal to" can be used in combination with "greater than", which is applicable to the technical solutions adopted when it is greater than, and can also be used in combination with "less than", which is applicable to the technical solutions adopted when it is less than. When "equal to" is used in combination with "greater than", it is not used in combination with "less than"; when "equal to" is used in combination with "less than", it is not used in combination with "greater than".
[0031] To better understand the solutions of the embodiments of the present application, the terminal devices, related concepts, and backgrounds that may be involved in the embodiments of the present application will be introduced first below.
[0032] Beidou positioning: The receiver in the terminal device capable of Beidou satellite positioning can continuously capture and receive navigation signals from Beidou satellites. These signals contain the orbital parameters of the satellites, time information, and necessary navigation telegrams. By processing and calculating these signals, a high-precision positioning function can be achieved.
[0033] In many outdoor event areas, there are problems of lack of conventional network signal coverage or unstable network signals. In the prior art, when there is no stable coverage of conventional network signals, the situation of the event site is presented through the competition venue map and the positioning icons of the contestants. However, since a live broadcast picture containing the moving images of the athletes and the surrounding intuitive environmental images cannot be formed, the information richness of the live broadcast picture is low, and the viewing experience of the audience is poor.
[0034] To solve the above problems, the embodiments of the present application provide a data processing method and device for event live broadcast. When the target competition contestant is in an area without an internet-connected camera, this method determines the environmental image of the surrounding environment where the target competition contestant is currently located and the current moving image based on the current Beidou positioning and current movement data of the target competition contestant, and thus obtains a target live broadcast picture presenting the current on-site situation. In this way, compared with the situation of presenting the event site through the competition venue map and the positioning icons of the contestants in the prior art, the present application can simulate a live broadcast picture containing people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast picture and the viewing experience of the audience.
[0035] Please refer to Figure 1 , Figure 1 which is a schematic structural diagram of an event live broadcast system provided by the embodiments of the present application. As Figure 1As shown, the event live broadcast system 100 includes a terminal device 110 and a server 120. The terminal device 110 is communicatively connected to the server 120. The server 120 can be a single server or a server cluster composed of multiple servers. The terminal device 110 can be a mobile phone terminal, a Beidou satellite watch, a Beidou box, etc.
[0036] In the daily use of the event live broadcast system 100, the server 120 obtains the current Beidou positioning and current motion data of the target competition player. The current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion situation of the target competition player. When it is detected that the target competition player enters the area without an Internet-connected camera, the target environmental image is determined according to the current Beidou positioning and the geographical environment library. The geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning. The target motion image is determined according to the current motion data and the target digital human. The target digital human is used to represent the image of the target competition player when performing the target event. The target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target competition player when the physical motion situation is the current motion data. The target live broadcast image is determined according to the target environmental image and the target motion image. The target live broadcast image is used to represent the on-site situation of the target competition player at the current Beidou positioning.
[0037] Please refer to Figure 2 , Figure 2 is a schematic structural diagram of a server in an event live broadcast system provided by an embodiment of the present application. As Figure 2As shown, the server 120 includes a processor 210 and a memory 220, and the processor 210 is communicatively connected to the memory 220. Among them, one or more programs are stored in the memory 220, and the one or more programs are configured to be executed by the processor 210. The functions of the one or more programs are to obtain the current Beidou positioning and current motion data of the target competition player. The current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion condition of the target competition player; when it is detected that the target competition player enters the area photographed by the non-networked camera, determine the target environmental image according to the current Beidou positioning and the geographical environment library. The geographical environment library is used to indicate the geographical environment along the competition route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning; determine the target motion image according to the current motion data and the target digital human. The target digital human is used to represent the image of the target competition player when performing the target event. The target event is the competition event corresponding to the competition route, and the target motion image is used to represent the motion image of the target competition player when the physical motion condition is the current motion data; determine the target live broadcast screen according to the target environmental image and the target motion image. The target live broadcast screen is used to represent the on-site situation of the target competition player at the current Beidou positioning.
[0038] The following introduces a data processing method for event live broadcast provided by an embodiment of the present application.
[0039] Please refer to Figure 3 , Figure 3 which is a schematic flowchart of a data processing method for event live broadcast provided by an embodiment of the present application, and is applied to the server 120 in the event live broadcast system 100 as shown in Figure 1 The event live broadcast system 100 includes a terminal device 110 and a server 120. The terminal device 110 is communicatively connected to the server 120. The server 120 can be a single server or a server group composed of multiple servers. The terminal device 110 can be a mobile phone terminal, a Beidou satellite watch, a Beidou box, etc.; as shown in Figure 3 , the method includes the following steps:
[0040] Step S301, obtain the current Beidou positioning and current motion data of the target competition player.
[0041] Among them, the current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion condition of the target competition player.
[0042] Among them, the current Beidou positioning is obtained by the terminal device 110 capturing and receiving navigation signals from Beidou satellites for processing and calculation, and the terminal device 110 forwards the current Beidou positioning to the server 120 through the Beidou short message function via Beidou satellites.
[0043] Among them, the current motion data is recorded by the terminal device 110 during the competition and forwarded to the server 120 through the Beidou short message function via Beidou satellites.
[0044] Step S302, when it is detected that the target competition player enters the area without an internet-connected camera, determine the target environmental image according to the current Beidou positioning and the geographical environment library.
[0045] Among them, the geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning.
[0046] In a possible embodiment, the determining the target environmental image according to the current Beidou positioning and the geographical environment library includes: querying the geographical environment library according to the current Beidou positioning to determine the basic environmental image corresponding to the current Beidou positioning; determining the on-site environmental information corresponding to the current Beidou positioning, where the on-site environmental information is used to indicate the on-site environmental situation of the current position of the target competition player; and determining the target environmental image according to the on-site environmental information and the basic environmental image.
[0047] Among them, the geographical environment library is pre-constructed, and the construction process of the geographical environment library includes the following steps: determining a plurality of collection points according to the event route; determining the collection Beidou positioning corresponding to each collection point among the plurality of collection points, where the collection Beidou positioning is used to indicate the position of the corresponding collection point; obtaining a plurality of collection tasks according to the collection tasks corresponding to the collection Beidou positioning corresponding to each collection point; sending the plurality of collection tasks to the route scanning subsystem, so that the route scanning subsystem sends a plurality of environmental slice alignment data groups to the server; receiving the plurality of environmental slice alignment data groups; and constructing the geographical environment library corresponding to the event route according to the plurality of environmental slice alignment data groups.
[0048] Among them, the route scanning subsystem includes a management terminal, a route scanning device, and a Beidou positioning terminal. The management terminal is communicatively connected to the route scanning device and the Beidou positioning terminal. The route scanning device is communicatively connected to the Beidou positioning terminal. The Beidou positioning terminal is used to determine the current Beidou positioning. The management terminal in the route scanning subsystem receives the multiple collection tasks and performs the following operations for the multiple collection tasks: When it is detected by the Beidou positioning terminal that the current Beidou positioning is the collection Beidou positioning corresponding to the currently processed collection task, the route scanning device is used to collect images of the position indicated by the current Beidou positioning to obtain environmental image slices; The environmental image slices are aligned with the current Beidou positioning to obtain an environmental slice alignment data group, completing the currently processed collection task, and then performing the next collection task; Repeat the above steps until all the multiple collection tasks are completed to obtain multiple environmental slice alignment data groups; The multiple environmental slice alignment data groups are sent to the server.
[0049] Among them, for the race route, the software system provides a route scanning function. The administrator of the race organizer logs in to the administrator account through the management terminal, such as a mobile phone, and enters the function interface through the race APP. The function interface is provided with a "route scanning function". When this function is enabled, a Beidou positioning terminal binding interface pops up on the mobile phone, requesting to bind a Beidou positioning terminal. After the device binding is completed, it continues to jump to the route scanning device binding interface, requesting to bind a route scanning device for this route scanning event. The route scanning device can be, for example, a camera, etc. After the binding operation is completed, the mobile phone reminds the administrator to complete the multiple collection tasks. For the currently processed collection task, the mobile phone prompts the administrator through the visual interface to use the route scanning device to collect images at the position indicated by the collection Beidou positioning corresponding to the currently processed collection task. After the administrator completes the image collection, the mobile phone aligns the collected environmental image slices with the current Beidou positioning when collecting these environmental image slices to obtain the environmental slice alignment data group for the currently processed collection task, and thus repeats this process to obtain multiple environmental slice alignment data groups.
[0050] Among them, after the management terminal completes the multiple collection tasks, it can return to an area covered by a conventional network. On the mobile phone APP side, click to complete the collection and upload all the recorded videos, and upload the multiple environmental slice alignment data groups to the server through a conventional network, such as a wifi network.
[0051] Among them, in the geographical environment library, each Beidou positioning corresponds to at least one environmental image slice. Based on the at least one environmental image slice, scene modeling is performed to obtain the basic environmental image corresponding to each Beidou positioning.
[0052] It can be seen that in this example, the geographical environment database is queried according to the current Beidou positioning to obtain the basic environment image, so as to determine the target environment image based on the on-site environment information corresponding to the current Beidou positioning and the basic environment image, and thus obtain the target live broadcast image presenting the current on-site situation accordingly. In this way, compared with the prior art of presenting the event site through the stadium map and the player positioning icons, the present application can simulate a live broadcast image including people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast image presentation and the viewing experience of the audience.
[0053] In a possible embodiment, the on-site environment information includes target meteorological information, and the target meteorological information is used to indicate the weather condition at the current position of the target competition player. The determining the target environment image according to the on-site environment information and the basic environment image includes: determining a target weather effect and a target light effect according to the target meteorological information; and determining the target environment image according to the target weather effect, the target light effect and the basic environment image.
[0054] Among them, the target meteorological information includes weather condition, temperature, precipitation, etc., and the weather condition includes sunny, rainy, cloudy, rain turning to sunny, etc.
[0055] Among them, both the target weather effect and the target light effect are special scene effects corresponding to the target weather information. For example, when the target weather information includes light rain, the target weather effect is light rain and the target light effect is relatively dim light.
[0056] Among them, the determining the target environment image according to the target weather effect, the target light effect and the basic environment image means correcting the original weather effect and light effect in the basic environment image according to the target weather effect and the target light effect.
[0057] It can be seen that in this example, the geographical environment database is queried according to the current Beidou positioning to obtain the basic environment image, and then the basic environment image is corrected according to the target weather information to obtain the target environment image, and thus obtain the target live broadcast image presenting the current on-site situation accordingly. In this way, compared with the prior art of presenting the event site through the stadium map and the player positioning icons, the present application can simulate a live broadcast image including people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast image presentation and the viewing experience of the audience.
[0058] In a possible embodiment, determining the target environmental image according to the target weather effect, the target light effect, and the basic environmental image includes: obtaining a target captured image, where the target captured image is a live image captured by the network camera closest to the target competition player; determining the route status information of the event route according to the target captured image, where the route status information includes road flatness, road dryness / wetness, and road visibility; determining a corrected environmental image according to the route status information and the basic environmental impact; and determining the target environmental image according to the target weather effect, the target light effect, and the corrected environmental image.
[0059] Among them, a plurality of network cameras are arranged on the sections of the event route where there is stable coverage of regular network signals. The target captured image is a live image captured by the network camera closest to the target competition player among the plurality of network cameras.
[0060] Among them, the route status information is obtained by performing image recognition and information extraction on the target captured image.
[0061] Among them, determining the corrected environmental image according to the route status information and the basic environmental impact means correcting the original road flatness, road dryness / wetness, and road visibility in the basic environmental image according to the road flatness, the road dryness / wetness, and the road visibility.
[0062] It can be seen that in this example, the basic environmental image is obtained by querying the geographical environment database according to the current Beidou positioning, and then the basic environmental image is corrected according to the target weather information and the target captured image to obtain the target environmental image. Thus, the target live broadcast image presenting the current on-site situation is obtained accordingly. In this way, compared with the situation of presenting the event site through the stadium map and the player positioning icon in the prior art, the present application can simulate a live broadcast image including people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast image presentation and the viewing experience of the audience.
[0063] Step S303, determining the target motion image according to the current motion data and the target digital human.
[0064] Among them, the target digital human is used to represent the image of the target competition player when performing the target event. The target event is the competition event corresponding to the event route. The target motion image is used to represent the motion image of the target competition player when the body motion condition is the current motion data.
[0065] In a possible embodiment, determining the target motion image according to the current motion data and the target digital human includes: obtaining the historical motion data of the target competition player, where the historical motion data is used to characterize the physical motion of the target competition player in the past for the target event; determining the historical motion data as training data to obtain a target digital twin model; performing a rehearsal on the target digital twin model according to the target meteorological information and the route status information to obtain the target motion state of the target competition player when the physical motion condition is the current motion data; and determining the target motion image according to the target motion state and the target digital human.
[0066] Among them, the current motion data includes the motion duration of the target competition player, etc.
[0067] Among them, the target digital twin model refers to a model object that provides decision support for an entity object in the digital space during the digital twin process.
[0068] Among them, determining the historical motion data as training data to obtain a target digital twin model includes: obtaining a preset initial digital twin model; determining the historical motion data as training data, and performing incremental learning on the initial digital twin model to obtain the target digital twin model.
[0069] Among them, determining the historical motion data as training data and performing incremental learning on the initial digital twin model to obtain the target digital twin model includes: opening a target thread, and training the initial digital twin model in the target thread using the historical motion data and based on an incremental learning method.
[0070] It can be seen that in this example, the target motion state of the target competition player at present is output through the target digital twin model, and then the target motion image of the target competition player is determined according to the target motion state and the target digital human representing the image of the target competition player, so as to obtain the target live broadcast screen presenting the current on-site situation accordingly. In this way, compared with presenting the event site through a stadium map and a player positioning icon in the prior art, the present application can simulate a live broadcast screen containing characters and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast screen and the viewing experience of the audience.
[0071] In a possible embodiment, the pre-play of the target digital twin model based on the target meteorological information and the route status information to obtain the target motion state of the target competition player when the body motion condition is the current motion data includes: obtaining the pre-play result of the target digital twin model; constructing a dynamic change model of the motion state corresponding to the target digital twin model according to the pre-play result; and determining the target motion state according to the current motion data and the dynamic change model of the motion state.
[0072] Wherein, the pre-play result is a plurality of target digital twin sub-models corresponding one by one to multiple stages of the target project.
[0073] Wherein, the constructing a dynamic change model of the motion state corresponding to the target digital twin model according to the pre-play result includes: combining the plurality of target digital twin sub-models in chronological order to obtain the dynamic change model of the motion state.
[0074] Wherein, determining the target motion state according to the current motion data and the dynamic change model of the motion state may be, for example, inputting the motion duration in the current motion data, such as 6 hours, into the dynamic change model of the motion state, and the dynamic change model of the motion state outputs the motion state of the target user continuously exercising for 6 hours, such as a breathing rate of 25 times per minute, a heart rate of 140 times per minute, a sweating amount of 1000 ml, and a physical state of being relatively tired.
[0075] It can be seen that in this example, a dynamic change model of the motion state is constructed according to the pre-play result of the target digital twin model, and thus a target live broadcast screen presenting the current on-site situation is obtained. In this way, compared with the prior art of presenting the event site through a stadium map and player positioning icons, the present application can simulate a live broadcast screen containing characters and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast screen and the viewing experience of the audience.
[0076] In a possible embodiment, the method for determining the target digital human includes the following steps: obtaining a preset initial digital human and pre-stored image data of the target competition player, where the pre-stored image data is used to represent the personal image of the target competition player; and updating the initial digital human according to the pre-stored image data to obtain the target digital human.
[0077] Wherein, the pre-stored image data is determined according to the pre-collected image or image video of the target competition player, and specifically, it can be obtained by performing image recognition and information extraction on the image or image video of the target competition player.
[0078] Among them, updating the initial digital human according to the pre-stored image data to obtain the target digital human may specifically be modifying the texture data of the initial digital human according to the pre-stored image data.
[0079] It can be seen that in this example, the target digital human is determined according to the pre-stored image data of the target competition player, so as to present a target live broadcast image that conforms to the image of the target competition player. In this way, compared with the situation of presenting the event site through the stadium map and the player positioning icon in the prior art, the present application can simulate a live broadcast image containing people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast image presentation and the viewing experience of the audience.
[0080] Step S304, determining a target live broadcast image according to the target environmental image and the target motion image.
[0081] Among them, the target live broadcast image is used to represent the on-site situation of the target competition player at the current Beidou positioning.
[0082] Among them, determining the target live broadcast image according to the target environmental image and the target motion image includes: determining a on-site environmental image according to the target environmental image and the target motion image; performing a frame capture on the on-site environmental image to obtain the target live broadcast image.
[0083] Among them, determining the target live broadcast image according to the target environmental image and the target motion image may, for example, input the target environmental image and the target motion image into a preset generative AI model to obtain the target live broadcast image.
[0084] Please refer to Figure 4 , Figure 4 is a schematic diagram of a scenario of a data processing method for event live broadcast provided by an embodiment of the present application. As Figure 4 shown, the target environmental image 1 and the target motion image 2 are 3D stereoscopic images. The target motion image 2 is placed in the target environmental image 1 to obtain a on-site environmental image 3, and then a frame capture is performed on the on-site environmental image to obtain a target live broadcast image 4.
[0085] It can be seen that in this application, the server obtains the current Beidou positioning and current motion data of the target competition player. The current Beidou positioning is used to represent the current position of the target competition player, and the current motion data is used to represent the current physical motion situation of the target competition player. When it is detected that the target competition player enters the area where there is no network camera shooting, the target environmental image is determined according to the current Beidou positioning and the geographical environment library. The geographical environment library is used to indicate the geographical environment along the event route corresponding to the target competition player, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning. The target motion image is determined according to the current motion data and the target digital human. The target digital human is used to represent the image of the target competition player when performing the target event. The target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target competition player when the physical motion situation is the current motion data. The target live broadcast screen is determined according to the target environmental image and the target motion image. The target live broadcast screen is used to represent the on-site situation of the target competition player at the current Beidou positioning. Since when the target competition player is in the area where there is no network camera shooting, the environmental image of the surrounding environment where the target competition player is currently located and the current motion image are determined according to the current Beidou positioning and the current motion data of the target competition player, and thus the target live broadcast screen presenting the current on-site situation is obtained. In this way, compared with the prior art of presenting the event site through the stadium map and the player positioning icon, this application can simulate a live broadcast screen containing people and the environment that directly presents the on-site situation, thereby improving the information richness of the live broadcast screen presentation and the viewing experience of the audience.
[0086] The above mainly introduces the solution of the embodiment of this application from the perspective of the execution process on the method side. It can be understood that in order for the controller to implement the above functions, it includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments provided in this article, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.
[0087] Consistent with the above-described embodiments, please refer to Figure 5 , Figure 5 which is a block diagram of the functional units of a data processing device for event live broadcast provided by an embodiment of this application, as Figure 5As shown in the figure, the data processing device 500 for live sports events includes: a first receiving unit 501, configured to obtain the current Beidou positioning and current motion data of the target athlete. The current Beidou positioning is used to represent the current position of the target athlete, and the current motion data is used to represent the current physical motion of the target athlete; a first processing unit 502, configured to, when detecting that the target athlete enters the area where there is no network camera, determine a target environmental image according to the current Beidou positioning and the geographical environment library. The geographical environment library is used to indicate the geographical environment along the event route corresponding to the target athlete, and the target environmental image is used to represent the geographical environment corresponding to the current Beidou positioning; determine a target motion image according to the current motion data and the target digital human. The target digital human is used to represent the image of the target athlete when performing the target event. The target event is the competition event corresponding to the event route, and the target motion image is used to represent the motion image of the target athlete when the physical motion is the current motion data; determine a target live broadcast screen according to the target environmental image and the target motion image. The target live broadcast screen is used to represent the on-site situation of the target athlete at the current Beidou positioning.
[0088] In a possible embodiment, in terms of determining the target environmental image according to the current Beidou positioning and the geographical environment library, the first processing unit 502 is specifically configured to: query the geographical environment library according to the current Beidou positioning to determine the basic environmental image corresponding to the current Beidou positioning; determine the on-site environmental information corresponding to the current Beidou positioning. The on-site environmental information is used to indicate the on-site environmental situation of the current position of the target athlete; determine the target environmental image according to the on-site environmental information and the basic environmental image.
[0089] In a possible embodiment, the on-site environmental information includes target meteorological information. The target meteorological information is used to indicate the weather condition of the current position of the target athlete. In terms of determining the target environmental image according to the on-site environmental information and the basic environmental image, the first processing unit 502 is specifically configured to: determine a target weather effect and a target light effect according to the target meteorological information; determine the target environmental image according to the target weather effect, the target light effect and the basic environmental image.
[0090] In a possible embodiment, in determining the target environmental image based on the target weather effect, the target light effect, and the base environmental image, the first processing unit 502 is specifically configured to: obtain a target captured image, where the target captured image is a live image captured by a network camera closest to the target competition player; determine route status information of the event route according to the target captured image, where the route status information includes road flatness, road dryness / wetness, and road visibility; determine a corrected environmental image according to the route status information and the base environmental impact; and determine the target environmental image according to the target weather effect, the target light effect, and the corrected environmental image.
[0091] In a possible embodiment, in determining the target motion image based on the current motion data and the target digital human, the first processing unit 502 is specifically configured to: obtain historical motion data of the target competition player, where the historical motion data is used to characterize the physical motion of the target competition player in the past for the target event; determine the historical motion data as training data to obtain a target digital twin model; perform a preview on the target digital twin model according to the target meteorological information and the route status information to obtain a target motion state of the target competition player when the physical motion condition is the current motion data; and determine the target motion image according to the target motion state and the target digital human.
[0092] In a possible embodiment, in performing a preview on the target digital twin model according to the target meteorological information and the route status information to obtain a target motion state of the target competition player when the physical motion condition is the current motion data, the first processing unit 502 is specifically configured to: obtain a preview result of the target digital twin model; construct a motion state dynamic change model corresponding to the target digital twin model according to the preview result; and determine the target motion state according to the current motion data and the motion state dynamic change model.
[0093] In a possible embodiment, the data processing device 500 for event live broadcast is specifically further configured to: obtain a preset initial digital human and pre-stored image data of the target competition player, where the pre-stored image data is used to characterize the personal image of the target competition player; and update the initial digital human according to the pre-stored image data to obtain the target digital human.
[0094] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part, and will not be elaborated here.
[0095] In the case of adopting an integrated unit, such asFigure 6 As shown Figure 6 is a block diagram of the functional units of another data processing device for live sports event provided in an embodiment of the present application. In Figure 6 , the data processing device 500 for live sports event includes: a processing module 612 and a communication module 611. The processing module 612 is used to control and manage the actions of the data processing device 500 for live sports event. For example, it executes the steps of the first receiving unit 501 and the first processing unit 502, and / or is used to execute other processes of the technologies described herein. The communication module 611 is used to support the interaction between the data processing device 500 for live sports event and other devices. As Figure 6 shown, the data processing device 500 for live sports event may further include a storage module 613, and the storage module 613 is used to store the program code and data of the data processing device 500 for live sports event.
[0096] Among them, the processing module 612 may be a processor or a controller. For example, it may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in connection with the disclosure of the present application. The processor may also be a combination that implements computing functions, such as a combination including one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 611 may be a transceiver, an RF circuit or a communication interface, etc. The storage module 613 may be a memory.
[0097] Among them, all relevant contents of each scenario involved in the above method embodiment can be cited in the function description of the corresponding functional module, and will not be repeated here. The above data processing device 500 for live sports event can all execute the above Figure 3 shown data processing method for live sports event.
[0098] The above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired or wireless manner. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more collections of available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.
[0099] Figure 7 is a structural block diagram of a server provided by an embodiment of the present application. As Figure 7 shown, the server 120 may include one or more of the following components: a processor 210, and a memory 220 coupled to the processor 210. The memory 220 may store one or more computer programs 221, and the one or more computer programs 221 may be configured to implement the methods described in the above embodiments when executed by the one or more processors 210.
[0100] The processor 210 may include one or more processing cores. The processor 210 connects various parts within the entire server 120 through various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 220, and by invoking the data stored in the memory 220, it performs various functions of the server 120 and processes data. Optionally, the processor 210 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLA). The processor 210 may integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing display content; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 210 and may be implemented separately through a communication chip.
[0101] The memory 220 may include random access memory (RAM) and may also include read-only memory (ROM). The memory 220 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 220 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created during the use of the server 120.
[0102] It can be understood that the server 120 may include more or fewer structural elements than those shown in the above block diagram, which is not limited herein. An embodiment of the present application provides a computer-readable storage medium, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, the steps of the method according to any possible embodiment are implemented.
[0103] It should be understood that in various embodiments of the present application, the magnitudes of the serial numbers of the above processes do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
[0104] In several embodiments provided by the present application, it should be understood that the disclosed methods, apparatuses, and systems can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of the unit is only a logical function division, and there can be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the apparatuses or units can be in electrical, mechanical, or other forms.
[0105] The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0106] In addition, each functional unit in various embodiments of the present invention can be integrated in a processing unit, or each unit can be physically included separately, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a combination of hardware and software functional units.
[0107] The integrated units implemented in the form of software functional units can be stored in a computer-readable storage medium. The above-mentioned software functional units stored in a storage medium include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute some steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: USB flash drive, mobile hard disk, magnetic disk, optical disc, volatile memory or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus random access memory (DR RAM), etc., and various media that can store program codes.
[0108] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various modifications and alterations, including combinations of the above different functions and implementation steps, including software and hardware implementation manners, all within the protection scope of the present invention.
Claims
1. A data processing method for live event broadcast, characterized in that: Applied to a server of a sports live broadcast system, the method comprises: Acquire a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant; When it is detected that the target contestant enters the shooting area without networked cameras, the basic environment image corresponding to the current Beidou positioning is determined by querying the geographical environment library according to the current Beidou positioning, and the geographical environment library is used to indicate the geographical environment along the route of the event corresponding to the target contestant; the on-site environment information corresponding to the current Beidou positioning is determined, and the on-site environment information is used to indicate the on-site environment conditions of the current position of the target contestant, and the on-site environment information includes target meteorological information, and the target meteorological information is used to indicate the weather conditions of the current position of the target contestant; the target weather effect and the target light effect are determined according to the target meteorological information; the target shooting picture is obtained, and the target shooting picture is the on-site picture shot by the networked camera closest to the target contestant; the route status information of the event route is determined according to the target shooting picture, and the route status information includes road flatness, road dryness and wetness, and road visibility; the corrected environment image is determined according to the route status information and the basic environment image; the target environment image is determined according to the target weather effect, the target light effect and the corrected environment image, and the target environment image is used to characterize the geographical environment corresponding to the current Beidou positioning; Determine a target motion image according to the current motion data and the target digital human, the target digital human being is used to represent the image of the target contestant when performing a target event, the target event is the event corresponding to the race route, and the target motion image is used to represent the motion image of the target contestant when the physical motion condition is the current motion data; A target live broadcast picture is determined according to the target environment image and the target motion image, and the target live broadcast picture is used to represent the on-site situation of the target contestant in the current Beidou positioning.
2. The method according to claim 1, characterized in that The step of determining the target motion image according to the current motion data and the target digital human comprises: Acquire historical motion data of the target contestant, where the historical motion data is used to characterize the physical motion of the target contestant in the past when performing the target event; Determining the historical motion data as training data to obtain a target digital twin model; Previewing the target digital twin model according to the target meteorological information and the route status information to obtain a target motion state of the target contestant when the physical motion condition is the current motion data; The target motion image is determined according to the target motion state and the target digital human.
3. The method according to claim 2, characterized in that The step of previewing the target digital twin model according to the target meteorological information and the route status information to obtain the target motion state of the target contestant when the physical motion condition is the current motion data includes: Obtaining a preview result of the target digital twin model; According to the preview results, a dynamic change model of the motion state corresponding to the target digital twin model is constructed; The target motion state is determined according to the current motion data and the motion state dynamic change model.
4. The method according to claim 3, characterized in that The method for determining the target digital human comprises the following steps: Acquire a preset initial digital human and pre-stored image data of the target contestant, wherein the pre-stored image data is used to represent the personal image of the target contestant; The initial digital human is updated according to the pre-stored image data to obtain the target digital human.
5. A data processing device for live event broadcast, characterized in that: A server applied to a sports live broadcast system, the device comprising: A first receiving unit is used to obtain a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant; The first processing unit is used to, when detecting that the target contestant enters the non-networked camera shooting area, query the geographical environment library according to the current Beidou positioning to determine the basic environment image corresponding to the current Beidou positioning, and the geographical environment library is used to indicate the geographical environment along the competition route corresponding to the target contestant; determine the on-site environment information corresponding to the current Beidou positioning, and the on-site environment information is used to indicate the on-site environment conditions of the current position of the target contestant, and the on-site environment information includes target meteorological information, and the target meteorological information is used to indicate the weather conditions of the current position of the target contestant; determine the target weather effect and the target light effect according to the target meteorological information; obtain the target shooting picture, and the target shooting picture is the on-site picture shot by the networked camera closest to the target contestant; determine the route status information of the competition route according to the target shooting picture, and The route status information includes road flatness, road dryness and wetness, and road visibility; a corrected environmental image is determined based on the route status information and the basic environmental image; a target environmental image is determined based on the target weather effect, the target light effect, and the corrected environmental image, and the target environmental image is used to characterize the geographical environment corresponding to the current Beidou positioning; a target motion image is determined based on the current motion data and a target digital human, and the target digital human is used to characterize the image of the target contestant when performing a target event, the target event being the event corresponding to the event route, and the target motion image is used to characterize the motion image of the target contestant when the physical motion condition is the current motion data; a target live broadcast screen is determined based on the target environmental image and the target motion image, and the target live broadcast screen is used to characterize the on-site situation of the target contestant at the current Beidou positioning.
6. A server, characterized in that: The method comprises a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 4.
7. A computer-readable storage medium, characterized in that: A computer program / instruction is stored thereon, and when the computer program / instruction is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Simulation figure sport match live broadcast software scheme
CN106257539A
Image generation method and device and vehicle
CN117953103A