Method and device for generating live event screen

Abstract

The present application discloses a method and device for generating a live broadcast screen of an event, the method obtaining the current Beidou positioning and current motion data of a target contestant; when it is detected that the target contestant enters a non-networked camera shooting area, at least two target screens corresponding to the target contestant are determined according to the current Beidou positioning; the target live broadcast screen is determined according to at least two target screens, the current Beidou positioning and the current motion data, and the target live broadcast screen is used to characterize the on-site situation of the target contestant at the current Beidou positioning. Since the target live broadcast screen is determined according to the target screen indicating the on-site situation of the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning and the current motion data of the target contestant, the authenticity and accuracy of the generated target live broadcast screen are higher.

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a method and device for generating a live broadcast screen of an event. Background Art

[0002] At present, many areas involved in long-distance outdoor events have problems with no conventional network signal coverage or unstable network signals. In the prior art, when there is stable coverage of conventional network signals, the images obtained by the networked cameras arranged at the stadium are used as live broadcast images. When there is no stable coverage of conventional network signals, virtual live broadcast images are generated based on the sports data and positioning information reported at the competition site. However, due to the long distances covered by long-distance outdoor events, the road conditions and light between different sections vary greatly, resulting in the problem of low authenticity and accuracy of the generated virtual live broadcast images. Summary of the invention

[0003] The present application proposes a method and device for generating a live broadcast picture of an event, so as to solve the problem of low authenticity and accuracy of the generated virtual live broadcast picture, and to improve the authenticity and accuracy of the generated virtual live broadcast picture.

[0004] In a first aspect, an embodiment of the present application provides a method for generating a live event screen, which is applied to a server of a live event system, and the method includes:

[0005] Acquire a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant;

[0006] When it is detected that the target contestant enters the non-networked camera shooting area, at least two target images corresponding to the target contestant are determined according to the current Beidou positioning, each of the at least two target images is used to indicate the on-site situation of the starting point or the end point of the non-networked camera shooting area;

[0007] A target live broadcast picture is determined according to the at least two target pictures, the current Beidou positioning and the current sports data, and the target live broadcast picture is used to represent the on-site situation of the target contestant at the current Beidou positioning.

[0008] In a second aspect, an embodiment of the present application provides a device for generating a live event screen, which is applied to a server of a live event system, and the device includes:

[0009] A first receiving unit is used to obtain a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant;

[0010] The first processing unit is used to determine at least two target images corresponding to the target player according to the current Beidou positioning when it is detected that the target player enters the shooting area of ​​the non-networked camera, and each of the at least two target images is used to indicate the on-site situation of the starting point or the end point of the shooting area of ​​the non-networked camera; determine a target live broadcast image according to the at least two target images, the current Beidou positioning and the current motion data, and the target live broadcast image is used to represent the on-site situation of the target player under the current Beidou positioning.

[0011] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the method described in any one of the first aspects.

[0012] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction, when executed by a processor, implements the steps of the method described in any one of the first aspects.

[0013] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements part or all of the steps of the method described in any one of the first aspects of the embodiments of the present application.

[0014] It can be seen that in this application, the server obtains the current Beidou positioning and current motion data of the target contestant, the current Beidou positioning is used to characterize the current position of the target contestant, and the current motion data is used to characterize the current physical movement of the target contestant; when the target contestant is detected to enter the non-networked camera shooting area, at least two target images corresponding to the target contestant are determined according to the current Beidou positioning, and each of the at least two target images is used to indicate the on-site situation of the starting point or end point of the non-networked camera shooting area; the target live broadcast image is determined according to at least two target images, the current Beidou positioning and the current motion data, and the target live broadcast image is used to characterize the on-site situation of the target contestant in the current Beidou positioning. Since the target live broadcast image is determined according to the target image indicating the on-site situation of the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning and the current motion data of the target contestant, the authenticity and accuracy of the generated target live broadcast image are higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 It is a structural diagram of a system for broadcasting a sports event provided by an embodiment of the present application;

[0017] Figure 2 It is a structural diagram of a server in a live event broadcasting system provided by an embodiment of the present application;

[0018] Figure 3 It is a flowchart of a method for generating a live event screen provided by an embodiment of the present application;

[0019] Figure 4 It is a scene schematic diagram of a method for generating a live broadcast screen of an event provided in an embodiment of the present application;

[0020] Figure 5 This is a block diagram of the functional units of a device for generating a live event screen provided in an embodiment of the present application;

[0021] Figure 6 It is a block diagram of the functional units of another device for generating a live event screen provided in an embodiment of the present application;

[0022] Figure 7 It is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0025] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0026] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist at the same time; B exists alone. Among them, A and B can be singular or plural.

[0027] In the embodiment of the present application, the symbol " / " can indicate that the objects associated with each other are in an "or" relationship. In addition, the symbol " / " can also indicate a division sign, that is, performing a division operation. For example, A / B can indicate A divided by B.

[0028] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0029] In the embodiments of the present application, "equal to" can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. When equal to is used in conjunction with greater than, it is not used in conjunction with less than; when equal to is used in conjunction with less than, it is not used in conjunction with greater than.

[0030] In order to better understand the solutions of the embodiments of the present application, the terminal devices, related concepts and backgrounds that may be involved in the embodiments of the present application are first introduced below.

[0031] Beidou positioning: The receiver in the terminal equipment capable of Beidou satellite positioning can continuously capture and receive navigation signals from Beidou satellites. These signals contain the satellite's orbital parameters, time information and necessary navigation messages. By processing and calculating these signals, high-precision positioning functions can be achieved.

[0032] At present, many areas involved in long-distance outdoor events have problems with no conventional network signal coverage or unstable network signals. In the prior art, when there is stable coverage of conventional network signals, the images obtained by the networked cameras arranged at the stadium are used as live broadcast images. When there is no stable coverage of conventional network signals, virtual live broadcast images are generated based on the sports data and positioning information reported at the competition site. However, due to the long distances covered by long-distance outdoor events, the road conditions and light between different sections vary greatly, resulting in the problem of low authenticity and accuracy of the generated virtual live broadcast images.

[0033] To solve the above problems, an embodiment of the present application provides a method and device for generating a live broadcast screen of an event. The method determines the target live broadcast screen based on a target screen indicating the on-site situation of the starting point or end point of the non-networked camera shooting area entered by the target competitor, the current Beidou positioning of the target competitor, and the current motion data, so that the generated target live broadcast screen has higher authenticity and accuracy.

[0034] See also Figure 1 , Figure 1 Schematic diagram of a system for broadcasting a sports event provided by an embodiment of the present application. Figure 1 As shown, the live broadcast system 100 includes a terminal device 110 and a server 120. The terminal device 110 is connected to the server 120 for communication. The server 120 can be a server or a server group composed of multiple servers. The terminal device 110 can be a mobile phone terminal, a Beidou satellite watch, a Beidou box, etc.

[0035] In daily use of the live event system 100, the server 120 obtains the current Beidou positioning and current motion data of the target player, the current Beidou positioning is used to characterize the current position of the target player, and the current motion data is used to characterize the current physical movement of the target player; when it is detected that the target player enters the shooting area of ​​the non-networked camera, at least two target pictures corresponding to the target player are determined according to the current Beidou positioning, and each of the at least two target pictures is used to indicate the on-site situation of the starting point or end point of the shooting area of ​​the non-networked camera; the target live picture is determined according to the at least two target pictures, the current Beidou positioning and the current motion data, and the target live picture is used to characterize the on-site situation of the target player at the current Beidou positioning.

[0036] See also Figure 2, Figure 2 Schematic diagram of the structure of a server in a live event broadcast system provided by an embodiment of the present application. Figure 2 As shown, the server 120 includes a processor 210 and a memory 220, and the processor 210 is communicatively connected to the memory 220. Among them, one or more programs are stored in the memory 220, and the one or more programs are configured to be executed by the processor 210. The function of the one or more programs is to obtain the current Beidou positioning and current motion data of the target contestant, the current Beidou positioning is used to characterize the current position of the target contestant, and the current motion data is used to characterize the current physical motion of the target contestant; when the target contestant is detected to enter the non-networked camera shooting area, at least two target pictures corresponding to the target contestant are determined according to the current Beidou positioning, and each of the at least two target pictures is used to indicate the on-site situation of the starting point or end point of the non-networked camera shooting area; the target live picture is determined according to at least two target pictures, the current Beidou positioning and the current motion data, and the target live picture is used to characterize the on-site situation of the target contestant in the current Beidou positioning.

[0037] The following describes a method for generating a live broadcast screen of an event provided by an embodiment of the present application.

[0038] See also Figure 3 , Figure 3 is a flow chart of a method for generating a live event screen provided by an embodiment of the present application, which is applied to Figure 1 The server 120 in the live broadcast system 100 shown in the figure includes a terminal device 110 and a server 120. The terminal device 110 is in communication connection with the server 120. The server 120 can be a single server or a server group consisting of multiple servers. The terminal device 110 can be a mobile phone terminal, a Beidou satellite watch, a Beidou box, etc. Figure 3 As shown, the method comprises the following steps:

[0039] Step S301, obtaining the current Beidou positioning and current motion data of the target contestant.

[0040] The current Beidou positioning is used to characterize the current position of the target contestant, and the current motion data is used to characterize the current physical motion of the target contestant.

[0041] The current Beidou positioning is obtained by the terminal device 110 capturing and receiving navigation signals from Beidou satellites for processing and calculation, and the terminal device 110 forwards the current Beidou positioning to the server 120 through Beidou satellites via the Beidou short message function.

[0042] The current sports data is recorded by the terminal device 110 during the game and forwarded to the server 120 via the Beidou satellite through the Beidou short message function.

[0043] Step S302: When it is detected that the target contestant enters a shooting area without a networked camera, at least two target images corresponding to the target contestant are determined according to the current Beidou positioning.

[0044] Among them, each of the at least two target images is used to indicate the on-site situation of the starting point or end point of the shooting area of ​​the non-networked camera.

[0045] The at least two target images are captured by networked cameras arranged on the race route.

[0046] Step S303: determine a target live broadcast picture according to the at least two target pictures, the current Beidou positioning and the current motion data.

[0047] The target live broadcast picture is used to represent the on-site situation of the target contestant at the current Beidou positioning.

[0048] In a possible embodiment, determining the target live broadcast screen according to the at least two target screens, the current Beidou positioning and the current motion data includes: determining a target environmental image according to the at least two target screens and the current Beidou positioning, the target environmental image being used to characterize the geographical environment corresponding to the current Beidou positioning; determining a target motion image according to the at least two target screens and the current motion data, the target motion image being used to characterize the motion image of the target contestant when the body motion condition is the current motion data; determining the target live broadcast screen according to the target environmental image and the target motion image.

[0049] The target environment image is obtained by 3D stereo modeling. The target motion image is a target digital human presenting the target motion state.

[0050] Wherein, determining the target live screen according to the target environment image and the target motion image includes: placing the target motion image in the target environment image to obtain a target scene image; and capturing an image of the target digital human in the target scene image to obtain the target live screen.

[0051] Wherein, the target digital human in the target on-site image is captured to obtain the target live broadcast screen.

[0052] It can be seen that in this example, the target environmental image is determined based on at least two target images and the current Beidou positioning, and the target motion image is determined based on at least two target images and the current motion data, thereby determining the target live broadcast image based on the target environmental image and the target motion image. Since the target live broadcast image is determined based on the target image of the on-site situation indicating the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning of the target contestant, and the current motion data, the generated target live broadcast image has higher authenticity and accuracy.

[0053] In a possible embodiment, determining the target environment image based on the at least two target pictures and the current Beidou positioning includes: determining target scene environment information based on the at least two target pictures and the current Beidou positioning, the target scene environment information being used to indicate the scene environment conditions of the current position of the target competition user; determining a basic environment image based on the current Beidou positioning and a geographic environment library; determining the target environment image based on the target scene environment information and the basic environment image.

[0054] Among them, the geographic environment library is pre-constructed, and the construction process of the geographic environment library includes the following steps: determining multiple collection points according to the event route; determining the collection Beidou positioning corresponding to each of the multiple collection points, and the collection Beidou positioning is used to indicate the position of the corresponding collection point; obtaining multiple collection tasks according to the collection tasks corresponding to the collection Beidou positioning corresponding to each collection point; sending the multiple collection tasks to the route scanning subsystem, so that the route scanning subsystem sends multiple environmental slice alignment data groups to the server; receiving the multiple environmental slice alignment data groups; and constructing the geographic environment library corresponding to the event route according to the multiple environmental slice alignment data groups.

[0055] Among them, the route scanning subsystem includes a management terminal, a route scanning device and a Beidou positioning terminal. The management terminal is communicatively connected with the route scanning device and the Beidou positioning terminal. The route scanning device is communicatively connected with the Beidou positioning terminal. The Beidou positioning terminal is used to determine the current Beidou positioning. The management terminal in the route scanning subsystem receives the multiple acquisition tasks and performs the following operations for the multiple acquisition tasks: when the Beidou positioning terminal detects that the current Beidou positioning is the acquired Beidou positioning corresponding to the currently processed acquisition task, the route scanning device is used to perform image acquisition on the position indicated by the current Beidou positioning to obtain an environmental image slice; the environmental image slice is aligned with the current Beidou positioning to obtain an environmental slice alignment data group, the currently processed acquisition task is completed, and the next acquisition task is executed; the above steps are repeated until all the multiple acquisition tasks are completed to obtain multiple environmental slice alignment data groups; and the multiple environmental slice alignment data groups are sent to the server.

[0056] Among them, for the event route, the software system provides a route scanning function. The administrator of the event organizer logs in to the administrator account through the management terminal, such as a mobile phone, through the event APP and enters the function interface. The function interface is provided with a "route scanning function". When this function is turned on, the mobile phone pops up the Beidou positioning terminal binding interface and requests to bind a Beidou positioning terminal. After the device binding is completed, it continues to jump to the route scanning device binding interface and requests to bind a route scanning device for this route scanning event. The route scanning device can be, for example, a camera. After completing the binding operation, the mobile phone reminds the administrator to complete the multiple collection tasks. For the currently processed collection task, the mobile phone prompts the administrator through a visual interface to use the route scanning device to collect images at the location indicated by the Beidou positioning corresponding to the currently processed collection task. After the administrator completes the image collection, the mobile phone aligns the collected environmental image slices with the current Beidou positioning of the environmental image slices to obtain the environmental slice alignment data group of the currently processed collection task, thereby repeating this process to obtain multiple environmental slice alignment data groups.

[0057] Among them, after completing the multiple collection tasks, the management terminal can return to the area with regular network coverage, click on the mobile phone APP to complete the collection and upload all recorded videos, and upload the multiple environmental slice alignment data groups to the server through a regular network, such as a wifi network.

[0058] Among them, in the geographic environment library, each Beidou positioning corresponds to at least one environmental image slice, and scene modeling is performed according to the at least one environmental image slice to obtain the basic environmental image corresponding to each Beidou positioning.

[0059] Among them, determining the target live broadcast picture according to the target environment image and the target motion image may, for example, be inputting the target environment image and the target motion image into a preset generative AI model to obtain the target live broadcast picture.

[0060] It can be seen that in this example, the target scene environment information is determined based on at least two target images and the current Beidou positioning, and then the basic environmental impact is determined based on the current Beidou positioning and the geographic environment library, so that the target environment image is determined based on the target scene environment information and the basic environment image, and then the target live broadcast image is determined based on the target environment image and the target motion image. Since the target live broadcast image is determined based on the target image of the on-site situation indicating the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning of the target contestant and the current motion data, the generated target live broadcast image has higher authenticity and accuracy.

[0061] In a possible embodiment, the at least two target screens include a first target screen and a second target screen, the first target screen is used to indicate the on-site situation of the starting point of the non-networked camera shooting area, and the second target screen is used to indicate the on-site situation of the end point of the non-networked camera shooting area, and the target scene environment information is determined according to the at least two target screens and the current Beidou positioning, including: determining the first scene environment information according to the first target screen, the first scene environment information is used to indicate the on-site environment situation of the starting point of the non-networked camera shooting area; determining the second scene environment information according to the second target screen, the second scene environment information is used to indicate the key on-site environment situation of the non-networked camera shooting area; determining the target scene environment information according to the current Beidou positioning, the first scene environment information and the second scene environment information.

[0062] The first scene environment information determined according to the first target screen may be image information obtained by performing image recognition on the first target screen. The second scene environment information determined according to the second target screen may be image information obtained by performing image recognition on the second target screen.

[0063] The on-site environmental conditions include road congestion, road flatness, road dryness and wetness, and road visibility.

[0064] It can be seen that in this example, the target scene environment information is determined based on the first scene environment information of the starting point of the non-networked camera shooting area and the second scene environment information of the end point of the non-networked camera shooting area, thereby determining the target environment image based on the target scene environment information and the basic environment image, and thereby determining the target live broadcast picture based on the target environment image and the target motion image. Since the target live broadcast picture is determined based on the target picture of the scene situation of the starting point or end point of the non-networked camera shooting area indicating the entry of the target contestant, the current Beidou positioning of the target contestant, and the current motion data, the generated target live broadcast picture has higher authenticity and accuracy.

[0065] In a possible embodiment, the target scene environment information includes target road visibility, and the determining of the target scene environment information according to the current Beidou positioning, the first scene environment information and the second scene environment information includes: determining the starting road visibility of the non-networked camera shooting area according to the first scene environment information; determining the end road visibility of the non-networked camera shooting area according to the second scene environment information; obtaining weather information corresponding to the current Beidou positioning; and determining the target road visibility according to the weather information, the starting road visibility and the end road visibility.

[0066] Wherein, the determining of the starting road visibility of the non-networked camera shooting area according to the first scene environment information may specifically be filtering, classifying and converging the first scene environment information to obtain the starting road visibility. The determining of the ending road visibility of the non-networked camera shooting area according to the second scene environment information may specifically be filtering, classifying and converging the second scene environment information to obtain the starting road visibility.

[0067] The weather information includes weather conditions, precipitation, temperature, etc. The weather conditions include sunny days, rainy days, cloudy days, rain turning to sunny days, etc.

[0068] Among them, determining the target road visibility based on the weather information, the starting road visibility and the endpoint road visibility includes: obtaining a preset field environment calculation model, the field environment calculation model is trained using historical weather information, historical starting road visibility and historical endpoint road visibility as training data; importing the weather information, the starting road visibility and the endpoint road visibility into the field environment calculation model, and inputting the current system time, thereby obtaining the target road visibility.

[0069] It can be seen that in this example, the target road visibility of the target contestant's location is determined based on the starting road visibility and the ending road visibility of the non-networked camera shooting area, thereby determining the target environmental image based on the target road visibility and the basic environmental image, and thereby determining the target live broadcast picture based on the target environmental image and the target motion image. Since the target live broadcast picture is determined based on the target picture of the on-site situation of the starting point or ending point of the non-networked camera shooting area indicating the target contestant's entry, the target contestant's current Beidou positioning and current motion data, the generated target live broadcast picture has higher authenticity and accuracy.

[0070] In a possible embodiment, determining a target motion image based on the at least two target screens and the current motion data includes: determining first on-site motion information based on the first target screen, the first target on-site motion information being used to indicate the motion status of the target competition user at the starting point of the non-networked camera shooting area; obtaining a target digital human corresponding to the target competition player, the target digital human being being used to represent the image of the target competition player when performing a corresponding competition event; determining a target motion image based on the first on-site motion information, the current motion data and the target digital human, the target motion image being used to represent the motion image of the target competition player when the body motion status is the current motion data.

[0071] Among them, the method for determining the target digital human includes the following steps: obtaining a preset initial digital human and pre-stored image data of the target contestant, wherein the pre-stored image data is used to characterize the personal image of the target contestant; updating the initial digital human according to the pre-stored image data to obtain the target digital human.

[0072] The pre-stored image data is determined based on a pre-collected image photo or image video of the target contestant, and can be specifically obtained by performing image recognition and information extraction on the image photo or image video of the target contestant.

[0073] Wherein, the updating of the initial digital human according to the pre-stored image data to obtain the target digital human may specifically be to modify the texture data of the initial digital human according to the pre-stored image data.

[0074] The determining of the first on-site motion information according to the first target picture may specifically be to perform image recognition on the first target picture to obtain the first on-site motion information. The first on-site motion information may be, for example, that the user's physical state is relatively relaxed.

[0075] The target environment image is obtained by 3D stereo modeling. The target motion image is a digital human presenting the target motion state.

[0076] Among them, see Figure 4 , Figure 4 Schematic diagram of a scenario of a method for generating a live event screen provided by an embodiment of the present application. Figure 4 As shown, when the target contestant 404 enters the non-networked camera shooting area 401, the starting point networked camera 402 that can capture the starting point of the non-networked camera shooting area 401 will capture the on-site situation of the target contestant 404 at the starting point of the non-networked camera shooting area 401, which is the first target picture among the at least two target pictures, and the end point networked camera 403 that can capture the end point of the non-networked camera shooting area 401 will capture the on-site situation of the target contestant 404 at the end point of the non-networked camera shooting area 401 during the current Beidou positioning, which is the second target picture among the at least two target pictures.

[0077] It can be seen that in this example, the first on-site motion information is determined based on the first target picture, and then the target motion image is determined based on the first on-site motion information, the current motion data and the target digital human, so that the target live broadcast picture is determined based on the target environment image and the target motion image. Since the target live broadcast picture is determined based on the target picture of the on-site situation indicating the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning of the target contestant and the current motion data, the generated target live broadcast picture has higher authenticity and accuracy.

[0078] In a possible embodiment, determining a target motion image based on the first on-site motion information, the current motion data and the target digital human includes: obtaining historical motion data of the target contestant, the historical motion data being used to characterize the physical motion conditions of the target contestant during past performances of the competition; determining the historical motion data as training data to obtain a target digital twin model; previewing the target digital twin model based on the first on-site motion information and the target on-site environment information to obtain a target motion state of the target contestant when the physical motion condition is the current motion data; and determining the target motion image based on the target motion state and the target digital human.

[0079] The current exercise data includes the exercise duration of the target contestant and the like.

[0080] Among them, the target digital twin model refers to the model object that provides decision support for the entity object in the digital space during the digital twin process.

[0081] Among them, determining the historical motion data as training data to obtain the target digital twin model includes: obtaining a preset initial digital twin model; determining the historical motion data as training data, performing incremental learning on the initial digital twin model, and obtaining the target digital twin model.

[0082] Among them, determining the historical motion data as training data, performing incremental learning on the initial digital twin model, and obtaining the target digital twin model includes: opening a target thread, and using the historical motion data in the target thread to train the initial digital twin model based on an incremental learning method.

[0083] Among them, the target digital twin model is previewed according to the target on-site environmental information and the first on-site motion information to obtain the target motion state of the target contestant when the body motion condition is the current motion data, including: obtaining the preview result of the target digital twin model; constructing a motion state dynamic change model corresponding to the target digital twin model according to the preview result; and determining the target motion state according to the current motion data and the motion state dynamic change model.

[0084] Among them, the preview results are multiple target digital twin models that correspond one-to-one to multiple stages of carrying out the target project.

[0085] Among them, constructing the motion state dynamic change model corresponding to the target digital twin model based on the preview result includes: combining the multiple target digital twin sub-models according to the time sequence to obtain the motion state dynamic change model.

[0086] Among them, the target motion state is determined according to the current motion data and the motion state dynamic change model. For example, the motion duration in the current motion data, such as 6 hours, is input into the motion state dynamic change model. The motion state dynamic change model outputs the calculated motion state of the target user who continues to exercise for 6 hours, such as a breathing rate of 25 times / minute, a heart rate of 140 times / minute, a sweat volume of 1000ml, and a relatively tired physical state.

[0087] It can be seen that in this example, by rehearsing the target digital twin model obtained by training according to the historical motion data of the target contestant, the target motion state of the target contestant when the body motion situation is the current motion data under the conditions of the first-site motion information and the target site environmental information is predicted, and then the target motion image is determined according to the target motion state and the target digital human, and the target live broadcast picture is determined according to the target environmental image and the target motion image. Since the target live broadcast picture is determined according to the target picture of the on-site situation indicating the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning of the target contestant and the current motion data, the generated target live broadcast picture has higher authenticity and accuracy.

[0088] It can be seen that in this application, the server obtains the current Beidou positioning and current motion data of the target contestant, the current Beidou positioning is used to characterize the current position of the target contestant, and the current motion data is used to characterize the current physical movement of the target contestant; when the target contestant is detected to enter the non-networked camera shooting area, at least two target images corresponding to the target contestant are determined according to the current Beidou positioning, and each of the at least two target images is used to indicate the on-site situation of the starting point or end point of the non-networked camera shooting area; the target live broadcast image is determined according to at least two target images, the current Beidou positioning and the current motion data, and the target live broadcast image is used to characterize the on-site situation of the target contestant in the current Beidou positioning. Since the target live broadcast image is determined according to the target image indicating the on-site situation of the starting point or end point of the non-networked camera shooting area entered by the target contestant, the current Beidou positioning and the current motion data of the target contestant, the authenticity and accuracy of the generated target live broadcast image are higher.

[0089] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that, in order to realize the above functions, the controller includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiment provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0090] In accordance with the above-mentioned embodiment, please refer to Figure 5 , Figure 5 is a block diagram of the functional units of a device for generating a live event screen provided by an embodiment of the present application, such as Figure 5As shown, the device 500 for generating the live broadcast screen of the event includes: a first receiving unit 501, used to obtain the current Beidou positioning and current motion data of the target contestant, the current Beidou positioning is used to characterize the current position of the target contestant, and the current motion data is used to characterize the current body movement of the target contestant; a first processing unit 502, used to determine at least two target screens corresponding to the target contestant according to the current Beidou positioning when it is detected that the target contestant enters the shooting area of ​​the non-networked camera, each of the at least two target screens is used to indicate the on-site situation of the starting point or end point of the shooting area of ​​the non-networked camera; determine the target live broadcast screen according to the at least two target screens, the current Beidou positioning and the current motion data, and the target live broadcast screen is used to characterize the on-site situation of the target contestant at the current Beidou positioning.

[0091] In a possible embodiment, in terms of determining the target live broadcast picture based on the at least two target pictures, the current Beidou positioning and the current motion data, the first processing unit 502 is specifically used to: determine a target environmental image based on the at least two target pictures and the current Beidou positioning, the target environmental image being used to characterize the geographical environment corresponding to the current Beidou positioning; determine a target motion image based on the at least two target pictures and the current motion data, the target motion image being used to characterize the motion image of the target contestant when his body motion condition is the current motion data; determine the target live broadcast picture based on the target environmental image and the target motion image.

[0092] In a possible embodiment, in terms of determining the target environmental image based on the at least two target images and the current Beidou positioning, the first processing unit 502 is specifically used to: determine target on-site environmental information based on the at least two target images and the current Beidou positioning, the target on-site environmental information being used to indicate the on-site environmental conditions of the current location of the target competition user; determine a basic environmental image based on the current Beidou positioning and the geographic environment library; determine the target environmental image based on the target on-site environmental information and the basic environmental image.

[0093] In a possible embodiment, the at least two target screens include a first target screen and a second target screen, the first target screen is used to indicate the on-site situation of the starting point of the non-networked camera shooting area, and the second target screen is used to indicate the on-site situation of the end point of the non-networked camera shooting area. In terms of determining the target scene environment information based on the at least two target screens and the current Beidou positioning, the first processing unit 502 is specifically used to: determine the first scene environment information based on the first target screen, the first scene environment information is used to indicate the on-site environment situation of the starting point of the non-networked camera shooting area; determine the second scene environment information based on the second target screen, the second scene environment information is used to indicate the key on-site environment situation of the non-networked camera shooting area; determine the target scene environment information based on the current Beidou positioning, the first scene environment information and the second scene environment information.

[0094] In a possible embodiment, the target scene environment information includes target road visibility. In terms of determining the target scene environment information based on the current Beidou positioning, the first scene environment information and the second scene environment information, the first processing unit 502 is specifically used to: determine the starting road visibility of the non-networked camera shooting area based on the first scene environment information; determine the end road visibility of the non-networked camera shooting area based on the second scene environment information; obtain weather information corresponding to the current Beidou positioning; determine the target road visibility based on the weather information, the starting road visibility and the end road visibility.

[0095] In a possible embodiment, in terms of determining the target motion image based on the at least two target pictures and the current motion data, the first processing unit 502 is specifically used to: determine first on-site motion information based on the first target picture, the first target on-site motion information being used to indicate the motion status of the target competition user at the starting point of the non-networked camera shooting area; obtain a target digital human corresponding to the target competition player, the target digital human being being used to represent the image of the target competition player when performing the corresponding competition event; determine a target motion image based on the first on-site motion information, the current motion data and the target digital human, the target motion image being used to represent the motion image of the target competition player when the body motion status is the current motion data.

[0096] In a possible embodiment, in terms of determining the target motion image based on the first on-site motion information, the current motion data and the target digital human, the first processing unit 502 is specifically used to: obtain the historical motion data of the target contestant, the historical motion data being used to characterize the physical motion conditions of the target contestant during the past performance of the competition; determine the historical motion data as training data to obtain a target digital twin model; preview the target digital twin model based on the first on-site motion information and the target on-site environment information to obtain the target motion state of the target contestant when the physical motion condition is the current motion data; and determine the target motion image based on the target motion state and the target digital human.

[0097] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.

[0098] In the case of integrated units, such as Figure 6 As shown, Figure 6 This is a block diagram of the functional units of another device for generating a live event screen provided by an embodiment of the present application. Figure 6 In the embodiment, the apparatus 500 for generating the live event screen includes: a processing module 612 and a communication module 611. The processing module 612 is used to control and manage the actions of the apparatus 500 for generating the live event screen, for example, to execute the steps of the first receiving unit 501 and the first processing unit 502, and / or to execute other processes of the technology described herein. The communication module 611 is used to support the interaction between the apparatus 500 for generating the live event screen and other devices. Figure 6 As shown, the device 500 for generating a live event screen may further include a storage module 613, and the storage module 613 is used to store program codes and data of the device 500 for generating a live event screen.

[0099] Among them, the processing module 612 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 611 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 613 can be a memory.

[0100] Among them, all relevant contents of each scene involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here. Figure 3 The method for generating the live broadcast screen of the event shown.

[0101] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0102] Figure 7 is a structural block diagram of a server provided in an embodiment of the present application. Figure 7As shown, the server 120 may include one or more of the following components: a processor 210, and a memory 220 coupled to the processor 210, wherein the memory 220 may store one or more computer programs 221, and the one or more computer programs 221 may be configured to implement the methods described in the above embodiments when executed by one or more processors 210.

[0103] The processor 210 may include one or more processing cores. The processor 210 uses various interfaces and lines to connect the various parts of the entire server 120, and executes various functions and processes data of the server 120 by running or executing instructions, programs, code sets or instruction sets stored in the memory 220, and calling data stored in the memory 220. Optionally, the processor 210 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 210 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 210, but may be implemented separately through a communication chip.

[0104] The memory 220 may include a random access memory (RAM) or a read-only memory (ROM). The memory 220 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 220 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 120 during use, etc.

[0105] It is understandable that the server 120 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here. The present application embodiment provides a computer-readable storage medium on which a computer program / instruction is stored, and when the computer program / instruction is executed by a processor, the steps of the method described in any possible embodiment are implemented.

[0106] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0107] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the unit is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0108] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0109] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0110] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM) and direct RAM bus random access memory (DR RAM), among other media that can store program code.

[0111] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.

Claims

1. A method for generating a live event screen, characterized in that: Applied to a server of a sports live broadcast system, the method comprises: Acquire a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant; When it is detected that the target contestant enters the non-networked camera shooting area, at least two target images corresponding to the target contestant are determined according to the current Beidou positioning, and the at least two target images are captured by networked cameras arranged on the race route, and the at least two target images include a first target image and a second target image, the first target image is used to indicate the on-site situation of the starting point of the non-networked camera shooting area, and the second target image is used to indicate the on-site situation of the end point of the non-networked camera shooting area; A target live broadcast picture is determined according to the at least two target pictures, the current Beidou positioning and the current sports data, and the target live broadcast picture is used to represent the on-site situation of the target contestant at the current Beidou positioning.

2. The method according to claim 1, characterized in that The determining the target live broadcast picture according to the at least two target pictures, the current Beidou positioning and the current motion data includes: Determine a target environment image according to the at least two target images and the current Beidou positioning, wherein the target environment image is used to represent the geographical environment corresponding to the current Beidou positioning; Determine a target motion image according to the at least two target images and the current motion data, wherein the target motion image is used to represent the motion image of the target contestant when the body motion condition is the current motion data; The target live broadcast picture is determined according to the target environment image and the target motion image.

3. The method according to claim 2, characterized in that The determining of the target environment image according to the at least two target images and the current Beidou positioning includes: Determine target scene environment information according to the at least two target images and the current Beidou positioning, wherein the target scene environment information is used to indicate the scene environment of the current position of the target contestant; Determine the basic environment image according to the current Beidou positioning and geographic environment database; The target environment image is determined according to the target scene environment information and the basic environment image.

4. The method according to claim 3, characterized in that The determining the target scene environment information according to the at least two target images and the current Beidou positioning includes: Determine first scene environment information according to the first target picture, where the first scene environment information is used to indicate the scene environment of the starting point of the shooting area of ​​the non-networked camera; Determine second scene environment information according to the second target picture, where the second scene environment information is used to indicate the scene environment of the end point of the shooting area of ​​the non-networked camera; The target scene environment information is determined according to the current Beidou positioning, the first scene environment information and the second scene environment information.

5. The method according to claim 4, characterized in that The target scene environment information includes target road visibility, and determining the target scene environment information according to the current Beidou positioning, the first scene environment information, and the second scene environment information includes: Determine the starting point road visibility of the non-networked camera shooting area according to the first on-site environment information; Determine the end road visibility of the non-networked camera shooting area according to the second scene environment information; Obtain weather information corresponding to the current Beidou positioning; The target road visibility is determined according to the weather information, the starting point road visibility and the end point road visibility.

6. The method according to claim 5, characterized in that The determining of the target motion image according to the at least two target pictures and the current motion data includes: Determining first on-site motion information according to the first target picture, where the first on-site motion information is used to indicate the motion situation of the target contestant at the starting point of the non-networked camera shooting area; Acquire a target digital person corresponding to the target contestant, wherein the target digital person is used to represent the image of the target contestant when performing a corresponding competition event; A target motion image is determined according to the first on-site motion information, the current motion data and the target digital human, and the target motion image is used to represent the motion image of the target contestant when the body motion condition is the current motion data.

7. The method according to claim 6, characterized in that: The step of determining the target motion image according to the first on-site motion information, the current motion data and the target digital human comprises: Acquire historical motion data of the target contestant, where the historical motion data is used to characterize the physical motion of the target contestant during past performances of the competition; Determining the historical motion data as training data to obtain a target digital twin model; Previewing the target digital twin model according to the first on-site motion information and the target on-site environment information to obtain a target motion state of the target contestant when the physical motion condition is the current motion data; The target motion image is determined according to the target motion state and the target digital human.

8. A device for generating a live event screen, characterized in that: A server applied to a sports live broadcast system, the device comprising: A first receiving unit is used to obtain a current Beidou positioning and current motion data of a target contestant, wherein the current Beidou positioning is used to characterize a current position of the target contestant, and the current motion data is used to characterize a current physical motion condition of the target contestant; A first processing unit is used to determine at least two target images corresponding to the target contestant according to the current Beidou positioning when it is detected that the target contestant enters the shooting area of ​​the non-networked camera, the at least two target images are captured by the networked cameras arranged on the competition route, the at least two target images include a first target image and a second target image, the first target image is used to indicate the on-site situation of the starting point of the shooting area of ​​the non-networked camera, and the second target image is used to indicate the on-site situation of the end point of the shooting area of ​​the non-networked camera; determine a target live broadcast image according to the at least two target images, the current Beidou positioning and the current sports data, and the target live broadcast image is used to represent the on-site situation of the target contestant in the current Beidou positioning.

9. A server, characterized in that: The method comprises a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program / instruction is stored thereon, and when the computer program / instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images