Method, system, device and electronic equipment for generating live screen of shooting competition

By obtaining the three-dimensional scanning results of the shooting target screen and the gun rod, a simulated first-person perspective live broadcast screen is generated, which solves the problem that the shooting athlete's aiming process cannot be broadcast live in real time in the prior art, and improves the user experience of shooting competitions.

CN114007136BActive Publication Date: 2024-12-03MIGU CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111274088.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-29
Publication Date
2024-12-03
Estimated Expiration
2041-10-29

AI Technical Summary

Technical Problem

The prior art cannot live broadcast the aiming process of shooting athletes in a first-person perspective in real time, resulting in poor user experience.

Method used

By obtaining the shooting target image at a horizontal perspective and the three-dimensional scanning results of the shooting athlete's gun rod, a simulated first-person view live broadcast image is generated, and the spatial position of the gun rod is determined using the three-dimensional scanning results and based on this fitted perspective, combining the shooting target image for rendering and coordinates Zoom to generate a live broadcast screen.

Benefits of technology

It improves the user experience of shooting competitions, keeps the live broadcast screen consistent with the first-person perspective of the shooting athlete, and enhances the viewing ability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114007136B_ABST
    Figure CN114007136B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention relate to the field of computer vision technology, and disclose a method, system, device, and electronic device for generating live images of shooting competitions. The method comprises: obtaining a shooting target image captured at a horizontal perspective; obtaining a three-dimensional scanning result of a gun barrel of a shooting athlete; and generating a live image simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning result and the shooting target image. Through the above-mentioned method, the embodiments of the present invention improve the viewing experience of the live images of shooting competitions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of computer vision technology, and specifically to a method, system, device and electronic equipment for generating a live picture of a shooting competition. Background Art

[0002] Among various sports competitions, shooting competition is a competitive event with strong viewing value. In the related art, the live broadcast of shooting competition is mainly divided into two parts. When the athlete is aiming, the aiming process of the shooter is recorded and broadcast to the user through a third-person perspective (such as a camera set directly in front of the athlete), and when the shooter completes the shooting, the shooting target can be recorded by a camera set directly in front of the shooting target and the recorded shooting target picture can be broadcast to the user, so that the user can intuitively watch the athlete's shooting results. However, the inventor found in the process of implementing the embodiment of the present invention that when the related art is shooting the shooting process of the shooter, it is impossible to broadcast the aiming process of the shooter in real time from a first-person perspective, which makes the user experience of watching the shooting competition poor. Summary of the invention

[0003] In view of the above problems, the embodiments of the present invention provide a method, system, device and electronic device for generating a live broadcast image of a shooting competition, which are used to solve the problem of poor user experience existing in the prior art.

[0004] According to one aspect of an embodiment of the present invention, a method for generating a live broadcast picture of a shooting competition is provided, the method comprising:

[0005] Acquire a shooting target image captured at a horizontal viewing angle;

[0006] Obtaining a three-dimensional scan of a shooter's gun shaft;

[0007] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated according to the three-dimensional scanning result and the shooting target picture.

[0008] In an optional manner, the three-dimensional scanning result includes a plurality of three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the gun barrel length to the unit effective accuracy of the scanning device used for three-dimensional scanning.

[0009] In an optional manner, the method further comprises:

[0010] Determining a variance of the three-dimensional scan result;

[0011] If the variance is greater than the variance threshold, controlling the scanning device to re-scan the gun barrel in three dimensions to regenerate a three-dimensional scanning result of the gun barrel;

[0012] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated based on the regenerated three-dimensional scanning result and the shooting target picture.

[0013] In an optional manner, the method further includes:

[0014] Determine the spacing between the unit rings on the shooting target as a first spacing, and determine the spacing between the shooting target and the shooting athlete as a second spacing;

[0015] Calculate the product of the first distance and the gun barrel length, and the sum of the gun barrel length and the second distance;

[0016] The ratio of the product to the sum is determined as the variance threshold.

[0017] In an optional manner, the three-dimensional coordinate points include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end and the rear end of the gun barrel; the method includes:

[0018] After the scanning device determines the three-dimensional coordinate point corresponding to the front end of the gun barrel, the three-dimensional coordinate point between the front end and the rear end of the gun barrel and the three-dimensional coordinate point corresponding to the rear end of the gun barrel are determined in sequence with the unit effective accuracy as the step size.

[0019] In an optional manner, generating a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture includes:

[0020] Rendering the shooting target image according to the three-dimensional scanning result;

[0021] Determine the distance between the camera device used to capture the shooting target image and the shooting target as a third distance;

[0022] The rendered shooting target picture is scaled in coordinates according to the second spacing and the third spacing to generate a live picture simulating the first-person perspective of the shooting athlete.

[0023] According to one aspect of an embodiment of the present invention, a system for generating live images of a shooting competition is provided, the system comprising: a scanning device, a camera device and a server; the server is used to:

[0024] Acquire a shooting target image captured by the camera device at a horizontal viewing angle;

[0025] Obtaining a three-dimensional scanning result of the shooting athlete's gun barrel by the scanning device;

[0026] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated according to the three-dimensional scanning result and the shooting target picture.

[0027] According to one aspect of an embodiment of the present invention, a device for generating a live picture of a shooting competition is provided, the device comprising:

[0028] A first acquisition module is used to acquire a shooting target image captured at a horizontal viewing angle;

[0029] A second acquisition module is used to acquire a three-dimensional scanning result of a gun barrel of a shooting athlete;

[0030] A generation module is used to generate a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture.

[0031] According to another aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;

[0032] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the operation of the above-mentioned method for generating live broadcast images of shooting competitions.

[0033] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein at least one executable instruction is stored in the storage medium. When the executable instruction is executed on an electronic device, the electronic device executes the operation of the above-mentioned method for generating a live broadcast image of a shooting competition.

[0034] In the embodiment of the present invention, the shooting target image is collected through the horizontal perspective, and the gun barrel of the shooting athlete is scanned in three dimensions at the same time; after the three-dimensional scanning results of the shooting target image and the gun barrel are obtained, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated according to the three-dimensional scanning results and the shooting target image. In the above process, the spatial position of the gun barrel of the shooting athlete can be determined through the three-dimensional scanning results, and then the first-person perspective of the shooting athlete is fitted according to the spatial position of the gun barrel. According to the fitted first-person perspective and the shooting target image, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated, thereby improving the user experience of the shooting competition.

[0035] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings are only used to illustrate the embodiments and are not to be considered as limiting the present invention. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings. In the accompanying drawings:

[0037] Figure 1 A schematic diagram showing a flow chart of a method for generating a live picture of a shooting competition provided by an embodiment of the present invention;

[0038] Figure 2 A schematic diagram showing the structure of a live broadcast picture generation system for a shooting competition provided by an embodiment of the present invention;

[0039] Figure 3 A schematic diagram showing the structure of a live picture generating device for a shooting competition provided by an embodiment of the present invention;

[0040] Figure 4 A schematic structural diagram of an electronic device provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0041] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein.

[0042] Figure 1 The flowchart of the method for generating live images of shooting competitions according to the embodiment of the present invention is shown, and the method is executed by an electronic device. The memory of the electronic device is used to store at least one executable instruction, and the executable instruction enables the processor of the electronic device to perform the operation of the method for generating live images of shooting competitions.

[0043] like Figure 1 As shown, the method comprises the following steps:

[0044] Step 110: Acquire a shooting target image captured at a horizontal viewing angle.

[0045] In a shooting competition, a shooting athlete aims and shoots at a shooting target through a horizontal perspective, and a camera device can be arranged between the shooting athlete and the shooting target to obtain a picture of the shooting target captured through the horizontal perspective. Furthermore, the camera device can be arranged in front of the shooting athlete so that the shooting athlete, the camera device and the shooting target are located in the same straight line.

[0046] Step 120: Obtain a three-dimensional scanning result of the shooting athlete's gun barrel.

[0047] Among them, the gun barrel of the shooter can be three-dimensionally scanned by a scanning device, and the three-dimensional scanning result of the gun barrel of the shooter generated by the scanning device is obtained. It should be noted that the "gun barrel" here can also be replaced by a gun body, a gun head, etc., and can also be a part of the gun barrel, as long as its spatial position can reflect the shooting direction of the shooter. The scanning device can be, for example, an infrared scanning device, including an infrared transmitting grid and an infrared receiving grid. When the gun barrel of the shooter is three-dimensionally scanned, the gun barrel can be three-dimensionally scanned from the horizontal direction and the vertical direction respectively. Further, an infrared transmitting grid is set on the left and top of the shooting position of the shooter, and an infrared receiving grid is set on the right and bottom of the shooting position of the shooter. The infrared transmitting grid and the infrared receiving grid have a unit effective accuracy, and the infrared transmitting grid and the infrared receiving grid have a unit effective accuracy, for example, which can be set to 0.5cm.

[0048] The three-dimensional scanning result of the gun barrel of the shooting athlete includes a plurality of three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the length of the gun barrel to the unit effective accuracy of the scanning device used for three-dimensional scanning. The three-dimensional coordinate points further include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end and the rear end of the gun barrel. When the three-dimensional coordinate points corresponding to the gun barrel are determined by the scanning device, the three-dimensional coordinate points corresponding to the front end of the gun barrel can be determined first. After the three-dimensional coordinate points corresponding to the front end of the gun barrel are determined by the scanning device, the three-dimensional coordinate points located between the front end and the rear end of the gun barrel and the three-dimensional coordinate points corresponding to the rear end of the gun barrel are determined in sequence with the unit effective accuracy of the infrared transmitting grid and the infrared receiving grid as the step length.

[0049] Before the three-dimensional scanning of the gun barrel of the shooter is performed by the scanning device, a spatial rectangular coordinate system can be established, with the shooting position of the shooter as the coordinate origin, the shooting direction of the shooter as the positive direction of the X axis, the positive direction of the Z axis above the shooting position of the shooter, and the positive direction of the Y axis to the right of the shooting position of the shooter. The infrared transmitting grid set on the top of the shooter starts from the maximum value of the positive direction of the X axis and scans line by line along the YZ plane; if the infrared transmitting grid set on the top of the shooter transmits an infrared signal, and the infrared receiving grid set on the bottom of the shooter receives all the signals, it means that there is no gun body information in the YZ plane. If the infrared receiving grid set on the bottom of the shooter receives the infrared signal, there is signal attenuation at (Xa, Ya), then the horizontal coordinate (Xa, Ya) corresponding to the infrared signal not received is taken. At the coordinate (Xa, Ya), the infrared transmitting grid set on the left side of the shooting position of the shooter starts from the maximum value of the positive direction of the Z axis and scans line by line along the XY plane. If the infrared transmitting grid set on the left side of the shooting position transmits the infrared signal, the infrared receiving grid set on the right side of the shooting position receives all the signals, then there is no gun body information in the XY plane. If the infrared receiving grid set on the right side has signal attenuation at Za, the corresponding three-dimensional coordinate point (Xa, Ya, Za) where the infrared signal is not obtained is determined as the three-dimensional coordinate point corresponding to the front end of the gun barrel. Further, with Xa as the reference, the negative offset to the X axis is 0.5 cm, and the current X axis value is taken as Xb. After the infrared transmitting grid set on the top of the shooter transmits the infrared signal, the infrared receiving grid set on the bottom of the shooter has signal attenuation at (Xb, Yb), then the horizontal coordinate (Xb, Yb) corresponding to the infrared signal not obtained is taken. At the (Xb, Yb) coordinate, the infrared transmitting grid set on the left side of the shooting position of the shooter starts from the maximum value of the positive direction of the Z axis and scans line by line along the XY plane. If the infrared transmitting grid set on the left side of the shooting position transmits the infrared signal, and the infrared receiving grid set on the right side of the shooting position receives all the signals, there is no gun body information in the XY plane. If the infrared receiving grid set on the right side has signal attenuation at Zb, the corresponding three-dimensional coordinate point (Xb, Yb, Zb) that does not receive the infrared signal is determined as the three-dimensional coordinate point between the front end and the rear end of the gun barrel. Repeat the above steps to determine the three-dimensional coordinate point to obtain an ordered set of three-dimensional coordinate points [(Xa, Ya, Za), (Xb, Yb, Zb)… (Xn, Yn, Zn)].

[0050] Step 130: Generate a live broadcast image simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning result and the shooting target image.

[0051] Before generating a live broadcast picture simulating the first-person perspective of a shooting athlete based on the three-dimensional scanning result and the shooting target picture, the three-dimensional scanning result can be verified. When verifying the three-dimensional scanning result, first determine the variance of the three-dimensional scanning result, and compare the variance of the three-dimensional scanning result with the variance threshold; if the variance of the three-dimensional scanning result is greater than the variance threshold, control the scanning device to re-scan the gun barrel in three dimensions to regenerate the three-dimensional scanning result of the gun barrel; generate a live broadcast picture simulating the first-person perspective of a shooting athlete based on the regenerated three-dimensional scanning result and the shooting target picture.

[0052] Before verifying the three-dimensional scanning results, it is necessary to determine the variance threshold. When determining the variance threshold, the spacing of the unit rings on the shooting target is determined as the first spacing, and the spacing between the shooting target and the shooting athlete is determined as the second spacing; the product of the first spacing and the length of the gun barrel, and the sum of the length of the gun barrel and the second spacing are calculated; the ratio of the product to the sum is determined as the variance threshold. The calculation formula of the variance threshold can be, for example: E(max)=H*D1 / (H+D2); E(max) represents the variance threshold, H represents the length of the gun barrel, D1 represents the first spacing, and D2 represents the second spacing. Further, any two sets of data can be taken from the ordered set of three-dimensional coordinate points [(Xa, Ya, Za), (Xb, Yb, Zb)…(Xn, Yn, Zn)] for linear regression fitting, and the remaining data can be used to verify whether the variance is less than the variance threshold. During the shooting competition, each time the athlete adjusts the aiming direction of the gun, the above steps can be used to obtain a unique linear regression fitting function f(x, y, z), and the corresponding coordinates Xt, Yt, and Zt of the target in three-dimensional space can be obtained according to the distribution position of the shooting target in three-dimensional space. It can be understood that since the X-axis is perpendicular to the screen, when the screen is displayed, the Y-axis corresponds to the horizontal coordinate in the screen, and the Z-axis corresponds to the vertical coordinate in the screen. If the distance between the camera and the shooting target is D3, the coordinate scaling ratio is D3:D2, and the scaled coordinates (Yt*D3 / D2, Zt*D3 / D2) are the lens coordinates.

[0053] Among them, since the camera device is located in front of the shooting athlete, the shooting target screen needs to be scaled when generating the live broadcast screen simulating the first-person perspective of the shooting athlete. Furthermore, when generating the live broadcast screen simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning results and the shooting target screen, the shooting target screen is first rendered according to the three-dimensional scanning results, and the distance between the camera device used to collect the shooting target screen and the shooting target is determined as the third distance. The rendered shooting target screen is scaled according to the second distance and the third distance to generate the live broadcast screen simulating the first-person perspective of the shooting athlete.

[0054] Among them, by generating a live broadcast picture simulating the first-person perspective of a shooting athlete, according to the changes in the shooting athlete's gun barrel collected by the infrared scanning device, the first-person perspective of the shooting athlete can be fitted to present the floating feeling of the first-person perspective shooting movement to the live broadcast user. The embodiment of the present invention continuously adjusts the imaging according to the three-dimensional scanning results obtained in real time by the scanning device and the shooting target picture collected in real time by the camera device, so that the live broadcast picture is always consistent with the first-person perspective of the shooting athlete. When generating a live broadcast picture simulating the first-person perspective of the shooting athlete, the current wind speed of the stadium can also be collected in real time, and the current wind speed of the stadium can be added to the live broadcast picture as a text reference, and the live broadcast picture with the current wind speed of the stadium added can be output to the live broadcast user in the form of a live stream.

[0055] In the embodiment of the present invention, the shooting target image is collected through the horizontal perspective, and the gun barrel of the shooting athlete is scanned in three dimensions at the same time; after the three-dimensional scanning results of the shooting target image and the gun barrel are obtained, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated according to the three-dimensional scanning results and the shooting target image. In the above process, the spatial position of the gun barrel of the shooting athlete can be determined through the three-dimensional scanning results, and then the first-person perspective of the shooting athlete is fitted according to the spatial position of the gun barrel. According to the fitted first-person perspective and the shooting target image, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated, thereby improving the user experience of the shooting competition.

[0056] Figure 2 FIG. 1 is a schematic diagram showing the structure of a live broadcast screen generation system for a shooting competition according to an embodiment of the present invention. Figure 2 As shown, the system 200 includes: a scanning device 210 , a camera device 220 and a server 230 .

[0057] Among them, the server 230 is used to: obtain the shooting target image captured by the camera device at a horizontal perspective; obtain the three-dimensional scanning result of the shooting athlete's gun barrel by the scanning device; and generate a live broadcast image simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning result and the shooting target image.

[0058] In the embodiment of the present invention, the shooting target image is collected at a horizontal viewing angle by a camera device, and the gun barrel of the shooter is scanned in three dimensions by a scanning device; after the three-dimensional scanning results of the shooting target image and the gun barrel are obtained, a live broadcast image simulating the first-person perspective of the shooter can be generated based on the three-dimensional scanning results and the shooting target image. In the above process, the spatial position of the gun barrel of the shooter can be determined by the three-dimensional scanning results, and then the first-person perspective of the shooter can be fitted according to the spatial position of the gun barrel. According to the fitted first-person perspective and the shooting target image, a live broadcast image simulating the first-person perspective of the shooter can be generated, thereby improving the user experience of the shooting competition.

[0059] Figure 3 FIG. 1 is a schematic diagram showing the structure of a live picture generating device for a shooting competition according to an embodiment of the present invention. Figure 3 As shown, the device 300 includes: a first acquisition module 310 , a second acquisition module 320 and a generation module 330 .

[0060] Among them, the first acquisition module 310 is used to obtain a shooting target image captured from a horizontal perspective; the second acquisition module 320 is used to obtain a three-dimensional scanning result of the shooting athlete's gun barrel; the generation module 330 is used to generate a live broadcast image simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning result and the shooting target image.

[0061] In an optional manner, the three-dimensional scanning result includes a plurality of three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the gun barrel length to the unit effective accuracy of the scanning device used for three-dimensional scanning.

[0062] In an optional manner, the generating module 330 is used to:

[0063] Determining a variance of the three-dimensional scan result;

[0064] If the variance is greater than the variance threshold, controlling the scanning device to re-scan the gun barrel in three dimensions to regenerate a three-dimensional scanning result of the gun barrel;

[0065] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated based on the regenerated three-dimensional scanning result and the shooting target picture.

[0066] In an optional manner, the generating module 330 is used to:

[0067] Determine the spacing between the unit rings on the shooting target as a first spacing, and determine the spacing between the shooting target and the shooting athlete as a second spacing;

[0068] Calculate the product of the first distance and the gun barrel length, and the sum of the gun barrel length and the second distance;

[0069] The ratio of the product to the sum is determined as the variance threshold.

[0070] In an optional manner, the three-dimensional coordinate points include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end of the gun barrel and the rear end of the gun barrel; the second acquisition module 320 is used to:

[0071] After the scanning device determines the three-dimensional coordinate point corresponding to the front end of the gun barrel, the three-dimensional coordinate point between the front end and the rear end of the gun barrel and the three-dimensional coordinate point corresponding to the rear end of the gun barrel are determined in sequence with the unit effective accuracy as the step size.

[0072] In an optional manner, the generating module 330 is used to:

[0073] Rendering the shooting target image according to the three-dimensional scanning result;

[0074] Determine the distance between the camera device used to capture the shooting target image and the shooting target as a third distance;

[0075] The rendered shooting target picture is scaled in coordinates according to the second spacing and the third spacing to generate a live picture simulating the first-person perspective of the shooting athlete.

[0076] In the embodiment of the present invention, the shooting target image is collected through the horizontal perspective, and the gun barrel of the shooting athlete is scanned in three dimensions at the same time; after the three-dimensional scanning results of the shooting target image and the gun barrel are obtained, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated according to the three-dimensional scanning results and the shooting target image. In the above process, the spatial position of the gun barrel of the shooting athlete can be determined through the three-dimensional scanning results, and then the first-person perspective of the shooting athlete is fitted according to the spatial position of the gun barrel. According to the fitted first-person perspective and the shooting target image, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated, thereby improving the user experience of the shooting competition.

[0077] Figure 4 A schematic diagram of the structure of an electronic device according to an embodiment of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the electronic device.

[0078] like Figure 4 As shown, the electronic device may include: a processor (processor) 402 , a communication interface (Communications Interface) 404 , a memory (memory) 406 , and a communication bus 408 .

[0079] The processor 402, the communication interface 404, and the memory 406 communicate with each other via the communication bus 408. The communication interface 404 is used to communicate with other devices such as a client or other server network elements. The processor 402 is used to execute the program 410, which can specifically execute the relevant steps in the above-mentioned embodiment of the live screen generation method for shooting competition.

[0080] Specifically, the program 410 may include program code including computer executable instructions.

[0081] The processor 402 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the electronic device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0082] The memory 406 is used to store the program 410. The memory 406 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0083] Program 410 can be specifically called by processor 402 to enable the electronic device to perform the following operations:

[0084] Acquire a shooting target image captured at a horizontal viewing angle;

[0085] Obtaining a three-dimensional scan of a shooter's gun shaft;

[0086] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated according to the three-dimensional scanning result and the shooting target picture.

[0087] In an optional manner, the program 410 may be specifically called by the processor 402 to enable the electronic device to perform the following operations:

[0088] The three-dimensional scanning result includes a plurality of three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the length of the gun barrel to the unit effective accuracy of the scanning device used for three-dimensional scanning.

[0089] Program 410 can be specifically called by processor 402 to enable the electronic device to perform the following operations:

[0090] Determining a variance of the three-dimensional scan result;

[0091] If the variance is greater than the variance threshold, controlling the scanning device to re-scan the gun barrel in three dimensions to regenerate a three-dimensional scanning result of the gun barrel;

[0092] A live broadcast picture simulating the first-person perspective of the shooting athlete is generated based on the regenerated three-dimensional scanning result and the shooting target picture.

[0093] Program 410 can be specifically called by processor 402 to enable the electronic device to perform the following operations:

[0094] Determine the spacing between the unit rings on the shooting target as a first spacing, and determine the spacing between the shooting target and the shooting athlete as a second spacing;

[0095] Calculate the product of the first distance and the gun barrel length, and the sum of the gun barrel length and the second distance;

[0096] The ratio of the product to the sum is determined as the variance threshold.

[0097] In an optional manner, the program 410 may be specifically called by the processor 402 to enable the electronic device to perform the following operations:

[0098] The three-dimensional coordinate points include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end and the rear end of the gun barrel; the method includes:

[0099] After the scanning device determines the three-dimensional coordinate point corresponding to the front end of the gun barrel, the three-dimensional coordinate point between the front end and the rear end of the gun barrel and the three-dimensional coordinate point corresponding to the rear end of the gun barrel are determined in sequence with the unit effective accuracy as the step size.

[0100] In an optional manner, the program 410 may be specifically called by the processor 402 to enable the electronic device to perform the following operations:

[0101] Generating a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture includes:

[0102] Rendering the shooting target image according to the three-dimensional scanning result;

[0103] Determine the distance between the camera device used to capture the shooting target image and the shooting target as a third distance;

[0104] The rendered shooting target picture is scaled in coordinates according to the second spacing and the third spacing to generate a live picture simulating the first-person perspective of the shooting athlete.

[0105] In the embodiment of the present invention, the shooting target image is collected through the horizontal perspective, and the gun barrel of the shooting athlete is scanned in three dimensions at the same time; after the three-dimensional scanning results of the shooting target image and the gun barrel are obtained, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated according to the three-dimensional scanning results and the shooting target image. In the above process, the spatial position of the gun barrel of the shooting athlete can be determined through the three-dimensional scanning results, and then the first-person perspective of the shooting athlete is fitted according to the spatial position of the gun barrel. According to the fitted first-person perspective and the shooting target image, a live broadcast image simulating the first-person perspective of the shooting athlete can be generated, thereby improving the user experience of the shooting competition.

[0106] An embodiment of the present invention provides a computer-readable storage medium, which stores at least one executable instruction. When the executable instruction is executed on an electronic device, the electronic device executes the method for generating a live screen of a shooting competition in any of the above method embodiments.

[0107] The embodiment of the present invention provides a device for generating a live picture of a shooting competition, which is used to execute the method for generating a live picture of a shooting competition.

[0108] An embodiment of the present invention provides a computer program, which can be called by a processor to enable an electronic device to execute the method for generating a live screen of a shooting competition in any of the above method embodiments.

[0109] An embodiment of the present invention provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed on a computer, the computer executes the method for generating a live screen of a shooting competition in any of the above method embodiments.

[0110] The algorithm or display provided herein is not inherently related to any particular computer, virtual system or other equipment. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious to construct the structure required for this type of system. In addition, the embodiment of the present invention is not directed to any specific programming language yet. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description made to specific languages ​​above is for disclosing the best mode of the present invention.

[0111] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0112] Similarly, it should be understood that in order to streamline the present invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed invention requires more features than those expressly recited in each claim.

[0113] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0114] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.

Claims

1. A method for generating live pictures of a shooting competition, characterized in that: The method comprises: Acquire a shooting target image captured at a horizontal viewing angle; Obtaining a three-dimensional scanning result of a gun barrel of a shooting athlete; the three-dimensional scanning result includes three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the length of the gun barrel to the unit effective accuracy of a scanning device used for three-dimensional scanning; the three-dimensional coordinate points include a three-dimensional coordinate point corresponding to the front end of the gun barrel, a three-dimensional coordinate point corresponding to the rear end of the gun barrel, and a three-dimensional coordinate point located between the front end of the gun barrel and the rear end of the gun barrel; Generate a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture; Determine the variance of the three-dimensional scanning result; if the variance is greater than the variance threshold, control the scanning device to re-scan the gun barrel in three dimensions to regenerate the three-dimensional scanning result of the gun barrel; generate a live broadcast picture simulating the first-person perspective of the shooting athlete based on the regenerated three-dimensional scanning result and the shooting target picture; the variance of the three-dimensional scanning result is calculated based on the first spacing, the gun barrel length determined by the three-dimensional coordinate points, and the second spacing, wherein the spacing of the unit rings on the shooting target is determined as the first spacing, and the spacing between the shooting target and the shooting athlete is determined as the second spacing.

2. The method according to claim 1, characterized in that The method further comprises: Calculate the product of the first distance and the gun barrel length, and the sum of the gun barrel length and the second distance; The ratio of the product to the sum is determined as the variance threshold.

3. The method according to claim 2, characterized in that The three-dimensional coordinate points include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end and the rear end of the gun barrel; the method includes: After the scanning device determines the three-dimensional coordinate point corresponding to the front end of the gun barrel, the three-dimensional coordinate point between the front end and the rear end of the gun barrel and the three-dimensional coordinate point corresponding to the rear end of the gun barrel are determined in sequence with the unit effective accuracy as the step size.

4. The method according to claim 2, characterized in that: Generating a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture includes: Rendering the shooting target image according to the three-dimensional scanning result; Determine the distance between the camera device used to capture the shooting target image and the shooting target as a third distance; The rendered shooting target picture is scaled in coordinates according to the second spacing and the third spacing to generate a live picture simulating the first-person perspective of the shooting athlete.

5. A live broadcast picture generation system for a shooting competition, characterized in that: The system comprises: a scanning device, a camera device and a server; the server is used for: Acquire a shooting target image captured by the camera device at a horizontal viewing angle; Obtaining a three-dimensional scanning result of the shooting athlete's gun barrel by the scanning device; the three-dimensional scanning result includes three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the length of the gun barrel to the unit effective accuracy of the scanning device used for three-dimensional scanning; the three-dimensional coordinate points include a three-dimensional coordinate point corresponding to the front end of the gun barrel, a three-dimensional coordinate point corresponding to the rear end of the gun barrel, and a three-dimensional coordinate point located between the front end and the rear end of the gun barrel; Generate a live broadcast picture simulating the first-person perspective of the shooting athlete according to the three-dimensional scanning result and the shooting target picture; Determine the variance of the three-dimensional scanning result; if the variance is greater than the variance threshold, control the scanning device to re-scan the gun barrel in three dimensions to regenerate the three-dimensional scanning result of the gun barrel; generate a live broadcast picture simulating the first-person perspective of the shooting athlete based on the regenerated three-dimensional scanning result and the shooting target picture; the variance of the three-dimensional scanning result is calculated based on the first spacing, the gun barrel length determined by the three-dimensional coordinate points, and the second spacing, wherein the spacing of the unit rings on the shooting target is determined as the first spacing, and the spacing between the shooting target and the shooting athlete is determined as the second spacing.

6. A device for generating live pictures of shooting competitions, characterized in that: The device comprises: A first acquisition module is used to acquire a shooting target image captured at a horizontal viewing angle; A second acquisition module is used to acquire a three-dimensional scanning result of a gun barrel of a shooting athlete; the three-dimensional scanning result includes three-dimensional coordinate points representing the spatial position of the gun barrel, and the number of the three-dimensional coordinate points is the ratio of the length of the gun barrel to the unit effective accuracy of the scanning device used for three-dimensional scanning; the three-dimensional coordinate points include the three-dimensional coordinate points corresponding to the front end of the gun barrel, the three-dimensional coordinate points corresponding to the rear end of the gun barrel, and the three-dimensional coordinate points located between the front end of the gun barrel and the rear end of the gun barrel; A generation module is used to generate a live broadcast picture simulating the first-person perspective of the shooting athlete based on the three-dimensional scanning result and the shooting target picture; determine the variance of the three-dimensional scanning result; if the variance is greater than the variance threshold, control the scanning device to re-scan the gun barrel in three dimensions to regenerate the three-dimensional scanning result of the gun barrel; generate a live broadcast picture simulating the first-person perspective of the shooting athlete based on the regenerated three-dimensional scanning result and the shooting target picture; the variance of the three-dimensional scanning result is calculated based on the first spacing, the gun barrel length determined by the three-dimensional coordinate points, and the second spacing, wherein the spacing of the unit rings on the shooting target is determined as the first spacing, and the spacing between the shooting target and the shooting athlete is determined as the second spacing.

7. An electronic device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the live broadcast image generation method for a shooting competition as described in any one of claims 1-4.

8. A computer-readable storage medium, characterized in that: The storage medium stores at least one executable instruction. When the executable instruction is executed on the electronic device, the electronic device executes the operation of the method for generating a live broadcast image of a shooting competition as described in any one of claims 1 to 4.

Citation Information

Patent Citations

  • VR technology-based bow and arrow practice or competition simulation device and method

    CN112370757A

  • Confrontation evaluation system for combat exercise

    CN113008074A