Virtual production method and apparatus

Abstract

The present disclosure relates to a virtual production method and apparatus, applied to virtual production performed by using a plurality of videography devices. The method comprises: in a first display period, displaying a plurality of inner frustum images on a display screen in a time-division manner, wherein any videography device among the plurality of videography devices corresponds to at least one inner frustum image among the plurality of inner frustum images, different videography devices correspond to different inner frustum images, the time-division display represents that the inner frustum image corresponding to any videography device is displayed in a first time segment in the first display period corresponding to the videography device, and the inner frustum images corresponding to different videography devices are displayed in different first time segments; and respectively performing photographing in corresponding first time segments by means of the videography devices among the plurality of videography devices, so that the videography devices capture corresponding inner frustum images. The present disclosure achieves multi-camera virtual production, thereby greatly improving the production efficiency and application scenarios of virtual production.

Description

Virtual shooting method and device TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of virtual shooting, and in particular to a virtual shooting method and device. BACKGROUND

[0002] Virtual production is a film and television production technology that combines real-time 3D rendering, game engine technology and traditional studio shooting, uses computer graphics and film production technology to create visual content, and uses large LED display technology and live shooting technology to shoot high-definition and realistic film and television content in real time. It provides creators with an immersive environment where they can view and capture the final picture effect in real time. In recent years, in order to improve the production quality of film and television works and reduce the time cost and economic cost of film and television production, virtual shooting technology has become a popular solution in the industry. However, in virtual shooting, how to realize multi-camera shooting is a technical blank, which restricts the application scenarios of virtual shooting and seriously hinders the wider industry application of virtual shooting. SUMMARY

[0003] Therefore, the present disclosure provides a virtual shooting method, device, electronic equipment, storage medium and computer program product.

[0004] According to an aspect of the present disclosure, a virtual shooting method is provided, which is applied to virtual shooting using multiple shooting devices. The method comprises: displaying multiple inner cone pictures on a display screen in time in a first display period; wherein any shooting device in the multiple shooting devices corresponds to at least one inner cone picture in the multiple inner cone pictures, and different shooting devices correspond to different inner cone pictures; the time display indicates that the inner cone picture corresponding to any shooting device is displayed in a first time segment corresponding to the shooting device in the first display period, and the inner cone pictures corresponding to different shooting devices are displayed in different first time segments; and each shooting device in the multiple shooting devices shoots in the corresponding first time segment, so that each shooting device shoots the corresponding inner cone picture.

[0005] In a possible implementation, the starting time of each shooting of any shooting device in the multiple shooting devices in the first display period is not earlier than the starting time of the first time segment corresponding to the shooting, and the time length of each shooting is not greater than the time length of the first time segment corresponding to the shooting.

[0006] In a possible implementation, the method further includes: sending, by the synchronization controller, a synchronization signal to each of the display screen and the plurality of photographing devices; and displaying, by the display screen, the inner frustum picture corresponding to the photographing device in response to the synchronization signal, while the photographing device starts photographing in response to the synchronization signal.

[0007] In a possible implementation, the displaying the plurality of inner frustum pictures on the display screen in time includes: sequentially displaying the plurality of inner frustum pictures on the display screen, so that the display frame rate of the inner frustum picture corresponding to each of the plurality of photographing devices on the display screen is the same as the photographing frame rate of the photographing device.

[0008] In a possible implementation, the first display period further includes at least one second time segment; and during the second time segment, the photographing device does not perform photographing.

[0009] In a possible implementation, each of the at least one second time segment displays one of the plurality of inner frustum pictures; and the displaying the plurality of inner frustum pictures on the display screen in time includes: sequentially displaying the plurality of inner frustum pictures on the display screen according to the order of each first time segment and the order of each second time segment in the first display period, so that the inner frustum picture corresponding to each photographing device is displayed alternately in the first display period.

[0010] In a possible implementation, the duration of the first time segment and the second time segment in which the same inner frustum picture is displayed in the first display period is the same.

[0011] In a possible implementation, the plurality of photographing devices are two photographing devices, and the plurality of inner frustum pictures are two inner frustum pictures; the first display period includes two first time segments and two second time segments; the two second time segments are located between the two first time segments, and the two second time segments display the two inner frustum pictures respectively, so that the inner frustum picture corresponding to each of the two photographing devices is displayed alternately in the first display period.

[0012] In a possible implementation, the method further includes: rendering, by the rendering device, based on the parameter data of the plurality of shooting devices and the original to-be-rendered data, to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; the number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device; splicing the inner frustum pictures corresponding to each shooting device to be displayed in the first display period to obtain a spliced image; splitting the spliced image by the display screen to obtain the plurality of inner frustum pictures; or, rendering, by the rendering device, based on the parameter data of the plurality of shooting devices and the original to-be-rendered data, to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; the number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device; transmitting the inner frustum pictures corresponding to each shooting device to be displayed in the first display period to the display screen in a multi-channel transmission manner, so that the display screen obtains the plurality of inner frustum pictures.

[0013] In a possible implementation, the method further includes: determining whether there is an overlapping area in different inner frustum pictures to be displayed in the first display period; if there is an overlapping area, determining, for any overlapping area, the gray value of the overlapping area in the corresponding inner frustum pictures; calculating the gray compensation value corresponding to the first display period based on the gray values of the overlapping area in the corresponding inner frustum pictures; and performing gray compensation on the inner frustum pictures corresponding to the overlapping area based on the gray compensation value corresponding to the first display period.

[0014] In a possible implementation, the gray compensation on the inner frustum pictures corresponding to the overlapping area based on the gray compensation value corresponding to the first display period includes: obtaining the gray compensation value corresponding to a historical display period; calculating the mean value of the gray compensation value corresponding to the historical display period and the gray compensation value corresponding to the first display period; and performing gray compensation on the inner frustum pictures corresponding to the overlapping area based on the mean value. In a possible implementation, the shooting frame rates of any two shooting devices in the plurality of shooting devices are the same or in a multiple relationship.

[0015] According to another aspect of the present disclosure, there is provided a virtual camera device applied to virtual shooting with multiple shooting devices, the device comprising: a display module configured to display multiple inner cone pictures on a display screen in a time-sharing manner in a first display period; wherein any one of the multiple shooting devices corresponds to at least one of the multiple inner cone pictures, and different shooting devices correspond to different inner cone pictures; the time-sharing display means that the inner cone picture corresponding to any one of the shooting devices is displayed in a first time segment corresponding to the shooting device in the first display period, and the inner cone pictures corresponding to different shooting devices are displayed in different first time segments; and a shooting module configured to shoot in the corresponding first time segment by each of the multiple shooting devices, so that each of the shooting devices shoots the corresponding inner cone picture.

[0016] According to another aspect of the present disclosure, there is provided an electronic device comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0017] According to another aspect of the present disclosure, there is provided a non-volatile computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above method.

[0018] According to another aspect of the present disclosure, there is provided a computer program product comprising computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, which, when run in a processor of an electronic device, causes the processor in the electronic device to perform the above method.

[0019] According to various aspects of the present disclosure, in a first display period, a plurality of inner cone of vision pictures are displayed on the display screen in time division; wherein any one of the plurality of shooting devices corresponds to at least one of the plurality of inner cone of vision pictures, and different shooting devices correspond to different inner cone of vision pictures; the time division display means that the inner cone of vision picture corresponding to any one of the shooting devices is displayed in a first time segment corresponding to the shooting device in the first display period, and the inner cone of vision pictures corresponding to different shooting devices are displayed in different first time segments; each of the plurality of shooting devices shoots in the corresponding first time segment, so that each shooting device shoots the corresponding inner cone of vision picture; in this way, by displaying the plurality of inner cone of vision pictures corresponding to the plurality of shooting devices in time division, it is ensured that each shooting device can shoot with the corresponding inner cone of vision picture as the background in the same display period, thereby realizing multi-camera virtual shooting; as an example, the shooting device can be configured with a rolling shutter camera, so that multi-camera virtual shooting can be realized based on the rolling shutter camera, the demand for multi-camera virtual shooting is met, and the production efficiency and application scenarios of virtual shooting are greatly improved.

[0020] Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the present disclosure and serve to explain the principles of the present disclosure.

[0022] FIG. 1 shows a structure diagram of a virtual shooting system according to an embodiment of the present disclosure;

[0023] FIG. 2 shows a scene schematic diagram of double-camera virtual shooting according to an embodiment of the present disclosure;

[0024] FIG. 3 shows a flowchart of a virtual shooting method according to an embodiment of the present disclosure;

[0025] FIG. 4 shows a flowchart of a method for acquiring a plurality of inner cone of vision pictures according to an embodiment of the present disclosure;

[0026] FIG. 5 shows a distribution schematic diagram of different inner cone of vision pictures on a display screen according to an embodiment of the present disclosure;

[0027] FIG. 6 shows a schematic diagram of the order of a first time segment according to an embodiment of the present disclosure;

[0028] FIG. 7 shows a schematic diagram of the order of a first time segment according to an embodiment of the present disclosure;

[0029] FIG. 8 shows a schematic diagram of the order of a first time segment according to an embodiment of the present disclosure;

[0030] FIG. 9 shows a diagram of an ordering of a first time segment according to an embodiment of the present disclosure;

[0031] FIG. 10 shows a diagram of an ordering of a first time segment according to an embodiment of the present disclosure;

[0032] FIG. 11 shows a diagram of an ordering of a first time segment according to an embodiment of the present disclosure;

[0033] FIG. 12 shows a diagram of an ordering of a first time segment according to an embodiment of the present disclosure;

[0034] FIG. 13 shows a diagram of an ordering of a first time segment according to an embodiment of the present disclosure;

[0035] FIG. 14 shows a diagram of display content on a display screen changing over time according to an embodiment of the present disclosure;

[0036] FIG. 15 shows a flowchart of a method of virtual shooting according to an embodiment of the present disclosure;

[0037] FIG. 16 shows a diagram of a structure of a virtual shooting device according to an embodiment of the present disclosure;

[0038] FIG. 17 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0039] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in different drawings represent the same or similar elements. Although various aspects of embodiments are illustrated in the drawings, the drawings are not necessarily drawn to scale unless specifically noted.

[0040] Reference in the specification to "one embodiment" or "some embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. The appearances of the phrase "in one embodiment" or "in some embodiments" in various places in the specification are not necessarily all referring to the same embodiment, although it can. The terms "including," "comprising," "having," and variations thereof are meant to encompass the item listed thereafter and equivalents thereof as well as additional items. The terms "a" and "an" are meant to encompass both the singular and the plural, unless otherwise indicated.

[0041] In the present disclosure, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B can represent: including the case of A alone, the case of A and B together, and the case of B alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple. In addition, in order to better illustrate the present disclosure, a large number of specific details are given in the specific embodiments below. Those skilled in the art should understand that the present disclosure can also be implemented without some specific details. In some examples, methods, means, elements and circuits that are well known to those skilled in the art are not described in detail in order to highlight the main ideas of the present disclosure.

[0042] FIG. 1 shows a structural diagram of a virtual shooting system according to an embodiment of the present disclosure; as shown in FIG. 1, the virtual shooting system can include: a broadcast processing device 101 (which can also be referred to as a play controller or a rendering master, etc.), a rendering device 102, a synchronization controller 103, a display screen 104 (three display screens are shown in the figure: display screen 1041, display screen 1042, and display screen 1043), a shooting device 105; wherein the number of various devices can be flexibly configured according to actual needs, and no limitation is made in this regard; in addition, other devices such as mobile terminals or network devices can also be configured in the virtual shooting system according to actual needs; one or more devices in the virtual shooting system can also be integrated into one device according to needs, for example, the rendering device 102, the broadcast processing device 101, and the synchronization controller 103 can be integrated into one device.

[0043] Exemplarily, the play control processing device 101 can be connected with the rendering device 102, and can send various control instructions to the rendering device 102 to control the rendering device 102 to render a desired picture. The rendering device 102 can render a picture meeting the requirements in response to the control instruction of the play control processing device 101, and can send the rendered picture to the play control processing device 101, and the play control processing device 101 can perform splicing, decoding and other processing on the picture from the rendering device 102. As an example, the rendering device 102 can be deployed with a rendering engine to construct a virtual environment consistent with a real shooting environment by rendering a picture in real time; as another example, the rendering device 102 can be a distributed rendering cluster. Exemplarily, the play control processing device 101 can be connected with the display screen 104 to control and manage the display screen 104. For example, the play control processing device 101 can be used for data transmission and decoding, such as receiving a picture from the rendering device 102 and decoding it into a format suitable for display on the display screen 104; can also be used for display control of the display screen 104, such as overall control and scheduling of the display screen 104, including brightness adjustment, color correction, gray scale control and the like, and can also control the display screen 104 to display and refresh the picture; can also be used for partition management of the display screen 104, and the display screen can be divided into multiple independent areas, each of which can display different content. As an example, the play control processing device 101 can be configured with a sending card (also referred to as a sender) for converting an image into a format suitable for transmission to the display screen 104.

[0044] Exemplarily, the display screen 104 can be an LED screen, a liquid crystal screen or the like, and can be a curved screen or a flat screen. The type, number, size, resolution and the like of the display screen 104 in the virtual shooting system can be customized according to actual needs, and are not limited in this regard. For example, the display screen 104 can be a large display screen composed of many small LED display units. As an example, the display screen 104 can be configured with a receiving card (also referred to as a receiver) to decode the received signal and the like for display on the display screen 104.

[0045] Exemplarily, the play control processing device 101 can be connected with the shooting device 105, and the shooting device 105 can transmit a shot picture to the play control processing device 101. As an example, the shooting device 105 is configured with a rolling shutter camera. The rolling shutter camera is a camera that uses a rolling shutter mechanism to capture images. In the rolling shutter mechanism, the imaging points on the photosensitive sensor are exposed in sequence row by row (or column by column). The rolling shutter camera is widely used in fields such as high-quality video shooting.

[0046] Exemplarily, the synchronization controller 103 can be used to synchronize the broadcast processing device 101 and the shooting device 105, so as to ensure high-precision time synchronization between the broadcast processing device 101 controlling the display screen 104 to display a picture and the shooting device 105 shooting the picture. As an example, the synchronization controller 103 can generate a synchronization signal and send the synchronization signal to the broadcast processing device 101 and the shooting device 105, so that the broadcast processing device 101 and the shooting device 105 are synchronized.

[0047] In the process of virtual shooting, the broadcast processing device 101 in the virtual shooting system can control the rendering device 102 to perform picture rendering, and the broadcast processing device 101 transmits the rendered picture to the display screen 104 for display. At the same time, the actor can perform in front of the display screen 104, and the broadcast processing device 101 controls the shooting device 105 to shoot, so that the actor is the foreground and the picture in the display screen is the background in the shot video frame, thereby realizing virtual shooting.

[0048] In some virtual shooting scenarios, the number of shooting devices 105 is multiple, that is, virtual shooting can be performed through multiple positions. Multiple-position shooting can collect more angle pictures in the process of one performance of the actor, thereby improving shooting efficiency and meeting the needs of different shooting angles. FIG. 2 shows a schematic diagram of a double-position virtual shooting scene according to an embodiment of the present disclosure. As shown in FIG. 2, the number of shooting devices 105 is two, that is, camera 1 and camera 2 in the figure, and camera 1 and camera 2 are used to shoot at different angles.

[0049] Compared with the scenario in which the number of shooting devices 105 is one, that is, single-position virtual shooting, the multiple-position virtual shooting scenario is more complex. Embodiments of the present disclosure provide a virtual shooting method to realize multiple-position virtual shooting. As an example, multiple-position virtual shooting can be realized based on a rolling shutter camera, thereby meeting the needs of multiple-position virtual shooting and greatly improving the production efficiency and application scenarios of virtual shooting.

[0050] The virtual shooting method provided by the present disclosure will be described in detail below.

[0051] FIG. 3 shows a flowchart of a virtual shooting method according to an embodiment of the present disclosure. The method can be applied to virtual shooting using multiple shooting devices. Exemplarily, the method can be executed by the virtual shooting system shown in FIG. 1 or one or more components in the virtual shooting system. As shown in FIG. 3, the method can include the following steps:

[0052] In step 301, a plurality of internal view cone pictures are displayed on the display screen in time division in a first display period; wherein any one of the plurality of shooting devices corresponds to at least one of the plurality of internal view cone pictures, and different shooting devices correspond to different internal view cone pictures; the time division display means that the internal view cone picture corresponding to any one of the shooting devices is displayed in a first time segment corresponding to the shooting device in the first display period, and the internal view cone pictures corresponding to different shooting devices are displayed in different first time segments.

[0053] For example, the display screen in this step can be the display screen 104 in FIG. 1. The plurality of internal view cone pictures can be obtained by the broadcast control processing device 101 in FIG. 1 and provided to the display screen 104 for display, and the shooting devices can include the shooting device 105 in FIG. 1.

[0054] The first display period means any display period in the virtual shooting process using the plurality of shooting devices; for example, the length of the first display period can be determined by the least common multiple of the shooting frame rates of the plurality of shooting devices, to ensure that each shooting device can shoot at least once in each display period, and at least one shooting device shoots only once in each display period. The higher the shooting frame rate of the shooting device, the more times the shooting device shoots in the first display period; conversely, the lower the shooting frame rate of the shooting device, the fewer times the shooting device shoots in the first display period.

[0055] For example, the shooting frame rates of any two of the plurality of shooting devices are the same or in a multiple relationship. If the shooting frame rates of any two of the shooting devices are the same, it means that the two shooting devices shoot the same number of times in the first display period; if the shooting frame rates of any two of the shooting devices are in a multiple relationship, it means that the two shooting devices shoot different numbers of times in the first display period, but in a multiple relationship.

[0056] As an example, for a virtual shooting scene of two positions, if the shooting frame rates of the two shooting devices are both 25 frames / s, the duration of the first display period is 40 ms, and within 40 ms, the two shooting devices are both shot once; if the shooting frame rates of the two shooting devices are 25 frames / s and 50 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, one shooting device is shot once, and the other shooting device can be shot twice; as another example, for a virtual shooting scene of three positions, if the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s and 25 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, two shooting devices are both shot once, and the other shooting device can be shot twice; if the shooting frame rates of the three shooting devices are 25 frames / s, 25 frames / s and 25 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, the three shooting devices are all shot once; if the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s and 100 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, one of the three shooting devices is shot once, one of the three shooting devices is shot twice, and one of the three shooting devices is shot four times.

[0057] In the process of virtual shooting by the plurality of shooting devices, due to the difference in the visual angle of different shooting devices, when any shooting device performs each shooting, the inner visual cone picture corresponding to the shooting device needs to be displayed on the display screen, so that the shooting device can shoot the correct picture.

[0058] The plurality of shooting devices correspond to at least one inner visual cone picture in the plurality of inner visual cone pictures in the first display period. For example, the number of the plurality of inner visual cone pictures in the first display period is the same as the number of times of shooting of the plurality of shooting devices in the first display period; for any shooting device, the number of inner visual cone pictures corresponding to the shooting device is the same as the number of times of shooting of the shooting device in the first display period.

[0059] Different shooting devices in the plurality of shooting devices correspond to different inner visual cone pictures, i.e. different shooting devices shoot different pictures; for the same shooting device, the inner visual cone picture for each shooting in the first display period can be the same or different.

[0060] As an example, for a virtual shooting scene with two shooting positions, if the shooting frame rates of the two shooting devices are both 25 frames / s, the duration of the first display period is 40 ms, and within 40 ms, the two shooting devices are both shot once, and accordingly, two internal view cone pictures need to be displayed within 40 ms; if the shooting frame rates of the two shooting devices are 25 frames / s and 50 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, one shooting device is shot once, and the other shooting device can be shot twice, and accordingly, three internal view cone pictures need to be displayed within 40 ms; as another example, for a virtual shooting scene with three shooting positions, if the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s and 25 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, two shooting devices are both shot once, and the other shooting device can be shot twice, and accordingly, four internal view cone pictures need to be displayed within 40 ms; if the shooting frame rates of the three shooting devices are 25 frames / s, 25 frames / s and 25 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, the three shooting devices are all shot once, and accordingly, three internal view cone pictures need to be displayed within 40 ms; if the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s and 100 frames / s respectively, the duration of the first display period is 40 ms, and within 40 ms, one shooting device is shot once, one shooting device is shot twice, and one shooting device is shot four times; and accordingly, seven internal view cone pictures need to be displayed within 40 ms.

[0061] The first display period includes a plurality of first time segments, each of the first time segments is used for displaying one internal view cone picture, and the internal view cone pictures displayed by different first time segments are different. For example, the number of first time segments in the first display period is the same as the number of internal view cone pictures in the plurality of internal view cone pictures in the first display period, that is, the number of first time segments in the first display period is the same as the total number of times that the plurality of shooting devices need to be shot in the first display period. For any shooting device, the first time segment used for displaying the internal view cone picture corresponding to the shooting device is the first time segment corresponding to the shooting device; if the shooting device needs to be shot once in the first display period, the number of internal view cone pictures corresponding to the shooting device is one, and accordingly, the number of corresponding first time segments is also one; if the shooting device needs to be shot multiple times in the first display period, the number of internal view cone pictures corresponding to the shooting device is multiple, and accordingly, the number of corresponding first time segments is also multiple, and each first time segment corresponds to one internal view cone picture, that is, each shooting corresponds to one time segment. For example, there is no overlap between different first time segments.

[0062] As an example, for a virtual shooting scene with two camera positions, if the shooting frame rates of the two shooting devices are both 25 frames / s, the duration of the first display period is 40 ms, and within 40 ms, the two shooting devices each shoot once. Correspondingly, 40 ms includes two first time segments for displaying two internal cone pictures, respectively. If the shooting frame rates of the two shooting devices are 25 frames / s and 50 frames / s, respectively, the duration of the first display period is 40 ms, and within 40 ms, one shooting device shoots once, and the other shooting device can shoot twice. Correspondingly, 40 ms includes three first time segments for displaying three internal cone pictures, respectively. As another example, for a virtual shooting scene with three camera positions, if the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s, and 25 frames / s, respectively, the duration of the first display period is 40 ms, and within 40 ms, two shooting devices each shoot once, and the other shooting device can shoot twice. Correspondingly, 40 ms includes four first time segments for displaying four internal cone pictures, respectively. If the shooting frame rates of the three shooting devices are 25 frames / s, 25 frames / s, and 25 frames / s, respectively, the duration of the first display period is 40 ms, and within 40 ms, the three shooting devices each shoot once. Correspondingly, 40 ms includes three first time segments for displaying three internal cone pictures, respectively. If the shooting frame rates of the three shooting devices are 25 frames / s, 50 frames / s, and 100 frames / s, respectively, the duration of the first display period is 40 ms, and within 40 ms, one of the three shooting devices shoots once, one of the three shooting devices shoots twice, and one of the three shooting devices shoots four times. Correspondingly, 40 ms includes seven first time segments for displaying seven internal cone pictures, respectively.

[0063] The duration of the first time segment determines the duration of the internal cone picture displayed on the display screen, that is, the duration during which the shooting device can capture the internal cone picture. Therefore, the first time segment can also be referred to as a capture time segment. As an example, the duration of each first time segment in the first display period can be determined according to the duration of the first display period and the duration of each shooting of the shooting device corresponding to the first time segment. For any shooting device, the duration of each shooting of the shooting device is a fixed value, which is the duration of exposure of a photosensor in the shooting device. The sum of the durations of the first time segments in the first display period is not more than the duration of the first display period. Meanwhile, for any first time segment, the duration of the first time segment is not less than the duration of each shooting of the shooting device corresponding to the first time segment. In this way, based on the above constraints, by reasonably configuring the durations of the first time segments, the number of shootings of the multiple shooting devices in the first display period and the fact that each shooting can shoot a complete picture as expected can be met.

[0064] As an example, each of the plurality of shooting devices is configured with a rolling shutter camera; wherein the length of each shooting of any shooting device in the first display period is the sum of the shutter time and the rolling time of the shooting device; wherein the shutter time represents the exposure time of each imaging point on the sensor of the rolling shutter camera, and the rolling time represents the time interval between the start of exposure of the first row of imaging points and the start of exposure of the last row of imaging points on the sensor of the rolling shutter camera. Correspondingly, the length of the first time segment corresponding to any shooting device is not less than the sum of the shutter time and the rolling time of the shooting device, so that by reasonably configuring the length of the first time segment, it is ensured that the rolling shutter camera of the shooting device can roll from the first row of imaging points to the last row of imaging points, and the display screen can continuously display the corresponding internal cone picture during the exposure time of all rows of imaging points.

[0065] For example, in the virtual shooting scene of the double-camera position in FIG. 2, if the camera 1 and the camera 2 are both rolling shutter cameras, and the shutter time is 5ms and the rolling time is 6ms; the shooting frame rate of the camera 1 and the camera 2 is 25 frames per second, then the length of the first display period can be determined as 40ms, and in the 40ms, the camera 1 and the camera 2 both need to shoot once, and correspondingly, the 40ms includes two first time segments T1 and T2, which are used to display the internal cone picture corresponding to the camera 1 and the internal cone picture corresponding to the camera 2 respectively, wherein the length of T1 and T2 is not less than the sum of the shutter time and the rolling time, and the sum of the lengths of T1 and T2 does not exceed the length of the first display period, that is, the length of T1 and T2 is not less than 11ms, and the sum of the lengths of T1 and T2 is not more than 40ms, and then under the two constraints, the specific values of the lengths of T1 and T2 can be set according to the requirements, for example, T1=T2=11ms, or T1=T2=20ms, or T1=14ms, T2=17ms, etc.

[0066] Based on the foregoing description, the duration of each first time segment in the first display period needs to satisfy the following constraints: the sum of the durations of each first time segment does not exceed the duration of the first display period, and for any first time segment, the duration of the first time segment is not less than the duration of each shooting of the corresponding shooting device. Under the condition of satisfying the above constraints, in addition to each first time segment, the first display period can also include at least one second time segment, that is, the first display period can include a plurality of first time segments and at least one second time segment. During the second time segment, the shooting device does not shoot. Therefore, the second time segment can also be referred to as a non-capture time segment. Since the content displayed in the second time segment will not be captured by the shooting device, that is, the content displayed in the second time segment will not affect the picture shot by the virtual shooting. Therefore, the display content of the second time segment can be flexibly configured as needed, for example, a preset image, a random image, one of a plurality of internal cone pictures, and the like.

[0067] Step 302, each shooting device in the plurality of shooting devices respectively shoots in the corresponding first time segment, so that each shooting device shoots the corresponding internal cone picture.

[0068] Exemplarily, the shooting device can be the shooting device 105 shown in FIG. 1.

[0069] This step can be performed by a plurality of shooting devices for virtual shooting; wherein each shooting device shoots with the internal cone picture displayed on the display screen as the background and the entity object as the foreground. Exemplarily, the entity object can include actors, props, scenery, and the like. At the same time, any shooting device shoots in the first time segment of the internal cone picture corresponding to the shooting device displayed on the display screen, so that the shooting device can shoot the correct internal cone picture. For any shooting device, if there are a plurality of first time segments corresponding to the shooting device in the first display period, the shooting device shoots in each corresponding first time segment to shoot the internal cone picture displayed in each first time segment, that is, each internal cone picture corresponding to the shooting device.

[0070] In a possible implementation, the starting time of each shooting of any shooting device in the plurality of shooting devices in the first display period is not earlier than the starting time of the first time segment corresponding to the shooting, and the duration of each shooting is not greater than the duration of the first time segment corresponding to the shooting.

[0071] Exemplarily, the starting moment of each photographing of any photographing device in the plurality of photographing devices in the first display period is the same as the starting moment of the first time segment corresponding to the photographing. In this way, the photographing device can photograph after the corresponding first time segment starts to display the inner view cone picture or synchronously, so that the photographing device can photograph the corresponding inner view cone picture, and since the length of each photographing does not exceed the length of the first time segment corresponding to the photographing, the photographing device has enough time to photograph a complete inner view cone picture, thereby ensuring that any photographing device can photograph a correct and complete inner view cone picture.

[0072] Exemplarily, the synchronization of the plurality of photographing devices and the display screen can be realized by the synchronization controller. Exemplarily, the synchronization controller can send a synchronization signal to any photographing device in the plurality of photographing devices and the display screen respectively; the display screen displays the inner view cone picture of the first time segment corresponding to the photographing device in response to the synchronization signal, and the photographing device starts photographing in response to the synchronization signal. For example, the synchronization controller can be the synchronization controller 103 in FIG. 1, the photographing device can be the photographing device 105, and the display screen can be the display screen 104. The synchronization controller 103 can send a synchronization signal to each photographing device 105 and the display screen 104, so as to realize that at the starting moment of any first time segment, the photographing device corresponding to the first time segment starts photographing synchronously, that is, the starting moment of each photographing in the first display period is the same as the starting moment of the first time segment corresponding to the photographing; or after the starting moment of any first time segment, the photographing device corresponding to the first time segment starts photographing, that is, the starting moment of each photographing in the first display period is later than the starting moment of the first time segment corresponding to the photographing. For example, the first time segment T1 corresponds to the photographing device P, the synchronization controller 103 can send a synchronization signal 1 to the display screen and the photographing device P, the display screen displays the first time segment 1 after receiving the synchronization signal 1, and the photographing device P starts photographing after receiving the synchronization signal 1, so as to realize that the photographing device P starts photographing synchronously at the starting moment of the first time segment T1.

[0073] In the embodiments of the present disclosure, in the first display period, a plurality of internal view cone pictures are displayed on the display screen in time division; wherein any one of the plurality of shooting devices corresponds to at least one of the plurality of internal view cone pictures, and different shooting devices correspond to different internal view cone pictures; the time division display means that the internal view cone picture corresponding to any one of the shooting devices is displayed in a first time segment corresponding to the shooting device in the first display period, and the internal view cone pictures corresponding to different shooting devices are displayed in different first time segments; each of the plurality of shooting devices shoots in the corresponding first time segment, so that each of the shooting devices shoots the corresponding internal view cone picture; in this way, by displaying the plurality of internal view cone pictures corresponding to the plurality of shooting devices in time division, it is ensured that each of the shooting devices can shoot with the corresponding internal view cone picture as the background in the same display period, thereby realizing virtual shooting of multiple positions; as an example, the shooting device can be configured with a rolling shutter camera, so that virtual shooting of multiple positions can be realized based on the rolling shutter camera, the demand for virtual shooting of multiple positions is met, and the production efficiency and application scenarios of virtual shooting are greatly improved.

[0074] In a possible implementation, the method can further include: obtaining the plurality of internal view cone pictures to be displayed in the first display period. For example, the plurality of internal view cone pictures to be displayed in the first display period can be obtained before the plurality of internal view cone pictures are displayed on the display screen in time division in the first display period in step 301.

[0075] For example, the plurality of internal view cone pictures to be displayed in the first display period can be obtained in the following manner.

[0076] For example, the plurality of internal view cone pictures to be displayed in the first display period can be obtained in the following manner.

[0077] FIG. 4 shows a flowchart of a method for obtaining a plurality of internal view cone pictures according to an embodiment of the present disclosure. As shown in FIG. 4, the method for obtaining the plurality of internal view cone pictures to be displayed in the first display period can include:

[0078] In step 401, the rendering device is used to render, based on the parameter data of the plurality of shooting devices and the original rendering data, the internal view cone picture corresponding to each of the shooting devices to be displayed in the first display period.

[0079] For example, the rendering device can be the rendering device 102 shown in FIG. 1.

[0080] Exemplarily, before performing the step, the rendering device can acquire the parameter data of each shooting device and the original to-be-rendered data, and then render the inner frustum pictures corresponding to the shooting devices. The original to-be-rendered data can be frame data, model geometry data, lighting data, environment data, etc. of a picture of a virtual scene planned to be shot by a user; the parameter data of the shooting device can include intrinsic parameters and extrinsic parameters, the intrinsic parameters of the shooting device can include focal length, optical center offset, distortion parameters, pixel size, and the extrinsic parameters of the shooting device can include position data and attitude data (for example, rotation angle); since the displacement and attitude of each shooting device can change in real time during the shooting process, the extrinsic parameters of each shooting device can be updated in real time.

[0081] The number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device. The higher the shooting frame rate of the shooting device is, the more the number of the corresponding inner frustum pictures is, and vice versa.

[0082] Exemplarily, for any shooting device, the number of the inner frustum pictures corresponding to the shooting device in the first display period is the same as the number of times the shooting device needs to shoot in the first display period; the number can be determined according to the length of the first display period and the shooting frame rate of the shooting device. The determination of the length of the first display period can refer to the foregoing description. For example, if the shooting frame rate of a shooting device is 25 frames per second and the length of the first display period is 40 ms, the shooting device needs to shoot once in 40 ms, and the number of the inner frustum pictures corresponding to the shooting device in the first display period is 1; for another example, if the shooting frame rate of a shooting device is 50 frames per second and the length of the first display period is 40 ms, the shooting device needs to shoot twice in 40 ms, and the number of the inner frustum pictures corresponding to the shooting device in the first display period is 2.

[0083] Exemplarily, for any shooting device, the rendering device can acquire the parameter data (such as attitude and rotation angle) of the shooting device in real time, simulate the state of the shooting device according to the parameter data, and render a certain number of inner frustum pictures corresponding to the shooting device based on the original to-be-rendered data. For example, the rendering device can map the original to-be-rendered data according to the parameter data of the shooting device to change the position, focal point, angle of view, etc. of the to-be-rendered data, so that the mapped to-be-rendered data (i.e. the inner frustum picture) is adapted to the shooting device.

[0084] Step 402, splicing the inner frustum pictures corresponding to each shooting device to be displayed in the first display period to obtain a frame of spliced image;

[0085] Exemplarily, the step can be performed by the broadcast processing device 101 in FIG. 1. After the rendering device 102 completes rendering of the inner view frustum picture corresponding to each shooting device, the rendering device 102 can send the rendered inner view frustum picture corresponding to each shooting device to the broadcast processing device 101. After the broadcast processing device 101 splices the inner view frustum pictures corresponding to each shooting device, a spliced picture is obtained, and the spliced picture is sent to the display screen 104. As an example, the spliced picture can be sent to a receiving card configured on the display screen 104 by a sending card configured on the broadcast processing device 101.

[0086] Exemplarily, the inner view frustum pictures corresponding to each shooting device can be spliced based on a preset order. For example, the inner view frustum pictures can be spliced according to the numbers of the shooting devices, or according to the order in which the shooting devices start shooting, or according to the order in which the inner view frustum pictures corresponding to the shooting devices are displayed in the same display period.

[0087] It is considered that when multi-camera shooting is performed, the shooting angles of different shooting devices can overlap, so that the inner view frustum pictures corresponding to different shooting devices displayed on the display screen can have overlapping areas. FIG. 5 shows a distribution diagram of different inner view frustum pictures on a display screen according to an embodiment of the present disclosure. As shown in FIG. 5, the inner view frustum picture A corresponding to the camera 1 and the inner view frustum picture B corresponding to the camera 2 are displayed on the display screen, and the inner view frustum picture A and the inner view frustum picture B have an overlapping area. When picture switching is performed, the overlapping area oscillates at a high frequency, thereby causing a certain high-frequency flicker, which affects the vision of the staff present, and therefore, in a multi-camera virtual shooting scene, it is necessary to reduce the flicker of the human eye when watching the screen caused by the overlapping area.

[0088] In a possible implementation, before the splicing of the inner view frustum pictures corresponding to each shooting device to be displayed in the first display period, the method further includes: determining whether the different inner view frustum pictures to be displayed in the first display period have overlapping areas; if there are overlapping areas, determining, for any overlapping area, a gray value of the overlapping area in the corresponding inner view frustum pictures; calculating a gray compensation value corresponding to the first display period based on the gray values of the overlapping area in the corresponding inner view frustum pictures; and performing gray compensation on the inner view frustum pictures corresponding to the overlapping area based on the gray compensation value corresponding to the first display period.

[0089] Exemplarily, the determining the gray scale value of the overlapping region in each corresponding inner view frustum image comprises: determining an average gray scale value of the overlapping region in each corresponding inner view frustum image. It can be understood that the number of the corresponding inner view frustum images of any overlapping region is at least two. In addition to the average gray scale value, the gray scale value of the overlapping region in each corresponding inner view frustum image can also be expressed in other ways, for example, the median gray scale value of all gray scale values of the overlapping region in each corresponding inner view frustum image can be determined instead of the average gray scale value, and the like. Those skilled in the art can select as needed.

[0090] Exemplarily, the calculating the gray scale compensation value corresponding to the first display period based on the gray scale value of the overlapping region in each corresponding inner view frustum image comprises: calculating a difference value of the average gray scale values of the overlapping region in each corresponding inner view frustum image, and taking the product of a preset proportion parameter and the difference value as the corresponding gray scale compensation value in the first display period. Wherein, if the number of the corresponding inner view frustum images of the overlapping region exceeds two, a plurality of difference values of the average gray scale values of the overlapping region in different corresponding inner view frustum images can be obtained by pairwise, and the final difference value can be obtained by averaging the plurality of difference values. Wherein, the difference value can be represented by any numerical value reflecting the difference size, such as difference value, ratio value, etc. The preset proportion parameter can be set arbitrarily as needed.

[0091] Exemplarily, the performing gray scale compensation on each inner view frustum image corresponding to the overlapping region based on the gray scale compensation value corresponding to the first display period comprises: obtaining a gray scale compensation value corresponding to a historical display period; calculating the average of the gray scale compensation value corresponding to the historical display period and the gray scale compensation value corresponding to the first display period; and performing gray scale compensation on each inner view frustum image corresponding to the overlapping region based on the average. Wherein, the historical display period can include one or more display periods before the first display period. In this way, by averaging the gray scale compensation values of the historical display periods, the gray scale fluctuation caused by the higher compensation value is reduced, so that the compensation of the picture in the time dimension is more gentle, that is, the difference compensation changes slowly with time, rather than suddenly or dramatically.

[0092] For example, taking the two inner cone pictures with overlapping area shown in FIG. 5 as an example, the overlapping area C = A & B can be calculated in real time according to the inner cone picture A and the inner cone picture B, and then the average gray value L_CA of the inner cone picture A in the overlapping area and the average gray value L_CB of the inner cone picture B in the overlapping area can be counted, and then the difference value Dif = L_CA - L_CB of the average gray value L_CA of the inner cone picture A in the overlapping area and the average gray value L_CB of the inner cone picture B in the overlapping area can be calculated; and then the gray compensation value Delta = -alpha * Dif is calculated, where alpha is a proportional parameter, for example, 0.5 can be taken, and the gray compensation value is the gray compensation value corresponding to the current display period, and then the average value Delta_t = tsmooth(Delta, Delta1, Delta2...) is calculated in combination with the gray compensation values corresponding to the historical display periods, where Delta1, Delta2... represent the gray compensation values corresponding to the historical different display periods, and tsmooth represents time low-pass processing, that is, the average value of these gray compensation values is taken; the inner cone picture A is compensated based on the average value Delta_t A_pro = A' + Delta_t, where A_pro is the gray value of the inner cone picture A after gray compensation, and A' is the original gray value of the inner cone picture A; the inner cone picture B is compensated based on the average value Delta_t B_pro = B' - Delta_t, where B_pro is the gray value of the inner cone picture B after gray compensation, and B' is the original gray value of the inner cone picture B. In this way, the gray difference of different inner cone pictures corresponding to the overlapping area is compensated into the inner cone picture A and the inner cone picture B, and the difference compensation is ensured to be slowly changed in time.

[0093] Further, if the inner view frustum picture A, the inner view frustum picture B and the inner view frustum picture C exist in the same overlapping area, the gray scale compensated gray scale values can be obtained by using the above-mentioned manner between each other, and after three times of processing, the average of the gray scale compensated gray scale values of the same inner view frustum picture is taken as the final gray scale value of the inner view frustum picture. For example, first, based on the average gray scale value L_CA of the inner view frustum picture A in the overlapping area and the average gray scale value L_CB of the inner view frustum picture B in the overlapping area, A_pro and B_pro are obtained by using the above-mentioned manner; second, based on the average gray scale value L_CA of the inner view frustum picture A in the overlapping area and the average gray scale value L_CC of the inner view frustum picture C in the overlapping area, A_pro and C_pro are obtained by using the above-mentioned manner; third, based on the average gray scale value L_CC of the inner view frustum picture C in the overlapping area and the average gray scale value L_CB of the inner view frustum picture B in the overlapping area, C_pro and B_pro are obtained by using the above-mentioned manner; further, the A_pro obtained in the first time and the A_pro obtained in the second time are averaged to obtain the final gray scale compensated gray scale value of the inner view frustum picture A, the B_pro obtained in the first time and the B_pro obtained in the third time are averaged to obtain the final gray scale compensated gray scale value of the inner view frustum picture B, and the C_pro obtained in the second time and the C_pro obtained in the third time are averaged to obtain the final gray scale compensated gray scale value of the inner view frustum picture C. When there are more than three overlapping inner view frustum pictures, the above-mentioned manner can be used for gray scale compensation.

[0094] The above-mentioned gray scale compensation process can be performed at any link before the multiple inner view frustum pictures are displayed on the display screen in time division, so that the inner view frustum pictures displayed on the display screen are gray scale compensated.

[0095] In step 403, the spliced image is split by the display screen to obtain the multiple inner view frustum pictures.

[0096] For example, the display screen 104 in FIG. 1 can perform the step, as an example, the receiving card configured on the display screen 104 splits the spliced image to obtain the multiple inner view frustum pictures corresponding to the shooting devices in the first display period.

[0097] For example, the spliced image can be split based on the splicing order when the inner view frustum pictures corresponding to the shooting devices to be displayed in the first display period are spliced.

[0098] In the embodiments of the present disclosure, the rendering device is used to render based on the parameter data of the plurality of shooting devices and the original to-be-rendered data to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; the inner frustum pictures corresponding to each shooting device to be displayed in the first display period are spliced to obtain a spliced image; the spliced image is split by the display screen to obtain the plurality of inner frustum pictures; and thus the inner frustum pictures required for real-time rendering and the transmission of the inner frustum pictures are realized, so that the display screen can be used for time-sharing display. As an example, after the inner frustum pictures required for rendering are obtained, a flicker reduction process is further performed, so as to reduce the flicker of the human eye when watching the screen in the overlapping area, effectively suppress the flicker perception of the naked eye of the on-site personnel, and improve the shooting comfort of the on-site personnel.

[0099] Method two,

[0100] In a possible implementation, the obtaining of the plurality of inner frustum pictures to be displayed in the first display period further includes: using a rendering device to render based on the parameter data of the plurality of shooting devices and the original to-be-rendered data to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; wherein the number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device; and the inner frustum pictures corresponding to each shooting device to be displayed in the first display period are transmitted to the display screen in a multi-channel transmission manner, so that the display screen obtains the plurality of inner frustum pictures.

[0101] The specific description of the rendering based on the parameter data of the plurality of shooting devices and the original to-be-rendered data by the rendering device can be referred to the related description in step 401.

[0102] For example, the control processing device and the display screen have a plurality of data transmission channels, and after the rendering device generates the inner frustum pictures corresponding to each shooting device to be displayed in the first display period, the control processing device sends the inner frustum pictures to the display screen in a multi-channel transmission manner through the plurality of data transmission channels. For example, the control processing device can be configured with a sending card, and the display screen can be configured with a receiving card; the sending card and the receiving card have a plurality of data transmission channels; the sending card sends the inner frustum pictures corresponding to each shooting device to be displayed in the first display period rendered by the rendering device to the receiving card through the plurality of data transmission channels; and the receiving card receives the inner frustum pictures through the plurality of data transmission channels, so as to realize the transmission of the inner frustum pictures corresponding to each shooting device to be displayed in the first display period to the display screen in a multi-channel transmission manner.

[0103] Exemplarily, before transmitting the inner view frustum pictures corresponding to the plurality of photographing devices to be displayed in the first display period to the display screen in a multi-channel transmission manner, it can be determined whether there is an overlapping area in the different inner view frustum pictures to be displayed in the first display period; if there is an overlapping area, for any overlapping area, the gray value of the overlapping area in the corresponding inner view frustum pictures is determined; based on the gray value of the overlapping area in the corresponding inner view frustum pictures, the gray compensation value corresponding to the first display period is calculated; and based on the gray compensation value corresponding to the first display period, the gray compensation is performed on the inner view frustum pictures corresponding to the overlapping area. The possible gray compensation manner can refer to the related description in the foregoing.

[0104] The possible implementation manner of displaying the plurality of inner view frustum pictures on the display screen in the step 301 is exemplarily described below.

[0105] Scenario one: the first display period includes a first time segment. In this scenario, the first display period only includes the first time segment. Therefore, in the first display period, only the inner view frustum pictures corresponding to the plurality of photographing devices can be displayed; and the determination manner of the number and length of the first time segments in the first display period can refer to the related description in the foregoing.

[0106] In a possible implementation manner, the displaying the plurality of inner view frustum pictures on the display screen comprises: sequentially displaying the plurality of inner view frustum pictures on the display screen, so that the display frame rate of the inner view frustum picture corresponding to any photographing device in the plurality of photographing devices on the display screen is the same as the photographing frame rate of the photographing device.

[0107] Exemplarily, the order of the first time segments in the first display period can be determined according to the photographing frame rate of each photographing device in the plurality of photographing devices; and the plurality of inner view frustum pictures are sequentially displayed on the display screen according to the order of the first time segments in the first display period, so that the display frame rate of the inner view frustum picture corresponding to any photographing device in the plurality of photographing devices on the display screen is the same as the photographing frame rate of the photographing device.

[0108] Exemplarily, the shooting frame rates of the plurality of shooting devices are same, and in the first display period, each shooting device needs to shoot once, corresponding to one first time segment. Then, the order of the first time segments in the first display period can be determined according to the order of starting shooting of the shooting devices, or a preset order, or a randomly generated order. Then, based on the order of the first time segments, the corresponding internal view cone picture is displayed on the display screen in the first time segment corresponding to each shooting device in turn, and correspondingly, each shooting device shoots once in the corresponding first time segment, thereby shooting the corresponding internal view cone picture. In this way, for any shooting device, one internal view cone picture corresponding to the shooting device is displayed in the same display period, and the shooting device shoots once in the same display period, thereby realizing that the display frame rate of the internal view cone picture corresponding to any shooting device in the plurality of shooting devices on the display screen is same as the shooting frame rate of the shooting device, meeting the virtual shooting requirement of multiple positions.

[0109] Exemplarily, in the virtual shooting process, the number, duration and order of the first time segments in each display period are same, that is, the data, duration and order of the first time segments can be determined only in the initial display period.

[0110] For example, FIG. 6 shows a schematic diagram of the order of a first time segment according to an embodiment of the present disclosure; as shown in FIG. 6, it is a virtual shooting scene of two positions, and the shooting frame rates of the two shooting devices are same. T1 and T2 respectively represent the first time segments corresponding to the shooting devices; in the same display period, T1 and T2 can be arranged in the order of T1 first and T2 second (i.e. the case shown in FIG. 6), or in the order of T2 first and T1 second, so that in the same display period, one internal view cone picture corresponding to T1 and T2 is displayed respectively, and T1 and T2 both shoot once, and the shooting frame rates of T1 and T2 are same as the display frame rates of the internal view cone pictures corresponding to T1 and T2 on the display screen.

[0111] FIG. 7 shows a schematic diagram of an order of a first time segment according to an embodiment of the present disclosure; as shown in FIG. 7, it is a virtual shooting scene of three positions, and the shooting frame rates of the three shooting devices are the same. T1, T2, and T3 represent the first time segments corresponding to the shooting devices respectively, and in the same display period, T1, T2, and T3 can be arranged in the order of T1, T2, and T3 (i.e. the case shown in FIG. 7), or can be arranged in the order of T2, T1, and T3, or can be arranged in the order of T3, T1, and T2, etc. It can be understood that the order of T1, T2, and T3 can be flexibly set, as long as there is and only one T1, T2, and T3 in each display period, and the order in different display periods is the same. In this way, in the same display period, one inner cone picture corresponding to T1, T2, and T3 is displayed respectively, and T1, T2, and T3 are all shot once, and the shooting frame rate of T1, T2, and T3 is the same as the display frame rate of the inner cone picture corresponding to T1, T2, and T3 on the display screen.

[0112] Scene two: the first display period includes the first time segment and the second time segment. The number of the first time segment and the second time segment can be one or more. In this scene, the first display period includes the first time segment and the second time segment, so that the inner cone picture corresponding to each shooting device can be displayed in the first display period. After determining the number, duration, and order of the first time segment, the number, duration, order, and display content of the second time segment can be further flexibly set. The determination of the duration and number of the first time segment in the first display period can refer to the related description in the foregoing.

[0113] For example, in the case that the shooting frame rates of at least two shooting devices in the plurality of shooting devices are different, for a plurality of first time segments corresponding to the same shooting device existing in the first display period, the order of other first time segments and each second time segment in the first display period can be configured according to requirements, as long as these first time segments are arranged at equal intervals in the first display period.

[0114] Considering that the content displayed in the second time segment in the process of virtual shooting will be seen by the on-site staff, the content displayed in the second time segment can be reasonably designed to reduce the flicker caused by the on-site staff viewing the screen with the naked eye as much as possible. For example, any second time segment displays one of the plurality of inner cone pictures. In this way, it is more convenient to directly reuse the rendered inner cone picture as the display content of the second time segment. At the same time, since the difference between different inner cone pictures in the same display period is usually not too large, the picture flicker is reduced.

[0115] Exemplarily, the number and length of the second time segments in the first display period can be configured according to requirements under the condition of meeting constraints; for example, the constraints can include: the total length of each second time segment in the first display period and the total length of each first time segment is equal to the length of the first display period.

[0116] As an example, the length of the first time segment and the second time segment displaying the same inner visual cone picture in the first display period is close. As another example, the length of the first time segment and the second time segment displaying the same inner visual cone picture in the first display period is the same, thereby reducing flicker.

[0117] For example, FIG. 8 shows a schematic diagram of the ordering of the first time segments according to an embodiment of the present disclosure; as shown in FIG. 8, the virtual shooting scene is of double camera positions, and the shooting frame rates of the two shooting devices are the same. T1 and T2 respectively represent the first time segments corresponding to the shooting devices; T' represents the second time segment. As shown in FIG. 8, in the same display period, one T1, one T2, and one T' are included, and are sequentially arranged in the order of T1, T', and T2, so that the shooting frame rate of any shooting device is the same as the display frame rate of the corresponding internal view cone picture. FIG. 9 shows a schematic diagram of the ordering of the first time segments according to an embodiment of the present disclosure; as shown in FIG. 9, the virtual shooting scene is of double camera positions, and the shooting frame rate of one shooting device is twice that of the other shooting device. T1 and T2 respectively represent the first time segments corresponding to the shooting devices; T' represents the second time segment. As shown in FIG. 8, in the same display period, two T1, one T2, and one T' are included, and are sequentially arranged in the order of T1, T2, T1, and T', wherein the time length of T' is the same as that of T2, so that the shooting frame rate of any shooting device is the same as the display frame rate of the corresponding internal view cone picture. FIG. 10 shows a schematic diagram of the ordering of the first time segments according to an embodiment of the present disclosure; as shown in FIG. 10, the virtual shooting scene is of three camera positions, and the shooting frame rates of two shooting devices are the same, which are twice that of the other shooting device. T1, T2, and T3 respectively represent the first time segments corresponding to the shooting devices, and T' represents the second time segment. As shown in FIG. 9, in the same display period, two T1, two T2, one T3, and one T' are included, and are sequentially arranged in the order of T1, T2, T3, T1, T2, and T', wherein the time length of T' is the same as that of T3, so that the shooting frame rate of any shooting device is the same as the display frame rate of the corresponding internal view cone picture. FIG. 11 shows a schematic diagram of the ordering of the first time segments according to an embodiment of the present disclosure; as shown in FIG. 11, the virtual shooting scene is of three camera positions, and the shooting frame rates of the three shooting devices are the same. T1, T2, and T3 respectively represent the first time segments corresponding to the shooting devices, and T' represents the second time segment. As shown in FIG. 11, in the same display period, one T1, one T2, one T3, and two T' are included, and are sequentially arranged in the order of T1, T', T2, T', and T3, so that the shooting frame rate of any shooting device is the same as the display frame rate of the corresponding internal view cone picture. FIG. 12 shows a schematic diagram of the ordering of the first time segments according to an embodiment of the present disclosure; as shown in FIG. 12, the virtual shooting scene is of double camera positions, and the shooting frame rates of the two shooting devices are the same. T1 and T2 respectively represent the first time segments corresponding to the shooting devices; T' represents the second time segment.As shown in FIG. 12, in the same display period, one T1, one T2, and two T' are arranged in the order of T1, T', T2, and T' to make the shooting frame rate of any shooting device the same as the display frame rate of the corresponding internal view cone picture, and to improve the display refresh rate and further reduce the influence of flicker. FIG. 13 shows a schematic diagram of the ordering of a first time segment according to an embodiment of the present disclosure. As shown in FIG. 13, it is a virtual shooting scene of three camera positions, and the shooting frame rates of the three shooting devices are the same. T1, T2, and T3 represent the corresponding first time segments of the shooting devices, and T' represents the second time segment. As shown in FIG. 13, in the same display period, one T1, one T2, one T3, and three T' are arranged in the order of T1, T', T2, T', T3, and T' to make the shooting frame rate of any shooting device the same as the display frame rate of the corresponding internal view cone picture, and to improve the display refresh rate and further reduce the influence of flicker.

[0118] In a possible implementation, any second time segment of the at least one second time segment displays one internal view cone picture of the plurality of internal view cone pictures; and the time-sharing display of the plurality of internal view cone pictures on the display screen comprises: sequentially displaying the plurality of internal view cone pictures on the display screen according to the ordering of the first time segments and the ordering of the second time segments in the first display period, so that the internal view cone pictures corresponding to the shooting devices are alternately displayed in the first display period.

[0119] For example, the ordering of the second time segments and the internal view cone pictures to be displayed in the second time segments in the first display period can be determined according to the ordering of the first time segments and the internal view cone pictures to be displayed in the first time segments in the first display period; and the plurality of internal view cone pictures are sequentially displayed on the display screen according to the ordering of the first time segments and the ordering of the second time segments in the first display period, so that the internal view cone pictures corresponding to the shooting devices are alternately displayed in the first display period.

[0120] For example, the time lengths of the first time segment and the second time segment of the same internal view cone picture in the first display period are close or the same, so that the influence of flicker is further reduced on the basis of the alternately display.

[0121] For example, the plurality of shooting devices are two shooting devices, and the plurality of internal view cone pictures are two internal view cone pictures; the first display period includes two first time segments and two second time segments; the two second time segments are located between the two first time segments, and the two second time segments display the two internal view cone pictures, respectively, so that the internal view cone pictures corresponding to the two shooting devices are alternately displayed in the first display period.

[0122] For example, FIG. 14 shows a schematic diagram of display content on a display screen changing over time according to an embodiment of the present disclosure. As shown in FIG. 14, the horizontal axis represents time, and the vertical axis includes high and low levels. The high level represents the display of the inner view frustum picture A, and the low level represents the display of the inner view frustum picture B, which correspond to the two shooting devices, respectively. Taking the shooting frame rate of the two shooting devices as 25 frames per second, that is, one frame of image is shot every 40 ms, the length of the first display period can be determined as 40 ms. In the 40 ms, the inner view frustum picture A and the inner view frustum picture B are displayed, respectively. Two first time periods are needed in the first display period, and the length of each first time period is not less than the length of shooting of the shooting device each time. Taking the shutter length of the shooting device as 5 ms and the rolling length as 6 ms as an example, the first time period needs at least 11 ms. Assuming that T1=T4=11 ms in FIG. 14 is the first time period, and T2 and T3 are the second time period, then T2+T3=18 ms, T2 and T3 can be taken as 9 ms. T1 and T3 display the inner view frustum picture A (that is, T1 displays A(1, t1) and T3 displays A(2, t1) in the figure), and T2 and T4 display the inner view frustum picture B (that is, T2 displays B(1, t1) and T4 displays B(2, t1) in the figure). In this way, T1, T2, T3, and T4 alternately display the inner view frustum pictures corresponding to the two shooting devices, which meets the requirement of the display screen displaying the inner view frustum picture and the shooting device shooting synchronously, and also can better reduce the naked-eye flicker and improve the viewing comfort of the on-site personnel such as actors and shooting teams.

[0123] In the embodiments of the present disclosure, by configuring the order of each first time segment and / or the order of each second time segment in the first display period, the multi-camera virtual shooting requirement is met, and the flicker is controlled by reasonable order of each first time segment and / or second time segment, the flicker perception of the naked eye is suppressed, and the shooting comfort of the on-site personnel is improved.

[0124] For example, taking the virtual shooting of the double-camera positions shown in FIG. 2 by using the virtual shooting system shown in FIG. 1 as an example, FIG. 15 shows a method flowchart of virtual shooting according to an embodiment of the present disclosure. As shown in FIG. 15, the rendering device 102 acquires the parameter data (internal parameters and real-time updated external parameters) of the camera 1 and the camera 2 and the original data to be rendered, and renders the inner view cone picture A and the inner view cone picture B according to the parameter data of the camera 1 and the camera 2, wherein the inner view cone picture A corresponds to the camera 1, and the inner view cone picture B corresponds to the camera 2. The rendering device 102 transmits the rendered inner view cone picture A and the inner view cone picture B to the broadcast control processing device 101. The broadcast control processing device 101 receives the inner view cone picture A and the inner view cone picture B, splices the inner view cone picture A and the inner view cone picture B to obtain a frame image AB, and can perform flicker reduction according to the overlap of the inner view cone picture A and the inner view cone picture B. The sending card of the broadcast control processing device 101 sends the spliced image AB to the receiving card configured by the display screen 104 according to the shooting phase requirement (for example, the order of starting shooting of the camera 1 and the camera 2). The receiving card configured by the display screen 104 receives the spliced image AB, first performs splitting processing on the image AB to separate the inner view cone picture A and the inner view cone picture B, and then performs time-sharing on-screen display according to the sorting of the first time segment and / or the second time segment. The display screen 104 displays the inner view cone picture A and the inner view cone picture B in time-sharing manner. The camera 1 captures an image with the inner view cone picture A as the background, and the camera 2 captures an image with the inner view cone picture B as the background. During this period, the synchronization controller 103 locks the shooting frame rate of the sending card and the camera, and adjusts the shutter phase (that is, the time when shooting starts) of the camera 1 and the camera 2 respectively, so that the camera 1 and the camera 3 can capture the inner view cone picture A and the inner view cone picture B respectively without picture aliasing. In this way, the actual needs of virtual shooting are combined to meet the double-camera position shooting requirement, and the flicker perception of the naked eye is suppressed through reasonable on-screen content sorting control and flicker reduction, thereby improving the shooting comfort.

[0125] Based on the same inventive concept of the above-mentioned method embodiments, the embodiments of the present disclosure also provide a virtual shooting device which can be used to execute the technical solutions described in the above-mentioned method embodiments.

[0126] FIG. 16 shows a structural schematic diagram of a virtual camera according to an embodiment of the present disclosure, which is applied to virtual shooting with multiple shooting devices. As shown in FIG. 16, the device can include a display module 1601 configured to display multiple internal cone pictures on a display screen in a first display period in time division; wherein any shooting device in the multiple shooting devices corresponds to at least one internal cone picture in the multiple internal cone pictures, and different shooting devices correspond to different internal cone pictures; the time division display indicates that the internal cone picture corresponding to any shooting device is displayed in a first time segment corresponding to the shooting device in the first display period, and the internal cone pictures corresponding to different shooting devices are displayed in different first time segments; and a shooting module 1602 configured to shoot in the corresponding first time segment by each shooting device in the multiple shooting devices, so that each shooting device shoots the corresponding internal cone picture.

[0127] In the embodiment of the present disclosure, multiple internal cone pictures are displayed on a display screen in a first display period in time division; wherein any shooting device in the multiple shooting devices corresponds to at least one internal cone picture in the multiple internal cone pictures, and different shooting devices correspond to different internal cone pictures; the time division display indicates that the internal cone picture corresponding to any shooting device is displayed in a first time segment corresponding to the shooting device in the first display period, and the internal cone pictures corresponding to different shooting devices are displayed in different first time segments; and each shooting device in the multiple shooting devices shoots in the corresponding first time segment, so that each shooting device shoots the corresponding internal cone picture; in this way, multiple internal cone pictures corresponding to the multiple shooting devices are displayed in time division, so that each shooting device can shoot with the corresponding internal cone picture as the background in the same display period, thereby realizing virtual shooting with multiple positions. As an example, the shooting device can be configured with a rolling shutter camera, so that virtual shooting with multiple positions can be realized based on the rolling shutter camera, the demand for virtual shooting with multiple positions is met, and the production efficiency and application scenarios of virtual shooting are greatly improved.

[0128] In a possible implementation, the start time of each shooting of any shooting device in the multiple shooting devices in the first display period is not earlier than the start time of the first time segment corresponding to the shooting, and the time length of each shooting is not greater than the time length of the first time segment corresponding to the shooting.

[0129] In a possible implementation, the device further includes a synchronization module configured to send a synchronization signal to the display screen and any shooting device in the multiple shooting devices through a synchronization controller; and the display module 1601 is further configured to display the internal cone picture of the first time segment corresponding to the shooting device in response to the synchronization signal, and simultaneously, the shooting device starts shooting in response to the synchronization signal.

[0130] In a possible implementation, the display module 1601 is further configured to: display the plurality of internal view cone pictures on the display screen in sequence, so that the display frame rate of the internal view cone picture corresponding to any one of the plurality of shooting devices on the display screen is the same as the shooting frame rate of the shooting device.

[0131] In a possible implementation, the first display period further includes at least one second time segment; and during the second time segment, the shooting device does not perform shooting.

[0132] In a possible implementation, any one of the at least one second time segment displays one of the plurality of internal view cone pictures; and the display module 1601 is configured to: display the plurality of internal view cone pictures on the display screen in sequence according to the order of the first time segments and the order of the second time segments in the first display period, so that the internal view cone pictures corresponding to the plurality of shooting devices are displayed alternately in the first display period.

[0133] In a possible implementation, the time length of the first time segment and the second time segment in which the same internal view cone picture is displayed in the first display period is the same.

[0134] In a possible implementation, the plurality of shooting devices are two shooting devices, and the plurality of internal view cone pictures are two internal view cone pictures; the first display period includes two first time segments and two second time segments; and the two second time segments are located between the two first time segments, and the two second time segments display the two internal view cone pictures respectively, so that the internal view cone pictures corresponding to the two shooting devices are displayed alternately in the first display period.

[0135] In a possible implementation, the apparatus further includes an acquisition module configured to: render, by a rendering device, based on the parameter data of the plurality of photographing devices and the original to-be-rendered data, the inner frustum pictures corresponding to each photographing device to be displayed in the first display period, wherein the number of inner frustum pictures corresponding to any photographing device is related to the photographing frame rate of the photographing device; splice the inner frustum pictures corresponding to each photographing device to be displayed in the first display period to obtain a spliced image; split the spliced image by the display screen to obtain the plurality of inner frustum pictures; or render, by a rendering device, based on the parameter data of the plurality of photographing devices and the original to-be-rendered data, the inner frustum pictures corresponding to each photographing device to be displayed in the first display period, wherein the number of inner frustum pictures corresponding to any photographing device is related to the photographing frame rate of the photographing device; and transmit, in a multi-channel transmission manner, the inner frustum pictures corresponding to each photographing device to be displayed in the first display period to the display screen, so that the display screen obtains the plurality of inner frustum pictures.

[0136] In a possible implementation, the acquisition module is further configured to: determine whether there is an overlapping area in different inner frustum pictures to be displayed in the first display period; if there is an overlapping area, determine, for any overlapping area, the gray value of the overlapping area in the corresponding inner frustum pictures; calculate a gray compensation value corresponding to the first display period based on the gray values of the overlapping area in the corresponding inner frustum pictures; and perform gray compensation on the inner frustum pictures corresponding to the overlapping area based on the gray compensation value corresponding to the first display period.

[0137] In a possible implementation, the acquisition module is configured to: acquire a gray compensation value corresponding to a historical display period; calculate a mean value of the gray compensation value corresponding to the historical display period and the gray compensation value corresponding to the first display period; and perform gray compensation on the inner frustum pictures corresponding to the overlapping area based on the mean value.

[0138] In a possible implementation, the photographing frame rates of any two photographing devices in the plurality of photographing devices are the same or in a multiple relationship.

[0139] In some embodiments, the apparatus provided by the embodiments of the present disclosure has functions or includes modules that can be used to execute the methods described in the above method embodiments, and the specific implementation can be referred to the description of the above method embodiments, which will not be described here in detail for simplicity.

[0140] The embodiments of the present disclosure also provide a computer-readable storage medium having stored computer program instructions, which, when executed by a processor, implement the above method. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0141] The embodiment of the present disclosure further provides an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0142] The embodiment of the present disclosure further provides a computer program product, comprising computer readable code, or a non-volatile computer readable storage medium carrying computer readable code, when the computer readable code is run in the processor of the electronic device, the processor in the electronic device executes the above method.

[0143] FIG. 17 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, the device 1900 can be provided as a server or a terminal device. Referring to FIG. 17, the device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions, such as an application program, executable by the processing component 1922. The application program stored in the memory 1932 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute the instructions to perform the above method. The device 1900 can further include a power supply component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to a network, and an input output interface 1958 (I / O interface). The device 1900 can operate based on an operating system stored in the memory 1932, such as Windows Server TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM or the like. In an exemplary embodiment, a non-volatile computer readable storage medium, such as the memory 1932 including computer program instructions executable by the processing component 1922 of the device 1900 to complete the above method, is also provided.

[0144] The present disclosure can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.

[0145] Computer readable storage media can be tangible storage media which can retain and store instructions for use by an instruction execution device. Computer readable storage media can be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer readable storage media include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.

[0146] Computer readable program instructions for carrying out operations of the present disclosure can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or any combination of one or more of the above in any combination, written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.

[0147] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0148] The computer program product of the second aspect can include a computer readable storage medium. The computer readable storage medium can include instructions. The instructions can include one or both of: instructions for causing a computer to enable a user equipment device to receive a configuration message from a base station, the configuration message comprising an indication of a set of one or more parameters for a first type of hybrid automatic repeat request process, the first type of hybrid automatic repeat request process being associated with a first type of data; and instructions for causing a computer to enable a user equipment device to receive a configuration message from a base station, the configuration message comprising an indication of a set of one or more parameters for a first type of hybrid automatic repeat request process, the first type of hybrid automatic repeat request process being associated with a first type of data.

[0149] Embodiments of the present disclosure have been described above, with the understanding that these embodiments are exemplary only, and are not restrictive, and are not limited to the disclosed embodiments. Many modifications and changes to this disclosure would be apparent to those of ordinary skill in the art. The scope of the technology disclosed is not to be limited by the specific illustrative embodiments presented above, but only by the claims that follow. The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting.

Claims

1. A virtual photographing method characterized by comprising: The method is applied to virtual shooting by using multiple shooting devices, and the method comprises the following steps: In a first display period, multiple internal cone pictures are displayed on a display screen in time division; wherein any shooting device in the multiple shooting devices corresponds to at least one internal cone picture in the multiple internal cone pictures, and different shooting devices correspond to different internal cone pictures; the time division display means that the internal cone picture corresponding to any shooting device is displayed in a first time segment corresponding to the shooting device in the first display period, and the internal cone pictures corresponding to different shooting devices are displayed in different first time segments; Each shooting device in the multiple shooting devices shoots in the corresponding first time segment, so that each shooting device shoots the corresponding internal cone picture.

2. The method of claim 1, wherein, The starting moment of each shooting of any shooting device in the multiple shooting devices in the first display period is not earlier than the starting moment of the first time segment corresponding to the shooting, and the time length of each shooting is not longer than the time length of the first time segment corresponding to the shooting.

3. The method of claim 1, wherein, The method further comprises the following steps: The display screen displays the internal cone picture of the first time segment corresponding to the shooting device in response to the synchronization signal, and at the same time, the shooting device starts shooting in response to the synchronization signal.

4. The method of claim 1, wherein, The time division display of the multiple internal cone pictures on the display screen comprises the following steps: The multiple internal cone pictures are displayed on the display screen in sequence, so that the display frame rate of the internal cone picture corresponding to any shooting device in the multiple shooting devices on the display screen is the same as the shooting frame rate of the shooting device.

5. The method of claim 1, wherein, The first display period further comprises at least one second time segment; wherein the shooting device does not shoot during the second time segment.

6. The method of claim 5, wherein, Any second time segment in the at least one second time segment displays one internal cone picture in the multiple internal cone pictures; The time division display of the multiple internal cone pictures on the display screen comprises the following steps: According to the sequence of each first time segment and the sequence of each second time segment in the first display period, the multiple internal cone pictures are displayed on the display screen in sequence, so that the internal cone picture corresponding to each shooting device is displayed alternately in the first display period.

7. The method of claim 6, wherein, The time length of the first time segment and the second time segment of the same internal cone picture in the first display period is the same.

8. The method of claim 7, wherein, The multiple shooting devices are two shooting devices, and the multiple internal cone pictures are two internal cone pictures; the first display period comprises two first time segments and two second time segments; wherein the two second time segments are located between the two first time segments, and the two second time segments display the two internal cone pictures respectively, so that the internal cone pictures corresponding to the two shooting devices are displayed alternately in the first display period.

9. The method of claim 1, wherein, The method further comprises the following steps: rendering equipment is used to render based on the parameter data of the plurality of shooting devices and the original to-be-rendered data, to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; wherein the number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device; the inner frustum pictures corresponding to each shooting device to be displayed in the first display period are spliced to obtain a spliced image; the spliced image is split by the display screen to obtain the plurality of inner frustum pictures; or, rendering equipment is used to render based on the parameter data of the plurality of shooting devices and the original to-be-rendered data, to obtain the inner frustum pictures corresponding to each shooting device to be displayed in the first display period; wherein the number of the inner frustum pictures corresponding to any shooting device is related to the shooting frame rate of the shooting device; the inner frustum pictures corresponding to each shooting device to be displayed in the first display period are transmitted to the display screen in a multi-channel transmission manner, so that the display screen obtains the plurality of inner frustum pictures.

10. The method according to claim 1 or 9, characterized in that, The method further includes: judging whether there is an overlapping area in different inner frustum pictures to be displayed in the first display period; if there is an overlapping area, for any overlapping area, the gray values of the overlapping area in the corresponding inner frustum pictures are determined; based on the gray values of the overlapping area in the corresponding inner frustum pictures, a gray compensation value corresponding to the first display period is calculated; the gray compensation value corresponding to the first display period is used to perform gray compensation on the inner frustum pictures corresponding to the overlapping area.

11. The method of claim 10, wherein, The gray compensation value corresponding to the first display period is used to perform gray compensation on the inner frustum pictures corresponding to the overlapping area, including: obtaining a gray compensation value corresponding to a historical display period; calculating the mean value of the gray compensation value corresponding to the historical display period and the gray compensation value corresponding to the first display period; based on the mean value, the gray compensation is performed on the inner frustum pictures corresponding to the overlapping area.

12. The method of claim 1, wherein, The shooting frame rates of any two shooting devices in the plurality of shooting devices are the same or in a multiple relationship.

13. A virtual camera, characterized by The device is applied to virtual shooting using a plurality of shooting devices, and includes: a display module configured to display a plurality of inner frustum pictures on a display screen in a first display period; wherein any shooting device in the plurality of shooting devices corresponds to at least one inner frustum picture in the plurality of inner frustum pictures, and the inner frustum pictures corresponding to different shooting devices are different; the display of any shooting device corresponding to the inner frustum picture in the first display period is displayed in a first time segment corresponding to the shooting device, and the inner frustum pictures corresponding to different shooting devices are displayed in different first time segments; a shooting module configured to perform shooting in a corresponding first time segment by each shooting device in the plurality of shooting devices, so that each shooting device shoots a corresponding inner frustum picture.

14. An electronic device, comprising: includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method of any one of claims 1 to 12 when executing the instructions stored in the memory.

15. A non-transitory computer readable storage medium having stored thereon computer program instructions, wherein, The computer program instructions, when executed by a processor, implement the method of any one of claims 1 to 12.

Images