Virtual camera adjustment method and device

Abstract

One or more embodiments of the present disclosure provide a method and apparatus for adjusting a virtual camera, which are applied to a data processing program running on a computing device; a virtual camera corresponding to a physical camera is created in a virtual three-dimensional space corresponding to a physical three-dimensional space simulated on the computing device; the virtual camera is used to simulate shooting of a virtual scene, and the simulated shot image is displayed through a physical screen; the physical camera is used to shoot the physical screen; a virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the method comprises: obtaining focus data corresponding to the physical camera; determining the position of a first focus after the physical camera is focused, and determining the relative position relationship between the first focus and the physical screen; if the first focus is located in front of the physical screen, adjusting the position of a second focus of the virtual camera to the virtual screen model, and sending the focus data to the physical camera for focusing.

Description

Technical Field

[0001] One or more embodiments of the present disclosure relate to the field of virtual shooting technology, and in particular, to a method and device for adjusting a virtual camera. Background Art

[0002] Virtual shooting based on physical screens is an emerging film and television shooting technology that combines physical screens (such as LED screens or LCD screens), real-time computer graphics (Real-time Computer Graphics) and traditional photography techniques. In this technology, the physical screen is used as a background to display a pre-designed virtual scene, so that actors and cameras can interact directly with this virtual scene. The display image of this virtual scene on the physical screen is rendered in real time by a computer and can be adjusted in real time according to the needs of the shooting. This technology allows filmmakers to see the final visual effects on the set without having to wait until the post-production stage. In this way, directors and actors can better control the camera and performance during shooting to achieve the desired effect.

[0003] When performing virtual shooting based on a physical screen, it is usually necessary to create a virtual camera in a computer and render the display image of the virtual scene on the physical screen according to the shooting-related data of the virtual camera, that is, it can be regarded as an image obtained by simulating the shooting of the virtual scene by the virtual camera through the physical screen. The physical camera is used to shoot the physical screen, specifically to shoot the real scene and the display image on the physical screen. In practical applications, it is usually hoped to increase the degree of reality of the virtual scene in the image captured by the physical camera as much as possible. This degree of reality includes both the matching degree of the spatial position and perspective relationship of the virtual and real objects, and the matching degree of the defocus effect. In the related art, it is usually required that the shooting-related data of the virtual camera and the physical camera are consistent. Although this can ensure the matching degree of the spatial position and perspective relationship of the virtual and real objects, it will cause the problem of secondary defocus in the virtual scene in the image captured by the physical camera. Specifically, since the shooting-related data of the virtual camera and the physical camera are consistent, when the image captured by the physical camera has a defocus effect (for example, the physical camera is not correctly focused as required), the image captured by the virtual camera also has a defocus effect because the virtual camera follows the shooting parameters of the physical camera. Therefore, the displayed image of the virtual scene on the physical screen has a primary defocus effect. In this case, the physical camera, which was originally not correctly focused, shoots the displayed image on the physical screen again, and the virtual scene part in the obtained image has a secondary defocus effect, which causes the defocus effect of the real scene part and the virtual scene part in the image to not match. Summary of the invention

[0004] One or more embodiments of the present disclosure provide the following technical solutions:

[0005] The present disclosure provides a method for adjusting a virtual camera, which is applied to a data processing program running on a computing device; a virtual three-dimensional space corresponding to a physical three-dimensional space is simulated on the computing device; a virtual camera corresponding to a physical camera is created in the virtual three-dimensional space; the virtual camera is used to simulate shooting of a preset virtual scene, and the simulated shot image is displayed through a physical screen; the physical camera is used to shoot the physical screen; a virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the method comprises:

[0006] Acquire adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data;

[0007] Determine a position of a first focus of the physical camera after focusing based on the focus data, and determine a relative position relationship between the first focus and the physical screen;

[0008] If the first focus is located in front of the physical screen, the position of the second focus of the virtual camera is adjusted to the virtual screen model, and the adjustment data is sent to the physical camera so that the physical camera focuses based on the focus data.

[0009] The present disclosure also provides a virtual camera adjustment device, which is applied to a data processing program running on a computing device; a virtual three-dimensional space corresponding to a physical three-dimensional space is simulated on the computing device; a virtual camera corresponding to a physical camera is created in the virtual three-dimensional space; the virtual camera is used to simulate shooting of a preset virtual scene, and the simulated shot image is displayed through a physical screen; the physical camera is used to shoot the physical screen; a virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the device comprises:

[0010] An acquisition module, used to acquire adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data;

[0011] a determination module, configured to determine a position of a first focus of the physical camera after focusing based on the focus data, and determine a relative position relationship between the first focus and the physical screen;

[0012] An adjustment module is used to adjust the position of the second focus of the virtual camera to the virtual screen model when the first focus is located in front of the physical screen, and send the adjustment data to the physical camera so that the physical camera focuses based on the focus data.

[0013] The present disclosure also provides an electronic device, comprising:

[0014] processor;

[0015] a memory for storing processor-executable instructions;

[0016] The processor implements the steps of any of the above methods by running the executable instructions.

[0017] The present disclosure also provides a computer-readable storage medium having computer instructions stored thereon, which implement the steps of any of the above methods when executed by a processor.

[0018] In the above technical solution, a virtual three-dimensional space corresponding to the physical three-dimensional space can be simulated on the computing device, and a virtual camera corresponding to the physical camera and a virtual screen model corresponding to the physical screen can be created in the virtual three-dimensional space, wherein the virtual camera can be used to simulate shooting of a preset virtual scene, and the simulated shot image can be displayed through the physical screen, and the physical camera can be used to shoot the physical screen; the data processing program on the computing device can determine the position of the first focus of the physical camera after focusing based on the focus data when obtaining adjustment data containing focus data corresponding to the physical camera, and determine the relative position relationship between the first focus and the physical screen; when it is determined that the first focus is located in front of the physical screen, the position of the second focus of the virtual camera is adjusted to the virtual screen model, and the adjustment data is sent to the physical camera so that the physical camera focuses based on the focus data.

[0019] By adopting this method, when realizing virtual shooting, on the one hand, the focus position of the created virtual camera corresponding to the physical camera can be automatically adjusted according to the focus position of the current physical camera, so as to reduce the out-of-focus effect of the image captured by the virtual camera, avoid the problem of secondary out-of-focus, and avoid manually setting the offset distance for the focus of the virtual camera. Therefore, the adjustment efficiency and accuracy are relatively high, which is suitable for scenes where the physical camera moves over a large range. Moreover, since the focus position of the virtual camera can be automatically adjusted, it can be adapted to screens of various shapes. On the other hand, when it is necessary to control the focus of the physical camera to move in front of the physical screen, the adjustment method for the focus position of the virtual camera can be determined according to the predicted relative position relationship between the focus of the physical camera and the physical screen, and it can be determined whether to adjust the focus position of the physical camera accordingly. In this way, the out-of-focus effect of the image captured by the virtual camera can be reduced, and it is ensured that when the physical camera focuses and shoots according to the adjustment data, the virtual camera has adjusted the second focus position to the virtual screen model, so that the picture displayed on the screen is clear, thereby reducing the negative impact caused by the problem of secondary out-of-focus. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The following is a description of the accompanying drawings required for describing the exemplary embodiments, wherein:

[0021] Figure 1 A schematic diagram showing an application scenario according to an embodiment of the present disclosure.

[0022] Figure 2 A flowchart of a method for adjusting a virtual camera according to an embodiment of the present disclosure is shown.

[0023] Figure 3 A schematic diagram showing a physical camera and a physical screen according to an embodiment of the present disclosure is shown.

[0024] Figure 4 A schematic diagram showing another physical camera and a physical screen according to an embodiment of the present disclosure is shown.

[0025] Figure 5 A schematic structural diagram of a device according to an embodiment of the present disclosure is shown.

[0026] Figure 6 A block diagram of a virtual camera adjustment device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0027] Here, exemplary embodiments will be described in detail, and examples thereof are shown in the accompanying drawings. When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of the present disclosure. On the contrary, they are only examples consistent with some aspects of one or more embodiments of the present disclosure.

[0028] It should be noted that in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in the present disclosure. In some other embodiments, the steps included in the method may be more or less than those described in the present disclosure. In addition, a single step described in the present disclosure may be decomposed into multiple steps for description in other embodiments; and multiple steps described in the present disclosure may also be combined into a single step for description in other embodiments.

[0029] When performing virtual shooting based on a physical screen, it is usually necessary to create a virtual camera in a computer and render the display image of the virtual scene on the physical screen based on the shooting-related data of the virtual camera, which can be regarded as an image obtained by simulating the shooting of the virtual scene by the virtual camera through the physical screen. The physical camera is used to shoot the physical screen, specifically the real scene (i.e. the scene in the real world) and the display image on the physical screen. In practical applications, it is usually hoped to increase the degree of reality of the virtual scene in the image captured by the physical camera as much as possible. This degree of reality includes both the matching degree of the spatial position and perspective relationship of the virtual and real objects, and the matching degree of the defocus effect. Therefore, it is necessary to ensure that the defocus effect of the virtual camera and the defocus effect of the physical camera are matched in real time.

[0030] Defocus is a photography term, which means that during the shooting process, the main part of the captured image is not presented clearly, but becomes blurred or distorted because the focus of the camera lens deviates from the subject being photographed. Defocus is usually caused by the focus of the camera lens not matching the actual position of the subject being photographed. However, defocus is not always negative, and in some special cases, defocus effects are deliberately created to achieve a certain artistic effect, for example: to create an abstract and dreamy atmosphere.

[0031] In the related art, it is usually required that the shooting-related data of the virtual camera and the physical camera are consistent. Among them, the shooting-related data may include internal parameters such as focal length, optical center offset, distortion parameters, pixel size, and external parameters such as position data, posture data (for example, rotation angle), and may also include adjustable shooting parameters such as focus and aperture. Although this can ensure the matching degree of the spatial position and perspective relationship of virtual and real objects, it will cause the virtual scene in the image captured by the physical camera to have a secondary defocus problem. Specifically, since the shooting-related data of the virtual camera and the physical camera are consistent, when the image captured by the physical camera has a defocus effect (for example, the physical camera is not correctly focused as required), the virtual camera follows the shooting parameters of the physical camera, resulting in the image captured by the virtual camera also having a defocus effect, so the display image of the virtual scene on the physical screen has a primary defocus effect. In this case, the physical camera that was originally not correctly focused shoots the display image on the physical screen, and the virtual scene part in the obtained image has a secondary defocus effect, resulting in the defocus effect of the real scene part in the image not matching the virtual scene part.

[0032] In order to avoid the problem of secondary defocus, the focus of the virtual camera can be manually set by the technician to a certain offset distance to reduce the defocus effect of the image captured by the virtual camera. However, this method of manually setting the offset distance is inefficient and inaccurate, and is difficult to apply to scenes where the physical camera moves over a large range. It is usually only suitable for flat screens, and for screens of other shapes such as curved screens and tri-fold screens, it is difficult to manually estimate the focus offset distance of the virtual camera because the shapes of these screens are not flat, so they are usually not suitable for these screens.

[0033] One or more embodiments of the present disclosure provide a technical solution for adjusting a virtual camera. In the technical solution, a virtual three-dimensional space corresponding to a physical three-dimensional space can be simulated on a computing device, and a virtual camera corresponding to a physical camera and a virtual screen model corresponding to a physical screen can be created in the virtual three-dimensional space, wherein the virtual camera can be used to simulate shooting of a preset virtual scene, and the simulated shot image is displayed through a physical screen, and the physical camera can be used to shoot the physical screen; when the data processing program on the computing device obtains adjustment data including focus data corresponding to the physical camera, it can determine the position of the first focus of the physical camera after focusing based on the focus data, and determine the relative position relationship between the first focus and the physical screen, and when it is determined that the first focus is located in front of the physical screen, the position of the second focus of the virtual camera is adjusted to the virtual screen model, and the adjustment data is sent to the physical camera so that the physical camera focuses based on the focus data.

[0034] By adopting this method, when realizing virtual shooting, on the one hand, the focus position of the created virtual camera corresponding to the physical camera can be automatically adjusted according to the focus position of the current physical camera, so as to reduce the out-of-focus effect of the image captured by the virtual camera, avoid the problem of secondary out-of-focus, and avoid manually setting the offset distance for the focus of the virtual camera. Therefore, the adjustment efficiency and accuracy are relatively high, which is suitable for scenes where the physical camera moves over a large range. Moreover, since the focus position of the virtual camera can be automatically adjusted, it can be adapted to screens of various shapes. On the other hand, when it is necessary to control the focus of the physical camera to move in front of the physical screen, the adjustment method for the focus position of the virtual camera can be determined according to the predicted relative position relationship between the focus of the physical camera and the physical screen, and it is determined whether to make corresponding adjustments to the focus position of the physical camera, so as to ensure that when the physical camera focuses and shoots according to the adjustment data, the virtual camera has adjusted the second focus position to the virtual screen model, so that the picture displayed on the screen is clear, thereby reducing the out-of-focus effect of the image captured by the virtual camera, thereby reducing the negative impact caused by the problem of secondary out-of-focus.

[0035] The technical solutions provided by one or more embodiments of the present disclosure are described in detail below.

[0036] Please refer to Figure 1 , Figure 1 A schematic diagram showing an application scenario according to an embodiment of the present disclosure.

[0037] like Figure 1As shown, the virtual shooting system includes three physical screens (021, 022, 023), and the mobile terminal 01 can establish communication connections with the three physical screens (021, 022, 023) respectively, and the mobile terminal 01 can also establish a communication connection with the computing device 03. The mobile terminal 01 can control each physical screen to display an identification graphic array and send multiple screen images obtained by image acquisition of each physical screen to the computing device 03, and the computing device 03 can generate and display virtual screen models corresponding to the three physical screens (021, 022, 023) according to the multiple screen images sent by the mobile terminal 01.

[0038] The physical screen used in the virtual shooting system may be an LED display screen, a liquid crystal (LCD) display screen, etc., and may be a curved screen or a flat screen. It should be understood that those skilled in the art can customize the type, quantity, size, resolution, etc. of the physical screen in the virtual shooting system according to actual needs, and the embodiments of the present disclosure are not limited to this. It should be understood that the embodiments of the present disclosure are not limited to the communication connection method between devices.

[0039] In addition, the virtual shooting system also includes a physical camera 04. Similarly, the computing device 03 can generate and display a virtual camera corresponding to the physical camera 04. The physical camera 04 can shoot the three physical screens (021, 022, 023) under the operation of the person responsible for shooting. The physical camera 04 can also establish a communication connection with the computing device 03.

[0040] It should be noted that a virtual three-dimensional space (e.g., a virtual three-dimensional space that restores the physical three-dimensional space in a 1:1 manner) corresponding to the physical three-dimensional space (i.e., the real three-dimensional space in the real world) can be simulated on the computing device 03. The three physical screens (021, 022, 023) and the physical camera 04 are real objects in the physical three-dimensional space, while the virtual screen model and the virtual camera are virtual objects created in the virtual three-dimensional space.

[0041] Please refer to Figure 2 , Figure 2 A flowchart of a method for adjusting a virtual camera according to an embodiment of the present disclosure is shown.

[0042] In this embodiment, the above-mentioned virtual camera adjustment method can be implemented in a virtual shooting system. The virtual shooting system may include a physical camera, a physical screen and a computing device in a physical three-dimensional space, and the computing device may simulate a virtual three-dimensional space corresponding to the physical three-dimensional space. The virtual shooting system may also include a virtual screen model corresponding to the physical screen and a virtual camera corresponding to the physical camera created in the virtual three-dimensional space.

[0043] It should be noted that the above-mentioned virtual screen model can be a three-dimensional model rendered in the above-mentioned virtual three-dimensional space that is consistent with the appearance, position, etc. of the above-mentioned physical screen in the above-mentioned physical three-dimensional space; the above-mentioned virtual camera can be a three-dimensional model rendered in the above-mentioned virtual three-dimensional space that is consistent with the appearance, position, etc. of the above-mentioned physical camera in the above-mentioned physical three-dimensional space.

[0044] Among them, the above-mentioned virtual camera can be used to simulate shooting of a pre-designed virtual scene, and the simulated image is first mapped to the virtual screen model, and then rendered to the physical screen for display. Since the virtual screen model has the same parameters as the physical screen, by mapping to the virtual screen model, the rendered image can be better adapted to the physical screen. Accordingly, the above-mentioned physical camera can be used to shoot the physical screen, and the image captured by the physical camera will contain the virtual scene part.

[0045] It should be noted that, under normal circumstances, the virtual camera and the physical camera have the same internal parameters such as focal length, optical center offset, distortion parameters, pixel size, etc. The virtual camera's external parameters such as position data and posture data in the virtual three-dimensional space are consistent with the physical camera's external parameters such as position data and posture data in the physical three-dimensional space. Similarly, the shape, size, position data, etc. of the virtual screen model in the virtual three-dimensional space are consistent with the shape, size, position data, etc. of the physical screen in the physical three-dimensional space.

[0046] In some embodiments, in order to finally realize virtual shooting, the data processing program running on the computing device can create the virtual camera corresponding to the physical camera in the virtual three-dimensional space. Specifically, the virtual camera corresponding to the physical camera can be initialized and created in the virtual three-dimensional space. At this time, the internal parameters of the initialized virtual camera should be consistent with the internal parameters of the physical camera, but the external parameters of the virtual camera can be random data, and the external parameters of the virtual camera can be adjusted to be consistent with the external parameters of the physical camera later.

[0047] When adjusting the external parameters of the virtual camera, the relative position relationship between the physical camera in the above-mentioned physical three-dimensional space and the above-mentioned physical screen can be determined first. Subsequently, the position of the virtual camera in the virtual three-dimensional space can be adjusted to a position corresponding to the virtual screen model (which can be called a target position), wherein the relative position relationship between the target position and the virtual screen model is consistent with the relative position relationship between the physical camera and the physical screen. In practical applications, the relative position relationship between the physical camera and the physical screen may include not only the position of the center point of the physical camera relative to the physical screen, but also the rotation angle of the lens of the physical camera relative to the physical screen. In this way, the external parameters of the virtual camera can be kept consistent with the external parameters of the physical camera.

[0048] The above virtual camera adjustment method can be applied to a data processing program running on the above computing device, and can specifically include the following steps:

[0049] Step 201: Acquire adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data.

[0050] In this embodiment, the data processing program running on the computing device can obtain adjustment data corresponding to the physical camera, wherein the adjustment data can specifically include focus data.

[0051] Focus data can be used to cause the physical camera to focus. Focusing refers to the process of adjusting the camera lens to adjust the camera focus to a suitable position so that the subject being photographed is clearly visible in the captured image. When the camera focuses on the subject being photographed, the subject part in the captured image will appear clear and sharp, and the details will be clearly discernible.

[0052] The adjustment data in step 201 may be obtained through a wireless follow focus device, and a specific example is described below.

[0053] In some embodiments, the adjustment data may further include aperture data.

[0054] Aperture data can be used to cause physical cameras to adjust their aperture. The aperture is the part of the camera lens that controls the size of the hole that allows light to pass through. It consists of a series of adjustable blades that control the amount of light entering the camera by adjusting the degree of opening and closing of these blades. Adjusting the size of the aperture affects the depth and exposure of the image. A larger aperture can produce a shallow depth of field effect, making the subject in focus and the background blurred. A smaller aperture can produce a larger depth of field, making both the subject and the background in focus.

[0055] Step 202: Determine the position of a first focus of the physical camera after focusing based on the focus data, and determine the relative position relationship between the first focus and the physical screen.

[0056] In this embodiment, after the adjustment data is obtained, the physical camera may not adjust the shooting-related data based on the adjustment data, for example, focusing based on the focus data contained in the adjustment data. Instead, the data processing program running on the computing device may first determine the position of the focus (which may be referred to as the first focus) of the physical camera after focusing based on the focus data in the physical three-dimensional space, and after determining the position of the first focus in the physical three-dimensional space, further determine the relative position relationship between the first focus in the physical three-dimensional space and the physical screen, so as to adjust the position of the focus of the virtual camera according to the relative position relationship.

[0057] In some embodiments, the physical camera may be equipped with a tracking system.

[0058] Among them, the above-mentioned tracking system can be implemented based on a combination of software and hardware. For example, the tracking system may include a distance sensor, a steering angle sensor and a computing chip. The distance sensor and the steering angle sensor first collect the motion data of the above-mentioned physical camera, and then the computing chip performs calculations based on the collected motion data to obtain the external parameters of the physical camera, and then sends the external parameters of the physical camera to the data processing program running on the above-mentioned computing device. Of course, the computing chip can also summarize the collected motion data and send it directly to the data processing program, and the data processing program performs calculations based on the motion data to obtain the external parameters of the physical camera.

[0059] When predicting the position of the first focus of the physical camera after it focuses based on the focus data, since the physical camera is equipped with the tracking system, the external parameters of the physical camera can be obtained through the tracking system first, so that the initial position of the focus of the physical camera in the physical three-dimensional space can be calculated according to the external and internal parameters of the physical camera, and based on the focus data, the position of the first focus of the physical camera in the physical three-dimensional space after it focuses based on the focus data can be calculated.

[0060] Accordingly, when determining the relative position relationship between the above-mentioned first focus of the above-mentioned physical camera and the above-mentioned physical screen, the position data of the physical screen in the physical three-dimensional space can be obtained. For example, the position data sent by the positioning system carried on the physical screen can be obtained as the position data of the physical screen in the physical three-dimensional space, and based on the calculated position of the above-mentioned first focus in the above-mentioned physical three-dimensional space and the acquired position of the above-mentioned physical screen in the physical three-dimensional space, the relative position relationship between the first focus and the physical screen is determined.

[0061] Please refer to Figure 3 , Figure 3 A schematic diagram showing a physical camera and a physical screen according to an embodiment of the present disclosure is shown.

[0062] In practical applications, the display surface of the screen can be regarded as the front surface of the screen, and the non-display surface of the screen can be regarded as the back surface of the screen. Figure 3 As shown, if the focus of the physical camera is located in front of the front of the physical screen, it can be considered that the focus of the physical camera is located in front of the physical screen; if the focus of the physical camera is located on the front of the screen, it can be considered that the focus of the physical camera is located on the physical screen; if the focus of the physical camera is located behind the back of the physical screen, it can be considered that the focus of the physical camera is located behind the physical screen.

[0063] In some embodiments, when determining the relative positional relationship between the first focus of the physical camera and the physical screen, the distance (referred to as the first distance) between the first focus in the physical three-dimensional space and the physical camera (referred to as the lens of the physical camera) can be obtained first, and the distance (referred to as the second distance) between the virtual camera (referred to as the lens of the virtual camera) and the virtual screen model in the virtual three-dimensional space can be calculated. The positions of the virtual camera and the virtual screen model in the virtual three-dimensional space correspond to the positions of the physical camera and the physical screen in the physical three-dimensional space, so the distance between the virtual camera and the virtual screen model can be regarded as the distance between the physical camera and the physical screen. In this way, the relative positional relationship between the first focus and the physical screen in the physical three-dimensional space can be determined by comparing the size relationship between the first distance and the second distance.

[0064] Subsequently, it can be compared whether the above-mentioned first distance is smaller than the above-mentioned second distance. If the first distance is smaller than the second distance, it can be determined that the above-mentioned first focus is located in front of the above-mentioned physical screen; if the first distance is equal to the second distance, it can be determined that the above-mentioned first focus is located on the above-mentioned physical screen; if the first distance is greater than the second distance, it can be determined that the above-mentioned first focus is located behind the above-mentioned physical screen.

[0065] Please continue to refer to Figure 3 If the first focus is located in front of the front side of the physical screen, it means that the first distance is smaller than the second distance, and the first focus can be considered to be located in front of the physical screen; if the first focus is located on the front side of the physical screen, it means that the first distance is equal to the second distance, and the first focus can be considered to be located on the physical screen; if the first focus is located behind the back side of the physical screen, it means that the first distance is greater than the second distance, and the first focus can be considered to be located behind the physical screen.

[0066] In some embodiments, when calculating the second distance between the virtual camera and the virtual screen model, a viewing cone model corresponding to the virtual camera may be established first.

[0067] The frustum model is a model used in computer graphics to represent three-dimensional scenes. It is implemented by dividing the scene space into two parts: the viewing volume and the clipping volume.

[0068] The viewing volume is the geometric shape that extends from the camera or observer's viewpoint to the visible part of the scene. It is usually a tetrahedron or hexahedron with a near clipping plane and a far clipping plane, as well as vertices determined by the viewpoint position and viewing direction. The viewing volume defines a virtual two-dimensional projection plane, and the final two-dimensional image is generated by mapping objects in space onto this plane.

[0069] The clipping volume is the area between the viewing volume and the screen or viewport. It is defined by applying clipping operations, clipping objects inside the viewing volume to the parts that are ultimately visible on the screen. Clipping operations can include culling objects that are outside the viewing volume, culling occluded objects, and performing perspective transformations.

[0070] Therefore, the viewing angle range of the virtual camera can be determined through the viewing cone model corresponding to the above virtual camera, that is, the part of the scene that the virtual camera can capture can be determined.

[0071] The virtual screen model may be a three-dimensional model rendered in the virtual three-dimensional space, and the three-dimensional model is usually composed of elements such as vertices, faces, edges, and includes attributes such as normal vectors and vertex colors.

[0072] Among them, vertices are the basic building blocks of 3D models, and they define the position information in 3D models. Usually, each vertex has 3D coordinates, that is, its position in 3D space. Faces are polygons composed of adjacent vertices, usually triangles or quadrilaterals. Faces define the surface geometry of the model. By connecting vertices, planar geometric bodies such as cubes, spheres, etc. can be formed. Each face consists of the indices of the specified vertices, which define the vertices contained in the face. Edges are the connecting lines between two adjacent vertices. Boundary lines are the boundary parts in the model, and they define the edge shape of the model.

[0073] In practical applications, if the physical screen is an LED screen, the vertices of the virtual screen model may be the four vertices of the LED box (usually a cube) constituting the LED screen on the front side of the screen.

[0074] In this case, it can be determined whether each vertex of the virtual screen model is located within the viewing angle corresponding to the frustum model. If there is at least one vertex located within the viewing angle corresponding to the frustum model, the distance between the at least one vertex and the virtual camera (specifically, the lens of the virtual camera) can be determined respectively, and the average distance can be calculated, so that the average distance can be used as the second distance between the virtual camera and the virtual screen model.

[0075] In some embodiments, the relative position relationship between the first focus of the physical camera and the physical screen may not be determined directly, but the relative position relationship between the foreground depth point of the physical camera and the physical screen may be determined. It should be noted that the distance between the position of the foreground depth point of the physical camera and the position of the focus of the physical camera in the present disclosure is the foreground depth of the physical camera.

[0076] Depth of field refers to the range that is considered clear in a photo, that is, the focus range of the object in the image in the front and back directions. In practical applications, the focus range in front of the object in the image is the front depth of field, that is, the front depth of field refers to the range in which the object can remain clear in an image captured by the camera, starting from the focus of the camera lens and extending forward. The focus range behind the object in the image is the back depth of field, that is, the back depth of field refers to the range in which the object can remain clear in an image captured by the camera, starting from the focus of the camera lens and extending backward.

[0077] Depth of field is often used to control the clarity and spatial sense of an image. Depth of field is affected by many factors, the most important of which are aperture, focal length and shooting distance. A larger aperture, a longer focal length and a closer shooting distance usually produce a shallow depth of field effect, that is, only a small part of the photographed object is in sharp range, and other areas are blurred. On the other hand, a smaller aperture, a shorter focal length and a longer shooting distance will produce a larger depth of field, so that the photographed object and the surrounding area can remain sharp.

[0078] That is, when determining the relative position relationship between the above-mentioned first focus of the above-mentioned physical camera and the above-mentioned physical screen, we can first determine the foreground depth of field after the physical camera focuses based on the above-mentioned focus data and adjusts the aperture based on the above-mentioned aperture data, and determine the position of the above-mentioned foreground depth of field point based on the position of the first focus and the foreground depth of field.

[0079] Subsequently, the relative position relationship between the foreground depth point and the physical screen may be determined to serve as the relative position relationship between the first focus and the physical screen.

[0080] Please refer to Figure 4 , Figure 4 A schematic diagram showing another physical camera and a physical screen according to an embodiment of the present disclosure is shown.

[0081] like Figure 4 As shown, the foreground depth point of the physical camera is located before the focus of the physical camera, and the distance between the position of the foreground depth point and the position of the focus is the foreground depth of the physical camera; the back depth point of the physical camera is located after the focus of the physical camera, and the distance between the position of the back depth point and the position of the focus is the back depth of the physical camera.

[0082] In this case, if the foreground depth point of the physical camera is located in front of the front of the physical screen, the focus of the physical camera can be considered to be in front of the physical screen; if the foreground depth point of the physical camera is located on the front of the screen, the focus of the physical camera can be considered to be on the physical screen; if the foreground depth point of the physical camera is located behind the back of the physical screen, the focus of the physical camera can be considered to be behind the physical screen.

[0083] In this case, since the distance between the foreground depth point and the physical screen is greater than the distance between the actual first focus and the physical screen, it is equivalent to extending the adjustment range of the physical camera focal length. That is to say, when the foreground depth point is located in front of the physical screen, the focus may be located at a distance behind the screen. This distance is less than or equal to the length of the foreground depth of field, and such focusing effect is usually acceptable, which is equivalent to appropriately extending the adjustment range of the physical camera focal length behind the screen.

[0084] Step 203: If the first focus is located in front of the physical screen, adjust the position of the second focus of the virtual camera to the virtual screen model, and send the adjustment data to the physical camera so that the physical camera focuses based on the focus data.

[0085] In this embodiment, if it is determined that the first focus of the physical camera is located in front of the physical screen, the data processing program running on the computing device can adjust the position of the focus of the virtual camera (which can be called the second focus) in the virtual three-dimensional space, so that the position of the second focus in the virtual three-dimensional space falls on the virtual screen model. Similar to the relative positional relationship between the first focus and the physical screen in the physical three-dimensional space, if the second focus is located on the front of the virtual screen model in the virtual three-dimensional space, it can be considered that the second focus is located on the virtual screen model.

[0086] In addition, if it is determined that the above-mentioned first focus of the above-mentioned physical camera is located in front of the above-mentioned physical screen, the above-mentioned adjustment data can also be sent to the physical camera, so that the physical camera can adjust the data related to shooting based on the adjustment data, for example: focusing based on the focus data contained in the adjustment data, and adjusting the aperture based on the aperture data contained in the adjustment data.

[0087] By adjusting the position of the second focus of the virtual camera, the out-of-focus effect of the image captured by the virtual camera can be alleviated to a certain extent, thereby reducing the negative impact caused by the secondary out-of-focus problem. Therefore, the aperture of the virtual camera can be directly adjusted to be consistent with the aperture of the physical camera. After setting the focus and aperture and other shooting-related data for the virtual camera, the virtual camera can perform simulated shooting operations.

[0088] Usually, out-of-focus occurs not only when the camera lens is not focused accurately, but also when insufficient light enters the camera. Therefore, the aperture will also affect the out-of-focus effect of the camera's shooting.

[0089] In order to avoid the problem of the physical camera being captured due to secondary defocus, the data processing program running on the computing device can calculate an available value of the aperture of the virtual camera. When the aperture of the virtual camera adopts this value, for the image displayed on the physical screen by the virtual camera simulating the virtual scene, the physical camera will shoot the real scene and the display image on the physical screen again, and the defocus effect of the real scene part and the virtual scene part in the obtained image will change continuously, so that the real scene part and the virtual scene part in the image captured by the physical camera have a correct hierarchical relationship. In practical applications, the continuous change of the defocus effect means that in an image captured by the camera, starting from the focus of the camera lens, the scene at a position farther from the focus is more blurred, and the scene at a position closer to the focus is clearer.

[0090] In some embodiments, when adjusting the position of the second focus of the virtual camera to the virtual screen model, the position of the second focus in the virtual three-dimensional space can be adjusted to the virtual screen model based on the model data of the virtual screen model and the spatial data of the virtual three-dimensional space. For example, the spatial data of the virtual three-dimensional space can include a three-dimensional coordinate system corresponding to the virtual three-dimensional space, and the model data of the virtual screen model can include the three-dimensional coordinates of each vertex of the virtual screen model in the three-dimensional coordinate system. Based on this, the position of the second focus in the virtual three-dimensional space can be adjusted by adjusting the three-dimensional coordinates used to represent the position of the second focus, thereby achieving the adjustment of the position of the second focus in the virtual three-dimensional space to the virtual screen model.

[0091] According to the model setting method of the virtual camera, the position of the second focus can be directly changed as a variable parameter of the virtual camera, or can be changed by changing other parameters of the virtual camera (such as lens position), etc., and the present disclosure does not limit this.

[0092] In some embodiments, if it is determined that the first focus of the physical camera is not located in front of the physical screen, it means that the focus of the lens of the physical camera deviates from the physical screen and the actor performing in front of the physical screen. At this time, there is no clear part in the image captured by the physical camera, but all are blurred or distorted. During shooting, this situation is usually considered abnormal.

[0093] In this case, the data processing program running on the computing device can adjust the position of the second focus of the virtual camera in the virtual three-dimensional space to a position corresponding to the virtual screen model (referred to as the target position) in the virtual three-dimensional space, wherein the relative position relationship between the target position and the virtual screen model is consistent with the relative position relationship between the first focus of the physical camera and the physical screen.

[0094] It should be noted that if it is determined that the first focus of the physical camera is not located in front of the physical screen, there is no need to send the adjustment data to the physical camera, that is, the physical camera may no longer adjust the shooting-related data based on the adjustment data.

[0095] In some embodiments, if it is determined that the first focus of the physical camera is not located in front of the physical screen, the data processing program running on the computing device may output a prompt to the user that the focus of the physical camera is out of range.

[0096] In some embodiments, the user may use a wireless follow focus device to adjust the shooting-related data of the physical camera.

[0097] A wireless focus device is a device used to remotely control the focus of a lens. It communicates with the camera through wireless signal transmission. A wireless focus device usually consists of two parts, a transmitter (handheld device) and a receiver (mounted on the camera). The user sends a focus command through the handheld transmitter. The transmitter converts the focus command into a wireless signal and sends the signal to the receiver through wireless communication methods (such as radio waves or infrared rays). After receiving the wireless signal, the receiver converts it into a recognizable command and passes it to the camera. According to the received command, the camera adjusts the distance between the lens and the image sensor by controlling the focus mechanism inside the lens (for example: electric motor) to achieve the focusing effect, and the aperture can be adjusted by adjusting the opening and closing degree of the adjustable blades.

[0098] That is, the transmitter of the wireless follow focus device corresponding to the physical camera can establish a wireless connection with the computing device (which may be referred to as a first wireless connection); the receiver of the wireless follow focus device mounted on the physical camera may also establish a wireless connection with the computing device (which may be referred to as a second wireless connection).

[0099] When the adjustment data corresponding to the physical camera is obtained, the adjustment data corresponding to the physical camera sent by the transmitter through the first wireless connection may be obtained.

[0100] When the above-mentioned adjustment data is sent to the above-mentioned physical camera so that the physical camera adjusts the data related to shooting based on the adjustment data, the adjustment data can be sent to the above-mentioned receiver through the above-mentioned second wireless connection so that the receiver controls the physical camera to adjust the data related to shooting based on the adjustment data.

[0101] In an exemplary application scenario, a wireless focus follower can be used to first determine the current focus data and aperture data of the physical camera (i.e., the adjustment data in step 201), and the adjustment data is sent to the computing device, and the physical camera is not adjusted for the time being. The computing device determines the relative position relationship between the first focus and the physical screen in step 202 based on the adjustment data. If the first focus is located in front of the physical screen, step 203 is executed to adjust the position of the second focus of the virtual camera to the virtual screen model to avoid the virtual camera shooting out of focus, and then the adjustment data in step 201 is sent to the physical camera to adjust the physical camera. If the first focus is not located in front of the physical screen, only the position of the second focus of the virtual camera is adjusted to the target position, so that the virtual camera is consistent with the physical camera, and the physical camera is no longer adjusted according to the adjustment data, and a prompt that the focus of the physical camera is out of range is output to the user.

[0102] In the above technical solution, a virtual three-dimensional space corresponding to the physical three-dimensional space can be simulated on the computing device, and a virtual camera corresponding to the physical camera and a virtual screen model corresponding to the physical screen can be created in the virtual three-dimensional space, wherein the virtual camera can be used to simulate shooting of a preset virtual scene, and the simulated shot image can be displayed through the physical screen, and the physical camera can be used to shoot the physical screen; the data processing program on the computing device can determine the position of the first focus of the physical camera after focusing based on the focus data when obtaining adjustment data containing focus data corresponding to the physical camera, and determine the relative position relationship between the first focus and the physical screen; when it is determined that the first focus is located in front of the physical screen, the position of the second focus of the virtual camera is adjusted to the virtual screen model, and the adjustment data is sent to the physical camera so that the physical camera focuses based on the focus data.

[0103] By adopting this method, when realizing virtual shooting, on the one hand, the focus position of the created virtual camera corresponding to the physical camera can be automatically adjusted according to the focus position of the current physical camera, so as to reduce the out-of-focus effect of the image captured by the virtual camera, avoid the problem of secondary out-of-focus, and avoid manually setting the offset distance for the focus of the virtual camera. Therefore, the adjustment efficiency and accuracy are relatively high, which is suitable for scenes where the physical camera moves over a large range. Moreover, since the focus position of the virtual camera can be automatically adjusted, it can be adapted to screens of various shapes. On the other hand, when it is necessary to control the focus of the physical camera to move in front of the physical screen, the adjustment method for the focus position of the virtual camera can be determined according to the predicted relative position relationship between the focus of the physical camera and the physical screen, and it is determined whether to make corresponding adjustments to the focus position of the physical camera, so as to ensure that when the physical camera focuses and shoots according to the adjustment data, the virtual camera has adjusted the second focus position to the virtual screen model, so that the picture displayed on the screen is clear, thereby reducing the out-of-focus effect of the image captured by the virtual camera, thereby reducing the negative impact caused by the problem of secondary out-of-focus.

[0104] Corresponding to the aforementioned embodiment of the method for adjusting a virtual camera, the present disclosure also provides an embodiment of an apparatus for adjusting a virtual camera.

[0105] Please refer to Figure 5 , Figure 5 It is a structural diagram of a device shown in an exemplary embodiment of the present disclosure. At the hardware level, the device includes a processor 501, an internal bus 502, a network interface 503, a memory 504 and a non-volatile memory 505, and of course may also include other required hardware. One or more embodiments of the present disclosure can be implemented based on software, such as the processor 501 reading the corresponding computer program from the non-volatile memory 505 into the memory 504 and then running it. Of course, in addition to the software implementation, one or more embodiments of the present disclosure do not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the execution subject of the following processing flow is not limited to each logic module, but can also be hardware or logic devices.

[0106] Please refer to Figure 6 , Figure 6 It is a block diagram of a virtual camera adjustment device shown in an exemplary embodiment of the present disclosure.

[0107] The above virtual camera adjustment device can be applied to Figure 5The device shown is used to implement the technical solution of the present disclosure. The virtual camera adjustment device can be applied to a data processing program running on a computing device; the computing device simulates a virtual three-dimensional space corresponding to the physical three-dimensional space; a virtual camera corresponding to the physical camera is created in the virtual three-dimensional space; the virtual camera is used to simulate shooting of a preset virtual scene, and the simulated shot image is displayed through a physical screen; the physical camera is used to shoot the physical screen; a virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the device includes:

[0108] The acquisition module 601 is used to acquire adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data;

[0109] A determination module 602 is used to determine the position of a first focus of the physical camera after focusing based on the focus data, and determine a relative position relationship between the first focus and the physical screen;

[0110] The adjustment module 603 is used to adjust the position of the second focus of the virtual camera to the virtual screen model when the first focus is located in front of the physical screen, and send the adjustment data to the physical camera so that the physical camera focuses based on the focus data.

[0111] Optionally, the adjustment module 603 is further used to:

[0112] If the first focus is not in front of the physical screen, the position of the second focus is adjusted to the target position corresponding to the virtual screen model; wherein the relative position relationship between the target position and the virtual screen model is consistent with the relative position relationship between the first focus and the physical screen.

[0113] Optionally, the adjustment data also includes aperture data;

[0114] The step of sending the adjustment data to the physical camera so that the physical camera performs focusing based on the focusing data includes:

[0115] The adjustment data is sent to the physical camera, so that the physical camera performs focusing based on the focus data and performs aperture adjustment based on the aperture data.

[0116] Optionally, determining a relative position relationship between the first focus and the physical screen includes:

[0117] Determine the foreground depth of field after the physical camera focuses based on the focus data and adjusts the aperture based on the aperture data, and determine the position of the foreground depth of field point based on the position of the first focus and the foreground depth of field; wherein the distance between the position of the foreground depth of field point and the position of the first focus is the foreground depth of field;

[0118] The relative position relationship between the foreground depth point and the physical screen is determined as the relative position relationship between the first focus and the physical screen.

[0119] Optionally, the physical camera is equipped with a tracking system;

[0120] The determining a position of a first focus of the physical camera after focusing based on the focus data includes:

[0121] Acquire the external parameters of the physical camera sent by the tracking system;

[0122] Based on the external parameters of the physical camera and the focus data, a position of a first focus of the physical camera after focusing based on the focus data is determined.

[0123] Optionally, adjusting the position of the second focus of the virtual camera to the virtual screen model includes:

[0124] Based on the model data of the virtual screen model and the space data of the virtual three-dimensional space, the position of the second focus of the virtual camera is adjusted to the virtual screen model.

[0125] Optionally, the device further comprises:

[0126] An output module is used to output a prompt to the user that the focus of the physical camera is out of range when the first focus is not located in front of the physical screen.

[0127] Optionally, a transmitter of a wireless follow focus device corresponding to the physical camera establishes a first wireless connection with the computing device; a receiver of the wireless follow focus device is mounted on the physical camera; and a second wireless connection is established between the receiver and the computing device;

[0128] The obtaining of adjustment data corresponding to the physical camera includes:

[0129] Acquire adjustment data corresponding to the physical camera sent by the transmitter through the first wireless connection;

[0130] The step of sending the adjustment data to the physical camera so that the physical camera performs focusing based on the focusing data includes:

[0131] The adjustment data is sent to the receiver via the second wireless connection, so that the receiver controls the physical camera to focus based on the focus data.

[0132] Optionally, the external parameters include position data and posture data.

[0133] For the device embodiment, it basically corresponds to the method embodiment, so the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the technical solution of the present disclosure.

[0134] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0135] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0136] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0137] Computer-readable media include permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0138] It should be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of further restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0139] The above describes a specific embodiment of the present disclosure. Other embodiments are within the scope of the present disclosure. In some cases, the actions or steps recorded in the present disclosure can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0140] The terms used in one or more embodiments of the present disclosure are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of the present disclosure. The singular forms of "a", "said" and "the" are also intended to include plural forms unless the context clearly indicates other meanings. The term "and / or" refers to and includes any or all possible combinations of one or more associated listed items.

[0141] The description of the terms "one embodiment", "some embodiments", "example", "specific example" or "one implementation method" etc. used in one or more embodiments of the present disclosure means that the specific features or characteristics described in conjunction with the embodiment are included in at least one embodiment of the present disclosure. The schematic descriptions of these terms are not necessarily for the same embodiment. Moreover, the specific features or characteristics described can be combined in a suitable manner in one or more embodiments of the present disclosure. In addition, different embodiments and specific features or characteristics in different embodiments can be combined without contradiction.

[0142] It should be understood that although the terms first, second, third, etc. may be used to describe various information in one or more embodiments of the present disclosure, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determination".

[0143] The above description is only a preferred embodiment of one or more embodiments of the present disclosure and is not intended to limit one or more embodiments of the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present disclosure shall be included in the scope of protection of one or more embodiments of the present disclosure.

[0144] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

Claims

1. A method for adjusting a virtual camera, applied to a data processing program running on a computing device; the computing device simulates a virtual three-dimensional space corresponding to a physical three-dimensional space; A virtual camera corresponding to the physical camera is created in the virtual three-dimensional space; the virtual camera is used to simulate shooting of a preset virtual scene, and display the simulated shot image through a physical screen; the physical camera is used to shoot the physical screen; A virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the method comprises: Acquire adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data, and the adjustment data is not used for adjusting the physical camera for the time being; Determine a position of a first focus of the physical camera after focusing based on the focus data, and determine a relative position relationship between the first focus and the physical screen; If the first focus is located in front of the physical screen, the position of the second focus of the virtual camera is adjusted to the virtual screen model, and then the adjustment data is sent to the physical camera so that the physical camera focuses based on the focus data.

2. The method according to claim 1, further comprising: If the first focus is not in front of the physical screen, the position of the second focus is adjusted to the target position corresponding to the virtual screen model; wherein the relative position relationship between the target position and the virtual screen model is consistent with the relative position relationship between the first focus and the physical screen.

3. The method according to claim 1, wherein the adjustment data further comprises aperture data; The step of sending the adjustment data to the physical camera so that the physical camera performs focusing based on the focusing data includes: The adjustment data is sent to the physical camera, so that the physical camera performs focusing based on the focus data and performs aperture adjustment based on the aperture data.

4. The method according to claim 3, wherein determining the relative position relationship between the first focus and the physical screen comprises: Determine the foreground depth of field after the physical camera focuses based on the focus data and adjusts the aperture based on the aperture data, and determine the position of the foreground depth of field point based on the position of the first focus and the foreground depth of field; wherein the distance between the position of the foreground depth of field point and the position of the first focus is the foreground depth of field; The relative position relationship between the foreground depth point and the physical screen is determined as the relative position relationship between the first focus and the physical screen.

5. The method according to claim 1, wherein the physical camera is equipped with a tracking system; The determining a position of a first focus of the physical camera after focusing based on the focus data includes: Acquire the external parameters of the physical camera sent by the tracking system; Based on the external parameters of the physical camera and the focus data, a position of a first focus of the physical camera after focusing based on the focus data is determined.

6. The method according to claim 1, wherein adjusting the position of the second focus of the virtual camera to the virtual screen model comprises: Based on the model data of the virtual screen model and the space data of the virtual three-dimensional space, the position of the second focus of the virtual camera is adjusted to the virtual screen model.

7. The method according to claim 1, further comprising: If the first focus is not located in front of the physical screen, a prompt is output to the user indicating that the focus of the physical camera is out of range.

8. According to the method of claim 1, a transmitter of the wireless follow focus device corresponding to the physical camera establishes a first wireless connection with the computing device; and a receiver of the wireless follow focus device is mounted on the physical camera; The receiver establishes a second wireless connection with the computing device; The obtaining of adjustment data corresponding to the physical camera includes: Acquire adjustment data corresponding to the physical camera sent by the transmitter through the first wireless connection; The step of sending the adjustment data to the physical camera so that the physical camera performs focusing based on the focusing data includes: The adjustment data is sent to the receiver via the second wireless connection, so that the receiver controls the physical camera to focus based on the focus data.

9. A virtual camera adjustment device, applied to a data processing program running on a computing device; the computing device simulates a virtual three-dimensional space corresponding to a physical three-dimensional space; A virtual camera corresponding to the physical camera is created in the virtual three-dimensional space; the virtual camera is used to simulate shooting of a preset virtual scene, and display the simulated shot image through a physical screen; the physical camera is used to shoot the physical screen; A virtual screen model corresponding to the physical screen is also created in the virtual three-dimensional space; the device comprises: An acquisition module, used for acquiring adjustment data corresponding to the physical camera; wherein the adjustment data includes focus data, and the adjustment data is not used for adjusting the physical camera temporarily; a determination module, configured to determine a position of a first focus of the physical camera after focusing based on the focus data, and determine a relative position relationship between the first focus and the physical screen; An adjustment module is used to adjust the position of the second focus of the virtual camera to the virtual screen model when the first focus is located in front of the physical screen, and then send the adjustment data to the physical camera so that the physical camera focuses based on the focus data.

10. An electronic device, comprising: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 8 by running the executable instructions.

11. A computer-readable storage medium having computer instructions stored thereon, wherein the instructions are executed by a processor to implement the method according to any one of claims 1 to 8.

Images