Focus following data prediction method, focus following equipment, shooting device, electronic equipment and storage medium

Abstract

The invention relates to a focus following data prediction method, focus following equipment, a shooting device, electronic equipment and a storage medium. The focus following data prediction method provided by the invention can flexibly adapt to various shooting frame rates, and can obtain the focus following data prediction value with very small computing power and time cost overhead, and the focus following data prediction value can replace the focus following data with abnormal fluctuation to be output; the focus following device is ensured to convert the received data into smooth output data, so that the LED or virtual shooting and recording data can be better matched, the problem of non-uniformity between frames of the LED or virtual shooting and recording data is solved, the real-time rendering effect is remarkably improved, more excellent visual experience is brought to shooting, and the user experience is improved. In addition, the workload of later manual frame-by-frame processing is reduced.

Description

Technical Field

[0001] The present invention relates to the field of virtual shooting, and in particular to a focus data prediction method, a focus device, a shooting apparatus, an electronic device and a storage medium. Background Art

[0002] In the cutting-edge technology application of LED virtual shooting, although traditional wireless and mechanical follow-focus devices can meet the shooting needs to a certain extent, their operation is a bit cumbersome. During the shooting process, the staff needs to pay attention to the real-time status of the camera in the physical world to ensure that each frame is accurate and correct, and at the same time, they need to accurately coordinate with the scene in the LED virtual world to achieve a perfect fusion of virtual and reality.

[0003] This dual focus working mode undoubtedly increases the difficulty and complexity of shooting, and puts higher requirements on the performance of the follow focus. Since the output frequency of traditional follow focus is limited and synchronization adjustment is difficult, the output data of the follow focus fluctuates to a certain extent, making it difficult for the follow focus data to synchronize with the LED or virtual shooting recording data, which is specifically manifested as recording data jumping. This asynchrony problem not only affects the shooting quality, but also increases the workload of manual adjustment in post-production, reducing production efficiency. Summary of the invention

[0004] Based on this, it is necessary to provide a focus data prediction method, a focus device, a shooting apparatus, an electronic device and a storage medium to address the problem that the focus device data is difficult to synchronize with the LED or virtual shooting and recording data.

[0005] A method for predicting focus data, comprising:

[0006] Obtain the sensor's historical detection array x'=[x'(1), x'(2), ..., x'(n)], where n is the total time series number corresponding to the historical detection array;

[0007] Constructing the amplification function Wherein k is a positive integer not greater than n;

[0008] Build

[0009] Based on u=(X T X) -1 X T Y, solve to obtain a and b;

[0010] Constructing a focus data prediction function x'(p+1)+ax"(p)=b, where p is a positive integer greater than n;

[0011] A predicted value of the focus data is obtained based at least on the focus data prediction function and a current detection value of the sensor.

[0012] In some embodiments, m≥3.

[0013] In some embodiments, m=4.

[0014] In some embodiments, when x' is an aperture history detection array, the focus data prediction function is a first prediction function;

[0015] When x' is the focal length history detection array, the focus data prediction function is the second prediction function;

[0016] When x' is the focus history detection array, the focus data prediction function is the third prediction function;

[0017] Constructing a first prediction function, a second prediction function and a third prediction function respectively;

[0018] There are three current detection values ​​of the sensor, namely, current aperture detection value, current focal length detection value and current focus detection value;

[0019] Based on the first prediction function and the current aperture detection value, obtaining an aperture data prediction value;

[0020] Based on the second prediction function and the current focal length detection value, obtaining a focal length data prediction value;

[0021] Based on the third prediction function and the current focus detection value, a focus data prediction value is obtained.

[0022] In some embodiments, the aperture history detection array, the focal length history detection array, and the focus history detection array are all normalized arrays.

[0023] A follow focus device, comprising:

[0024] A detection recording module is used to record the historical detection array x'=[x'(1), x'(2), ..., x'(n)] of the sensor and obtain the current detection value of the sensor;

[0025] Prediction module, used to build the amplification function and Wherein k is a positive integer not greater than n, and the prediction module is also used to construct u=(X T X) -1 X T Y, to solve for a and b, and then construct a focus data prediction function x'(p+1)+ax"(p)=b, where p is a positive integer greater than n. The prediction module is further used to obtain a predicted value of the focus data through the focus data prediction function and the current detection value of the sensor.

[0026] The output module is used to output the predicted value of the focus data.

[0027] In some embodiments, when x' is an aperture history detection array, the focus data prediction function is a first prediction function;

[0028] When x' is the focal length history detection array, the focus data prediction function is the second prediction function;

[0029] When x' is the focus history detection array, the focus data prediction function is the third prediction function;

[0030] The prediction module is used to construct a first prediction function, a second prediction function and a third prediction function respectively;

[0031] There are three current detection values ​​of the sensor, namely the current aperture detection value, the current focal length detection value and the current focus detection value;

[0032] The prediction module is used to obtain an aperture data prediction value through the first prediction function and the current aperture detection value;

[0033] The prediction module is used to obtain a focal length data prediction value through the second prediction function and the current focal length detection value;

[0034] The prediction module is used to obtain a focus data prediction value through the third prediction function and the current focus detection value.

[0035] A shooting device comprises the above-mentioned follow-focus device and an imaging module, wherein the output module is used to output the predicted value of the follow-focus data to the imaging module, and the imaging module is used to perform imaging according to the predicted value of the follow-focus data.

[0036] An electronic device comprises a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the method are executed.

[0037] A storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the method are executed.

[0038] The beneficial effects of the present invention are:

[0039] The focus data prediction method provided by the present invention can flexibly adapt to various shooting frame rates, and can obtain the focus data prediction value with very small computing power and time cost. The focus data prediction value can replace the abnormally fluctuating focus data for output, ensuring that the focus device converts the received data into smooth output data, so as to better match the LED or virtual shooting and recording data, solve the problem of unevenness between frames of LED or virtual shooting and recording data, significantly improve the effect of real-time rendering, bring a more outstanding visual experience to shooting, and also reduce the workload of manual frame-by-frame processing in the later stage. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 This is a flowchart of the steps of the focus data prediction method in Embodiment 1 of the present invention. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0042] Embodiment 1:

[0043] See also Figure 1 This embodiment provides a focus data prediction method, comprising the following steps:

[0044] Step 101: Obtain the sensor's historical detection array x'=[x'(1), x'(2), ..., x'(n)], where n is the total time sequence number corresponding to the historical detection array, and x'(1), x'(2), ..., x'(n) are obtained by sensor detection in chronological order. Wherein, x' is one of the aperture historical detection array, the focal length historical detection array and the focus historical detection array.

[0045] Generally, when the sensor detects x'(1), x'(2), ..., x'(n), it will perform normalization processing, so x'(1), x'(2), ..., x'(n) are all between 0 and 1. Correspondingly, the actual numerical difference between x'(1), x'(2), ..., x'(n) is not very obvious, so it is difficult to directly find the numerical change law of x'(1), x'(2), ..., x'(n). Due to the fluctuation of the transmission frequency of the wireless device and the uncertainty of the user's operation frequency, some data in x'(1), x'(2), ..., x'(n) may have abnormal fluctuations. However, considering that the actual numerical difference between x'(1), x'(2), ..., x'(n) is not very obvious and it is difficult to directly find the change law, it is usually difficult to directly identify the abnormal fluctuation values ​​in x'(1), x'(2), ..., x'(n).

[0046] Step 102: Construct the amplification function Wherein k is a positive integer not greater than n. For example, x”(1)=x'(1), x”(2)=x'(1)+x'(2), x”(3)=x'(1)+x'(2)+x'(3)=x”(2)+x'(3),......,x”(k)=x”(k-1)+x'(k). Therefore, x”(i)>x”(i-1), that is, x”(i) is a strictly increasing function. Therefore, compared with the sequence x'(1),x'(2),......,x'(n), the change pattern of the sequence x”(k), x”(k-1), x”(k-2),...... will be more obvious, which provides a good basis for the prediction of subsequent focus data.

[0047] Step 103: Build

[0048] Based on u=(X T X) -1 X T Y, solve to obtain a and b.

[0049] Step 104: x”(k) satisfies the differential equation The differential equation is discretized into [x”(k)-x”(k-1)]+ax”(k)=b, that is, x'(k)+ax”(k)=b. Based on this, a focus data prediction function x'(p+1)+ax”(p)=b can be constructed, where p is a positive integer greater than n.

[0050] At least based on the focus data prediction function and the current detection value of the sensor, that is, the predicted value of the focus data in the next frame sequence can be obtained by substituting the current detection value of the sensor into the focus data prediction function. If there is a large difference between the focus data detected by the sensor in the next frame sequence and the predicted value, the detected focus data can be replaced with the predicted value, and the predicted value of the focus data can be output to the imaging module for imaging, thereby significantly improving the continuity and smoothness of the focus data output compared to the prior art, and the focus data can better match or synchronize the LED or virtual shooting and recording data, solve the problem of unevenness between frames of LED or virtual shooting and recording data, significantly improve the effect of real-time rendering, and bring a more outstanding visual experience to the shooting. In addition, it also reduces the workload of manual frame-by-frame processing in the later stage.

[0051] There are three current detection values ​​of the sensor, namely the current aperture detection value, the current focal length detection value and the current focus detection value. It is worth noting that when x' is the aperture history detection array, the focus data prediction function is the first prediction function, the current detection value of the sensor corresponds to the current aperture detection value, and the first prediction function can be used to obtain the predicted value of the aperture data. When x' is the focal length history detection array, the focus data prediction function is the second prediction function, the current detection value of the sensor corresponds to the current focal length detection value, and the second prediction function can be used to obtain the predicted value of the focal length data. When x' is the focus history detection array, the focus data prediction function is the third prediction function, the current detection value of the sensor corresponds to the current focus detection value, and the third prediction function can be used to obtain the predicted value of the focus data.

[0052] Therefore, by repeating the above-mentioned focus data prediction method, the first prediction function, the second prediction function and the third prediction function can be constructed for the three cases where x' is the aperture history detection array, the focal length history detection array and the focus history detection array, respectively, and the first prediction function, the second prediction function and the third prediction function will not interfere with each other. Therefore, the above-mentioned focus data prediction method can simultaneously output more continuous and smooth aperture data, focal length data and focus data, thereby allowing the final picture rendering effect to be more significantly improved.

[0053] Generally, m≥3. The larger the value of m, the less the impact of abnormal fluctuations in x'(1), x'(2), ..., x'(n), thereby ensuring the accuracy of a and b. Considering the temporal continuity of the focus operation, the focus data only in several adjacent frames have a high correlation. Therefore, in order to ensure the accuracy of the prediction of the focus data, m should not be too large. Taking the above factors into consideration, after testing, m=4 is the best solution.

[0054] It is worth noting that the focus data has a single dimension, a small amount of data, and poor real-time performance. Therefore, it is difficult to use regression analysis methods, neural networks, etc. to achieve a similar effect as in the present embodiment.

[0055] Based on the aforementioned focus data prediction method, this embodiment further provides a focus device, including a detection and recording module, a prediction module and an output module.

[0056] The detection recording module can record the historical detection array x'=[x'(1), x'(2), . . . , x'(n)] of the sensor, and obtain the current detection value of the sensor, that is, the detection recording module can execute the aforementioned step 101.

[0057] The prediction module can build an amplification function and Where k is a positive integer not greater than n, the prediction module can also construct u=(X T X) -1 X T Y, to obtain a and b by solving, and then construct the focus data prediction function x'(p+1)+ax"(p)=b, where p is a positive integer greater than n.

[0058] In addition, the prediction module can also obtain the predicted value of the focus data through the focus data prediction function and the current detection value of the sensor. That is, the detection and recording module can execute the above steps 102, 103 and 104.

[0059] The output module can output the predicted value of the focus data to the imaging module.

[0060] When x' is an aperture history detection array, the focus data prediction function is a first prediction function; when x' is a focal length history detection array, the focus data prediction function is a second prediction function; when x' is a focus history detection array, the focus data prediction function is a third prediction function. In some embodiments, the prediction module constructs a first prediction function, a second prediction function, and a third prediction function respectively.

[0061] There are three current detection values ​​of the sensor, namely, the current aperture detection value, the current focal length detection value and the current focus detection value. The prediction module can obtain the aperture data prediction value through the first prediction function and the current aperture detection value; the prediction module can obtain the focal length data prediction value through the second prediction function and the current focal length detection value; the prediction module can obtain the focus data prediction value through the third prediction function and the current focus detection value.

[0062] This embodiment also provides a shooting device, including the above-mentioned follow-focus device and an imaging module, wherein the output module is used to output the predicted value of the follow-focus data to the imaging module, and the imaging module is used to perform imaging according to the predicted value of the follow-focus data.

[0063] This embodiment further provides an electronic device, including a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the focus data prediction method are executed.

[0064] This embodiment further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the focus data prediction method are executed.

[0065] It should be understood that, unless otherwise specified herein, the execution of the above steps is not strictly limited in order, and the steps may be executed in other orders. Moreover, each step may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0066] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0067] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0068] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A method for predicting focus data, characterized in that: include: Obtain the sensor's historical detection array x'=[x'(1), x'(2), ..., x'(n)], where n is the total time series number corresponding to the historical detection array; Constructing the amplification function Where k is a positive integer not greater than n; Build Based on u=(X T X) -1 X T Y, solve to obtain a and b; Constructing a focus data prediction function x'(p+1)+ax"(p)=b, where p is a positive integer greater than n; A predicted value of the focus data is obtained based at least on the focus data prediction function and a current detection value of the sensor.

2. The focus data prediction method according to claim 1, characterized in that: m≥3。 3. The method for predicting focus data according to claim 2, characterized in that: m＝4。 4. The focus data prediction method according to claim 1, characterized in that: When x' is the aperture history detection array, the focus data prediction function is the first prediction function; When x' is the focal length history detection array, the focus data prediction function is the second prediction function; When x' is the focus history detection array, the focus data prediction function is the third prediction function; Constructing a first prediction function, a second prediction function and a third prediction function respectively; There are three current detection values ​​of the sensor, namely, current aperture detection value, current focal length detection value and current focus detection value; Based on the first prediction function and the current aperture detection value, obtaining an aperture data prediction value; Based on the second prediction function and the current focal length detection value, obtaining a focal length data prediction value; Based on the third prediction function and the current focus detection value, a focus data prediction value is obtained.

5. The focus data prediction method according to claim 4, characterized in that: The aperture history detection array, the focal length history detection array and the focus history detection array are all normalized arrays.

6. A follow focus device, characterized in that: include: A detection recording module is used to record the historical detection array x'=[x'(1), x'(2), ..., x'(n)] of the sensor and obtain the current detection value of the sensor; Prediction module, used to build the amplification function and Wherein k is a positive integer not greater than n, and the prediction module is also used to construct u=(X T X) -1 X T Y, to solve for a and b, and then construct a focus data prediction function x'(p+1)+ax"(p)=b, where p is a positive integer greater than n. The prediction module is further used to obtain a predicted value of the focus data through the focus data prediction function and the current detection value of the sensor. The output module is used to output the predicted value of the focus data.

7. The focus follow device according to claim 6, characterized in that: When x' is the aperture history detection array, the focus data prediction function is the first prediction function; When x' is the focal length history detection array, the focus data prediction function is the second prediction function; When x' is the focus history detection array, the focus data prediction function is the third prediction function; The prediction module is used to construct a first prediction function, a second prediction function and a third prediction function respectively; There are three types of current detection values ​​of the sensor, namely the current aperture detection value, the current focal length detection value and the current focus detection value; The prediction module is used to obtain an aperture data prediction value through the first prediction function and the current aperture detection value; The prediction module is used to obtain a focal length data prediction value through the second prediction function and the current focal length detection value; The prediction module is used to obtain a focus data prediction value through the third prediction function and the current focus detection value.

8. A photographing device, characterized in that: It comprises the focus tracking device and imaging module as described in claim 6 or 7, the output module is used to output the predicted value of the focus tracking data to the imaging module, and the imaging module is used to perform imaging according to the predicted value of the focus tracking data.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps in the method according to any one of claims 1 to 5 are executed.

10. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are executed.

Images