Method, device, electronic device and storage medium for determining zoom effect

Abstract

The present disclosure relates to a method, device, electronic device, and storage medium for determining a zoom effect. The method includes: obtaining a target video including a zoom process, wherein the target video has multiple video frames; determining the position information of preset feature points in the multiple video frames; and determining a zoom evaluation result of the target video based on the position information of the preset feature points in each video frame. Using the method of the present disclosure, for a target video involving a zoom operation, the position information of the preset feature points in each video frame is refined with reference to the preset feature points. Thus, a zoom evaluation result is obtained based on the position change of the preset feature points in each video frame. Automatically determining the zoom effect in an algorithmic manner is more objective and accurate while reducing labor costs.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing, and in particular to a method, device, electronic device, and storage medium for determining a zoom effect. Background Art

[0002] With technological advancements, the photography capabilities of electronic devices, such as mobile phones, are becoming increasingly sophisticated, resulting in increasingly superior photography. When using these devices for photography, users often need to adjust the zoom to focus on the subject in the scene. The smoothness of the zoom process is a key criterion for evaluating the performance of these devices.

[0003] In the related art, the zoom effect of an electronic device is often determined manually, which is highly subjective and cannot accurately determine the zoom performance of the electronic device. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a method, device, electronic device and storage medium for determining a zoom effect.

[0005] According to a first aspect of an embodiment of the present disclosure, a method for determining a zoom effect is provided, comprising:

[0006] Acquire a target video including a zoom process, wherein the target video has a plurality of video frames;

[0007] Determining position information of preset feature points in a plurality of the video frames;

[0008] The zoom evaluation result of the target video is determined according to the position information of the preset feature points in each video frame.

[0009] In some embodiments, the position information includes coordinates, and determining the position information of the preset feature points in the plurality of video frames includes:

[0010] Determining the coordinates of the preset feature point in each of the video frames to obtain a coordinate set comprising a plurality of coordinates, wherein an arrangement order of the plurality of coordinates in the coordinate set corresponds to an arrangement order of a plurality of video frames in the target video;

[0011] Determining the zoom evaluation result of the target video according to the position information of the preset feature points in each video frame includes:

[0012] Determining a plurality of preset coordinates according to the coordinate set;

[0013] determining an evaluation curve according to the plurality of preset coordinates;

[0014] The zoom evaluation result is determined according to the coordinate set and the evaluation curve.

[0015] In some embodiments, the zoom evaluation result includes a degree of zoom smoothness, and determining the zoom evaluation result according to the coordinate set and the evaluation curve includes:

[0016] Determining operation parameters according to the distance between the preset coordinates and the evaluation curve;

[0017] The operation parameter is used to represent the degree of zoom smoothness.

[0018] In some embodiments, characterizing the zoom smoothness by the operation parameter includes:

[0019] Acquiring configuration information, wherein the configuration information is used to characterize a correspondence between a threshold range and a smoothness level;

[0020] A smoothness level corresponding to a threshold range of the operation parameter is determined according to the operation parameter and the configuration information.

[0021] In some embodiments, the evaluation curve is a reference fitting curve;

[0022] Determining a plurality of preset coordinates according to the coordinate set includes:

[0023] Selecting part or all of the coordinates in the coordinate set as the plurality of preset coordinates;

[0024] The determining of the operation parameters according to the distance between the preset coordinates and the evaluation curve includes:

[0025] Determining the distance between each of the preset coordinates and the reference fitting curve to obtain a plurality of distances;

[0026] The operation parameters are determined using a preset operation method according to the multiple distances.

[0027] In some embodiments, the evaluation curve is a displacement change curve;

[0028] Determining a plurality of preset coordinates according to the coordinate set includes:

[0029] Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate;

[0030] The determining of the operation parameters according to the distance between the preset coordinates and the evaluation curve includes:

[0031] determining a distance between each of the preset coordinates and the displacement change curve to obtain a plurality of distances;

[0032] The operation parameters are determined using a preset operation method according to the multiple distances.

[0033] In some embodiments, the evaluation curve is a displacement change curve;

[0034] Determining a plurality of preset coordinates according to the coordinate set includes:

[0035] Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate;

[0036] The step of determining the zoom evaluation result according to the coordinate set and the evaluation curve further includes:

[0037] In response to the displacement change curve being a smooth curve, determining that the zoom evaluation result of the target video is smooth;

[0038] In response to the displacement change curve being a non-smooth curve, determining that a zoom evaluation result of the target video is non-smooth;

[0039] The displacement change curve and the zoom evaluation result are output.

[0040] According to a second aspect of an embodiment of the present disclosure, a device for determining a zoom effect is provided, comprising:

[0041] An acquisition module, configured to acquire a target video including a zoom process, wherein the target video has a plurality of video frames;

[0042] A first determining module is used to determine position information of preset feature points in a plurality of video frames;

[0043] The second determining module is used to determine the zoom evaluation result of the target video according to the position information of the preset feature points in each video frame.

[0044] In some embodiments, the location information includes coordinates, and the first determining module is configured to:

[0045] Determining the coordinates of the preset feature point in each of the video frames to obtain a coordinate set comprising a plurality of coordinates, wherein an arrangement order of the plurality of coordinates in the coordinate set corresponds to an arrangement order of a plurality of video frames in the target video;

[0046] The second determining module is used for:

[0047] Determining a plurality of preset coordinates according to the coordinate set;

[0048] determining an evaluation curve according to the plurality of preset coordinates;

[0049] The zoom evaluation result is determined according to the coordinate set and the evaluation curve.

[0050] In some embodiments, the zoom evaluation result includes a degree of zoom smoothness, and the second determining module is further configured to:

[0051] Determining operation parameters according to the distance between the preset coordinates and the evaluation curve;

[0052] The operation parameter is used to represent the degree of zoom smoothness.

[0053] In some embodiments, the second determining module is further configured to:

[0054] Acquiring configuration information, wherein the configuration information is used to characterize a correspondence between a threshold range and a smoothness level;

[0055] A smoothness level corresponding to a threshold range of the operation parameter is determined according to the operation parameter and the configuration information.

[0056] In some embodiments, the evaluation curve is a reference fitting curve;

[0057] The second determining module is further configured to: select part or all of the coordinates in the coordinate set as the plurality of preset coordinates;

[0058] The second determining module is further configured to:

[0059] Determining the distance between each of the preset coordinates and the reference fitting curve to obtain a plurality of distances;

[0060] The operation parameters are determined using a preset operation method according to the multiple distances.

[0061] In some embodiments, the evaluation curve is a displacement change curve;

[0062] The second determining module is used for:

[0063] Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate;

[0064] The second determining module is further configured to:

[0065] determining a distance between each of the preset coordinates and the displacement change curve to obtain a plurality of distances;

[0066] The operation parameters are determined using a preset operation method according to the multiple distances.

[0067] In some embodiments, the evaluation curve is a displacement change curve;

[0068] The second determining module is configured to: use the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate;

[0069] The second determining module is further configured to: in response to the displacement change curve being a smooth curve, determine that the zoom evaluation result of the target video is smooth;

[0070] In response to the displacement change curve being a non-smooth curve, determining that a zoom evaluation result of the target video is non-smooth;

[0071] The displacement change curve and the zoom evaluation result are output.

[0072] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, including:

[0073] processor;

[0074] a memory for storing executable instructions for the processor;

[0075] The processor is configured to execute the method for determining the zoom effect as described in any one of the above items.

[0076] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is proposed. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the method for determining the zoom effect as described in any one of the above items.

[0077] The technical solutions provided by the embodiments of the present disclosure can achieve the following beneficial effects: Using the method disclosed herein, for a target video involving a zoom operation, the position information of the preset feature points in each video frame is refined, using the preset feature points as a reference. This allows the determination of whether the zoom effect is smooth based on the positional changes of the preset feature points in each video frame. This algorithmic automatic determination of the zoom effect is more objective and accurate, while also reducing labor costs.

[0078] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0079] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0080] Figure 1 is a flowchart of a method according to an exemplary embodiment.

[0081] Figure 2 is a flowchart of a method according to an exemplary embodiment.

[0082] Figure 3 is a flowchart of a method according to an exemplary embodiment.

[0083] Figure 4 is a flowchart of a method according to an exemplary embodiment.

[0084] Figure 5 It is a block diagram of a device according to an exemplary embodiment.

[0085] Figure 6 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0086] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, like numbers in different figures represent like or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present invention, as detailed in the appended claims.

[0087] With technological advancements, the photography capabilities of electronic devices, such as mobile phones, are becoming increasingly sophisticated, resulting in increasingly superior photography. When using these devices for photography, users often need to adjust the zoom to focus on the subject in the scene. The smoothness of the zoom process is a key criterion for evaluating the performance of these devices.

[0088] In related technologies, the zoom effect of electronic devices is often determined manually. This method has at least the following technical problems:

[0089] First, it is highly subjective and cannot accurately determine the zoom performance of the electronic device.

[0090] Second, it is impossible to accurately compare the zoom performance of multiple electronic devices.

[0091] Third, it is impossible to accurately know the shaking situation during the zoom process.

[0092] In an embodiment of the present disclosure, a method for determining a zoom effect is proposed, comprising: obtaining a target video including a zoom process, wherein the target video has multiple video frames. Determining the position information of preset feature points in the multiple video frames. Determining the zoom evaluation result of the target video based on the position information of the preset feature points in each video frame. Using the method of the present disclosure, for a target video involving a zoom operation, the position information of the preset feature points in each video frame is refined with reference to the preset feature points. Thus, a zoom evaluation result is obtained based on the position change of the preset feature points in each video frame. Automatically determining the zoom effect in an algorithmic manner is more objective and accurate while reducing labor costs.

[0093] In an exemplary embodiment, the zoom effect determination method of this embodiment is applied to an electronic device, such as a mobile phone, a tablet computer, a laptop computer, a smart wearable device, or the like.

[0094] like Figure 1 As shown, the method of this embodiment may include the following steps:

[0095] S110: Acquire a target video including a zoom process.

[0096] S120: Determine position information of preset feature points in multiple video frames.

[0097] S130 : Determine a zoom evaluation result of the target video according to position information of preset feature points in each video frame.

[0098] In step S110, according to the operation instruction, a video recording interface can be entered in the camera program of the electronic device. In the video recording interface, the user can manually zoom and continuously adjust the scene in the viewfinder interface, and the target video includes this zoom process.

[0099] For example, during the zoom adjustment framing interface, the electronic device uses a screen recording program to record the zoom adjustment process in real time to obtain a target video. The target video after screen recording can be stored in a set location, and the processor obtains the target video from the set location.

[0100] Alternatively, during video recording in a camera application, the zoom adjustment operation is maintained until the recording is completed, thereby obtaining a target video including the zoom adjustment process. The processor of the electronic device may obtain the target video after the recording is completed, or the target video after the recording is completed is stored in the electronic device, and the processor obtains the target video from the storage location.

[0101] In this step, the target video has multiple video frames. After acquiring the target video, the processor can control the target video to be framed. The frame division process can be performed according to a preset unit time length (such as 1 second), thereby obtaining multiple continuous video frames.

[0102] In step S120, the preset feature points may be, for example, corner points in a video frame or key points of a person's facial features, etc. The preset feature points may be manually selected or automatically identified by the system during the processing.

[0103] In this step, the automatic identification of preset feature points is described as an example. The preset feature points are, for example, corner points. A variety of image processing algorithms can be integrated into the chip of the electronic device, such as recognition algorithms, tracking algorithms (such as optical flow methods), etc. The processor or application can call the image processing algorithm to identify and track the preset feature points in each video frame and determine the position information of the preset feature points in each video frame. This embodiment does not limit the number of preset feature points, and it is sufficient to obtain the position information of the same preset feature points in each video frame.

[0104] The location information may be, for example, the coordinates or depth of a preset feature point.

[0105] In step S130, a zoom evaluation result of the target video may be determined based on the position information of the preset feature points in each video frame. The zoom evaluation result may indicate whether the zoom effect of the target video is smooth, or the degree of smoothness.

[0106] According to the order of video frames after the target video is divided into frames, every two adjacent video frames are recorded as a video frame group, and the target video may include multiple video frame groups. Smooth zoom effect may mean that: during the zoom process, the magnification change of multiple video frame groups that is not less than the group number threshold is within a preset range. For example, the magnification change of each video frame group is within the preset range, that is, the magnification change of any two adjacent video frames is within the preset range. Alternatively, the group number threshold can be set to: n / 2*m, where n represents the number of video frames and m represents the percentage. For example, m can be 70%, then for the n / 2 groups of video frames formed by n video frames, the magnification change of greater than or equal to 70% of the groups of video frames is within the preset range. When the zoom is smooth, during the video playback, the changes of adjacent video frames are relatively smooth, and the picture or focus point will not shake too much.

[0107] Non-smooth zooming can mean that during zooming, the magnification of multiple video frames exceeding a threshold falls outside a preset range. Non-smooth zooming can cause significant jitter in the image or focus during video playback, resulting in a poor user experience.

[0108] In this embodiment, for example, whether the zoom effect is smooth can be characterized or determined by judging the coordinate change of the preset feature point.

[0109] In an exemplary embodiment, after step S130, the following step may be further included: outputting the zoom evaluation result; for example, the zoom evaluation result may be displayed on a screen, and / or the zoom evaluation result may be broadcasted through an audio component.

[0110] In an exemplary embodiment, the location information includes coordinates, such as Figure 2 As shown, step S120 of this embodiment may include the following steps:

[0111] S1201: Determine the coordinates of preset feature points in each video frame, and obtain a coordinate set including a plurality of coordinates.

[0112] On this basis, step S130 in this embodiment may include the following steps:

[0113] S131. Determine an evaluation curve based on the coordinate set.

[0114] S132: Determine a zoom evaluation result according to the coordinate set and the evaluation curve.

[0115] In step S1201 , the arrangement order of the multiple coordinates in the coordinate set corresponds to the arrangement order of the multiple video frames in the target video.

[0116] In this step, after the target video is framed, each video frame can obtain the coordinates of the preset feature points according to the arrangement order (time order) of the multiple video frames after framing, thereby obtaining multiple coordinates corresponding to the multiple video frames one by one. The point set composed of multiple coordinates is recorded as a coordinate set.

[0117] In step S131, step S131 may include the following steps:

[0118] S1311. Determine multiple preset coordinates based on the coordinate set. In this step, the preset coordinates can be part or all of the coordinates selected from the multiple coordinates; the preset coordinates can also be coordinates obtained by performing corresponding operations based on the multiple coordinates, for example, the preset coordinates are the coordinate difference between every two adjacent coordinates in the coordinate set.

[0119] S1312: Determine an evaluation curve based on a plurality of preset coordinates. In this step, the evaluation curve can be used to represent a reference curve when the target video has good smoothness.

[0120] In an exemplary embodiment, the evaluation curve may include a reference fitting curve or a displacement change curve. The evaluation curve may reflect the changes between video frames in the target video frame. The reference fitting curve may be obtained by fitting multiple coordinates, and the displacement change curve may be obtained by, for example, using coordinate change information of adjacent video frames.

[0121] In step S132 , the processor may determine whether the zoom effect is smooth based on the multiple coordinates in the coordinate set and the evaluation curve.

[0122] In an exemplary embodiment, Figure 3 As shown, step S132 in this embodiment may include the following steps:

[0123] S1321. Determine operation parameters based on the distance between the preset coordinates and the evaluation curve.

[0124] S1322: Characterize the degree of zoom smoothness using a calculation parameter.

[0125] In step S1321, the calculation parameter may be an average value, maximum value, or minimum value obtained based on the distance. The evaluation curve represents a reference curve for a good zoom effect. The processor calculates the distance between each budget coordinate and the evaluation curve based on the distance between the preset coordinates and the evaluation curve, and then determines the calculation parameter based on the multiple distances.

[0126] In step S1322, the processor may calculate a parameter representing the difference between the zoom effect of the target video and the better effect represented by the reference curve. For example, the calculation parameter may be the average value of multiple distances, and the average value may be equated with the zoom degree score to represent the zoom evaluation result of the target video.

[0127] In an exemplary embodiment, Figure 4 As shown, in this embodiment, step S1322 may include the following steps:

[0128] S1322-1. Obtain configuration information.

[0129] S1322-2. Determine, based on the operation parameters and configuration information, a smoothness level corresponding to a threshold range within which the operation parameters are located.

[0130] In step S1322-1, the configuration information is used to characterize the correspondence between the threshold range and the smoothness level. The configuration information may be predetermined and stored in the electronic device. The processor may obtain the configuration information from the storage location.

[0131] In step S1322-2, the processor may determine the smoothness level corresponding to the operation parameters in the configuration information by looking up the table or performing a traversal query based on the operation parameters and the configuration information.

[0132] For example, if the operation parameters are within the first threshold range, the corresponding smoothness level is the first level. If the operation parameters are within the second threshold range, the corresponding smoothness level is the second level. If the operation parameters are within the third threshold range, the corresponding smoothness level is the third level. If the first threshold range > the second threshold range > the third threshold range, the first level is better than the second level, and the second level is better than the third level.

[0133] In combination with the form of the evaluation curve, the embodiments of the present disclosure may include the following two examples: When the evaluation curve may be a reference fitting curve, refer to the first example below; when the evaluation curve may be a displacement change curve, refer to the second example below.

[0134] In the first example:

[0135] In this example, the evaluation curve may be a reference fitting curve, which may be generated by fitting all or part of the coordinates in the coordinate set.

[0136] In this example, step S1311 may include the following steps:

[0137] S1311-1. Select part or all of the coordinates in the coordinate set as multiple preset coordinates.

[0138] In this example, step S1321 may include the following steps:

[0139] S1321-1. Determine the distance between each preset coordinate and the reference fitting curve to obtain multiple distances.

[0140] S1321-2. Determine operation parameters using a preset operation method based on multiple distances.

[0141] In step S1311-1, the processor may select all coordinates in the coordinate set as preset coordinates, i.e., the number of preset coordinates may be the same as the number of coordinates in the coordinate set and correspond one to one. Alternatively, the processor may select some coordinates in the coordinate set as preset coordinates, in which case the number of preset coordinates is less than the number of coordinates in the coordinate set.

[0142] In this step, the processor can control the call algorithm fitting to obtain the reference fitting curve with multiple preset coordinates as sample data. For example, the preset coordinates are (x i ,y i ), where i = 1, 2, 3, ... m, and m is a natural number. The function or curve form is, for example, the following polynomial: θ (x) = θ0 + θ1x + θ2x 2 +...θ n x n , where n is a natural number; the horizontal coordinate in the reference fitting curve can be x, and the vertical coordinate can be y.

[0143] Using multiple preset coordinates as test data pairs, combined with MATLAB least squares method, calculate the coefficients θ0, θ1, θ2...θ in the polynomial n In this step, when using the least squares method to solve the coefficient, the coefficient can be differentiated and the partial derivative is set to 0 to obtain the coefficient; the coefficient obtained should minimize the standard function. Where, the standard function = ∑ (sample data - reference data) 2 , the reference data is for example a reference fitting curve.

[0144] In step S1321-1, the reference fitting curve is a theoretical curve calculated by an algorithm, which can represent the ideal smooth state of the zoom process. The deviation between the preset coordinates and the curve can reflect the zoom effect in the target video.

[0145] In this step, on the reference fitting curve, there are multiple preset coordinates (x i ,y i ) one-to-one correspondence of multiple points on the curve (X i , Y i ). The processor can control the calling algorithm to calculate the distance l between each preset coordinate and the corresponding point, As the distance between each preset coordinate and the reference fitting curve, a plurality of distances are obtained.

[0146] In step S1321-2, the preset operation method may be, for example, an average value, a variance, an extreme value, etc. The processor may determine corresponding operation parameters based on the plurality of distances by using the preset operation method.

[0147] In this step, the preset calculation method is the average value algorithm and the calculation parameter is the average value as an example for description.

[0148] After determining the distance between each preset coordinate and the reference fitting curve, the processor can determine an average distance laverage based on the distance from each preset coordinate to the reference fitting curve. The average laverage indicates the average smoothness of the entire zoom process. A smaller laverage indicates that the preset coordinates as a whole are closer to the reference fitting curve, and the zoom effect of the target video approaches the ideal state represented by the reference fitting curve.

[0149] In this example, the average value can be used to directly represent the zoom smoothness of the target video. The average value determined by the processor is output to the user interface. If the average value is laverage, the zoom smoothness is recorded as laverage. Therefore, when comparing the zoom effects of different products, the average value can be used to directly compare the zoom effects of different products, making the comparison more intuitive and convenient.

[0150] Alternatively, the processor determines the threshold range of the average value according to the configuration information, thereby determining the smoothness level corresponding to the average value. The processor outputs the determined smoothness level to the interface display.

[0151] In addition, in this step, the preset operation method may further include an extreme value or maximum value algorithm, and the operation parameters may further include a maximum value and a minimum value.

[0152] For example, by taking the derivative of the distance function l to obtain an extreme point (the derivative is zero, corresponding to the extreme point), the obtained extreme point can be further used to determine the maximum point. It is understood that the extreme point may or may not be the maximum point, depending on how the extreme point varies on both sides of the interval. The extreme point can be used to determine the minimum distance lmin and the maximum distance lmax of the distance from the coordinate point to the reference fitting curve.

[0153] The minimum distance lmin indicates the optimal smoothing state during zooming, while the maximum distance lmax indicates the worst smoothing state. Combining the maximum distance and the average value to evaluate the zoom effect provides a more accurate evaluation. For example, if both the average value and the maximum distance are within the first threshold, the zoom effect is approaching the ideal state represented by the reference fitting curve, and the zoom effect of the target video is at the first level.

[0154] In this example, the zoom effect of the target video can be quantitatively evaluated based on the relationship between each preset coordinate and the reference fitting curve, and the evaluation method is more intuitive and convenient.

[0155] In the second example:

[0156] In this example, the evaluation curve may be a displacement change curve, which may be generated by fitting based on a plurality of new coordinates obtained by performing corresponding operations on all or part of the coordinates in the coordinate set.

[0157] For example, the preset coordinates may be the coordinate difference between every two adjacent coordinates in the coordinate set, and the displacement change curve is determined according to the multiple coordinate differences.

[0158] In conjunction with the aforementioned embodiment, each coordinate in the coordinate set corresponds to a preset feature point in the corresponding video frame. Therefore, in the order of the video frames, the coordinate difference between every two adjacent coordinates is the displacement information of the preset feature point in each of the two adjacent video frames. Based on the coordinate set, the processor can invoke a fitting algorithm to determine the displacement information of the preset feature point in each of the two adjacent frames.

[0159] The coordinate difference represents displacement information, which can reflect the scale change during the zoom process. Based on the determined displacement information, the processor can determine a displacement change curve to simulate the zoom process in the target video. The displacement change curve has the frame number as the abscissa and the coordinate difference or displacement information as the ordinate. The displacement change curve reflects the scale change between two adjacent frames during the zoom process.

[0160] Therefore, in this example, step S1311 may include the following steps:

[0161] S1311-2. Taking the coordinate difference between every two adjacent coordinates in the coordinate set as a preset coordinate. In this step, the coordinate difference between every two adjacent coordinates is taken as a preset coordinate, and the total number of preset coordinates may be less than the total number of coordinates in the coordinate set.

[0162] In this example, step S1321 may include the following steps:

[0163] S1321-3. Determine the distance between each preset coordinate and the displacement change curve to obtain multiple distances.

[0164] S1321-4. Determine operation parameters using a preset operation method based on multiple distances.

[0165] In step S1321-3, the displacement change curve is a theoretical curve determined by fitting, and each preset coordinate has a corresponding point on the displacement change curve. Based on the preset coordinates and the displacement change curve, the processor can determine the distance between each preset coordinate and the displacement change curve. The determination method can be referred to in the above-mentioned distance formula 1. In this way, multiple distances are obtained.

[0166] In step S1321-4, the preset operation method may be an algorithm such as average, variance, or extreme value. The processor may determine corresponding operation parameters based on the multiple distances using the preset operation method. For example, the operation parameter may be the average distance.

[0167] In this example, the operation parameter can be made to directly represent the zoom smoothness of the target video. For example, the processor records the determined average distance as the zoom smoothness and outputs the average distance.

[0168] Alternatively, the processor determines the threshold range of the average distance based on the configuration information, thereby determining the smoothness level corresponding to the average distance. The processor controls the display of the smoothness level.

[0169] In addition, the following evaluation method can also be used in this example. Step S132 can include the following steps:

[0170] S1323-1. In response to the displacement change curve being a smooth curve, determine that the zoom evaluation result of the target video is smooth.

[0171] In this step, after determining the displacement change curve, it is possible to determine whether the displacement change curve is smooth. For example, it can be determined whether the tangent line of the displacement change curve rotates continuously as the tangent point moves, or whether the displacement change curve has a first-order continuous derivative within a set interval. If the first-order derivative of the displacement change curve is continuous, the displacement change curve is smooth.

[0172] When the displacement change curve is smooth, it indicates that the displacement information changes smoothly during the zoom process, and the zoom evaluation result of the target video is smooth.

[0173] S1323-2: In response to the displacement change curve being a non-smooth curve, determine that the zoom evaluation result of the target video is non-smooth.

[0174] In this step, when the displacement change curve is non-smooth, it indicates that the displacement information change difference during the zoom process is also large, and the zoom evaluation result of the target video is non-smooth.

[0175] S1323-3. Output the displacement change curve and zoom evaluation results.

[0176] In this step, the processor can control the direct output of the displacement change curve and the evaluation result of whether it is smooth, so as to display the zoom parity structure in a graphical way, which is more vivid and intuitive.

[0177] Another method for determining whether the displacement change curve is smooth is to divide the intervals corresponding to the displacement change curve into multiple groups. Determine whether the curve portion within each group of intervals is smooth based on the derivative of each group of intervals. The curve is determined to be smooth when the proportion of groups of smooth intervals in the total number of groups reaches a threshold.

[0178] In this example, changes in displacement information can also be used to determine whether jitter occurred during zooming. For example, if the displacement information between two adjacent frames changes significantly, jitter may have caused the sudden change during video capture. Combining this with the displacement change curve can effectively identify the frame number corresponding to the sudden change in displacement information, facilitating timely adjustments.

[0179] In an exemplary embodiment, the present disclosure also provides a device for determining a zoom effect. Figure 5 As shown, the apparatus of this embodiment may include: an acquisition module 110, a first determination module 120, and a second determination module 130. The apparatus of this embodiment is used to implement Figure 1 The method shown in FIG. The acquisition module 110 is configured to acquire a target video including a zoom process, wherein the target video has multiple video frames. The first determination module 120 is configured to determine the position information of preset feature points in the multiple video frames. The second determination module 130 is configured to determine a zoom evaluation result based on the position information of the preset feature points in each video frame.

[0180] In an exemplary embodiment, still referring to Figure 5 The device of this embodiment may include: an acquisition module 110, a first determination module 120 and a second determination module 130. The device of this embodiment is used to implement the following Figure 2 The method shown. The position information may include coordinates. The first determination module 120 is configured to determine the coordinates of a preset feature point in each video frame to obtain a coordinate set comprising a plurality of coordinates, wherein the order of the plurality of coordinates in the coordinate set corresponds to the order of the plurality of video frames in the target video. The second determination module 130 is configured to determine a plurality of preset coordinates based on the coordinate set; determine an evaluation curve based on the plurality of preset coordinates; and determine a zoom evaluation result based on the coordinate set and the evaluation curve.

[0181] In an exemplary embodiment, still referring to Figure 5 The device of this embodiment may include: an acquisition module 110, a first determination module 120 and a second determination module 130. The device of this embodiment is used to implement the following Figure 3 and Figure 4 The zoom evaluation result may include the degree of zoom smoothness. The second determining module 130 may also be configured to: determine an operation parameter according to the distance between the preset coordinates and the evaluation curve; and characterize the degree of zoom smoothness with the operation parameter.

[0182] In this embodiment, the second determination module 130 is further configured to: obtain configuration information, wherein the configuration information is used to characterize the correspondence between the threshold range and the smoothness level; and determine the smoothness level corresponding to the threshold range of the operation parameter according to the operation parameter and the configuration information.

[0183] In an exemplary embodiment, still referring to Figure 5 The apparatus of this embodiment may include: an acquisition module 110, a first determination module 120, and a second determination module 130. The evaluation curve may be a reference fitting curve; the second determination module 130 is further configured to select some or all of the coordinates in the coordinate set as a plurality of preset coordinates; the second determination module 130 is further configured to determine the distance between each preset coordinate and the reference fitting curve to obtain a plurality of distances; and determine operation parameters based on the plurality of distances using a preset operation method.

[0184] In an exemplary embodiment, still referring to Figure 5 The apparatus of this embodiment may include: an acquisition module 110, a first determination module 120, and a second determination module 130. The evaluation curve is a displacement change curve; the second determination module 130 is further configured to use the coordinate difference between every two adjacent coordinates in the coordinate set as a preset coordinate; and to determine the distance between each preset coordinate and the displacement change curve to obtain multiple distances; and to determine operation parameters based on the multiple distances using a preset operation method.

[0185] In this embodiment, the second determination module 130 is further used to: in response to the displacement change curve being a smooth curve, determine that the zoom evaluation result of the target video is smooth; in response to the displacement change curve being a non-smooth curve, determine that the zoom evaluation result of the target video is non-smooth; and output the displacement change curve and the zoom evaluation result.

[0186] like Figure 6 FIG2 is a block diagram of an electronic device. The present disclosure also provides an electronic device for executing the zoom effect determination method provided in each exemplary embodiment of the present disclosure. For example, device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0187] Device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .

[0188] The processing component 502 generally controls the overall operation of the device 500, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 502 may include one or more modules to facilitate interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.

[0189] The memory 504 is configured to store various types of data to support operations on the device 500. Examples of such data include instructions for any application or method operating on the device 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0190] Power component 506 provides power to the various components of device 500. Power component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 500.

[0191] The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the device 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0192] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), which is configured to receive external audio signals when the device 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 504 or transmitted via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.

[0193] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0194] The sensor assembly 514 includes one or more sensors for providing various aspects of the status assessment of the device 500. For example, the sensor assembly 514 can detect the open / closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500. The sensor assembly 514 can also detect changes in the position of the device 500 or a component of the device 500, the presence or absence of user contact with the device 500, the orientation or acceleration / deceleration of the device 500, and temperature changes of the device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0195] The communication component 516 is configured to facilitate wired or wireless communication between the device 500 and other devices. The device 500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0196] In an exemplary embodiment, the device 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described methods.

[0197] In another exemplary embodiment of the present disclosure, a non-transitory computer-readable storage medium, such as memory 504, includes instructions. The instructions are executable by processor 520 of device 500 to perform the above-described method. For example, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device. When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the above-described method.

[0198] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0199] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for determining a zoom effect, characterized in that: include: Acquire a target video including a zoom process, wherein the target video has a plurality of video frames; Determining position information of preset feature points in a plurality of the video frames, wherein the position information includes coordinates; Determining a zoom evaluation result of the target video according to position information of the preset feature points in each video frame; Wherein, determining the position information of the preset feature points in the plurality of video frames includes: Determining the coordinates of the preset feature point in each of the video frames to obtain a coordinate set comprising a plurality of coordinates, wherein an arrangement order of the plurality of coordinates in the coordinate set corresponds to an arrangement order of a plurality of video frames in the target video; Determining the zoom evaluation result of the target video according to the position information of the preset feature points in each video frame includes: Determining a plurality of preset coordinates according to the coordinate set; determining an evaluation curve according to the plurality of preset coordinates; The zoom evaluation result is determined according to the coordinate set and the evaluation curve.

2. The determination method according to claim 1, wherein the zoom evaluation result includes a degree of zoom smoothness, and determining the zoom evaluation result based on the coordinate set and the evaluation curve comprises: Determining operation parameters according to the distance between the preset coordinates and the evaluation curve; The operation parameter is used to represent the degree of zoom smoothness.

3. The determination method according to claim 2, wherein characterizing the zoom smoothness by the calculation parameter comprises: Acquiring configuration information, wherein the configuration information is used to characterize a correspondence between a threshold range and a smoothness level; A smoothness level corresponding to a threshold range of the operation parameter is determined according to the operation parameter and the configuration information.

4. The determination method according to claim 2, characterized in that: The evaluation curve is a reference fitting curve; Determining a plurality of preset coordinates according to the coordinate set includes: Selecting part or all of the coordinates in the coordinate set as the plurality of preset coordinates; The determining of the operation parameters according to the distance between the preset coordinates and the evaluation curve includes: Determining the distance between each of the preset coordinates and the reference fitting curve to obtain a plurality of distances; The operation parameters are determined using a preset operation method according to the multiple distances.

5. The determination method according to claim 2, characterized in that: The evaluation curve is a displacement change curve; Determining a plurality of preset coordinates according to the coordinate set includes: Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate; The determining of the operation parameters according to the distance between the preset coordinates and the evaluation curve includes: determining a distance between each of the preset coordinates and the displacement change curve to obtain a plurality of distances; The operation parameters are determined using a preset operation method according to the multiple distances.

6. The determination method according to claim 1, characterized in that: The evaluation curve is a displacement change curve; Determining a plurality of preset coordinates according to the coordinate set includes: Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate; The step of determining the zoom evaluation result according to the coordinate set and the evaluation curve further includes: In response to the displacement change curve being a smooth curve, determining that the zoom evaluation result of the target video is smooth; In response to the displacement change curve being a non-smooth curve, determining that a zoom evaluation result of the target video is non-smooth; The displacement change curve and the zoom evaluation result are output.

7. A device for determining a zoom effect, characterized in that: include: An acquisition module, configured to acquire a target video including a zoom process, wherein the target video has a plurality of video frames; A first determining module is configured to determine position information of preset feature points in a plurality of the video frames, wherein the position information includes coordinates; A second determining module is used to determine the zoom evaluation result of the target video according to the position information of the preset feature points in each video frame; The first determining module is used for: Determining the coordinates of the preset feature point in each of the video frames to obtain a coordinate set comprising a plurality of coordinates, wherein an arrangement order of the plurality of coordinates in the coordinate set corresponds to an arrangement order of a plurality of video frames in the target video; The second determining module is used for: Determining a plurality of preset coordinates according to the coordinate set; determining an evaluation curve according to the plurality of preset coordinates; The zoom evaluation result is determined according to the coordinate set and the evaluation curve.

8. The determination device according to claim 7, characterized in that The zoom evaluation result includes a degree of zoom smoothness, and the second determining module is further configured to: Determining operation parameters according to the distance between the preset coordinates and the evaluation curve; The operation parameter is used to represent the degree of zoom smoothness.

9. The determination device according to claim 8, characterized in that The second determining module is further configured to: Acquiring configuration information, wherein the configuration information is used to characterize a correspondence between a threshold range and a smoothness level; A smoothness level corresponding to a threshold range of the operation parameter is determined according to the operation parameter and the configuration information.

10. The determination device according to claim 8, characterized in that The evaluation curve is a reference fitting curve; The second determining module is further configured to: select part or all of the coordinates in the coordinate set as the plurality of preset coordinates; The second determining module is further configured to: Determining the distance between each of the preset coordinates and the reference fitting curve to obtain a plurality of distances; The operation parameters are determined using a preset operation method according to the multiple distances.

11. The determination device according to claim 8, characterized in that The evaluation curve is a displacement change curve; The second determining module is used for: Taking the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate; The second determining module is further configured to: determining a distance between each of the preset coordinates and the displacement change curve to obtain a plurality of distances; The operation parameters are determined using a preset operation method according to the multiple distances.

12. The determination device according to claim 7, characterized in that The evaluation curve is a displacement change curve; The second determining module is configured to: use the coordinate difference between every two adjacent coordinates in the coordinate set as the preset coordinate; The second determining module is further configured to: in response to the displacement change curve being a smooth curve, determine that the zoom evaluation result of the target video is smooth; In response to the displacement change curve being a non-smooth curve, determining that a zoom evaluation result of the target video is non-smooth; The displacement change curve and the zoom evaluation result are output.

13. An electronic device, characterized in that: include: processor; a memory for storing executable instructions for the processor; The processor is configured to execute the method for determining the zoom effect according to any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium, characterized in that When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for determining a zoom effect according to any one of claims 1 to 6.

Images