Zoom performance detection method, device, electronic equipment and medium

Abstract

The present application provides a zoom performance detection method, device, electronic device and medium. In the method, objective data related to the zoom performance of the electronic device to be tested is calculated based on the zoom screen recording video and zoom video recording video of the electronic device to be tested, so as to achieve objective detection of the zoom performance of the electronic device.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a zoom performance detection method, device, electronic equipment and medium. Background Art

[0002] When a user shoots through a camera application in an electronic device (such as a mobile phone, etc.), the user can adjust the shooting focal length through zoom operations in the preview interface of the camera application, thereby changing the size of the photographed object in the camera preview interface. Since the zoom performance of different devices may be different, the user experience is different when performing manual zoom on the camera applications of different mobile phones.

[0003] At present, most users judge the zoom performance of electronic devices subjectively, which is less objective. Therefore, how to objectively test the zoom performance of electronic devices is a technical problem that needs to be solved. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a zoom performance detection method, device, electronic device and medium. In the method, objective data related to the zoom performance of the electronic device to be tested is calculated, so as to objectively detect the zoom performance of the electronic device.

[0005] In a first aspect, an embodiment of the present application provides a zoom performance detection method. The method includes:

[0006] The test electronic device obtains a zoom screen recording video of the electronic device under test; the zoom screen recording video includes a process of zooming of the electronic device under test in a preview interface of a camera application program;

[0007] The test electronic device intercepts and processes the zoom screen recording video frame by frame to obtain multiple video frame images;

[0008] The test electronic device calculates the preview frame field of view FOV of each video frame image;

[0009] The test electronic device determines the preview frame FOV angle change information of two adjacent video frame images before and after the lens of the electronic device under test is switched according to the preview frame FOV of each video frame image; the preview frame FOV angle change information is used to detect the zoom smoothness of the electronic device under test;

[0010] And / or, after the test electronic device obtains a plurality of video frame images, the method further includes:

[0011] The test electronic device calculates the center offset ratio of the photographed object between every two adjacent video frame images;

[0012] The test electronic device determines the object center offset ratio information of two adjacent video frame images before and after the electronic device under test is zoomed according to the object center offset ratio of every two adjacent video frame images; wherein the object center offset ratio information is used to detect the zoom smoothness of the electronic device under test.

[0013] In this way, the testing electronic device can calculate the preview frame FOV angle change information of two adjacent video frame images before and after the lens of the electronic device to be tested is switched, so as to objectively detect the zoom smoothness performance of the electronic device.

[0014] The test electronic device can also calculate the center offset ratio information of the object of two adjacent video frame images before and after the electronic device to be tested is zoomed, so as to objectively detect the zoom smoothness performance of the electronic device.

[0015] According to the first aspect, after the test electronic device calculates the preview frame field of view angle of each video frame image, the method further includes: the test electronic device generates a curve of the preview frame FOV changing over time; wherein the change curve is used to detect the zoom smoothness of the electronic device to be tested.

[0016] In this way, the test electronic device can objectively detect the zoom smoothness performance of the electronic device based on the change curve of the preview frame FOV over time.

[0017] According to the first aspect, or any implementation of the first aspect above, in the zoom screen recording video, the shooting object of the camera application of the electronic device to be tested is a picture card, and the graphics in the picture card are reference point graphics.

[0018] After the test electronic device obtains a plurality of video frame images, it also includes:

[0019] The test electronic device performs target detection on each video frame image to obtain the pixel coordinates of the center point of the reference point graphic in each video frame image and the pixel side length of the target frame of the reference point graphic.

[0020] According to the first aspect, or any implementation of the first aspect, the test electronic device calculates the preview box FOV of each video frame image, including:

[0021] The preview frame field of view angle α of each video frame image in the horizontal direction is calculated based on the following formula: i ;

[0022]

[0023] Alternatively, the preview frame viewing angle β of each video frame image in the vertical direction is calculated based on the following formula: i ;

[0024]

[0025] Where, length is the pixel length of the video frame image (i.e., the preview frame), width is the pixel width of the video frame image (i.e., the preview frame), and d i is the pixel side length of the target frame of the reference point pattern, r is the radius of the reference point pattern in the chart; L is the distance between the chart and the electronic device to be tested.

[0026] In this way, for electronic devices to be tested with different preview frame resolutions, the preview frame FOV can be accurately calculated, so that a horizontal comparison of zoom smoothness of different electronic devices can be achieved based on objective data.

[0027] According to the first aspect, or any implementation of the first aspect, the testing electronic device calculates the center offset ratio of each two adjacent video frame images of the captured object, including:

[0028] The object center offset ratio Δ between the i-th video frame image and the j-th video frame image is calculated based on the following formula: ij :

[0029]

[0030] Among them, length is the pixel length of the video frame image, width is the pixel width of the video frame image, (x i ,y i ) is the pixel coordinate of the center point of the reference point graphic in the i-th video frame image, (x j ,yj) is the pixel coordinate of the center point of the reference point graphic in the i-th video frame image.

[0031] In this way, for electronic devices to be tested with different preview frame resolutions, the marker position can be automatically identified, and an accurate and normalized center offset ratio can be calculated, so that a horizontal comparison of zoom smoothness of different electronic devices can be achieved based on objective data.

[0032] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0033] The test electronic device obtains a zoom video of the electronic device under test; the zoom video includes a process in which a user performs a zoom operation on a preview interface of a camera application of the electronic device under test to zoom the electronic device under test;

[0034] In the case where the zoom operation includes a click-to-zoom operation, the test electronic device calculates the click-to-zoom reaction time of the electronic device under test each time the user clicks the zoom operation according to the zoom video recording, and determines the switching average frame rate information of the electronic device under test during the click-to-zoom operation;

[0035] Among them, the click-to-zoom reaction time is used to indicate the time interval from when the user clicks the zoom point on the mobile phone interface to when the preview box FOV starts to change; the switching average frame rate is used to indicate the ratio of the number of frames of the FOV change animation to the duration of the FOV change animation when the user performs a click-to-zoom operation; the click-to-zoom reaction time and the switching average frame rate are used to detect the zoom and chirality of the electronic device under test;

[0036] In the case where the zoom operation includes a sliding zoom operation, the test electronic device calculates the sliding zoom reaction time and the sliding zoom delay time of the electronic device under test each time the user performs a sliding zoom operation according to the zoom video recording;

[0037] Among them, the sliding zoom reaction time is used to indicate the time interval from when the user's finger starts to slide on the interface to when the preview box FOV starts to change; the sliding zoom delay time is used to indicate the time interval from when the user's finger stops sliding after the preview box FOV changes evenly to when the preview box FOV ends changing and stabilizes; the sliding zoom reaction time and the sliding zoom delay time are used to detect the zoom tracking properties of the electronic device to be tested.

[0038] In this way, the tested electronic device can calculate the click zoom reaction time of the electronic device under test each time the user clicks the zoom operation, the switching average frame rate information of the electronic device under test during the point-to-zoom operation, and the sliding zoom reaction time and sliding zoom delay time of the electronic device under test each time the user slides the zoom operation, so as to objectively test the zoom tracking performance of the electronic device.

[0039] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0040] The test electronic device generates a click-to-zoom reaction time box plot according to the click-to-zoom reaction time of the electronic device under test each time the user clicks to zoom;

[0041] The test electronic device generates a sliding zoom reaction time box plot according to the sliding zoom reaction time of the electronic device under test during each sliding zoom operation by the user;

[0042] The test electronic device generates a sliding zoom delay time box plot according to the sliding zoom delay time of the electronic device under test when the user slides and zooms each time; wherein the click zoom reaction time box plot, the sliding zoom reaction time box plot, and the sliding zoom delay time box plot are used to detect the zoom tracking chirality of the electronic device under test.

[0043] In this way, the tested electronic device can objectively detect the zoom and hand tracking performance of the electronic device based on the click zoom reaction time box plot, the sliding zoom reaction time box plot, and the sliding zoom delay time box plot.

[0044] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0045] The test electronic device obtains a first score corresponding to the preview box FOV angle change information and a first weight corresponding to the first score;

[0046] The testing electronic device obtains a second score corresponding to the center offset ratio information of the photographed object and a second weight corresponding to the second score;

[0047] The test electronic device acquires a third score corresponding to the switching average frame rate information and a third weight corresponding to the third score;

[0048] The testing electronic device determines a median click-to-zoom reaction time based on the click-to-zoom reaction time box plot, and obtains a fourth score corresponding to the median click-to-zoom reaction time, and a fourth weight corresponding to the fourth score;

[0049] The test electronic device determines a median sliding zoom reaction time based on the sliding zoom reaction time box plot, and obtains a fifth score corresponding to the median sliding zoom reaction time, and a fifth weight corresponding to the fifth score;

[0050] The test electronic device determines a median of the sliding zoom delay time based on the sliding zoom delay time box plot, and obtains a sixth score corresponding to the median of the sliding zoom delay time, and a sixth weight corresponding to the sixth score;

[0051] The test electronic device performs weighted summation of the first score, the second score, the third score, the fourth score, the fifth score and the sixth score according to the first weight, the second weight, the third weight, the fourth weight, the fifth weight and the sixth weight to obtain a total zoom performance score of the electronic device to be tested.

[0052] In this way, the testing electronic device can calculate the total zoom performance score of the electronic device to be tested, detect whether the zoom performance of the electronic device is qualified, and can also achieve horizontal comparison of different electronic devices based on the total zoom performance scores of different electronic devices.

[0053] In a second aspect, an embodiment of the present application provides a zoom performance detection device. The device includes:

[0054] A video frame-by-frame capture module is used to obtain a zoom screen recording video of the electronic device under test, and to perform frame-by-frame capture processing on the zoom screen recording video to obtain multiple video frame images; wherein the zoom screen recording video includes a process in which the electronic device under test zooms in the preview interface of the camera application;

[0055] A data calculation module, used to calculate the preview box FOV of each video frame image;

[0056] A data statistics module is used to determine the preview frame FOV angle change information of two adjacent video frame images before and after the lens of the electronic device under test is switched according to the preview frame FOV of each video frame image; the preview frame FOV angle change information is used to detect the zoom smoothness of the electronic device under test;

[0057] and / or,

[0058] The data calculation module is also used to calculate the center offset ratio of the shooting object between every two adjacent video frame images;

[0059] The data statistics module is also used to determine the object center offset ratio information of two adjacent video frame images before and after the electronic device under test is zoomed according to the object center offset ratio of every two adjacent video frame images; wherein the object center offset ratio information is used to detect the zoom smoothness of the electronic device under test.

[0060] According to the second aspect, the data statistics module is further used to generate a change curve of the preview box FOV over time according to the preview box FOV of each video frame image; wherein the change curve is used to detect the zoom smoothness of the electronic device to be tested.

[0061] According to the second aspect, or any implementation of the second aspect above, the device further includes:

[0062] A timing module is used to obtain a zoom video of the electronic device under test; the zoom video includes a process in which a user performs a zoom operation in a preview interface of a camera application of the electronic device under test to zoom the electronic device under test;

[0063] The timing module is further used to calculate the click-to-zoom reaction time of the electronic device under test each time the user clicks the zoom operation according to the zoom video recording when the zoom operation includes a click-to-zoom operation, and to determine the switching average frame rate information of the electronic device under test during the click-to-zoom operation;

[0064] Among them, the click-to-zoom reaction time is used to indicate the time interval from when the user clicks the zoom point on the mobile phone interface to when the preview box FOV starts to change; the switching average frame rate is used to indicate the ratio of the number of frames of the FOV change animation to the duration of the FOV change animation when the user performs a click-to-zoom operation; the click-to-zoom reaction time and the switching average frame rate are used to detect the zoom and chirality of the electronic device under test;

[0065] The timing module is further used to calculate the sliding zoom reaction time and the sliding zoom delay time of the electronic device under test each time the user performs a sliding zoom operation according to the zoom video recording when the zoom operation includes a sliding zoom operation;

[0066] Among them, the sliding zoom reaction time is used to indicate the time interval from when the user's finger starts to slide on the interface to when the preview box FOV starts to change; the sliding zoom delay time is used to indicate the time interval from when the user's finger stops sliding after the preview box FOV changes evenly to when the preview box FOV ends changing and stabilizes; the sliding zoom reaction time and the sliding zoom delay time are used to detect the zoom tracking properties of the electronic device to be tested.

[0067] According to the second aspect, or any implementation of the second aspect above, the data statistics module is further used to generate a click zoom reaction time box plot according to the click zoom reaction time of the electronic device to be tested each time the user clicks the zoom operation; it is also used to generate a sliding zoom reaction time box plot according to the sliding zoom reaction time of the electronic device to be tested each time the user slides the zoom operation; it is also used to generate a sliding zoom delay time box plot according to the sliding zoom delay time of the electronic device to be tested each time the user slides the zoom operation;

[0068] Among them, the click zoom reaction time box plot, the sliding zoom reaction time box plot, and the sliding zoom delay time box plot are used to detect the zoom and chirality of the electronic device to be tested.

[0069] According to the second aspect, or any implementation of the second aspect above, the device further includes:

[0070] A data analysis module, used to obtain a first score corresponding to the preview box FOV angle change information, and a first weight corresponding to the first score;

[0071] The data analysis module is further used to obtain a second score corresponding to the center offset ratio information of the photographed object, and a second weight corresponding to the second score;

[0072] The data analysis module is further used to obtain a third score corresponding to the switching average frame rate information and a third weight corresponding to the third score;

[0073] The data analysis module is further used to determine the median click-to-zoom reaction time based on the click-to-zoom reaction time box plot, and obtain a fourth score corresponding to the median click-to-zoom reaction time, and a fourth weight corresponding to the fourth score;

[0074] The data analysis module is further used to determine the median of the sliding zoom reaction time based on the sliding zoom reaction time box plot, and obtain a fifth score corresponding to the median of the sliding zoom reaction time, and a fifth weight corresponding to the fifth score;

[0075] The data analysis module is further used to determine the median of the sliding zoom delay time based on the sliding zoom delay time box plot, and obtain a sixth score corresponding to the median of the sliding zoom delay time, and a sixth weight corresponding to the sixth score;

[0076] The data analysis module is also used to perform weighted summation of the first score, the second score, the third score, the fourth score, the fifth score and the sixth score according to the first weight, the second weight, the third weight, the fourth weight, the fifth weight and the sixth weight to obtain a total score of the zoom performance of the electronic device to be tested.

[0077] According to the second aspect, or any implementation of the second aspect above, the device further includes:

[0078] The data analysis module is also used to analyze the zoom smoothness of the electronic device under test according to the change curve of the preview frame FOV over time; and / or, the analysis module is also used to analyze the zoom tracking property of the electronic device under test according to the zoom reaction time box diagram.

[0079] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0080] In a third aspect, an embodiment of the present application provides an electronic device. The electronic device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the zoom performance detection method of the first aspect and any one of the first aspects.

[0081] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0082] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the zoom performance detection method of the first aspect and any one of the first aspects.

[0083] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0084] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program. When the computer program is executed, the computer executes the zoom performance detection method as described in the first aspect or any one of the first aspects.

[0085] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0086] In a sixth aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the zoom performance detection method as in the first aspect or any one of the first aspects to control the receiving pin to receive a signal, so as to control the sending pin to send a signal.

[0087] The sixth aspect and any implementation of the sixth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the sixth aspect and any implementation of the sixth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] Figure 1a-Figure 1c is a schematic diagram of an application scenario shown as an example;

[0089] Figure 2 is an architectural diagram of an exemplary zoom performance detection system;

[0090] Figure 3 is a schematic diagram of the structure of an exemplary test electronic device;

[0091] Figure 4 is a schematic diagram of a zoom performance detection process shown as an example;

[0092] Figure 5 is a schematic diagram showing the positional relationship between the electronic device to be tested and the image card to be photographed;

[0093] Figure 6 The figure is a schematic diagram of a process of performing zoom smoothness detection on an electronic device to be tested;

[0094] Figure 7a is a schematic diagram of target detection results of a video frame image shown as an example;

[0095] Figure 7b is a schematic diagram of the preview box FOV shown as an example;

[0096] Figure 7c Schematic diagram showing the comparison of the preview box FOV changing curve over time;

[0097] Figure 8 The figure is a schematic diagram showing an exemplary process of performing zoom and chirality detection on an electronic device to be tested;

[0098] Fig. 9 Schematic diagram showing comparison of zoom reaction time box plots for example. DETAILED DESCRIPTION

[0099] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0100] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0101] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0102] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0103] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0104] With the continuous improvement of mobile imaging technology, the imaging capabilities of smartphones have developed rapidly, and mobile phone photography has become the preferred photography method for more and more users. In order to meet the shooting needs of users, it has become a trend in terminal development to set cameras with different focal lengths in the same terminal. By setting cameras with different focal lengths in the same terminal at the same time, the terminal can adjust the FOV (Field of View) (or the FOV of the camera lens) of the preview interface by simply adjusting the zoom ratio (or zoom ratio, ZoomRatio value, etc.), thereby achieving the effect of zooming in or out of the scene.

[0105] Among them, FOV refers to the range that the camera lens can cover. When the object exceeds the FOV, it will not be captured by the lens. The range that the camera lens can cover is usually expressed as an angle, which is called the FOV of the camera lens. The larger the FOV, the larger the range that the camera lens can cover; the smaller the FOV, the smaller the range that the camera lens can cover, and the clearer the details of the object being photographed.

[0106] The above-mentioned terminal can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA) or a dedicated camera (such as a SLR camera, a card camera), etc. This application does not impose any restrictions on the specific types of the above-mentioned terminal devices.

[0107] Usually, users can shoot through the camera application of mobile phones and other terminals. When shooting, users can adjust the focal length through zoom operations in the preview interface of the camera application, thereby changing the size of the subject in the camera preview interface. The larger the focal length, the narrower the camera's framing range, and the fewer scenes that can be captured (that is, the smaller the FOV of the mobile phone camera), but the scene occupies a larger proportion in the camera preview interface. The smaller the focal length, the wider the camera's framing range, the wider the field of view of the captured picture, and the more scenes that can be captured (that is, the larger the FOV of the mobile phone camera), but the scene is smaller in the camera preview interface.

[0108] Zoom operation is an important and high-frequency operation in shooting scenes, and its use experience will directly affect the user's shooting experience. The following explanation is given using a mobile phone as an example of a terminal device. Among them, the zoom operation of the mobile phone is closely coupled with finger touch, including click zoom operation and slide zoom operation (such as single-finger slide zoom operation and double-finger slide zoom operation).

[0109] Figure 1a An example application scenario is shown. The mobile phone detects a user operation (such as a touch / click operation) on the camera application icon, and in response to the operation, a Figure 1a The shooting interface 10 shown in (1). The shooting interface 10 can be the user interface of the default shooting mode of the camera application, and the user can complete the shooting on this interface. The camera application is an image shooting application on electronic devices such as smart phones and tablets. This application does not limit the name of the application. In other words, the user can open the shooting interface 10 of the camera application by clicking the camera application icon. It can be understood that the default camera in the default shooting mode is not limited to the rear camera, and the mobile phone can also set the front camera as the default camera. In other words, after opening the camera application, the mobile phone can display the image captured by the front camera in the preview area 102, which can be used for the user to shoot with the default front camera.

[0110] like Figure 1a As shown in (1), the shooting interface 10 may include a parameter adjustment area 101, a preview area 102, a camera mode option area 103, a gallery shortcut control 105, a camera flip control 104, a shutter control 106, and a zoom control 107. The present embodiment does not limit the shape of the zoom control 107. Among them, each control in the parameter adjustment area 101 is used to adjust the corresponding shooting parameters, including but not limited to: a flash setting control, an AI recognition switch setting control, a color standard setting control, and a more detailed camera setting control. The preview area 102 can be used to display a preview image, which is an image captured by the mobile phone through the camera in real time. The mobile phone can refresh the display content in the preview area 102 in real time so that the user can preview the image currently captured by the camera. One or more shooting mode options may be displayed in the camera mode option 103. The one or more shooting mode options may include but are not limited to: an aperture mode option, a night scene mode option, a portrait mode option, a photo mode option, a video mode option, a professional option mode, and more options. It can be understood that one or more shooting mode options can be displayed on the interface as text information, such as "aperture", "night scene", "portrait", "photo", "video", "professional", "more", and can also be displayed as icons or other forms of interactive elements (IE), which are not limited in this application.

[0111] Continue to refer to Figure 1a In (1), the zoom control 107 is used to trigger the mobile phone to adjust the zoom ratio, thereby adjusting the FOV of the shooting preview interface 102. The "1x" displayed on the zoom control 107 indicates that the current optical zoom ratio of the mobile phone is 1x, and the subsequent x indicates the zoom ratio.

[0112] In one example, if Figure 1a As shown in (1), the user clicks the zoom control 107, and the mobile phone adjusts the current zoom ratio of the mobile phone in response to the user's click operation on the zoom control 107. For example, the user clicks the zoom control 107 to trigger the zoom ratio of the mobile phone to be adjusted from "1x" to "3x", as shown in FIG. Figure 1a As shown in (2), the FOV of the mobile phone shooting preview interface becomes smaller, and the shooting scene in the shooting preview interface becomes larger. Similarly, the user can click the zoom control 107 multiple times to adjust (increase or decrease) the current zoom ratio of the mobile phone multiple times according to the preset ratio difference.

[0113] In another example, Figure 1b As shown in (1), the user slides the zoom control 107, and the mobile phone responds to the user's single-finger sliding operation on the zoom control 107 to adjust the current zoom ratio of the mobile phone, and the FOV of the shooting preview interface and the size of the shot scene change accordingly. When the user slides the zoom control 107 to adjust the current zoom ratio of the mobile phone, the display style of the zoom control 107 changes to indicate that the zoom ratio of the mobile phone is being adjusted. Figure 1b As shown in (2). Continue to refer to Figure 1b In (2), in response to the user's single-finger sliding operation, the current zoom ratio 108 of the mobile phone changes and is displayed on the preview interface, so that the user can clearly know the current zoom ratio of the mobile phone. When the current zoom ratio of the mobile phone is adjusted to 3.0x, if the user stops sliding the zoom control and lets go, the current zoom ratio of the mobile phone is set to 3.0x, and the display style of the zoom control 107 is restored and indicates that the current zoom ratio is "3x". The zoom ratio adjustment of the mobile phone is completed. At this time, you can refer to Figure 1a As shown in (2). Figure 1b In the example shown, taking the case where the user slides the zoom control 107 upward to increase the zoom ratio as an example, the case where the user slides the zoom control 107 downward to decrease the zoom ratio is similar, which will not be described in detail here.

[0114] In another example, Figure 1c As shown in (1), the user slides two fingers away from each other on the preview interface, and the phone responds to the user's sliding operation by increasing the current zoom ratio of the phone, reducing the FOV of the shooting preview interface, and enlarging the captured scene. Similarly, if the user slides two fingers toward each other on the preview interface, the phone responds to the user's sliding operation by reducing the current zoom ratio of the phone, increasing the FOV of the shooting preview interface, and reducing the captured scene. When the user slides two fingers (slides two fingers away from each other or slides two fingers toward each other) on the preview interface to adjust the current zoom ratio of the phone, the display style of the zoom control 107 changes to indicate that the zoom ratio of the phone is being adjusted. Please refer to Figure 1c As shown in (2). Continue to refer to Figure 1c In (2), in response to the user's two-finger sliding operation, the current zoom ratio 109 of the mobile phone changes and is displayed on the preview interface, so that the user can clearly know the current zoom ratio of the mobile phone. When the current zoom ratio of the mobile phone is adjusted to 3.0x, if the user stops the two-finger sliding operation and lets go, the current zoom ratio of the mobile phone is set to 3.0x, and the display style of the zoom control 107 is restored and indicates that the current zoom ratio is "3x". The zoom ratio of the mobile phone is adjusted. At this time, you can refer to Figure 1a As shown in (2).

[0115] When users perform zoom operations on camera applications of different mobile phones, the zoom smoothness may be different, which will directly affect the preview experience of users when shooting. When users perform zoom operations on camera applications of different mobile phones, the zoom chirality may also be different, which will directly affect the preview experience of users when shooting.

[0116] Among them, zoom smoothness can be understood as the degree of smoothness of zooming of the electronic device in response to the user's zoom operation when the user performs the zoom operation in the camera preview interface of the electronic device.

[0117] Zoom chirality can be understood as the delay of zooming of the electronic device when the user performs a zoom operation on the camera preview interface of the electronic device and the electronic device responds to the user's zoom operation.

[0118] Whether it is zoom smoothness or zoom chirality, it can be called the zoom performance of an electronic device. At present, the detection of the zoom performance of electronic devices mainly relies on the subjective feelings of users, without the support of objective data. Therefore, how to objectively test the zoom performance of electronic devices is a problem that needs to be solved.

[0119] In view of this, an embodiment of the present application provides a zoom performance detection method. This method can relatively objectively detect the zoom performance (such as zoom smoothness and zoom tracking) of an electronic device. It should be noted that the zoom performance detection method provided in the embodiment of the present application can be used to detect the performance of an electronic device in zooming when shooting a preview screen, and can also be used to detect the zoom performance of an electronic device in a video preview screen. The embodiment of the present application does not limit the shooting mode when detecting the zoom performance of an electronic device. For example, the zoom performance detection method provided in the embodiment of the present application can also detect the smoothness and tracking of an electronic device when zooming a shooting preview screen or a video preview screen in shooting modes such as portraits and night scenes.

[0120] The zoom performance detection method provided in the embodiment of the present application can be applied to Figure 2 The test system shown in Figure 1 is Figure 2As shown, the test system includes a picture card, an electronic device to be tested with a shooting preview function, and a test electronic device for a user to test the zoom performance of the electronic device to be tested.

[0121] In some examples, the types of the electronic device to be tested and the test electronic device may be the same or different. The types of the electronic device to be tested and the test electronic device include, but are not limited to, mobile phones, tablet computers, handheld computers, personal computers (PCs), cellular phones, personal digital assistants (PDAs), wearable devices and other electronic devices. The embodiments of the present application do not limit the specific types of the electronic device to be tested and the test electronic device. The electronic device to be tested may be any electronic device with a shooting preview function and a zoom function. Figure 2 In the test scenario shown, an example is given in which the electronic device to be tested is a mobile phone and the test electronic device is a PC.

[0122] In some examples, such as Figure 2 As shown, a third-party video recording device can also be set in the test system. The third-party video recording device is used to record the zoom process of the electronic device to be tested to obtain zoom video data of the electronic device to be tested. Exemplarily, the third-party recording device can be a mobile phone, camera or other device with a recording function, and the third-party video recording device can have a high frame rate, that is, the third-party video recording device records a large number of frames per second, for example, the third-party video recording device records a larger number of frames per second than a preset number threshold. Figure 2 An example is given in which the third-party video recording device is a high frame rate camera.

[0123] In some examples, in order to ensure that the environmental parameters remain unchanged when testing the zoom performance of the same electronic device under test, and the environmental parameters are consistent when testing the zoom performance of different electronic devices under test, at least one light source device can be added to the test system, such as Figure 2 As shown. Among them, at least one light source device is used to ensure that the environmental parameters remain unchanged during the process of testing the zoom performance of the electronic device to be tested. The embodiment of the present application does not limit the number of light source devices included in the test system. Figure 2 An example is given for illustrative description using an example in which the test system includes two light source devices.

[0124] Figure 3 FIG. 1 is a schematic diagram of a software system included in a test electronic device. Figure 3As shown, the test electronic equipment (or test device, detection device, etc.) may include a light source control module (or light source control system), a three-party recording control module (or three-party recording control system), a video frame-by-frame capture module (or video frame-by-frame capture system), a data calculation module (or data calculation system), a timing module (or timing system), a data statistics module (or data statistics system), and a data analysis module (or data analysis system).

[0125] Among them, the light source control module is used to control the light source device, such as turning on the light source device, adjusting the illumination and / or color temperature of the light source device, etc., so that the light source device can provide different environments, such as lighting environments formed by different illuminations and / or different color temperatures. Different lighting environments directly affect the camera preview exposure time of the electronic device under test, and then affect the preview frame rate of the electronic device under test. Therefore, in an embodiment of the present application, the zoom performance of the electronic device under test at different preview frame rates can be tested.

[0126] The three-party recording control module can be used to control the three-party video recording device, for example, to turn on the recording function of the three-party video recording device to record the zoom process of the electronic device under test. Optionally, the three-party recording control module can also be used to read the zoom video data recorded in the three-party video recording device. It is understandable that the recording function of the three-party video recording device can also be turned on manually, such as pressing the shooting button of the three-party video recording device, which is not limited in the embodiments of the present application.

[0127] The video frame-by-frame capture module can be used to perform frame-by-frame capture operations on video data to obtain each video frame in the video data. In an embodiment of the present application, the video frame-by-frame capture module can be used to perform frame-by-frame capture operations on zoom screen recording video data recorded by screen recording software of the electronic device under test.

[0128] Regarding the processing flow of the data calculation module, timing module, data statistics module, and data analysis module, please refer to the description below and will not be repeated here.

[0129] Figure 4 A flowchart of a zoom performance detection method provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, when using Figure 2When the test system shown tests the zoom performance of the electronic device to be tested, before the test, all other light sources except the light source device can be turned off, and the blackout curtain can be drawn before turning on the light source device to ensure that the environmental parameters during the test will not affect the test. The light source device can be turned on by the user manually turning on the switch of the light source device, or by turning on the light source device through the light source control module in the test electronic device. During the test under the same lighting environment, the illumination and color temperature of each light source device remain unchanged, and the illumination and / or color temperature of different light source devices can be the same or different.

[0130] To ensure that the electronic equipment under test (such as Figure 2 When the image card is photographed by a mobile phone (as shown in FIG), the composition of the image card in the preview frame (or viewfinder) of the electronic device under test is a standardized composition (that is, the image card can be fully displayed in the viewfinder), and the position of the electronic device under test needs to be adjusted. Figure 2 As shown, Figure 5 (1) shows an example of a top view of the relative position of the electronic device under test and the chart. The fixed distance L between the two remains unchanged. The position of the electronic device under test can be adjusted in the adjustment direction shown in the figure (i.e., the horizontal direction perpendicular to the line connecting the electronic device and the chart). Exemplarily, the position of the electronic device under test is adjusted so that when the electronic device under test uses the main camera lens to capture an image (for example, the zoom ratio is 1.0x), the center point of the preview frame of the electronic device under test coincides with the center point of the chart, as shown in FIG. Figure 5 As shown in (2).

[0131] Continue to refer to Figure 2 and Figure 5 As shown in (2), in the embodiment of the present application, the graphics in the chart can be a reference (mark) point graphics, and the boundaries of the reference point graphics are clear. Exemplarily, the boundaries of the reference point graphics are black, and the background color of the reference point graphics in the chart is neutral gray. In this way, it is beneficial to perform target detection on the preview interface image of the electronic device to be tested.

[0132] exist Figure 2 and Figure 5 In the example shown in (2), the reference point graphic is a circle, and its radius is r. It can be understood that the reference point graphic in the chart can also be a square, and this embodiment does not limit this. In the embodiment of the present application, the reference point graphic is a circle as an example for explanation.

[0133] In an optional embodiment, in order to adjust the position of the electronic device to be tested so that the composition of the picture card in the viewfinder of the electronic device to be tested is complete, a bracket and a sliding track installed on the bracket can be set in the test system, and the electronic device to be tested can be placed on the sliding track. When starting the test, the user can move the position of the electronic device to be tested on the sliding track so that the composition of the picture card in the viewfinder of the electronic device to be tested is complete. Optionally, a device movement control module (or device movement control system) can also be set in the test electronic device to control the movement of the electronic device to be tested on the sliding track so that the composition of the picture card in the viewfinder of the electronic device to be tested is complete. That is to say, before starting the test, the positions of the picture card and the electronic device to be tested are fixed, and the picture card is displayed completely in the viewfinder of the electronic device to be tested, and the positions of the picture card and the electronic device to be tested will not be changed during the test.

[0134] During the test, the camera application of the electronic device under test is opened, and the user enables the electronic device under test to achieve full-magnification zoom through zoom operations (including click zoom operations and slide zoom operations) in the camera's preview interface, and uses a third-party video recording device to shoot the zoom process of the electronic device under test to obtain zoom video data, and uses the screen recording software in the electronic device under test to record the zoom process of the electronic device under test to obtain zoom screen recording video data.

[0135] It should be pointed out that full-magnification zoom can be understood as a zoom operation by a user so that the zoom magnification adjustment of the electronic device under test involves all the zoom magnifications preset therein.

[0136] In the same lighting environment, after the user realizes full-magnification zoom of the electronic device under test by clicking the zoom operation and sliding the zoom operation in the preview interface of the camera application, the shooting in the current lighting environment can be ended, and it can be determined whether it is necessary to test the zoom performance of the electronic device under test in other lighting environments. If it is necessary to continue testing the zoom performance of the electronic device under test in other lighting environments, adjust the light source to shoot the zoom process of the electronic device under test in other lighting environments. If the zoom process of the electronic device under test has been shot in all lighting environments, the test electronic device exports the zoom video data shot in the third-party video recording device and the zoom screen video data recorded in the electronic device under test to the test electronic device. Optionally, the third-party video recording device can also automatically send the zoom video data it shoots to the test electronic device. Similarly, the electronic device under test can also automatically send its recorded zoom screen video data to the test electronic device. It is understandable that when the zoom process of the electronic device under test has been filmed in all lighting environments, the user can also export the zoom video data shot in the third-party video recording device and the zoom screen video data recorded in the electronic device under test to the test electronic device. The embodiment of the present application does not limit the way in which the test electronic device obtains the zoom video data shot in the third-party video recording device and the way in which the zoom screen video data recorded in the electronic device under test is obtained. For example, the zoom video data of the electronic device under test can also be shot by the test electronic device. In this case, the way in which the test electronic device obtains the zoom video data of the electronic device under test is that the test electronic device shoots the zoom process of the electronic device under test to obtain the zoom video data of the electronic device under test.

[0137] In an embodiment of the present application, the zoom screen recording video data recorded in the electronic device to be tested can indicate changes in the preview window during the zooming process of the electronic device to be tested, and can be used to detect the zoom smoothness of the electronic device to be tested; the zoom video recording video data shot in a third-party recording device can indicate the user's zoom operation on the electronic device to be tested, and can allow the user to detect the zoom tracking property of the electronic device to be tested.

[0138] The following explains the process of testing the electronic device for detecting the zoom smoothness of the electronic device to be tested based on the zoom screen recording video data, and the process of testing the electronic device for detecting the zoom handiness of the electronic device to be tested based on the zoom video recording video data.

[0139] (I) Testing of zoom smoothness of electronic equipment under test

[0140] Figure 6The process of testing the electronic device to detect the zoom smoothness of the electronic device under test based on the zoom screen recording video data is exemplarily shown. In this process, the zoom screen recording video data refers to the zoom screen recording video data collected for an electronic device under test in a lighting environment.

[0141] like Figure 6 As shown, the process of testing the electronic device to detect the zoom smoothness of the electronic device to be tested based on the zoom screen recording video data specifically includes the following steps:

[0142] S201, a frame-by-frame video capture module of a test electronic device obtains zoom screen recording video data recorded by the electronic device to be tested.

[0143] Among them, the zoom screen recording video data can be generated based on the screen recording software in the electronic device under test, including the process of zooming the electronic device under test in the preview interface of the camera application (for example, the photo preview interface or the video preview interface).

[0144] In some examples, the zoom screen recording video data includes a process in which the electronic device under test performs full-magnification zooming in a preview interface of a camera application.

[0145] Exemplarily, taking the process in which a user zooms the electronic device under test by performing a click-to-zoom operation on the preview interface of the electronic device under test as an example, assuming that the click-to-zoom magnification items pre-set in the electronic device under test include 0.5x, 1.0x, 2.0x and 3.0x, then the full-magnification zoom means that when the user performs a click-to-zoom operation on the preview interface of the electronic device under test, the user's zoom operation causes the zoom magnification adjustment of the electronic device under test to involve 0.5x, 1.0x, 2.0x and 3.0x, that is, involving all the pre-set click-to-zoom magnifications.

[0146] Exemplarily, taking the process in which a user zooms the electronic device under test by sliding a zoom operation in the preview interface of the electronic device under test as an example, and the zoom ratio range of the electronic device under test is 0.5x to 15.0x as an example, full-ratio zoom means that when the user performs a sliding zoom operation in the preview interface of the electronic device under test, the user's zoom operation causes the zoom ratio adjustment of the electronic device under test to involve any zoom ratio from 0.5x to 15.0x, that is, all zoom ratios of the electronic device under test. Of course, when the user performs a sliding zoom operation in the preview interface of the electronic device under test, the user's zoom operation can also cause the zoom ratio adjustment of the electronic device under test to only involve a partial zoom ratio range (for example, 0.5x to 6.0x), and the present application does not limit this, as long as the user's sliding zoom operation can test the zoom smoothness of the electronic device under test.

[0147] In some examples, the camera of the electronic device to be tested may include one or more shooting lenses. Among them, the shooting lens is used to obtain a captured image within a specific magnification range. The smaller the focal length of the shooting lens, the larger its field of view angle, the larger the framing range, and more scenes can be captured. Conversely, the larger the focal length of the shooting lens, the smaller its field of view angle, the smaller the framing range, and fewer but farther scenes can be captured. Take the example of an electronic device including three shooting lenses, namely a wide-angle lens, a main camera lens and a telephoto lens, and their respective zoom ratio ranges are 0.5x-0.9x, 1.0x-2.9x, and 3.0x-20x, respectively. The values ​​of the above zoom ratio ranges are only exemplary. In the case where the camera of the electronic device to be tested may include multiple shooting lenses, the full-magnification zoom of the electronic device to be tested needs to involve the zoom ratio corresponding to each shooting lens.

[0148] S202, a video frame-by-frame capture module of the test electronic device performs a frame-by-frame capture operation on the zoom screen recording video data to obtain each video frame image.

[0149] Exemplarily, the video frame-by-frame capture module may call a frame capture tool to perform frame-by-frame capture operations on the zoom screen recording video data to obtain each video frame image.

[0150] Figure 7a The video frame image f is shown as an example i , video frame image f i It can represent the screen image corresponding to the i-th video frame. Since the length (denoted as length) and width (denoted as width) of the preview frame of the electronic device under test are both fixed values, the video frame image f i The length is also length, and the width is also width.

[0151] S203, the data calculation module of the test electronic device calls the target detection model to perform target detection on each video frame image, and records the coordinates of the center point of the target frame and the side length of the target frame of each video frame image.

[0152] The target detection model is used to find the region of interest in the image and determine the location information of the region of interest. The target detection model can use the target box to identify the region of interest and determine the side length of the target box and the pixel coordinates of the center point of the target box.

[0153] Exemplarily, the target detection model may be a YOLO (You Only Look Once) model, wherein the training set of the target detection model is an image set containing reference points.

[0154] The target detection model targets the video frame image f i Perform target detection and determine the target frame as follows Figure 7a As shown. Among them, the side length of the target box is d i , the pixel coordinates of the center point of the target box are (x i ,y i ). It should be noted that the side length of the target box is d i , pixel coordinates of the center point of the target frame (x i ,y i ), and the video frame image f i The units of length and width are both pixels.

[0155] S204, the data calculation module of the test electronic device calculates the center offset ratio of the reference points of every two adjacent video frame images according to the target frame center point coordinates and the target frame side length of each video frame image, and sends the center offset ratio of the reference points of every two adjacent video frame images to the data statistics module of the test electronic device.

[0156] For the video frame image f i , after target detection, the side length of the target box is d i , the pixel coordinates (x i ,y i );For the video frame image f j (i.e., the screen image corresponding to the jth video frame), after target detection, the side length of its target box is d j , the pixel coordinates of the center point of the target box (x j ,y j ). Among them, the video frame image f i and video frame image f j are two adjacent video frame images.

[0157] Therefore, based on the preview frame resolution of the electronic device to be tested, the center offset ratio of the reference point graphic between the i-th video frame and the j-th video frame is:

[0158]

[0159] In this way, for electronic devices to be tested with different preview frame resolutions, the marker position can be automatically identified, and an accurate and normalized center offset ratio can be calculated, so that a horizontal comparison of zoom smoothness of different electronic devices can be achieved based on objective data.

[0160] S205: The data calculation module of the test electronic device calculates the preview box FOV of each video frame image, and sends the preview box FOV of each video frame image to the data statistics module of the test electronic device.

[0161] The preview frame FOV can be the FOV in the horizontal direction (such as Figure 7b α shown), it can also be the FOV in the vertical direction (such as Figure 7b In this embodiment, the data calculation module calculates the preview box FOV in the horizontal direction or the preview box FOV in the vertical direction of each video frame image, and this embodiment does not limit this.

[0162] For the video frame image f i The data calculation module can calculate the corresponding preview box FOV in the horizontal direction according to the following formula:

[0163]

[0164] Or, for the video frame image f i The data calculation module can also calculate the corresponding preview box FOV in the vertical direction according to the following formula:

[0165]

[0166] In this way, for electronic devices to be tested with different preview frame resolutions, the preview frame FOV can be accurately calculated, so that a horizontal comparison of zoom smoothness of different electronic devices can be achieved based on objective data.

[0167] This embodiment does not limit the timing sequence of S204 and S205.

[0168] S206, the data statistics module of the test electronic device counts the center offset ratio of the reference points of two adjacent video frame images before and after the electronic device to be tested is zoomed, and sends the center offset ratio of the reference points of two adjacent video frame images before and after the zoom to the data analysis module of the test electronic device.

[0169] In the embodiment of the present application, the data statistics module of the test electronic device can obtain the center offset ratio of the reference points of each two adjacent video frames in the zoom screen recording video data. In this way, the data statistics module can count the center offset ratio of the reference points of two adjacent video frame images before and after zooming.

[0170] Assuming that the two adjacent video frame images before and after a zoom are video frame images f1 and video frame images f2, the data statistics module can obtain that the center offset ratio of the reference points of the two adjacent video frame images before and after the zoom is Δ 12 .

[0171] Among them, the two adjacent video frame images before and after zooming can be marked by the user or recognized based on a preset neural network model, which is not limited in the embodiment of the present application.

[0172] It can be understood that the zoom screen recording video data includes multiple zoom processes of the electronic device under test, so the data statistics module can obtain the center offset ratio of the reference point of two adjacent video frame images before and after multiple zooms (such as Δ 12 , Δ 34 , Δ 67 , …). Furthermore, the data statistics module can count the reference point center offset ratio Δ of two adjacent video frame images before and after zooming of the electronic device under test in the current lighting environment according to the multiple reference point center offset ratios of two adjacent video frame images before and after zooming.

[0173] Exemplarily, the data statistics module may process the reference point center offset ratios of two adjacent video frame images before and after zooming by weighted averaging to obtain the reference point center offset ratio Δ of two adjacent video frame images before and after zooming of the electronic device under test in the current lighting environment.

[0174] As another example, the data statistics module can also determine the average of the reference point center offset ratios of two adjacent video frame images before and after zoom based on a preset statistical algorithm as the reference point center offset ratio Δ of two adjacent video frame images before and after zoom of the electronic device under test under the current lighting environment.

[0175] This embodiment does not limit the way in which the data statistics module counts the reference point center offset ratio Δ of two adjacent video frame images before and after zooming of the electronic device under test in the current lighting environment based on multiple reference point center offset ratios of two adjacent video frame images before and after zooming.

[0176] S207, the data statistics module of the test electronic device calculates the FOV angle change of the preview box of two adjacent video frame images before and after any lens switching, and counts the FOV angle change of the preview box of two adjacent video frame images before and after the lens switching of the electronic device to be tested, and sends the FOV angle change of the preview box of two adjacent video frame images before and after the lens switching to the data analysis module of the test electronic device.

[0177] In the embodiment of the present application, the data statistics module of the test electronic device can obtain the preview frame FOV of each video frame image in the horizontal direction (or the preview frame FOV of each video frame image in the vertical direction) in the zoom screen recording video data. In this way, the data statistics module can calculate the change in the preview frame FOV angle of two adjacent video frame images before and after any lens switching.

[0178] Assume that the two adjacent video frame images before and after a certain lens switch are video frame image f3 and video frame image f4, respectively, video frame image f3 is a preview frame image acquired based on the first camera, and video frame image f4 is a preview frame image acquired based on the second camera. Then, when the data statistics module obtains the preview frame FOV of each video frame image in the zoom screen recording video data in the horizontal direction, the data statistics module can calculate the preview frame FOV angle change of the two adjacent video frame images before and after the lens switch:

[0179] Δα1=α4-α3.

[0180] Wherein, α4 ​​is the preview box FOV of the video frame image f4 in the horizontal direction, and α3 is the preview box FOV of the video frame image f3 in the horizontal direction.

[0181] When the data statistics module obtains the preview box FOV of each video frame image in the vertical direction in the zoom screen recording video data, the data statistics module can calculate the preview box FOV angle change of two adjacent video frame images before and after the lens switch:

[0182] Δβ1=β4-β3.

[0183] Wherein, β4 is the preview box FOV of the video frame image f4 in the vertical direction, and β3 is the preview box FOV of the video frame image f3 in the vertical direction.

[0184] Among them, the two adjacent video frame images before and after the lens switch can be marked by the user, or can be recognized based on a preset neural network model, which is not limited in the embodiment of the present application.

[0185] It can be understood that the zoom screen recording video data includes multiple lens switching processes of the electronic device to be tested, so the data statistics module can calculate the preview box FOV angle changes of two adjacent video frame images before and after the multiple lens switching (such as Δα1, Δα2, Δα3, ..., or such as Δβ1, Δβ2, Δβ3, ...). Furthermore, the data statistics module can count the preview box FOV angle changes Δα or Δβ of the two adjacent video frame images before and after the lens switching of the electronic device to be tested under the current lighting environment based on the preview box FOV angle changes of two adjacent video frame images before and after the multiple lens switching.

[0186] Exemplarily, the data statistics module can process the preview box FOV angle change of two adjacent video frame images before and after the multiple lens switching by weighted averaging to obtain the preview box FOV angle change Δα or Δβ of two adjacent video frame images before and after the lens switching of the electronic device under test under the current lighting environment.

[0187] As another example, the data statistics module can also determine the average of the preview box FOV angle changes of two adjacent video frame images before and after the multiple lens switches based on a preset statistical algorithm, as the preview box FOV angle change Δα or Δβ of two adjacent video frame images before and after the lens switch of the electronic device under test under the current lighting environment.

[0188] This embodiment does not limit the way in which the data statistics module counts the preview box FOV angle changes Δα or Δβ of two adjacent video frame images before and after the lens switching of the electronic device under test under the current lighting environment based on the preview box FOV angle changes of two adjacent video frame images before and after multiple lens switching.

[0189] S208, the data statistics module of the test electronic device counts the change curve of the preview box FOV over time, and sends the change curve of the preview box FOV over time to the data analysis module of the test electronic device.

[0190] In the embodiment of the present application, the data statistics module of the test electronic device can obtain the preview frame FOV of each video frame image in the horizontal direction (or the preview frame FOV of each video frame image in the vertical direction) in the zoom screen recording video data, and the data statistics module can count the change curve of the preview frame FOV of the electronic device under test during the zoom process over time. Among them, the change curve of the preview frame FOV of the electronic device under test during the zoom process over time can also be used as a performance indicator for evaluating the zoom smoothness of the electronic device.

[0191] This embodiment does not limit the timing sequence of S206 , S207 , and S208 .

[0192] S209: The data analysis module for testing the electronic device analyzes the zoom smoothness of the electronic device to be tested.

[0193] In this embodiment, the data analysis module can analyze the zoom smoothness of the electronic device under test based on at least one of the following: the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed, the preview frame FOV angle change Δα or Δβ of two adjacent video frame images before and after the lens of the electronic device under test is switched, and the preview frame FOV change curve over time during the zooming process of the electronic device under test.

[0194] The smaller the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed, the better the zoom smoothness of the electronic device under test is. For example, if the zoom smoothness of the electronic device under test is qualified, the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed must be less than a threshold value of 1.

[0195] The smaller the change Δα or Δβ of the preview frame FOV angle of two adjacent video frame images before and after the lens switching of the electronic device under test is, the better the zoom smoothness of the electronic device under test is. For example, if the zoom smoothness of the electronic device under test is qualified, the change Δα or Δβ of the preview frame FOV angle of two adjacent video frame images before and after the lens switching of the electronic device under test needs to be less than a threshold value 2.

[0196] The more uniform the change speed of the preview frame FOV during the zooming process of the electronic device under test is, the better the zooming smoothness of the electronic device under test is. On the contrary, the more non-uniform the change speed of the preview frame FOV during the zooming process of the electronic device under test is, the worse the zooming smoothness of the electronic device under test is.

[0197] Figure 7c The following is an exemplary diagram showing the curve of the change of the preview frame FOV over time during the zooming process of the electronic device A and the electronic device B under test in a certain lighting environment. Figure 7c As shown, for the electronic device B under test, the curve of the change of the preview frame FOV over time during the zooming process of the electronic device A under test is smoother. That is, compared with the electronic device B under test, the change speed of the preview frame FOV during the zooming process of the electronic device A under test is more uniform. Therefore, based on the curve of the change of the preview frame FOV over time during the zooming process of the electronic device A under test and the electronic device B under test under a certain lighting environment, the data analysis module can analyze that the zooming smoothness of the electronic device A under test is better than the zooming smoothness of the electronic device B under test.

[0198] In one example, the data analysis module can also calculate the zoom smoothness score S1 of the electronic device under test according to the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed, the preview frame FOV angle change Δα or Δβ of two adjacent video frame images before and after the lens switching of the electronic device under test, and the preset scoring strategy:

[0199] S1=w Δ ·S_Δ+w Δα S_Δα or S1 = w Δ ·S_Δ+w Δβ ·S_Δβ.

[0200] Among them, w Δ The weight of the reference point center offset ratio Δ of two adjacent video frame images before and after zooming of the electronic device under test, w Δα The weight w represents the change Δα of the preview box FOV angle of two adjacent video frames before and after the lens switching of the electronic device under test. Δβ represents the weight of the change Δβ of the preview box FOV angle of two adjacent video frame images before and after the lens switching of the electronic device under test. Δα and w Δβ equal.

[0201] Among them, S_Δ represents the score of the center offset ratio Δ of the reference point of two adjacent video frame images before and after the zoom of the electronic device under test, S_Δα represents the score of the preview box FOV angle change Δα of two adjacent video frame images before and after the lens switching of the electronic device under test, and S_Δβ represents the score of the preview box FOV angle change Δβ of two adjacent video frame images before and after the lens switching of the electronic device under test.

[0202] Exemplarily, the data analysis module may query the corresponding score S_Δ according to the interval to which Δ belongs.

[0203] For example, if Δ∈(num 00 ,num 01 ], then S_Δ=score01; if Δ∈(num 01 ,num 02 ], then S_Δ=score02;…;if Δ∈(num 0(n_0-1) ,num 0n_0 ], then S_Δ=score0n_0.

[0204] Among them, score01>score02>L>score0n_0. That is, the smaller the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed, the higher the score, indicating that the zoom smoothness of the electronic device under test is better.

[0205] Exemplarily, the data analysis module may also query the corresponding score S_Δα according to the interval to which Δα belongs, or may query the corresponding score S_Δβ according to the interval to which Δβ belongs.

[0206] For example, if Δα∈(num 10 ,num 11 ], then S_Δα=score11; if Δα∈(num 11 ,num 12 ], then S_Δα=score12;...; if Δ∈(num 1(n_1-1) ,num 1n_1 ], then S_Δ=score1n_1.

[0207] Or, if Δβ∈(num 20 ,num 21 ], then S_Δβ=score11; if Δβ∈(num 21 ,num 22 ], then S_Δβ=score12;...; if Δβ∈(num 2(n_1-1) ,num 2n_1 ], then S_Δ=score1n_1.

[0208] Among them, score11>score12>L>score1n_1. That is, the smaller the change Δα or Δβ of the preview frame FOV angle of two adjacent video frame images before and after the lens switching of the electronic device under test is, the higher the score is, indicating that the zoom smoothness of the electronic device under test is better.

[0209] In this way, the data analysis module can realize horizontal comparison of different electronic devices according to the zoom smoothness scores S1 of different electronic devices. The higher the zoom smoothness score S1, the better the zoom smoothness of the electronic device. For example, if the zoom smoothness score S1 of a certain electronic device is lower than the preset score threshold 1, it indicates that the zoom smoothness of the electronic device is unqualified.

[0210] When the zoom smoothness scores S1 are consistent, the data analysis module can also perform a horizontal comparison of different electronic devices based on the reference point center offset ratio Δ score S_Δ of different electronic devices, or the preview frame FOV angle change Δα score S_Δα (or the preview frame FOV angle change Δβ score S_Δβ). For example, when the zoom smoothness scores S1 are consistent, the data analysis module can also perform a horizontal comparison of different electronic devices based on the reference point center offset ratio Δ score S_Δ of different electronic devices. That is, electronic devices with a higher reference point center offset ratio Δ score S_Δ have better zoom smoothness.

[0211] The technical solution provided in the embodiment of the present application uses objective data (i.e., the reference point center offset ratio Δ and the preview frame FOV angle change Δα or Δβ) to characterize the zoom smoothness of the electronic device, thereby realizing objective detection of the zoom smoothness of the electronic device.

[0212] (II) Testing of zoom and chirality of electronic equipment under test

[0213] Figure 8 The process of testing the electronic device to detect the zoom and chirality of the electronic device under test based on the zoom video data is shown as an example. In this process, the zoom video data refers to the zoom video data collected for an electronic device under test in a lighting environment.

[0214] like Figure 8 As shown, the process of testing the electronic device to detect the zoom and chirality of the electronic device to be tested based on the zoom video data specifically includes the following steps:

[0215] S301, a timing module of a test electronic device obtains zoom video data recorded by a third-party video recording device.

[0216] The zoom recording video data includes a process in which a user performs a zoom operation in a preview interface (eg, a photo preview interface or a video preview interface) of a camera application of the electronic device under test.

[0217] The zoom recording video data may include a process in which a user zooms the electronic device under test by clicking to switch the zoom operation on the preview interface of the electronic device under test, and may also include a process in which a user zooms the electronic device under test by sliding the zoom operation on the preview interface of the electronic device under test, and may also include both a process in which a user zooms the electronic device under test by clicking to switch the zoom operation on the preview interface of the electronic device under test, and a process in which a user zooms the electronic device under test by sliding the zoom operation on the preview interface of the electronic device under test.

[0218] Exemplarily, taking the zoom recorded video data including the process in which the user zooms the electronic device under test by clicking the zoom operation in the preview interface of the electronic device under test as an example, assuming that the click zoom magnification items pre-set in the electronic device under test include 0.5x, 1.0x, 2.0x and 3.0x, then the full-magnification zoom means that when the user performs the click zoom operation in the preview interface of the electronic device under test, the user's zoom operation causes the zoom magnification adjustment of the electronic device under test to involve 0.5x, 1.0x, 2.0x and 3.0x, that is, involving all the pre-set click zoom magnifications.

[0219] Exemplarily, taking the zoom recorded video data including the process of a user zooming the electronic device to be tested through a sliding zoom operation (a single-finger sliding zoom operation or a two-finger sliding zoom operation) in the preview interface of the electronic device to be tested as an example, and the zoom ratio range of the electronic device to be tested is 0.5x to 15.0x as an example, then the full-ratio zoom means that when the user performs the sliding zoom operation in the preview interface of the electronic device to be tested, the user's zoom operation causes the zoom ratio adjustment of the electronic device to be tested to involve any zoom ratio from 0.5x to 15.0x, that is, to involve all zoom ratios of the electronic device to be tested. Of course, when the user performs the sliding zoom operation in the preview interface of the electronic device to be tested, the user's zoom operation can also cause the zoom ratio adjustment of the electronic device to be tested to only involve a part of the zoom ratio range (for example, 0.5x to 6.0x), and the present application is not limited to this, as long as the user's sliding zoom operation can test the zoom and chirality of the electronic device to be tested.

[0220] S302: A timing module of the electronic device under test calculates a click-to-zoom reaction time for each click-to-zoom operation, and sends the click-to-zoom reaction time to a data statistics module of the electronic device under test.

[0221] The click zoom reaction time T0 refers to the time interval from when the user clicks the UI (User Interface) zoom point to when the preview box FOV starts to change.

[0222] For each click zoom operation, the timing module obtains the timestamp t0 when the user's finger touches the UI zoom point and leaves the screen, as well as the timestamp t s .

[0223] In this embodiment, for a user click zoom operation, the click zoom reaction time is: T0 = t s -t0.

[0224] S303, the timing module of the test electronic device calculates the average frame rate of zoom switching each time the zoom operation is clicked, and determines the average frame rate of switching when the electronic device to be tested clicks to zoom, and sends the average frame rate of switching when the electronic device to be tested clicks to the data analysis module of the test electronic device.

[0225] The average frame rate AFR for switching when clicking to zoom refers to the ratio of the number of stable intermediate frames n included in the FOV change animation to the animation duration when the user performs a click-to-zoom operation. The duration of the FOV change animation is the time interval from the start of the preview frame FOV change to the end of the preview frame FOV change and stabilization when the user performs a click-to-zoom operation.

[0226] For each click zoom operation, the timing module obtains the timestamp t0 of the moment when the user's finger touches the UI zoom focus and leaves the screen, and the timestamp t s , the timestamp t when the preview box FOV ends changing and stabilizes f , and timestamp t s With timestamp t f The number of stable intermediate frames n between them.

[0227] The stable intermediate frame can be understood as a video frame that can be fully displayed on the preview interface after the preview frame FOV starts to change and before the preview frame FOV stops changing and stabilizes.

[0228] In this embodiment, for a user click zoom operation, the average frame rate of switching when clicking zoom is:

[0229] AFR=n / (t f -t s ).

[0230] It can be understood that the zoom video data includes multiple click zoom operations of the user on the electronic device to be tested, so the timing module can calculate the switching average frame rates (such as AFR1, AFR2, AFR3, ...) when multiple click zoom operations are performed. Furthermore, the timing module can calculate the switching average frame rate AFR when the electronic device to be tested clicks to zoom based on these multiple switching average frame rates, and send it to the data analysis module.

[0231] Exemplarily, the timing module may process the multiple switching average frame rates (such as AFR1, AFR2, AFR3, ...) in a weighted average manner to obtain the switching average frame rate AFR when the electronic device under test clicks to zoom in the current lighting environment.

[0232] As another example, the data statistics module may also determine the average of the multiple switching average frame rates (such as AFR1, AFR2, AFR3, ...) based on a preset statistical algorithm as the switching average frame rate AFR when the electronic device under test clicks to zoom in the current lighting environment.

[0233] This embodiment does not limit the way in which the timing module calculates the switching average frame rate AFR when the electronic device to be tested clicks to zoom under the current lighting environment based on multiple switching average frame rates (such as AFR1, AFR2, AFR3, ...).

[0234] S304, a timing module of the electronic device under test calculates a sliding zoom reaction time during each sliding zoom operation, and sends the sliding zoom reaction time to a data statistics module of the electronic device under test.

[0235] Slide zoom response time T s , refers to the time interval from when the finger starts sliding on the UI to when the FOV starts changing.

[0236] For each sliding zoom operation, the timing module obtains the timestamp t0′ when the user's finger starts sliding on the UI, and the timestamp t0′ when the preview box FOV starts changing. s ′.

[0237] In this embodiment, for a user sliding zoom operation, the sliding zoom reaction time is: T s =t s ′-t0′.

[0238] S305: The timing module of the electronic device under test calculates the sliding zoom delay time during each sliding zoom operation, and sends the sliding zoom delay time to the data statistics module of the electronic device under test.

[0239] Slide zoom delay time T d , refers to the time interval from when the preview box FOV changes evenly to when the finger stops sliding to when the preview box FOV stops changing and stabilizes.

[0240] Each time the user performs a sliding zoom operation, the user's finger keeps sliding steadily, and the user stops sliding the finger after the preview frame FOV also changes steadily with the sliding of the finger. In this way, the problem of inaccurate statistics of the sliding zoom delay time due to the uneven change of the preview frame FOV can be avoided.

[0241] The timing module obtains the timestamp t0′ when the user's finger starts to slide on the UI and the timestamp t0′ when the preview box FOV starts to change. s ′, the timestamp t1 when the user stops sliding and leaves the UI interface immediately, and the timestamp t2 when the preview box FOV stops changing and stabilizes f ′.

[0242] In this embodiment, for a user sliding zoom operation, the sliding zoom delay time is: T d =t f ′-t1.

[0243] It should be noted that, when detecting the zoom and chirality of an electronic device, the embodiments of the present application may not distinguish between a single-finger sliding zoom operation and a two-finger sliding zoom operation, which are collectively referred to as a sliding zoom operation. The reason is that when a user performs a two-finger sliding zoom operation, one of the fingers may be fixedly pressed on the UI interface, and the zoom of the electronic device to be tested may be triggered only by sliding the other finger. In this case, the two-finger sliding zoom operation may also be understood as a zoom operation with one finger fixed and the other finger sliding.

[0244] This embodiment does not limit the timing sequence of S303 - S305 .

[0245] S306, the data statistics module of the test electronic device generates a zoom-related time box plot according to the click zoom reaction time, the slide zoom response time and the slide zoom delay time, and sends the zoom-related time box plot to the data analysis module of the test electronic device.

[0246] Among them, the zoom-related time box plots may include a click zoom reaction time box plot, a sliding zoom response time box plot, and a sliding zoom delay time box plot.

[0247] The data statistics module can obtain a large number of click zoom reaction times, a large number of sliding zoom response times, and a large number of sliding zoom delay times, and draw a click zoom reaction time box plot based on a large number of click zoom reaction times, a sliding zoom reaction time box plot based on a large number of sliding zoom response times, and a sliding zoom delay time box plot based on a large number of sliding zoom delay times. Among them, the click zoom reaction time box plot can be used to reflect the overall statistical distribution of the click zoom reaction time during multiple click zoom operations, the sliding zoom reaction time box plot can be used to reflect the overall statistical distribution of the sliding zoom reaction time during multiple sliding zoom operations, and the sliding zoom delay time box plot can be used to reflect the overall statistical distribution of the sliding zoom delay time during multiple sliding zoom operations.

[0248] Among them, the shorter the click zoom reaction time of the electronic device under test, the shorter the slide zoom response time, and the shorter the slide zoom delay time, the better the zoom and chirality of the electronic device under test.

[0249] Optionally, the data statistics module of the test electronic device will send to the data analysis module the median click zoom reaction time corresponding to the click zoom reaction time box plot, the median sliding zoom reaction time corresponding to the sliding zoom reaction time box plot, and the median sliding zoom delay time corresponding to the sliding zoom delay time box plot.

[0250] Of course, the data statistics module of the test electronic device can also generate other types of statistical charts based on the click zoom reaction time, the sliding zoom response time and the sliding zoom delay time to reflect the overall statistical distribution of zoom-related time during multiple zoom operations. This embodiment is not limited to this.

[0251] S307, the data analysis module for testing the electronic device analyzes the zoom and chirality of the electronic device to be tested.

[0252] In this embodiment, the data analysis module can analyze the zoom tracking properties of the electronic device under test based on at least one of the median zoom-related time (i.e., click zoom reaction time, slide zoom response time, slide zoom delay time) of the electronic device under test, the zoom-related time box plot, and the average switching frame rate AFR when clicking to zoom.

[0253] The larger the switching average frame rate AFR when clicking zoom, the better the zoom and chirality of the electronic device under test. For example, if the zoom and chirality of the electronic device under test is qualified, the switching average frame rate AFR of the electronic device under test needs to be greater than a threshold value of 3.

[0254] The smaller the median of the zoom-related time, the better the zoom and chirality of the electronic device under test. For example, if the zoom and chirality of the electronic device under test is qualified, the median of the click zoom reaction time must be less than a threshold of 41, the median of the slide zoom reaction time must be less than a threshold of 42, and the median of the slide zoom delay time must be less than a threshold of 43.

[0255] In an example, the data analysis module may analyze the zoom and chirality of the electronic device to be tested based on a zoom-related time box plot of the electronic device to be tested.

[0256] Fig. 9 (1) shows, by way of example, a box plot of the click-to-zoom reaction time of the electronic device A and the electronic device B under test in a certain lighting environment. Fig. 9As shown in (1), the click-to-zoom reaction time of the electronic device A under test is mostly short, while the click-to-zoom reaction time of the electronic device B under test is mostly long, and the median click-to-zoom reaction time of the electronic device A under test is lower than the median click-to-zoom reaction time of the electronic device B under test. Therefore, the data analysis module can analyze the zoom following chirality of the electronic device A under test better than that of the electronic device B under test based on the click-to-zoom reaction time box plot of the electronic device A under test and the electronic device B under test under a certain lighting environment.

[0257] Fig. 9 (2) shows, by way of example, a box plot of the sliding zoom reaction time of the electronic device A and the electronic device B under test in a certain lighting environment. Fig. 9 As shown in (2), the sliding zoom reaction time of the electronic device A under test is mostly short, while the sliding zoom reaction time of the electronic device B under test is mostly long, and the median sliding zoom reaction time of the electronic device A under test is lower than the median sliding zoom reaction time of the electronic device B under test. Therefore, the data analysis module can analyze the zoom following chirality of the electronic device A under test better than that of the electronic device B under test based on the box plot of the sliding zoom reaction time of the electronic device A under test and the electronic device B under test under a certain lighting environment.

[0258] Fig. 9 (3) shows a box diagram of the sliding zoom delay time of the electronic device A and the electronic device B under test in a certain lighting environment. Fig. 9 As shown in (3), the sliding zoom delay time of the electronic device A under test is mostly short, while the sliding zoom delay time of the electronic device B under test is mostly long, and the median sliding zoom delay time of the electronic device A under test is lower than the median sliding zoom delay time of the electronic device B under test. Therefore, the data analysis module can analyze the zoom following chirality of the electronic device A under test better than that of the electronic device B under test based on the box plot of the sliding zoom delay time of the electronic device A under test and the electronic device B under test under a certain lighting environment.

[0259] Combination Fig. 9 In (1), (2), and (3), the data analysis module can analyze and conclude that the zoom and chirality of the electronic device A under test is better than the zoom and chirality of the electronic device B under test under a certain lighting environment.

[0260] In one example, the data analysis module can also calculate the zoom and chirality score S2 of the electronic device under test according to the median click zoom reaction time T1, the median slide zoom reaction time T2, the median slide zoom delay time T3, the average switching frame rate AFR when clicking zoom, and the preset scoring strategy of the electronic device under test:

[0261] S2=w T1·S_T1+w T2 ·S_T2+w T3 ·S_T3+w AFR ·S_AFR.

[0262] Among them, w T1 represents the weight of the median click-to-zoom reaction time T1 of the electronic device under test, w T2 represents the weight of the median sliding zoom reaction time T2 of the electronic device under test, w T3 represents the weight of the median sliding zoom delay time T3 of the electronic device under test, w AFR The weight representing the switching average frame rate AFR when the electronic device under test clicks to zoom.

[0263] Among them, S_T1 represents the score of the median click zoom reaction time T1 of the electronic device under test, S_T2 represents the score of the median slide zoom reaction time T2 of the electronic device under test, S_T3 represents the score of the median slide zoom delay time T3 of the electronic device under test, and S_AFR represents the score of the switching average frame rate AFR when the electronic device under test clicks to zoom.

[0264] Exemplarily, the data analysis module may query the corresponding score S_T1 according to the interval to which the median click-to-zoom reaction time T1 belongs.

[0265] For example, if T1∈(num 30 ,num 31 ], then S_T1=score31; if T1∈(num 31 ,num 32 ], then S_T1=score32;…;If T1∈(num 3(n_3-1) ,num 3n_3 ], then S_T1=score3n_3.

[0266] Among them, score31>score32>L>score3n_3. That is, the smaller the median T1 of the reaction time of clicking zoom of the electronic device under test is, the higher the score is, indicating that the zoom and chirality of the electronic device under test is better.

[0267] Similarly, the data analysis module can query the corresponding score S_T2 according to the interval to which the sliding zoom reaction time median T2 belongs. The smaller the sliding zoom reaction time median T2 of the electronic device under test, the higher the score, indicating that the zoom and chirality of the electronic device under test is better.

[0268] Similarly, the data analysis module can query the corresponding score S_T3 according to the interval to which the median T3 of the sliding zoom delay time belongs. The smaller the median T3 of the sliding zoom delay time of the electronic device to be tested, the higher the score, indicating that the zoom followability of the electronic device to be tested is better.

[0269] Exemplarily, the data analysis module can query the corresponding score S_AFR according to the interval to which the average switching frame rate AFR at the time of click zoom belongs.

[0270] For example, if AFR ∈ (num 40 , num 41 , then S_AFR = score41; if AFR ∈ (num 41 , num 42 , then S_AFR = score42; …; if AFR ∈ (num 4(n_4-1) , num 4n_4 , then S_AFR = score4n_4.

[0271] Among them, score41 < score42 < … < score4n_4. That is, the larger the average switching frame rate AFR at the time of click zoom of the electronic device to be tested, the higher the score, indicating that the zoom followability of the electronic device to be tested is better.

[0272] In this way, the data analysis module can perform a horizontal comparison of different electronic devices according to the zoom followability score S2 of different electronic devices. Among them, the higher the zoom followability score S2, the better the zoom followability of the electronic device. Exemplarily, if the zoom followability score S2 of a certain electronic device is lower than the preset score threshold 2, it indicates that the zoom followability of the electronic device is unqualified.

[0273] In the case where the zoom followability score S2 is the same, the data analysis module can also perform a horizontal comparison of different electronic devices according to at least one of the scores S_AFR of the average switching frame rate AFR, the score S_T1 of the median T1 of the click zoom reaction time, the score S_T2 of the median T2 of the sliding zoom reaction time, and the score S_T3 of the median T3 of the sliding zoom delay time of different electronic devices. For example, in the case where the zoom smoothness score S2 is the same, the data analysis module can also perform a horizontal comparison of different electronic devices according to the score S_AFR of the average switching frame rate AFR of different electronic devices. That is, the electronic device with a higher score S_AFR of the average switching frame rate AFR has better zoom followability.

[0274] The technical solution provided in the embodiment of the present application uses objective data (i.e., the average switching frame rate AFR, the median click zoom reaction time T1, the median sliding zoom reaction time T2, and the median sliding zoom delay time T3) to characterize the zoom and chirality of electronic devices. It has a wider applicability and is simple and convenient to operate, and can achieve objective detection of the zoom and chirality of electronic devices.

[0275] (III) Detection and analysis of the zoom performance (zoom smoothness and zoom tracking) of the electronic device under test

[0276] In combination with the aforementioned detection of zoom smoothness and zoom chirality of the electronic device to be tested, the testing electronic device can perform both zoom smoothness detection and zoom chirality detection on the electronic device to be tested.

[0277] Combination Figure 2 , Figure 3 , Figure 6 and Figure 8 The test electronic device can analyze the reference point center offset ratio Δ and the preview frame FOV angle change Δα or Δβ according to the zoom screen recording video data of the electronic device to be tested in a certain lighting scene, and analyze the switching average frame rate AFR and the median click zoom reaction time T1, the median sliding zoom reaction time T2, and the median sliding zoom delay time T3 according to the zoom video recording video data of the electronic device to be tested in the lighting scene, so as to detect the zoom performance of the electronic device to be tested.

[0278] For details not explained here, please refer to the previous text and I will not repeat them here.

[0279] In one example, the data analysis module can also calculate the zoom performance score S of the electronic device under test according to the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test is zoomed, the preview frame FOV angle change Δα or Δβ of two adjacent video frame images before and after the lens of the electronic device under test is switched, the median of the click zoom reaction time T1, the median of the sliding zoom reaction time T2, the median of the sliding zoom delay time T3, the switching average frame rate AFR when clicking the zoom, and the preset scoring strategy:

[0280] S=w Δ ·S_Δ+w Δα ·S_Δα+w T1 ·S_T1+w T2 ·S_T2+w T3 ·S_T3+w AFR S_AFR, or

[0281] S=w Δ ·S_Δ+w Δβ ·S_Δβ+wT1 ·S_T1+w T2 ·S_T2+w T3 ·S_T3+w AFR ·S_AFR.

[0282] Among them, w Δ The weight of the reference point center offset ratio Δ of two adjacent video frame images before and after zooming of the electronic device under test, w Δα The weight w represents the change Δα of the preview box FOV angle of two adjacent video frames before and after the lens switching of the electronic device under test. Δβ represents the weight of the change Δβ of the preview box FOV angle of two adjacent video frame images before and after the lens switching of the electronic device under test. Δα and w Δβ Equal. T1 represents the weight of the median click-to-zoom reaction time T1 of the electronic device under test, w T2 represents the weight of the median sliding zoom reaction time T2 of the electronic device under test, w T3 represents the weight of the median sliding zoom delay time T3 of the electronic device under test, w AFR The weight representing the switching average frame rate AFR when the electronic device under test clicks to zoom.

[0283] Among them, S_Δ represents the score of the center offset ratio Δ of the reference points of two adjacent video frame images before and after the electronic device under test zooms, S_Δα represents the score of the preview frame FOV angle change Δα of two adjacent video frame images before and after the lens of the electronic device under test switches, and S_Δβ represents the score of the preview frame FOV angle change Δβ of two adjacent video frame images before and after the lens of the electronic device under test switches. S_T1 represents the score of the median T1 of the click zoom reaction time of the electronic device under test, S_T2 represents the score of the median T2 of the sliding zoom reaction time of the electronic device under test, S_T3 represents the score of the median T3 of the sliding zoom delay time of the electronic device under test, and S_AFR represents the score of the switching average frame rate AFR when the electronic device under test clicks to zoom.

[0284] Exemplarily, the data analysis module may query the corresponding score S_Δ according to the interval to which Δ belongs.

[0285] Exemplarily, the data analysis module may also query the corresponding score S_Δα according to the interval to which Δα belongs, or may query the corresponding score S_Δβ according to the interval to which Δβ belongs.

[0286] Exemplarily, the data analysis module can query the corresponding score S_T1 according to the interval to which the median click zoom reaction time T1 belongs, query the corresponding score S_T2 according to the interval to which the median sliding zoom reaction time T2 belongs, and query the corresponding score S_T3 according to the interval to which the median sliding zoom delay time T3 belongs.

[0287] Exemplarily, the data analysis module may query the corresponding score S_AFR according to the interval to which the switching average frame rate AFR when clicking zoom belongs.

[0288] For details not explained here, please refer to the previous text and I will not repeat them here.

[0289] Table 1

[0290]

[0291] Taking the preview frame FOV angle change Δα as the preview frame FOV angle change data as an example, Table 1 exemplarily shows the total zoom performance score S of multiple devices under the same lighting environment, as well as the score of each performance indicator.

[0292] In this way, the data analysis module can realize horizontal comparison of different electronic devices according to the zoom performance scores S of different electronic devices. The higher the zoom performance score S, the better the zoom performance of the electronic device. For example, if the zoom performance score S of an electronic device is lower than the preset score threshold 3, it indicates that the zoom performance of the electronic device is unqualified.

[0293] In the case where the zoom performance scores S are consistent, the data analysis module can also realize horizontal comparison of different electronic devices based on at least one of the scores S_Δ of the center offset ratio Δ of the reference point of different electronic devices, the scores S_Δα of the preview box FOV angle change Δα (or the scores S_Δβ of the preview box FOV angle change Δβ), the scores S_AFR of the switching average frame rate AFR, the scores S_T1 of the median click zoom reaction time T1, the scores S_T2 of the median sliding zoom reaction time T2, and the scores S_T3 of the median sliding zoom delay time T3. For example, in the case where the focus performance scores S are consistent, the data analysis module can also realize horizontal comparison of different electronic devices based on the scores S_AFR of the switching average frame rates AFR of different electronic devices. That is, electronic devices with higher scores S_AFR of the switching average frame rate AFR have better zoom performance.

[0294] This embodiment also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the zoom performance detection method in the above-mentioned embodiment.

[0295] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the zoom performance detection method in the above-mentioned embodiment.

[0296] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory so that the chip executes the zoom performance detection method in the above-mentioned method embodiments.

[0297] Among them, the electronic equipment (such as test electronic equipment, etc.), computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0298] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0299] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0300] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A zoom performance detection method, characterized in that: include: Obtain zoom screen recording video of the electronic device under test; The zoom screen recording video includes a process in which the electronic device under test performs zooming in a preview interface of a camera application program; The zoom screen recording video is intercepted frame by frame to obtain multiple video frame images; Calculate the preview frame field of view FOV of each video frame image; According to the preview frame FOV of each video frame image, determine the preview frame FOV angle change information of the first video frame image and the second video frame image in the multiple video frame images; wherein the first video frame image and the second video frame image are two adjacent frames in the zoom screen recording video, the first video frame image is collected by the first camera of the electronic device to be tested, and the second video frame image is collected by the second camera of the electronic device to be tested, and the first camera and the second camera are different; After obtaining the plurality of video frame images, the method further includes: Calculate the object center offset ratio between every two adjacent video frame images; Determining object center offset ratio information of a third video frame image and a fourth video frame image among the multiple video frame images according to the object center offset ratio of every two adjacent video frame images; the third video frame image and the fourth video frame image are two adjacent frames in the zoom screen recording video, and the third video frame image and the fourth video frame image have different zoom magnifications; The preview frame FOV angle change information and the object center offset ratio information are used together to detect the zoom smoothness of the electronic device to be tested.

2. The method according to claim 1, characterized in that After calculating the preview frame field of view of each video frame image, it also includes: Generate a curve of the change of the preview frame FOV over time; wherein the change curve is used to detect the zoom smoothness of the electronic device to be tested.

3. The method according to claim 1, characterized in that In the zoom screen recording video, the shooting object of the camera application of the electronic device under test is a picture card, and the graphics in the picture card are reference point graphics; After obtaining the plurality of video frame images, the method further includes: Target detection is performed on each video frame image to obtain the pixel coordinates of the center point of the reference point pattern in each video frame image and the pixel side length of the target frame of the reference point pattern.

4. The method according to claim 3, characterized in that The step of calculating the preview box FOV of each video frame image includes: The preview frame field of view of each video frame image in the horizontal direction is calculated based on the following formula: ; ； Alternatively, the preview frame viewing angle of each video frame image in the vertical direction is calculated based on the following formula: ; ； in, length is the pixel length of the video frame image, width is the pixel width of the video frame image, is the pixel side length of the target box of the reference point graphic, is the radius of the reference point graphic in the chart; is the distance between the chart card and the electronic device to be tested.

5. The method according to claim 3, characterized in that: The calculating the center offset ratio of each two adjacent video frame images of the captured objects comprises: The calculation is based on the following formula i The video frame image and the j The object center offset ratio of the video frame image : ； in, length is the pixel length of the video frame image, width is the pixel width of the video frame image, For the i The pixel coordinates of the center point of the reference point graphic in the video frame image, For the i The pixel coordinates of the center point of the reference point graphic in a video frame image.

6. The method according to any one of claims 1 to 5, characterized in that: Also includes: Acquire a zoom video of the electronic device under test; the zoom video includes a process in which a user performs a zoom operation on a preview interface of a camera application of the electronic device under test to zoom the electronic device under test; In the case where the zoom operation includes a click-to-zoom operation, calculating the click-to-zoom reaction time of the electronic device under test each time the user clicks the zoom operation according to the zoom video recording, and determining the switching average frame rate information of the electronic device under test during the click-to-zoom operation; The click-to-zoom reaction time is used to indicate the time interval from when the user clicks the zoom point on the interface to when the preview box FOV starts to change; the switching average frame rate is used to indicate the ratio of the number of frames of the FOV change animation to the duration of the FOV change animation when the user performs a click-to-zoom operation; the click-to-zoom reaction time and the switching average frame rate are used to detect the zoom and chirality of the electronic device under test; In the case where the zoom operation includes a sliding zoom operation, calculating the sliding zoom reaction time and the sliding zoom delay time of the electronic device under test each time the user performs a sliding zoom operation according to the zoom video recording; Among them, the sliding zoom reaction time is used to indicate the time interval from when the user's finger starts to slide on the interface to when the preview frame FOV starts to change; the sliding zoom delay time is used to indicate the time interval from when the user's finger stops sliding to when the preview frame FOV ends changing and stabilizes after the preview frame FOV changes evenly; the sliding zoom reaction time and the sliding zoom delay time are used to detect the zoom tracking property of the electronic device to be tested.

7. The method according to claim 6, characterized in that Also includes: Generate a click-to-zoom reaction time box plot according to the click-to-zoom reaction time of the electronic device under test when the user clicks to zoom each time; Generate a sliding zoom reaction time box plot according to the sliding zoom reaction time of the electronic device under test during each sliding zoom operation by the user; Generate a box plot of the sliding zoom delay time according to the sliding zoom delay time of the electronic device under test during each sliding zoom operation by the user; The click zoom reaction time box plot, the slide zoom reaction time box plot, and the slide zoom delay time box plot are used to detect the zoom and chirality of the electronic device to be tested.

8. The method according to claim 7, characterized in that Also includes: Obtaining a first score corresponding to the preview box FOV angle change information and a first weight corresponding to the first score; Acquire a second score corresponding to the object center offset ratio information and a second weight corresponding to the second score; Acquire a third score corresponding to the switching average frame rate information, and a third weight corresponding to the third score; Determine a median click-to-zoom reaction time based on the click-to-zoom reaction time box plot, and obtain a fourth score corresponding to the median click-to-zoom reaction time, and a fourth weight corresponding to the fourth score; Determine a median sliding zoom reaction time based on the sliding zoom reaction time box plot, and obtain a fifth score corresponding to the median sliding zoom reaction time and a fifth weight corresponding to the fifth score; Determine a median of the sliding zoom delay time based on the sliding zoom delay time box plot, and obtain a sixth score corresponding to the median of the sliding zoom delay time and a sixth weight corresponding to the sixth score; According to the first weight, the second weight, the third weight, the fourth weight, the fifth weight and the sixth weight, the first score, the second score, the third score, the fourth score, the fifth score and the sixth score are weightedly summed to obtain a total score of the zoom performance of the electronic device to be tested.

9. A zoom performance detection device, characterized in that: include: A video frame-by-frame capture module, used to obtain a zoom screen recording video of the electronic device under test, and to perform frame-by-frame capture processing on the zoom screen recording video to obtain a plurality of video frame images; wherein the zoom screen recording video includes a process of zooming of the electronic device under test in the preview interface of the camera application; A data calculation module, used to calculate the preview box FOV of each video frame image; A data statistics module, used to determine the preview frame FOV angle change information of the first video frame image and the second video frame image in the multiple video frame images according to the preview frame FOV of each video frame image; wherein the first video frame image and the second video frame image are two adjacent frames in the zoom screen recording video, the first video frame image is collected by the first camera of the electronic device to be tested, and the second video frame image is collected by the second camera of the electronic device to be tested, and the first camera and the second camera are different; The data calculation module is further used to calculate the center offset ratio of the photographed object between every two adjacent video frame images; The data statistics module is further used to determine the object center offset ratio information of the third video frame image and the fourth video frame image in the multiple video frame images according to the object center offset ratio of each two adjacent video frame images; the third video frame image and the fourth video frame image are two adjacent frame images in the zoom screen recording video, and the zoom magnifications corresponding to the third video frame image and the fourth video frame image are different; The preview frame FOV angle change information and the object center offset ratio information are used together to detect the zoom smoothness of the electronic device to be tested.

10. The device according to claim 9, characterized in that The data statistics module is also used to generate a change curve of the preview frame FOV over time according to the preview frame FOV of each video frame image; wherein the change curve is used to detect the zoom smoothness of the electronic device to be tested.

11. The device according to claim 9 or 10, characterized in that Also includes: A timing module, used for obtaining a zoom video of the electronic device under test; the zoom video includes a process in which a user performs a zoom operation in a preview interface of a camera application of the electronic device under test to zoom the electronic device under test; The timing module is further used to calculate the click-to-zoom reaction time of the electronic device under test each time the user clicks the zoom operation according to the zoom video, and determine the switching average frame rate information of the electronic device under test during the click-to-zoom operation when the zoom operation includes a click-to-zoom operation; The click-to-zoom reaction time is used to indicate the time interval from when the user clicks the zoom point on the interface to when the preview box FOV starts to change; the switching average frame rate is used to indicate the ratio of the number of frames of the FOV change animation to the duration of the FOV change animation when the user performs a click-to-zoom operation; the click-to-zoom reaction time and the switching average frame rate are used to detect the zoom and chirality of the electronic device under test; The timing module is further used to calculate the sliding zoom reaction time and the sliding zoom delay time of the electronic device under test each time the user performs a sliding zoom operation according to the zoom video recording when the zoom operation includes a sliding zoom operation; Among them, the sliding zoom reaction time is used to indicate the time interval from when the user's finger starts to slide on the interface to when the preview frame FOV starts to change; the sliding zoom delay time is used to indicate the time interval from when the user's finger stops sliding to when the preview frame FOV ends changing and stabilizes after the preview frame FOV changes evenly; the sliding zoom reaction time and the sliding zoom delay time are used to detect the zoom tracking property of the electronic device to be tested.

12. The device according to claim 11, characterized in that The data statistics module is further used to generate a click-to-zoom reaction time box plot according to the click-to-zoom reaction time of the electronic device under test when the user clicks to zoom each time; The data statistics module is further used to generate a sliding zoom reaction time box plot according to the sliding zoom reaction time of the electronic device under test during each sliding zoom operation by the user; The data statistics module is further used to generate a box plot of the sliding zoom delay time according to the sliding zoom delay time of the electronic device under test during each sliding zoom operation by the user; The click zoom reaction time box plot, the slide zoom reaction time box plot, and the slide zoom delay time box plot are used to detect the zoom and chirality of the electronic device to be tested.

13. The device according to claim 12, characterized in that Also includes: A data analysis module, used to obtain a first score corresponding to the preview box FOV angle change information, and a first weight corresponding to the first score; The data analysis module is further used to obtain a second score corresponding to the object center offset ratio information and a second weight corresponding to the second score; The data analysis module is further used to obtain a third score corresponding to the switching average frame rate information, and a third weight corresponding to the third score; The data analysis module is further used to determine a median click-to-zoom reaction time based on the click-to-zoom reaction time box plot, and obtain a fourth score corresponding to the median click-to-zoom reaction time, and a fourth weight corresponding to the fourth score; The data analysis module is further used to determine a median sliding zoom reaction time based on the sliding zoom reaction time box plot, and obtain a fifth score corresponding to the median sliding zoom reaction time, and a fifth weight corresponding to the fifth score; The data analysis module is further used to determine a median of the sliding zoom delay time based on the sliding zoom delay time box plot, and obtain a sixth score corresponding to the median of the sliding zoom delay time, and a sixth weight corresponding to the sixth score; The data analysis module is further used to perform weighted summation of the first score, the second score, the third score, the fourth score, the fifth score and the sixth score according to the first weight, the second weight, the third weight, the fourth weight, the fifth weight and the sixth weight to obtain a total score of the zoom performance of the electronic device to be tested.

14. The device according to claim 13, characterized in that The data analysis module is further used to analyze the zoom smoothness of the electronic device to be tested according to the change curve of the preview frame FOV over time; and / or, The data analysis module is further used to analyze the zoom chirality of the electronic device to be tested according to the click zoom reaction time box plot, the slide zoom reaction time box plot, and the slide zoom delay time box plot.

15. An electronic device, characterized in that: include: one or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the zoom performance detection method as described in any one of claims 1-8.

16. A computer-readable storage medium comprising a computer program, characterized in that: When the computer program runs on an electronic device, the electronic device executes the zoom performance detection method as described in any one of claims 1 to 8.

Images