Camera testing system, method, storage medium and electronic device

Abstract

The present disclosure relates to a camera testing system and method, the system comprising a testing device, a display device and a device to be tested, the device to be tested comprising a camera, the testing device being connected to the display device and the device to be tested respectively; the testing device being used to trigger the display device to output a display object; the device to be tested being used to obtain a test video stream by photographing the display object through the camera, and sending the test video stream to the testing device; the testing device being further used to receive the test video stream, and obtain a first time and a second time, and determine a working delay of the camera according to the first time and the second time, the first time including the time when the testing device triggers the display device to output the display object, and the second time including the time when the testing device receives the first frame of the display object when receiving the test video stream.

Description

Technical Field

[0001] The present disclosure relates to the field of camera technology, and in particular, to a camera testing system, method, storage medium and electronic device. Background Art

[0002] With the rapid development of imaging technology, more and more products are equipped with cameras. In order to improve the camera's shooting effect and ensure the product's performance, the camera is usually subjected to time delay measurement.

[0003] In the related art, the camera delay can be measured by pressing a stopwatch. However, this method not only requires manual determination of the shooting time of the camera and the current time when the camera outputs the image, but also requires manual pressing of the stopwatch. Since manual operation may result in visual errors and reaction errors, the accuracy of the measured camera working delay will be low. Summary of the invention

[0004] In order to solve the above problems, the present disclosure provides a camera testing system, method, storage medium and electronic device.

[0005] In a first aspect, the present disclosure provides a camera testing system, the system comprising: a test device, a display device and a device to be tested, the device to be tested comprising a camera, the test device being connected to the display device and the device to be tested, respectively; the test device being used to trigger the display device to output a display object; the device to be tested being used to obtain a test video stream by photographing the display object through the camera, and sending the test video stream to the test device; the test device being further used to receive the test video stream, and obtain a first time and a second time, and determine a working delay of the camera according to the first time and the second time, the first time including the time when the test device triggers the display device to output the display object, and the second time including the time when the test device receives the first frame of the display object when receiving the test video stream.

[0006] Optionally, in the case where the display device includes a light-emitting device, the display object includes light; and the test device is further used to trigger the light-emitting device to emit light according to a target brightness.

[0007] Optionally, the test device includes: a processor and a video receiver, the processor is connected to the display device and the video receiver respectively, and the video receiver is connected to the device under test; the processor is used to trigger the light-emitting device to emit light according to the target brightness; the video receiver is used to receive the test video stream sent by the device under test; the processor is also used to store the first time when triggering the light-emitting device to emit light according to the target brightness, and obtain the first time after receiving the test video stream sent by the device under test, and determine the first frame according to the brightness characteristics of each frame of data in the test video stream, obtain the second time when the first frame is received, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

[0008] Optionally, the processor is further used to binarize the data of the Y channel of each frame of the test video stream to obtain target frame data, obtain brightness characteristics of each target frame data, and determine the first frame according to the brightness characteristics.

[0009] Optionally, in the case where the display device includes a display device, the display object includes a target video stream; the test device is further used to send the target video stream to the display device; and the display device is used to display the target video stream.

[0010] Optionally, the test device includes: a processor, a signal source and a video receiver, the processor is respectively connected to the signal source and the video receiver, the video receiver is connected to the device under test, and the signal source is connected to the display device; the processor is used to output the target video stream through the signal source; the video receiver is used to receive the test video stream sent by the device under test; the processor is also used to store the first time of outputting the first frame of the target video stream when outputting the target video stream, and after receiving the test video stream, obtain the first time, and determine the first frame according to the brightness characteristics of the first frame of the target video stream and the brightness characteristics of each frame of data in the test video stream, obtain the second time of receiving the first frame, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

[0011] Optionally, the test device is also used to obtain the size of the display device, and after receiving the test video stream sent by the device under test, obtain multiple difference frames between every two frames of data in the test video stream, and determine whether the frame rate of the device under test is stable based on image features of the multiple difference frames, wherein the difference frames include difference data between every two frames of data.

[0012] Optionally, when the image feature includes the area of ​​the image region corresponding to the difference frame, the test device is further used to determine that the frame rate of the device under test is stable when the area of ​​each image region corresponding to the difference frame is less than or equal to a preset area threshold; or, when the image feature includes the width of the image region corresponding to the difference frame, the test device is further used to determine that the frame rate of the device under test is stable when the width of each image region corresponding to the difference frame is less than or equal to a preset width threshold.

[0013] Optionally, the device under test is further used to determine the first frame of the display object from the original image data captured by the camera, and to determine the shooting time of the first frame, and to send the shooting time to the test device; the test device is further used to obtain the time difference between the shooting time and the time when the test device triggers the display device to output the display object, and to use the time difference as the working delay of the camera.

[0014] In a second aspect, the present disclosure provides a camera testing method, which is applied to a test device in a camera testing system, wherein the system comprises: the test device, a display device and a device to be tested, wherein the device to be tested comprises a camera, and the test device is connected to the display device and the device to be tested, respectively; the method comprises: triggering the display device to output a display object; receiving the test video stream sent by the device to be tested when the camera shoots the display object to obtain a test video stream; obtaining a first time and a second time, and determining a working delay of the camera according to the first time and the second time, wherein the first time comprises the time when the test device triggers the display device to output the display object, and the second time comprises the time when the test device receives the first frame of the display object when receiving the test video stream.

[0015] Optionally, in the case where the display device includes a light-emitting device, the display object includes light; and triggering the display device to output the display object includes: triggering the light-emitting device to emit light according to a target brightness.

[0016] Optionally, the method also includes: when the light-emitting device is triggered to emit light according to the target brightness, storing the first time; obtaining the first time and the second time, and determining the working delay of the camera based on the first time and the second time includes: obtaining the first time; determining the first frame based on the brightness characteristics of each frame of data in the test video stream; obtaining the second time when the first frame is received; obtaining the time difference between the first time and the second time, and using the time difference as the working delay of the camera.

[0017] Optionally, determining the first frame according to the brightness characteristics of each frame of data in the test video stream includes: binarizing the data of the Y channel of each frame of the test video stream to obtain target frame data; acquiring the brightness characteristics corresponding to each of the target frame data; and determining the first frame according to the brightness characteristics.

[0018] Optionally, when the presentation device includes a display device, the presentation object includes a target video stream; and triggering the presentation device to output the presentation object includes: sending the target video stream to the display device, so that the display device displays the target video stream.

[0019] Optionally, the method also includes: when outputting the target video stream, storing the first time of outputting the first frame of the target video stream; obtaining the first time and the second time, and determining the working delay of the camera based on the first time and the second time includes: obtaining the first time; determining the first frame based on the brightness characteristics of the first frame of the target video stream and the brightness characteristics of each frame of data in the test video stream; obtaining the second time of receiving the first frame; obtaining the time difference between the first time and the second time, and using the time difference as the working delay of the camera.

[0020] Optionally, before sending the target video stream to the display device, the method further includes: obtaining the size of the display device; after receiving the test video stream sent by the device under test, the method further includes: obtaining a plurality of difference frames between every two frames of data in the test video stream; determining whether the frame rate of the device under test is stable based on image features of the plurality of difference frames, wherein the difference frames include difference data between every two frames of data.

[0021] Optionally, in a case where the image feature includes the area of ​​the image region corresponding to the difference frame, determining whether the frame rate of the device under test is stable based on the image features of the multiple difference frames includes: when the area of ​​the image region corresponding to each of the difference frames is less than or equal to a preset area threshold, determining that the frame rate of the device under test is stable; or, in a case where the image feature includes the width of the image region corresponding to the difference frame, determining whether the frame rate of the device under test is stable based on the image features of the multiple difference frames includes: when the width of the image region corresponding to each of the difference frames is less than or equal to a preset width threshold, determining that the frame rate of the device under test is stable.

[0022] Optionally, after triggering the display device to output the display object, the method further includes: after the device under test determines the first frame of the display object from the original image data captured by the camera, and determines the shooting time of capturing the first frame, receiving the shooting time sent by the device under test; obtaining the time difference between the shooting time and the time when the test device triggers the display device to output the display object, and using the time difference as the working delay of the camera.

[0023] In a third aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in the second aspect of the present disclosure.

[0024] In a fourth aspect, the present disclosure provides an electronic device, comprising: a memory on which a computer program is stored; and a processor for executing the computer program in the memory to implement the steps of the method described in the second aspect of the present disclosure.

[0025] Through the above technical solution, a camera test system is provided, the system includes a test device, a display device and a device to be tested, the device to be tested includes a camera, the test device is connected to the display device and the device to be tested respectively; the test device is used to trigger the display device to output a display object; the device to be tested is used to obtain a test video stream by shooting the display object through the camera, and send the test video stream to the test device; the test device is also used to receive the test video stream, and obtain a first time and a second time, and determine the working delay of the camera according to the first time and the second time, the first time includes the time when the test device triggers the display device to output the display object, and the second time includes the time when the test device receives the first frame of the display object when receiving the test video stream. That is to say, the test device can determine the working delay of the camera of the device to be tested according to the first time of triggering the display device to output the display object and the second time of receiving the first frame of the display object sent by the device to be tested, so that the first time and the second time can be directly obtained by the test device, the acquisition method is simple, and the entire test process does not require manual participation, so that the first time and the second time are more accurate, thereby improving the accuracy of the measurement.

[0026] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure but do not constitute a limitation of the present disclosure. In the accompanying drawings:

[0028] Figure 1 is a structural schematic diagram of a camera testing system provided by an embodiment of the present disclosure;

[0029] Figure 2 is a structural schematic diagram of a second camera testing system provided by an embodiment of the present disclosure;

[0030] Figure 3 is a structural schematic diagram of a third camera testing system provided by an embodiment of the present disclosure;

[0031] Figure 4 is a schematic diagram of a physical dimension mark provided by an embodiment of the present disclosure;

[0032] Figure 5 is a schematic diagram of a difference frame provided by an embodiment of the present disclosure;

[0033] Figure 6 A flowchart of a camera testing method provided by an embodiment of the present disclosure;

[0034] Figure 7 A flowchart of a second camera testing method provided by an embodiment of the present disclosure;

[0035] Figure 8 A flowchart of a third camera testing method provided by an embodiment of the present disclosure;

[0036] Fig. 9 It is a block diagram of an electronic device provided by an embodiment of the present disclosure.

[0037] Description of Reference Numerals

[0038] 101 Test Equipment 102 Display Equipment

[0039] 103 Device under test 1011 Processor

[0040] 1012 video receiver 1013 signal source DETAILED DESCRIPTION

[0041] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.

[0042] In the description below, words such as “first” and “second” are only used for the purpose of distinguishing the description and should not be understood as indicating or implying relative importance or order.

[0043] First, the application scenario of the present disclosure is described. The present disclosure can be applied to the scenario of testing the working delay of a camera, which can include a camera in a terminal device or a camera in a drone, and the present disclosure does not limit this. In order to ensure the performance of the product, it is necessary to perform delay measurement on the camera used in the product during the product debugging phase to avoid a poor user experience caused by a long working delay of the camera.

[0044] In the related art, the working delay of the camera to be tested can be obtained manually. For example, the stopwatch can be pressed and the timing can be started at the same time when the camera to be tested is used to shoot. At the same time when the camera to be tested outputs the captured image, the stopwatch can be pressed again to stop the timing. The timing time of the stopwatch is the working delay of the camera to be tested. It is also possible to shoot a clock display interface with the camera to be tested to obtain an image, and when the camera to be tested outputs the image, the current moment presented in the clock display interface and the shooting moment presented in the clock interface in the image can be manually read. The time difference between the current moment and the shooting moment is the working delay of the camera to be tested. However, the above-mentioned method of manually obtaining the working delay of the camera to be tested requires manual determination of whether the camera to be tested outputs an image, and requires manual pressing of the stopwatch or manual reading of the corresponding moment. Due to the errors in human vision and reaction, the above-mentioned method of manually obtaining the working delay of the camera to be tested has a low accuracy. In addition, the manual operation method will also lead to low test efficiency.

[0045] In order to solve the above problems, the present disclosure provides a camera test system, method, storage medium and electronic device. Among them, the test device in the camera test system can determine the working delay of the device under test according to the first time when the display device is triggered to output the display object and the second time when the first frame of the display object sent by the device under test is received, so that the first time and the second time can be directly obtained by the test device, the acquisition method is simple, and the whole process does not require human participation, so that the first time and the second time are more accurate, thereby improving the accuracy of the measurement.

[0046] The present disclosure is described below in conjunction with specific embodiments.

[0047] Figure 1 Schematic diagram of the structure of a camera test system provided by an embodiment of the present disclosure. Figure 1 As shown, the camera test system 100 may include a test device 101, a display device 102 and a device under test 103, the device under test 103 includes a camera, and the test device 101 is connected to the display device 102 and the device under test 103 respectively;

[0048] The test device 101 is used to trigger the display device 102 to output a display object;

[0049] The device under test 103 is used to obtain a test video stream by photographing the display object through the camera, and send the test video stream to the test device 101;

[0050] The test device 101 is also used to receive the test video stream and obtain a first time and a second time, and determine the working delay of the camera according to the first time and the second time. The first time may include the time when the test device 101 triggers the display device 102 to output the display object, and the second time may include the time when the test device 101 receives the first frame of the display object when receiving the test video stream.

[0051] It should be noted that before using the camera test system 100, a corresponding test environment needs to be set up. The present disclosure can determine the corresponding test environment according to the type of the display device 102. For example, when the display device 102 is a light-emitting device, the test environment can be a darkroom environment, so that after the light-emitting device emits light, the brightness change of the test environment is more obvious. In addition, the camera of the device under test 103 can be aimed at the display object output by the display device 102 to ensure that the camera can capture the display object. For example, if the display device 102 is a light-emitting device, the camera can be aimed at the light-emitting device; if the display device 102 is a projector, the camera can be aimed at the area projected by the projector.

[0052] The test device 101 may include a start button, through which the user can start the test device 101. After the test device 101 starts working, the entire camera test system 100 enters a working state. In addition, in order to ensure that the camera of the device under test 103 can capture the moment when the display device 102 outputs the display object, before the test device 101 is started, the device under test 103 may be in a working state, that is, the camera of the device under test 103 is always in a shooting state.

[0053] After receiving the user's trigger operation on the start button, the test device 101 can immediately trigger the display device 102 to output the display object, or trigger the display device 102 to output the display object after a preset time period. The present disclosure does not limit the time point of triggering the display device 102. Among them, the test device 102 can trigger the display device 102 in a variety of ways. For example, the test device 101 can trigger the display device 102 through a pulse signal, or through a level jump, which is not limited in the present disclosure. In addition, the test device 101 can also record the first time when the display device 102 is triggered to output the display object.

[0054] The display device 102 can output the display object after receiving the trigger operation of the test device 101. Since the device under test 103 is always in working state, the camera of the device under test 103 is always shooting the location of the display object, so the camera can shoot the whole process before and after the display device 102 outputs the display object.

[0055] After the test device 101 is started, it can receive the test video stream sent by the device under test 103. Since the test video stream may include the screen before the display device 102 outputs the display object, the first moment of outputting the display object, and the screen after outputting the display object, after receiving the test video stream sent by the device under test 103, the test device 101 needs to determine the time of the first moment of the display device 102 outputting the display object from the test video stream, that is, the second time including the first frame of the display object. After determining the second time, the test device 101 can obtain the first time of triggering the display device 102 to output the display object, and obtain the time difference between the first time and the second time, which is the working delay of the camera of the device under test 103.

[0056] It should be noted that after the camera of the device under test 103 captures the original image data corresponding to the display object, the original image data needs to be encoded, compressed, etc. to obtain the test video stream, and then the test video stream is sent to the test device 101.

[0057] Considering that encoding, compression and other processing require processing time, and that the device under test 103 also needs to spend transmission time to send the test video stream to the test device 101, and the test device 101 ignores the processing time and transmission time when obtaining the second time. Therefore, in order to solve the above problem, the device under test 103 is also used to determine the first frame of the display object from the original image data captured by the camera, and determine the shooting time of the first frame, and send the shooting time to the test device 101; the test device 101 is also used to obtain the time difference between the shooting time and the time when the test device 101 triggers the display device 102 to output the display object, and use the time difference as the working delay of the camera. In this way, after the camera of the device under test 103 obtains the original image data including the first frame of the display object, it can directly obtain the shooting time of the first frame. After that, it only needs to send the shooting time to the test device 101. The test device 101 can directly determine the working delay of the camera of the device under test 103 according to the time difference between the shooting time and the time of outputting the display object. The processing time of the original image and the transmission time of the data are filtered out in the working delay, thereby improving the accuracy of the working delay.

[0058] The camera testing method disclosed in the present invention is described below with reference to some examples.

[0059] Example 1: Take the display device 102 including a light-emitting device as an example.

[0060] In the case where the display device 102 includes a light emitting device, the display object includes light, and the test device 101 is used to trigger the light emitting device to emit light according to a target brightness. The target brightness can be a brightness that is significantly different from the current test environment. In this way, the test device 101 can determine the frame of the display object to be output from the test video stream sent by the device under test 103 according to the change in brightness.

[0061] Figure 2 is a schematic diagram of the structure of the second camera test system provided by the embodiment of the present disclosure. Figure 2 As shown, the test device 101 includes a processor 1011 and a video receiver 1012, the processor 1011 is connected to the display device 102 and the video receiver 1012 respectively, and the video receiver 1012 is connected to the device under test 103;

[0062] The processor 1011 is used to trigger the light emitting device to emit light according to the target brightness;

[0063] The video receiver 1012 is used to receive the test video stream sent by the device under test 103;

[0064] The processor 1011 is also used to store the first time when the light-emitting device is triggered to emit light according to the target brightness, and obtain the first time after receiving the test video stream sent by the device under test 103, and determine the first frame according to the brightness characteristics of each frame of data in the test video stream, obtain the second time when the first frame is received, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

[0065] After receiving the user's start-up instruction, the processor 1011 of the test device 101 can send a trigger signal to the light-emitting device and record the first time of triggering the light-emitting device. After receiving the trigger signal, the light-emitting device can emit light according to the target brightness. If the light-emitting device has been in a light-emitting state before receiving the trigger signal sent by the test device 101, the target brightness can be a brightness that is significantly different from the initial brightness before receiving the trigger signal, for example, the target brightness can be brighter than the initial brightness or darker than the initial brightness; if the light-emitting device has been in a closed state before receiving the trigger signal sent by the test device 101, the target brightness can be a lower brightness, as long as the camera of the device under test 103 captures a large difference between the images before and after the light-emitting device emits light according to the target brightness.

[0066] Since the camera of the device under test 103 needs to capture the picture of the first moment when the light-emitting device emits light according to the target brightness, the test device 101 can control the video receiver 1012 of the test device 101 to receive the test video stream sent by the device under test 103 before sending a trigger signal to the light-emitting device. After receiving the test video stream sent by the device under test 103, the video receiver 1012 of the test device 101 can send the test video stream to the processor 1011 of the test device 101, and the processor 1011 can perform binarization processing on the data of the Y channel of each frame of the test video stream to obtain target frame data, obtain the brightness characteristics of each target frame data, and determine the first frame according to the brightness characteristics.

[0067] Among them, for each frame of data of the test video stream, the processor 1011 can perform binarization processing on the Y channel data of the frame data by the method of the relevant technology, and obtain the sum of the brightness of all pixels. Since in the picture taken by the camera of the device under test 103, the brightness of the picture after the light-emitting device emits light according to the target brightness is different from the brightness of the picture before the light-emitting device emits light according to the target brightness, the first frame can be determined from the test video stream according to the brightness of each frame of data in the test video stream. For example, if the light-emitting device is in a closed state before receiving the trigger signal sent by the test device 101, and emits light according to the target brightness after receiving the trigger signal, then the frame with significantly increased brightness can be determined from the test video stream as the first frame; if the light-emitting device is in a light-emitting state before receiving the trigger signal sent by the test device 101, and is extinguished after receiving the trigger signal, then the frame with significantly reduced brightness can be determined from the test video stream as the first frame.

[0068] In addition, after receiving the test video stream sent by the device under test 103, the test device 101 can obtain the first time of triggering the light-emitting device to emit light according to the target brightness, and after determining the first frame, the second time of receiving the first frame by the test device 101 can be obtained, and the difference between the first time and the second time can be obtained, and the difference can be used as the working delay of the camera of the device under test 103. In this way, the test device 103 can determine the working delay of the device under test 103 by triggering the light-emitting device to emit light, and no manual participation is required during the test process, thereby improving the accuracy of the working delay.

[0069] It should be noted that the light-emitting device may be turned off after outputting the first frame of data of the target video stream, or may remain in a light-emitting state, and the present disclosure does not limit this.

[0070] Example 2: Take the display device 102 as an example.

[0071] In the case where the display device 102 includes a display device, the display object may include a target video stream, and the test device 101 is further used to send the target video stream to the display device, and the display device is used to display the target video stream. The target video stream may be a video stream with a specific mark added, for example, the brightness of the target video stream is higher.

[0072] Figure 3 Schematic diagram of the structure of the third camera test system provided by the embodiment of the present disclosure. Figure 3 As shown, the test device 101 includes: a processor 1011, a signal source 1013 and a video receiver 1012, the processor 1011 is connected to the signal source 1013 and the video receiver 1012 respectively, the video receiver 1012 is connected to the device under test 103, and the signal source 1013 is connected to the display device;

[0073] The processor 1011 is used to output the target video stream through the signal source 1013;

[0074] The video receiver 1012 is used to receive the test video stream sent by the device under test 103;

[0075] The processor 1011 is also used to store the first time of outputting the first frame of the target video stream when outputting the target video stream, and obtain the first time after receiving the test video stream, and determine the first frame according to the brightness characteristics of the first frame of the target video stream and the brightness characteristics of each frame of data in the test video stream, obtain the second time of receiving the first frame, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

[0076] After receiving the user's start-up instruction, the processor 1011 of the test device 101 can send the target video stream to the display device through the signal source 1013, and record the first time of sending the first frame of the target video stream. If the display device does not display the video stream before receiving the target video stream, for example, the display device is in a standby black screen state, then the target video stream can be any video stream, and when the display device displays the target video stream, the brightness of the display screen is significantly increased compared to the standby black screen state; if the display device has displayed the initial video stream before receiving the target video stream, then the target video stream can be a specific video stream, for example, the brightness of the target video stream is significantly different from the brightness of the initial video stream. After receiving the target video stream sent by the processor 1011 through the signal source 1013, the display device can display the target video stream.

[0077] In addition, if the target video stream is any video stream, the camera of the device under test 103 needs to capture the first moment when the display device displays the target video stream. In this way, the device under test 103 can start capturing the display device before the test device 101 sends the target video stream to the display device. Therefore, before the test device 101 sends the target video stream to the display device, the video receiver 1012 of the test device 101 can be controlled to receive the test video stream sent by the device under test 103.

[0078] After receiving the test video stream sent by the device under test 103, the video receiver 1012 of the test device 101 can send the test video stream to the processor 1011 of the test device 101, and the processor 1011 can obtain the first time of outputting the first frame of the target video stream, and obtain the target brightness feature of the first frame data of the target video stream. Afterwards, the processor 1011 can obtain the brightness feature of each frame data in the test video stream, and take the frame in the test video stream whose brightness feature is the same as the target brightness feature as the first frame, and obtain the second time when the video receiver 1012 receives the first frame. The method of obtaining the brightness feature can refer to the method of obtaining the brightness feature in Example 1, which will not be repeated here.

[0079] After the processor 1011 obtains the first time of outputting the first frame of the target video stream and the second time of receiving the first frame, the difference between the first time and the second time can be obtained, and the difference is used as the working delay of the camera of the device under test 103. In this way, the test device 103 does not need to be synchronized with other external devices, and the working delay of the camera of the device under test 103 can be obtained only through the target video stream. The test process is simpler, the operating speed and cost requirements of the test system are lower, and no manual participation is required, and a more accurate working delay can be obtained.

[0080] It should be noted that the test device 101 can also add a specific mark to any frame data of the target video stream. For example, the brightness of the 5th frame data of the target video stream can be set to a larger target brightness value, which is greater than the brightness values ​​of the 4th frame data and the 6th frame data. In this way, the test device 101 can obtain the first time of outputting the 5th frame data. After receiving the test video stream sent by the device under test 103, the target test frame corresponding to the 5th frame data can be determined from the test video stream according to the target brightness value, and the second time of receiving the target test frame can be obtained. The difference between the first time and the second time is obtained, and the difference is used as the working delay of the camera of the device under test 103. In this way, the device under test 103 does not need to be in the working state all the time in order to capture the first frame data of the target video stream. The test device 101 can trigger the device under test 103 to enter the working state after receiving the user's start instruction, thereby reducing the energy consumption of the device under test 103.

[0081] In addition, the display device 102 may include a light-emitting device and a display device, that is, the two methods of Example 1 and Example 2 are superimposed. When the test device 101 outputs the first frame data of the target video stream, it can simultaneously trigger the light-emitting device to emit light according to the target brightness. In this way, the brightness of the first frame data captured by the camera of the device under test 103 can be made more prominent, so that when the test device 101 determines the first frame from the test video stream sent by the device under test 103, there will be no wrong judgment due to the small difference in brightness of each frame data, resulting in inaccurate working delay of the camera of the device under test 103, thereby improving the accuracy of the working delay.

[0082] Based on the method of obtaining the working delay of the camera of the device under test 103 in this example, the test device 101 can also obtain the frame rate stability of the device under test 103. In a possible implementation, the test device 101 is also used to obtain the size of the display device, and after receiving the test video stream sent by the device under test 103, obtain multiple difference frames between every two frames of data in the test video stream, and determine whether the frame rate of the device under test 103 is stable according to the image features of the multiple difference frames, wherein the difference frame includes the difference data between every two frames of data.

[0083] When setting up the test environment, the size of the display device can be pre-stored through configuration information, and the test device 101 can directly obtain it when needed. In the case where the size of the display device cannot be determined, in a possible implementation, the test device 101 can obtain the size of the display device through a physical size mark. Figure 4 is a schematic diagram of a physical dimension mark provided by an embodiment of the present disclosure, such as Figure 4As shown, the physical size mark can be placed above the display device, and the physical size mark can include black grids and white grids, and the sizes of the black grids and the white grids can be preset fixed values. After receiving the test video stream including the physical size mark sent by the device under test 103, the test device 101 can determine the number of the black grids and the white grids from the test video stream, and determine the size of the display device according to the number.

[0084] In another possible implementation, the test device 101 can determine the size of the display device based on the unit width of each frame of data and the number of frames of images that the display device can simultaneously display, and the product of the unit width and the number of frames is the size of the display device.

[0085] After obtaining the size of the display device and receiving the test video stream sent by the device under test 103, the test device 101 can binarize each frame of data in the test video stream to obtain a binarized image corresponding to each frame of data, and then obtain the difference frame between every two frames of data in the test video stream based on the binarized image. For example, if the test video stream includes 5 frames of data, the test device 101 can obtain the difference frame between the first frame of data and the second frame of data, the difference frame between the second frame of data and the third frame of data, the difference frame between the third frame of data and the fourth frame of data, and the difference frame between the fourth frame of data and the fifth frame of data in the test video stream. The difference frame between every two frames of data can be obtained by the XOR method of the relevant technology. Figure 5 is a schematic diagram of a difference frame provided by an embodiment of the present disclosure, such as Figure 5 As shown, the top image represents the binarized image of the first frame data of the test video stream, the middle image represents the binarized image of the second frame data of the test video stream, and the bottom image represents the binarized image of the difference frame data after the XOR operation of the first frame data and the second frame data.

[0086] After acquiring the difference frame between every two frames of data in the test video stream, the test device 101 can determine whether the frame rate of the device under test 103 is stable according to the image features of the difference frame, wherein the image features may include the area and width of the image region.

[0087] In the case where the image feature includes the area of ​​the image region corresponding to the difference frame, the test device 101 is also used to determine the stability of the frame rate of the device under test when the area of ​​the image region corresponding to each difference frame is less than or equal to the preset area threshold. The preset area threshold can be determined according to the requirement of the device under test 103 for frame rate stability. When the frame rate of the device under test 103 is stable, the area of ​​each frame of data output by the device under test 103 should be the same. Based on this, if the device under test 103 has a high requirement for frame rate stability, such as 99%, a smaller preset area threshold can be set, such as 2%; if the device under test 103 has a low requirement for frame rate stability, such as 90%, a larger preset area threshold can be set, such as 5%, and the present disclosure does not limit this.

[0088] After obtaining the area of ​​the image region corresponding to each difference frame, the test device 101 can compare it with the preset area threshold. If the area of ​​the image region corresponding to each difference frame is less than or equal to the preset area threshold, it can be determined that the frame rate of the device under test 103 is stable; if the area of ​​the image region corresponding to some difference frames is greater than the preset area threshold, it is determined that the frame rate of the device under test 103 is unstable. Here, the number of partial difference frames can be determined according to the requirements of the device under test 103 for frame rate stability. If the device under test 103 has a high requirement for frame rate stability, such as 99%, a smaller number, such as 1, can be set; if the device under test 103 has a low requirement for frame rate stability, such as 90%, a larger number, such as 5, can be set, and the present disclosure does not limit this.

[0089] In the case where the image feature includes the width of the image area corresponding to the difference frame, the test device 101 is also used to determine the stability of the frame rate of the device under test when the width of each image area corresponding to the difference frame is less than or equal to the preset width threshold. The preset width threshold can be determined according to the requirement of the device under test 103 for frame rate stability. When the frame rate of the device under test 103 is stable, the width of each frame of data output by the device under test 103 should be the same. Based on this, if the device under test 103 has a high requirement for frame rate stability, such as 99%, a smaller preset width threshold can be set, such as 2%; if the device under test 103 has a low requirement for frame rate stability, such as 90%, a larger preset width threshold can be set, such as 5%, and the present disclosure does not limit this.

[0090] After obtaining the width of the image area corresponding to each difference frame, the test device 101 can compare it with the preset width threshold. If the width of the image area corresponding to each difference frame is less than or equal to the preset width threshold, it is determined that the frame rate of the device under test 103 is stable; if the width of the image area corresponding to some difference frames is greater than the preset width threshold, it is determined that the frame rate of the device under test 103 is unstable. Here, the number of partial difference frames can be determined according to the requirements of the device under test 103 for frame rate stability. If the device under test 103 has a high requirement for frame rate stability, such as 99%, a smaller number, such as 1, can be set; if the device under test 103 has a low requirement for frame rate stability, such as 90%, a larger number, such as 5, can be set, and the present disclosure does not limit this. In this way, the frame rate stability of the device under test 103 can be determined by only obtaining the width of the image area of ​​the difference frame. Compared with determining the stability of the device under test 103 by the area of ​​the image area corresponding to the difference frame, the calculation process is simpler, thereby improving the efficiency of determining the frame rate stability.

[0091] Through the above system, the test device can trigger the display device to output different display objects according to the type of the display device. When the display device is a light-emitting device, the working delay of the camera of the device under test can be determined according to the first time of triggering the light-emitting device to emit light and the second time of receiving the first frame of the display object. When the display device is a display device, the working delay of the camera of the device under test can be determined according to the first time of outputting the first frame of the target video stream and the second time of receiving the first frame of the display object. In this way, there is no need for manual participation in the entire test process, and the test device can automatically obtain the working delay of the camera, thereby improving the accuracy of the working delay and saving labor costs. In addition, the test device can also determine the stability of the frame rate of the device under test based on the image features of the difference frame between every two frames of data in the test video stream, so as to obtain the performance of the device under test more comprehensively.

[0092] Figure 6 A flowchart of a camera testing method provided by an embodiment of the present disclosure is applied to a test device in a camera testing system, the system comprising: the test device, a display device and a device to be tested, the device to be tested comprising a camera, the test device being connected to the display device and the device to be tested respectively; Figure 6 As shown, the method includes:

[0093] S601: Trigger the display device to output a display object.

[0094] S602: When the camera shoots the display object to obtain a test video stream, receive the test video stream sent by the device under test.

[0095] S603: Obtain a first time and a second time, and determine a working delay of the camera according to the first time and the second time.

[0096] The first time may include the time when the test device triggers the display device to output the display object, and the second time may include the time when the test device receives the first frame of the display object when receiving the test video stream.

[0097] It should be noted that after the camera of the device under test captures the original image data corresponding to the display object, the original image data needs to be encoded, compressed, etc. to obtain the test video stream, and then the test video stream is sent to the test device. Since encoding, compression, etc. require processing time, and the device under test also needs transmission time to send the test video stream to the test device, the test device ignores the processing time and transmission time when obtaining the second time.

[0098] In order to solve the above problem, after the display device is triggered to output the display object, the first frame of the display object can be determined from the original image data captured by the camera on the device under test, and after determining the shooting time of the first frame, the shooting time sent by the device under test is received; the time difference between the shooting time and the time when the test device triggers the display device to output the display object is obtained, and the time difference is used as the working delay of the camera. In this way, after the camera of the device under test obtains the original image data including the first frame of the display object, the shooting time of the first frame can be directly obtained, and then the shooting time only needs to be sent to the test device. The test device can directly determine the working delay of the camera of the device under test based on the time difference between the shooting time and the time to output the display object. The working delay filters out the processing time of the original image and the transmission time of the data, thereby improving the accuracy of the working delay.

[0099] By adopting the above method, the test device can determine the working delay of the device under test based on the first time of triggering the display device to output the display object and the second time of receiving the first frame of the display object sent by the device under test. In this way, the first time and the second time can be directly obtained by the test device. The acquisition method is simple and the whole process does not require human intervention, which makes the first time and the second time more accurate, thereby improving the accuracy of the measurement.

[0100] Figure 7 A flowchart of a second camera testing method provided in an embodiment of the present disclosure, the method is applied to a testing device. Figure 7 As shown, the method includes:

[0101] S701: When the display device includes a light-emitting device, trigger the light-emitting device to emit light according to a target brightness, and store a first time when the light-emitting device is triggered to emit light according to the target brightness.

[0102] S702: Obtain the first time.

[0103] S703: Determine the first frame according to the brightness characteristics of each frame of data in the test video stream.

[0104] In this step, after receiving the test video stream sent by the device under test, the test device can binarize the data of the Y channel of each frame of the test video stream to obtain target frame data, obtain the brightness characteristics corresponding to each target frame data, and determine the first frame based on the brightness characteristics.

[0105] Among them, for each frame of data in the test video stream, the test device can binarize the data of the Y channel of the frame data through the method of the relevant technology, and obtain the sum of the brightness of all pixels. Since the brightness of the picture taken by the camera of the device under test after the light-emitting device emits light according to the target brightness is different from the brightness of the picture before the light-emitting device emits light according to the target brightness, the first frame can be determined from the test video stream according to the brightness of each frame of data in the test video stream. For example, if the light-emitting device is in an off state before receiving the trigger signal sent by the test device, and emits light according to the target brightness after receiving the trigger signal, a frame with significantly increased brightness can be determined from the test video stream as the first frame.

[0106] S704: Obtain the second time when the first frame is received.

[0107] S705: Obtain a time difference between the first time and the second time, and use the time difference as a working delay of the camera.

[0108] By adopting the above method, the test equipment can determine the working delay of the camera of the device under test based on the first time when the light-emitting device is triggered to emit light and the second time when the first frame of the display object is received. In this way, no human participation is required during the entire test process, and the test equipment can automatically obtain the working delay of the camera, thereby improving the accuracy of the working delay.

[0109] Figure 8 A flowchart of a third camera testing method provided in an embodiment of the present disclosure, the method is applied to a testing device. Figure 8 As shown, the method includes:

[0110] S801: When the display device includes a display device, the target video stream is sent to the display device, and a first time of outputting a first frame of the target video stream is stored.

[0111] In this step, the test device may send the target video stream to the display device, and the display device may display the target video stream.

[0112] S802: Obtain the first time.

[0113] S803: Determine the first frame according to the brightness characteristics of the first frame of the target video stream and the brightness characteristics of each frame of data in the test video stream.

[0114] In this step, after receiving the test video stream sent by the device under test, the test device can obtain the target brightness feature of the first frame of the target video stream. Afterwards, the test device can obtain the brightness feature of each frame of the test video stream, and take the frame in the test video stream whose brightness feature is the same as the target brightness feature as the first frame. The method for obtaining the brightness feature can refer to Figure 7 The method for obtaining brightness characteristics in the illustrated embodiment will not be described in detail here.

[0115] S804: Obtain the second time when the first frame is received.

[0116] S805: Obtain a time difference between the first time and the second time, and use the time difference as a working delay of the camera.

[0117] It should be noted that the test device can also determine the frame rate stability of the device under test based on the test video stream sent by the device under test. In one possible implementation, the test device can obtain the size of the display device before sending the target video stream to the display device. After receiving the test video stream sent by the device under test, it can obtain multiple difference frames between every two frames of data in the test video stream, and determine whether the frame rate of the device under test is stable based on the image features of the multiple difference frames, wherein the difference frame includes the difference data between every two frames of data. Among them, the method of obtaining the size of the display device has been described in detail in the embodiment corresponding to the test system, and will not be repeated here.

[0118] The image feature may include the area of ​​the image region and the width of the image region. When the image feature includes the area of ​​the image region corresponding to the difference frame, and when the area of ​​each image region corresponding to the difference frame is less than or equal to a preset area threshold, the frame rate of the device under test is determined to be stable; when the image feature includes the width of the image region corresponding to the difference frame, and when the width of each image region corresponding to the difference frame is less than or equal to a preset width threshold, the frame rate of the device under test is determined to be stable.

[0119] By adopting the above method, the test device can determine the working delay of the camera of the device under test according to the first time of outputting the first frame of the target video stream and the second time of receiving the first frame of the display object. In this way, the test device can automatically obtain the working delay of the camera without manual participation in the entire test process, thereby improving the accuracy of the working delay. In addition, the test device can also determine the stability of the frame rate of the device under test according to the image features of the difference frame between every two frames of data in the test video stream, so as to obtain the performance of the device under test more comprehensively.

[0120] Regarding the method in the above embodiment, the specific manner of executing the operation in each step has been described in detail in the embodiment of the system, and will not be elaborated here.

[0121] Fig. 9 is a block diagram of an electronic device 900 provided by an embodiment of the present disclosure. Fig. 9 As shown, the electronic device 900 may include: a processor 901 and a memory 902. The electronic device 900 may also include one or more of a multimedia component 903, an input / output (I / O) interface 904, and a communication component 905.

[0122] The processor 901 is used to control the overall operation of the electronic device 900 to complete all or part of the steps in the above-mentioned camera test method. The memory 902 is used to store various types of data to support the operation of the electronic device 900, and these data may include, for example, instructions for any application or method used to operate on the electronic device 900, and application-related data, such as contact data, sent and received messages, pictures, audio, video, etc. The memory 902 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, referred to as EPROM), programmable read-only memory (Programmable Read-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, magnetic disk or optical disk. The multimedia component 903 may include a screen and an audio component. The screen may be, for example, a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in the memory 902 or sent through the communication component 905. The audio component also includes at least one speaker for outputting audio signals. The I / O interface 904 provides an interface between the processor 901 and other interface modules, and the other interface modules may be keyboards, mice, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 905 is used for wired or wireless communication between the electronic device 900 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, is not limited here. Therefore, the corresponding communication component 905 may include: Wi-Fi module, Bluetooth module, NFC module, etc.

[0123] In an exemplary embodiment, the electronic device 900 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to execute the above-mentioned camera testing method.

[0124] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, and when the program instructions are executed by a processor, the steps of the above-mentioned camera test method are implemented. For example, the computer-readable storage medium can be the above-mentioned memory 902 including program instructions, and the above-mentioned program instructions can be executed by the processor 901 of the electronic device 900 to complete the above-mentioned camera test method.

[0125] In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program that can be executed by a programmable device. The computer program has a code portion for executing the above-mentioned camera test method when executed by the programmable device.

[0126] The preferred embodiments of the present disclosure are described in detail above in conjunction with the accompanying drawings. However, the present disclosure is not limited to the specific details in the above embodiments. Within the technical concept of the present disclosure, the technical solution of the present disclosure can be subjected to a variety of simple modifications, and these simple modifications all belong to the protection scope of the present disclosure. It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present disclosure will not further describe various possible combinations.

[0127] In addition, various embodiments of the present disclosure may be arbitrarily combined, and as long as they do not violate the concept of the present disclosure, they should also be regarded as the contents disclosed by the present disclosure.

Claims

1. A camera testing system, characterized in that: The system comprises: a test device, a display device and a device to be tested, wherein the device to be tested comprises a camera, and the test device is connected to the display device and the device to be tested respectively; The testing device is used to trigger the display device to output the display object; The device under test is used to obtain a test video stream by photographing the display object through the camera, and send the test video stream to the test device; The test device is also used to receive the test video stream and obtain a first time and a second time, and determine the working delay of the camera based on the first time and the second time, wherein the first time includes the time when the test device triggers the display device to output the display object, and the second time includes the time when the test device receives the first frame of the display object when receiving the test video stream.

2. The system according to claim 1, characterized in that In the case where the display device comprises a light emitting device, the display object comprises light; The testing device is also used to trigger the light-emitting device to emit light according to the target brightness.

3. The system according to claim 2, characterized in that The test device comprises: a processor and a video receiver, wherein the processor is connected to the display device and the video receiver respectively, and the video receiver is connected to the device under test; The processor is used to trigger the light-emitting device to emit light according to the target brightness; The video receiver is used to receive the test video stream sent by the device under test; The processor is also used to store the first time when triggering the light-emitting device to emit light according to the target brightness, and obtain the first time after receiving the test video stream sent by the device under test, and determine the first frame according to the brightness characteristics of each frame of data in the test video stream, obtain the second time when the first frame is received, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

4. The system according to claim 3, characterized in that The processor is also used to perform binarization processing on the data of the Y channel of each frame of the test video stream to obtain target frame data, obtain the brightness characteristics of each target frame data, and determine the first frame according to the brightness characteristics.

5. The system according to claim 1, characterized in that In the case where the presentation device includes a display device, the presentation object includes a target video stream; The test device is further used to send the target video stream to the display device; The display device is used to display the target video stream.

6. The system according to claim 5, characterized in that The test device comprises: a processor, a signal source and a video receiver, the processor is connected to the signal source and the video receiver respectively, the video receiver is connected to the device under test, and the signal source is connected to the display device; The processor is used to output the target video stream through the signal source; The video receiver is used to receive the test video stream sent by the device under test; The processor is also used to store the first time of outputting the first frame of the target video stream when outputting the target video stream, and obtain the first time after receiving the test video stream, and determine the first frame according to the brightness characteristics of the first frame of the target video stream and the brightness characteristics of each frame of data in the test video stream, obtain the second time of receiving the first frame, and obtain the time difference between the first time and the second time, and use the time difference as the working delay of the camera.

7. The system according to claim 5, characterized in that The test device is also used to obtain the size of the display device, and after receiving the test video stream sent by the device under test, obtain multiple difference frames between every two frames of data in the test video stream, and determine whether the frame rate of the device under test is stable based on image features of the multiple difference frames, wherein the difference frames include difference data between every two frames of data.

8. The system according to claim 7, characterized in that In the case where the image feature includes the area of ​​the image region corresponding to the difference frame, the test device is further used to determine that the frame rate of the device under test is stable when the area of ​​the image region corresponding to each difference frame is less than or equal to a preset area threshold; or In the case where the image feature includes the width of the image area corresponding to the difference frame, the test device is further used to determine that the frame rate of the device under test is stable when the width of each image area corresponding to the difference frame is less than or equal to a preset width threshold.

9. The system according to claim 1, characterized in that The device under test is further used to determine the first frame of the display object from the original image data captured by the camera, determine the shooting time of the first frame, and send the shooting time to the test device; The test device is further used to obtain the time difference between the shooting time and the time when the test device triggers the display device to output the display object, and use the time difference as the working delay of the camera.

10. A camera testing method, characterized in that: A test device applied to a camera test system, the system comprising: the test device, a display device and a device to be tested, the device to be tested comprising a camera, the test device being connected to the display device and the device to be tested respectively; the method comprising: Triggering the display device to output a display object; When the camera captures the display object to obtain a test video stream, receiving the test video stream sent by the device under test; Obtain a first time and a second time, and determine the working delay of the camera according to the first time and the second time, the first time includes the time when the test device triggers the display device to output the display object, and the second time includes the time when the test device receives the first frame of the display object when receiving the test video stream.

11. The method according to claim 10, characterized in that In the case where the display device includes a light emitting device, the display object includes light; and triggering the display device to output the display object includes: The light emitting device is triggered to emit light according to a target brightness.

12. The method according to claim 11, characterized in that The method further comprises: When the light-emitting device is triggered to emit light according to the target brightness, storing the first time; The acquiring the first time and the second time, and determining the working delay of the camera according to the first time and the second time comprises: Obtaining the first time; Determining the first frame according to the brightness characteristics of each frame of data in the test video stream; Acquire the second time when the first frame is received; Obtain a time difference between the first time and the second time, and use the time difference as a working delay of the camera.

13. The method according to claim 10, characterized in that In the case where the presentation device includes a display device, the presentation object includes a target video stream; and triggering the presentation device to output the presentation object includes: The target video stream is sent to the display device so that the display device displays the target video stream.

14. The method according to claim 13, characterized in that Before sending the target video stream to the display device, the method further includes: Obtaining the size of the display device; After receiving the test video stream sent by the device under test, the method further includes: Acquire a plurality of difference frames between every two frames of data in the test video stream; Whether the frame rate of the device under test is stable is determined according to the image features of the plurality of difference frames, wherein the difference frames include difference data between every two frames of data.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 10 to 14 are implemented.

16. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 10 to 14.

Images