Delay time detection method and system and time measurement target plate

Abstract

The invention relates to a delay time detection method and system and a time measurement target plate. The time measurement target plate comprises: a light source device; the light source device is provided with a light source area and an identification area; a plurality of light source assemblies are arranged in the light source area according to a preset arrangement rule; a light source identifier matched with the position of each light source assembly is arranged in the identification area; when the time measurement target plate operates, the plurality of light source assemblies of the light source device are lightened at a preset frequency. By adopting the time measurement target plate, the accuracy of the VST time delay obtained by testing can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of delay detection, and in particular to a delay time detection method, system and time measurement target plate. Background Art

[0002] Virtual reality head mounted display device, referred to as VR headset, its display principle is that the two screens corresponding to the left and right eyes of the VR headset display the images of the left and right eyes respectively, and the human eye obtains this information with differences and produces a three-dimensional sense in the mind. Video See-through (VST) technology, that is, video perspective technology, is a technology that captures images of the real world through a camera and integrates them into a virtual scene in real time. It is one of the key technologies in the fields of virtual reality (VR), augmented reality (AR), extended reality (XR) and mixed reality (MR).

[0003] VST technology is implemented through VR headsets, that is, the VST mode of VR headsets. This mode uses the camera of the VR headset to capture real-time video images, combines the real-time video images with computer-generated images, and presents them to the user on the display screen of the VR headset. The data processing used in its implementation includes real-time video capture, image processing, scene reconstruction, and rendering display. The processing process is relatively complex, so it will bring VST delay to the VST mode of the VR headset, thereby affecting the user experience. By accurately measuring the VST delay of the VR headset, it can provide a data support basis for optimizing delays and improving user experience.

[0004] In traditional technology, the image displayed on the display screen of the VR headset is captured by a detection camera, the coordinates of the light source component in the image are determined based on the captured image, and then the VST delay is determined based on the coordinates of the light source component. However, when the display screen of the VR headset displays the image, the image is jittery and distorted. The jitter and distortion of the image will lead to inaccurate coordinate recognition of the light source component, which will further lead to inaccurate VST delay. Summary of the invention

[0005] Based on this, it is necessary to provide a delay time detection method, system and time measurement target board that can improve the accuracy of the VST delay obtained by the test in order to solve the above technical problems.

[0006] In a first aspect, the present application provides a time measurement target plate, the time measurement target plate comprising: a light source device; The light source device is provided with a light source area and a marking area; A plurality of light source components are arranged in a preset arrangement rule in the light source area; a light source identification matching the position of each light source component is arranged in the identification area; When the time measurement target plate is in operation, the plurality of light source components of the light source device are lit at a preset frequency.

[0007] In one of the embodiments, the time measurement target plate further comprises: a time synchronization device; The time synchronization device is connected to the light source device and the external device to achieve clock synchronization between the light source device and the external device.

[0008] In one embodiment, a plurality of light source assemblies are arranged in a linear arrangement or an array arrangement.

[0009] In one of the embodiments, the light source identification is generated based on a position identification and a serial number identification code of the light source assembly at a corresponding position.

[0010] In one embodiment, the light source identifier includes a QR code identifier.

[0011] In a second aspect, the present application further provides a delay time detection system for realizing delay detection of an imaging device to be tested, the delay time detection system comprising: the time measurement target plate, the image acquisition device, the photoelectric detection device and the processor as described above; The time synchronization device and the image acquisition device are respectively connected to the processor; the light source device, the image acquisition device and the photoelectric detection device are respectively connected to the time synchronization device; The imaging device to be tested is arranged between the time measurement target plate and the image acquisition device, and is used to acquire the image of the light source device and display it on the display component of the imaging device to be tested; The image acquisition device is used to acquire a display image of a display component of the imaging device to be tested, and transmit the display image to a processor; The photoelectric detection device is arranged in front of the display component of the imaging device to be tested, and is used to detect the refresh of the display component; The processor is used to control the light source device to operate at a preset frequency; The time synchronization device is used to receive the acquisition instruction of the processor, start to collect the signal of the photoelectric detection device at a preset time, record the effective signal time and synchronously trigger the image acquisition device to collect the display image of the imaging device to be tested; The processor is further used to receive the display image captured by the image acquisition device, and determine the photon capture time of the imaging device to be tested based on the display image; and determine the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time.

[0012] In a third aspect, the present application further provides a delay time detection method, which is applied to the delay time detection system as described above, and the method includes: Controlling the light source device to operate at a preset frequency so that the imaging device to be tested collects an image of the light source device and displays it on a display component of the imaging device to be tested; Start collecting signals from the photoelectric detection device at a preset time, record the effective signal time and synchronously trigger the image acquisition device to collect the display image of the imaging device to be tested; receiving the display image acquired by the image acquisition device, and determining the photon capture moment of the imaging device to be tested based on the display image; The VST delay of the imaging device to be tested is determined according to the effective signal time and the photon capture time.

[0013] In one embodiment, the receiving the display image acquired by the image acquisition device and determining the photon capture moment of the imaging device to be tested based on the display image comprises: According to the displayed image, identifying all light source identifiers in the displayed image; Determining all light source component areas in the display image according to all the light source identifiers; Determine a first serial number identification of a first target light source assembly according to all the light source assembly areas; The photon capture moment of the imaging device to be tested is determined according to the first serial number identifier and the preset frequency of the light source device.

[0014] In one embodiment, determining all light source component areas in the displayed image according to all the light source identifiers includes: According to all the light source identifiers, determining the position identifiers and the serial number identifiers corresponding to all the light source identifiers; According to all the position identifiers and the serial number identifiers, all the light source component areas in the display image and the serial number identifier corresponding to each light source component area are determined.

[0015] In one embodiment, determining the first serial number identification of the first target light source assembly according to all the light source assembly regions includes: Traversing all the light source component areas to perform lighting component area detection, and determining a plurality of lighting component areas and a serial number identification corresponding to each lighting component area; The smallest serial number identifier corresponding to the plurality of lighting component areas is used as the first serial number identifier of the first target light source component.

[0016] In one embodiment, determining the first serial number identification of the first target light source assembly according to all the light source assembly regions includes: According to the serial number identification corresponding to each light source component area, starting from the first light source component area and moving in the direction of increasing serial number identification, the lighting component area detection is performed; The serial number identifier corresponding to the first detected lit component area is used as the first serial number identifier of the first target light source component.

[0017] In one embodiment, determining the first serial number identification of the first target light source assembly according to all the light source assembly regions includes: Dividing all the light source assembly areas into a plurality of light source groups according to a preset number; Performing lighting component area detection on the first light source component area in each of the light source groups to determine a first target lighting component area; Taking the first target lighting component area as the starting position, performing lighting component area detection in the direction of decreasing serial number identifiers; The serial number identifier corresponding to the last detected lit component area is used as the first serial number identifier of the first target light source component.

[0018] In one of the embodiments, after determining all light source component areas in the display image according to all the light source identifiers, the method further includes: Determine a second serial number identification of a second target light source assembly according to all the light source assembly areas; The exposure duration of the imaging device to be tested is determined according to the first serial number identifier, the second serial number identifier and a preset frequency of the light source device.

[0019] In one embodiment, determining the second serial number identification of the second target light source assembly according to all the light source assembly regions includes: Traversing all the light source component areas to perform lighting component area detection, and determining a plurality of lighting component areas and a serial number identification corresponding to each lighting component area; The largest serial number identifier corresponding to the plurality of lighting component areas is used as the second serial number identifier of the second target light source component.

[0020] In one embodiment, determining the second serial number identification of the second target light source assembly according to all the light source assembly regions includes: According to the serial number identification corresponding to each light source component area, starting from the last light source component area as the starting position and moving in the direction of decreasing serial number identification, the lighting component area is detected; The serial number identification corresponding to the first detected lit component area is used as the second serial number identification of the second target light source component.

[0021] In one embodiment, determining the second serial number identification of the second target light source assembly according to all the light source assembly regions includes: Dividing all the light source assembly areas into a plurality of light source groups according to a preset number; Performing a lighting component area detection on the first light source component area in each of the light source groups to determine a second target lighting component area; Taking the second target lighting component area as the starting position, performing lighting component area detection in the direction of increasing serial number identifiers; The serial number identifier corresponding to the last detected lit component area is used as the second serial number identifier of the second target light source component.

[0022] In one embodiment, determining the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time includes: The VST delay of the imaging device to be tested is determined according to the effective signal time, the photon capture time and the exposure time.

[0023] The above-mentioned delay time detection method, system and time measurement mark, the time measurement mark comprises: a light source device; the light source device is provided with a light source area and an identification area; a plurality of light source components are arranged in a preset arrangement rule in the light source area; a light source identification matching the position of each light source component is provided in the identification area; when the time measurement mark is in operation, the plurality of light source components of the light source device are lit at a preset frequency. The light source identification is used to identify the light source component, and the first LED lamp bead in the light source image that is in a lit state can be located and identified through the light source identification, thereby calculating the VST delay, thereby avoiding the inaccuracy of the detected VST delay caused by the jitter and distortion of the image, thereby improving the accuracy of the detected VST delay. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of a region in which an LED lamp bead is in a lit state in an image in one embodiment; Figure 2a A schematic diagram of an arrangement of LED lamp beads in one embodiment; Figure 2b A schematic diagram of the position of the first LED lamp bead in a lit state in an image in a detection round in an embodiment; Figure 2c A schematic diagram of the position of the first LED lamp bead in a lit state in an image in another detection round in one embodiment; Figure 2dA schematic diagram of the position of the first LED lamp bead in a lit state in an image in another detection round in an embodiment; Figure 3 A schematic diagram of the structure of a time measurement target plate in an embodiment; Figure 4a is a schematic diagram of the application process of Mark in one embodiment; Figure 4b A schematic diagram of selecting a light source area in an image in one embodiment; Figure 5 is a schematic flow chart of a delay time detection method in one embodiment; Figure 6 A schematic diagram of the structure of a delay time detection system in one embodiment; Figure 7 A schematic diagram of an image captured by a detection camera in one embodiment; Figure 8 FIG. 4 is a flow chart of a delay time detection method in another embodiment. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0026] As mentioned in the background technology, the image presented on the display screen of the VR headset is captured by a detection camera, the coordinates of the light source component in the image are determined based on the captured image, and then the VST delay is determined based on the coordinates of the light source component. However, when the display screen of the VR headset displays the image, the image is jittery and distorted. The jitter and distortion of the image will lead to inaccurate coordinate recognition of the light source component, which will further lead to inaccurate VST delay.

[0027] In traditional technology, the VST delay is detected by a delay time detection system, which includes at least a light source and a detection camera, and the detection camera is used to capture the image presented on the display screen of the VR headset, and the image includes a complete light source image. Among them, the light source includes a number of LED lamp beads, and the LED lamp beads have a specific arrangement (such as arranging in a row), lighting frequency and brightness, so as to achieve the effect of a "marquee", and only one LED lamp bead is lit at the same time.

[0028] By locating and identifying the first LED lamp bead in the light source image that is in the lit state, that is, after determining the coordinate information of the first LED lamp bead in the lit state, the LED lamp bead can be identified by the coordinate information, thereby calculating the VST delay.

[0029] Among them, when conducting multiple rounds of tests on the same VR headset and locating the first LED lamp bead that is in the lit state in the image, the applicant found that for the same VR headset, the VST delay should be fixed or fluctuate within a very small range, but the results of each round of tests fluctuate over a large range.

[0030] After conducting an in-depth study on the reasons for the large fluctuations, the applicant found that due to the existence of image jitter and distortion, when locating the first LED bead in the image that was in the lit state based on the coordinate information, there were large differences in the coordinate information of each round of testing. Among them, jitter refers to the phenomenon that the displayed image shakes due to untimely rendering, loss of depth information, etc. when the VR headset processes the image; distortion refers to the deformation of the image caused by the refraction and reflection of light on the optical design (such as the lens, camera sensor) during the optical imaging process, as well as defects in the internal imaging system or installation errors, such as the image presenting a barrel or pillow shape.

[0031] That is, the detection principle of the above delay time detection system is: assuming that each LED lamp bead in the light source has a fixed position in the image captured by the detection camera, the fixed position is used to locate and identify the first LED lamp bead in the image that is in the lighting state, so as to determine the VST delay. However, due to the influence of jitter and distortion, the position of each LED lamp bead in the image will change.

[0032] That is, there is a deviation between the position of the LED lamp bead in the actual captured image and the assumed position of the LED lamp bead, resulting in a deviation when the LED lamp bead in the actual captured image is positioned and identified through coordinate information. For example, the position with coordinates (40,0) in the actual captured image corresponds to LED lamp bead a, but according to the above-mentioned assumed positions of each LED lamp bead, the position with coordinates (40,0) should correspond to LED lamp bead b. Therefore, the LED lamp bead is incorrectly identified due to distortion, which ultimately leads to VST delay calculation errors.

[0033] Among them, coordinates refer to the coordinates of pixels in the image, that is, it is assumed that the pixels corresponding to each LED bead in the image captured by the detection camera are known. For example, if pixel 1 corresponds to LED bead a, and pixel 2 corresponds to LED bead b, then after the detection camera actually captures the image, the pixel value can be used to locate the area where the first LED bead in the lit state is located. Accordingly, there is a fixed spacing between each LED bead, which is reflected in the image as a fixed number of pixels. For example, there are 10 pixels between two LED beads.

[0034] The principle of positioning by pixel value is as follows: in the image, there is an obvious "boundary" between the area corresponding to the LED lamp bead being off and the area corresponding to the LED lamp bead being on, that is, there is a position where the pixel value changes dramatically between the two areas. By identifying this position, the first LED lamp bead in the on state can be positioned. A dramatic change in pixel value means that the difference between the pixel values ​​of two adjacent pixels is greater than a preset value, or the difference between the average pixel values ​​of two adjacent pixel areas is greater than a preset value. A pixel area includes two or more pixels.

[0035] like Figure 1 As shown in the figure, the ROI black area refers to the area where the LED lamp beads are in the lit state in the image captured by the detection camera. Since the detection camera has an exposure time, this area generally includes multiple LED lamp beads. For example, if the exposure time is 10ms, the lighting frequency of the light source is 1000Hz, that is, one LED lamp bead is lit every 1ms, then the number of LED lamp beads in the lit state in the image is 10. Among them, point P is the coordinate of the first LED lamp bead in the image that is in the lit state, that is, the position where the left and right pixel values ​​change dramatically, and the movement direction of the "marquee" is from left to right.

[0036] like Figure 2a As shown, the light source has n LED lamp beads. Figure 2a It is assumed that each LED lamp bead has a fixed position in the image captured by the detection camera. Figure 2a In the figure, the distance between LED bead Xa and the leftmost LED bead is 300 pixels, representing a delay range of [0ms-30ms), and the distance between LED bead Xa and LED bead Xb is 100 pixels, representing a delay range of [30ms-40ms).

[0037] like Figure 2b , Figure 2c and Figure 2d As shown, point P1, point P2 and point P3 are the positions of the first LED bead in the lit state in the images obtained from different rounds of tests. It can be understood that from the above VST delay calculation principle, due to the different positions, the VST delay obtained from each round of testing will also be different, resulting in errors in the detected VST delay, which makes the detected VST delay inaccurate.

[0038] In order to solve the problem that the detected VST delay is not accurate enough, in an exemplary embodiment, as shown in FIG. Figure 3As shown, a time measurement mark is provided, and the time measurement mark includes: a light source device; the light source device is provided with a light source area and an identification area; a plurality of light source components are arranged in a preset arrangement rule in the light source area; a light source identification matching the position of each light source component is provided in the identification area; when the time measurement mark is in operation, the plurality of light source components of the light source device are lit at a preset frequency, and as a preferred solution, the light source components are lit in sequence at the preset frequency. The light source identification is used to identify the light source component, and the first LED lamp bead in the light source image that is in a lit state can be located and identified through the light source identification, thereby calculating the VST delay, thereby avoiding the inaccuracy of the detected VST delay caused by the jitter and distortion of the image, thereby improving the accuracy of the detected VST delay.

[0039] The light source device includes a plurality of light source components and a light source driving component. The light source component can be an LED lamp bead or any object that can emit light.

[0040] The following is an example of LED lamp beads as the light source component. Figure 3 As shown, a light source device is provided.

[0041] The preset arrangement rule may include a linear arrangement and an array arrangement. The linear arrangement means that all light source components are arranged in a row. For example, the light source identifiers may also be arranged in a row. For example, the light source components and the light source identifiers are interlaced to form a row. The interlaced arrangement method can be referred to in Figure 3 ; Array arrangement can be found in Figure 3 .

[0042] The light source mark (Mark) can be a symbol mark that can record information, such as a QR code mark, a bar code mark, etc., and is used to record the serial number mark and the position mark of each LED lamp bead. It can be understood that the symbol mark is generated based on the serial number mark and the position mark code.

[0043] The serial number identification refers to the number (ID) of each LED lamp bead. Taking 100 LED lamp beads as an example, the serial number identification of each LED lamp bead can be 1-100 in sequence.

[0044] The position mark includes the distance between the light source assembly and the corresponding light source mark and the corner point information. For example, if the Mark is set in a square shape, the corner point information is the coordinate information of the four corners of the square. The Mark can also be set in other shapes, such as a circle, a rectangle, etc.

[0045] The position of the Mark is not limited in this embodiment, and the information recorded in the Mark can be uniquely corresponding to an LED lamp bead. For example, the light source device 110 includes 100 LED lamp beads, each LED lamp bead corresponds to a Mark, and the Mark can be set at Figure 3 The right side of the LED lamp bead is shown.

[0046] Among them, the preset frequency (i.e., the lighting frequency) will be explained below and will not be repeated here.

[0047] For example, Figure 4a and Figure 4b As shown, when the Mark is used, it can be used to identify the LED lamp beads and select the area where the corresponding LED lamp beads are located in the image. Among them, point P1~point P4 are points corresponding to the corner point information. The Mark provides the serial number of the LED lamp bead, the corner point information and the distance moved to the left. The corner point information and the distance are used in combination to determine the position of the area where the corresponding LED lamp bead is located, and select the area where the corresponding LED lamp bead is located.

[0048] Among them, the area where the corresponding LED lamp beads are located is the ROI area, and then the pixel value in the area can be obtained according to the ROI detection algorithm. The pixel value is used to determine whether the LED lamp beads in the area are in a lit state or an off state.

[0049] Based on the same inventive concept, the embodiment of the present application also provides a delay time detection method, which is applied to a delay time detection system, such as Figure 5 As shown, the method controls the light source device to run at a preset frequency so that the imaging device to be tested collects the image of the light source device and displays it on the display component of the imaging device to be tested; starts collecting the signal of the photoelectric detection device at a preset time, records the effective signal time and synchronously triggers the image acquisition device to collect the display image of the imaging device to be tested; receives the display image collected by the image acquisition device, and determines the photon capture time of the imaging device to be tested based on the display image; determines the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time. In this embodiment, the photon capture time is based on each light source mark in the time measurement mark plate to locate and identify the light source component, thereby avoiding positioning through pixels in the image for identification, and further avoiding the influence of distortion on the positioning process. This positioning method improves the accuracy of determining the photon capture time, making the VST delay obtained by the test more accurate.

[0050] For the delay time detection system, the system is used to realize the delay detection of the imaging device to be tested, such as Figure 6As shown, the system includes: the time measurement target plate 100 as described above, an image acquisition device 200, a photoelectric detection device 300 and a processor 400.

[0051] The time measurement target plate 100 may include a light source device 110 , and may also include the light source device 110 and a time synchronization device 120 .

[0052] In one embodiment, when the time measurement target 100 includes the light source device 110 , the time synchronization device 120 may be implemented by the processor 400 .

[0053] In another embodiment, when the time measurement target plate 100 includes a light source device 110 and a time synchronization device 120, the time synchronization device 120 is connected to the light source device 110 and other devices in the system except the time measurement target plate 100, so as to ensure that multiple light source components of the light source device are lit in sequence at a preset frequency; and to ensure and control the clock synchronization of the light source device and other devices, so as to achieve the purpose of sharing one clock source for the entire system.

[0054] The following is an example of a time measurement target plate 100 including a light source device 110 and a time synchronization device 120. The time synchronization device 120 and the image acquisition device 200 are respectively connected to the processor 400 ; the light source device 110 , the image acquisition device 200 and the photoelectric detection device 300 are respectively connected to the time synchronization device 120 .

[0055] The imaging device 500 to be tested is arranged between the time measurement mark plate 100 and the image acquisition device 200. The imaging device 500 to be tested is used to collect the image of the light source device 110 and display it on the display component of the imaging device 500 to be tested. When the delay time detection system is in use, the imaging device 500 to be tested is arranged between the light source device 110 and the image acquisition device 200. The light source device 110 needs to be arranged in the imaging area of ​​the camera of the imaging device 500 to be tested, so as to ensure that the camera of the imaging device 500 to be tested can collect the complete image of the light source device 110 and display the image of the light source device 110 on the display component of the imaging device 500 to be tested. Among them, the imaging device 500 to be tested can be a VR head display, or it can be any device that can realize the VST mode, which is not specifically limited in the embodiment of the present application.

[0056] The following is an example of the imaging device 500 to be tested being a VR head display. Since the VR head display includes two display components corresponding to the left and right eyes, there can also be two image acquisition devices 200, which respectively acquire images of the corresponding display components; it can be understood that there can also be two photoelectric detection devices 300, which respectively acquire the screen lighting signal of the corresponding display component. That is, the delay time detection system provided in the embodiment of the present application can detect the VST delay (i.e., VST delay) corresponding to the two display components for the left and right eyes respectively.

[0057] The number of light source components in the light source device 110 can be determined according to the VST delay of the imaging device 500 to be tested, and is not specifically limited in the embodiment of the present application.

[0058] The time synchronization device 120 can control the operation of the light source device 110 through the light source driving component. The operation of the light source device 110 can be lit up in sequence from left to right and from top to bottom, or from right to left and from top to bottom, or from left to right and from bottom to top, or from right to left and from bottom to top. The time synchronization device 120 can also control the lighting frequency and brightness of the light source device 110 through the light source driving component to achieve the effect of a marquee.

[0059] During the operation of the light source device 110, only one light source assembly is in a lighting state at the same time. By adjusting the frequency of the light source device 110, the VST delay range that can be detected by the delay time detection system can be adjusted.

[0060] For example, taking the light source device 110 consisting of 100 independently controllable LED lamp beads, if the frequency of the light source device 110 is set to 1000Hz, the time required for all 100 LED lamp beads to complete the display is 100ms, and the VST delay range of the imaging device to be detected that can be detected at this time is 0ms-100ms; if the frequency of the light source device 110 is set to 300Hz, the time required for all 100 LED lamp beads to complete the display is 333ms, and the VST delay range of the imaging device to be detected that can be detected at this time is 0ms-333ms; if the frequency of the light source device 110 is set to 3000Hz, the time required for all 100 LED lamp beads to complete the display is 33ms, and the VST delay range of the imaging device to be detected that can be detected at this time is 0ms-33ms.

[0061] The image acquisition device 200 is used to acquire a display image of a display component of the imaging device 500 to be tested, and transmit the display image to the processor 400. The display component of the imaging device 500 to be tested is arranged in the imaging area of ​​the image acquisition device 200.

[0062] Taking a VR headset as an example, there are two image acquisition devices 200, and the VR headset includes a display component corresponding to the left eye and a display component corresponding to the right eye; the display component corresponding to the left eye is arranged in the imaging area of ​​the first image acquisition device 200; the display component corresponding to the right eye is arranged in the imaging area of ​​the second image acquisition device 200.

[0063] The display image captured by the image acquisition device 200 includes the screen displayed by the display component. The image acquisition device 200 can be a binocular detection camera, and the two cameras correspond to the display component of the left eye and the display component of the right eye respectively. The binocular detection camera is rigidly composed of two cameras of exactly the same type. The camera supports automatic or manual gain adjustment, exposure time adjustment, and hard triggering for taking pictures. Among them, in this embodiment, the gain adjustment range is 0dB-20dB; the exposure time adjustment range is 15us~10sec.

[0064] The photoelectric detection device 300 is arranged in front of the display component of the imaging device 500 to be tested, and is used to detect the refresh of the display component. The photoelectric detection device 300 can be fixed to the front end of the image acquisition device 200 by a bracket, and its setting position needs to ensure that the photoelectric detection device 300 can detect the refresh of the display component of the imaging device 500 to be tested.

[0065] Taking the imaging device 500 to be tested as a VR head display and the image acquisition device 200 as a binocular detection camera as an example, there are two photoelectric detection devices 300, one photoelectric detection device 300 corresponds to the display component of the left eye, and is used to detect the refresh of the left eye display component. The time synchronization device 120 collects the signal of the screen lighting of the display component, and controls the camera corresponding to the display component of the left eye based on the signal of the screen lighting of the display component to collect the display picture including the display component of the left eye; the other photoelectric detection device 300 corresponds to the display component of the right eye, and is used to detect the refresh of the right eye display component. The time synchronization device 120 collects the signal of the screen lighting of the display component, and controls the camera corresponding to the display component of the right eye based on the signal of the screen lighting of the display component to collect the display picture including the display component of the right eye.

[0066] The photoelectric detection device 300 includes a photodiode, which can convert an optical signal into an electrical signal. The spectrum range to which the photodiode can respond is 400nm-690nm, which is slightly smaller than the visible light range of 380nm-750nm. The photodiode has a response time of 0.09us and a small size, which can reduce the overall size of the delay time detection system. The photodiode can be used to detect the refresh and refresh cycle of the display component.

[0067] like Figure 6As shown, two photoelectric detection devices 300 are respectively installed in front of the left and right eyepiece lenses of the image acquisition device 200 and are firmly fixed, which can be fixed by a fixing bracket (not shown) and the like. The distance between the photoelectric detection device 300 and the display component of the imaging device 500 to be tested is about 12mm-22mm.

[0068] The photoelectric detection device 300 is connected to the time synchronization device 120, and the time synchronization device 120 is connected to the processor 400; the photoelectric detection device 300 detects the refresh of the display component, collects the signal of the screen lighting of the display component, and sends the signal indicating that the screen lighting of the display component is to the time synchronization device 120, and the time synchronization device 120 controls the image acquisition device 200 to acquire the display image of the display component of the imaging device 500 to be tested according to the signal. The image acquisition device 200 is rigidly composed of two binocular cameras of the same type and is connected to the processor 400. The processor 400 can set the exposure time, gain and photo properties of the image acquisition device 200. The light source device 110, the image acquisition device 200, the photoelectric detection device 300 and the time synchronization device 120 share the same clock source, so that the delay time detection system can achieve microsecond synchronization accuracy.

[0069] The processor 400 is used to control the operation of the imaging device 500 to enter the VST mode and control the light source device 110 to operate at a preset frequency; the time synchronization device 120 is used to receive the acquisition instruction of the processor 400, start to acquire the signal of the photoelectric detection device 300 at a preset time T1, record the effective signal time T2 and synchronously trigger the image acquisition device 200 to acquire the display image of the imaging device 500 to be tested; the processor 400 is also used to receive the display image acquired by the image acquisition device 200, and determine the photon capture time T3 of the imaging device 500 to be tested based on the display image; determine the VST delay of the imaging device 500 to be tested according to the effective signal time T2 and the photon capture time T3.

[0070] When the delay time detection system is used to detect the VST delay of the imaging device 500 to be tested, the imaging device 500 to be tested is first controlled to run by the processor 400. The processor 400 controls the light source device 110 to run at a preset frequency through the time synchronization device 120. The processor 400 can be any device with a data processing function, such as a computer device, etc. The time synchronization device 120 can be any device with a data processing function, such as a single-chip microcomputer, a computer device, etc.

[0071] Control the operation of the imaging device 500 to be tested, that is, control the imaging device 500 to be powered on and enter the VST mode. After entering the VST mode, the event of the camera of the imaging device 500 to be tested will continue to occur. Control the operation of the light source device 110, that is, control the light source device 110 to be turned on. After turning on, multiple light source components of the light source device 110 are lit in sequence, and only one light source component is in the lit state at the same time.

[0072] The following is an example of all light source components lighting up in sequence from small to large in the order of serial number identification after the light source device 110 is running: When the delay magnitude of the imaging device 500 to be tested is known, the preset frequency can be determined according to the delay magnitude of the imaging device 500 to be tested. When the delay magnitude of the imaging device 500 to be tested is unknown, the frequency of the light source device 110 can be gradually increased to determine the preset frequency in a step-by-step approach. When the light source device 110 is controlled to operate, the brightness of the light source device 110 is set at the same time. The brightness needs to be set according to the brightness of the current test environment. It is necessary to ensure that the light source device 110 observed in the display image captured by the image acquisition device 200 will not be too bright or too dark when it is lit.

[0073] After the imaging device 500 to be tested and the light source device 110 are running, the time synchronization device 120 receives the acquisition instruction of the processor 400, starts to acquire the signal of the photoelectric detection device 300 at the preset time T1, records the time when the effective signal is acquired as T2, and synchronously triggers the image acquisition device 200 to acquire an image at the time T2. The processor 400 sends the acquisition instruction to the time synchronization device 120, wherein the acquisition instruction includes the preset time T1.

[0074] After receiving the acquisition instruction, the time synchronization device 120 starts to acquire the signal of the photoelectric detection device 300 at the preset time T1. After the imaging device 500 to be tested and the light source device 110 are in operation, the photoelectric detection device 300 is also in a working state, and the refresh generation signal of the display component of the imaging device 500 to be tested is detected in real time, but the time synchronization device 120 does not obtain the signal. After receiving the acquisition instruction, the time synchronization device 120 starts to acquire the signal of the photoelectric detection device 300 in real time at the preset time T1, and the time when the valid signal is acquired is recorded as T2.

[0075] The preset time T1 is determined by taking the time when the first light source component is lit after the light source device 110 is running as the initial time. After the light source device 110 is running, the time when the first light source component in the light source device 110 is lit is taken as time 0. When the preset time T1 is reached, the time synchronization device 120 starts to collect the signal of the photoelectric detection device 300.

[0076] The preset time T1 needs to be set according to the delay magnitude of the imaging device 500 to be tested. Specifically, the preset time T1 is greater than the nominal delay of the imaging device 500 to be tested, and is less than or equal to the maximum delay measurement range of the light source device 110 at the preset frequency. The preset time T1 needs to be greater than the nominal delay of the imaging device 500 to be tested. If it is less than the nominal delay of the imaging device 500 to be tested, it may result in that the lit light source component cannot be observed in the display image captured by the image acquisition device 200.

[0077] Among them, the nominal delay can be the delay roughly calibrated when the imaging device 500 to be tested leaves the factory. The maximum delay measurement range of the light source device 110 at the preset frequency is the time required for all light source components to light up in sequence at the current preset frequency. For example, if the preset frequency of the light source device 110 is 1000 Hz, the light source device 110 includes 100 light source components, and the maximum delay measurement range of the light source device 110 is 100 ms. If the preset frequency of the light source device 110 is 300 Hz, the light source device 110 includes 100 light source components, and the maximum delay measurement range of the light source device 110 is 333 ms. If the preset frequency of the light source device 110 is 3000 Hz, the light source device 110 includes 100 light source components, and the maximum delay measurement range of the light source device 110 is 33 ms.

[0078] For example, if the nominal delay of the imaging device 500 to be tested is 2ms and the preset frequency of the light source device 110 is 1000Hz, the preset time can be set to 3ms, and the preset time T1 is the lighting time of the fourth light source component. In order to meet the imaging device 500 to be tested corresponding to all VST delays, the lighting time of the last light source component of the light source device 110 can be used as the preset time T1. Assuming that the frequency of the light source device 110 is 1000Hz, 99ms can be used as the preset time, that is, the lighting time of the last light source component in the light source device 110.

[0079] The photoelectric detection device 300 detects the refresh of the display component of the imaging device 500 to be tested, and the photoelectric detection device 300 detects the effective signal of the display component at time T2. Two points need to be explained here: (1) The effective signal represents the signal when the screen of the display component is lit; (2) The signals of the photoelectric detection device 300 all correspond to corresponding timestamps, and the time synchronization device 120 can directly obtain the timestamp T2 when the photoelectric detection device 300 detects the effective signal; or it can start calculating at the preset time T1, obtain the time difference between the preset time T1 and the time when the effective signal is collected, and then sum the time difference between the preset time T1 and the time when the effective signal is collected to determine the effective signal time T2. The time synchronization device 120 synchronously triggers the image acquisition device 200 to collect images at time T2, and the image acquisition device 200 sends the collected display image to the processor 400.

[0080] When the time synchronization device 120 acquires the valid signal at time T2, it synchronously controls the image acquisition device 200 to acquire an image, that is, it controls the image acquisition device 200 to acquire the display image of the display component of the imaging device 500 to be tested. The display component of the imaging device 500 to be tested is within the imaging range of the image acquisition device 200, that is, the image acquisition device 200 can acquire the picture currently displayed by the display component.

[0081] like Figure 7 As shown, it is the display image collected by the image acquisition device 200. After the light source device 110 is running, all the light source components are lit one by one in sequence. After the imaging device 500 to be tested enters the VST mode, the event event will continue to occur, and an event event will last for a period of time, that is, the camera can continuously receive the photons generated by the light source device 110 during this period of time. If multiple light source components are lit one by one in sequence during this period of time, then in this event event, the camera can receive the photon signal generated by each light source component that is lit, that is, in the image generated by this event event, there will be multiple light source components lit at the same time. Take an event event that takes 11ms and the frequency of the light source device 110 is 1000Hz as an example: an event event corresponds to 7 light source components lighting up in sequence, then in the image generated by this event event, there will be 7 light source components in the lighting state. At this time, the image acquisition device 200 collects the display image of the display component of the imaging device 500 to be tested, and there will be 7 light source components in the display image that are all lit.

[0082] After receiving the display image captured by the image acquisition device 200, the processor 400 performs image processing on the display image to determine the photon capture time T3 of the imaging device 500 to be tested; according to the effective signal time T2 and the photon capture time T3 collected, the VST delay of the imaging device 500 to be tested is determined. Among them, the effective signal time T2 represents the time corresponding to the signal when the screen of the display component is lit, that is, the time when the display component of the imaging device 500 to be tested displays photons. According to the display image, the time when the imaging device 500 to be tested captures photons can be determined, that is, the photon capture time T3. Therefore, the VST delay of the imaging device 500 to be tested is determined according to the effective signal time T2 and the photon capture time T3.

[0083] At this point, the description of the delay time detection system in the embodiments of the present application is completed.

[0084] The delay time detection method applied to the system is described below. The method includes steps 502 to 508. Among them: Step 502: Control the light source device to operate at a preset frequency, so that the imaging device to be tested collects an image of the light source device and displays it on a display component of the imaging device to be tested.

[0085] Step 504 , starting to collect signals from the photoelectric detection device at a preset time, recording the effective signal time and synchronously triggering the image acquisition device to collect the display image of the imaging device to be tested.

[0086] Step 506: Receive the display image acquired by the image acquisition device, and determine the photon capture moment of the imaging device to be tested based on the display image.

[0087] It can be understood that the image information with Mark in the identification area in the displayed image can be used to locate the first light source component in the image that is in a lit state, so that the photon capture moment can be calculated based on the serial number identification of the light source component.

[0088] Among them, the determination of the photon capture moment of the imaging device to be tested based on the displayed image needs to be implemented with the help of the Mark detection algorithm. Specifically, the program corresponding to the Mark detection algorithm can identify a specific type of Mark from the displayed image, and then parse the Mark to obtain the coded information therein, namely the serial number identifier and the position identifier.

[0089] Among them, the specific type refers to the type of Mark obtained by encoding the serial number identifier and the position identifier in the embodiment of the present application. It can be understood that there is other information in the displayed image, such as the light source component area. In order to avoid the Mark detection algorithm from misidentifying other information, the Mark detection algorithm in the embodiment of the present application can identify and process the specific type of Mark. If the specific type of Mark is not detected, the execution process of the Mark detection algorithm is exited.

[0090] After all identifiable light source identifiers (i.e., Marks) are identified from the displayed image through the Mark detection algorithm, all light source component areas in the displayed image are determined based on all the light source identifiers; the first serial number identifier of the first target light source component is determined based on all the light source component areas; and the photon capture moment of the imaging device to be tested is determined based on the first serial number identifier and the preset frequency of the light source device.

[0091] The first target light source component refers to the first light source component in the image that is in a lit state. Whether it is lit or not can be determined by the average pixel value of the light source component area. Specifically, the average pixel value can be compared with a preset pixel value threshold. If the average pixel value is greater than the preset pixel value threshold, it is determined that the corresponding light source component is in a lit state. If the average pixel value is less than or equal to the preset pixel value threshold, it is determined that the corresponding light source component is in an unlit state.

[0092] The preset pixel value threshold can distinguish whether the light source component is in a lit state or an unlit state. For example, the preset pixel value threshold can be 100, 150, etc.

[0093] Exemplarily, the light source identifier is a symbol identifier obtained after encoding, so it needs to be decoded to obtain the information it carries, namely the position identifier and the serial number identifier. That is, based on all the light source identifiers, the position identifiers and the serial number identifiers corresponding to all the light source identifiers can be determined; then, based on all the position identifiers and the serial number identifiers, all the light source component areas in the display image and the serial number identifiers corresponding to each light source component area can be determined.

[0094] Among them, each light source component area can be obtained by moving the corresponding identification area, and how to move can be determined by the position mark. For example, if the identification area is a square, the position mark includes corner point information and the moving distance, such as Figure 4a As shown, the corner point information, i.e., the coordinates of points P1 to P4, are moved to the left by the distance. In addition, the light source component area can also be constructed by the position mark, i.e., the light source component area is constructed by moving the corner point information, i.e., the coordinate information, according to the distance in the position mark.

[0095] In summary, each light source assembly area can be obtained. For example, if there are 100 light source assemblies, 100 corresponding light source assembly areas can be obtained.

[0096] For how to determine the first serial number identification of the first target light source component according to all the light source component areas, please refer to Figure 7 For understanding, the present application provides three determination methods: traversal method, fast grouping method and multi-threading method. For the traversal method, the lighting component area detection is performed starting from any light source component area, and the lighting component area detection of other light source component areas is completed in sequence to obtain multiple lighting component areas and the serial number identification corresponding to each lighting component area. The corresponding smallest serial number identification is found from the multiple lighting component areas, and it is used as the first serial number identification of the first target light source component.

[0097] For the quick grouping method, it means first dividing all the light source component areas into a plurality of light source groups according to a preset number, and then performing lighting component area detection on the first light source component area in each of the light source groups to determine the first target lighting component area; starting from the first target lighting component area, performing lighting component area detection in the direction of decreasing serial number identification; and taking the serial number identification corresponding to the last lighting component area detected as the first serial number identification of the first target light source component.

[0098] The preset number can be set as needed and is not limited in this embodiment.

[0099] Exemplarily, by performing a lighting component area detection on the first light source component area in each of the light source groups, one, two or more first target lighting component areas can be obtained. For example, if the number of light source component areas is 100, the corresponding light source components can be serially numbered 1-100 in sequence, and the preset number is 10, then 10 light source groups can be obtained, and the serial number of the light source components corresponding to the first light source component area of ​​each light source group is 1, 11, 21... and so on. Accordingly, the first target lighting component area may be one, two or more, for example, if the first target lighting component area is one, the corresponding serial number is 21.

[0100] Correspondingly, if there is one first target lighting component area, the lighting component area detection is performed with the first target lighting component area as the starting position in the direction of decreasing serial number identification; if no lighting component area is detected, the serial number identification corresponding to the first target lighting component area is used as the first serial number identification of the first target light source component; if a lighting component area is detected, the serial number identification corresponding to the last detected lighting component area is used as the first serial number identification of the first target light source component.

[0101] If there are two or more first target lighting component areas, first determine the first target lighting component area corresponding to the smallest serial number identifier from each first target lighting component area, and then use the first target lighting component area corresponding to the smallest serial number identifier as the starting position to detect the lighting component areas in the direction of decreasing serial number identifiers; if no lighting component area is detected, the serial number identifier corresponding to the first target lighting component area corresponding to the smallest serial number identifier is used as the first serial number identifier of the first target light source component; if a lighting component area is detected, the serial number identifier corresponding to the last lighting component area detected is used as the first serial number identifier of the first target light source component.

[0102] For the multi-threaded method, according to the serial number identification corresponding to each light source component area, the lighting component area detection is performed with the first light source component area as the starting position in the direction of increasing serial number identification; the serial number identification corresponding to the first detected lighting component area is used as the first serial number identification of the first target light source component.

[0103] In addition, while the lighting component area detection is performed in the direction of increasing serial number identification starting from the first light source component area, the lighting component area detection can be performed in the direction of decreasing serial number identification starting from the last light source component area.

[0104] For the above two detection directions, when the first target light source component is detected in any detection direction, detection in both detection directions is stopped. Among them, if a lit component area is detected first in the detection direction of detecting the lighting component area with the first light source component area as the starting position and in the direction of increasing serial number identification, the serial number identification corresponding to the first lighting component area is used as the first serial number identification of the first target light source component; if a lit component area is detected in the detection direction of detecting the lighting component area with the last light source component area as the starting position and in the direction of decreasing serial number identification, detection is continued until the extinguished component area is detected first.

[0105] For the latter of the two detection directions, if an extinguished component area is detected, the serial number identifier corresponding to the last lit component area detected during the continued detection will be used as the first serial number identifier of the first target light source component.

[0106] Exemplarily, after the first serial number identifier is determined based on the above three determination methods, the photon capture time T3 of the imaging device to be tested can be determined based on the first serial number identifier by the following formula 1: T3=Ts×v (I) Among them, Ts is the first serial number identifier; v is the movement rate of the light source component when producing the "marquee" effect, which can be calculated by the preset frequency, that is, the reciprocal of the preset frequency.

[0107] Step 508: Determine the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time.

[0108] Exemplarily, the VST delay may include the exposure time of the camera of the VR headset, or may not include the exposure time of the camera of the VR headset.

[0109] The VST delay includes the exposure time of the camera of the VR headset. The VST delay can be directly determined according to the effective signal time and the photon capture time. Specifically, the VST delay T can be determined by the following formula 2: T=T1+ΔT–T3 (II) Wherein, T1 is the above-mentioned preset time, ΔT is the time difference from the preset time T1 to the effective signal time T2, that is, T1+ΔT=T2; T3 is the photon capture time.

[0110] The VST delay does not include the exposure time of the camera of the VR headset. The VST delay can be determined according to the effective signal time, the photon capture time and the exposure time. Specifically, the VST delay T can be determined by the following formula three: T = T1 + ΔT – T3 - Texp (III) Among them, T1 is the above-mentioned preset time, ΔT is the time difference from the preset time T1 to the effective signal time T2, that is, T1+ΔT=T2; T3 is the photon capture time; Texp is the exposure time.

[0111] The following describes how to determine the exposure time Texp: The exposure time Texp can be used to determine the second serial number identifier of the second target light source component based on all the light source component areas after determining all the light source component areas in the display image, and to determine the exposure duration of the imaging device to be tested based on the first serial number identifier, the second serial number identifier and the preset frequency of the light source device.

[0112] The second target light source assembly refers to the light source assembly with the largest serial number among the light source assemblies in the lighting state.

[0113] Among them, the exposure time Texp can be determined by the following formula 4: Texp=(Te–Ts)×v (4) Among them, Te refers to the second serial number identification, Ts refers to the first serial number identification, and v is the movement rate of the light source component when producing a "marquee" effect, which can be calculated through the preset frequency, that is, the reciprocal of the preset frequency.

[0114] For example, how to determine the second serial number identifier is similar to the above determination of the first serial number identifier, and can also refer to Figure 7 For understanding, the present application also provides three determination methods, namely: traversal method, fast grouping method and multi-threading method. For the traversal method, the lighting component area detection is performed starting from any light source component area, and the lighting component area detection of other light source component areas is completed in sequence to obtain multiple lighting component areas and the serial number identification corresponding to each lighting component area. The largest corresponding serial number identification is found from the multiple lighting component areas, and it is used as the second serial number identification of the second target light source component.

[0115] For the quick grouping method, it means first dividing all the light source component areas into a plurality of light source groups according to a preset number, and then performing lighting component area detection on the first light source component area in each of the light source groups to determine the second target lighting component area; performing lighting component area detection in the direction of increasing serial number identification with the second target lighting component area as the starting position; and using the serial number identification corresponding to the last lighting component area detected as the second serial number identification of the second target light source component.

[0116] The preset number can be set as needed and is not limited in this embodiment.

[0117] Exemplarily, by performing a lighting component area detection on the first light source component area in each of the light source groups, one, two or more second target lighting component areas can be obtained. For example, if the number of light source component areas is 100, the corresponding light source components can be serially numbered 1-100 in sequence, and the preset number is 10, then 10 light source groups can be obtained, and the serial number of the light source components corresponding to the first light source component area of ​​each light source group is 1, 11, 21... and so on. Accordingly, the second target lighting component area may be one, two or more, for example, if the second target lighting component area is one, the corresponding serial number is 21.

[0118] Correspondingly, if there is only one first target lighting component area, the lighting component area detection is performed with the second target lighting component area as the starting position in the direction of increasing serial number identification; if no lighting component area is detected, the serial number identification corresponding to the second target lighting component area is used as the second serial number identification of the second target light source component; if a lighting component area is detected, the serial number identification corresponding to the last detected lighting component area is used as the second serial number identification of the second target light source component.

[0119] If there are two or more second target lighting component areas, first determine the second target lighting component area corresponding to the maximum serial number identifier from each second target lighting component area, and then use the second target lighting component area corresponding to the maximum serial number identifier as the starting position to detect the lighting component areas in the direction of increasing serial number identifiers; if no lighting component area is detected, the serial number identifier corresponding to the second target lighting component area corresponding to the maximum serial number identifier is used as the second serial number identifier of the second target light source component; if a lighting component area is detected, the serial number identifier corresponding to the last detected lighting component area is used as the second serial number identifier of the second target light source component.

[0120] For the multi-threaded method, according to the serial number identification corresponding to each light source component area, the lighting component area detection is performed with the last light source component area as the starting position in the direction of decreasing serial number identification; the serial number identification corresponding to the first detected lighting component area is used as the second serial number identification of the second target light source component.

[0121] In addition, the second serial number identifier can also be determined through the above two detection direction corresponding embodiments. In specific implementation, the difference is that in this embodiment, the second serial number identifier is determined instead of the first serial number identifier. The specific determination process is not repeated here.

[0122] The following combination Figure 8 An optional embodiment of the detection process of the system is described, and the embodiment includes steps 1 to 5, wherein: Step 1: Set the flashing frequency and brightness of the light source, that is, set the lighting frequency and brightness of the light source component in the light source device.

[0123] Step 2: Set the PD working relative to the light source starting time T1, that is, set the preset time of the photodiode, and when the time synchronization device reaches the preset time, collect the signal of the photodiode.

[0124] Step 3: Record the time difference ΔT between the generation time of the pulse signal of the PD response when the screen is refreshed (ie, the effective signal time T2) and the preset time T1.

[0125] Step 4: Use the pulse signal of the PD response to trigger the detection camera to capture the image under the perspective screen of the VR headset, and call the program corresponding to the delay time detection method to calculate the photon capture time T3 through the image.

[0126] Step 5: Calculate the final delay value (VST delay) T=T1+ΔT-T3 based on the above-obtained moments.

[0127] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0128] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0129] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0130] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A time measurement target, characterized in that: The time measurement target plate comprises: a light source device; The light source device is provided with a light source area and a marking area; A plurality of light source components are arranged in a preset arrangement rule in the light source area; a light source identification matching the position of each light source component is arranged in the identification area; When the time measurement target plate is in operation, the plurality of light source components of the light source device are lit at a preset frequency.

2. The time measurement target according to claim 1, characterized in that: The time measurement target plate also includes: a time synchronization device; The time synchronization device is connected to the light source device and the external device to achieve clock synchronization between the light source device and the external device.

3. The time measurement target according to claim 1, characterized in that: The plurality of light source components are arranged in a linear arrangement or an array arrangement.

4. The time measurement target according to claim 1, characterized in that: The light source identification is generated based on the position identification and serial number identification code of the light source assembly at the corresponding position.

5. The time measurement target plate according to claim 4, characterized in that: The light source identification includes a QR code identification.

6. A delay time detection system, characterized in that: Used to realize the delay detection of the imaging device to be tested, the delay time detection system comprises: a time measurement target plate, an image acquisition device, a photoelectric detection device and a processor as described in any one of claims 1 to 5; The time synchronization device and the image acquisition device are respectively connected to the processor; the light source device, the image acquisition device and the photoelectric detection device are respectively connected to the time synchronization device; The imaging device to be tested is arranged between the time measurement target plate and the image acquisition device, and is used to acquire the image of the light source device and display it on the display component of the imaging device to be tested; The image acquisition device is used to acquire a display image of a display component of the imaging device to be tested, and transmit the display image to a processor; The photoelectric detection device is arranged in front of the display component of the imaging device to be tested, and is used to detect the refresh of the display component; The processor is used to control the light source device to operate at a preset frequency; The time synchronization device is used to receive the acquisition instruction of the processor, start to collect the signal of the photoelectric detection device at a preset time, record the effective signal time and synchronously trigger the image acquisition device to collect the display image of the imaging device to be tested; The processor is further used to receive the display image captured by the image acquisition device, and determine the photon capture time of the imaging device to be tested based on the display image; and determine the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time.

7. A delay time detection method, characterized in that: Applied to the delay time detection system of claim 6, the method comprising: Controlling the light source device to operate at a preset frequency so that the imaging device to be tested collects an image of the light source device and displays it on a display component of the imaging device to be tested; Start collecting signals from the photoelectric detection device at a preset time, record the effective signal time and synchronously trigger the image acquisition device to collect the display image of the imaging device to be tested; receiving the display image acquired by the image acquisition device, and determining the photon capture moment of the imaging device to be tested based on the display image; The VST delay of the imaging device to be tested is determined according to the effective signal time and the photon capture time.

8. The method according to claim 7, characterized in that The receiving the display image acquired by the image acquisition device and determining the photon capture moment of the imaging device to be tested based on the display image comprises: According to the displayed image, identifying all light source identifiers in the displayed image; Determining all light source component areas in the display image according to all the light source identifiers; Determine a first serial number identification of a first target light source assembly according to all the light source assembly areas; The photon capture moment of the imaging device to be tested is determined according to the first serial number identifier and the preset frequency of the light source device.

9. The method according to claim 8, characterized in that The determining, according to all the light source identifiers, all light source component areas in the displayed image comprises: According to all the light source identifiers, determining the position identifiers and the serial number identifiers corresponding to all the light source identifiers; According to all the position identifiers and the serial number identifiers, all the light source component areas in the display image and the serial number identifier corresponding to each light source component area are determined.

10. The method according to claim 8, characterized in that The determining, according to all the light source assembly areas, a first serial number identification of a first target light source assembly comprises: Traversing all the light source component areas to perform lighting component area detection, and determining a plurality of lighting component areas and a serial number identification corresponding to each lighting component area; The smallest serial number identifier corresponding to the plurality of lighting component areas is used as the first serial number identifier of the first target light source component.

11. The method according to claim 8, characterized in that The determining, according to all the light source assembly areas, a first serial number identification of a first target light source assembly comprises: According to the serial number identification corresponding to each light source component area, starting from the first light source component area and moving in the direction of increasing serial number identification, the lighting component area detection is performed; The serial number identifier corresponding to the first detected lit component area is used as the first serial number identifier of the first target light source component.

12. The method according to claim 8, characterized in that The determining, according to all the light source assembly areas, a first serial number identification of a first target light source assembly comprises: Dividing all the light source assembly areas into a plurality of light source groups according to a preset number; Performing lighting component area detection on the first light source component area in each of the light source groups to determine a first target lighting component area; Taking the first target lighting component area as the starting position, performing lighting component area detection in the direction of decreasing serial number identifiers; The serial number identifier corresponding to the last detected lit component area is used as the first serial number identifier of the first target light source component.

13. The method according to claim 8, characterized in that After determining all light source component areas in the display image according to all the light source identifiers, the method further includes: Determine a second serial number identification of a second target light source assembly according to all the light source assembly areas; The exposure duration of the imaging device to be tested is determined according to the first serial number identifier, the second serial number identifier and a preset frequency of the light source device.

14. The method according to claim 13, characterized in that The determining the second serial number identification of the second target light source assembly according to all the light source assembly areas comprises: Traversing all the light source component areas to perform lighting component area detection, and determining a plurality of lighting component areas and a serial number identification corresponding to each lighting component area; The largest serial number identifier corresponding to the plurality of lighting component areas is used as the second serial number identifier of the second target light source component.

15. The method according to claim 13, characterized in that The determining the second serial number identification of the second target light source assembly according to all the light source assembly areas comprises: According to the serial number identification corresponding to each light source component area, starting from the last light source component area as the starting position and moving in the direction of decreasing serial number identification, the lighting component area is detected; The serial number identification corresponding to the first detected lit component area is used as the second serial number identification of the second target light source component.

16. The method according to claim 13, characterized in that The determining the second serial number identification of the second target light source assembly according to all the light source assembly areas comprises: Dividing all the light source assembly areas into a plurality of light source groups according to a preset number; Performing a lighting component area detection on the first light source component area in each of the light source groups to determine a second target lighting component area; Taking the second target lighting component area as the starting position, performing lighting component area detection in the direction of increasing serial number identifiers; The serial number identifier corresponding to the last detected lit component area is used as the second serial number identifier of the second target light source component.

17. The method according to any one of claims 13 to 16, characterized in that Determining the VST delay of the imaging device to be tested according to the effective signal time and the photon capture time includes: The VST delay of the imaging device to be tested is determined according to the effective signal time, the photon capture time and the exposure time.

Images