Delay time detection method, system and time measurement target
By using a time measurement scale and light source markers in a virtual reality head-mounted display device, combined with time synchronization and image acquisition technologies, the jitter and distortion problems in delay detection were solved, and more accurate delay calculations were achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-11
- Publication Date
- 2026-03-31
AI Technical Summary
In existing technologies, the virtual reality perspective technology for virtual reality head-mounted displays suffers from image jitter and distortion during delay detection, leading to inaccurate delay calculations.
A time measurement target is used, and multiple light source components are lit at a preset frequency by a light source device. The light source is positioned using a light source marker. Combined with a time synchronization device and an image acquisition device, the photon capture time is determined to avoid the effects of image jitter and distortion.
It improves the accuracy of latency detection in virtual reality headsets and reduces errors caused by image jitter and distortion.
Smart Images

Figure CN119316592B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of delay detection technology, and in particular to a delay time detection method, system and time measurement plate. Background Technology
[0002] Virtual reality head-mounted displays, or VR headsets for short, work by displaying images for each eye on two separate screens. The human eye receives this differentiated information and generates a sense of depth in the brain. Video see-through (VST) technology is a technique that captures real-world images using a camera and fuses them into a virtual scene in real time. It is a key technology in the fields of virtual reality (VR), augmented reality (AR), extended reality (XR), and mixed reality (MR).
[0003] VST (Virtual Subtitle Detection) technology, or VST mode for VR headsets, is implemented using VR headsets. This mode captures real-time video images using the headset's camera, combines these images with computer-generated graphics, and presents the result to the user on the headset's display. The data processing involved includes real-time video capture, image processing, scene reconstruction, and rendering, which is highly complex and introduces VST latency, impacting the user experience. Accurate measurement of VR headset VST latency provides a data-driven foundation for optimizing latency and improving user experience.
[0004] In traditional technology, images captured by a camera and displayed on the VR headset's screen are used to determine the coordinates of the light source components in the image, and then the VST delay is determined based on the coordinates of the light source components. However, when VR headsets display images, there are jitter and distortion phenomena. The jitter and distortion of the images can lead to inaccurate recognition of the coordinates of the light source components, which in turn leads to inaccurate VST delay. Summary of the Invention
[0005] Therefore, it is necessary to provide a delay time detection method, system, and time measurement standard that can improve the accuracy of the VST delay obtained from the test, in order to address the above-mentioned technical problems.
[0006] In a first aspect, this application provides a time measurement scale, the time measurement scale comprising: a light source device;
[0007] The light source device is provided with a light source area and a marking area;
[0008] The light source area contains multiple light source components arranged according to a preset rule; the identification area contains light source identification marks that match the position of each light source component.
[0009] When the time measuring plate is running, the multiple light source components of the light source device are lit at a preset frequency.
[0010] In one embodiment, the time measurement scale further includes a time synchronization device;
[0011] The time synchronization device is connected to the light source device and external devices to achieve clock synchronization between the light source device and external devices.
[0012] In one embodiment, multiple light source components are arranged in a linear or array configuration.
[0013] In one embodiment, the light source identifier is generated based on the position identifier and serial number identifier of the light source component at the corresponding location.
[0014] In one embodiment, the light source identifier includes a QR code identifier.
[0015] Secondly, this application also provides a time delay detection system for detecting the time delay of an imaging device under test. The time delay detection system includes: a time measurement plate, an image acquisition device, a photoelectric detection device, and a processor as described above.
[0016] The time synchronization device and the image acquisition device are respectively connected to the processor; the light source device, the image acquisition device, and the photoelectric detection device are respectively connected to the time synchronization device;
[0017] The imaging device under test is disposed between the time measurement plate and the image acquisition device, and is used to acquire the image of the light source device and display it on the display component of the imaging device under test;
[0018] The image acquisition device is used to acquire a display image including the display component of the imaging device under test, and transmit the display image to the processor;
[0019] The photoelectric detection device is disposed in front of the display component of the imaging device under test, and is used to detect the refresh of the display component;
[0020] The processor is used to control the light source device to operate at a preset frequency;
[0021] The time synchronization device is used to receive the acquisition command from the processor, start acquiring the signal from the photoelectric detection device at a preset time, record the time of the valid signal, and synchronously trigger the image acquisition device to acquire the display image of the imaging device under test.
[0022] The processor is further configured to receive the display image acquired by the image acquisition device, and determine the photon capture time of the imaging device under test based on the display image; and determine the VST delay of the imaging device under test according to the effective signal time and the photon capture time.
[0023] Thirdly, this application also provides a delay time detection method, applied to the delay time detection system described above, the method comprising:
[0024] The light source device is controlled to operate at a preset frequency so that the imaging device under test can acquire the image of the light source device and display it on the display component of the imaging device under test;
[0025] The system begins acquiring signals from the photoelectric detection device at a preset time, records the time of valid signals, and simultaneously triggers the image acquisition device to acquire the display image of the imaging device under test.
[0026] Receive the display image acquired by the image acquisition device, and determine the photon capture time of the imaging device under test based on the display image;
[0027] The VST delay of the imaging device under test is determined based on the effective signal time and the photon capture time.
[0028] In one embodiment, receiving the displayed image acquired by the image acquisition device and determining the photon capture time of the imaging device under test based on the displayed image includes:
[0029] Identify all light source identifiers in the displayed image based on the displayed image;
[0030] Based on all the light source identifiers, determine all light source component areas in the displayed image;
[0031] Based on all the light source component regions, determine the first sequence number identifier of the first target light source component;
[0032] The photon capture time of the imaging device under test is determined based on the first serial number identifier and the preset frequency of the light source device.
[0033] In one embodiment, determining all light source component regions in the displayed image based on all the light source identifiers includes:
[0034] Based on all the light source identifiers, determine the position identifier and sequence number identifier corresponding to each light source identifier;
[0035] Based on all the location identifiers and sequence identifiers, determine all light source component areas in the displayed image and the corresponding sequence identifier for each light source component area.
[0036] In one embodiment, determining the first sequence number identifier of the first target light source component based on all said light source component regions includes:
[0037] Traverse all the light source component areas to detect the lit component areas, and determine multiple lit component areas and the corresponding serial number identifier for each lit component area;
[0038] The smallest corresponding serial number in the multiple lighting component regions is used as the first serial number of the first target light source component.
[0039] In one embodiment, determining the first sequence number identifier of the first target light source component based on all said light source component regions includes:
[0040] Based on the serial number corresponding to each light source component area, the lighting component area is detected in the direction of increasing serial number from the first light source component area as the starting position.
[0041] The serial number corresponding to the first illuminated component area detected is used as the first serial number of the first target light source component.
[0042] In one embodiment, determining the first sequence number identifier of the first target light source component based on all said light source component regions includes:
[0043] Divide all the light source component areas into multiple light source groups according to a preset number;
[0044] For the first light source component area in each light source group, the lighting component area is detected to determine the first target lighting component area;
[0045] Starting from the first target illuminated component area, the illuminated component area is detected in the direction of decreasing sequence number.
[0046] The serial number of the last illuminated component area detected is used as the first serial number of the first target light source component.
[0047] In one embodiment, after determining all light source component areas in the displayed image based on all the light source identifiers, the method further includes:
[0048] Based on all the light source component regions, determine the second serial number identifier of the second target light source component;
[0049] The exposure time of the imaging device under test is determined based on the first serial number identifier, the second serial number identifier, and the preset frequency of the light source device.
[0050] In one embodiment, determining the second serial number identifier of the second target light source component based on all said light source component regions includes:
[0051] Traverse all the light source component areas to detect the lit component areas, and determine multiple lit component areas and the corresponding serial number identifier for each lit component area;
[0052] The largest corresponding serial number in the multiple lighting component regions is used as the second serial number of the second target light source component.
[0053] In one embodiment, determining the second serial number identifier of the second target light source component based on all said light source component regions includes:
[0054] Based on the serial number corresponding to each light source component area, the lighting component area is detected starting from the last light source component area and moving in the direction of decreasing serial number.
[0055] The serial number corresponding to the first illuminated component area detected is used as the second serial number of the second target light source component.
[0056] In one embodiment, determining the second serial number identifier of the second target light source component based on all said light source component regions includes:
[0057] Divide all the light source component areas into multiple light source groups according to a preset number;
[0058] For the first light source component area in each light source group, the lit component area is detected to determine the second target lit component area;
[0059] Starting from the second target illuminated component area, the illuminated component area is detected in the direction of increasing sequence number.
[0060] The serial number corresponding to the last illuminated component area detected is used as the second serial number of the second target light source component.
[0061] In one embodiment, determining the VST delay of the imaging device under test based on the effective signal time and the photon capture time includes:
[0062] The VST delay of the imaging device under test is determined based on the effective signal time, the photon capture time, and the exposure duration.
[0063] The aforementioned delay time detection method, system, and time measurement target include a light source device; the light source device has a light source area and an identification area; multiple light source components are arranged in a preset pattern within the light source area; and a light source identification mark is provided in the identification area, matching the position of each light source component. When the time measurement target is running, the multiple light source components of the light source device illuminate at a preset frequency. The light source identification mark is used to identify the light source components, allowing the location and identification of the first illuminated LED in the light source image. This enables the calculation of the VST delay, avoiding inaccurate VST delay detection due to image jitter and distortion, thereby improving the accuracy of the detected VST delay. Attached Figure Description
[0064] Figure 1 This is a schematic diagram of the area where the LED beads are lit in one embodiment;
[0065] Figure 2a This is a schematic diagram of the arrangement of LED beads in one embodiment;
[0066] Figure 2b This is a schematic diagram showing the position of the first LED bead in the lit state in an image during a detection round in one embodiment;
[0067] Figure 2c This is a schematic diagram showing the position of the first lit LED bead in an image during another detection round in one embodiment;
[0068] Figure 2d This is a schematic diagram showing the position of the first LED bead in the lit state in an image during another detection round in one embodiment;
[0069] Figure 3 This is a schematic diagram of the structure of a time measurement scale in one embodiment;
[0070] Figure 4a This is a schematic diagram illustrating the application process of Mark in one embodiment;
[0071] Figure 4b This is a schematic diagram of selecting a light source area in an image in one embodiment;
[0072] Figure 5 This is a flowchart illustrating a delay time detection method in one embodiment;
[0073] Figure 6 This is a schematic diagram of the delay time detection system in one embodiment;
[0074] Figure 7This is a schematic diagram illustrating the detection of an image captured by a camera in one embodiment;
[0075] Figure 8 This is a flowchart illustrating the delay time detection method in another embodiment. Detailed Implementation
[0076] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0077] As mentioned in the background technology, the image is captured by a detection camera and displayed on the screen of a VR headset. The coordinates of the light source components in the image are determined based on the captured image, and then the VST delay is determined based on the coordinates of the light source components. However, when the VR headset displays an image, there are jitter and distortion phenomena. The jitter and distortion of the image will lead to inaccurate recognition of the coordinates of the light source components, which will further lead to inaccurate VST delay.
[0078] In traditional technology, the VST delay is detected by a delay time detection system. This system includes at least a light source and a detection camera. The detection camera is used to capture the image displayed on the VR headset's screen, and the image includes a complete image of the light source. The light source includes several LED beads with a specific arrangement (such as arranged in a row), lighting frequency, and brightness, thereby achieving a "marquee" effect, with only one LED bead lit at a time.
[0079] By locating and marking the first LED in the light source image that is lit, that is, after determining the coordinate information of the first LED in the lit state, the LED can be marked and identified using the coordinate information, and the VST delay can be calculated.
[0080] In particular, by conducting multiple rounds of testing on the same VR headset and locating the first LED bead in the image that was lit, the applicant found that for the same VR headset, the VST latency should be fixed or fluctuate within a very small range, but the results of each round of testing showed a large range of fluctuations.
[0081] After in-depth research into the causes of the large fluctuations, the applicant discovered that due to factors such as image jitter and distortion, the coordinate information obtained in each round of testing varied significantly when locating the first lit LED in the image based on coordinate information. Jitter refers to the shaking of the displayed image caused by untimely rendering and loss of depth information during image processing by the VR headset; distortion refers to image deformation caused by the refraction and reflection of light in optical design (such as lenses and camera sensors), as well as defects or installation errors in the internal imaging system, resulting in images appearing barrel-shaped or pincushion-shaped.
[0082] The detection principle of the aforementioned time delay detection system is as follows: It is assumed that each LED in the light source has a fixed position in the image captured by the detection camera. This fixed position is used to locate and mark the first LED in the image that is lit, thereby determining the VST delay. However, due to jitter and distortion, the positions of each LED in the image may change.
[0083] In other words, there is a discrepancy between the actual LED positions in the captured image and the assumed LED positions. This leads to errors in locating and labeling the LEDs in the captured image using coordinate information. For example, the position at coordinates (40,0) in the actual captured image corresponds to LED a, but according to the assumed positions of the LEDs, the position at coordinates (40,0) should correspond to LED b. Therefore, distortion causes incorrect labeling of the LEDs, ultimately resulting in incorrect VST delay calculation.
[0084] Here, coordinates refer to the coordinates of pixels in the image. It's assumed that the pixels corresponding to each LED in the image captured by the detection camera are known. For example, if pixel 1 corresponds to LED a and pixel 2 corresponds to LED b, then after the detection camera actually captures the image, the location of the first LED in a lit state can be determined using pixel values. Correspondingly, each LED has a fixed spacing, which translates to a fixed number of pixels in the image. For example, there might be a 10-pixel gap between two LEDs.
[0085] The principle behind pixel value localization is as follows: In an image, there is a clear "boundary" between the area where an LED is off and the area where it is on. This boundary represents a point where the pixel value changes drastically between the two areas. By identifying this point, the first LED in the on state can be located. A drastic change in pixel value means that the difference between the pixel values of two adjacent pixels is greater than a preset value, or the difference between the average pixel values of two adjacent pixel regions is greater than a preset value. A pixel region includes two or more pixels.
[0086] like Figure 1 As shown, the black area of the ROI refers to the region in the image captured by the detection camera where the LEDs are lit. Since the detection camera has an exposure time, this region typically includes multiple LEDs. For example, if the exposure time is 10ms and the light source's illumination frequency is 1000Hz (one LED lights up every 1ms), then the number of LEDs lit in the image is 10. Point P represents the coordinates of the first LED in the image to be lit, i.e., the location where the pixel values change drastically from left to right; the "marquee" moves from left to right.
[0087] like Figure 2a As shown, the light source has n LED beads. Figure 2a This assumes that each LED bead has a fixed position in the image captured by the detection camera. Figure 2a In the diagram, LED bead Xa is 300 pixels away from the leftmost LED bead, representing a delay range of [0ms-30ms]. LED bead Xa and LED bead Xb are 100 pixels apart, representing a delay range of [30ms-40ms].
[0088] like Figure 2b , Figure 2c and Figure 2d As shown, points P1, P2, and P3 represent the positions of the first lit LED beads in the images obtained from different rounds of testing. It can be understood that, based on the calculation principle of VST delay described above, the VST delay obtained from each round of testing will differ due to the different positions, leading to errors in the detected VST delay and thus making the detected VST delay inaccurate.
[0089] To address the issue of inaccurate VST delay detection, in an exemplary embodiment, such as... Figure 3As shown, a time measurement chart is provided, comprising: a light source device; the light source device having a light source area and an identification area; multiple light source components arranged in a preset pattern within the light source area; and a light source identification mark matching the position of each light source component within the identification area. When the time measurement chart is in operation, the multiple light source components of the light source device illuminate at a preset frequency. Preferably, the light source components illuminate sequentially at the preset frequency. The light source identification mark is used to identify the light source components, allowing the location and identification of the first illuminated LED in the light source image. This enables the calculation of the VST delay, avoiding inaccurate VST delay detection due to image jitter and distortion, thereby improving the accuracy of the detected VST delay.
[0090] The light source device includes multiple light source components and a light source driver component. The light source components can be LED beads or any object capable of emitting light.
[0091] The following explanation uses LED beads as an example of a light source component. Figure 3 As shown, a light source device is provided.
[0092] The preset arrangement rules can include linear arrangement and array arrangement. Linear arrangement means that all light source components are arranged in a single column. For example, light source identifiers can also be arranged in a single column. For instance, light source components and light source identifiers can be interspersed to form a single column. The interspersed arrangement method can be found in [reference needed]. Figure 3 For array arrangement methods, please refer to [link / reference]. Figure 3 .
[0093] The light source mark can be a symbolic identifier that records information, such as a QR code or barcode, and is used to record the serial number and location of each LED. It can be understood that this symbolic identifier is generated based on the serial number and location identifier encoding.
[0094] The serial number identifier refers to the number (ID) of each LED bead. Taking 100 LED beads as an example, the serial number identifier of each LED bead can be 1-100.
[0095] The position marker includes the distance between the light source component and the corresponding light source marker, as well as corner information. For example, if the Mark is set as a square, the corner information is the coordinates of the four corners of the square. The Mark can also be set in other shapes, such as a circle or a rectangle.
[0096] In this embodiment, the location of the Mark is not limited, as long as the information recorded in the Mark can uniquely correspond to a single LED. For example, the light source device 110 includes 100 LEDs, each LED corresponding to a Mark, which can be set at such location as... Figure 3 The right side of the LED bead shown.
[0097] The preset frequency (i.e., the lighting frequency) will be explained in detail below and will not be repeated here.
[0098] For example, such as Figure 4a and Figure 4b As shown, when used, this Mark can be used to identify LED beads and to select the corresponding area of an LED bead in an image. Points P1 to P4 are the points corresponding to corner information. The Mark provides the LED bead's serial number, corner information, and the distance to the left. The corner information and distance are used together to determine the location of the corresponding LED bead and to select the area where the corresponding LED bead is located.
[0099] The area containing the corresponding LED beads is the ROI (Region of Interest). The pixel value of this area can then be obtained using the ROI detection algorithm. This pixel value is used to determine whether the LED beads in this area are lit or off.
[0100] Based on the same inventive concept, this application also provides a delay time detection method, applied to a delay time detection system, such as... Figure 5 As shown, the method controls a light source device to operate at a preset frequency, enabling the imaging device under test (DUT) to acquire images from the light source device and display them on the display component of the DUT. It then begins acquiring signals from a photoelectric detection device at a preset time, records the effective signal time, and simultaneously triggers an image acquisition device to acquire the displayed image of the DUT. The method receives the displayed image acquired by the image acquisition device and determines the photon capture time of the DUT based on the displayed image. Finally, it determines the VST delay of the DUT based on the effective signal time and the photon capture time. In this embodiment, the photon capture time is used to locate and identify the light source component based on the light source markers in the time measurement scale, thus avoiding the need for pixel-based positioning and identification in the image. This avoids the influence of distortion on the positioning process, improving the accuracy of determining the photon capture time and making the obtained VST delay more accurate.
[0101] For a time delay detection system, this system is used to detect the time delay of the imaging device under test, such as... Figure 6As shown, the system includes: a time measurement scale 100, an image acquisition device 200, a photoelectric detection device 300, and a processor 400, as described above.
[0102] The time measurement scale 100 may include a light source device 110, and may also include a time synchronization device 120.
[0103] In one embodiment, when the time measurement scale 100 includes a light source device 110, the time synchronization device 120 can be implemented by the processor 400.
[0104] In another embodiment, when the time measuring plate 100 includes a light source device 110 and a time synchronization device 120, the time synchronization device 120 is connected to the light source device 110 and other devices in the system other than the time measuring plate 100, to ensure that multiple light source components of the light source device are lit sequentially at a preset frequency; to ensure and control the clock synchronization of the light source device with other devices, so as to achieve the purpose of the entire system sharing a clock source.
[0105] The following description uses the time measurement scale 100, which includes a light source device 110 and a time synchronization device 120, as an example:
[0106] The time synchronization device 120 and the image acquisition device 200 are respectively connected to the processor 400; the light source device 110, the image acquisition device 200 and the photoelectric detection device 300 are respectively connected to the time synchronization device 120.
[0107] The imaging device under test 500 is positioned between the time measurement scale 100 and the image acquisition device 200. The imaging device under test 500 is used to acquire images from the light source device 110 and display them on its display component. In use, the delay time detection system positions the imaging device under test 500 between the light source device 110 and the image acquisition device 200. The light source device 110 needs to be positioned within the imaging area of the camera of the imaging device under test 500 to ensure that the camera of the imaging device under test 500 can acquire a complete image of the light source device 110 and display the image of the light source device 110 on the display component of the imaging device under test 500. The imaging device under test 500 can be a VR headset or any device capable of implementing VST mode; this embodiment does not impose specific limitations.
[0108] The following explanation uses a VR headset as an example to illustrate the concept. Since a VR headset includes two display components corresponding to the left and right eyes, there can be two image acquisition devices 200, each acquiring images from its corresponding display component. Similarly, there can be two photoelectric detection devices 300, each acquiring signals indicating screen illumination from its corresponding display component. In other words, the delay time detection system provided in this embodiment can detect the VST delay (i.e., VST latency) corresponding to the two display components for the left and right eyes respectively.
[0109] The number of light source components in the light source device 110 can be determined based on the VST delay of the imaging device 500 under test, and this application embodiment does not impose a specific limitation.
[0110] The time synchronization device 120 can control the operation of the light source device 110 through the light source driving component. The light source device 110 can be lit sequentially from left to right and from top to bottom, or from right to left and from top to bottom, or from left to right and from bottom to top, or from right to left and from bottom to top. The time synchronization device 120 can also control the lighting frequency and brightness of the light source device 110 through the light source driving component to achieve a running light effect.
[0111] During operation, only one light source component of the light source device 110 is lit at any given time. By adjusting the frequency of the light source device 110, the VST delay range that the delay time detection system can detect can be adjusted.
[0112] For example, taking a light source device 110 composed of 100 independently controllable LED beads as an example, if the frequency of the light source device 110 is set to 1000Hz, the time required for all 100 LED beads to complete the display is 100ms, and the VST delay range of the imaging device under test that can be detected is 0ms-100ms; if the frequency of the light source device 110 is set to 300Hz, the time required for all 100 LED beads to complete the display is 333ms, and the VST delay range of the imaging device under test that can be detected is 0ms-333ms; if the frequency of the light source device 110 is set to 3000Hz, the time required for all 100 LED beads to complete the display is 33ms, and the VST delay range of the imaging device under test that can be detected is 0ms-33ms.
[0113] The image acquisition device 200 is used to acquire display images including the display component of the imaging device under test 500, and transmit the display images to the processor 400. The display component of the imaging device under test 500 is disposed within the imaging area of the image acquisition device 200.
[0114] Taking a VR headset as an example, there are two image acquisition devices 200. The VR headset includes a display component for the left eye and a display component for the right eye. The display component for the left eye is set in the imaging area of the first image acquisition device 200, and the display component for the right eye is set in the imaging area of the second image acquisition device 200.
[0115] The image acquisition device 200 acquires the display image, including the screen displayed by the display components. The image acquisition device 200 can be a binocular detection camera, with two cameras corresponding to the display components for the left and right eyes, respectively. The binocular detection camera is rigidly composed of two identical cameras, which support automatic or manual gain adjustment, exposure time adjustment, and hard-trigger shooting. In this embodiment, the gain adjustment range is 0dB-20dB; the exposure time adjustment range is 15us-10sec.
[0116] The photoelectric detection device 300 is positioned in front of the display component of the imaging device 500 under test and is used to detect the refresh rate of the display component. The photoelectric detection device 300 can be fixed to the front end of the image acquisition device 200 by a bracket, and its position must ensure that the photoelectric detection device 300 can detect the refresh rate of the display component of the imaging device 500 under test.
[0117] Taking the imaging device under test 500 as a VR headset and the image acquisition device 200 as a binocular detection camera as an example, there are two photoelectric detection devices 300. One photoelectric detection device 300 corresponds to the display component of the left eye and is used to detect the refresh of the display component of the left eye. The time synchronization device 120 collects the signal of the screen of the display component being lit and controls the camera corresponding to the display component of the left eye to capture the display image of the display component of the left eye based on the signal of the screen of the display component being lit. The other photoelectric detection device 300 corresponds to the display component of the right eye and is used to detect the refresh of the display component of the right eye. The time synchronization device 120 collects the signal of the screen of the display component being lit and controls the camera corresponding to the display component of the right eye to capture the display image of the display component of the right eye based on the signal of the screen of the display component being lit.
[0118] The photoelectric detection device 300 includes a photodiode, which converts light signals into electrical signals. The photodiode's spectral range is 400nm-690nm, slightly smaller than the visible light range of 380nm-750nm. The photodiode has a response time of 0.09µs and a small size, reducing the overall size of the delay time detection system. The photodiode can be used to detect the refresh rate and refresh cycle of display components.
[0119] like Figure 6As shown, two photoelectric detection devices 300 are respectively installed in front of the left and right eye camera lenses of the image acquisition device 200 and are securely fixed. This fixing can be achieved through a fixing bracket (not shown) or other means. The distance between the photoelectric detection device 300 and the display component of the imaging device 500 under test is approximately 12mm-22mm.
[0120] The photoelectric detection device 300 is connected to the time synchronization device 120, which in turn is connected to the processor 400. The photoelectric detection device 300 detects the refresh rate of the display component, acquires the signal indicating that the screen of the display component is lit, and sends this signal to the time synchronization device 120. The time synchronization device 120 then controls the image acquisition device 200 to acquire the display image of the display component, including the image of the imaging device under test 500, based on this signal. The image acquisition device 200 consists of two identical binocular cameras and is connected to the processor 400. The processor 400 can set the exposure time, gain, and imaging attributes of the image acquisition device 200. The light source device 110, image acquisition device 200, photoelectric detection device 300, and time synchronization device 120 share the same clock source, enabling the delay time detection system to achieve microsecond-level synchronization accuracy.
[0121] The processor 400 is used to control the operation of the imaging device under test 500 and to enter the VST mode, and to control the light source device 110 to operate at a preset frequency; the time synchronization device 120 is used to receive the acquisition command from the processor 400, start acquiring the signal from the photoelectric detection device 300 at a preset time T1, record the effective signal time T2, and synchronously trigger the image acquisition device 200 to acquire the display image of the imaging device under test 500; the processor 400 is also used to receive the display image acquired by the image acquisition device 200, and determine the photon capture time T3 of the imaging device under test 500 based on the display image; and determine the VST delay of the imaging device under test 500 according to the effective signal acquisition time T2 and the photon capture time T3.
[0122] When using a time delay detection system to detect the VST delay of the imaging device 500 under test, the processor 400 first controls the operation of the imaging device 500. The processor 400 controls the light source device 110 to operate at a preset frequency via the time synchronization device 120. The processor 400 can be any device with data processing capabilities, such as a computer. The time synchronization device 120 can be any device with data processing capabilities, such as a microcontroller or a computer.
[0123] Controlling the operation of the imaging device under test 500, that is, controlling the imaging device under test 500 to power on and enter VST mode. After entering VST mode, the event events of the camera of the imaging device under test 500 will continue to occur. Controlling the operation of the light source device 110, that is, controlling the light source device 110 to turn on. After turning on, the multiple light source components of the light source device 110 are lit sequentially, and only one light source component is lit at any given time.
[0124] The following explanation uses the example of all light source components lighting up sequentially from smallest to largest according to their serial numbers after the light source device 110 is activated:
[0125] When the delay level of the imaging device under test 500 is known, the preset frequency can be determined based on the delay level of the imaging device under test 500. When the delay level of the imaging device under test 500 is unknown, the preset frequency can be determined by gradually increasing the frequency of the light source device 110. When controlling the operation of the light source device 110, the brightness of the light source device 110 will also be set. The brightness needs to be set according to the brightness of the current test environment to ensure that the light source device 110 is not too bright or too dim when observed in the display image acquired by the image acquisition device 200.
[0126] After the imaging device 500 and the light source device 110 are running, the time synchronization device 120 receives the acquisition command from the processor 400, starts acquiring the signal from the photoelectric detection device 300 at a preset time T1, records the time when a valid signal is acquired as T2, and synchronously triggers the image acquisition device 200 to acquire an image at time T2. The processor 400 sends an acquisition command to the time synchronization device 120, wherein the acquisition command includes the preset time T1.
[0127] After receiving the acquisition command, the time synchronization device 120 begins acquiring the signal from the photoelectric detection device 300 at a preset time T1. When the imaging device under test 500 and the light source device 110 are running, the photoelectric detection device 300 is also in working condition, detecting the refresh generation signal of the display component of the imaging device under test 500 in real time. However, the time synchronization device 120 does not acquire this signal. After receiving the acquisition command, the time synchronization device 120 begins acquiring the signal from the photoelectric detection device 300 in real time at the preset time T1, and records the time when a valid signal is acquired as T2.
[0128] The preset time T1 is determined by taking the moment when the first light source component lights up after the light source device 110 starts operating as the initial time. After the light source device 110 starts operating, the moment when the first light source component in the light source device 110 lights up is taken as time 0. When the preset time T1 is reached, the time synchronization device 120 starts to collect the signal from the photoelectric detection device 300.
[0129] The preset time T1 needs to be set according to the delay level of the imaging device 500 under test. Specifically, the preset time T1 is greater than the nominal delay of the imaging device 500 under test, and less than or equal to the maximum delay measurement range of the light source device 110 at a preset frequency. The preset time T1 needs to be greater than the nominal delay of the imaging device 500 under test. If it is less than the nominal delay of the imaging device 500 under test, the lit light source component may not be observable in the display image acquired by the image acquisition device 200.
[0130] The nominal delay can be the delay roughly calibrated at the factory of the imaging device 500 under test. The maximum delay measurement range of the light source device 110 at a preset frequency is the time required for all light source components to be lit sequentially at the current preset frequency. For example, if the preset frequency of the light source device 110 is 1000Hz and the light source device 110 includes 100 light source components, the maximum delay measurement range of the light source device 110 is 100ms. If the preset frequency of the light source device 110 is 300Hz and the light source device 110 includes 100 light source components, the maximum delay measurement range of the light source device 110 is 333ms. If the preset frequency of the light source device 110 is 3000Hz and the light source device 110 includes 100 light source components, the maximum delay measurement range of the light source device 110 is 33ms.
[0131] For example, if the nominal delay of the imaging device under test 500 is 2ms and the preset frequency of the light source device 110 is 1000Hz, the preset time can be set to 3ms, and the preset time T1 is the lighting time of the fourth light source component. To satisfy the requirements of all VST delays for the imaging device under test 500, the lighting time of the last light source component of the light source device 110 can be used as the preset time T1. Assuming the frequency of the light source device 110 is 1000Hz, 99ms can be used as the preset time, which is the lighting time of the last light source component in the light source device 110.
[0132] The photoelectric detection device 300 detects the refresh of the display component of the imaging device 500 under test, and the photoelectric detection device 300 detects the effective signal of the display component at time T2. Two points need to be explained here: (1) The effective signal represents the signal when the screen of the display component is lit; (2) The signals of the photoelectric detection device 300 all correspond to the corresponding timestamps. The timestamp T2 when the photoelectric detection device 300 detects the effective signal can be directly obtained by the time synchronization device 120; or it can be calculated from the preset time T1, obtain the time difference between the preset time T1 and the time when the effective signal is collected, and then sum the time difference between the preset time T1 and the time when the effective signal is collected to determine the effective signal time T2. The time synchronization device 120 synchronously triggers the control of the image acquisition device 200 to acquire the image at time T2. The image acquisition device 200 sends the acquired display image to the processor 400.
[0133] When the time synchronization device 120 receives a valid signal at time T2, it synchronously controls the image acquisition device 200 to acquire an image, that is, controls the image acquisition device 200 to acquire the display image including the display component of the imaging device under test 500. The display component of the imaging device under test 500 is within the imaging range of the image acquisition device 200, meaning that the image acquisition device 200 can acquire the image currently displayed by the display component.
[0134] like Figure 7 The image shown is the display image acquired by the image acquisition device 200. After the light source device 110 starts operating, all light source components light up one by one in sequence. Since the imaging device under test 500 enters VST mode, events will continuously occur, and each event lasts for a period of time. This means the camera can continuously receive photons generated by the light source device 110 during this period. If multiple light source components light up one by one in sequence during this period, the camera can receive the photon signal generated by each lit light source component within this event. Therefore, the image generated by this event will show multiple light source components lit simultaneously. For example, if an event takes 11ms and the frequency of the light source device 110 is 1000Hz: if one event corresponds to 7 light source components lighting up in sequence, then the image generated by this event will show all 7 light source components lit. At this time, the image acquisition device 200 acquires the display image including the display components of the imaging device under test 500, and the display image will also show all 7 light source components lit.
[0135] After receiving the display image acquired by the image acquisition device 200, the processor 400 performs image processing on the display image to determine the photon capture time T3 of the imaging device under test 500; based on the effective signal acquisition time T2 and the photon capture time T3, it determines the VST delay of the imaging device under test 500. Here, the effective signal time T2 represents the time corresponding to the signal that the screen of the display component is lit, that is, the time when the display component of the imaging device under test 500 displays photons. The time when the imaging device under test 500 captures photons, i.e., the photon capture time T3, can be determined from the display image. Therefore, the VST delay of the imaging device under test 500 is determined based on the effective signal time T2 and the photon capture time T3.
[0136] This concludes the description of the delay time detection system in the embodiments of this application.
[0137] The delay detection method applied to this system is described below. This method includes steps 502-508. Wherein:
[0138] Step 502: Control the light source device to operate at a preset frequency so that the imaging device under test can acquire the image of the light source device and display it on the display component of the imaging device under test.
[0139] Step 504: Start acquiring signals from the photoelectric detection device at a preset time, record the time of valid signals, and simultaneously trigger the image acquisition device to acquire the display image of the imaging device under test.
[0140] Step 506: Receive the displayed image acquired by the image acquisition device, and determine the photon capture time of the imaging device under test based on the displayed image.
[0141] It can be understood that the image information with a Mark in the marked area in the displayed image can be used to locate the first light source component in the image that is lit up. Then, the photon capture time can be calculated based on the serial number of the light source component.
[0142] Determining the photon capture time of the imaging device under test based on the displayed image requires the use of a Mark detection algorithm. Specifically, the program that calls the Mark detection algorithm can identify a specific type of Mark in the displayed image, and then parse the Mark to obtain its encoded information, namely the sequence number and position identifier.
[0143] In this application, the specific type refers to the type of Mark obtained by encoding with serial number and position identifier in the embodiments of this application. It is understood that other information, such as the light source component area, may also exist in the displayed image. To avoid the Mark detection algorithm misidentifying other information, the Mark detection algorithm in this application embodiment can identify and process the Mark of this specific type. If the Mark of this specific type is not detected, the execution process of the Mark detection algorithm is terminated.
[0144] After identifying all identifiable light source markers (i.e., Marks) from the displayed image using the Mark detection algorithm, all light source component regions in the displayed image are determined based on all the light source markers; a first sequence number identifier of the first target light source component is determined based on all the light source component regions; and the photon capture time of the imaging device under test is determined based on the first sequence number identifier and the preset frequency of the light source device.
[0145] The first target light source component refers to the first light source component in the image that is lit. Whether it is lit or not can be determined by the average pixel value of the light source component area. Specifically, the average pixel value can be compared with a preset pixel value threshold. If the average pixel value is greater than the preset pixel value threshold, the corresponding light source component is determined to be lit. If the average pixel value is less than or equal to the preset pixel value threshold, the corresponding light source component is determined to be off.
[0146] The preset pixel value threshold can distinguish whether the light source component is on or off. For example, the preset pixel value threshold can be 100, 150, etc.
[0147] For example, the light source identifier is an encoded symbol, therefore, it needs to be decoded to obtain the information it carries, namely the position identifier and the sequence number identifier. That is, based on all the light source identifiers, the position identifier and the sequence number identifier corresponding to all the light source identifiers can be determined; then, based on all the position identifiers and the sequence number identifier, all light source component areas in the displayed image and the sequence number identifier corresponding to each light source component area can be determined.
[0148] Each light source component area can be obtained by moving its corresponding marked area; the method of movement is determined by position markers. For example, if the marked area is a square, the position markers include corner information and the distance moved, such as... Figure 4a As shown, the corner information, i.e., the coordinates of points P1 to P4, is moved to the left by this distance. Furthermore, the light source component area can also be constructed using position markers; that is, the light source component area is constructed based on the coordinates obtained after moving the corner information (i.e., the coordinate information) according to the distance in the position markers.
[0149] In summary, we can obtain the regions of each light source component. For example, if there are 100 light source components, we can obtain 100 corresponding light source component regions.
[0150] For how to determine the first sequence number identifier of the first target light source component based on all the aforementioned light source component regions, please refer to... Figure 7 As an example, this application provides three determination methods: traversal method, fast grouping method, and multi-threaded method. Wherein:
[0151] For the traversal method, the detection of lit component regions begins with any light source component region, and the detection of lit component regions in other light source component regions is performed sequentially, resulting in multiple lit component regions and a corresponding sequence number for each lit component region. The smallest corresponding sequence number is found among the multiple lit component regions and used as the first sequence number of the first target light source component.
[0152] The rapid grouping method involves first dividing all the light source component areas into multiple light source groups according to a preset number, then detecting the lit component area of the first light source component area in each light source group to determine the first target lit component area; starting from the first target lit component area, detecting lit component areas in the direction of decreasing sequence number; and using the sequence number corresponding to the last detected lit component area as the first sequence number of the first target light source component.
[0153] The preset quantity can be set as needed, and this embodiment does not impose any restrictions.
[0154] For example, by detecting the lit component region of the first light source component region in each light source group, one, two, or more first target lit component regions can be obtained. For instance, if the number of light source component regions is 100, and the corresponding sequence number of the light source components can be sequentially 1-100, with a preset number of 10, then 10 light source groups can be obtained. The sequence number of the light source component corresponding to the first light source component region of each light source group is 1, 11, 21, and so on. Accordingly, the first target lit component region may be one, two, or more; for example, if the first target lit component region is one, the corresponding sequence number is 21.
[0155] Accordingly, if there is only one first target lighting component area, then the lighting component area detection is performed starting from the first target lighting component area and proceeding in the direction of decreasing sequence number; if no lighting component area is detected, then the sequence number corresponding to the first target lighting component area is used as the first sequence number of the first target light source component; if a lighting component area is detected, then the sequence number corresponding to the last detected lighting component area is used as the first sequence number of the first target light source component.
[0156] If there are two or more first target lighting component areas, first determine the first target lighting component area corresponding to the smallest sequence number from each first target lighting component area, and then detect lighting component areas starting from the first target lighting component area corresponding to the smallest sequence number and moving in the direction of decreasing sequence number; if no lighting component area is detected, the sequence number corresponding to the first target lighting component area corresponding to the smallest sequence number is used as the first sequence number of the first target light source component; if a lighting component area is detected, the sequence number corresponding to the last detected lighting component area is used as the first sequence number of the first target light source component.
[0157] For the multi-threaded method, based on the sequence number identifier corresponding to each light source component area, the lighting component area is detected starting from the first light source component area and proceeding in the direction of increasing sequence number identifier; the sequence number identifier corresponding to the first detected lighting component area is used as the first sequence number identifier of the first target light source component.
[0158] In addition, while detecting the illuminated component area starting from the first light source component area and moving in the direction of increasing serial number, the detection of the illuminated component area can also start from the last light source component area and move in the direction of decreasing serial number.
[0159] For both detection directions, detection stops in both directions when the first target light source component is detected in either direction. Specifically, if a lit component area is detected first in a detection direction that starts from the first light source component area and proceeds in a direction with increasing serial numbers, then the serial number corresponding to the first lit component area is taken as the first serial number of the first target light source component. If a lit component area is detected in a detection direction that starts from the last light source component area and proceeds in a direction with decreasing serial numbers, detection continues until an extinguished component area is detected first.
[0160] For the latter of the two detection directions mentioned above, if an area of the extinguished component is detected, the serial number of the last lit component area detected during the continued detection will be used as the first serial number of the first target light source component.
[0161] For example, after determining the first sequence number identifier based on the above three determination methods, the photon acquisition time T3 of the imaging device under test can be determined based on the first sequence number identifier using the following formula:
[0162] T3 = Ts × v (I)
[0163] Where Ts is the first serial number identifier; v is the speed at which the light source component moves when it produces the "marquee" effect, which can be calculated by the preset frequency, i.e., the reciprocal of the preset frequency.
[0164] Step 508: Determine the VST delay of the imaging device under test based on the effective signal time and the photon capture time.
[0165] For example, VST delay may include the exposure time of the VR headset's camera, or it may not include the exposure time of the VR headset's camera.
[0166] The VST delay includes the exposure time of the VR headset's camera. This VST delay can be directly determined based on the effective signal time and the photon capture time. Specifically, the VST delay T can be determined using the following formula:
[0167] T = T1 + ΔT – T3 (II)
[0168] Where T1 is the preset time mentioned above, ΔT is the time difference between the preset time T1 and the effective signal time T2, i.e., T1+ΔT=T2; T3 is the photon capture time.
[0169] For the VST delay excluding the exposure time of the camera for the VR headset, the VST delay can be determined based on the effective signal time, the photon capture time, and the exposure duration. Specifically, the VST delay T can be determined using the following formula:
[0170] T = T1 + ΔT – T3 - Texp (III)
[0171] Where T1 is the preset time mentioned above, ΔT is the time difference between the preset time T1 and the effective signal time T2, i.e., T1+ΔT=T2; T3 is the photon capture time; and Texp is the exposure time.
[0172] The following explains how to determine the exposure time Texp:
[0173] The exposure time Texp can be determined after all light source component areas in the displayed image are determined, and based on all light source component areas, the second sequence number identifier of the second target light source component is determined, and the exposure time of the imaging device under test is determined based on the first sequence number identifier, the second sequence number identifier, and the preset frequency of the light source device.
[0174] Among them, the second target light source component refers to the light source component with the largest serial number among the light source components that are in the lit state.
[0175] The exposure time Texp can be determined using the following formula:
[0176] Texp=(Te–Ts)×v (4)
[0177] Where Te refers to the second serial number identifier, Ts refers to the first serial number identifier, and v is the speed at which the light source component moves when it produces the "marquee" effect. It can be calculated by the preset frequency, which is the reciprocal of the preset frequency.
[0178] For example, the method for determining the second sequence number identifier is similar to that for determining the first sequence number identifier, and can also be referred to... Figure 7 As one example, this application also provides three determination methods: traversal method, fast grouping method, and multi-threading method. Wherein:
[0179] For the traversal method, the detection of lit component regions begins with any light source component region, and the detection of lit component regions in other light source component regions is performed sequentially, resulting in multiple lit component regions and a corresponding sequence number for each lit component region. The largest sequence number is found among the multiple lit component regions and used as the second sequence number for the second target light source component.
[0180] The rapid grouping method involves first dividing all the light source component areas into multiple light source groups according to a preset number, then detecting the lit component area of the first light source component area in each light source group to determine the second target lit component area; starting from the second target lit component area, detecting lit component areas in the direction of increasing sequence number; and using the sequence number corresponding to the last detected lit component area as the second sequence number of the second target light source component.
[0181] The preset quantity can be set as needed, and this embodiment does not impose any restrictions.
[0182] For example, by detecting the lit component region of the first light source component region in each light source group, one, two, or more second target lit component regions can be obtained. For instance, if the number of light source component regions is 100, and the corresponding light source component serial numbers can be sequentially numbered 1-100, with a preset quantity of 10, then 10 light source groups can be obtained. The serial numbers of the light source components corresponding to the first light source component region of each light source group are 1, 11, 21, and so on. Correspondingly, there may be one, two, or more second target lit component regions; for example, if there is only one second target lit component region, its corresponding serial number is 21.
[0183] Accordingly, if there is only one first target lighting component area, then the lighting component area is detected starting from the second target lighting component area and proceeding in the direction of increasing sequence number. If no lighting component area is detected, then the sequence number corresponding to the second target lighting component area is used as the second sequence number of the second target light source component. If a lighting component area is detected, then the sequence number corresponding to the last detected lighting component area is used as the second sequence number of the second target light source component.
[0184] If there are two or more second target lighting component areas, first determine the second target lighting component area corresponding to the largest sequence number from each second target lighting component area, and then detect lighting component areas starting from the second target lighting component area corresponding to the largest sequence number and moving in the direction of increasing sequence number; if no lighting component area is detected, the sequence number corresponding to the second target lighting component area corresponding to the largest sequence number is used as the second sequence number of the second target light source component; if a lighting component area is detected, the sequence number corresponding to the last detected lighting component area is used as the second sequence number of the second target light source component.
[0185] For the multi-threaded method, based on the sequence number of each light source component area, the lighting component area is detected starting from the last light source component area and moving in the direction of decreasing sequence number; the sequence number of the first detected lighting component area is used as the second sequence number of the second target light source component.
[0186] Furthermore, the second sequence number identifier can also be determined through the embodiments corresponding to the two detection directions mentioned above. The difference in specific implementation is that in this embodiment, the second sequence number identifier is determined, rather than the first sequence number identifier. The specific determination process will not be described in detail here.
[0187] The following combination Figure 8 An optional embodiment of the detection process of the system is described, which includes steps 1 to 5, wherein:
[0188] Step 1: Set the light source flicker frequency and brightness, that is, set the lighting frequency and brightness of the light source components in the light source device.
[0189] Step 2: Set the PD working relative to the light source start time T1, that is, set the preset time of the photodiode. When the time synchronization device reaches the preset time, the signal of the photodiode is collected.
[0190] Step 3: Record the time difference ΔT between the generation time (i.e., effective signal time T2) of the PD response pulse signal when the screen refreshes and the preset time T1.
[0191] Step 4: Use the pulse signal of the PD response to trigger the detection camera to capture the image under the VR headset's perspective view, and call the program corresponding to the delay time detection method to calculate the photon capture time T3 through the image.
[0192] Step 5: Calculate the final delay value (VST delay) T = T1 + ΔT - T3 based on the time values obtained above.
[0193] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0194] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0195] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0196] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A time measurement target plate characterized by, The time measurement target plate is used for determining the VST delay time of the imaging device to be measured; the time measurement target plate comprises a light source device; The light source device is provided with a light source area and a mark area; A plurality of light source components are arranged in the light source area according to a preset arrangement rule; a light source mark corresponding to the position of each light source component is arranged in the mark area; the light source components and the light source marks are arranged alternately, and each light source component corresponds to one light source mark; the light source mark is generated based on the position mark and the serial number mark of the corresponding light source component; the position mark comprises the distance between the light source component and the corresponding light source mark and the angle point information; the light source mark is used for determining the area of all light source components in the display image; the display image is the image of the light source device collected by the imaging device to be measured and displayed on the display component of the imaging device to be measured; When the time measurement target plate is in operation, the plurality of light source components of the light source device are lighted up at a preset frequency.
2. The time measurement target plate according to claim 1, characterized by The time measurement target plate further comprises a time synchronization device; The time synchronization device is connected with the light source device and an external device to realize the clock synchronization of the light source device and the external device.
3. The time measurement target plate according to claim 1, wherein The plurality of light source components are arranged in a linear arrangement or an array arrangement.
4. The time measurement target plate according to claim 1, wherein The light source mark comprises a two-dimensional code mark.
5. A delay time detection system characterized by, The delay time detection system is used for realizing the delay time detection of the imaging device to be measured, and comprises the time measurement target plate according to any one of claims 1 to 4, an image collection device, a photoelectric detection device and a processor; The time synchronization device and the image collection device are respectively connected with the processor; the light source device, the image collection device and the photoelectric detection device are respectively connected with the time synchronization device; The imaging device to be measured is arranged between the time measurement target plate and the image collection device, and is used for collecting the image of the light source device and displaying the image on the display component of the imaging device to be measured; The image collection device is used for collecting the display image comprising the display component of the imaging device to be measured, and transmitting the display image to the processor; The photoelectric detection device is arranged in front of the display component of the imaging device to be measured, and is used for detecting the refresh of the display component; The processor is used for controlling the light source device to operate at a preset frequency; The time synchronization device is used for receiving the collection instruction of the processor, starting to collect the signal of the photoelectric detection device at a preset time, recording the effective signal time and synchronously triggering the image collection device to collect the display image of the imaging device to be measured; The processor is further used for receiving the display image collected by the image collection device, determining the photon capture time of the imaging device to be measured based on the display image, and determining the VST delay time of the imaging device to be measured according to the effective signal time and the photon capture time.
6. A delay time detection method characterized by, The method is applied to the delay time detection system according to claim 5, and the method comprises: The light source device is controlled to operate at a preset frequency, so that the imaging device under test collects an image of the light source device and displays the image on a display component of the imaging device under test; At a preset time, a signal of the photodetector device is collected, an effective signal time is recorded, and an image collection device is triggered to collect a display image of the imaging device under test; The display image collected by the image collection device is received, and a photon capture time of the imaging device under test is determined based on the display image; According to the effective signal time and the photon capture time, a VST delay of the imaging device under test is determined.
7. The method of claim 6, wherein, The display image collected by the image collection device is received, and a photon capture time of the imaging device under test is determined based on the display image; According to the display image, all light source identifiers in the display image are identified; According to all the light source identifiers, all light source component regions in the display image are determined; According to all the light source component regions, a first serial number identifier of a first target light source component is determined; According to the first serial number identifier and the preset frequency of the light source device, a photon capture time of the imaging device under test is determined.
8. The method of claim 7, wherein, According to all the light source identifiers, corresponding position identifiers and serial number identifiers of all the light source identifiers are determined; According to all the position identifiers and serial number identifiers, all light source component regions in the display image and corresponding serial number identifiers of each light source component region are determined. The first serial number identifier of the first target light source component is determined by traversing all the light source component regions to detect light component regions and determining a plurality of light component regions and corresponding serial number identifiers of each light component region; 9. The method of claim 7, wherein, The corresponding smallest serial number identifier of the plurality of light component regions is taken as the first serial number identifier of the first target light source component. The first serial number identifier of the first target light source component is determined by taking the first light source component region as a starting position and detecting light component regions in the direction of increasing serial number identifier; The corresponding serial number identifier of the detected first light component region is taken as the first serial number identifier of the first target light source component.
10. The method of claim 7, wherein, The first serial number identifier of the first target light source component is determined by dividing all the light source component regions into a plurality of light source groups in a preset number; The first serial number identifier of the first target light source component is determined by taking the first light source component region as a starting position and detecting light component regions in the direction of increasing serial number identifier; The corresponding serial number identifier of the detected last light component region is taken as the first serial number identifier of the first target light source component.
11. The method of claim 7, wherein, The display image collected by the image collection device is received, and a photon capture time of the imaging device under test is determined based on the display image; 12. The method of claim 7, wherein, According to all the light source component areas, a second serial number of a second target light source component is determined; According to the first serial number, the second serial number, and a preset frequency of the light source device, an exposure time of the imaging equipment under test is determined.
13. The method of claim 12, wherein, The determining of the second serial number of the second target light source component according to all the light source component areas comprises: All the light source component areas are traversed to detect the light component areas, and a plurality of light component areas and a serial number corresponding to each light component area are determined; The serial number corresponding to the largest light component area in the plurality of light component areas is taken as the second serial number of the second target light source component.
14. The method of claim 12, wherein, The determining of the second serial number of the second target light source component according to all the light source component areas comprises: According to the serial number corresponding to each light source component area, a light component area detection is performed in a direction of decreasing serial number from a last light source component area as a starting position; The serial number corresponding to a first detected light component area is taken as the second serial number of the second target light source component.
15. The method of claim 12, wherein, The determining of the second serial number of the second target light source component according to all the light source component areas comprises: All the light source component areas are divided into a plurality of light source groups in a preset number; A second target light component area is determined by detecting a first light source component area in each light source group; A light component area detection is performed in a direction of increasing serial number from the second target light component area as a starting position; The serial number corresponding to a last detected light component area is taken as the second serial number of the second target light source component.
16. The method of any one of claims 12-15, wherein, The determining of the VST delay of the imaging equipment under test according to the effective signal time and the photon capture time comprises: The VST delay of the imaging equipment under test is determined according to the effective signal time, the photon capture time, and the exposure time.
Citation Information
Patent Citations
LED light strip detection device and method for backlight sources
CN110488515A
LED light source identification method and device based on deep learning, equipment and medium
CN117611929A
Delay time detection system
CN118573846A