Light source synchronization method
By calculating the target delay time to synchronize the light source, the problem of poor synchronism of the light source in the prior art is solved, and the delay time test is inaccurate, achieving higher measurement accuracy and accuracy.
Patent Information
- Application Number
- PCT/CN2024/131806
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-04
- Filing Date
- 2024-11-13
- Publication Date
- 2025-06-12
AI Technical Summary
The prior art lacks effective means to avoid coupling and interference from delay time tests by factors such as the exposure timing of the camera module, the display frame rate and duty cycle of the display module, and affect the accuracy of the test results.
A light source synchronization method is proposed. By obtaining the unit period and unit exposure time of the image sensor, as well as the first delay time from the industrial control machine to the display device, the target delay time is calculated to ensure that the light time of the flashing stripes is aligned with the exposure start time of the image sensor, and the synchronization of the light source is achieved.
Through the light source synchronization method, the accuracy and accuracy of delay measurement are significantly improved, the impact of test results is reduced, and the delay time of the equipment to be tested can be more accurately reflected.
Smart Images

Figure CN2024131806_12062025_PF_FP_ABST
Abstract
Description
Light source synchronization method
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is based on the Chinese patent application with application number: 202311651480.3 and application date of December 4, 2023, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application as a reference. Technical Field
[0003] The present application relates to the field of delay measurement, and in particular to a light source synchronization method. Background Art
[0004] Extended Reality (XR) devices can create virtual environments and allow users to interact with real-world scenes. XR devices are integrated devices, and their latency is constrained by various factors, including hardware, algorithms, and usage scenarios. Related technologies lack an effective method to prevent the coupling and interference of factors such as the camera module's exposure timing, the display module's frame rate, and the duty cycle on latency testing, thereby affecting test results.
[0005] Summary of the Invention
[0006] This application aims to solve at least one of the technical problems existing in the prior art. To this end, this application proposes a light source synchronization method that ensures that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor, achieving light source synchronization with high control precision and accuracy.
[0007] In a first aspect, the present application provides a light source synchronization method, the method comprising:
[0008] Acquiring a unit cycle corresponding to an image sensor during an image acquisition process, a unit exposure duration of the image sensor, and a first delay time from an industrial computer to a display device; the industrial computer is configured to send a control signal to the display device so that the display device displays flickering stripes in response to the control signal; and the image sensor is configured to capture the flickering stripes displayed by the display device.
[0009] Calculating a target delay time based on the unit period, the unit exposure duration, and the first delay time;
[0010] Before the image sensor is exposed for the first target time, the control signal is sent to the display device in advance by the target delay time.
[0011] According to the light source synchronization method of the present application, the target delay time is calculated by the unit period of the image sensor of the device to be tested, the unit exposure time and the first delay time from the industrial computer to the display device, so as to control the lighting of the flashing stripes based on the target delay time, thereby ensuring that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor, realizing the synchronization of the light source, and the control precision and accuracy are high.
[0012] According to one embodiment of the present application, the calculating the target delay time based on the unit period, the unit exposure duration, and the first delay time includes:
[0013] Obtaining a non-exposure duration based on a difference between the unit period and the unit exposure duration;
[0014] determining, based on the first delay time and the unit period, a remaining delay time corresponding to the first delay time when the image sensor is exposed for a second target time;
[0015] A target delay time is calculated based on the remaining delay time, the non-exposure time, the unit period, the unit exposure time, and the first delay time.
[0016] According to one embodiment of the present application, the target delay time is calculated based on the remaining delay time, the non-exposure time, the unit cycle, the unit exposure time, and the first delay time, including:
[0017] When the remaining delay time is less than the non-exposure time, a difference between the remaining delay time and the unit exposure time is subtracted from the unit period as the target delay time;
[0018] When the remaining delay time is not less than the non-exposure time, the sum of the difference and the unit period is determined as the target delay time.
[0019] According to one embodiment of the present application, the calculating the target delay time based on the unit period, the unit exposure duration, and the first delay time includes:
[0020] When the lighting cycle of the flashing stripes is an integer multiple of the unit cycle and the first delay time is an integer multiple of the unit cycle, the difference between the unit cycle and the unit exposure time is determined as the target delay time.
[0021] In a second aspect, the present application provides a delay measurement method, which is applied to a measurement system for measuring a device to be measured, wherein the measurement system includes a display device and a detection device, and the display device is electrically connected to the detection device; the method includes:
[0022] Before the first target exposure of the image sensor of the device under test, a control signal is sent to the display device in advance by a target delay time, wherein the control signal is used to control the display device to display flickering stripes; the target delay time is calculated based on a unit cycle corresponding to the image sensor during image acquisition, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device;
[0023] When the display device displays the flickering stripes, the display device sends first light intensity information generated based on the flickering stripes to the detection device; the image sensor acquires second light intensity information from the flickering stripes and sends the second light intensity information to the detection device;
[0024] The detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received.
[0025] According to the delay measurement method of the present application, the target delay time is obtained by calculation so that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor to achieve light source synchronization. On this basis, the delay measurement is performed based on the time difference between the first light intensity information sent by the display device and the second light intensity information sent by the device to be tested. The parameters of the device to be tested itself can be combined to reduce the impact on the test results, significantly improving the measurement precision and accuracy.
[0026] According to one embodiment of the present application, the display device sends first light intensity information generated based on the flickering stripes to the detection device; the image sensor collects the flickering stripes to obtain second light intensity information, and sends the second light intensity information to the detection device, including:
[0027] Combining the optical path signal corresponding to the first light intensity information and the optical path signal corresponding to the second light intensity information into one signal to obtain a target optical path signal;
[0028] The target optical path signal is sent to the detection device.
[0029] According to one embodiment of the present application, the device delay time includes at least one of a light-up delay time and a dark-down delay time; the detection device calculates the device delay time of the device under test based on the time of receiving the first light intensity information and the time of receiving the second light intensity information, including:
[0030] Extracting a first time corresponding to a first rising edge, a second time corresponding to a second rising edge, a third time corresponding to a first falling edge, and a fourth time corresponding to a second falling edge from the target optical path signal;
[0031] Obtaining the lighting delay time based on the difference between the second time and the first time;
[0032] The dark delay time is obtained based on the difference between the fourth time and the third time.
[0033] According to one embodiment of the present application, when the first target time is multiple times, the detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received, including:
[0034] Obtaining a second delay time corresponding to each of the first target times based on a time at which the first light intensity information is received and a time at which the second light intensity information is received at each of the first target times;
[0035] An average of multiple second delay times is taken to obtain the device delay time.
[0036] In a third aspect, the present application provides a measurement system, comprising:
[0037] a display device configured to display flashing stripes and generate first light intensity information in response to a control signal received from an industrial computer and sent in advance by a target delay time; the target delay time being calculated based on a unit cycle corresponding to an image sensor during image acquisition, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device;
[0038] A detection device, wherein the detection device is electrically connected to the display device and the device to be tested, respectively, and the detection device is used to calculate the device delay time of the device to be tested based on the time of receiving the first light intensity information and the time of receiving the second light intensity information, wherein the second light intensity information is generated by the device to be tested collecting the flashing stripes displayed by the display device.
[0039] In a fourth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the light source synchronization method as described in the first aspect or the delay measurement method as described in the second aspect.
[0040] In a fifth aspect, the present application provides a computer program product, comprising a computer program, which, when executed by a processor, implements the light source synchronization method as described in the first aspect or the delay measurement method as described in the second aspect.
[0041] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:
[0042] The target delay time is calculated through the unit period and unit exposure time of the image sensor of the device under test and the first delay time from the industrial computer to the display device. The flashing stripes are controlled to light up based on the target delay time, thereby ensuring that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor, achieving synchronization of the light source with high control precision and accuracy.
[0043] Furthermore, by setting the flashing stripe cycle and the delay from the industrial computer to the control screen, the lighting cycle of the flashing stripes is an integer multiple of the unit cycle, and the first delay time is an integer multiple of the unit cycle, so there is no need to adjust the target delay time according to the delay of the industrial computer. On the basis of ensuring the control accuracy and achieving light source synchronization, it also makes the calculation simpler and more convenient.
[0044] Furthermore, the target delay time is calculated to align the lighting time of the flashing stripes with the exposure start time of the image sensor to achieve light source synchronization. On this basis, the delay measurement is performed based on the time difference between the first light intensity information sent by the display device and the second light intensity information sent by the device under test. The parameters of the device under test itself can be combined to reduce the impact on the test results, significantly improving the measurement precision and accuracy.
[0045] Furthermore, by setting a display device for displaying flickering stripes, a device to be tested and a detection device for collecting flickering stripes, the flickering stripes can be used for long-term collection, statistical average, and improved credibility; the target delay time is obtained by calculating the parameters of the device to be tested, and the flickering stripes are controlled to light up based on the target delay time to ensure that the lighting time of the flickering stripes is aligned with the exposure start time of the image sensor. On this basis, the delay time of the device to be tested is measured based on the time difference between the rising edge and the falling edge of the collected signal, which has high measurement precision and accuracy, simple and easy operation, and low design cost.
[0046] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0048] FIG1 is a schematic diagram of a process flow of a light source method provided in an embodiment of the present application;
[0049] FIG2 is a schematic diagram of a structure of a measurement system according to an embodiment of the present application;
[0050] FIG3 is a schematic diagram of the principle of the light source and the method provided in an embodiment of the present application;
[0051] FIG4 is a second schematic diagram of the principle of the light source and the method provided in an embodiment of the present application;
[0052] FIG5 is a third schematic diagram of the principle of the light source and the method provided in an embodiment of the present application;
[0053] FIG6 is a fourth schematic diagram of the principle of the light source and the method provided in an embodiment of the present application;
[0054] FIG7 is a flow chart of a delay measurement method according to an embodiment of the present application;
[0055] FIG8 is a schematic diagram showing one of the principles of the delay measurement method provided in an embodiment of the present application;
[0056] FIG9 is a second schematic diagram of the principle of the delay measurement method provided in an embodiment of the present application;
[0057] FIG10 is a second structural diagram of a measurement system provided in an embodiment of the present application;
[0058] FIG11 is a schematic structural diagram of a light source synchronization device provided in an embodiment of the present application;
[0059] FIG12 is a schematic structural diagram of a delay measurement device provided in an embodiment of the present application;
[0060] FIG13 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0061] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0062] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0063] The light source synchronization method, delay measurement method, measurement system and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.
[0064] The light source synchronization method and the delay measurement method may be applied to a terminal, and may be specifically executed by hardware or software in the terminal.
[0065] The light source synchronization method and delay measurement method provided in the embodiments of the present application may be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the light source synchronization method and delay measurement method. The electronic devices mentioned in the embodiments of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, and wearable devices. The light source synchronization method and delay measurement method provided in the embodiments of the present application are described below using electronic devices as the execution entities as an example.
[0066] As shown in FIG1 , the light source synchronization method includes: step 110 , step 120 and step 130 .
[0067] The light source synchronization method can be applied to perform delay measurement on a device under test.
[0068] The device under test may be a terminal integration device.
[0069] As shown in FIG2 , in some embodiments, the device under test may be an XR device under test, which includes an image sensor and a display light machine. The image captured by the image sensor will be displayed on the display light machine.
[0070] Step 110: Obtain a unit period corresponding to the image sensor during image acquisition, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device; the industrial computer is configured to send a control signal to the display device so that the display device displays flickering stripes in response to the control signal; and the image sensor is configured to capture the flickering stripes displayed by the display device.
[0071] In this step, the industrial computer is used for program control and data processing, is electrically connected to the display device, and is used to send a control signal to the display device so that the display device displays flickering stripes in response to the control signal.
[0072] The flashing stripes light up / dim down based on a certain cycle.
[0073] Continuing with reference to FIG2 , in some embodiments, the flickering stripe may be located at the center of the control screen of the display device, the width of the flickering stripe may be the width of the control screen, and the height of the flickering stripe may be single-digit pixels.
[0074] During the actual synchronization process, the device under test can be placed in front of the control screen of the display device, with the center aligned with the center of the control screen. The device under test can be fixed with the bracket installed on the storage platform. After turning on the VST perspective mode, the image sensor in the device under test will capture the content of the control screen of the display device.
[0075] The unit period is the duration of each frame of image captured by the image sensor, that is, the refresh period, which is denoted by T below.
[0076] The unit exposure duration of the image sensor is the duration of exposure of the image sensor in one unit period, which is denoted by T2 below, where T>T2.
[0077] The first delay time is the signal transmission delay time between the industrial computer and the control screen of the display device, hereinafter represented by D0.
[0078] It is understandable that the type of industrial computer and the distance between it and the control screen may have different corresponding first delay times; the parameters of the image sensor may have different corresponding unit periods and unit exposure times.
[0079] Step 120: Calculate a target delay time based on the unit period, the unit exposure time, and the first delay time;
[0080] In this step, the target delay time is used to synchronize the exposure of the image sensor with the time when the flickering stripes are displayed on the control screen of the display device, that is, while the flickering stripes are displayed on the control screen, the image sensor is exposed to capture the image.
[0081] The following description takes the device to be tested as an XR device as an example.
[0082] By entering the XR device's VST mode, the device's optical refresh period, T, can be measured. By configuring the industrial computer to output flickering stripes on the control screen, the initial delay from the industrial computer to the control screen can be measured as D0. Without precise control of the stripe period, the measurement cannot guarantee that the on / off timing of the stripes falls within the image sensor's camera exposure time. Let T2 be the camera's unit exposure time within a unit period, T:
[0083] If the time point when the stripes light up / dark down is within T2, the image will be displayed on the screen after being processed in the current cycle, as shown in case 1 in Figure 3.
[0084] If the time point when the stripes light up / dark down is outside T2, the image will be displayed on the screen after the next cycle processing, as shown in case 2 in Figure 3.
[0085] It is understandable that the true value of the PTP delay is (Tc-Ta). When (Tc-Tb) remains unchanged, the time point of image sensor exposure capture is not synchronized with the timing of the stripes lighting up / darkening, which will affect the time (Tb-Ta), thereby introducing changes in the true value of the delay (Tc-Ta), that is, the flickering stripe period and the camera's beating. At this time, the PTP delay of the XR device will fluctuate within a range of 1 frame, thus affecting the experimental test results.
[0086] In this application, we analyze the camera acquisition mode of XR devices:
[0087] Image sensors using different exposure methods (including Rolling Shutter and Global Shutter) can determine their accurate exposure time by eliciting their fsync signal.
[0088] Taking the Global Shutter as an example, its unit period is the same as that of the optical engine, T. During each frame, the image sensor is exposed and drives the fsync signal high / low. The ideal synchronization between image sensor exposure and stripe timing is shown in case 0 in Figure 4: Through the fsync signal, the flashing timing of the control panel's flashing stripes can be precisely controlled, aligning their light-up time, Ta, with the start time of image sensor exposure.
[0089] In this step, the fsync signal can be used to obtain the target delay time corresponding to the Nth fsync occurrence based on the duration and transformation between the unit period, the unit exposure time, and the first delay time, so that after the Nth fsync occurs, the lighting time Ta of the flashing stripes is aligned with the exposure start time of the image sensor.
[0090] Step 130 : Before the first target exposure of the image sensor, send a control signal to the display device in advance by a target delay time.
[0091] In this step, the first target times can be based on user customization, such as being set to N+1 times or N+2 times.
[0092] The Nth exposure of the image sensor may be represented by the occurrence of the Nth fsync signal.
[0093] For example, when the Nth fsync signal appears, the industrial computer sends a control signal to the display device in advance by the target delay time. After receiving the control signal, the display device immediately responds to control the flashing stripes to light up on the control screen. At the same time, the fsync signal controls the exposure of the image sensor so that the exposure start time of the image sensor is aligned with the lighting time of the flashing stripes, thereby achieving synchronization of the light source.
[0094] According to the light source synchronization method provided in the embodiment of the present application, the target delay time is calculated by the unit period of the image sensor of the device to be tested, the unit exposure time and the first delay time from the industrial computer to the display device, so as to control the lighting of the flashing stripes based on the target delay time, thereby ensuring that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor, realizing the synchronization of the light source, and the control precision and accuracy are high.
[0095] The specific implementation of step 120 is described below from different perspectives.
[0096] In some embodiments, step 120 may include:
[0097] Based on the difference between the unit period and the unit exposure duration, the non-exposure duration is obtained;
[0098] Determine, based on the first delay time and the unit period, a remaining delay time corresponding to the first delay time when the image sensor is exposed for a second target time;
[0099] The target delay time is calculated based on the remaining delay time, the non-exposure time, the unit period, the unit exposure time, and the first delay time.
[0100] In this embodiment, the non-exposure time duration is the duration during which the image sensor is in a non-exposed state within one unit period, that is, (T-T2).
[0101] As shown in FIG5 and FIG6 , in an actual execution process, the remaining delay time can be obtained based on the remainder of the quotient of the first delay time D0 and the unit period T.
[0102] In some embodiments, the first delay time D0 and the unit period T may be processed by a modulo operation to obtain the remaining delay time.
[0103] After obtaining the remaining delay time, the relationship between the remaining delay time and the non-exposure time is determined. As shown in FIG5 , if the remaining delay time is less than the non-exposure time, the target delay time D1 can be directly introduced within the unit cycle to achieve light source synchronization; as shown in FIG6 , if the remaining delay time is not less than the non-exposure time, the target delay time D1 needs to be introduced within the next unit cycle to achieve light source synchronization.
[0104] In some embodiments, calculating the target delay time based on the remaining delay time, the non-exposure time, the unit period, the unit exposure time, and the first delay time may include:
[0105] If the remaining delay time is less than the non-exposure time, the difference between the unit period and the remaining delay time and the unit exposure time is determined as the target delay time.
[0106] When the remaining delay time is not less than the non-exposure time, the sum of the difference and the unit period is determined as the target delay time.
[0107] In this embodiment, as shown in FIG5 , when the remaining delay time is less than the non-exposure time, that is, when the sum of the remaining delay time and the exposure time T2 is less than the unit period T, when the fsync signal appears N times, the difference between the unit period T and the remaining delay time and the unit exposure time T2 is determined as the target delay time D1, that is, D1 = T-(D0 mod T)-T2. At this time, the industrial computer introduces the target delay time D1 to synchronize the stripe lighting time with the exposure time.
[0108] Wherein, N=Floor(T1 / T)-Floor(D0 / T)-1; T1 is the lighting period of the flashing stripes.
[0109] As shown in Figure 6, when the remaining delay time is not less than the non-exposure time, that is, the sum of the remaining delay time and the unit exposure time T2 is not less than the unit period T, when the fsync signal appears N times, the sum of the difference between the unit period T minus the remaining delay time and the unit exposure time T2 and the unit period T is determined as the target delay time D1, that is, D1 = 2T-(D0 mod T)-T2. At this time, the industrial computer introduces the target delay time D1 to achieve synchronization between the stripe lighting time and the exposure time.
[0110] Wherein, N=Floor(T1 / T)-Floor(D0 / T)-2; T1 is the lighting period of the flashing stripes.
[0111] According to the light source synchronization method provided in the embodiment of the present application, the target delay time corresponding to the Nth exposure is adjusted in real time through the first delay time of the industrial computer. It is applicable to any model of industrial computer, has a wide range of application scenarios and universality, and has high control precision and accuracy.
[0112] In some embodiments, step 120 may include:
[0113] When the lighting cycle of the flashing stripes is an integer multiple of the unit cycle and the first delay time is an integer multiple of the unit cycle, the difference between the unit cycle and the unit exposure time is determined as the target delay time.
[0114] In this embodiment, the lighting cycle of the flashing stripe, that is, the duration of continuous lighting of the flashing stripe in one blinking cycle, is represented by T1.
[0115] The lighting period T1 of the flashing stripes is an integer multiple of the unit period T, that is, T1 mod T=0.
[0116] The first delay time D0 is an integer multiple of the unit period T, that is, D0 mod T=0.
[0117] In some embodiments, the lighting cycle of the flashing stripes and related parameters of the image sensor can be designed based on actual needs, such as setting the flashing stripe cycle and the delay from the industrial computer to the control screen so that the lighting cycle of the flashing stripes is an integer multiple of the unit cycle, and the first delay time is an integer multiple of the unit cycle.
[0118] In this case, when N fsync signals are received, the difference between the unit period T and the unit exposure time T2 is determined as the target delay time D1, that is, D1 = T-T2. At this time, the industrial computer introduces the target delay time D1 to synchronize the stripe lighting time with the exposure time.
[0119] Wherein, N=(T1-D0) / T-1.
[0120] It should be noted that the value of N can be customized by the user and can be selected based on actual needs.
[0121] According to the light source synchronization method provided in the embodiment of the present application, by setting the flashing stripe period and the delay from the industrial computer to the control screen, the lighting period of the flashing stripes is an integer multiple of the unit period, and the first delay time is an integer multiple of the unit period, so there is no need to adjust the target delay time according to the delay of the industrial computer. On the basis of ensuring the control accuracy to achieve light source synchronization, it also makes the calculation simpler and more convenient.
[0122] The embodiment of the present application also provides a delay measurement method.
[0123] The delay measurement method is applied to a measurement system, which includes a display device, a device to be tested, and a detection device.
[0124] The display device and the device to be tested are electrically connected to the detection device respectively.
[0125] As shown in FIG. 7 , the delay measurement method includes: step 710 , step 720 , and step 730 .
[0126] The delay measurement is applied to a measurement system for measuring a device to be measured. The measurement system includes a display device and a detection device, and the display device is electrically connected to the detection device.
[0127] Step 710: Before the first target exposure of the image sensor of the device under test, a control signal is sent to the display device in advance by a target delay time, where the control signal is used to control the display device to display flickering stripes; the target delay time is calculated based on a unit cycle corresponding to the image sensor during image acquisition, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device;
[0128] In this step, the target delay time can be calculated based on the light source synchronization method described in any of the above embodiments, and this application will not elaborate on it here.
[0129] The first target can be based on user customization.
[0130] The target delay time can be determined based on the light source synchronization method described in any of the above embodiments, which will not be described in detail here.
[0131] The control signal is used to control the display device to display flickering stripes on the control screen.
[0132] For example, when receiving N fsync signals, before receiving the next fsync signal, the industrial computer sends a control signal to the display device in advance by the target delay time D1; after the display device receives the control signal, it immediately controls the flashing stripes on the control screen to light up.
[0133] Step 720: When the display device displays flickering stripes, the display device sends first light intensity information generated based on the flickering stripes to the detection device; the image sensor collects the flickering stripes to obtain second light intensity information, and sends the second light intensity information to the detection device;
[0134] In this step, the first light intensity information is light intensity information generated by the display device to display flickering stripes.
[0135] The second light intensity information is acquired by an image sensor of the device to be tested.
[0136] During the actual execution process, when receiving N fsync signals, before receiving the next fsync signal, the industrial computer sends a control signal to the display device in advance by the target delay time D1; after the display device receives the control signal, it immediately controls the flashing stripes on the control screen to light up; when the flashing stripes light up, the display device sends the first light intensity information of the control screen to the detection device.
[0137] At the same time as the flashing stripes light up, the next fsync signal is received. The fsync signal controls the exposure of the image sensor of the device under test, thereby collecting the flashing stripes that light up on the control screen at the same time to generate second light intensity information. The device under test sends the second light intensity information to the detection device.
[0138] Step 730: The detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received.
[0139] In this step, the device delay time is the delay of the device under test itself, which is affected and restricted by various factors such as its own hardware, algorithm, and usage scenario.
[0140] During the actual detection process, affected by the speed of signal transmission, the detection device can receive the first light intensity information and the second light intensity information successively, and then calculate the device delay time of the device under test based on the difference in time between the received first light intensity information and the second light intensity information.
[0141] During the research and development process, the inventors discovered that in related technologies, the real scene is often captured by a camera module and then transmitted to its display screen to measure the delay based on the time displayed on the display screen. Due to differences in parameters such as the hardware module and the frame rate of the display module, this method causes the actual true value of the delay to be measured to be a variable with a certain fluctuation range, thereby affecting the accuracy of the test and making it impossible for developers to clearly understand the impact of minor improvements to XR devices on the delay time through test results.
[0142] In this application, the target delay time is calculated so that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor to achieve light source synchronization. The coupling and interference of the exposure of the camera module and the display frame rate of the display module on the delay time test can be considered. By combining the parameters of the device under test itself to reduce the impact on the test results, the measurement precision and accuracy are significantly improved, which helps developers to clarify the impact of minor improvements to the device under test on the delay time through test results.
[0143] According to the delay measurement method provided in the embodiment of the present application, the target delay time is obtained by calculation so that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor to achieve light source synchronization. On this basis, the delay measurement is performed based on the time difference between the first light intensity information sent by the display device and the second light intensity information sent by the device to be tested. The parameters of the device to be tested itself can be combined to reduce the impact on the test results, significantly improving the measurement precision and accuracy.
[0144] In some embodiments, step 720 may include:
[0145] Combining the optical path signal corresponding to the first light intensity information and the optical path signal corresponding to the second light intensity information into one signal to obtain a target optical path signal;
[0146] Send the target optical path signal to the detection device.
[0147] In this embodiment, the target optical path signal includes an optical path signal corresponding to the first light intensity information and an optical path signal corresponding to the second light intensity information, and the target optical path signal is a one-path signal.
[0148] After the first light intensity information and the second light intensity information are generated, the two signals may be combined into one signal and input into a detection device for the detection device to perform delay measurement.
[0149] According to the delay measurement method provided in the embodiment of the present application, by combining the collected dual-path signals into a single path to enter the detection device, the high-cost equipment required for trigger synchronization at the acquisition end can be avoided, and the additional errors introduced by different specifications of the test equipment can be eliminated, thereby improving the accuracy of the collected signal.
[0150] In some embodiments, the device delay time includes at least one of a light-up delay time and a dark-down delay time; step 730 may include:
[0151] Extracting a first time corresponding to a first rising edge, a second time corresponding to a second rising edge, a third time corresponding to a first falling edge, and a fourth time corresponding to a second falling edge from the target optical path signal;
[0152] Based on the difference between the second time and the first time, the lighting delay time is obtained;
[0153] The dark delay time is obtained based on the difference between the fourth time and the third time.
[0154] In this embodiment, the target optical path signal is a single path signal obtained by combining two collected signals.
[0155] The first rising edge is the first rising edge corresponding to the target optical path signal within the fringe period.
[0156] The second rising edge is the second rising edge corresponding to the target optical path signal within the fringe period.
[0157] The first falling edge is the first falling edge corresponding to the target optical path signal within the fringe period.
[0158] The second falling edge is the second falling edge corresponding to the target optical path signal within the fringe period.
[0159] The following takes the device to be tested as an XR device as an example to specifically describe the implementation method of this application.
[0160] For example, during the actual test process, an overall measurement system as shown in Figure 2 is built to ensure that each device is placed in the specified position, and the XR device is placed in front of the OLED control screen of the display device at a target distance (such as 30mm or 40mm, etc.).
[0161] According to the light source synchronization method described in any of the above embodiments, based on the target delay time calculated according to the XR device parameters, the two flashing stripes are controlled to light up based on the target delay time, and according to the fsync signal induced by the camera exposure of the XR device, the precisely timed flashing stripes are displayed on the control screen to ensure that the exposure time of the image sensor is synchronized with the lighting time of the flashing stripes.
[0162] After the image acquisition is completed, the signal corresponding to the first light intensity information sent by the display device and the signal corresponding to the second light intensity information collected by the XR device are merged into one to obtain the target light path signal.
[0163] Turn on the detection equipment to receive the target optical path signal received within the target acquisition time, and use the industrial computer to save the data of the received target optical path signal changing with time, as shown in Figure 8, including two rising edges and two falling edges.
[0164] The target acquisition time can be user-defined, such as set to 5 minutes or 8 minutes, etc., which is not limited in this application.
[0165] Continuing to refer to Figure 8, taking the rising edge as an example, in each stripe cycle, the first light intensity jump time T0_up (i.e., the first time) represents that the control screen lights up, and the second rising light intensity jump time T1_up (i.e., the second time) represents that the XR display screen of the XR device lights up.
[0166] The time difference between the two rising edges can be roughly considered as the time difference between the control screen lighting up and the XR display lighting up. Based on the difference between the second time T1_up and the first time T0_up, the XR device lighting up delay time Delay_up can be obtained.
[0167] Taking the falling edge as an example, in each stripe cycle, the first light intensity drop time T0_down (i.e., the third time) represents the control screen going dark, and the second light intensity drop time T1_down (i.e., the fourth time) represents the XR display screen of the XR device going dark.
[0168] The time difference corresponding to the two falling edges can be approximately considered as the time difference between the control screen going dark and the XR display screen going dark. Based on the difference between the fourth time T1_down and the third time T0_down, the dark delay time Delay_down of the XR device can be obtained.
[0169] In some embodiments, the light-on delay time and the dark-off delay time can be obtained based on the following steps:
[0170] c.1 During the data processing phase, scintillation signals from two different sources enter Admesy. The collected data on light intensity changes over time will include two cycles with a delay signal at the millisecond level superimposed together.
[0171] c.2 Based on the positions of the rising and falling edges, four key time points can be identified:
[0172] The two rising edges indicate the time when the OLED display lights up and the time when the XR device lights up: T0_up and T1_up, respectively.
[0173] Two drops: T0_down and T1_down respectively represent the time when the OLED display goes dark and the XR device goes dark.
[0174] c.3 By calculating the time interval between the two rise times, the light-up delay time Delay_up of the XR device can be obtained.
[0175] c.4 By calculating the time interval between the two drops, the dark delay time Delay_down of the XR device can be obtained.
[0176] The specific extraction method of the first rising edge, the second rising edge, the first falling edge and the second falling edge is described below:
[0177] Identify the first rise and fall points (the control screen lights up and dims):
[0178] a. Record half the brightness of the flashing stripes displayed on the control screen as I0.
[0179] b. Start from the starting point of the data and traverse the data points where the light intensity changes with time.
[0180] c. Find the first point (called I1) whose strength with the next two points satisfies the following conditions: I1<I0,I2> I0, I3>I0.
[0181] d.I1 marks the point of the first rise, and its time coordinate is T0_up.
[0182] e. Next, find the first point (called I1) whose intensity satisfies the following conditions with the following two points: I1>I0, I2 <I0,I3<I0。
[0183] f.I1 marks the point of the first drop, and its time coordinate is T0_down.
[0184] Identify the second rise and fall points (XR device display lights up and dims):
[0185] a. Calculate the minimum and maximum values of the 10-200 data points after the first rising point, recording them as min and max, respectively. These points correspond to the brightness of the control screen when it is on and the brightness of the control screen when it is on plus the brightness of the XR device display.
[0186] b. Calculate the threshold value T1 = 0.5*(max+min).
[0187] c. Start traversing from the data point after the first rising point.
[0188] d. Find the first point (called I4) that satisfies the following conditions: I4>T1
[0189] e.I4 marks the second rising point, indicating that the XR device display lights up, and its time coordinate is T1_up.
[0190] f. Similarly, calculate the minimum and maximum values of the 10-200 data points after the first drop point, and then calculate the threshold value T2 = 0.5*(max+min).
[0191] g. Start traversing from the data point after the first drop point.
[0192] h. Find the first point (called I5) that satisfies the following conditions: I5 <T2
[0193] i.I5 marks the second drop point, indicating that the XR device display goes dark, and its time coordinate is T1_down.
[0194] Of course, in other embodiments, other methods may be used to extract the first rising edge, the second rising edge, the first falling edge, and the second falling edge, which is not limited in this application.
[0195] As shown in FIG9 , in some embodiments, when the first target time is multiple times, the detection device calculates the device delay time of the device under test based on the time of receiving the first light intensity information and the time of receiving the second light intensity information, which may include:
[0196] Based on the time of receiving the first light intensity information at each first target time and the time of receiving the second light intensity information at each first target time, a second delay time corresponding to each first target time is obtained;
[0197] An average of multiple second delay times is taken to obtain the device delay time.
[0198] In this embodiment, the first rising edge, the second rising edge, the first falling edge, and the second falling edge within a plurality of fringe periods may be collected.
[0199] For each stripe cycle, the light-up delay time and dark-down delay time of the device under test corresponding to the stripe cycle can be obtained based on the above method, thereby obtaining multiple light-up delay times and multiple dark-down delay times.
[0200] The average of multiple light-up delay times is taken as the final light-up delay time, so as to obtain the average light-up delay time of the device under test under long-term operation.
[0201] The average of multiple dark delay times is taken as the final dark delay time, and the average dark delay time of the device under test under long-term operation can be obtained.
[0202] According to the delay measurement method provided in the embodiment of the present application, by taking the average of the light-up delay time and dark-down delay time corresponding to multiple stripe flashing cycles, the average light-up delay time and average dark-down delay time of the device under test under long-term operation can be obtained, with high precision and accuracy.
[0203] An embodiment of the present application also provides a measurement system.
[0204] As shown in FIG10 , the measurement system includes: a display device and a detection device.
[0205] In this embodiment, the display device is used to display flashing stripes and generate first light intensity information in response to a control signal sent by the industrial computer in advance of the target delay time; the target delay time is calculated based on the unit period corresponding to the image sensor during the image acquisition process, the unit exposure time of the image sensor, and the first delay time from the industrial computer to the display device.
[0206] The detection device is electrically connected to the display device and the device to be tested respectively. The detection device is used to calculate the device delay time of the device to be tested based on the time of receiving the first light intensity information and the time of receiving the second light intensity information. The second light intensity information is generated by the device to be tested collecting the flashing stripes displayed by the display device.
[0207] The detection device is used to perform delay measurement based on the delay measurement method described in any of the above embodiments, which will not be described in detail in this application.
[0208] The device to be tested is arranged in front of the display device, and is used to collect the flickering stripes displayed by the display device and generate second light intensity information.
[0209] In some embodiments, the detection device may include an Admesy meter.
[0210] In some embodiments, the detection device may be a light intensity measurement device with a high dynamic range and a low response time.
[0211] The following continues to take the device to be tested as an XR device as an example to specifically explain the implementation method of this application.
[0212] During the actual test process, an overall measurement system as shown in Figure 2 can be built to ensure that each device is placed in the specified position and the XR device is placed in front of the OLED control screen of the display device at a target distance (such as 30mm or 40mm, etc.).
[0213] As shown in Figure 10, the dual optical fibers of the transmission module are installed, with the input port of one optical fiber aligned with the center of the OLED display; the input port of the other optical fiber is fixed behind the XR device and aligned with the single-channel display screen of the XR device to collect the intensity changes of the flickering stripes in the VST mode.
[0214] Fix the output port of the dual optical fibers to ensure that the light beams can fully enter the light intensity detection equipment.
[0215] Turn on the XR device and control screen, and set the flashing stripe timing according to the XR device parameters based on the target delay time calculated by the light source synchronization method described in any of the above embodiments, so as to display the flashing stripes with precise timing on the control screen according to the fsync signal induced by the XR device camera exposure.
[0216] Turn on the flicker measurement mode of the Admesy measuring instrument, set the target acquisition time (such as 5 minutes or 8 minutes, etc.), and use the industrial computer to save the data of light intensity variation over time collected by the Admesy measuring instrument (that is, the data of target optical path signal variation over time), as shown in Figures 8 and 9.
[0217] Based on the time-varying behavior of the target optical path signal, the two rising edges within the fringe period are extracted. The light-up delay time of the device under test is measured based on the time difference between the two rising edges; the dark-down delay time of the device under test is measured based on the time difference between the two falling edges.
[0218] According to an embodiment of the present application, a measurement system is provided. By setting a display device for displaying flickering stripes, a device to be tested and a detection device for collecting flickering stripes, the flickering stripes can be used for long-term collection, statistical average, and improved credibility; a target delay time is obtained by calculating the parameters of the device to be tested, and the flickering stripes are controlled to light up based on the target delay time to ensure that the lighting time of the flickering stripes is aligned with the exposure start time of the image sensor. On this basis, the delay time of the device to be tested is measured based on the time difference between the rising edge and the falling edge of the collected signal. The system has high measurement precision and accuracy, is simple and easy to implement, and has a low design cost.
[0219] In some embodiments, the measurement system may further include: a first fiber coupling lens, a second fiber coupling lens, a target fiber, a first fiber, and a second fiber.
[0220] In this embodiment, the first fiber coupling lens is a fiber coupling lens corresponding to a control screen of the display device, and the first fiber coupling lens is provided at an output end of the display device.
[0221] The second fiber coupling lens is a fiber coupling lens corresponding to the display screen of the device under test, and the second fiber coupling lens is arranged at the output end of the device under test.
[0222] The target optical fiber is connected to the input end of the detection device.
[0223] The first optical fiber is connected between the first optical fiber coupling lens and the target optical fiber, and the second optical fiber is connected between the second optical fiber coupling lens and the target optical fiber, that is, the first optical fiber and the second optical fiber are combined into one path through the target optical fiber.
[0224] Continuing with the example of an XR device as the device to be tested, during the actual measurement process, the XR device to be tested is placed in front of the control screen of the measurement system, with its center aligned with the center of the measurement system control screen, and the XR device is fixed by a human head model installed on the placement platform.
[0225] After turning on the VST perspective mode, flickering stripes will also appear on the display light machine of the XR device. The intensity changes of the flickering stripes on the control screen of the measurement system and the display light machine of the XR device each pass through the fiber coupling lens, converge and enter the two optical fibers, and after transmission, the two paths are combined into one path at the output end and enter the detection device.
[0226] According to the measurement system provided in the embodiment of the present application, by adopting dual-path acquisition and entering the detection device as a single path, the high-cost equipment required for trigger synchronization at the acquisition end is avoided, and the additional errors introduced by different specifications of the test equipment are eliminated, which can further improve the measurement accuracy.
[0227] The light source synchronization method provided in the embodiment of the present application can be executed by a light source synchronization device. In the embodiment of the present application, the light source synchronization device provided in the embodiment of the present application is described by taking the light source synchronization method performed by the light source synchronization device as an example.
[0228] An embodiment of the present application also provides a light source synchronization device.
[0229] As shown in FIG. 11 , the light source synchronization device includes a first processing module 1110 , a second processing module 1120 and a third processing module 1130 .
[0230] The first processing module 1110 is configured to obtain a unit period corresponding to an image sensor during an image acquisition process, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device; the industrial computer is configured to send a control signal to the display device so that the display device displays flickering stripes in response to the control signal; and the image sensor is configured to capture the flickering stripes displayed by the display device.
[0231] The second processing module 1120 is configured to calculate a target delay time based on the unit period, the unit exposure time, and the first delay time;
[0232] The third processing module 1130 is configured to send a control signal to the display device in advance by a target delay time before the first target exposure of the image sensor.
[0233] According to the light source synchronization device provided in the embodiment of the present application, the target delay time is calculated by the unit period of the image sensor of the device to be tested, the unit exposure time and the first delay time from the industrial computer to the display device, so as to control the lighting of the flashing stripes based on the target delay time, thereby ensuring that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor, realizing the synchronization of the light source, and the control precision and accuracy are high.
[0234] In some embodiments, the second processing module 1120 may be configured to:
[0235] Based on the difference between the unit period and the unit exposure duration, the non-exposure duration is obtained;
[0236] Determine, based on the first delay time and the unit period, a remaining delay time corresponding to the first delay time when the image sensor is exposed for a second target time;
[0237] The target delay time is calculated based on the remaining delay time, the non-exposure time, the unit period, the unit exposure time, and the first delay time.
[0238] In some embodiments, the second processing module 1120 may be configured to:
[0239] If the remaining delay time is less than the non-exposure time, the difference between the unit period and the remaining delay time and the unit exposure time is determined as the target delay time.
[0240] When the remaining delay time is not less than the non-exposure time, the sum of the difference and the unit period is determined as the target delay time.
[0241] In some embodiments, the second processing module 1120 may be configured to:
[0242] When the lighting cycle of the flashing stripes is an integer multiple of the unit cycle and the first delay time is an integer multiple of the unit cycle, the difference between the unit cycle and the unit exposure time is determined as the target delay time.
[0243] An embodiment of the present application also provides a delay measurement device.
[0244] As shown in Figure 12, the delay measurement device is applied to a measurement system, which includes a display device, a device under test and a detection device, and the display device and the device under test are electrically connected to the detection device respectively; it includes: a fourth processing module 1210, a fifth processing module 1220 and a sixth processing module 1230.
[0245] The fourth processing module 1210 is configured to send a control signal to the display device in advance of a target delay time before the first target exposure of the image sensor of the device under test, wherein the control signal is used to control the display device to display flickering stripes; the target delay time is calculated based on a unit cycle corresponding to the image sensor during image acquisition, a unit exposure time of the image sensor, and a first delay time from the industrial computer to the display device;
[0246] A fifth processing module 1220 is configured to, when the display device displays flickering stripes, cause the display device to send first light intensity information generated based on the flickering stripes to the detection device; acquire second light intensity information from the flickering stripes using an image sensor, and send the second light intensity information to the detection device;
[0247] The sixth processing module 1230 is configured to enable the detection device to calculate the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received.
[0248] According to the delay measurement device provided in the embodiment of the present application, the target delay time is obtained by calculation so that the lighting time of the flashing stripes is aligned with the exposure start time of the image sensor to achieve light source synchronization. On this basis, the delay measurement is performed based on the time difference between the first light intensity information sent by the display device and the second light intensity information sent by the device to be tested. The parameters of the device to be tested itself can be combined to reduce the impact on the test results, significantly improving the measurement precision and accuracy.
[0249] In some embodiments, the fifth processing module 1220 may also be configured to:
[0250] Combining the optical path signal corresponding to the first light intensity information and the optical path signal corresponding to the second light intensity information into one signal to obtain a target optical path signal;
[0251] Send the target optical path signal to the detection device.
[0252] In some embodiments, the device delay time includes at least one of a light-up delay time and a dark-down delay time; the sixth processing module 1230 may also be used to:
[0253] Extracting a first time corresponding to a first rising edge, a second time corresponding to a second rising edge, a third time corresponding to a first falling edge, and a fourth time corresponding to a second falling edge from the target optical path signal;
[0254] Based on the difference between the second time and the first time, the lighting delay time is obtained;
[0255] The dark delay time is obtained based on the difference between the fourth time and the third time.
[0256] In some embodiments, when the first target number is multiple, the sixth processing module 1230 may also be configured to:
[0257] Based on the time of receiving the first light intensity information at each first target time and the time of receiving the second light intensity information at each first target time, a second delay time corresponding to each first target time is obtained;
[0258] An average of multiple second delay times is taken to obtain the device delay time.
[0259] The light source synchronization device or delay measurement device in the embodiments of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application are not specifically limited.
[0260] The light source synchronization device or delay measurement device in the embodiment of the present application can be a device having an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0261] The light source synchronization device or delay measurement device provided in the embodiments of the present application can implement the various processes implemented in the method embodiments of Figures 1 to 9. To avoid repetition, they will not be described here.
[0262] In some embodiments, as shown in Figure 13, an embodiment of the present application also provides an electronic device 1300, including a processor 1301, a memory 1302, and a computer program stored on the memory 1302 and runnable on the processor 1301. When the program is executed by the processor 1301, each process of the above-mentioned light source synchronization method or delay measurement method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0263] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0264] An embodiment of the present application also provides a non-transitory computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the various processes of the above-mentioned light source synchronization method or delay measurement method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0265] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0266] An embodiment of the present application further provides a computer program product, including a computer program, which implements the above-mentioned light source synchronization method or delay measurement method when executed by a processor.
[0267] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0268] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned light source synchronization method or delay measurement method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0269] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0270] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0271] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0272] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
[0273] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
[0274] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and intent of the present application, and that the scope of the present application is defined by the claims and their equivalents.
Claims
1. A method for synchronizing light sources, characterized in that, it includes: Obtaining the unit period corresponding to the image sensor during image acquisition, the unit exposure duration of the image sensor, and the first delay time from the industrial control computer to the display device; The industrial control computer is used to send a control signal to the display device so that the display device displays a flashing stripe in response to the control signal; the image sensor is used to collect the flashing stripe displayed by the display device; Based on the unit period, the unit exposure duration, and the first delay time, calculate the target delay time; Before the first target exposure of the image sensor, send the control signal to the display device in advance by the target delay time.
2. The method for synchronizing light sources according to claim 1, characterized in that, The calculating the target delay time based on the unit period, the unit exposure duration, and the first delay time includes: Based on the difference between the unit period and the unit exposure duration, obtain the non-exposure duration; Based on the first delay time and the unit period, determine the remaining delay time corresponding to the first delay time in the case of the second target exposure of the image sensor; Based on the remaining delay time, the non-exposure duration, the unit period, the unit exposure duration, and the first delay time, calculate the target delay time.
3. The method for synchronizing light sources according to claim 2, characterized in that, The calculating the target delay time based on the remaining delay time, the non-exposure duration, the unit period, the unit exposure duration, and the first delay time includes: In the case where the remaining delay time is less than the non-exposure duration, determine the difference between the unit period minus the remaining delay time and the unit exposure duration as the target delay time; In the case where the remaining delay time is not less than the non-exposure duration, determine the sum of the difference value and the unit period as the target delay time.
4. The method for synchronizing light sources according to any one of claims 1-3, characterized in that, The calculating the target delay time based on the unit period, the unit exposure duration, and the first delay time includes: In the case where the lighting period of the flashing stripe is an integer multiple of the unit period and the first delay time is an integer multiple of the unit period, determine the difference between the unit period and the unit exposure duration as the target delay time.
5. A method for measuring delay, characterized in that, Applied to a measurement system for measuring a device under test, the measurement system includes a display device and a detection device, and the display device is electrically connected to the detection device; the method includes: Before the first target sub-exposure of the image sensor of the device under test, a control signal is sent to the display device with a target delay time in advance, and the control signal is used to control the display device to display a flashing stripe; the target delay time is calculated based on the unit cycle corresponding to the image sensor during the image acquisition process, the unit exposure duration of the image sensor, and the first delay time from the industrial control computer to the display device; When the display device displays the flashing stripe, the display device sends first light intensity information generated based on the flashing stripe to the detection device; the image sensor collects the flashing stripe to obtain second light intensity information and sends the second light intensity information to the detection device; The detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received.
6. The delay measurement method according to claim 5, wherein, the display device sends first light intensity information generated based on the flashing stripe to the detection device; the image sensor collects the flashing stripe to obtain second light intensity information and sends the second light intensity information to the detection device, including: merging the optical path signal corresponding to the first light intensity information and the optical path signal corresponding to the second light intensity information into one signal to obtain a target optical path signal; sending the target optical path signal to the detection device.
7. The delay measurement method according to claim 6, wherein, the device delay time includes at least one of the light-up delay time and the dark-down delay time; the detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received, including: extracting the first time corresponding to the first rising edge, the second time corresponding to the second rising edge, the third time corresponding to the first falling edge, and the fourth time corresponding to the second falling edge in the target optical path signal; obtaining the light-up delay time based on the difference between the second time and the first time; obtaining the dark-down delay time based on the difference between the fourth time and the third time.
8. The delay measurement method according to any one of claims 5-7, wherein, when the first target times are multiple, the detection device calculates the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received, including: obtaining the second delay time corresponding to each of the first target times based on the time when the first light intensity information is received and the time when the second light intensity information is received under each of the first target times; taking the average of the multiple second delay times to obtain the device delay time.
9. A measurement system, wherein, comprising: a display device, which is configured to display a flashing stripe and generate first light intensity information in response to a control signal sent by an industrial control computer with a target delay time in advance; The target delay time is calculated based on the unit cycle corresponding to the image sensor during image acquisition, the unit exposure duration of the image sensor, and the first delay time from the industrial control computer to the display device; A detection device, which is electrically connected to the display device and the device under test respectively. The detection device is used to calculate the device delay time of the device under test based on the time when the first light intensity information is received and the time when the second light intensity information is received. The second light intensity information is generated by the device under test collecting the flashing stripes displayed by the display device.
10. The measurement system according to claim 9, characterized in that, it further comprises: A first fiber optic coupling lens, which is arranged at the output end of the display device; A second fiber optic coupling lens, which is arranged at the output end of the device under test; A target optical fiber, which is connected to the input end of the detection device; A first optical fiber, which is connected between the first fiber optic coupling lens and the target optical fiber; A second optical fiber, which is connected between the second fiber optic coupling lens and the target optical fiber.
11. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, when the processor executes the program, it implements the light source synchronization method according to any one of claims 1-4 or the delay measurement method according to any one of claims 5-8.
12. A non-transitory computer-readable storage medium, on which a computer program is stored, characterized in that, when the computer program is executed by a processor, it implements the light source synchronization method according to any one of claims 1-4 or the delay measurement method according to any one of claims 5-8.
13. A computer program product, comprising a computer program, characterized in that, when the computer program is executed by a processor, it implements the light source synchronization method according to any one of claims 1-4 or the delay measurement method according to any one of claims 5-8.
Citation Information
Patent Citations
High-precision imaging delay testing device and method
CN110933397A
Image sensor dynamic transfer function phase deviation correction method and correction device
CN111385562A
Measurement system, method and device, computer equipment and storage medium
CN114007062A
Light source synchronization method, delay measurement method and measurement system
CN117768638A
Image pickup apparatus capable of performing image pickup with reduced flicker influence, method for controlling the same, and storage medium
US20200007737A1