Method, system, electronic device and storage medium for acquiring an infrared video delay
By capturing infrared and normal video of the blackbody state transition process using infrared imaging equipment and a high-speed camera, and obtaining the delay through frame analysis, the complex problem of infrared video delay detection in existing technologies is solved, achieving fast and simple delay acquisition, which is suitable for applications with high real-time requirements.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-08
- Publication Date
- 2026-03-27
AI Technical Summary
Existing methods for detecting video delay in infrared thermal imaging systems are complex, require signal analysis instruments and equipment, and are difficult to set up in test environments, which affects applications with high real-time requirements.
Infrared video and normal video of the blackbody state transition process are captured by an infrared imaging device and a high-speed camera, respectively. The time difference between video frames is obtained by frame-by-frame analysis, and the imaging delay of the infrared video is calculated.
It enables rapid and simple acquisition of infrared video latency, making it suitable for applications with high real-time requirements, such as vehicle video driving warning systems.
Smart Images

Figure CN115801982B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the field of infrared video, and particularly relates to a method and system for acquiring infrared video delay. BACKGROUND
[0002] With the rapid development of infrared detection technology, infrared thermal imaging systems are increasingly applied to various aspects of production and life. When performing video processing, an infrared thermal imaging processing system usually causes a delay in the video signal stream, and image delay is an important parameter for investigation in some use cases with relatively high real-time requirements. For example, if the image delay is large, the vehicle video driving early warning system will affect the obstacle collision early warning, which may cause serious consequences. Therefore, it is of great significance to accurately and conveniently detect the delay of an infrared thermal imaging system.
[0003] Existing infrared thermal imaging image delay test technologies usually have a complex test method, and most of them need to use signal analysis instrument equipment or complex test fixtures, and the test environment is not easy to build. SUMMARY
[0004] The main purpose of the embodiment of the present application is to provide a method and system for acquiring infrared video delay, an electronic device and a storage medium. The same conversion process of a black body can be photographed by a normal device and an infrared device to obtain a normal video and an infrared video, and the infrared imaging delay can be obtained by the normal video and the infrared video, so that the infrared imaging delay is quickly and simply obtained.
[0005] In a first aspect, a method for acquiring infrared video delay is provided, and the method comprises the following steps:
[0006] An infrared video of a conversion process of a black body converted from a first state to a second state is photographed by an infrared imaging device, and a normal video of a display device used for displaying the infrared video and the conversion process is photographed by a high-speed camera;
[0007] A first time point when the conversion process is completed on the external display device is obtained by frame-by-frame analysis of the normal video, and a second time point when the conversion process is completed in the normal video is obtained;
[0008] A difference between the first time point and the second time point is obtained, and the difference is determined as the imaging delay of the infrared video.
[0009] In one possible implementation, when the first state is that the black body is completely shielded, the second state is that the black body is completely displayed; when the first state is that the black body is completely displayed, the second state is that the black body is completely shielded.
[0010] In another possible implementation, the shielding or displaying of the black body comprises:
[0011] The baffle shields or displays the black body from a horizontal direction; or
[0012] The baffle shields or displays the black body from a vertical direction; or
[0013] The baffle shields or displays the black body in a rotating manner.
[0014] In another possible implementation, the method further includes:
[0015] The shooting time of the normal video is recorded by a timing device arranged in a shooting range of the high-speed camera.
[0016] In a second aspect, a system for acquiring an infrared video delay is provided, and the system includes:
[0017] An infrared video and normal video acquisition module is configured to acquire, by an infrared imaging device, an infrared video of a conversion process in which a black body is converted from a first state to a second state, and acquire, by a high-speed camera, a normal video of a display device used for displaying the infrared video and the conversion process;
[0018] A first time point and a second time point acquisition module is configured to analyze the normal video frame by frame to acquire a first time point at which the conversion process is completed on the display device, and a second time point at which the conversion process is completed in the normal video;
[0019] An imaging delay acquisition module is configured to acquire a difference between the first time point and the second time point, and determine the difference as an imaging delay of the infrared video.
[0020] In one possible implementation, when the first state is completely shielding the black body, the second state is completely displaying the black body; and when the first state is completely displaying the black body, the second state is completely shielding the black body.
[0021] In another possible implementation, the shielding or displaying the black body includes:
[0022] The baffle shields or displays the black body from a horizontal direction; or
[0023] The baffle shields or displays the black body from a vertical direction; or
[0024] The baffle shields or displays the black body in a rotating manner.
[0025] In another possible implementation, the system further includes:
[0026] A timing unit is configured to record the shooting time of the normal video by a timing device arranged in a shooting range of the high-speed camera.
[0027] In a third aspect, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the method for acquiring the infrared video delay according to the first aspect when executing the program.
[0028] In a fourth aspect, a non-transitory computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program, and the computer program is executable on a processor to implement the method for acquiring the infrared video delay according to the first aspect. BRIEF DESCRIPTION OF DRAWINGS
[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced.
[0030] Figure 1 A flow chart of the method for acquiring the infrared video delay provided by an embodiment of the present application is provided.
[0031] Figure 2 A structural diagram of the system for acquiring the infrared video delay provided by an embodiment of the present application is provided.
[0032] Figure 3 An entity structure diagram of an electronic device of the present application is provided.
[0033] DETAILED DESCRIPTION
[0034] The embodiments of the present application will be described in detail below, and examples of the embodiments are shown in the drawings, in which the same or similar notations represent the same or similar modules or modules with the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and are only used to explain the present application, and cannot be interpreted as a limitation on the present application.
[0035] Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an" and "the" used herein also include the plural forms. It should be further understood that the phrase "comprising" used in the specification of the present application means that the features, integers, steps, operations, modules and / or components exist, but does not exclude the presence or addition of one or more other features, integers, steps, operations, modules, components and / or groups thereof. It should be understood that when we say a module is "connected" or "coupled" to another module, it can be directly connected or coupled to other modules, or there can be intermediate modules. In addition, "connected" or "coupled" used herein can include wireless connection or wireless coupling. The phrase "and / or" used herein includes all or any module and all combinations of the associated listed items.
[0036] In order to make the purpose, technical solutions and advantages of the present application clearer, the implementation manners of the present application will be described in further detail below with reference to the drawings.
[0037] The technical solutions of the present application and the solutions to the above technical problems will be described in detail below with specific examples. The following specific examples can be combined with each other, and the same or similar concepts or processes can not be described again in some examples. The embodiments of the present application will be described below with reference to the drawings.
[0038] As shown in Figure 1 Fig. 1 is a flowchart of a method for acquiring infrared video delay provided by an embodiment of the present application, and the method comprises the following steps:
[0039] Step 101: An infrared video of a conversion process of a blackbody from a first state to a second state is shot by an infrared imaging device, and a normal video of the conversion process and a display device for displaying the infrared video is shot by a high-speed camera.
[0040] Before shooting, the blackbody needs to be powered on and the temperature of the blackbody needs to be set. After the temperature of the blackbody reaches the set temperature, the infrared video and the normal video can be shot. The infrared imaging device can be connected with a display device or have a display device.
[0041] Step 102: The normal video is analyzed frame by frame to acquire a first time point when the conversion process is completed on the connected display device and a second time point when the conversion process is completed in the normal video.
[0042] As shown in Figure 2 The display device is connected with the infrared imaging device, the display device is used to display the infrared video output by the thermal imaging device, and the clock is used to record time. The shutter is moved quickly to expose the blackbody target window completely, the infrared imaging device captures the moving picture of the shutter and outputs the moving picture to the connected display device or the display device for display.
[0043] The high-speed camera records the pictures of the shutter, the blackbody, the clock and the display device, analyzes the recording of the high-speed camera frame by frame, and acquires the picture of the shutter completely unblocking the blackbody target window (the clock T1 picture) and the picture of the display device displaying the picture of the blackbody target window completely unblocked (the clock T2 picture) shot by the infrared imaging device.
[0044] Step 103: The difference between the first time point and the second time point is acquired, and the difference is determined as the imaging delay of the infrared video.
[0045] The difference between T2 and T1 (T2 is generally later than T1) is the imaging delay time of the infrared video.
[0046] In the embodiment of the present application, when the black body is in the hot state, the black body generates infrared rays that spread outward, and the infrared imaging device generates special display effects when shooting infrared videos. Since these special display effects are generated by infrared rays, when the infrared imaging device and the black body are shielded by a shield, the special display effects on the infrared video will disappear, so that the display-disappearance or disappearance-display process of the special display effects can be displayed on the external display device, and the process of the display-disappearance or disappearance-display is the first time point.
[0047] The high-speed camera that shoots normal videos not only shoots the process of the state conversion of the black body, but also shoots the entire conversion process displayed on the external display device, so that the high-speed camera can obtain the second time point when the black body is converted from the first state to the second state. The high-speed camera can capture motion images at an exposure time of less than 1 / 1000 second or a frame rate of more than 250 frames per second.
[0048] After the first time point and the second time point are obtained, the difference between the first time point and the second time point is calculated, which is the imaging delay of the infrared video and the normal image.
[0049] When the first state is completely shielding the black body, the second state is completely displaying the black body; when the second state is completely displaying the black body, the second state is completely shielding the black body.
[0050] In the embodiment of the present application, the normal imaging time and the infrared imaging time when the black body is converted from the first state to the second state need to be obtained, so the conversion can be from completely shielding the black body to completely displaying the black body, or from completely displaying the black body to completely shielding the black body. After the shield shields the black body, the infrared imaging device cannot shoot the picture of the black body target window.
[0051] The shielding or displaying of the black body includes:
[0052] The shield shields or displays the black body from the horizontal direction; or,
[0053] The shield shields or displays the black body from the vertical direction; or,
[0054] The shield shields or displays the black body in a rotating manner.
[0055] The embodiment of the present application can capture the infrared video of the conversion process of the black body from the first state to the second state by the infrared imaging device, capture the normal video of the conversion process and the external display device for displaying the infrared video by the high-speed camera; acquire the first time point when the conversion process is completed on the external display device by frame-by-frame analysis of the normal video, and acquire the second time point when the conversion process is completed in the normal video; acquire the difference between the first time point and the second time point, and determine the difference as the imaging delay of the infrared video. The same conversion process of the black body can be captured by the normal device and the infrared device to obtain the normal video and the infrared video, and the infrared imaging delay can be obtained by the normal video and the infrared video, so that the infrared imaging delay is quickly and simply obtained.
[0056] The test reference clock is generated by the clock display software running on the computer, and the precision reaches milliseconds. The clock picture is displayed in the format of'minute: second: millisecond'.
[0057] The baffle, the black body, the display device and the clock picture are in the imaging range of the high-speed camera. The imaging picture of the high-speed camera can show the process that the baffle completely covers the black body target surface window to the process that the baffle does not cover the black body target surface window, the process that the display device shows the baffle completely covering the black body target surface window to the process that the display device shows the baffle not covering the black body target surface window, and the clock picture.
[0058] The high-speed camera records the moving picture of the baffle, the display picture of the display device and the millisecond clock picture. The recording file on the high-speed camera is copied to the computer, frame-by-frame playing is performed by using the video playing software on the computer, the time (T1) of the clock picture when the baffle completely does not cover the black body target surface window is recorded, the time (T2) of the clock picture when the picture of the display device completely does not cover the black body target surface window is recorded, and the imaging delay time of the infrared imaging device for capturing the infrared video is calculated by T2-T1.
[0059] As an optional embodiment of the present application, the method further comprises:
[0060] The shooting time of the normal video is recorded by the timing device arranged in the shooting range of the high-speed camera.
[0061] In the embodiment of the present application, in order to make the effect of acquiring the time period by frame-by-frame analysis more accurate, the timing device can also be arranged in the shooting range of the high-speed camera, and the time of the timing device in the normal video can be directly calculated in the subsequent frame-by-frame analysis process, so as to acquire the first time point and the second time point.
[0062] As shown in Figure 3 Fig. 1 is a structure diagram of a system for acquiring the infrared video delay provided by an embodiment of the present application, and the system comprises:
[0063] The infrared video and normal video acquisition module 301 is configured to capture an infrared video of a conversion process of a black body from a first state to a second state by an infrared imaging device, and capture a normal video of an external display device used for displaying the infrared video and the conversion process by a high-speed camera.
[0064] Before shooting, the black body needs to be powered on and the black body temperature needs to be set, and after the temperature of the black body reaches the set temperature, the infrared video and the normal video can be shot. The infrared imaging device can be connected with the external display device or have a display device.
[0065] The first time point and the second time point acquisition module 302 is configured to analyze the normal video frame by frame to obtain a first time point when the conversion process is completed on the external display device, and a second time point when the conversion process is completed in the normal video.
[0066] The display device is connected with the infrared imaging device, and the display device is configured to display the infrared video output by the thermal imaging device, and the clock is configured to record time. The shutter is moved quickly to expose the black body target window completely, the infrared imaging device captures a moving picture of the shutter, and outputs the moving picture to the external display device or the display device to display.
[0067] The high-speed camera records pictures of the shutter, the black body, the clock and the display device, analyzes the recording of the high-speed camera frame by frame, and obtains a picture in which the shutter completely exposes the black body target window (a clock T1 picture) and a picture in which the display device displays the picture in which the black body target window is completely exposed (a clock T2 picture).
[0068] The imaging delay acquisition module 303 is configured to obtain a difference between the first time point and the second time point, and determine the difference as an imaging delay of the infrared video.
[0069] The difference between T2 and T1 (the time of T2 is generally later than the time of T1) is the imaging delay time of the infrared video.
[0070] In the embodiment of the present application, when the black body is in a hot state, the black body generates infrared rays that spread outward, and the infrared imaging device generates special display effects for the infrared rays when shooting the infrared video. Since the special display effects are generated by the infrared rays, when the infrared imaging device and the black body are shielded by a shielding object, the special display effects disappear on the infrared video, so that the display-disappearance or disappearance-display process of the special display effects can be displayed on the external display device, and the process of the display-disappearance or disappearance-display on the external display device is the first time point.
[0071] The high-speed camera that shoots normal video shoots the whole conversion process displayed on the external display device in addition to the process of the black body state conversion, so that the high-speed camera can obtain the second time point when the black body is converted from the first state to the second state.
[0072] After the first time point and the second time point are obtained, the difference between the first time point and the second time point is calculated, and the difference is the imaging delay of the infrared video and the normal image.
[0073] When the first state is that the black body is completely blocked, the second state is that the black body is completely displayed.
[0074] In the embodiment of the present application, the normal imaging time and the infrared imaging time when the black body is converted from the first state to the second state are obtained, so the conversion can be from completely blocking the black body to completely displaying the black body, or from completely displaying the black body to completely blocking the black body.
[0075] The blocking or displaying the black body includes:
[0076] The blocking or displaying the black body includes:
[0077] The blocking or displaying the black body includes:
[0078] The blocking or displaying the black body includes:
[0079] In the embodiment of the present application, the infrared video of the conversion process when the black body is converted from the first state to the second state is shot by the infrared imaging device, and the normal video of the external display device for displaying the infrared video and the conversion process is shot by the high-speed camera; the first time point when the conversion process is completed on the external display device is obtained by frame-by-frame analysis of the normal video, and the second time point when the conversion process is completed in the normal video is obtained; the difference between the first time point and the second time point is obtained, and the difference is determined as the imaging delay of the infrared video. The same conversion process of the black body can be shot by the normal video and the infrared video by the normal device and the infrared device, and the infrared imaging delay can be obtained by the normal video and the infrared video, so that the infrared imaging delay can be obtained quickly and simply.
[0080] The test reference clock is generated by a clock display software running on a computer, and the precision reaches milliseconds. The clock picture is displayed in the format of minutes: seconds: milliseconds.
[0081] The baffle, blackbody, display device, and clock image are all within the imaging range of the high-speed camera. The high-speed camera's image must show the process from the baffle completely obscuring the blackbody target window to the blackbody target window becoming unobstructed, the process from the baffle completely obscuring the blackbody target window to the blackbody target window becoming unobstructed as displayed on the display device, and the clock image.
[0082] The high-speed camera records the movement of the baffle, the display screen, and the millisecond clock image. The recorded video files are copied to a computer, and played back frame by frame using video playback software. The clock time (T1) when the baffle is completely unobstructed from the blackbody target window is recorded, and the clock time (T2) when the baffle is completely unobstructed from the blackbody target window on the display screen is recorded. Using T2-T1, the imaging delay time of the infrared video captured by the infrared imaging device is calculated.
[0083] As an optional embodiment of the present invention, the system further includes:
[0084] A timing unit is used to record the shooting time of the normal video using a timing device located within the shooting range of the high-speed camera.
[0085] In this embodiment of the invention, in order to make the effect of obtaining time periods through frame-by-frame analysis more accurate, a timing device can be set within the shooting range of the high-speed camera. In the subsequent frame-by-frame analysis process, the time change of the timing device in the normal video can be directly calculated to obtain the first time point and the second time point.
[0086] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4 As shown, the electronic device may include: a processor 401, a communication interface 402, a memory 403, and a communication bus 404, wherein the processor, communication interface, and memory communicate with each other through the communication bus. The processor can call logical instructions in the memory to execute a method for acquiring infrared video delay. The method includes: capturing infrared video of the transition process of a blackbody changing from a first state to a second state using an infrared imaging device; simultaneously capturing normal video of the transition process using a high-speed camera on an external display device for displaying the infrared video; performing frame-by-frame analysis on the normal video to acquire a first time point when the transition process is completed on the external display device, and a second time point when the transition process is completed in the normal video; acquiring the difference between the first time point and the second time point, and determining the difference as the imaging delay of the infrared video.
[0087] In addition, the logic instructions in the memory described above can be implemented in the form of software function units and sold or used as independent products, and can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.
[0088] In another aspect, the embodiments of the present application also provide a computer program product, which comprises a computer program stored on a non-transitory computer readable storage medium, and the computer program comprises program instructions, and when the program instructions are executed by a computer, the computer can execute the method for acquiring infrared video delay provided by the above-mentioned method embodiments. The method comprises: capturing, by an infrared imaging device, an infrared video of a conversion process of a black body from a first state to a second state, and simultaneously capturing, by a high-speed camera, a normal video of an external display device for displaying the infrared video and the conversion process; performing frame-by-frame analysis on the normal video to acquire a first time point when the conversion process is completed on the external display device, and a second time point when the conversion process is completed in the normal video; acquiring a difference value between the first time point and the second time point, and determining the difference value as an imaging delay of the infrared video.
[0089] In another aspect, the embodiments of the present application also provide a non-transitory computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method for acquiring infrared video delay provided by the above-mentioned embodiments. The method comprises: capturing, by an infrared imaging device, an infrared video of a conversion process of a black body from a first state to a second state, and simultaneously capturing, by a high-speed camera, a normal video of an external display device for displaying the infrared video and the conversion process; performing frame-by-frame analysis on the normal video to acquire a first time point when the conversion process is completed on the external display device, and a second time point when the conversion process is completed in the normal video; acquiring a difference value between the first time point and the second time point, and determining the difference value as an imaging delay of the infrared video.
[0090] It should be understood that although the steps in the flowcharts of the accompanying drawings are shown in a sequence as indicated by arrows, the steps are not necessarily executed in the order as indicated by the arrows. Unless explicitly stated otherwise herein, the execution of the steps is not necessarily limited to a strict order, and the steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts of the accompanying drawings can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of which is not necessarily sequential, but can be round-robin or alternating with at least some of the other steps or sub-steps or stages of other steps.
[0091] The above merely describes some implementation manners of the present application, and it should be noted that, for those skilled in the art, some improvements and refinements can be made without departing from the principles of the present application, and these improvements and refinements should also be considered as falling within the protection scope of the present application.
Claims
1. A method of acquiring an infrared video delay, characterized by, The method comprises: The infrared video of the conversion process of the black body from the first state to the second state is photographed by an infrared imaging device, and at the same time, the normal video of the display device used for displaying the infrared video and the conversion process is photographed by a high-speed camera; wherein the shutter is quickly moved to completely expose the black body target surface window, the infrared imaging device captures the moving picture of the shutter, and outputs the moving picture to the external display device or the display device with the picture displayed; The normal video is analyzed frame by frame to obtain the first time point when the conversion process is completed on the display device, and the second time point when the conversion process is completed in the normal video; wherein the shutter, the black body, the display device and the clock picture are in the imaging range of the high-speed camera, the high-speed camera records the shutter, the black body, the clock picture and the display device, analyzes the recording of the high-speed camera frame by frame, the high-speed camera obtains the picture of the second time point when the shutter completely unblocks the black body target surface window and the clock, and obtains the picture of the first time point when the display device displays the completely unblocked black body target surface window and the clock photographed by the infrared imaging device; The difference between the first time point and the second time point is obtained, and the difference is determined as the imaging delay of the infrared video; The first state is completely blocking the black body, and the second state is completely displaying the black body.
2. The method of claim 1, wherein, The blocking or displaying the black body comprises: The shutter blocks or displays the black body from the horizontal direction; or The shutter blocks or displays the black body from the vertical direction; or The shutter blocks or displays the black body in a rotating manner.
3. A system for acquiring an infrared video delay, characterized in that The system comprises: An infrared video and normal video acquisition module is configured to photograph the infrared video of the conversion process of the black body from the first state to the second state by an infrared imaging device, and at the same time, photograph the normal video of the display device used for displaying the infrared video and the conversion process by a high-speed camera; wherein the shutter is quickly moved to completely expose the black body target surface window, the infrared imaging device captures the moving picture of the shutter, and outputs the moving picture to the external display device or the display device with the picture displayed; A first time point and a second time point acquisition module is configured to analyze the normal video frame by frame to obtain the first time point when the conversion process is completed on the display device, and the second time point when the conversion process is completed in the normal video; wherein the shutter, the black body, the display device and the clock picture are in the imaging range of the high-speed camera, the high-speed camera records the shutter, the black body, the clock picture and the display device, analyzes the recording of the high-speed camera frame by frame, the high-speed camera obtains the picture of the second time point when the shutter completely unblocks the black body target surface window and the clock, and obtains the picture of the first time point when the display device displays the completely unblocked black body target surface window and the clock photographed by the infrared imaging device; An imaging delay acquisition module is configured to obtain the difference between the first time point and the second time point, and determine the difference as the imaging delay of the infrared video; The first state is completely blocking the black body, and the second state is completely displaying the black body.
4. The system of claim 3, wherein, The blocking or displaying the black body comprises: The shutter blocks or displays the black body from the horizontal direction; or The shutter blocks or displays the black body from the vertical direction; or The baffle shields or displays the black body from the vertical direction; or The baffle shields or displays the black body in a rotating manner.
5. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor implements the method for obtaining the infrared video delay according to any one of claims 1-2 when executing the program.
6. A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program implements the method for obtaining the infrared video delay according to any one of claims 1-2 when executed by the processor.
Citation Information
Patent Citations
Method and device for testing delay of camera
CN107094249A