A method and system for photomechanics

Through multiple sets of different spatial resolution image acquisition and optical flow analysis of the photomechanical system, combined with trigger and binary lamp plate technology, the problem of insufficient spatial resolution in the high-speed image acquisition system is solved, and high-precision image acquisition and deformation field data acquisition are achieved.

CN111397779BActive Publication Date: 2025-08-26INST OF FLEXIBLE ELECTRONICS TECH OF THU ZHEJIANG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010205814.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-03-23
Publication Date
2025-08-26
Estimated Expiration
2040-03-23

AI Technical Summary

Technical Problem

The spatial resolution of images in high-speed image acquisition systems is insufficient, resulting in the inability to perform spatial refinement analysis of dynamic processes.

Method used

Through the photomechanical system, multiple sets of image acquisition modules with different spatial resolutions are used to acquire image sequences in parallel, combined with optical flow method for analysis, a high-precision image sequence spatial phase difference correction model is established, and image acquisition with different frame rates and time resolutions is controlled by triggers, and a binary lamp board is introduced for time calibration.

Benefits of technology

The spatial resolution of image acquisition is improved, the problem of insufficient spatial resolution in high-speed image acquisition systems is solved, and accurate calibration of image acquisition time and acquisition of high-precision deformation field data is realized.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111397779B_ABST
    Figure CN111397779B_ABST
Patent Text Reader

Abstract

The present invention relates to a method and system for photomechanics, the system comprising a system control module, an image acquisition module and a processor module: the image acquisition module is connected to the system control module and the processor module respectively, the system control module controls the image acquisition module to acquire multiple sets of image sequences with different spatial resolutions, the image acquisition module sends the image sequences to the processor module, the processor module receives the image sequences, the processor module is used to accurately locate the acquisition time of each image in the image sequence, and uses the optical flow method to analyze the image sequence to obtain deformation field data, thereby solving the problem of insufficient spatial resolution of the acquired images in the high-speed image acquisition system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of photomechanics, and in particular to a photomechanics method and system. Background Art

[0002] Photomechanics is a non-contact, full-field measurement method for highly dynamic processes that combines high-speed image acquisition with photomechanical data analysis. In recent years, it has become an important observation method in the study of problems such as explosions, impacts, and instability and destruction.

[0003] In related technologies, high-speed image acquisition systems, due to limited data transmission bandwidth, must reduce image size in order to increase image acquisition speed. This results in severely insufficient spatial resolution of the measurement results, making them unsuitable for studying the fine-grained spatial analysis of dynamic processes. In practical applications, image acquisition devices based on specialized high-speed imaging technologies such as spectrometry, array imaging, or on-chip in-situ storage can somewhat improve the spatial resolution of high-speed optical measurement systems. However, these devices suffer from complex structures, poor image consistency, and high costs.

[0004] In view of the problem of insufficient spatial resolution of captured images in high-speed image acquisition systems in related technologies, no effective solution has been proposed so far. Summary of the Invention

[0005] In response to the problem of insufficient spatial resolution of captured images in high-speed image acquisition systems in related technologies, the present invention provides a photomechanical system to at least solve the above problem.

[0006] According to one aspect of the present invention, a photomechanical system is provided, comprising a system control module, an image acquisition module, and a processor module.

[0007] The image acquisition module is connected to the system control module and the processor module respectively. The system control module controls the image acquisition module to acquire multiple sets of image sequences with different spatial resolutions. The image acquisition module sends the image sequences to the processor module, and the processor module receives the image sequences.

[0008] The processor module is used to accurately locate the acquisition time of each image in the image sequence, and use the optical flow method to analyze the image sequence to obtain deformation field data.

[0009] In one embodiment, the system control module further includes a trigger:

[0010] The trigger is connected to the image acquisition module, and the trigger sends a trigger signal to the image acquisition module. The image acquisition module performs image acquisition according to the trigger signal to obtain multiple groups of image sequences with different spatial resolutions. The triggering mode of the trigger includes synchronous triggering or staggered triggering.

[0011] In one embodiment, the system control module is further used to control the acquisition frame rate of the image acquisition module, triggering the image acquisition module to acquire images at different frame rates, and the image acquisition module acquires multiple sets of image sequences with different temporal resolutions and different spatial resolutions.

[0012] In one embodiment, the system further comprises a binary light board:

[0013] The binary light board is placed at the edge of the object to be measured and is used to characterize the image acquisition time;

[0014] The processor module is further configured to obtain a code displayed on the binary light board, and obtain an acquisition time of each image in the image sequence according to the code.

[0015] In one embodiment, the image acquisition module includes a high-speed low spatial resolution CCD module, a medium-speed medium spatial resolution CCD module, and a low-speed high spatial resolution CCD module.

[0016] In one embodiment, the image acquisition module further includes a lens and a spectrometer, the lens is arranged at the front end of the spectrometer, and the high-speed low spatial resolution CCD module, the medium-speed medium spatial resolution CCD module and the low-speed high spatial resolution CCD module are respectively arranged on the spectrometer.

[0017] In one embodiment, the beam splitter uses a dichroic beam splitter for light splitting, and the dichroic beam splitter is coated with a first optical coating and a second optical coating, and the first optical coating and the second optical coating are both used for color separation. If color separation is not required, the first optical coating and the second optical coating can be replaced with coatings consistent with those of an ordinary beam splitter.

[0018] In one embodiment, the image acquisition module further includes a relay lens, which is disposed between the lens and the beam splitter, and is used to extend the image distance.

[0019] According to another aspect of the present invention, there is provided a method of photomechanics, comprising the following steps:

[0020] Acquire multiple sets of image sequences with different spatial resolutions;

[0021] Obtaining, according to a time code on each image of the image sequence, an acquisition time of each image;

[0022] The acquisition time of each image in the image sequence is accurately located, and the image sequence is analyzed using an optical flow method to obtain deformation field data.

[0023] In one embodiment, obtaining the acquisition time of each image according to the time code on each image in the image sequence includes:

[0024] According to the code displayed on the binary light board, the acquisition time of each image in the image sequence is obtained, and the code is the time code.

[0025] In one embodiment, acquiring multiple sets of image sequences with different spatial resolutions includes:

[0026] A plurality of image sequences with different temporal resolutions and different spatial resolutions are acquired according to a trigger signal, wherein the trigger signal includes a synchronous trigger signal or a staggered trigger signal.

[0027] In one embodiment, acquiring multiple sets of image sequences with different temporal resolutions and different spatial resolutions according to the trigger signal includes:

[0028] According to the trigger signal, multiple sets of image sequences with different temporal resolutions and different spatial resolutions are acquired at different frame rates.

[0029] The above-mentioned photomechanical method and system include a system control module, an image acquisition module and a processor module: the image acquisition module is connected to the system control module and the processor module respectively, the system control module controls the image acquisition module to acquire multiple sets of image sequences with different spatial resolutions, the image acquisition module sends the image sequence to the processor module, and the processor module receives the image sequence; the processor module is used to accurately locate the acquisition time of each image in the image sequence, use the optical flow method to analyze the image sequence, and obtain deformation field data, thereby solving the problem of insufficient spatial resolution of the acquired images in the high-speed image acquisition system. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0031] Figure 1 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 1 ;

[0032] Figure 2is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 2 ;

[0033] Figure 3 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 3 ;

[0034] Figure 4 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 4 ;

[0035] Figure 5 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 5 ;

[0036] Figure 6 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 6 ;

[0037] Figure 7 is a block diagram of a photomechanical system according to a specific embodiment of the present invention;

[0038] Figure 8 is a schematic structural diagram of an optomechanical system according to a specific embodiment of the present invention;

[0039] Figure 9 is a structural diagram of an image acquisition process according to a specific embodiment of the present invention;

[0040] Figure 10 is a schematic structural diagram of a dichroic beam splitter according to a specific embodiment of the present invention;

[0041] Figure 11 is a structural schematic diagram of a light splitting optical path design according to a specific embodiment of the present invention;

[0042] Figure 12 is a schematic diagram of a staggered trigger design according to a specific embodiment of the present invention;

[0043] Figure 13 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 1 ;

[0044] Figure 14 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 2 ;

[0045] Figure 15 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 3 ;

[0046] Figure 16 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 4 . DETAILED DESCRIPTION

[0047] In order to facilitate the understanding of the present application, in order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application are described in detail below with reference to the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present application, and preferred embodiments of the present application are provided in the accompanying drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to provide a more thorough and comprehensive understanding of the disclosure of the present application. The present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present application, so the present application is not limited to the specific embodiments disclosed below.

[0048] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. In the description of this application, the meaning of "several" is at least one, such as one, two, etc., unless otherwise clearly and specifically defined.

[0049] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing specific embodiments only and are not intended to limit this application. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0050] According to one aspect of the invention, there is provided an optomechanical system, Figure 1 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 1 ,like Figure 1 As shown, the system includes a system control module 11, an image acquisition module 12 and a processor module 13:

[0051] The image acquisition module 12 is connected to the system control module 11 and the processor module 13 respectively. The system control module 11 controls the image acquisition module 12 to acquire multiple sets of image sequences with different spatial resolutions. The image acquisition module 12 sends the image sequences to the processor module 13, and the processor module 13 receives the image sequences.

[0052] Among them, the process of the image acquisition module 12 acquiring multiple groups of image sequences with different spatial resolutions is parallel. For example, the image acquisition module 12 simultaneously acquires three groups of image sequences with different spatial resolutions. The three groups of image sequences with different spatial resolutions include an image sequence with a first spatial resolution, an image sequence with a second spatial resolution, and an image sequence with a third spatial resolution. The first spatial resolution is greater than the second spatial resolution, and the second spatial resolution is greater than the third spatial resolution.

[0053] The processor module 13 is used to obtain the acquisition time of each image in the image sequence according to the time code on each image in the image sequence, accurately locate the acquisition time of each image in the image sequence, and use the optical flow method to analyze the image sequence to obtain deformation field data.

[0054] It's important to further clarify that optical flow is the instantaneous speed of pixel motion of a moving object on the observation imaging plane. Optical flow methods use the temporal changes in pixels in an image sequence and the correlation between adjacent frames to find the correspondence between the previous and current frames, thereby calculating the motion information of objects between adjacent frames. The instantaneous rate of change of grayscale at a specific coordinate point on a two-dimensional image plane is typically defined as an optical flow vector. Optical flow is an instantaneous rate, and when the time interval is very small (such as between two consecutive frames of a video), it is equivalent to the displacement of the target point.

[0055] By building a multi-optical image acquisition system, multiple sets of image sequences with different temporal resolution and different spatial resolution are collected simultaneously. The optical flow method is used to analyze the multiple sets of image sequences with different temporal resolution and different spatial resolution to obtain deformation field data.

[0056] Through the above-mentioned photomechanical system, multiple sets of image sequences with different spatial resolutions are collected. Based on the information redundancy of the images and the spatial continuity characteristics of the deformation field, a high-precision image sequence spatial phase difference correction model is established. The deformation field information of the high-spatial resolution image sequence is solved through image sequences with different spatial resolutions, which solves the problem of insufficient spatial resolution of the collected images in the high-speed image acquisition system.

[0057] In one embodiment, Figure 2 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 2 ,like Figure 2As shown, the system control module 21 also includes a trigger 211. The trigger 211 is connected to the image acquisition module 12. The trigger 211 sends a trigger signal to the image acquisition module 12. The image acquisition module 12 performs image acquisition based on the trigger signal, obtaining multiple image sequences with different spatial resolutions. The trigger 211 can be triggered synchronously or staggered. The trigger 211 can be an integrated hardware system that generates a trigger signal, such as a signal generator or an FPGA (Field-Programmable Gate Array) circuit board.

[0058] In the above-mentioned photomechanical system, the image acquisition module 12 is triggered and controlled by the trigger 211, which can very conveniently control the acquisition time of the image acquisition module 12 to acquire image sequences with different spatial resolutions. It can also be flexibly controlled by synchronous triggering or staggered triggering according to actual needs, thereby solving the problem that the trigger control process in the high-speed image acquisition system is complicated and difficult to operate, and is prone to measurement errors.

[0059] In one embodiment, the system control module 21 is also used to control the acquisition frame rate of the image acquisition module 12, and trigger the image acquisition module 12 to acquire images at different frame rates through the trigger 211. The image acquisition module 12 acquires multiple groups of image sequences with different temporal resolutions and different spatial resolutions.

[0060] It should be noted that the image sequences with different time resolutions refer to image sequences acquired at different frame rates. Under the same acquisition time, the acquired image sequences have different sequence lengths.

[0061] For example, the image acquisition module 12 simultaneously acquires images at a first frame rate, a second frame rate, and a third frame rate, obtaining an image sequence of a first time resolution, an image sequence of a second time resolution, and an image sequence of a third time resolution. The first time resolution corresponds to a first frame rate, the second time resolution corresponds to a second frame rate, and the third time resolution corresponds to a third frame rate. The first frame rate is greater than the second frame rate, and the second frame rate is greater than the third frame rate. The sequence lengths of the image sequence of the first time resolution, the image sequence of the second time resolution, and the image sequence of the third time resolution are respectively a first sequence length, a second sequence length, and a third sequence length. The first sequence length is greater than the second sequence length, and the second sequence length is greater than the third sequence length.

[0062] Through the above-mentioned photomechanical system, multiple groups of image sequences with different temporal resolutions and different spatial resolutions are obtained. Based on the information redundancy of the image and the temporal and spatial continuity characteristics of the deformation field, a high-precision image sequence spatial difference correction model is established. The deformation field information of the high-speed and high-spatial resolution image sequence is solved through image sequences with different temporal resolutions and different spatial resolutions, which improves the spatial resolution of the acquired images and solves the problem of insufficient image acquisition time in the high-speed image acquisition system.

[0063] In one embodiment, Figure 3 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 3 ,like Figure 3 As shown, the system also includes a binary light board 44:

[0064] The binary light board 44 is placed at the edge of the object to be tested and is used to characterize the image acquisition time. The processor module 43 is also used to convert the time code displayed on the binary light board 44 on each image in the image sequence into time, and obtain the acquisition time of each image in the image sequence. When the image acquisition module 12 acquires the image sequence of the object to be tested, it will acquire the information displayed by the binary light board 44 placed at the edge of the object to be tested into the image sequence of the object to be tested. The introduction of the binary light board 44 can accurately characterize and record the actual acquisition time of each image in the image sequence.

[0065] Through the above-mentioned photomechanical system, a binary light board is introduced to accurately characterize the actual acquisition time of each image in the image sequence, thereby achieving accurate calibration of the image acquisition time and solving the problem of accurate calibration of the image acquisition time in high-speed image acquisition systems.

[0066] In one embodiment, Figure 4 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 4 ,like Figure 4As shown, the image acquisition module 52 includes a high-speed, low-spatial-resolution CCD module 521, a medium-speed, medium-spatial-resolution CCD module 522, and a low-speed, high-spatial-resolution CCD module 523. High speed, medium speed, and low speed are used to represent the temporal resolution of the image, and images with different temporal resolutions are acquired at different frame rates. For example, the spatial resolution of the high-speed, low-spatial-resolution CCD module 521 is 1280*1024 pixels, the spatial resolution of the medium-speed, medium-spatial-resolution CCD module 522 is 2048*1080 pixels, and the spatial resolution of the low-speed, high-spatial-resolution CCD module 523 is 5120*3840 pixels. The acquisition frame rate of the high-speed, low-spatial-resolution CCD module 521 is 100,000 Hz, the acquisition frame rate of the medium-speed, medium-spatial-resolution CCD module 522 is 1000 Hz, and the acquisition frame rate of the low-speed, high-spatial-resolution CCD module 523 is 50 Hz.

[0067] Through the above-mentioned photomechanical system, a high-speed low spatial resolution CCD module 521, a medium-speed medium spatial resolution CCD module 522 and a low-speed high spatial resolution CCD module 523 are introduced for image acquisition. Based on the information redundancy of the image and the time and spatial continuity characteristics of the deformation field, a high-precision image sequence spatial difference correction model is established. The deformation field information of the high-speed high spatial resolution image sequence is solved by the high-speed low spatial resolution image sequence, the medium-speed medium spatial resolution image sequence and the low-speed high spatial resolution image sequence, which can further improve the solution accuracy of the deformation field information of the high-speed high spatial resolution image sequence.

[0068] In one embodiment, Figure 5 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 5 ,like Figure 5 As shown, the image acquisition module 52 also includes a lens 624 and a spectrometer 625, the lens 624 is arranged at the front end of the spectrometer 625, the high-speed low spatial resolution CCD module 521, the medium-speed medium spatial resolution CCD module 522 and the low-speed high spatial resolution CCD module 523 are respectively arranged on the spectrometer 625, wherein the high-speed low spatial resolution CCD module 521, the medium-speed medium spatial resolution CCD module 522 and the low-speed high spatial resolution CCD module 523 are respectively connected to the system control module 11, and the high-speed low spatial resolution CCD module 521, the medium-speed medium spatial resolution CCD module 522 and the low-speed high spatial resolution CCD module 523 are respectively connected to the data processing module 13.

[0069] In one embodiment, the beam splitter 625 uses a dichroic beam splitter for light splitting, and the dichroic beam splitter is coated with a first optical coating and a second optical coating, wherein the first optical coating and the second optical coating are both used for color separation. If color separation is not required, the first optical coating and the second optical coating can be replaced with coatings consistent with those of an ordinary beam splitter, or different optical coatings can be selected as needed.

[0070] In one embodiment, Figure 6 is a structural frame of the photomechanical system according to an embodiment of the present invention Figure 6 ,like Figure 6 As shown, the image acquisition module 82 further includes a relay lens 826 , which is disposed between the lens 624 and the beam splitter 625 . The relay lens 826 is used to extend the image distance.

[0071] Through the above-mentioned optical measurement and mechanical system, a relay mirror is set between the lens and the spectrometer to extend the image distance, thereby solving the problem of inconsistent length of the spectroscopic optical path in the high-speed image acquisition system.

[0072] This application also provides a specific embodiment to further explain the photomechanical system in detail:

[0073] In Example 1, Figure 7 is a structural block diagram of the optical measurement mechanics system according to a specific embodiment of the present invention, such as Figure 7 As shown, the system includes a system control module 91, an image acquisition module 92, a processor module 93 and a binary light board 94, wherein the system control module 91 is connected to the image acquisition module 92, and the system control module 91 is used to control the acquisition frame rate of the image acquisition module 92, and the system control module 91 includes a trigger (not shown in the figure), and the image acquisition module includes the high-speed low spatial resolution CCD module 921, the medium-speed medium spatial resolution CCD module 922 and the low-speed high spatial resolution CCD module 923, wherein the trigger is respectively connected to the image acquisition module including the high-speed low spatial resolution CCD module 921, the medium-speed medium spatial resolution CCD module 922 and the low-speed high spatial resolution CCD module 923, and the trigger is used to trigger the high-speed low spatial resolution CCD module 921, the medium-speed medium spatial resolution CCD module 922 and the low-speed high spatial resolution CCD module 923 to simultaneously perform image acquisition at different frame rates to obtain a high-speed low spatial resolution image sequence, a medium-speed medium spatial resolution image sequence and a low-speed high spatial resolution image sequence.

[0074] The binary light board 94 is placed at the edge of the object to be tested 95. When the image acquisition module 92 acquires the image sequence of the object to be tested 95, the binary code displayed by the binary light board 94 placed at the edge of the object to be tested will be acquired onto the image sequence of the object to be tested 95. The code serves as the time code for image acquisition. The system control module 91 controls the image acquisition module 92 to acquire multiple groups of image sequences with different spatial resolutions. The image acquisition module 92 sends the image sequence to the processor module 93, and the processor module 93 receives the image sequence. The processor module 93 obtains the acquisition time of each image in the image sequence based on the time code on each image in the image sequence, accurately locates the acquisition time of each image in the image sequence, and uses the optical flow method to analyze the image sequence to obtain deformation field data.

[0075] Figure 8 is a schematic structural diagram of an optomechanical system according to a specific embodiment of the present invention, Figure 9 This is a schematic diagram of the image acquisition process according to a specific embodiment of the present invention. It should be noted that the high-speed, low-spatial-resolution CCD module 921, the medium-speed, medium-spatial-resolution CCD module 922, and the low-speed, high-spatial-resolution CCD module 923 form a CCD array to acquire image sequences, obtaining multiple image sequences acquired at different frame rates and with different spatial resolutions. The processor module 93 is also used to store the image sequences and the deformation field analysis algorithm, and can be integrated on the same computer device.

[0076] The beam splitter (not shown in the figure) uses a dichroic beam splitter to split the light. Figure 10 Schematic diagram of the structure of the dichroic beam splitter according to a specific embodiment of the present invention, as shown in FIG. Figure 10 As shown, F1 and F2 are optical coatings. If color separation is not required, the coating can be replaced with the same coating as that of ordinary spectroscopes. Figure 11 FIG. 1 is a schematic diagram of a structure of a light splitting optical path design according to a specific embodiment of the present invention. Figure 11 As shown, due to the inconsistency of the splitting optical path length, a special beam splitter 925 is required here, and the relay lens 926 is used to extend the image distance. Figure 12 Schematic diagram of staggered trigger design according to a specific embodiment of the present invention, as shown in FIG. Figure 12 As shown, the triggering mode of the trigger includes synchronous triggering or staggered triggering, and the triggering mode of the trigger can be selected according to actual application requirements.

[0077] According to another aspect of the invention there is provided a method of photomechanics, Figure 13 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 1 ,like Figure 13 As shown, the method includes the following steps:

[0078] Step S910: Acquire multiple sets of image sequences with different spatial resolutions.

[0079] Among them, three groups of image sequences with different spatial resolutions can be obtained, and the three groups of image sequences with different spatial resolutions include an image sequence with a first spatial resolution, an image sequence with a second spatial resolution, and an image sequence with a third spatial resolution. The first spatial resolution is greater than the second spatial resolution, and the second spatial resolution is greater than the third spatial resolution.

[0080] Step S920, obtaining the acquisition time of each image in the image sequence according to the time code on the image;

[0081] Step S930 : accurately locate the acquisition time of each image in the image sequence, and use the optical flow method to analyze the image sequence to obtain deformation field data.

[0082] Among them, based on the information redundancy of the image and the spatial continuity characteristics of the deformation field, a solution model for the deformation field of the high-speed and high-spatial-resolution image sequence is established, and the three groups of image sequences with different spatial resolutions are spatially calibrated to obtain the conversion relationship between the three groups of image sequences with different spatial resolutions. A reference image is selected from the image sequence of the first spatial resolution, and the image sequences of the three groups of spatial resolutions are input into the solution model. The displacement fields of all images in the image sequence are solved according to the conversion relationship to obtain deformation field data.

[0083] According to the above steps S910 to S930, multiple groups of image sequences with different spatial resolutions are collected. Based on the information redundancy of the images and the spatial continuity characteristics of the deformation field, a solution model for the deformation field of the high-speed and high-spatial-resolution image sequence is established. The deformation field information of the high-spatial-resolution image sequence is solved through image sequences with different spatial resolutions, thereby solving the problem of insufficient spatial resolution of the collected images in the high-speed image acquisition system.

[0084] In one embodiment, Figure 14 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 2 ,like Figure 14 As shown, the method replaces step S920 with step S1020:

[0085] Step S1020 , obtaining the acquisition time of each image in the image sequence according to the code displayed on the binary light board, where the code is the time code.

[0086] The binary light board is placed at the edge of the object to be tested, and the binary light board will be displayed on the acquired image sequence of the object to be tested. The introduction of the binary light board can accurately characterize the actual acquisition time of each image in the image sequence.

[0087] According to the above step S1020, a binary light board is introduced to accurately characterize the actual acquisition time of each image in the image sequence, thereby achieving accurate calibration of the acquisition time and solving the problem of accurate calibration of the acquisition time in the high-speed image acquisition system.

[0088] In one embodiment, Figure 15 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 3 ,like Figure 15 As shown, the method replaces step S910 with step S1110:

[0089] Step S1110 , collecting multiple sets of image sequences with different temporal resolutions and different spatial resolutions according to a trigger signal, where the trigger signal includes a synchronous trigger signal or a staggered trigger signal.

[0090] According to the above step S1110, by introducing a trigger signal, the acquisition time of image sequences with different spatial resolutions can be very conveniently controlled. It is also possible to select a synchronous trigger signal or a staggered trigger signal for trigger control according to actual needs, thereby solving the problem that the trigger control process in the high-speed image acquisition system is complex and difficult to operate, and is prone to measurement errors.

[0091] In one embodiment, Figure 16 The process of the photomechanical method according to the embodiment of the present invention is as follows Figure 4 ,like Figure 16 As shown, the method replaces step S1110 with step S1210:

[0092] Step S1210 , capturing multiple sets of image sequences with different temporal resolutions and different spatial resolutions at different frame rates according to a trigger signal, wherein the trigger signal includes a synchronous trigger signal or a staggered trigger signal.

[0093] It should be further explained that image sequences with different temporal resolutions refer to image sequences acquired at different frame rates. Under the same acquisition time, the acquired image sequences have different sequence lengths.

[0094] For example, by simultaneously acquiring images at a first frame rate, a second frame rate, and a third frame rate, an image sequence with a first temporal resolution, an image sequence with a second temporal resolution, and an image sequence with a third temporal resolution are obtained. The first temporal resolution corresponds to a first frame rate, the second temporal resolution corresponds to a second frame rate, and the third temporal resolution corresponds to a third frame rate. The first frame rate is greater than the second frame rate, and the second frame rate is greater than the third frame rate. The sequence lengths of the image sequence with the first temporal resolution, the image sequence with the second temporal resolution, and the image sequence with the third temporal resolution are respectively a first sequence length, a second sequence length, and a third sequence length. The first sequence length is greater than the second sequence length, and the second sequence length is greater than the third sequence length.

[0095] According to the above-mentioned step S1210, multiple groups of image sequences with different temporal resolutions and different spatial resolutions are collected, and based on the information redundancy of the images and the temporal and spatial continuity characteristics of the deformation field, a solution model for the deformation field of the high-speed and high-spatial resolution image sequence is established. The deformation field information of the high-speed and high-spatial resolution image sequence is solved by using image sequences with different temporal resolutions and different spatial resolutions, thereby improving the spatial resolution of the collected images and solving the problem of insufficient collection time in the high-speed image collection system.

[0096] This application also provides a specific embodiment to further explain the photomechanical method in detail:

[0097] In Example 2, the photomechanical method includes the following steps:

[0098] Step S1310, collecting multiple groups of image sequences with different temporal resolutions and different spatial resolutions at different frame rates according to a trigger signal, the trigger signal including a synchronous trigger signal or a staggered trigger signal, wherein three groups of image sequences with different spatial resolutions can be obtained, the three groups of image sequences with different spatial resolutions including an image sequence with a low-speed first spatial resolution, an image sequence with a medium-speed second spatial resolution, and an image sequence with a high-speed third spatial resolution, the first spatial resolution being greater than the second spatial resolution, and the second spatial resolution being greater than the third spatial resolution.

[0099] Step S1320 : obtaining the acquisition time of each image in the image sequence according to the code displayed on the binary light board on each image in the image sequence as the time code.

[0100] Step S1330: Position the image sequence according to the acquisition time so as to analyze the image sequence.

[0101] In step S1340 , image sequences with different spatial resolutions are combined together, and the displacement is solved uniformly. Based on the information redundancy of the images and the spatial continuity characteristics of the deformation field, a deformation field solution model of the high-speed and high-spatial-resolution image sequence is established.

[0102] Step S1350: The spatial resolution of the obtained shift field depends on the spatial resolution of the image sequence with the low-speed first spatial resolution.

[0103] In step S1360, spatial calibration is performed on the three groups of image sequences with different spatial resolutions to obtain a conversion relationship between the three groups of image sequences with different spatial resolutions, a reference image is selected from the image sequence with a first spatial resolution, the image sequences with the three groups of spatial resolutions are input into the solution model, and the displacement fields of all images in the image sequence are solved according to the conversion relationship to obtain deformation field data.

[0104] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0105] The above embodiments merely illustrate several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. A photomechanical system, characterized in that: The system includes a system control module, an image acquisition module and a processor module: The image acquisition module is connected to the system control module and the processor module respectively. The system control module controls the image acquisition module to acquire multiple sets of image sequences with different spatial resolutions. The image acquisition module sends the image sequences to the processor module, and the processor module receives the image sequences. The processor module is used to accurately locate the acquisition time of each image in the image sequence, and analyze the image sequence using the optical flow method to obtain deformation field data; The system further includes a binary light board: the binary light board is placed at the edge of the object to be measured and is used to represent the acquisition time of the image; the processor module is further used to obtain the code displayed on the binary light board and obtain the acquisition time of each image in the image sequence according to the code; The image acquisition module includes a high-speed low spatial resolution CCD module, a medium-speed medium spatial resolution CCD module and a low-speed high spatial resolution CCD module; The image acquisition module further includes a lens and a spectroscope, wherein the lens is arranged at the front end of the spectroscope, and the high-speed low spatial resolution CCD module, the medium-speed medium spatial resolution CCD module and the low-speed high spatial resolution CCD module are respectively arranged on the spectroscope; The image acquisition module further includes a relay lens, which is arranged between the lens and the beam splitter and is used to extend the image distance.

2. The optomechanical system according to claim 1, wherein: The system control module further includes a trigger: The trigger is connected to the image acquisition module, and the trigger sends a trigger signal to the image acquisition module. The image acquisition module performs image acquisition according to the trigger signal to obtain multiple groups of image sequences with different spatial resolutions. The triggering mode of the trigger includes synchronous triggering or staggered triggering.

3. The photomechanical system according to claim 2, wherein: The system control module is further configured to control the acquisition frame rate of the image acquisition module, triggering the image acquisition module to acquire images at different frame rates, and the image acquisition module acquires multiple sets of image sequences with different temporal resolutions and different spatial resolutions.

4. The photomechanical system according to claim 1, wherein: The beam splitter uses a dichroic beam splitter for light splitting. The dichroic beam splitter is coated with a first optical coating and a second optical coating. The first optical coating and the second optical coating are both used for color separation. If color separation is not required, the first optical coating and the second optical coating can be replaced with coatings consistent with those of an ordinary beam splitter.

5. A photomechanical method, characterized in that: The photomechanical method is applied to the photomechanical system according to claim 1, comprising: Acquire multiple sets of image sequences with different spatial resolutions; Obtaining, according to a time code on each image of the image sequence, an acquisition time of each image; The acquisition time of each image in the image sequence is accurately located, and the image sequence is analyzed using an optical flow method to obtain deformation field data.

6. The method according to claim 5, characterized in that The acquiring of the acquisition time of each image according to the time code on each image in the image sequence comprises: According to the code displayed on the binary light board, the acquisition time of each image in the image sequence is obtained, and the code is the time code.

7. The method according to claim 5, characterized in that Acquiring multiple sets of image sequences with different spatial resolutions includes: A plurality of image sequences with different temporal resolutions and different spatial resolutions are acquired according to a trigger signal, wherein the trigger signal includes a synchronous trigger signal or a staggered trigger signal.

8. The method according to claim 7, characterized in that The collecting of multiple sets of image sequences with different temporal resolutions and different spatial resolutions according to the trigger signal comprises: According to the trigger signal, multiple sets of image sequences with different temporal resolutions and different spatial resolutions are acquired at different frame rates.

Citation Information

Patent Citations

  • Method and system for motion correction in a sequence of images

    CN101048800A

  • Method for computing visual field of multi-view dynamic scene acquisition

    CN101719264A