Imaging image display, correction method, system and apparatus

By capturing and correcting multiple frames of images using magneto-optical Kerr microscopy, the problem of imaging instability caused by changes in the position of the object was solved, resulting in a more stable imaging effect.

CN115514907BActive Publication Date: 2026-02-10BEIHANG UNIV +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210992100.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-18
Publication Date
2026-02-10
Estimated Expiration
2042-08-18

AI Technical Summary

Technical Problem

In magneto-optical Kerr microscopy, changes in the position of an object lead to unstable imaging results, making it difficult to separate positional differences from differences in magnetization.

Method used

By capturing multiple frames of images and using the positional differences between the image frames for correction, the position of the object being tested or the image frames themselves can be adjusted to ensure imaging stability.

Benefits of technology

It improves imaging stability, reduces the impact of positional changes on imaging results, ensures that the position of objects in the image remains unchanged, and improves imaging quality.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The present application belongs to the technical field of image processing, and provides an imaging image display method, which corrects the displayed image by using the non-displayed image, reduces the position change of the measured object, makes the measured object into a more stable image, and avoids the adverse effect of the position change of the measured object on the imaging effect. The present application also provides an imaging image correction method, an imaging image correction system and an imaging image correction device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of image processing technology, and relates to magneto-optical Kerr microscopy imaging technology. Specifically, it relates to a display method, correction method, correction system, and correction device for the image. Background Technology

[0002] Magneto-optic Kerr microscopy is a non-destructive measurement method for magnetic materials and spintronic devices. It involves illuminating the surface of the object under test with a beam of monochromatic linearly polarized light and utilizing the magneto-optic Kerr effect to observe the Kerr deflection angle of the reflected light, thereby revealing the magnetization state of the object. When observing the Kerr deflection angle of the reflected light, it is typically passed through an analyzer. The difference in Kerr deflection angle is converted into a difference in light intensity, thus indicating the magnetization state. This difference in magnetization state is usually obtained by comparing the differences in the intensity of the reflected light at different times.

[0003] To compare the magnetization state of a tested object at different times, the difference method is mainly used. This involves subtracting magneto-optical Kerr images acquired at two different times to analyze the differences between the two images. However, if the position of the tested object differs at different times, the sample position in the image will change. The difference will then combine the positional and magnetization state differences in the subtracted image, making them indistinguishable. Furthermore, because magneto-optical Kerr microscopy can magnify the observed area, even subtle positional changes in the tested object will appear as significant differences in the imaging results. Therefore, it is crucial to ensure that the position of the tested object remains as stable as possible during magneto-optical Kerr microscopy. However, due to environmental vibrations, equipment vibrations, and human interference, the tested object is prone to positional changes, affecting the imaging results. Therefore, a method capable of forming a stable image of the tested object is urgently needed. Summary of the Invention

[0004] In order to provide a method that can at least form a stable image of a test object in magneto-optical Kerr microscopy, the present invention provides an imaging image display method, an imaging image correction method, an imaging image correction system, and an imaging image correction device.

[0005] To achieve the above objectives, the technical solution provided by the present invention is as follows:

[0006] An image display method involves sequentially capturing at least three image frames, using at least two of the captured image frames as displayed image frames, displaying fewer image frames than the captured image frames, and at least one of the displayed image frames being a corrected image frame, wherein the image frame used for correction is located before the capture time of the image frame being corrected.

[0007] As a preferred embodiment, when three image frames are captured sequentially, the captured image frames are the first frame, the second frame, and the third frame, respectively. The first frame and the third frame are displayed on the display output device, while the second frame is not displayed. The third frame is corrected based on the first and second frames.

[0008] The aforementioned "second frame not being displayed" means that the second frame is not actively output, not that the second frame is never output under any circumstances.

[0009] As a preferred embodiment, when four image frames are captured sequentially, the captured image frames are the first frame, the second frame, the third frame, and the fourth frame, wherein the fourth frame is displayed on the display output device, and one of the first frame, the second frame, and the third frame is displayed on the display output device; the fourth frame is corrected based on at least two of the first frame, the second frame, and the third frame.

[0010] Preferably, when taking no less than three image frames, at least two image frames are displayed and output, and at least one image frame is not displayed and output; among the displayed image frames, at least one image frame is the image frame to be corrected, and the image frame to be corrected is not the first image frame displayed; the image frame to be corrected is corrected by at least one of the displayed image frames and the undisplayed image frames.

[0011] Preferably, when taking no fewer than four image frames, at least two image frames are displayed and at least two image frames are not displayed; at least three image frames are set before the image frame to be corrected, and the image frame to be corrected is not the first image frame displayed. The correction is performed at least through the undisplayed image frames.

[0012] Preferably, the correction is performed using at least one of the undisplayed image frames and the displayed image frames.

[0013] Preferably, the correction includes: comparing at least two image frames, moving the object under test according to the comparison result, the object under test moving, capturing the object under test, and obtaining the corrected image frame.

[0014] Preferably, the correction further includes: after photographing the object under test, comparing the obtained image frame with the image frame obtained before photographing, and moving the image of the photographed image frame.

[0015] The present invention also provides an imaging image correction method, comprising at least:

[0016] Select a reference image frame;

[0017] Select the corrected image frame;

[0018] The object under test is moved according to the reference image frame and the correction image frame.

[0019] Capture and display image frames;

[0020] The corrected image frame is not displayed, or is displayed in a manner that is not as prominent as the displayed image frame.

[0021] Preferably, the imaging correction method can be operated at any stage of the magneto-optical Kerr microscopy process.

[0022] Preferably, the imaging image correction method further includes: moving the object under test and capturing a secondary display image frame based on at least one of the reference image frame or the correction image frame and the display image frame.

[0023] Preferably, the imaging image correction method further includes: moving the object under test and capturing a secondary display image frame based on the display image frame and the correction image frame.

[0024] Further, optionally, based on the displayed image frame and the secondary displayed image frame, the object under test is moved to capture a tertiary displayed image frame.

[0025] Optionally, the display image frame is used for display on an imaging device.

[0026] Optionally, the reference image frame is used for display on an imaging device.

[0027] Optionally, based on the corrected image frame and the reference image frame, an offset parameter between the corrected image frame and the reference image frame is calculated; and based on the offset parameter, the object under test is moved.

[0028] Optionally, an offset parameter is calculated based on at least one of the reference image frame or the correction image frame, and the display image frame; the object under test is moved based on the offset parameter.

[0029] Furthermore, the offset parameter is calculated as follows: by identifying the difference in the position of the same feature of the tested item in the corresponding image frame, the actual offset of the tested item is calculated.

[0030] Furthermore, the object being tested is controlled to move in the opposite direction and distance to the actual offset.

[0031] Preferably, the feature of the tested item is the morphological feature of the tested item.

[0032] More preferably, the number of the features is multiple.

[0033] Preferably, the imaging image correction method further includes: after capturing the display image frame and before displaying the display image frame, comparing the display image frame with the reference image frame, moving the image of the display image frame, and using the moved display image frame as the display image frame.

[0034] The present invention also provides an imaging image correction system, including an imaging module, a sample movement module, a data processing module, and a display module. The imaging module is configured to image a sample and output a corresponding signal to the data processing module. The data processing module outputs signals to the sample movement module and the display module based on at least the signals transmitted by the imaging module. The sample movement module is configured to move the sample according to the signals transmitted by the data processing module. The display module displays the signals transmitted by the data processing module. The data processing module transmits corrected image frames to the display module for display, and the data processing module transmits at least a portion of the image frames acquired by the imaging module to the display module for display.

[0035] In addition, the present invention also provides an imaging image correction device, including a signal processing device, wherein the signal processing device is provided with at least a signal input terminal, a first signal output terminal, and a second signal output terminal, and the signal processing device processes the signal received by the signal input terminal according to a preset signal processing method and outputs a corresponding signal through at least one of the first signal output terminal and the second signal output terminal;

[0036] The signal input terminal is connected to the imaging device for data transmission, the first signal output terminal is connected to the displacement control device of the object being measured for data transmission, and the second signal output terminal is connected to the display device for data transmission.

[0037] The signal processing device includes at least the following signal transmission sequence:

[0038] The signal input terminal receives a signal, the first signal output terminal outputs a signal, the signal input terminal receives a signal, and the second signal output terminal outputs a signal.

[0039] The present invention has at least the following beneficial effects:

[0040] The imaging image display method provided by this invention can correct the displayed image frame, reduce the positional variation of the tested object, and not display the image used for correction, so that the position of the tested object in the displayed imaging image remains unchanged, making the tested object into a more stable image, and avoiding the adverse effects of the positional variation of the tested object on the imaging effect.

[0041] The imaging image correction method provided by this invention can correct the displayed image so that the position of the measured object remains unchanged, making the acquired image more stable, reducing the difference in imaging results in multiple displays, and improving the imaging effect.

[0042] The imaging image correction system provided by the present invention moves the object under test, captures and displays the corrected image frame, thereby making the position of the object under test in the displayed image more stable and making the object under test a more stable image.

[0043] The present invention provides an imaging image correction device that controls the position correction of the test object by outputting a displacement signal of the test object, and outputs a captured image of the test object after correction, so that the displayed image of the test object is more stable. Detailed Implementation

[0044] For clarity, not all features of the actual embodiments are described. In the following description, well-known functions and structures are not detailed in detail, as they would confuse the invention with unnecessary detail. It should be understood that in the development of any actual embodiment, numerous implementation details must be made to achieve the developer's specific objectives.

[0045] Furthermore, the features, operations, or characteristics described in the specification can be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can be rearranged or adjusted in a manner obvious to those skilled in the art. Therefore, the various orders in the specification are only for clearly describing a particular embodiment and do not imply a necessary order, unless otherwise stated that a particular order must be followed.

[0046] In the description of this invention, "several" means one or more, "multiple" means two or more, "greater than," "less than," and "exceeding" are understood to exclude the stated number, while "above," "below," and "within" are understood to include the stated number. The use of "first" and "second" in the description is merely for distinguishing technical features and should not be construed as indicating or implying relative importance, or implicitly indicating the number of indicated technical features, or implicitly indicating the order of the indicated technical features.

[0047] To display the image, the object under test is photographed at three time points, resulting in three image frames: the first frame, the second frame, and the third frame. The first and third frames are displayed on the output device, while the second frame is not. The third frame is then corrected based on the first and second frames. Specifically, by comparing the positional differences of the object under test in the first and second frames, the positional change of the object under test at the time of the second frame is determined compared to the time the first frame was taken. This positional change data is used to correct the third frame. Specifically, when correcting the third frame, the position of the object under test at that moment can be at least corrected, or the third frame image itself can be corrected, and the corrected image is used as the third frame for display. Alternatively, when correcting the third frame image itself, the positional difference of the object under test displayed in the third frame can be compared with that in the first or second frame. The third frame image itself can be moved, and the moved image is used as the third frame for subsequent processing.

[0048] When the magneto-optical Kerr microscopy imaging device is running, the imaging device images the object under test at preset times. This image display method can be used during the operation of the magneto-optical Kerr microscopy imaging device. Specifically, at a certain point in time, a first moment is selected, and the image of the object under test acquired at the first moment is taken as the first frame; a moment after the first moment is selected, in this embodiment, a second moment is selected, and the image of the object under test acquired at this moment is taken as the second frame; the closest moment after the second moment is selected, a third moment is selected, and the image of the object under test acquired at this moment is taken as the third frame. By comparing the positional differences of the object under test in the second frame and the first frame, the positional change of the object under test at the second moment compared to the first moment is obtained. This positional change data is used to correct the third frame. If the selected first, second, and third moments have all completed imaging, that is, the current imaging stage is after the third moment, then the correction method including the above method can be used to correct the image of the third frame. After the correction of the third frame is completed, the third frame is displayed on the display output device. If imaging has been completed at the first and second selected time points, but imaging has not yet occurred at the third time point, or the third time point has not yet arrived, then at least the position of the measured object at the third time point can be ensured to be the corrected position. Alternatively, after the third time point is captured, the third frame image itself can be corrected, and the corrected image can be displayed as the third frame. If imaging has been completed at the first selected time point, but imaging has not yet occurred at the second and third time points, or the second time point has not yet arrived, then after the second time point arrives and is captured, the second and first frame images can be compared and analyzed according to the aforementioned method to obtain the positional change data used for correcting the third frame. Furthermore, the first frame needs to be displayed before the third frame is displayed; the second frame is not displayed.

[0049] It should be noted that the aforementioned "second frame not displayed" refers to not actively outputting the second frame, not that the second frame is never output under any circumstances. For example, when using this invention, if the display mode of the second frame is not actively set, or when the technical solution described in this invention is running, only the first and third frames are displayed, and the second frame is temporarily stored or saved for later retrieval. In special circumstances, the second frame can be displayed; for example, at least when it is needed or desired to view the second frame, it can be actively retrieved and displayed.

[0050] In implementing the technical solution of this invention, more than three image frames can be used. Specifically, the object under test is photographed at four time points, resulting in four image frames, namely the first frame, the second frame, the third frame, and the fourth frame, with the shooting times being the first moment, the second moment, the third moment, and the fourth moment, respectively. That is, the first frame is photographed first, followed by the second frame, then the third frame, and finally the fourth frame. The fourth frame is displayed on the display output device, and one of the first, second, or third frames is also displayed on the display output device. The following explanation assumes that the first frame is displayed on the display output device, while the second and third frames are not. Based on the first, second, and third frames, the position of the object under test at the second frame and the third frame is analyzed to obtain a further analysis of the position change trend of the object under test. Furthermore, based on the time difference between the fourth frame and the first, second, and third frames, and combined with the position change trend of the object under test, the fourth frame is corrected. Specifically, when correcting the fourth frame, the position of the object being measured can be pre-adjusted based on the predicted position of the object at the fourth frame time, thus correcting the position of the object and making the captured fourth frame a corrected image; or, based on the predicted position of the object being measured at the fourth frame time, the fourth frame image itself can be corrected, and the corrected image can be displayed as the fourth frame. Furthermore, depending on the actual situation, the second frame can be displayed on the display output device, while the first and third frames are not displayed; or the third frame can be displayed on the display output device, while the first and second frames are not displayed.

[0051] When four image frames are captured, the correction of the fourth image frame can be performed as follows: At the first moment, the object being measured is located at the first position; at the second moment, compared to the first moment, the object's position changes, shifting to the second position; at the third moment, compared to the second moment, the object continues to change position, shifting to the third position. As an optional implementation, based on the time difference between the second and first moments, and the position difference between the second and first positions, the velocity and direction of the object are analyzed during the period between the second and first moments; based on the time difference between the third and second moments, and the position difference between the third and second positions, the velocity and direction of the object are analyzed during the period between the third and second moments; combining the velocity and direction information of the object in the first two time periods, the trend of the object's velocity and direction is analyzed; combining the trend of the object's velocity and direction, the velocity and direction of the object from the second to the third moment, the time of the third moment, and the position of the object, the position of the object at the fourth moment is predicted, i.e., the fourth position is predicted. Furthermore, in certain scenarios, the speed and direction of the measured object during the period between the third and second moments can be analyzed based on the time difference between the third and second moments, combined with the positional difference between the third and second positions. Then, the position of the measured object at the fourth moment can be predicted by combining the time difference between the third and fourth moments and the position of the measured object at the third moment. In other scenarios, the speed and direction of the measured object during the period between the third and first moments can be analyzed based on the time difference between the third and first moments, combined with the positional difference between the third and first positions. Then, the position of the measured object at the fourth moment can be predicted by combining the time difference between the third and fourth moments and the position of the measured object at the third moment. In yet another scenario, the speed and direction of the measured object during the period between the first and second moments can be analyzed based on the time difference between the first and second moments, combined with the positional difference between the first and second positions. Then, the position of the measured object at the fourth moment can be predicted by combining the time difference between the third and fourth moments and the position of the measured object at the third moment. Based on the above analysis, the position of the tested object is adjusted according to the predicted fourth position, or the image of the fourth frame is adjusted to reduce the difference between the position of the tested object and the reference position. The reference position can be selected from the first, second, or third position, depending on actual needs; that is, the position of the tested object located before the shooting time of the image frame being corrected. As for the method of obtaining the trend of the measured object's motion speed and direction, a mapping function can be obtained using function fitting, or a mapping model can be obtained using machine learning. Furthermore, the mapping relationship can be further analyzed by comparing the difference between the actual displacement and the preset displacement.

[0052] In addition, the test object can be moved directly based on the reference position and the position of the test object at the shooting time point closest to the shooting time of the image frame to be calibrated, so as to reduce the difference between the position of the test object and the reference position.

[0053] Besides the scenario described above where the first frame is displayed on the output device while the second and third frames are not, it's also possible to display the second and fourth frames while the first and third frames are not. In this case, based on the first and second frames, the second frame needs to be corrected. By comparing the positional differences of the measured object in the second and first frames, the positional change of the measured object at the time of the second frame's capture compared to the time the first frame was taken can be determined. This positional change data is then used to correct the obtained image of the second frame. When correcting the fourth frame, the same correction method as described above can be used for the scenario where the second and third frames are not displayed.

[0054] Furthermore, when implementing the technical solution of this invention, if more than four image frames are used, the aforementioned implementation methods for using three or four image frames can be referenced, and the implementation details can be adjusted according to actual needs. Those skilled in the art can make reasonable adjustments to the specific implementation process based on the foregoing content, and will not be elaborated further here.

[0055] As an optional approach, when taking at least three image frames, some image frames are displayed, with at least two frames; some image frames are not displayed, with at least one frame; among the displayed image frames, at least one frame is the image frame to be calibrated, and this image frame to be calibrated is not the first image frame displayed; the image frame to be calibrated can be calibrated using at least one of the displayed and undisplayed image frames. For specific calibration methods, please refer to the aforementioned implementation details. As an optional approach, when taking at least four image frames, some image frames are not displayed, with at least two frames; some image frames are displayed, with at least two frames; at least three image frames precede the image frame to be calibrated, and the image frame to be calibrated is not the first image frame displayed. Through the above methods, at least one of the at least two displayed image frames is a calibrated image frame, enhancing the matching degree between the displayed image frames, reducing display jitter, reducing positional jitter of the tested object in the saved image frames, and making the imaging effect of the tested object more stable.

[0056] The terms "not displaying" and "not showing" include both complete non-display and displaying in a manner not stronger than the salience of the displayed image frame. Specifically, the corresponding image frame can be completely not displayed, or it can be displayed on a different device, in a display area that can be turned off, in a relatively smaller display area, or it can be made transparent, obscured, brightened, darkened, or have reduced contrast in at least one of the following ways: or the salience of the displayed image frame can be enhanced. The specific salience can be determined and compared using methods such as eye-tracking heatmaps and electroencephalogram (EEG) signal analysis.

[0057] The present invention also provides an imaging image correction method. The correction method for this imaging image will be described below.

[0058] First, it should be noted that this imaging correction method can be applied at any stage of the magneto-optical Kerr microscopy process, such as when the device starts, at the beginning of imaging, during imaging, at the end of imaging, or when the device stops. Here, "at the beginning of imaging," "during imaging," and "at the end of imaging" refer to the device starting to image the object under test and recording the acquired image frames; "when the device starts" and "when the device stops" refer to the device being in operation but not yet recording image frames of the object under test.

[0059] One implementation of the image correction method when the device is started is as follows:

[0060] The device is started, and the imaging device begins to capture images of the object being tested, obtaining an image frame, which is then selected as the reference image frame.

[0061] The equipment continues to operate, and the imaging device continues to image the object being tested, obtaining an image frame, which is then selected as the correction image frame.

[0062] The device continues to operate, and calculates the offset parameters between the calibration image frame and the reference image frame based on the reference image frame and the calibration image frame. This is a parameterized representation of the offset of the measured object in terms of position when the calibration image frame was taken and when the reference image frame was taken. Based on the offset parameters, the measured object is moved to a position that matches the corresponding position in the reference image frame, that is, the measured object is moved to the position it was in when the reference image frame was taken.

[0063] The equipment continues to operate, taking pictures of the tested object and obtaining an image frame, which is then used as the display image frame and displayed on the display device.

[0064] The corrected image frame is either not displayed, or displayed in a manner less significant than that of the displayed image frame. Specifically, displaying the corrected image frame less significantly than the displayed image frame can be achieved by displaying it on a different device than the display device, in a display area that can be turned off, in a relatively smaller display area, or by giving it at least one of the following forms: transparency, obscuring, brightening, darkening, or reduced contrast. Alternatively, the salience of the displayed image frame can be enhanced so that the display effect of the corrected image frame is less significant relative to that of the displayed image frame. Or, the display effects of the displayed image frame and the corrected image frame can be at least the same or similar. The specific degree of salience can be determined and compared using methods such as eye-tracking heatmaps or electroencephalogram (EEG) signal analysis.

[0065] One implementation of the image correction method is as follows: when the device starts imaging, or the device is already in the imaging process, or switches from the startup state to the imaging state, or switches from the imaging state to the non-imaging state, or when the device finishes imaging.

[0066] The device begins imaging, and the imaging device begins to capture images of the object being tested, obtaining an image frame. This image frame is then selected as the reference image frame. Optionally, the device may save or temporarily store this image at this time.

[0067] The equipment continues to operate, and the imaging device continues to image the object being tested, obtaining an image frame. This image frame is selected as the correction image frame; optionally, at this time, the equipment saves or temporarily stores the image.

[0068] The device continues to operate, and calculates the offset parameters between the calibration image frame and the reference image frame based on the reference image frame and the calibration image frame. This is a parameterized representation of the offset of the measured object in terms of position when the calibration image frame was taken and when the reference image frame was taken. Based on the offset parameters, the measured object is moved to a position that matches the corresponding position in the reference image frame, that is, the measured object is moved to the position it was in when the reference image frame was taken.

[0069] The device continues to operate, taking pictures of the tested object and obtaining an image frame. This image frame is then used as the display image frame and displayed on the display device. Optionally, the device may save or temporarily store the image at this time.

[0070] The aforementioned corrected image frames are not displayed, or are displayed in a manner less significant than the displayed image frames. For an explanation of this, please refer to the preceding content; it will not be repeated here.

[0071] When the image correction method is run until the device stops, one implementation method is as follows:

[0072] The equipment continues to operate, and the imaging device begins to capture images of the tested object, obtaining an image frame, which is then selected as the reference image frame.

[0073] The equipment continues to operate, and the imaging device continues to image the object being tested, obtaining an image frame, which is then selected as the correction image frame.

[0074] The device continues to operate, and calculates the offset parameters between the calibration image frame and the reference image frame based on the reference image frame and the calibration image frame. This is a parameterized representation of the offset of the measured object in terms of position when the calibration image frame was taken and when the reference image frame was taken. Based on the offset parameters, the measured object is moved to a position that matches the corresponding position in the reference image frame, that is, the measured object is moved to the position it was in when the reference image frame was taken.

[0075] The device continues to operate, taking pictures of the object under test and obtaining an image frame, which is then displayed on the display device as the display image frame; when the device stops operating, the imaging device no longer takes pictures of the object under test.

[0076] The aforementioned corrected image frames are not displayed, or are displayed in a manner less significant than the displayed image frames. For an explanation of this, please refer to the preceding content; it will not be repeated here.

[0077] Furthermore, for situations not covered above, those skilled in the art can adjust the above implementation methods according to actual needs to match the corresponding requirements.

[0078] When a display image frame already exists, a secondary display image frame can be captured by moving the object under test based on at least one of the reference image frame or the calibration image frame, as well as the display image frame. Specifically, an offset parameter can be calculated using the display image frame and the reference image frame, and the position of the object under test can be adjusted according to the offset parameter, and the object under test can be captured again to obtain a secondary display image frame; alternatively, an offset parameter can be calculated using the display image frame and the calibration image frame, and the position of the object under test can be adjusted according to the offset parameter, and the object under test can be captured again to obtain a secondary display image frame; alternatively, an offset parameter can be calculated simultaneously using the display image frame, the calibration image frame, and the reference image frame, or further, a secondary offset parameter can be calculated based on the offset parameter calculated between pairs of images, and the position of the object under test can be adjusted according to the offset parameter or the secondary offset parameter, and the object under test can be captured again to obtain a secondary display image frame. All display image frames are displayed on the display device. Specifically, both the display image frame and the secondary display image frame obtained in the aforementioned steps are displayed on the display device, and the display image frame is displayed before the secondary display image frame. If the above steps continue to run in a loop, in the new loop, the secondary display image frame from the previous loop will be used as the display image frame, and the newly captured display image frame will be used as the secondary display image frame, and the two will be displayed in sequence.

[0079] In addition, based on the primary display image frame and the secondary display image frame, the object under test can be moved and photographed to obtain the tertiary display image frame. In subsequent loops, the secondary display image frame is used as the primary display image frame, and the tertiary display image frame is used as the secondary display image frame. This loop is repeated to correct the display image frame.

[0080] It should be noted that the aforementioned reference image frames can be displayed and output as needed.

[0081] Furthermore, based on the aforementioned corrections, further image processing corrections can be applied to the displayed image frame itself. For example, after capturing the displayed image frame and before displaying it, the displayed image frame can be compared with a reference image frame, and the image of the displayed image frame can be used as the new displayed image frame. Additionally, if necessary, the positional differences between the displayed image frame and the image frame obtained before capturing it can be compared, and the image of the displayed image frame can be moved through image processing to become the new displayed image frame. More specifically, a combination of pixel translation and pixel filling can be used for image processing of the displayed image frame.

[0082] The aforementioned specific display device, display output device, display device, and display output device can be a monitor; it can also be displayed on a projected object by projection, such as by projecting through a projector; or it can be displayed by simulation, for example, by controlling a movable entity to change its position or state to simulate the formation of observable information. It should also be noted that those skilled in the art can, as needed, display the image frames not displayed in this application through another display device or another area of ​​the display device. Furthermore, the aforementioned display-related technical solutions, in addition to real-time display, also include selective display after the corresponding data collection is completed using the above methods.

[0083] Specifically, the aforementioned offset parameters can be calculated as follows: Based on actual needs, by identifying the difference in position of the same feature of the tested object in the images (reference image frame, correction image frame, or at least one of the reference image frame, correction image frame, and display image frame), the actual offset of the tested object displayed in the image is determined. Based on the offset in the image, the actual offset of the tested object is deduced. Furthermore, based on the actual offset of the tested object, the tested object is controlled to move in the opposite direction and distance of the actual offset, so that after the movement, the tested object is as close as possible to its position before the actual offset occurred, i.e., the position when the reference image frame was captured. For example, when identifying the offset parameters of the tested object in the correction image frame and the reference image frame, by comparing the positional differences of a certain morphological structure of the tested object in the images, the offset in the images is determined. Then, based on the correspondence between the image and the actual size, the actual offset is obtained. The tested object is then controlled to move in the opposite direction and distance of the actual offset, so that the tested object returns to its position before the offset. Preferably, the aforementioned selected common feature of the tested item can be chosen as needed, such as the shape features of the tested item, like the edge of a device, artificial markings, or other relatively fixed shape features. Finding the common feature in two images can be determined through local similarity image recognition and traversing each image. Alternatively, machine learning can be used to input the two images into a mapping model to output the position of the common feature in each image, or directly output the offset or actual offset of the tested item between the two images. Multiple features can be selected simultaneously as features used to analyze the offset parameters.

[0084] The following describes an imaging image correction system proposed in this invention.

[0085] An imaging image correction system includes an imaging module, a sample movement module, a data processing module, and a display module. The imaging module is configured to image a sample and output a corresponding signal to the data processing module. The data processing module outputs signals to the sample movement module and the display module based on signals transmitted from at least the imaging module. The sample movement module is configured to move the sample according to the signals transmitted from the data processing module. The display module displays the signals transmitted from the data processing module.

[0086] More specifically, in the magneto-optical Kerr microscopy imaging equipment, the imaging module includes a polarization light source and a polarization analyzer. The polarization light source generates polarized light and illuminates the object under test. The polarized light reflected from the object is imaged by the polarization analyzer to form an image of the corresponding magnetization state. The sample movement module includes a sample displacement stage on which the object under test is placed and can be driven to move within a certain range. The data processing module is electrically or communicatively connected to the imaging module and the sample displacement stage. The data processing module receives the signal from the image output by the polarization analyzer and transmits the signal to the sample displacement stage and the display module. Specifically, the data processing module can be a processor, or a combination of a processor and a memory. By running a preset processing program, such as the aforementioned imaging image correction method and imaging image display method, it sends a display image signal to the display device to display the imaging image and outputs a displacement signal to the sample displacement stage to control the stage to perform corresponding displacements. The specific operation method is described above and will not be repeated here. The display module includes at least one of a monitor, a projector, and a physical simulation device to convert the image signal transmitted from the data processing module to the display module into an image form that can be interpreted or understood by humans. The data processing module transmits the corrected image frames to the display module for display, and partially transmits the image frames acquired by the imaging module to the display module for display.

[0087] The present invention also provides an imaging image correction device, including a signal processing device. The signal processing device is provided with at least a signal input terminal, a first signal output terminal, and a second signal output terminal. The signal processing device processes the signal received at the signal input terminal according to a preset signal processing method and outputs a signal through at least one of the first signal output terminal and the second signal output terminal.

[0088] The signal input terminal is connected to the imaging equipment for data transmission; the first signal output terminal is connected to the displacement control device of the measured object for data transmission; and the second signal output terminal is connected to the display device for data transmission.

[0089] Signal processing equipment should include at least the following signal output sequence:

[0090] The signal input terminal receives signals, and the received signals are processed by the signal processing equipment and then output through the first signal output terminal; the signal input terminal receives signals, and the second signal output terminal outputs signals.

[0091] As a feasible implementation, the signal processing device is a processor capable of running the aforementioned imaging image correction method, specifically in the following manner:

[0092] The signal input terminal receives the imaging data acquired by the imaging device and uses it as a reference image frame;

[0093] The signal input point receives the imaging data acquired by the imaging device and uses it as a correction image frame;

[0094] The processor calculates the offset parameter between the corrected image frame and the reference image frame based on the reference image frame and the corrected image frame;

[0095] The calculated offset parameters are output to the displacement control device of the measured object through the first signal output terminal;

[0096] The signal input terminal receives the imaging data acquired by the imaging device and uses it as a display image frame. The second signal output terminal then transmits the data of the display image frame to the display device for display.

[0097] Optionally, the signal processing device may also include a memory that stores image data acquired by the imaging device, enabling the processor to retrieve and analyze the data from the memory as needed.

[0098] It should be noted that after the first signal output terminal outputs a signal, the signal received by the signal input terminal shall include at least the data or signal of the image of the measured object formed after the time point when the first signal output terminal outputs the signal.

[0099] In addition, signal processing devices can also take the form of MCUs, signal processing circuits, etc. Those skilled in the art can select the appropriate implementation form according to their needs.

[0100] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Therefore, the above descriptions are merely embodiments of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely principles of the present invention. Various equivalent changes and modifications are included without departing from the spirit and scope of the present invention, and all such changes and modifications fall within the scope of the present invention as claimed.

Claims

1. A method for displaying imaging images in magneto-optical Kerr microscopy, characterized in that: At least four image frames are captured sequentially. At least two of the captured image frames are used as displayed image frames, and at least two image frames are used as undisplayed image frames. The number of displayed image frames is less than the number of captured image frames. At least one of the displayed image frames is a corrected image frame. The image frame used for correction is located before the capture time of the image frame being corrected. The correction is performed using at least two undisplayed image frames and at least one displayed image frame to reduce the difference between the position of the object under test and the reference position, where the reference position is the position of the object under test captured before the capture time of any of the image frames being corrected. In this process, at least three image frames are set before the image frame to be corrected, and the image frame to be corrected is not the first image frame displayed.

2. The imaging image display method as described in claim 1, characterized in that: The correction includes: comparing at least two image frames, moving the object under test according to the comparison result, taking a picture of the object under test, and obtaining the corrected image frame.

3. The imaging image display method as described in claim 2, characterized in that: The correction also includes: after photographing the object under test, comparing the obtained image frame with the image frame obtained before photographing, and moving the image of the photographed image frame.

4. An imaging image correction method for magneto-optical Kerr microscopy, characterized in that, At least including: Select a reference image frame; Select the corrected image frame; The object under test is moved according to the reference image frame and the correction image frame. Capture and display image frames; The corrected image frame is not displayed, or is displayed in a manner that is not as prominent as the displayed image frame; The object under test is moved according to at least one of the reference image frame or the correction image frame, and the display image frame; Capture secondary display image frames; Both the display image frame and the secondary display image frame are displayed on the display device, and the display image frame is displayed before the secondary display image frame.

5. The imaging image correction method as described in claim 4, characterized in that, Also includes: Based on the first display image frame and the second display image frame, move the object under test and capture the third display image frame.

6. The imaging image correction method as described in claim 4, characterized in that: The image frame is used for display on an imaging device.

7. The imaging image correction method as described in claim 6, characterized in that: The reference image frame is used for display on the imaging device.

8. The imaging image correction method as described in claim 4, characterized in that: Based on the corrected image frame and the reference image frame, calculate the offset parameter between the corrected image frame and the reference image frame; based on the offset parameter, move the object under test.

9. The imaging image correction method as described in claim 4, characterized in that: An offset parameter is calculated based on at least one of the reference image frame or the correction image frame, and the display image frame; the object under test is moved based on the offset parameter.

10. An imaging image correction method as described in any one of claims 8 or 9, characterized in that: The offset parameter is calculated as follows: by identifying the difference in the position of the same feature of the object being measured in the corresponding image frame, the actual offset of the object being measured is calculated.

11. The imaging image correction method as described in claim 10, characterized in that: Control the measured object to move in the opposite direction and distance to the actual offset.

12. The imaging image correction method as described in claim 4, characterized in that, Also includes: After capturing the display image frame and before displaying the display image frame, the display image frame is compared with the reference image frame, and the image of the display image frame is moved to use the moved display image frame as the display image frame.

13. An imaging image correction system for magneto-optical Kerr microscopy, characterized in that: The system includes an imaging module, a sample movement module, a data processing module, and a display module. The imaging module is configured to image a sample and output a corresponding signal to the data processing module. The data processing module outputs signals to the sample movement module and the display module based on signals transmitted from at least the imaging module. The sample movement module is configured to move the sample according to the signals transmitted from the data processing module. The display module displays the signals transmitted from the data processing module. The data processing module transmits corrected image frames to the display module for display, and at least partially transmits image frames acquired by the imaging module to the display module for display. The data processing module can operate the method according to any one of claims 1-12.

14. An imaging image correction device for magneto-optical Kerr microscopy, characterized in that: The device includes a signal processing device, which is provided with at least a signal input terminal, a first signal output terminal, and a second signal output terminal. The signal processing device processes the signal received by the signal input terminal according to a preset signal processing method and outputs a corresponding signal through at least one of the first signal output terminal and the second signal output terminal. The signal input terminal is connected to the imaging device for data transmission, the first signal output terminal is connected to the displacement control device of the object being measured for data transmission, and the second signal output terminal is connected to the display device for data transmission. The signal processing device includes at least the following signal transmission sequence: The signal input terminal receives a signal, the first signal output terminal outputs a signal, the signal input terminal receives a signal, and the second signal output terminal outputs a signal. The signal processing device is a processor, which can run the method according to any one of claims 1-12.

Citation Information

Patent Citations

  • Correction method for registration errors of sun high-resolution sequence images

    CN106097295A

  • Image processing method and device, electronic equipment and computer readable medium

    CN111935398A

  • Magneto-optical Kerr image registration correction method and system and microscope system

    CN112037270A