Method and device for realizing automatic refocusing of thermal reflection imaging temperature measurement
Through the automatic refocusing method based on the temperature changes of the reference image and the measured part, the three-axis nanodisplacement stage is used to adjust the position of the measured part, which solves the problem of automatic refocusing in the thermal reflection imaging temperature measurement, and improves the accuracy of the temperature measurement results .
Patent Information
- Application Number
- CN202210635536.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-06
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-06-06
AI Technical Summary
The existing thermal reflection imaging temperature measurement technology is difficult to achieve automatic refocusing, which affects the accuracy of the temperature measurement results, especially when the position of the measured part changes due to thermal expansion and contraction, the image sharpness becomes worse and blurred.
By obtaining the clarity of the rectangular area based on the reference image and the temperature changes of the measured part, the position of the measured part is adjusted using a three-axis nanodisplacement stage, and combining preset temperature thresholds, displacement thresholds and clarity conditions, automatic refocusing is achieved. Ensure the accuracy of the measurement results.
It effectively eliminates image blur and data error caused by defocus, improves the accuracy of thermal reflection imaging temperature measurement, and lays the foundation for thermal reflection imaging temperature measurement at high spatial resolution.
Smart Images

Figure CN114993505B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of temperature detection of microelectronic devices based on optical principles, and in particular to a method and device for realizing automatic refocusing of thermal reflection imaging temperature measurement. Background Art
[0002] When visible light shines on the surface of a material, the reflectivity of the material to visible light changes with the temperature of the material. The change in the reflectivity of the material to visible light is linearly related to the change in the temperature of the material surface:
[0003]
[0004] In the formula, △R is the change in reflectivity; R is the reflectivity value at the initial temperature; △T is the temperature change of the material being measured, in K; CTR is the thermal reflectivity calibration coefficient, in K-1.
[0005] According to the above principle, the change in the material surface temperature △T can be calculated by measuring the change in reflectivity △R. This test has a weak effective signal and strong noise, so methods such as multi-frame averaging must be used to enhance the signal-to-noise ratio.
[0006] In order to realize thermal reflection temperature measurement, in addition to measuring the reflectivity and reflectivity change, it is also necessary to know the CTR of the material being measured. The expression of CTR can be written as follows:
[0007]
[0008] The measurement of visible CTR needs to be achieved by measuring the rate of change of reflectivity under changing temperature. The actual thermal reflection temperature measurement device generally uses a CCD camera to measure the visible light signal reflected from the surface of the material, and cannot directly measure the reflectivity. After measuring the light intensity, the CCD camera converts the light intensity into an electrical signal, which is then digitized by the readout circuit and finally expressed in digital form. The value output by the CCD camera is generally called the camera reading (counts), represented by C, so the data finally processed by the computer is the reading of each pixel of the CCD camera. Therefore, formula (2) is rewritten as formula (3):
[0009]
[0010] Where C is the CCD reading at the initial temperature, and ΔC is the change in CCD reading when the temperature changes by ΔT. It must be noted that the CCD reading C is different at different temperatures when the wavelength of the light source is fixed, and the CCD reading is also different at different wavelengths when the temperature is fixed.
[0011] During the entire temperature measurement process, the measured object will expand and contract due to changes in ambient temperature, self-heating when powered on, etc. Since thermal reflection imaging temperature measurement technology has a spatial resolution of microns or even sub-microns, thermal expansion and contraction will cause the measured object to change in three-dimensional direction, which will seriously affect the accuracy of the temperature measurement results. The change in position in the vertical direction will be manifested as a decrease in image clarity and blur, that is, defocus, which will seriously affect the accuracy of the measurement results. Since temperature changes take some time to stabilize, the defocus phenomenon will develop continuously and gradually during the temperature change period during the thermal reflection thermal imaging temperature measurement process.
[0012] The existing thermal reflection imaging temperature measurement technology achieves clear focus by repeatedly adjusting the position or angle of the relevant components of the imaging system under the condition that the position of the calibration plate remains fixed. This requires a specific graphic structure on the calibration plate. During the thermal reflection thermal imaging temperature measurement process, the vertical position of the measured object will change dynamically with the heating or cooling process, requiring a method that can continuously track and focus. In thermal reflection temperature measurement, the measured object is a power device and there are many types, which do not have the specific graphic structure of the calibration plate. This method cannot meet the needs of automatic refocusing of thermal reflection thermal imaging temperature measurement. Summary of the invention
[0013] In order to overcome the problems existing in the related art, the embodiments of the present application provide a method and device for realizing automatic refocusing of thermal reflection imaging temperature measurement, which can improve the accuracy of temperature measurement results and lay the foundation for realizing thermal reflection imaging temperature measurement with high spatial resolution.
[0014] This application is implemented through the following technical solutions:
[0015] In a first aspect, an embodiment of the present application provides a method for realizing automatic refocusing of thermal reflection imaging temperature measurement, comprising: based on a reference image and a temperature change of a measured object, obtaining a rectangular area of the reference image, and calculating the clarity of the rectangular area; the reference image is a clearly focused image when the temperature remains unchanged;
[0016] Based on the temperature change of the measured object and the clarity of the rectangular area, the three-axis nano-displacement stage is adjusted; the temperature control device obtains the temperature change of the measured object; the measured object is placed on the temperature control device; the temperature control device is placed on the three-axis nano-displacement stage;
[0017] After adjusting the three-axis nano-displacement stage each time, the current measurement image is acquired and the clarity of the rectangular area is calculated; the current measurement image still includes the rectangular area;
[0018] The measurement result is determined by judging whether the current temperature of the measured object, the displacement of the three-axis nano-displacement stage and the current clarity meet the preset temperature threshold condition, the preset displacement threshold condition and the preset clarity condition.
[0019] In a possible implementation manner, acquiring a rectangular area of the reference image and calculating the definition of the rectangular area includes:
[0020] Acquiring the reference image;
[0021] Based on the reference image, a rectangular area of the reference image is acquired; the rectangular area is a part of the reference image, and the rectangular area includes a target area image of the test piece;
[0022] Based on the data of the rectangular area, the current definition of the rectangular area is calculated.
[0023] In a possible implementation manner, the calculating the definition of the rectangular area based on the data of the rectangular area includes:
[0024] Obtaining a pixel matrix within the rectangular area, and performing differential operations on the pixel matrix in horizontal and vertical directions;
[0025] The differential operation results in the horizontal and vertical directions are added to obtain the data value of the rectangular area clarity; wherein, the larger the data value of the rectangular area clarity is, the higher the clarity is.
[0026] In a possible implementation, adjusting the three-axis nano-displacement stage based on the temperature change of the measured object and the definition of the rectangular area includes:
[0027] Predicting the change direction of the vertical position of the measured object according to the temperature change of the measured object;
[0028] Based on the changing direction of the vertical position of the measured object, setting the stepping of the three-axis nano-displacement stage each time;
[0029] Based on each step of the three-axis nano-displacement stage, the device moves in a direction opposite to the direction in which the vertical position of the device under test changes.
[0030] In a possible implementation, the method based on the temperature change of the measured object and the definition of the rectangular area further includes:
[0031] When the three-axis nano-displacement stage moves for multiple times, the data value of the current definition is compared with the data value of the previous definition. If the data value of the current definition is greater than the data value of the previous definition, the current step of the three-axis nano-displacement stage is the step of the previous three-axis nano-displacement stage, and the moving direction is the same as the previous moving direction;
[0032] If the data value of the current definition is smaller than the data value of the previous definition, the step of the current three-axis nano-displacement stage is recalculated, and the moving direction is opposite to the previous moving direction.
[0033] In a possible implementation manner, the step of the current three-axis nano-translation stage is calculated based on a frame rate of a camera, a resonant frequency of the three-axis nano-translation stage, and an initial step.
[0034] In a possible implementation, the determining of whether the current temperature of the measured object, the displacement of the three-axis nano-displacement stage, and the current clarity meet a preset temperature threshold condition, a preset displacement threshold condition, and a preset clarity condition, and determining the measurement result includes:
[0035] If the current temperature of the measured object, the displacement of the three-axis nano-displacement stage and the current clarity simultaneously meet the preset temperature threshold condition, the preset displacement threshold condition and the preset clarity condition, the three-axis nano-displacement stage stops moving;
[0036] The current image data obtained is the measurement result;
[0037] The preset temperature threshold condition is when the temperature fluctuation range of the measured object is less than the temperature threshold within a preset time period;
[0038] The preset displacement threshold condition is that the current step of the three-axis nano-displacement stage is less than the set displacement threshold;
[0039] The preset definition condition is that the current definition data value is greater than the previous definition data value.
[0040] In a second aspect, an embodiment of the present application provides a device for realizing automatic refocusing of thermal reflection imaging temperature measurement, comprising: a CCD camera, a fixing device, a light source, an objective lens, a temperature control device, a three-axis nano-displacement stage and an optical platform; the CCD camera is used to acquire all images;
[0041] The fixing device is arranged on the optical platform and is used to fix the CCD camera, the light source and the objective lens;
[0042] The temperature control device is arranged on the three-axis nano-displacement platform, and is used to place the measured object and obtain the temperature change of the measured object;
[0043] The three-axis nano-displacement stage is arranged on the optical platform and is used for adjusting the position movement of the measured object.
[0044] In a third aspect, an embodiment of the present application provides a terminal device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, it implements any possible implementation method of the first aspect.
[0045] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements any possible implementation method of the first aspect.
[0046] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0047] In the embodiment of the present application, automatic refocusing in the thermal reflection imaging temperature measurement process is determined by preset temperature threshold conditions, preset displacement threshold conditions and preset clarity conditions, so that the image of the measured object always remains clear, and image blur and data errors caused by defocus are eliminated. This is a key technology for realizing optical thermal reflection temperature measurement, which can improve the accuracy of temperature measurement results and lay the foundation for realizing thermal reflection imaging temperature measurement at high spatial resolution.
[0048] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present specification. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0050] Figure 1 is a structural diagram of an automatic refocusing device provided in one embodiment of the present application;
[0051] Figure 2 is a flow chart of an automatic refocusing method provided by an embodiment of the present application;
[0052] Figure 3 is a reference image containing a rectangular area provided by an embodiment of the present application;
[0053] Figure 4 This is a diagram of image changes and image clarity changes during the automatic refocusing process provided by an embodiment of the present application. DETAILED DESCRIPTION
[0054] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0055] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0056] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0057] It should also be understood that the term "relative" used in the present specification and the appended claims refers to relative positions in mechanical movement.
[0058] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0059] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0060] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0061] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.
[0062] Figure 1 It is a structural diagram of an automatic refocusing device, and the method for realizing automatic refocusing of thermal reflection imaging temperature measurement of the present invention is implemented based on the device.
[0063] In one embodiment, referring to Figure 1, a device for realizing automatic refocusing of thermal reflection imaging temperature measurement, characterized in that it includes: a CCD camera 1, a fixing device 2, a light source 3, an objective lens 4, a temperature control device 5, a three-axis nano-displacement stage 6 and an optical platform 7. The CCD camera 1 is used to obtain a reference image; the fixing device 2 is arranged on the optical platform 7, and is used to fix the CCD camera 1, the light source 3 and the objective lens 4; the temperature control device 5 is arranged on the three-axis nano-displacement stage 6, and is used to place the DUT under test and obtain the temperature change of the DUT under test; the three-axis nano-displacement stage 6 is arranged on the optical platform 7, and is used to adjust the position movement of the DUT under test.
[0064] In one embodiment, see Figure 2 , a device for automatic refocusing based on thermal reflection imaging temperature measurement, and a method for realizing automatic refocusing of thermal reflection imaging temperature measurement are described in detail as follows:
[0065] Step 101, based on the reference image and the temperature change of the test piece, a rectangular area of the reference image is obtained, and the definition of the rectangular area is calculated; the reference image is a clearly focused image when the temperature remains unchanged.
[0066] See also Figure 3 , calculating the clarity of the rectangular area may include: obtaining a reference image 1 under a preset temperature condition; based on the reference image 1, selecting a rectangular area 3; the rectangular area 3 is a part of the reference image 1, and the rectangular area 3 contains the target area image 2 of the test piece; based on the data of the rectangular area 3, calculating the clarity of the rectangular area 3.
[0067] Specifically, a rectangular area 3 is selected on the reference image 1. The area should contain the target observation area 2, not any arbitrary area. The readings of each pixel in the rectangular area 3 will form a matrix with M rows corresponding to the image Y direction and N columns corresponding to the image X direction. The readings C[m][n] of each pixel in the rectangular area are obtained, where m is the number of rows in the rectangular area (0...M) and n is the number of columns in the rectangular area (0...N).
[0068] In the X direction, perform the difference operation:
[0069]
[0070] In the Y direction, perform the difference operation:
[0071]
[0072] Equation (4) and equation (5) are added together, and the sum is used as the definition data F.
[0073] Among them, based on the data of the rectangular area, the clarity of the rectangular area is calculated, including: obtaining the pixel point matrix in the rectangular area, and performing differential operations on the pixel point matrix in the horizontal and vertical directions; adding the differential operation results in the horizontal and vertical directions to obtain the data value of the clarity of the rectangular area; wherein, the larger the data value of the clarity of the rectangular area, the higher the clarity.
[0074] Exemplarily, the reference image refers only to the image in the initial state and when the temperature of the test piece does not change; the subsequent clarity data is also obtained by measuring the image of the test piece. Each time the nano-stage is adjusted, the image must be acquired first, then the above-mentioned rectangular area, which is also an image, and then the data on the image must be acquired.
[0075] For example, for a device under test, the temperature changes in different areas are different. Some position changes are due to self-heating, and some temperature changes are due to heat conduction or other reasons. Therefore, the above rectangular area must contain the image of the part to be measured, that is, the image of the target area of the device under test.
[0076] Step 102, based on the temperature change of the measured object and the definition of the rectangular area, the three-axis nano-displacement stage is adjusted; the temperature control device obtains the temperature change of the measured object; the measured object is placed on the temperature control device; the temperature control device is placed on the three-axis nano-displacement stage.
[0077] Among them, based on the temperature change of the measured object and the clarity of the rectangular area, the three-axis nano-displacement stage 6 is adjusted, including: predicting the change direction of the vertical position of the measured object according to the temperature change of the measured object; setting the stepping of the three-axis nano-displacement stage 6 each time based on the change direction of the vertical position of the measured object; and moving in the opposite direction of the change direction of the vertical position of the measured object based on each stepping of the three-axis nano-displacement stage 6.
[0078] Among them, based on the temperature change of the measured object and the clarity of the rectangular area, the three-axis nano-displacement stage 6 is adjusted, and it also includes: when the three-axis nano-displacement stage 6 moves for multiple times, the data value of the current clarity is compared with the data value of the previous clarity. If the data value of the current clarity is greater than the data value of the previous clarity, the current step of the three-axis nano-displacement stage 6 is the step of the three-axis nano-displacement stage 6 last time, and the moving direction is the same as the last moving direction; if the data value of the current clarity is smaller than the data value of the previous clarity, the current step of the three-axis nano-displacement stage 6 is recalculated, and the moving direction is opposite to the last moving direction.
[0079] The current step of the three-axis nano-displacement stage 6 is calculated based on the frame rate of the camera 1 , the resonant frequency of the three-axis nano-displacement stage 6 , and the initial step.
[0080] Exemplarily, the temperature T of the workpiece under test is monitored using a thermocouple or other temperature measuring instrument. As the temperature of the workpiece under test changes and defocus occurs to the workpiece under test, the clarity data will necessarily become smaller. At this time, the nano-positioning stage 6 based on piezoelectric ceramics is used to adjust the position of the Z-axis in real time. Predict the direction of the vertical position change of the workpiece under test according to whether the temperature rises or falls. Generally, when the temperature rises, the vertical position of the workpiece under test rises; when the temperature drops, the vertical position of the workpiece under test drops. According to the predicted direction of position change, set the nano-positioning stage 6 to move in the opposite direction of the vertical position change of the workpiece under test with an initial step size l0. Immediately collect an image after each movement is completed, and calculate its clarity data F x ; x is the number of displacements of the nano-positioning stage 6. It varies according to the depth of field of the objective lens 4 used, generally about 1 μm.
[0081] Exemplarily, after the nano-positioning stage 6 moves 2 times, compare the clarity data F1 and F2. If F1 < F2, the nano-positioning stage 6 continues to move in the original direction with a step size l0; if F1 > F2, the nano-positioning stage 6 moves in the opposite direction with a step size l0.
[0082] Exemplarily, when the number of movements x is greater than or equal to 3, if F x-1 < F x then the nano-positioning stage 6 continues to move in the original direction with a step size l0; if F x-1 > F x then the nano-positioning stage 6 moves in the opposite direction with a step size kl0 (0 < k < 1), and the value of k is related to the frame rate of the CCD camera 1, the resonance frequency of the nano-positioning stage 6, etc.
[0083] Step 103, after adjusting the three-axis nano-positioning stage each time, obtain the current measurement image and calculate the clarity of the rectangular area; the current measurement image still contains the rectangular area.
[0084] Exemplarily, calculate the clarity of the rectangular area based on the data of the rectangular area, including: obtaining the pixel point matrix within the rectangular area, performing differential operations on the pixel point matrix in the horizontal and vertical directions; adding the differential operation results in the horizontal and vertical directions to obtain the data value of the clarity of the rectangular area; among them, the larger the data value of the clarity of the rectangular area, the higher the clarity.
[0085] Step 104, by judging whether the temperature of the current workpiece under test, the displacement of the three-axis nano-positioning stage, and the current clarity meet the preset temperature threshold condition, preset displacement threshold condition, and preset clarity condition, if they are met, determine the measurement result, otherwise execute step 102.
[0086] Among them, judging whether the current temperature of the measured object, the displacement of the three-axis nano-displacement stage 6 and the current clarity meet the preset temperature threshold condition, the preset displacement threshold condition and the preset clarity condition, and determining the measurement result, includes: if the current temperature of the measured object meets the preset temperature threshold condition, the displacement of the three-axis nano-displacement stage 6 meets the preset displacement threshold condition, and the current rectangular area clarity meets the preset clarity condition, then the three-axis nano-displacement stage 6 stops moving; and obtaining the current image data as the measurement result.
[0087] If the current temperature of the measured object does not meet the preset temperature threshold condition, or the displacement of the three-axis nano-displacement stage 6 does not meet the preset displacement threshold condition, or the current rectangular area clarity does not meet the preset clarity condition, that is, one of the three does not meet its corresponding condition, then continue to adjust the three-axis nano-displacement stage 6 based on the temperature change and clarity of the measured object.
[0088] Among them, the preset temperature threshold condition is when the temperature fluctuation range of the measured object is less than the temperature threshold within the preset time period; the preset displacement threshold condition is when the current step of the three-axis nano-displacement stage 6 is less than the set displacement threshold; the preset clarity condition is when the current clarity data value is greater than the previous clarity data value.
[0089] For example, the temperature threshold T is set th (determined according to the required test accuracy, generally less than 0.5°C), when the temperature fluctuation of the measured object measured by the thermocouple is less than T th If kl0 is less than the set displacement threshold l th (generally less than 10% of the depth of field of the objective lens used) and F x-1 <F x When the nanometer displacement stage 6 stops moving, the CCD camera is controlled to collect an image as an image for calculating the effective measurement result.
[0090] For example, see Figure 4 According to the method for realizing automatic refocusing of thermal reflection imaging temperature measurement of the present invention, the clarity of the refocused image can be restored to the same position as the original clarity after defocusing.
[0091] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0092] The present application also provides a terminal device, which may include: at least one processor and a memory, wherein the memory stores a computer program that can be run on the at least one processor, and when the processor executes the computer program, the steps in any of the above method embodiments are implemented, such as Figure 2 Steps 101 to 104 in the illustrated embodiment. Alternatively, when the processor executes the computer program, the function of the automatic refocusing device for thermal reflection imaging temperature measurement in the above-mentioned device embodiments is realized.
[0093] Exemplarily, the computer program may be divided into one or more modules / units, one or more modules / units are stored in a memory and executed by a processor to complete the present application. The one or more modules / units may be a series of computer program segments capable of completing specific functions, and the program segments are used to describe the execution process of the computer program in a terminal device.
[0094] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0095] The memory may be an internal storage unit of the terminal device, or an external storage device of the terminal device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. The memory is used to store the computer program and other programs and data required by the terminal device. The memory may also be used to temporarily store data that has been output or is to be output.
[0096] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.
[0097] The method for realizing automatic refocusing of thermal reflection imaging temperature measurement provided in the embodiment of the present application can be applied to terminal devices such as computers, tablet computers, laptop computers, netbooks, personal digital assistants (PDAs), etc. The embodiment of the present application does not impose any restrictions on the specific type of terminal devices.
[0098] An embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in each embodiment of the above-mentioned method for realizing automatic refocusing of thermal reflection imaging temperature measurement.
[0099] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal implements the steps in each embodiment of the method for realizing automatic refocusing of thermal reflection imaging temperature measurement.
[0100] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0101] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0102] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0103] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0104] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0105] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A method for realizing automatic refocusing of thermal reflection imaging temperature measurement, characterized in that: include: Based on a reference image, obtaining a rectangular area of the reference image, and calculating the definition of the rectangular area; The reference image is a clearly focused image when the temperature remains unchanged; The obtaining of the rectangular area of the reference image and calculating the definition of the rectangular area comprises: obtaining the reference image; obtaining the rectangular area of the reference image based on the reference image; the rectangular area is a part of the reference image, and the rectangular area includes the target area image of the test piece; and calculating the current definition of the rectangular area based on the data of the rectangular area; Based on the temperature change of the measured object and the clarity of the rectangular area, the three-axis nano-displacement stage is adjusted; the temperature control device obtains the temperature change of the measured object; the measured object is placed on the temperature control device; the temperature control device is placed on the three-axis nano-displacement stage; The adjusting of the three-axis nano-displacement stage based on the temperature change of the measured object and the definition of the rectangular area includes: predicting the change direction of the vertical position of the measured object according to the temperature change of the measured object; setting the stepping of the three-axis nano-displacement stage each time based on the change direction of the vertical position of the measured object; and moving in the opposite direction of the change direction of the vertical position of the measured object based on the stepping of the three-axis nano-displacement stage each time; The method of adjusting the three-axis nano-displacement stage based on the temperature change of the measured object and the definition of the rectangular area further includes: after the three-axis nano-displacement stage moves for multiple times, comparing the data value of the current definition with the data value of the previous definition, if the data value of the current definition is greater than the data value of the previous definition, then the step of the current three-axis nano-displacement stage is the step of the previous three-axis nano-displacement stage, and the moving direction is the same as the previous moving direction; if the data value of the current definition is smaller than the data value of the previous definition, then recalculating the step of the current three-axis nano-displacement stage, and the moving direction is opposite to the previous moving direction; After adjusting the three-axis nano-displacement stage each time, the current measurement image is acquired, and the clarity of the rectangular area is calculated; the current measurement image still includes the rectangular area; The measurement result is determined by judging whether the current temperature of the measured object, the displacement of the three-axis nano-displacement stage and the current rectangular area clarity meet the preset temperature threshold condition, the preset displacement threshold condition and the preset clarity condition.
2. The automatic refocusing method according to claim 1, characterized in that: The calculating the current definition of the rectangular area based on the data of the rectangular area includes: Obtaining a pixel matrix within the rectangular area, and performing differential operations on the pixel matrix in horizontal and vertical directions; The differential operation results in the horizontal and vertical directions are added to obtain the data value of the rectangular area clarity; wherein, the larger the data value of the rectangular area clarity is, the higher the clarity is.
3. The automatic refocusing method according to claim 1, characterized in that: The step of the current three-axis nano-translation stage is calculated based on the frame rate of the camera, the resonant frequency of the three-axis nano-translation stage, and the initial step.
4. The automatic refocusing method according to claim 1, characterized in that: The determining whether the current temperature of the measured object, the displacement of the three-axis nano-displacement stage and the current clarity meet a preset temperature threshold condition, a preset displacement threshold condition and a preset clarity condition, and determining the measurement result includes: If the current temperature of the measured object, the displacement of the three-axis nano-displacement stage and the current clarity simultaneously meet the preset temperature threshold condition, the preset displacement threshold condition and the preset clarity condition, the three-axis nano-displacement stage stops moving; The current image data obtained is the measurement result; The preset temperature threshold condition is when the temperature fluctuation range of the measured object is less than the temperature threshold within a preset time period; The preset displacement threshold condition is that the current step of the three-axis nano-displacement stage is less than the set displacement threshold; The preset definition condition is that the current definition data value is greater than the previous definition data value.
5. A device for realizing automatic refocusing of thermal reflection imaging temperature measurement, characterized in that: The method for automatic refocusing according to any one of claims 1 to 4 is applied, wherein the device comprises: a CCD camera, a fixing device, a light source, an objective lens, a temperature control device, a three-axis nano-displacement stage and an optical platform; The CCD camera is used to acquire all images; The fixing device is arranged on the optical platform and is used to fix the CCD camera, the light source and the objective lens; The temperature control device is arranged on the three-axis nano-displacement platform, and is used to place the measured object and obtain the temperature change of the measured object; The three-axis nano-displacement stage is arranged on the optical platform and is used for adjusting the position movement of the measured object.
6. A terminal device, comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 4 is implemented.
7. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.
