Calibration system, calibration method and calibration procedure
By controlling the temperature difference of the target unit captured by the infrared camera, the infrared brightness contrast between high and low emissivity areas was achieved, improving the calibration accuracy of the vehicle's infrared camera and solving the boundary blurring problem caused by indoor environmental interference light.
Patent Information
- Application Number
- CN202580025763.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-07-05
- Filing Date
- 2025-05-08
- Publication Date
- 2026-11-17
AI Technical Summary
During the calibration of the infrared camera mounted on the vehicle, factors such as indoor ambient light interference can cause the boundaries of black and white areas to become blurred, affecting the accuracy of intersection point coordinate extraction and thus reducing calibration accuracy.
The target unit is photographed by an infrared camera. The temperature difference between the high emissivity region and the low emissivity region is controlled so that the high emissivity region is higher than the low emissivity region. The target image is obtained in a two-dimensional arrangement, and the coordinates of the feature points in the target region are extracted. The calibration is performed based on the relative positional relationship of the feature points.
This improved the calibration accuracy of characteristic parameters, ensured the accurate extraction of feature point coordinates, and enhanced the calibration effect of the infrared camera.
Smart Images

Figure CN123125620A_ABST
Abstract
Description
[0001] Cross-reference of related applications
[0002] This application is based on Japanese Patent Application No. 2024-109002, filed on July 5, 2024, the contents of which are incorporated herein by reference in their entirety. Technical Field
[0003] This disclosure relates to a calibration technique for calibrating characteristic parameters of a camera. Background Technology
[0004] The technology disclosed in Patent Document 1 involves capturing images of a checkerboard pattern in which black and white areas are arranged in a checkerboard pattern using a camera. Therefore, in the technology disclosed in Patent Document 1, the camera's characteristic parameters are calibrated based on the coordinates of the intersection points of the boundary lines in the captured image of the checkerboard pattern.
[0005] Existing technical documents
[0006] Patent documents
[0007] Patent Document 1: Patent No. 6906177
[0008] Therefore, when applying the technology disclosed in Patent Document 1 to an infrared camera mounted on a vehicle, the calibration environment becomes a relatively large indoor space. In this case, the following insight was gained: in the checkerboard pattern presented in the captured image, the boundaries between black and white areas become blurred due to the influence of factors such as interfering light in the indoor space. Therefore, there is a concern that the accuracy of extracting intersection coordinates at the boundaries between areas will deteriorate, thereby deteriorating the calibration accuracy. Summary of the Invention
[0009] The present disclosure addresses the problem of providing a calibration system for improving calibration accuracy. Another objective of the present disclosure is to provide a calibration method for improving calibration accuracy. A further objective of the present disclosure is to provide a calibration procedure for improving calibration accuracy.
[0010] The following describes the technical means of this disclosure used to solve the problem.
[0011] The first method of this disclosure is:
[0012] A calibration system, comprising a processor, for calibrating characteristic parameters of an infrared camera mounted on a vehicle.
[0013] Composed of execution:
[0014] An image of the target unit is acquired by photographing the target unit with an infrared camera. Within the target unit, at least one of high-emissivity regions and low-emissivity regions adjacent to each other in a manner that creates a difference in emissivity is arranged in two dimensions as the target region.
[0015] By extracting the coordinates of feature points from multiple target regions presented in the target image, the characteristic parameters are calibrated based on the relative positional relationship between the feature point coordinates of each target region.
[0016] The acquisition of the target image includes:
[0017] The target unit is captured by an infrared camera, and the temperature difference between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
[0018] The second method of this disclosure is:
[0019] A calibration method, executed by a processor to calibrate characteristic parameters of an infrared camera mounted on a vehicle, includes:
[0020] An image of the target unit is acquired by photographing the target unit with an infrared camera. Within the target unit, at least one of high-emissivity regions and low-emissivity regions adjacent to each other in a manner that creates a difference in emissivity is arranged in two dimensions as the target region.
[0021] By extracting the coordinates of feature points from multiple target regions presented in the target image, the characteristic parameters are calibrated based on the relative positional relationship between the feature point coordinates of each target region.
[0022] The acquisition of the target image includes:
[0023] The target unit is captured by an infrared camera, and the temperature difference between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
[0024] The third method disclosed herein is:
[0025] A calibration program, stored in a storage medium for calibrating characteristic parameters of an infrared camera mounted on a vehicle, includes instructions for instructing a processor to perform the calibration.
[0026] It contains instructions for performing the following actions:
[0027] An image of the target unit is acquired by photographing the target unit with an infrared camera. Within the target unit, at least one of high-emissivity regions and low-emissivity regions adjacent to each other in a manner that creates a difference in emissivity is arranged in two dimensions as the target region.
[0028] By extracting the coordinates of feature points from multiple target regions presented in the target image, the characteristic parameters are calibrated based on the relative positional relationship between the feature point coordinates of each target region.
[0029] The acquisition of the target image includes:
[0030] The target unit is captured by an infrared camera, and the temperature difference between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
[0031] Thus, in the first to third methods, the infrared camera mounted on the vehicle captures target units arranged in a two-dimensional pattern, with at least one of the adjacent high-emissivity regions and low-emissivity regions having a difference in emissivity as the target region. Then, by extracting the feature point coordinates of multiple target regions presented in the captured target image, the characteristic parameters are calibrated based on the relative positional relationship between the feature point coordinates of each target region.
[0032] Here, regarding the target unit in the first to third methods, with the high emissivity region having a higher temperature than the low emissivity region, the infrared camera captures the target unit while the temperature difference between these regions is controlled, thus presenting it in the target image. Therefore, by ensuring the difference in radiation energy between the high emissivity region and the low emissivity region based on the controlled temperature difference, the boundary presented in the target image can be given infrared brightness contrast. Thus, by using at least one of the high emissivity region and the low emissivity region, the extraction accuracy of feature point coordinates in each target region where the boundary can be accurately determined can be improved, thereby improving the calibration accuracy of the characteristic parameters. Attached Figure Description
[0033] Figure 1 This is a block diagram showing the overall structure of the first embodiment.
[0034] Figure 2 This is a block diagram showing the structure of the calibration system according to the first embodiment.
[0035] Figure 3 This is a front view showing the target unit of the calibration system according to the first embodiment.
[0036] Figure 4 This is a flowchart illustrating the external calibration process according to the first embodiment.
[0037] Figure 5 This is a top surface diagram used to illustrate the external calibration process according to the first embodiment.
[0038] Figure 6This is a schematic diagram showing the target image acquired in the external calibration process according to the first embodiment.
[0039] Figure 7 This is a schematic diagram illustrating the external calibration process according to the first embodiment.
[0040] Figure 8 This is a flowchart illustrating the internal calibration process according to the first embodiment.
[0041] Figure 9 This is a perspective view used to illustrate the internal calibration process according to the first embodiment.
[0042] Figure 10 This is a schematic diagram showing the target image obtained in the internal calibration process according to the first embodiment.
[0043] Figure 11 This is a schematic diagram illustrating the internal calibration process according to the first embodiment.
[0044] Figure 12 This is a block diagram illustrating the structure of the calibration system according to the second embodiment.
[0045] Figure 13 This is a front view showing the target unit of the calibration unit according to the third embodiment.
[0046] Figure 14 This is a schematic diagram illustrating the external calibration process and the internal calibration process according to the third embodiment.
[0047] Figure 15 This is a front view showing the target unit of the calibration unit according to the fourth embodiment.
[0048] Figure 16 This is a schematic diagram illustrating the external calibration process and the internal calibration process according to the fourth embodiment.
[0049] Figure 17 This is a front view showing the target unit of the calibration unit according to the fifth embodiment.
[0050] Figure 18 This is a schematic diagram illustrating the external calibration process and the internal calibration process according to the fifth embodiment.
[0051] Figure 19 This is a front view showing the target unit of the calibration unit according to a variation of the first and third embodiments. Detailed Implementation
[0052] Hereinafter, several embodiments of the present disclosure will be described based on the figures. Furthermore, in each embodiment, corresponding constituent elements are given the same reference numerals, and repeated descriptions may be omitted. Additionally, in cases where only a portion of the structure is described in each embodiment, the structures of other embodiments previously described can be applied to the other parts of that structure. Moreover, not only combinations of structures explicitly shown in the descriptions of each embodiment are possible, but structures of multiple embodiments can be partially combined with each other even without explicit description, provided that such combinations do not create obstacles.
[0053] (First Implementation)
[0054] Figure 1 The calibration system 1 of the first embodiment shown is constructed to calibrate the characteristic parameter Pc of the infrared camera 3 mounted on the main vehicle 2. Therefore, the calibration system 1 is installed in a calibration facility, such as the production or maintenance facility of the main vehicle 2. The main vehicle 2 is, among multiple vehicles requiring calibration of their mounted infrared cameras 3, one of which is located in the indoor space 9 of the calibration facility (see below). Figure 5 , 9 The vehicle that was included in the calibration was the one that was being calibrated.
[0055] like Figure 2 As shown, the infrared camera 3, which is the calibration target based on the calibration system 1, is configured to include an image sensor 31, a lens system 32, and an image circuit 33 together with a memory 30. The image sensor 31 is a semiconductor element, such as a microbolometer, having multiple pixels arranged vertically and horizontally. The image sensor 31 captures an infrared image pixel by pixel of a target object present in the field of view of the lens system 32 outside the infrared camera 3, particularly an infrared image of the target object receiving light in the far-infrared region (e.g., wavelength range of 7-14 μm) in this embodiment. The image circuit 33 is a semiconductor chip, such as an image processing circuit, that processes the image signals from each pixel of the image sensor 31. The image circuit 33 outputs an infrared image Ii by sampling the infrared brightness pixel by pixel and digitizing it according to the radiant energy of the infrared image receiving light from the field of view.
[0056] Therefore, as Figure 1 As shown, the transmission of infrared image Ii from the main vehicle 2 to the calibration system 1 is achieved through digital transmission via the communication network between the two (2 and 1). Furthermore, the output command Oi, which commands the calibration system 1 to output infrared image Ii to the main vehicle 2, is also achieved through digital transmission via the communication network between the two (1 and 2).
[0057] The characteristic parameter Pc of the infrared camera 3 includes the extrinsic parameter Pco and the intrinsic parameter Pci. The extrinsic parameter Pco is defined as a matrix parameter used to transform the external global coordinate system of the infrared camera 3 to its own camera coordinate system. The intrinsic parameter Pci is defined as a matrix parameter used to transform the internal camera coordinate system of the infrared camera 3 to the image coordinate system of the infrared image Ii. Based on these definitions, the characteristic parameter Pc is assigned as the camera matrix by the matrix product of the extrinsic parameter Pco and the intrinsic parameter Pci, which follows the number 1.
[0058] [Number 1]
[0059]
[0060] The calibration system 1 outputs calibration data Dc to the infrared camera 3 mounted on the host vehicle 2 in order to provide the host vehicle 2 with calibrated characteristic parameters Pc. The transmission of calibration data Dc from the calibration system 1 to the host vehicle 2 is achieved via digital transmission through the communication network between the two systems 1 and 2. The calibration data Dc provided to the host vehicle 2 is stored in the memory 30 of the infrared camera 3. The characteristic parameters Pc represented by the calibration data Dc stored in the memory 30 are used for images captured by the infrared camera 3.
[0061] The calibration system 1 includes a display unit 5, an input unit 6, a target unit 7, and a processing computer 10. The display unit 5 is a digital display for the operator of the calibration system 1, such as an LCD panel or an OLED panel. The input unit 6 accepts input from the operator of the calibration system 1, such as a mouse, trackball, or keyboard.
[0062] Figures 1-3 The target unit 7 shown has multiple high-emissivity regions 70 and low-emissivity regions 71 that are adjacent to each other in a manner that varies in emissivity. In the first embodiment, the high-emissivity regions 70 and low-emissivity regions 71 are respectively... Figure 3 Such a rectangular target area 72, in terms of length and width (described later) Figure 5 , 9 In the settings, the chessboard-like layout (up, down, left, right) is arranged in a two-dimensional pattern with side-by-side interactions. Furthermore, Figure 3 The number of rows and columns shown is an example, and the number of rows and columns may be the same or different in the calibration of the external parameter Pco and the internal parameter Pci, which will be discussed later.
[0063] At least the surface of each high emissivity region 70 (in Figure 5 , 9In the configured state, the front surfaces of the two sides of the main vehicle have an emissivity of, for example, 0.7 or higher, preferably 0.8 or higher, and more preferably 0.9 or higher. Therefore, at least the surface of each high emissivity region 70 is preferably made of a material such as black paint, black vinyl resin, black rubber, or black cloth. On the other hand, at least the surface of each low emissivity region 71 (in the configuration state, which is the front surface of the two sides of the main vehicle) has an emissivity of, for example, 0.7 or higher, preferably 0.8 or higher, and more preferably 0.9 or higher. Figure 5 , 9 In the configuration state, the front surface (which becomes the two sides of the main vehicle) has an emissivity of, for example, 0.3 or less, preferably 0.2 or less, and more preferably 0.1 or less. Therefore, at least the surface of each low emissivity region 71 is preferably made of a material such as aluminum, copper, stainless steel, or glass.
[0064] Target unit 7 has multiple such Figure 1 , 2 The heating element 73 and cooling element 74 are shown. Each heating element 73 is arranged in two dimensions to correspond 1:1 with a high emissivity region 70. Each heating element 73 is constructed of, for example, a Peltier element. Each heating element 73 is configured such that its heating surface is aligned with the back surface of its corresponding high emissivity region 70 (in...). Figure 5 , 9 In the set state, the back side is in contact with the corresponding region 70, thereby enabling the heating of that region 70. On the other hand, each cooling element 74 is arranged in two dimensions to correspond 1:1 with each low-emissivity region 71. Each cooling element 74 is constructed of, for example, a Peltier element. Each cooling element 74 is configured such that its heat-absorbing surface contacts the back side of its corresponding low-emissivity region 71 (in the set state). Figure 5 , 9 The heating elements 73 (in the setting state, the back side) are in contact, thereby enabling cooling of the corresponding area 71. The heating of the high emissivity area 70 based on these heating elements 73 and the cooling of the low emissivity area 71 based on the cooling elements 74 are controlled by the processing computer 10.
[0065] like Figure 1 As shown, the dedicated computer constituting the processing computer 10 has at least one memory 11 and one processor 12. The memory 11 is at least one non-transitorytangible storage medium, such as semiconductor memory, magnetic medium and optical medium, that stores programs and data that can be read by the computer.
[0066] In calibration system 1, processor 12 includes at least one of the following as its core: CPU (Central Processing Unit), GPU (Graphics Processing Unit), and RISC (Reduced Instruction Set Computer). To calibrate the characteristic parameter Pc of the infrared camera 3 mounted on the main vehicle 2, processor 12 executes multiple instructions stored in memory 11, contained in a calibration program. Thus, calibration system 1 constructs multiple functional blocks for calibrating the characteristic parameter Pc of the infrared camera 3 mounted on the main vehicle 2. These multiple functional blocks constructed in calibration system 1 include, for example... Figure 2 The image acquisition block 100 and calibration block 110 are shown.
[0067] Through the combined action of these blocks 100 and 110, the external calibration method for calibrating the external parameter Pco in the characteristic parameter Pc of the infrared camera 3 mounted on the main vehicle 2 is as follows: Figure 4 The external calibration process shown is executed. Upon startup of both calibration system 1 and main vehicle 2, the external calibration process is executed in response to a start input from the operator to input unit 6, based on the start request display of the external calibration on display unit 5. Furthermore, each "S" in the external calibration process represents a step executed by multiple instructions contained in the external calibration program stored in memory 11.
[0068] In S10, the image acquisition block 100 acquires a target image Iit as an infrared image Ii by photographing the target unit 7 from the infrared camera 3 according to the output instruction Oi. Therefore, as Figure 5 As shown, in a calibration facility equipped with calibration system 1, the target unit 7 is configured together with the main vehicle 2 within an indoor space (preferably an enclosed space) 9 with a light source positioned above it. Specifically, during the calibration of the external parameter Pco, multiple and an odd number of target units 7 are configured separately from each other along the left-right direction of the main vehicle 2, which is equipped with infrared camera 3. At this time, the target unit 7 located at the center in the left-right direction, as the frontal unit 7a, is in a fixed configuration state, separated from the main vehicle 2 in the front-rear direction and directly facing it on the optical axis of the lens system 32.
[0069] In S10, the image acquisition block 100 controls the temperature difference ΔT between the high emissivity region 70 and the low emissivity region 71, such that in each target unit 7 in this configuration, the high emissivity region 70 has a higher temperature than the low emissivity region 71. Therefore, in the first embodiment, the high emissivity region 70 in the target region 72 is managed to be above the ambient temperature by being heated to a temperature higher than the ambient temperature inside the indoor space 9. Conversely, the low emissivity region 71 in the target region 72 is managed to be below the ambient temperature by being cooled to a temperature lower than the ambient temperature inside the indoor space 9. Through the temperature management of these regions 70 and 71 respectively, the temperature difference ΔT is preferably controlled to, for example, 10°C, preferably 20°C, and more preferably 30°C, etc.
[0070] In S10, each target unit 7, controlling the temperature difference ΔT between the high emissivity region 70 and the low emissivity region 71, is captured by the infrared camera 3. The result is as follows: Figure 6 As shown in the figure (however, this figure only shows the image Iit of the front unit 7a), the target image Iit that presents all target units 7 is obtained.
[0071] exist Figure 4 In step S11, calibration block 110 extracts the feature point coordinates Cp of multiple target regions 72 presented in the target image Iit acquired by step S10. Thus, calibration block 110 in step S11 calibrates the external parameter Pco based on the relative positional relationship between the feature point coordinates Cp extracted for each target region 72.
[0072] Specifically, in S11, calibration block 110 binarizes the infrared brightness of the high emissivity region 70 and the low emissivity region 71 in the target image Iit. At this time, infrared brightness exceeding a brightness threshold in the high emissivity region 70 is forcibly converted to a high-side fixed value exceeding the brightness threshold, such as a maximum brightness value. On the other hand, infrared brightness below the brightness threshold in the low emissivity region 71 is forcibly converted to a low-side fixed value below the brightness threshold, such as a minimum brightness value. Therefore, calibration block 110 in S11... Figure 7 As shown, the feature point coordinates Cp of each target region 72 presented in the target image Iit are extracted from the high emissivity region 70 and low emissivity region 71 after binarization in the first embodiment.
[0073] Furthermore, in S11, the calibration block 110, based on the relative positional relationship of the extracted feature point coordinates Cp, identifies the offset amount generated at the center point of the front unit 7a presented in the target image Iit, for the center pixel located on the optical axis of the lens system 32 in the target image Iit. Simultaneously, in S11, the calibration block 110, with respect to the horizontal direction of the target image Iit, also identifies the tilt angle generated on the imaginary line connecting the center points of each target unit 7 presented in the target image Iit, based on the relative positional relationship of the extracted feature point coordinates Cp.
[0074] In S11, the external parameter Pco is calibrated by calibration block 110 by combining the identified offset and roll angle. As a result, calibration data Dc, representing the calibrated external parameter Pco, is output to the main vehicle 2 and stored in memory 30, thereby enabling the external parameter Pco to be used for correction of the infrared image Ii acquired by infrared camera 3. Here, calibration data Dc, representing the calibrated internal parameter Pci, can also be displayed to the operator via display unit 5. Furthermore, with the completion of S11, this execution of the external calibration process ends.
[0075] For the external parameter Pco described above, the internal calibration method used to calibrate the internal parameter Pci in the characteristic parameter Pc by using blocks 100 and 110 is as follows: Figure 8 The internal calibration process is executed as shown. Upon startup of both calibration system 1 and main vehicle 2, the internal calibration process is executed in response to a start input from the operator to input unit 6, based on the start request display of the internal calibration on display unit 5. Furthermore, each "S" in the internal calibration process represents a step executed by multiple instructions contained in the internal calibration program stored in memory 11.
[0076] In S20, the image acquisition block 100 acquires a target image Iit as an infrared image Ii by shooting the target unit 7 from the infrared camera 3 according to the output instruction Oi. Therefore, as Figure 9 As shown, the target unit 7 is configured together with the main vehicle 2 within an indoor space (preferably an enclosed space) 9 that is the same as or different from S10. However, during the calibration of the internal parameter Pci, the single target unit 7 is configured separately from the main vehicle 2, which is equipped with the infrared camera 3, in the longitudinal direction. However, whenever the relative configuration state of the target unit 7 and the main vehicle 2 is switched so that the imaging direction from the field of view of the infrared camera 3 toward the center point of the target unit 7 can be variably adjusted in multiple directions, the image is captured repeatedly.
[0077] In S20, the image acquisition block 100 controls the temperature difference ΔT between the high emissivity region 70 and the low emissivity region 71, such that in the target unit 7 where this relative configuration state is switched, the high emissivity region 70 has a higher temperature than the low emissivity region 71. Therefore, in the first embodiment, as a temperature management similar to that in S10, the high emissivity region 70 is heated to a temperature higher than the ambient temperature inside the indoor space 9, and the low emissivity region 71 is cooled to a temperature lower than the ambient temperature inside the indoor space 9, thereby controlling the temperature difference ΔT.
[0078] Thus, in S20, for each target unit 7 whose temperature difference ΔT between the high emissivity region 70 and the low emissivity region 71 is controlled, the images from the infrared camera 3 are repeated whenever the imaging direction is switched. The result is as follows: Figure 10 As shown in the figure (however, this figure only shows the image Iit along the frontal imaging direction along the optical axis of the lens system 32), multiple target images Iit that present the target unit 7 in the imaging direction are obtained.
[0079] exist Figure 8 In step S21, calibration block 110 extracts the feature point coordinates Cp of multiple target regions 72 presented in each target image Iit acquired in step S20. Therefore, calibration block 110 in step S21 calibrates the internal parameter Pci based on the relative positional relationship between the feature point coordinates Cp extracted from each target region 72 in each target image Iit.
[0080] Specifically, in S21, the calibration block 110 performs binarization processing on the infrared brightness of the high emissivity region 70 and the low emissivity region 71 in each target image Iit, similar to the process in S11. Therefore, in S21, the calibration block 110 further binarizes the high emissivity region 70 and the low emissivity region 71 after binarization processing, as described in the first embodiment. Figure 11 The grid point coordinates shown are extracted as feature point coordinates Cp for each target region 72 presented in each target image Iit.
[0081] Then, in S21, the internal parameter Pci is calibrated by the calibration block 110 through nonlinear optimization processing based on the relative positional relationship of the feature point coordinates Cp extracted from each target image Iit. As a result, since the calibration data Dc representing the calibrated internal parameter Pci is output to the main vehicle 2 and stored in the memory 30, the internal parameter Pci can be provided for the correction of the infrared image Ii acquired by the infrared camera 3. Here, the calibration data Dc representing the calibrated internal parameter Pci can also be displayed to the operator through the display unit 5. Furthermore, with the completion of S21, this execution of the internal calibration process ends.
[0082] (Effects)
[0083] The effects of the first embodiment described above will be explained below.
[0084] In the first embodiment, the target unit 7 is captured by the infrared camera 3 mounted on the main vehicle 2. The target unit 7 is arranged in two dimensions with two adjacent high emissivity regions 70 and low emissivity regions 71, which are adjacent to each other in a manner that has a difference in emissivity, as target regions 72. Then, by extracting the feature point coordinates Cp of the multiple target regions 72 presented in the target image Iit acquired by the capture, the characteristic parameter Pc is calibrated according to the relative positional relationship between the feature point coordinates Cp of each target region 72.
[0085] Here, regarding the target unit 7 of the first embodiment, with the high emissivity region 70 having a higher temperature than the low emissivity region 71, the infrared camera 3 captures images of the target image Iit while controlling the temperature difference ΔT between these regions 70 and 71. Thus, by ensuring the difference in radiant energy between the high emissivity region 70 and the low emissivity region 71 based on the controlled temperature difference ΔT, the boundary presented in the target image Iit can be given infrared brightness contrast. Therefore, for both the high emissivity region 70 and the low emissivity region 71, the extraction accuracy of the feature point coordinates Cp in each target region 72, which allows for accurate boundary determination, can be improved, thereby improving the calibration accuracy of the characteristic parameter Pc.
[0086] The target unit 7 of the first embodiment controls the temperature difference ΔT between the high emissivity region 70, which is the target region 72, heated to above ambient temperature, and the low emissivity region 71, which is the target region 72, cooled to below ambient temperature. As a result, the contrast of infrared brightness can be emphasized at the boundary between the high emissivity region 70 and the low emissivity region 71, where the controlled temperature difference ΔT produces the largest possible difference in radiant energy, thus ensuring high accuracy in the infrared brightness of the boundary presented in the target image Iit. Therefore, high extraction accuracy of the feature point coordinates Cp in each target region 72 can be guaranteed, and consequently, high calibration accuracy of the characteristic parameter Pc can be guaranteed.
[0087] According to the first embodiment, feature point coordinates Cp of each target region 72 are extracted from the target image Iit after the infrared brightness of each of the high emissivity region 70 and the low emissivity region 71 has been binarized. Thus, the clear difference in infrared brightness after binarization, which complements the difference in radiant energy based on the controlled temperature difference ΔT, can be used as a contrast factor to define the boundary presented in the target image Iit between the high emissivity region 70 and the low emissivity region 71. Therefore, high extraction accuracy of feature point coordinates Cp in each target region 72 can be guaranteed, thereby ensuring high calibration accuracy of the characteristic parameter Pc.
[0088] According to the first embodiment, the target unit 7 is captured by the infrared camera 3 through a checkerboard-like two-dimensional arrangement of high emissivity regions 70 and low emissivity regions 71, thereby enabling the acquisition of a target image Iit in a capture state presenting the grid points of these regions 70, 71. As a result, the grid point coordinates are easily and accurately extracted as feature point coordinates Cp of each target region 72 in the target image Iit. Therefore, the accuracy of the calibration can be improved regarding the characteristic parameter Pc, which is calibrated based on the relative positional relationship between the grid point coordinates that are the feature point coordinates Cp of each target region 72.
[0089] (Second Implementation)
[0090] like Figure 12 As shown, the second embodiment is a variation of the first embodiment. In the target unit 2007 of the second embodiment, multiple cooling elements 74 are omitted. Therefore, in S10 and S20 of the second embodiment, the heating element 73 corresponding to the high emissivity region 70 is heated to a temperature higher than the ambient temperature inside the indoor space 9, while the low emissivity region 71 is placed in a state exposed to the ambient temperature inside the indoor space 9, thereby controlling the temperature difference ΔT between the regions 70 and 71 constituting the target region 72.
[0091] In this second embodiment, even without temperature management of the low emissivity region 71, the temperature difference ΔT can be controlled by heating the high emissivity region 70, which serves as the target region 72, thus ensuring the difference in radiant energy between regions 70 and 71. This provides infrared brightness contrast to the boundary presented in the target image Iit between regions 70 and 71. Therefore, while simplifying the structure of the target unit 2007, the extraction accuracy of the feature point coordinates Cp in each target region 72 can be ensured, thereby ensuring the calibration accuracy of the characteristic parameter Pc. Furthermore, the effects following the first embodiment can be achieved for situations other than the target region 72 and the temperature management point.
[0092] (Third implementation method)
[0093] like Figure 13 As shown, the third embodiment is a variation of the second embodiment. The target unit 3007 in the third embodiment forms a background shape that surrounds multiple high emissivity regions 3070, thereby having low emissivity regions 3071 adjacent to each of the high emissivity regions 3070. In this third embodiment, the high emissivity regions 3070, which can only be heated by the heating element 73, are arranged in two dimensions as circular target regions 72, arranged in a longitudinal and transverse pattern.
[0094] Therefore, in S11 and S21 of the third embodiment, as Figure 14 (As shown in the figure for S21), the center point coordinates of the circular outline are extracted from the high emissivity region 3070 after binarization, using the feature point coordinates Cp of each target region 72 presented in the target image Iit. This third embodiment can also achieve the effects of the second embodiment.
[0095] (Fourth Implementation)
[0096] like Figure 15 As shown, the fourth embodiment is a variation of the second and third embodiments. The target unit 4007 of the fourth embodiment follows the third embodiment, forming a background shape that surrounds multiple high emissivity regions 4070, thereby having low emissivity regions 3071 adjacent to each of the high emissivity regions 4070. However, unlike the third embodiment, in the fourth embodiment, the high emissivity regions 4070, which can only be heated by the heating element 73, are arranged in a two-dimensional configuration as cross-shaped target regions 72.
[0097] Therefore, in S11 and S21 of the fourth embodiment, as Figure 16 (As shown in Figure S21), the center point coordinates of the cross-shaped contour are extracted from the high emissivity region 4070 after binarization, using the feature point coordinates Cp of each target region 72 presented in the target image Iit as the feature point coordinates. This fourth embodiment can also achieve the effects of the second embodiment.
[0098] (Fifth Implementation)
[0099] like Figure 17 As shown, the fifth embodiment is a variation of the second to fourth embodiments. The target unit 5007 of the fifth embodiment, following the third and fourth embodiments, forms a background shape that surrounds multiple high emissivity regions 5070, thereby having low emissivity regions 3071 adjacent to each of the high emissivity regions 5070. However, unlike the third and fourth embodiments, in the fifth embodiment, the high emissivity regions 5070, which can only be heated by the heating element 73, are arranged in two dimensions as X-shaped target regions 5072 intersecting in two inclined directions.
[0100] Therefore, in S11 and S21 of the fifth embodiment, as Figure 18(This figure represents case S21) As shown, the center point coordinates of the X-shaped contour are extracted from the high emissivity region 5070 after binarization, using the feature point coordinates Cp of each target region 5072 presented in the target image Iit. This fifth embodiment also achieves the effects of the second embodiment.
[0101] (Other implementation methods)
[0102] While several embodiments have been described above, this disclosure is not intended to be limited to those embodiments and can be applied to various embodiments and combinations without departing from the spirit of this disclosure.
[0103] In a variation, the dedicated computer constituting calibration system 1 may have at least one of digital circuitry and analog circuitry as a processor. Here, the digital circuitry is at least one of, for example, ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), SOC (System on a Chip), PGA (Programmable Gate Array), and CPLD (Complex Programmable Logic Device). Furthermore, these digital circuits may also have a memory storing programs.
[0104] In a variation, in the third to fifth embodiments, the relationship between the high emissivity regions 3070, 4070, and 5070 and the low emissivity region 3071 can be interchanged. In this case, the multiple low emissivity regions 3071 constituting the target regions 3072, 4072, and 5072 are each cooled to a temperature below the ambient temperature inside the indoor space 9 by their respective cooling elements 74, while the high emissivity regions 3070, 4070, and 5070 are preferably placed in a state exposed to the ambient temperature inside the indoor space 9.
[0105] exist Figure 19 In the target unit 7 of the modified example shown, each region 70, 71 of the first embodiment is formed into a circular shape conforming to the high emissivity region 3070 of the third embodiment, and further, a background-like low emissivity region 3071 may be formed surrounding these circular regions 70, 71. In this case, the boundaries of the low emissivity regions 71, 3071 may also be made of the same material as the surface of the high emissivity region 70, or a heat-insulating material, etc.
[0106] In variations S10 and S20, target units 7, 2007, 3007, 4007, and 5007, with configurations different from those described in the first embodiment, can also be photographed. In S11 and S21 under these circumstances, parameters Pco and Pci can be calibrated based on the relative positional relationship between feature point coordinates Cp using processing methods different from those described in the first embodiment.
[0107] In S11 and S21 of the modified example, binarization processing can be omitted. In the modified example, the main vehicle 2 to which calibration system 1 is applied can also be, for example, an autonomous driving robot capable of carrying goods or collecting information through autonomous driving or remote control driving. In the modified example, calibration system 1 may not include at least target unit 7 of constituent units 5 to 7. In this case, target unit 7 can also be constructed as an external unit of calibration system 1.
[0108] In addition to the described embodiments so far, the above-described implementations and variations can also serve as a calibration system 1 that can be mounted on the main vehicle 2 and has at least one processor 12 and one memory 11, and can be implemented in the form of a processing circuit (e.g., a processing ECU) or a semiconductor device (e.g., a semiconductor chip). In this case, since the calibration system 1 does not include constituent units 5 to 7, the target unit 7 can be constructed as an external unit of the calibration system 1.
[0109] (Postscript)
[0110] This specification discloses several technical ideas and various combinations thereof, as listed below. Furthermore, the symbols enclosed in parentheses in this appendix indicate a correspondence with the specific means described in the previously detailed embodiments, and do not limit the scope of the technology disclosed herein.
[0111] (Technical Idea 1)
[0112] A calibration system having a processor (12) for calibrating characteristic parameters (Pc) of an infrared camera (3) mounted on a vehicle (2).
[0113] Composed of execution:
[0114] The target unit (7, 2007, 3007, 4007, 5007) is captured by the infrared camera to obtain a target image (Iit). In this target unit, at least one of the high emissivity regions (70, 3070, 4070, 5070) and the low emissivity regions (71, 3071) adjacent to each other in a manner with a difference in emissivity is arranged in two dimensions as the target region (72); and
[0115] The characteristic parameters are calibrated by extracting the feature point coordinates (Cp) of multiple target regions presented in the target image, respectively, based on the relative positional relationship between the feature point coordinates of each target region.
[0116] The acquisition of the target image includes:
[0117] The target unit is captured by the infrared camera, and the temperature difference (ΔT) between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
[0118] (Technical Idea 2)
[0119] The calibration system as described in technical concept 1,
[0120] The acquisition of the target image includes:
[0121] The target image is obtained by capturing the target unit with the temperature difference controlled by the infrared camera. The temperature difference is the temperature difference between the high emissivity region, which is the target area, heated to a temperature higher than the ambient temperature, and the low emissivity region, which is the target area, cooled to a temperature lower than the ambient temperature.
[0122] (Technical Idea 3)
[0123] The calibration system as described in technical concept 1,
[0124] The acquisition of the target image includes:
[0125] The target image is obtained by capturing the target unit with the temperature difference controlled by the infrared camera. The temperature difference is the temperature difference between the high emissivity region, which is the target area, heated to above the ambient temperature, and the low emissivity region exposed to the ambient temperature.
[0126] (Technical Idea 4)
[0127] The calibration system as described in any of technical ideas 1 to 3
[0128] The calibration of the characteristic parameters includes:
[0129] By extracting the feature point coordinates of each target region from the target image, the characteristic parameters are calibrated according to the relative positional relationship between these feature point coordinates. In the target image, the infrared brightness of the high emissivity region and the low emissivity region are binarized.
[0130] (Technical Idea 5)
[0131] The calibration system as described in any of technical ideas 1 to 4
[0132] The acquisition of the target image includes:
[0133] The target image is obtained by capturing images of the target units, in which the high emissivity regions and the low emissivity regions are arranged in a checkerboard pattern in two dimensions, using the infrared camera.
[0134] The calibration of the characteristic parameters includes:
[0135] The feature parameters are calibrated by extracting the coordinates of grid points in multiple target regions presented in the target image as feature point coordinates, and then calibrating them based on the relative positional relationship between these grid point coordinates.
[0136] Furthermore, the aforementioned technical ideas 1 to 5 can also be grasped through the various technical ideas of methods and procedures.
Claims
1. A calibration system having a processor (12) for calibrating characteristic parameters (Pc) of an infrared camera (3) mounted on a vehicle (2), characterized in that, Composed of execution: The target unit (7, 2007, 3007, 4007, 5007) is captured by the infrared camera to obtain a target image (Iit). In this target unit, at least one of the high emissivity regions (70, 3070, 4070, 5070) and the low emissivity regions (71, 3071) adjacent to each other in a manner with a difference in emissivity is arranged in two dimensions as the target region (72); and The characteristic parameters are calibrated by extracting the feature point coordinates (Cp) of multiple target regions presented in the target image, respectively, based on the relative positional relationship between the feature point coordinates of each target region. The acquisition of the target image includes: The target unit is captured by the infrared camera, and the temperature difference (ΔT) between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
2. The calibration system as described in claim 1, characterized in that, The acquisition of the target image includes: The target image is obtained by capturing the target unit with the temperature difference controlled by the infrared camera. The temperature difference is the temperature difference between the high emissivity region, which is the target area, heated to a temperature higher than the ambient temperature, and the low emissivity region, which is the target area, cooled to a temperature lower than the ambient temperature.
3. The calibration system as described in claim 1, characterized in that, The acquisition of the target image includes: The target image is obtained by capturing the target unit with the temperature difference controlled by the infrared camera. The temperature difference is the temperature difference between the high emissivity region of the target area that is heated to above the ambient temperature and the low emissivity region that is exposed to the ambient temperature.
4. The calibration system according to any one of claims 1 to 3, characterized in that, The calibration of the characteristic parameters includes: By extracting the feature point coordinates of each target region from the target image, the characteristic parameters are calibrated according to the relative positional relationship between these feature point coordinates. In the target image, the infrared brightness of the high emissivity region and the low emissivity region are binarized.
5. The calibration system according to any one of claims 1 to 3, characterized in that, The acquisition of the target image includes: The target image is obtained by capturing images of the target units, in which the high emissivity regions and the low emissivity regions are arranged in a checkerboard pattern in two dimensions, using the infrared camera. The calibration of the characteristic parameters includes: The feature parameters are calibrated by extracting the coordinates of grid points in multiple target regions presented in the target image as feature point coordinates, and then calibrating them based on the relative positional relationship between these grid point coordinates.
6. A calibration method, executed by a processor (12) for calibrating characteristic parameters (Pc) of an infrared camera (3) mounted on a vehicle (2), characterized in that, Include: The target unit (7, 2007, 3007, 4007, 5007) is captured by the infrared camera to obtain a target image (Iit). In this target unit, at least one of the high emissivity regions (70, 3070, 4070, 5070) and the low emissivity regions (71, 3071) adjacent to each other in a manner with a difference in emissivity is arranged in two dimensions as the target region (72); and The characteristic parameters are calibrated by extracting the feature point coordinates (Cp) of multiple target regions presented in the target image, respectively, based on the relative positional relationship between the feature point coordinates of each target region. The acquisition of the target image includes: The target unit is captured by the infrared camera, and the temperature difference (ΔT) between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
7. A calibration procedure, stored in a storage medium (11) for calibrating characteristic parameters (Pc) of an infrared camera (3) mounted on a vehicle (2), and comprising instructions for causing a processor (12) to perform the calibration, characterized in that, It includes the instructions for performing the following actions: The target unit (7, 2007, 3007, 4007, 5007) is captured by the infrared camera to obtain a target image (Iit). In this target unit, at least one of the high emissivity regions (70, 3070, 4070, 5070) and the low emissivity regions (71, 3071) adjacent to each other in a manner with a difference in emissivity is arranged in two dimensions as the target region (72); and The characteristic parameters are calibrated by extracting the feature point coordinates (Cp) of multiple target regions presented in the target image, respectively, based on the relative positional relationship between the feature point coordinates of each target region. The acquisition of the target image includes: The target unit is captured by the infrared camera, and the temperature difference (ΔT) between the high emissivity region and the low emissivity region is controlled so that the temperature of the high emissivity region is higher than that of the low emissivity region, thereby obtaining the target image.
Citation Information
Patent Citations
Manufacturing method of shoe, sole, and high polymer material
JP2024109002A
