Image processing apparatus, system, method, and program

Abstract

To provide an image processing apparatus, and the like, capable of contributing to facilitating settings for parameters of image processing and suppressing variability of the parameters to be set.SOLUTION: An image processing apparatus includes: a data analysis unit which analyzes a parameter on the basis of at least one piece of sub data for parameter analysis obtained by sensing an object to be measured or the surroundings thereof; a parameter setting unit which sets the analyzed parameter, as a parameter for image processing of at least one piece of main data for measurement obtained by imaging the object to be measured; and an image processing unit which performs image processing on the main data according to the set parameter.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an image processing device, a system, a method, and a program. [Background technology]

[0002] One method for using an infrared camera to obtain infrared image data of a monitored object (such as a measured object, a surveyed object, or an inspected object) involves measuring the distance to the monitored object with a distance measuring device, determining the angle of view of the infrared camera based on the expected size of the monitored object, the minimum number of visible pixels of the measured object, and the measured distance, and photographing the monitored object with the infrared camera according to the determined angle of view to obtain infrared image data (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2009-267627 Summary of the Invention [Problem to be solved by the invention]

[0004] The following analysis is provided by the present inventors.

[0005] In the method described in Patent Document 1, the angle of view of the infrared camera can be adjusted automatically using the measured distance, but in the image processing of infrared image data, various parameters must be set manually, as in the image processing of general infrared image data. Setting parameters manually causes variations in the parameters, which causes variations in the quality of the image processing data obtained by image processing. Therefore, a certain level of skill is required to set parameters manually, which is difficult for beginners to master, and even if the user has the skills, there is a problem that the parameters set by the user vary. The same problem can be said when image processing image data other than infrared image data.

[0006] A main object of the present invention is to provide an image processing apparatus, system, method, and program that can facilitate the setting of parameters for image processing and contribute to reducing variation in the set parameters. [Means for solving the problem]

[0007] An image processing device according to a first aspect includes a data analysis unit configured to analyze parameters based on at least one sub-data for parameter analysis obtained by sensing a measurement object or its surroundings, a parameter setting unit configured to set the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object, and an image processing unit configured to image process the main data in accordance with the set parameters.

[0008] The image processing system relating to the second viewpoint includes an image processing device relating to the first viewpoint, at least one main camera communicatively connected to the image processing device and configured to photograph the measurement object and generate the main data, and at least one sub-sensor communicatively connected to the image processing device and configured to sense the measurement object or its surroundings and generate the sub-data.

[0009] An image processing method according to a third aspect includes a step in which an image processing device analyzes parameters based on at least one sub-data for parameter analysis obtained by sensing a measurement object or its surroundings, a step in which the image processing device sets the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object, and a step in which the main data is image-processed according to the set parameters.

[0010] A program relating to the fourth aspect causes an image processing device to execute a process of analyzing parameters based on at least one sub-data for parameter analysis obtained by sensing a measurement object or its surroundings, a process of setting the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object, and a process of image processing the main data in accordance with the set parameters.

[0011] The program can be recorded in a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. In the present disclosure, the program can also be embodied as a computer program product. The program is input to the computer device from an input device or an external device via a communication interface, stored in a storage device, drives the processor according to a predetermined step or process, and can display the processing result, including an intermediate state, at each stage via a display device as necessary, or can communicate with the outside via the communication interface. For example, a computer device for this purpose typically includes a processor, a storage device, an input device, a communication interface, and a display device as necessary, which are connectable to each other via a bus. Effect of the Invention

[0012] According to the first to fourth aspects, it is possible to facilitate the setting of parameters for image processing, and contribute to suppressing variation in the set parameters. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram illustrating an example of a configuration of an image processing system according to the present disclosure. [Diagram 2] FIG. 1 is a conceptual diagram illustrating an example of a usage mode of an image processing system according to the present disclosure. [Diagram 3]10 is a flowchart illustrating an example of an operation of an image processing device in the image processing system according to the present disclosure. [Figure 4] FIG. 11 is a block diagram illustrating a second example of the configuration of the image processing system according to the present disclosure. [Diagram 5] FIG. 11 is a block diagram illustrating a schematic diagram of a third example of the configuration of an image processing system according to the present disclosure. [Figure 6] FIG. 11 is a block diagram illustrating a fourth example of the configuration of an image processing system according to the present disclosure. [Figure 7] 1 is a block diagram illustrating a schematic example of a configuration of an image processing device according to the present disclosure. [Figure 8] FIG. 2 is a block diagram illustrating a schematic configuration of hardware resources. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The embodiments will be described below with reference to the drawings. In this application, when reference symbols are given to the drawings, they are intended to aid in understanding and are not intended to limit the embodiments shown in the drawings. The embodiments below are merely examples and do not limit the present invention. The connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional. One-way arrows are used to diagrammatically indicate the flow of a main signal (data) and do not exclude bidirectionality. Furthermore, although not explicitly shown in the circuit diagrams, block diagrams, internal configuration diagrams, connection diagrams, and the like shown in the present disclosure, input ports and output ports exist at the input and output ends of each connection line. The same is true for input / output interfaces. The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as necessary, and the computer device is configured to be able to communicate with devices (including computers) inside or outside the device via the communication interface, regardless of whether it is wired or wireless.

[0015] [Form 1] The image processing system according to the first embodiment will be described with reference to the drawings. Fig. 1 is a block diagram showing a schematic example of a configuration of the image processing system according to the present disclosure. Fig. 2 is a schematic image diagram showing an example of a usage mode of the image processing system according to the present disclosure.

[0016] The image processing system 1 is a system that processes infrared image data 11 (main data) acquired by photographing a measurement object 5 with an infrared camera 10 (main camera) (see Figs. 1 and 2). The image processing system 1 performs image processing on the infrared image data 11 (main data) in accordance with set parameters to generate infrared image processing data (image processing data). The image processing system 1 extracts and outputs temperature data (measurement data) relating to the measurement object 5 from the generated infrared image processing data. The image processing system 1 includes an infrared camera 10, a distance sensor 20, a component sensor 30, an image sensor 40, an environment sensor 50, and an image processing device 60.

[0017] The infrared camera 10 is a camera that captures an image of a measurement object 5 and generates infrared image data 11 (see Figs. 1 and 2). The infrared camera 10 outputs the generated infrared image data 11 to an image processing device 60. As the infrared camera 10, a camera for visualizing infrared rays emitted from an object, such as a far-infrared uncooled camera, a far-infrared cooled camera, a mid-infrared cooled camera, or a near-infrared camera, can be used. In Figs. 1 and 2, the infrared camera 10 is the main camera, but other types of cameras (such as an ultraviolet camera, an X-ray camera, or an NMR (Nuclear Magnetic Resonance) field camera) may also be used as the main camera.

[0018] The distance sensor 20 is a sensor that senses the measurement target 5 and generates distance data 21 (see Figs. 1 and 2). The distance sensor 20 outputs the generated distance data 21 to the image processing device 60. The distance data 21 is sub-data used to analyze parameters that cannot be acquired from the infrared image data 11. The distance sensor 20 serves as a sub-sensor for parameter analysis. As the distance sensor 20, a sensor capable of measuring distance, for example, a three-dimensional sensor such as a 3D-LIDAR (Three Dimensions - Light Detection And Ranging), a ToF (Time of Flight) camera, or a stereo camera, can be used.

[0019] The component sensor 30 is a sensor that senses the measurement object 5 and generates component data 31 (see Figs. 1 and 2). The component sensor 30 outputs the generated component data 31 to the image processing device 60. The component data 31 is sub-data used to analyze parameters that cannot be acquired from the infrared image data 11. The distance sensor 20 serves as a sub-sensor for parameter analysis. As the component sensor 30, a sensor capable of analyzing components, for example, a multi-wavelength spectroscopic camera such as a hyperspectral camera or a multispectral camera, can be used.

[0020] The image sensor 40 is a sensor that senses the measurement object 5 and generates image data 41 (see Figs. 1 and 2). The image sensor 40 outputs the generated image data 41 to the image processing device 60. The image data 41 is sub-data used to analyze parameters that cannot be obtained from the infrared image data 11. The image sensor 40 serves as a sub-sensor for parameter analysis. A sensor capable of capturing an image, such as an RGB (Red-Green-Blue) camera, can be used as the image sensor 40.

[0021] The environmental sensor 50 is a sensor that senses the measurement object 5 or its surroundings to generate environmental data 51 (see Figs. 1 and 2). The environmental sensor 50 outputs the generated environmental data 51 to the image processing device 60. The environmental data 51 is sub-data used to analyze parameters that cannot be acquired from the infrared image data 11. The environmental sensor 50 serves as a sub-sensor for parameter analysis. As the environmental sensor 50, a sensor capable of acquiring environmental information such as humidity, air pressure, and temperature, for example, a humidity sensor, air pressure sensor, temperature sensor, etc., can be used.

[0022] It is not necessary to use all types of sub-sensors (distance sensor 20, component sensor 30, image sensor 40, and environment sensor 50), and only the sub-sensors necessary for acquiring parameters for image processing of infrared image data 11 may be adopted depending on the usage situation. The sub-sensors may also be ones that capture images of things other than distance, components, images, and environment. The sub-sensors may also be composite ones that can acquire data related to multiple types (distance, components, images, environment, etc.) with one unit.

[0023] The image processing device 60 is a device that processes the infrared image data 11 from the infrared camera 10 (see Figs. 1 and 2). The image processing device 60 is communicably connected to the infrared camera 10 and sub-sensors for various parameter analysis (distance sensor 20, component sensor 30, image sensor 40, and environment sensor 50 in Fig. 1). The image processing device 60 has a function of analyzing parameters that cannot be acquired from the infrared image data 11 using various data (distance data 21, component data 31, image data 41, and environment data 51 in Fig. 1) of the sub-sensors for parameter analysis (distance sensor 20, component sensor 30, image sensor 40, and environment sensor 50 in Fig. 1). When there are special circumstances such as installing the image processing system 1 at the same place where it was installed in the past, any or all of the various data does not have to be real-time data, and data previously acquired (stored) may be used. The image processing device 60 has a function of judging whether the analyzed parameters satisfy the measurement conditions (numerical range of parameters) set in advance. When the measurement conditions are satisfied, the image processing device 60 has a function of setting the analyzed parameters as image processing parameters, and performing image processing on the infrared image data 11 according to the set parameters to generate infrared image processing data (image processing data). The image processing device 60 has a function of extracting and outputting temperature data (measurement data) related to the measurement object 5 from the generated infrared image processing data (image processing data). When the measurement conditions are not satisfied, the image processing device 60 has a function of generating and displaying guidance information based on the analyzed parameters. As the image processing device 60, a device (computer device) having functional units (e.g., a processor, a storage device, an input device, a communication interface, and a display device) constituting a computer can be used, and for example, a tablet terminal, a notebook personal computer, a personal computer, a smartphone, etc. can be used. The image processing device 60 can be virtually configured to include a data analysis unit 61, a parameter setting unit 62, an image processing unit 63, a data output unit 64, a guidance generation unit 65, and a guidance display unit 66 by executing a predetermined program.

[0024] The data analysis unit 61 is a functional unit that analyzes various parameters based on sub-data (distance data 21, component data 31, image data 41, and environmental data 51 in FIG. 1) from sub-sensors for parameter analysis (distance sensor 20, component sensor 30, image sensor 40, and environmental sensor 50 in FIG. 1) (see FIG. 1). The data analysis unit 61 judges whether the analyzed parameters satisfy the measurement conditions (numerical range of parameters) set in advance. The parameters are parameters necessary for image processing, and for example, parameters necessary for image processing of infrared image data 11 include (1) thermal tuning (level span), (2) emissivity, (3) atmospheric influence, (4) emissivity of metals, (5) shooting angle, and (6) spatial resolution.

[0025] (1) Thermal tuning (level span) "Thermal tuning (level span)" refers to the temperature range displayed when photographing with the infrared camera 10. In general, in infrared image processing data obtained by image processing infrared image data 11, the temperature range is visualized by gradation changes in RGB colors from high to low. A problem with visualizing this temperature range is that when photographing outdoors, the sky often appears in the background and the sky becomes very cold, so the level span range becomes wide and it becomes difficult to grasp the temperature change of the measurement target 5 that is originally to be measured. Therefore, in "thermal tuning (level span)", the sensor fusion of the infrared camera 10 and the distance sensor 20 is used to recognize (analyze) a place where no point cloud exists (for example, a place of the sky) from the scenery photographed by the distance sensor 20 side, and the temperature of the recognized place is set to be in the non-target range when setting the span. In addition, in the sensor fused state, the point cloud data within the field of view of the infrared camera 10 is divided into objects by clustering, the average temperature of the object to be measured 5 is obtained (analyzed), and a level span of up to ±X°C is set, thereby eliminating the influence of extremely hot or cold objects in the vicinity, and the level span can be set mainly based on the temperature of the object to be measured.

[0026] (2) Emissivity "Emissivity" refers to the emissivity of the measurement object 5 photographed by the infrared camera 10. Since the emissivity differs for each material of the measurement object 5, it is necessary to consider it for each event to be photographed. An issue regarding emissivity is that when photographing the temperature of the measurement object 5 with the infrared camera 10, it is necessary to set the emissivity of the measurement object 5 to be measured as a parameter in advance. In addition, there are standard emissivity tables for various materials for emissivity, and it is necessary to understand and refer to the contents of these tables before setting the emissivity as a camera parameter. Therefore, by sensor fusion of the infrared camera 10, the distance sensor 20, the component sensor 30, and the image sensor 40, for example, an object (e.g., a person, a utility pole, a transformer, a cable, etc.) is recognized using the point cloud data of the distance sensor 20, and the emissivity corresponding to the material of the recognized object is extracted (analyzed) from the standard emissivity tables for various materials that have been set in advance, and the extracted emissivity is set as a parameter. Furthermore, when the component sensor 30 is used, the components of the material being sensed are known, so the material can be identified by the components, the emissivity corresponding to the material can be extracted (analyzed) from a preset standard emissivity table for various materials, and the extracted emissivity can be set as a parameter. Furthermore, when the image sensor 40 is used, the image data 41 can be analyzed using AI (Artificial Intelligence) to identify the material, the emissivity corresponding to the material can be extracted (analyzed) from a preset standard emissivity table for various materials, and the extracted emissivity can be set as a parameter.

[0027] (3) Atmospheric influence The "influence of the atmosphere" refers to the influence of the atmosphere between the infrared camera 10 and the measurement target 5. Since the atmospheric environment has an influence on temperature measurement, it is necessary to set three parameters, namely, the distance from the infrared camera 10 to the measurement target 5, the spatial temperature, and the relative humidity, before shooting. The challenge with distance, spatial temperature, and relative humidity is that it is necessary to measure and set the distance, spatial temperature, and relative humidity with a sensor other than the infrared camera 10. Therefore, by sensor fusion of the infrared camera 10, the distance sensor 20, and the environment sensor 50, the distance is measured by the distance sensor 20, and the temperature and relative humidity are measured by the environment sensor 50, and the measured distance, spatial temperature, and relative humidity are set as parameters.

[0028] (4) Emissivity of metals The "emissivity of a metal" is the emissivity of the surface of a metal when the measurement object 5 photographed by the infrared camera 10 is a metal. The emissivity of a metal varies depending on the type of metal, and also varies depending on the state of the metal (rust, etc.). A problem with the emissivity of a metal is that the user 3 needs to recognize the type and state of the metal, investigate the emissivity of the metal of the recognized type and state in a standard emissivity table for metals, and set the emissivity of the metal obtained by the investigation as a parameter. Therefore, by sensor fusion of the infrared camera 10 and the component sensor 30, the metal of the measurement object 5 is sensed by the component sensor 30 and a component analysis is performed, the emissivity of the metal, which changes depending on the type and state of the metal, is extracted (analyzed) from the standard emissivity table, and the extracted emissivity of the metal is set as a parameter.

[0029] (5) Shooting angle The "shooting angle" is the angle of the line of sight at the shooting position of the infrared camera 10. The angle of the shooting position of the infrared camera 10 with respect to the measurement object 5 affects the shooting quality. One issue with the shooting angle is that the person taking the image is generally aware of the angle of the position where he or she is taking the image. Therefore, by sensor fusion of the infrared camera 10 and the distance sensor 20, when the measurement object 5 is flat, the shooting angle is recognized by the distance sensor 20 aligned with the infrared camera 10, and it is determined whether the recognized shooting angle is within the recommended range (shooting conditions), and if it is within the recommended range, the recognized shooting angle is set as a parameter. If it is outside the recommended range, the recognized shooting angle is used to generate guidance information that provides guidance that it is outside the recommended range.

[0030] (6) Spatial resolution "Spatial resolution" is the ability of the infrared camera 10 to distinguish two points that are close to each other as two independent points. The instantaneous field of view (minimum measurement field of view, IFOV) of the infrared camera 10 with respect to the measurement object 5 affects the quality of the image. One issue with spatial resolution is that the correspondence between the measurement object 5 that the user 3 is photographing and the instantaneous field of view (IFOV) is unclear. When the measurement object 5 is photographed by the infrared camera 10, it is not necessarily possible to measure the temperature if it is visible. To measure the temperature, a certain size is required, and the size of the measurement object 5 needs to be at least three times the instantaneous field of view (IFOV) of the infrared camera 10. Therefore, the size of the measurement object 5 photographed by the infrared camera 10 is recognized (analyzed), and it is determined whether the size of the recognized measurement object 5 is three times or more the IFOV, and if it is three times or more the IFOV, the size of the recognized measurement object 5 is set as a parameter. If the size is not three times or more the IFOV, guidance information is generated using the recognized size of the measurement object 5 to advise that the size is not three times or more the IFOV and to suggest moving the shooting position closer.

[0031] The parameter setting unit 62 is a functional unit that, when it is determined that the analyzed parameters satisfy the measurement conditions (numerical range of the parameters), sets the analyzed parameters as parameters for image processing of the infrared image data 11 (see FIG. 1). Note that, when the installation position of the infrared camera 10 is the same as the previous installation position, the previously set parameters may be reset.

[0032] The image processing unit 63 is a functional unit that performs image processing on the infrared image data 11 from the infrared camera 10 in accordance with set parameters (see FIG. 1). The image processing unit 63 performs image processing on the infrared image data 11 to generate infrared image processing data. The image processing unit 63 extracts temperature data relating to the measurement object 5 from the generated infrared image processing data. The extracted temperature data can be saved.

[0033] The data output unit 64 is a functional unit that outputs (displays, transmits, etc.) the temperature data related to the extracted measurement object 5 (see FIG. 1).

[0034] The guidance generating unit 65 is a functional unit that generates guidance information based on the analyzed parameters when it is determined that the analyzed parameters do not satisfy the measurement conditions (numerical range of the parameters) (see FIG. 1). Here, the guidance information is information that guides the user 3 on how to handle the image processing system 1 (for example, changing the installation location or orientation of the infrared camera 10, etc.) so as to satisfy the measurement conditions.

[0035] The guidance display unit 66 is a functional unit that displays the generated guidance information (see FIG. 1). By the user 3 referring to the displayed guidance information, the user 3 can be assisted in taking pictures with the infrared camera 10, and can be guided to change the camera shooting position, camera angle, etc. to an appropriate state (a state that satisfies the measurement conditions) and encouraged to do so.

[0036] Next, the operation of the image processing device in the image processing system according to the first embodiment will be described with reference to the drawings. Fig. 3 is a flow chart showing an example of the operation of the image processing device in the image processing system according to the present disclosure. Please refer to Figs. 1 and 2 for the configuration of the image processing system.

[0037] First, the data analysis unit 61 of the image processing device 60 acquires sub-data (distance data 21, component data 31, image data 41, and environmental data 51 in FIG. 1) from sub-sensors for parameter analysis (distance sensor 20, component sensor 30, image sensor 40, and environmental sensor 50 in FIG. 1) (step A1).

[0038] Next, the data analysis unit 61 of the image processing device 60 analyzes various parameters based on the acquired sub-data (step A2).

[0039] Next, the data analysis unit 61 of the image processing device 60 judges whether or not the analyzed parameters satisfy the preset measurement conditions (parameter numerical ranges) (step A3). If the measurement conditions are not satisfied (NO in step A3), the process proceeds to step A8.

[0040] If the measurement conditions are met (YES in step A3), the parameter setting unit 62 of the image processing device 60 sets the analyzed parameters as parameters for image processing of the infrared image data 11 (step A4).

[0041] Next, the image processing section 63 of the image processing device 60 acquires the infrared image data 11 (main data) from the infrared camera 10 (main camera) (step A5).

[0042] Next, the image processing unit 63 of the image processing device 60 processes the acquired infrared image data 11 (main data) according to the set parameters to generate infrared image processing data, and extracts temperature data (measurement data) related to the measurement object 5 from the generated infrared image processing data (step A6).

[0043] Next, the data output unit 64 of the image processing device 60 outputs (displays, transmits, etc.) the temperature data (measurement data) related to the extracted measurement object 5 (step A7), and then ends and returns to the start.

[0044] If the measurement conditions are not satisfied (NO in step A3), the guidance generating unit 65 of the image processing device 60 generates guidance information based on the analyzed parameters (step A8).

[0045] Next, the guidance display unit 66 of the image processing device 60 displays the generated guidance information (step A9), and then ends and returns to the start. This allows the user 3 to refer to the displayed guidance information, move the infrared camera 10 so that the camera shooting position, camera angle, etc. are in an appropriate state, and check whether the measurement conditions are met.

[0046] According to the first embodiment, the image processing parameters of the infrared image data 11 are analyzed using data from the sub-sensors for parameter analysis (the distance sensor 20, the component sensor 30, the image sensor 40, and the environment sensor 50) and are automatically set in the image processing device 60, so that it is not dependent on the knowledge of the user 3 regarding parameters, which makes it easier to set the image processing parameters and contributes to reducing the variation in the set parameters. This makes it possible to easily handle the infrared camera 10 and take pictures.

[0047] Furthermore, according to the first embodiment, the analyzed parameters are not only used as parameters to be set in image processing of the infrared image data 11, but also guidance is generated and displayed when the measurement conditions are not satisfied, thereby encouraging the user 3 to take improved photographs.

[0048] Furthermore, according to the first aspect, the analyzed parameters can be interpolated and shared as data that cannot be obtained by the infrared camera 10 alone.

[0049] [Form 2] The image processing system according to the second embodiment will be described with reference to the drawings. Fig. 4 is a block diagram showing a schematic diagram of a second example of the configuration of the image processing system according to the present disclosure.

[0050] The second embodiment is a modification of the first embodiment, and includes a plurality of main cameras 70a to 70m (whether the cameras are the same or different) corresponding to the infrared camera 10 in FIG. 1. The main cameras 70a to 70m are connected to the image processing device 60 so as to be able to communicate with each other. The sub-sensors 71a to 71n (the number of sub-sensors may be one) for parameter analysis corresponding to the distance sensor 20, the component sensor 30, the image sensor 40, and the environment sensor 50 in FIG. 1 are connected to the image processing device 60 so as to be able to communicate with each other. The main cameras 70a to 70m and the sub-sensors 71a to 71n may be fused together, and sub-data (e.g., environment data) commonly related to each main data of the plurality of main cameras 70a to 70m may be used for parameter analysis, or sub-data of the sub-sensors 71a to 71n corresponding to each main data of the main cameras 70a to 70m may be used for parameter analysis. The other configurations and operations are the same as those of the first embodiment.

[0051] According to the second embodiment, like the first embodiment, it is possible to facilitate the setting of parameters for image processing and contribute to reducing variation in the parameters that are set, and since a single image processing system 1 uses multiple main cameras 70a-70m, it is possible to perform measurements over a wide range and in a variety of types.

[0052] [Form 3] An image processing system according to the third embodiment will be described with reference to the drawings. Fig. 5 is a block diagram showing a schematic diagram of a third example of the configuration of the image processing system according to the present disclosure.

[0053] Form 3 is a modification of Form 1, in which sub-data already acquired by an information providing device 72 (e.g., a server device) through sensing by a sub-sensor 71 for parameter analysis, which corresponds to the distance sensor 20, component sensor 30, image sensor 40, and environment sensor 50 in FIG. 1, can be acquired by an image processing device 60 from the information providing device 72 via a network 73. The other configurations and operations are the same as those of Form 1. Form 3 may be applied to Form 2.

[0054] According to the third embodiment, as in the first embodiment, it is possible to facilitate the setting of parameters for image processing, thereby contributing to reducing variation in the parameters that are set, and by utilizing the existing infrastructure system (sub-sensor 71, information providing device 72, network 73), a dedicated sub-sensor for the image processing system 1 is not required (or is only partially required).

[0055] [Form 4] An image processing system according to the fourth embodiment will be described with reference to the drawings. Fig. 6 is a block diagram showing a schematic diagram of a fourth example of the configuration of the image processing system according to the present disclosure.

[0056] Form 4 is a modification of Form 1, in which a main camera 81 corresponding to the infrared camera 10 in FIG. 1 and sub-sensors 81a-82n (the number of sub-sensors may be one) for parameter analysis corresponding to the distance sensor 20, component sensor 30, image sensor 40, and environment sensor 50 in FIG. 1 are integrated into one hybrid main camera 80. The hybrid main camera 80 is connected to the image processing device 60 so as to be able to communicate with it. Other configurations and operations are similar to those of Form 1. Form 4 may be applied to Forms 2 and 3.

[0057] According to form 4, like form 1, it is possible to facilitate the setting of image processing parameters and contribute to reducing variation in the set parameters, and by using a single hybrid main camera 80 that integrates the main camera 81 and the sub-sensors 81a to 82n, it is possible to facilitate the installation of the image processing system 1.

[0058] [Form 5] The image processing device according to the fifth embodiment will be described with reference to the drawings. Fig. 7 is a block diagram showing a schematic example of the configuration of the image processing device according to the present disclosure.

[0059] The image processing device 60 is configured to perform image processing of at least one main data for measurement obtained by photographing a measurement object. The image processing device 60 includes a data analysis unit 61, a parameter setting unit 62, and an image processing unit 63.

[0060] The data analysis unit 61 is configured to analyze parameters based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings. The parameter setting unit 62 is configured to set the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object. The image processing unit 63 is configured to perform image processing of the main data according to the set parameters.

[0061] According to the fifth embodiment, the image processing parameters of the main data are analyzed using sub-data for parameter analysis, and are automatically set in the image processing device 60, which makes it easier to set the image processing parameters and contributes to reducing variation in the set parameters.

[0062] The image processing devices of the image processing systems according to the first to fourth aspects and the image processing device according to the fifth aspect can be configured by so-called hardware resources (information processing devices, computers), and may be configured as shown in Fig. 8. For example, the hardware resources 100 include a processor 101, a memory 102, a network interface 103, and the like, which are connected to each other by an internal bus 104.

[0063] Note that the configuration shown in Fig. 8 is not intended to limit the hardware configuration of the hardware resource 100. The hardware resource 100 may include hardware (e.g., an input / output interface) that is not shown. Furthermore, the number of units such as the processor 101 included in the device is not intended to be limited to the example shown in Fig. 8, and for example, multiple processors 101 may be included in the hardware resource 100. For example, a CPU (Central Processing Unit), an MPU (Micro Processor Unit), a GPU (Graphics Processing Unit), etc. can be used as the processor 101.

[0064] The memory 102 may be, for example, a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), or the like.

[0065] The network interface 103 may be, for example, a LAN (Local Area Network) card, a network adapter, a network interface card, or the like.

[0066] The functions of the hardware resource 100 are realized by the above-mentioned processing module. The processing module is realized, for example, by the processor 101 executing a program stored in the memory 102. The program can be updated by downloading it via a network or by using a storage medium storing the program. Furthermore, the processing module may be realized by a semiconductor chip. That is, it is sufficient that the functions performed by the processing module are realized by executing software on some kind of hardware.

[0067] Some or all of the above aspects may be described as follows, but are not limited to the following:

[0068] [Appendix 1] a data analysis unit configured to analyze a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; a parameter setting unit configured to set the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object; an image processing unit configured to perform image processing on the main data in accordance with the set parameters; An image processing device comprising: [Appendix 2] the image processing unit is configured to perform image processing on the main data in accordance with the set parameters to generate image processed data, and to extract measurement data relating to the measurement object from the generated image processed data; the image processing device includes a data output unit configured to output the extracted measurement data; 2. The image processing device according to claim 1. [Appendix 3] the data analysis unit is configured to determine whether the analyzed parameters satisfy a preset measurement condition; the parameter setting unit is configured to set the analyzed parameters as the parameters for the image processing of the main data when the analyzed parameters satisfy the measurement conditions. 3. The image processing device according to claim 1 or 2. [Appendix 4] a guidance generating unit configured to generate guidance information for guiding a user to satisfy the measurement condition based on the analyzed parameter when the analyzed parameter does not satisfy the measurement condition; a guidance display unit configured to display the generated guidance information; Equipped with 4. The image processing device according to claim 3. [Appendix 5] the main data is infrared image data, The sub-data includes at least one of distance data, component data, image data, and environmental data. 5. An image processing device according to any one of claims 1 to 4. [Appendix 6] The parameters are at least one of thermal tuning (level span), emissivity, atmospheric effects, metal emissivity, imaging angle, and spatial resolution. 6. The image processing device according to claim 5. [Appendix 7] An image processing device according to any one of claims 1 to 6, At least one main camera that is communicatively connected to the image processing device and configured to capture an image of the measurement object to generate the main data; At least one sub-sensor communicably connected to the image processing device and configured to sense the measurement object or its surroundings to generate the sub-data; An image processing system comprising: [Appendix 8] An image processing device according to any one of claims 1 to 6, A hybrid main camera including at least one main camera communicably connected to the image processing device and configured to capture an image of the measurement object to generate the main data, and at least one sub-sensor configured to sense the measurement object or its surroundings to generate the sub-data; An image processing system comprising: [Appendix 9] An image processing device according to any one of claims 1 to 6, At least one main camera that is communicatively connected to the image processing device and configured to capture an image of the measurement object to generate the main data; At least one sub-sensor configured to sense the measurement object or its surroundings and generate the sub-data; an information providing device that is communicably connected to the image processing device and the sub-sensor, acquires the sub-data from the sub-sensor, and provides the acquired sub-data to the image processing device; An image processing system comprising: [Appendix 10] The main camera is an infrared camera, The sub-sensor includes at least one of a distance sensor, a component sensor, an image sensor, and an environmental sensor. 10. An image processing system according to any one of claims 7 to 9. [Appendix 11] An image processing device analyzes a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; a step of setting the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object by the image processing device; image processing the main data according to the set parameters; An image processing method comprising: [Appendix 12] A process of analyzing a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; A process of setting the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object; image processing of the main data in accordance with the set parameters; A program for causing an image processing device to execute the above.

[0069] The disclosures of the above patent documents are incorporated herein by reference and may be used as the basis or part of the present invention as necessary. Within the framework of the entire disclosure of the present invention (including the claims and drawings), modifications and adjustments of the forms and embodiments are possible based on the basic technical ideas. Furthermore, within the framework of the entire disclosure of the present invention, various combinations or selections (or non-selection as necessary) of various disclosed elements (including each element of each claim, each element of each form or embodiment, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art would be able to make in accordance with the entire disclosure, including the claims and drawings, and the technical ideas. Furthermore, with regard to the numerical values ​​and numerical ranges described in this application, any intermediate value, lower numerical value, and small range are considered to be described even if not specified. Furthermore, the disclosures of the above cited documents may be used in part or in whole in combination with the descriptions in this document as part of the disclosure of the present invention in accordance with the spirit of the present invention as necessary, and are considered to be included (belong) to the disclosures of this application. [Explanation of symbols]

[0070] 1. Image Processing System 3 Users 5. Measurement Object 10 Infrared camera (main camera) 11 Infrared image data (main data) 20 Distance sensor (sub-sensor) 21 Distance data (sub-data) 30 component sensor (sub-sensor) 31 Ingredient data (sub-data) 40 Image sensor (sub-sensor) 41 Image data (sub-data) 50 Environmental sensor (sub-sensor) 51 Environmental Data (Sub-Data) 60 Image processing device 61 Data Analysis Department 62 Parameter setting section 63 Image Processing Unit 64 Data output section 65 Guidance Generation Unit 66 Guidance display section 70, 70a~70m Main camera 71, 71a to 71n Sub-sensor 72 Information provision device 73 Network 80 Hybrid main camera 81 Main Camera 82a~82n Sub-sensor 100 Hardware Resources 101 Processor 102 Memory 103 Network Interface 104 Internal Bus

Claims

1. a data analysis unit configured to analyze a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; a parameter setting unit configured to set the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object; an image processing unit configured to perform image processing on the main data in accordance with the set parameters; An image processing device comprising:

2. the image processing unit is configured to perform image processing on the main data in accordance with the set parameters to generate image processed data, and to extract measurement data relating to the measurement object from the generated image processed data; the image processing device includes a data output unit configured to output the extracted measurement data; 2. The image processing device according to claim 1.

3. the data analysis unit is configured to determine whether the analyzed parameters satisfy a preset measurement condition; the parameter setting unit is configured to set the analyzed parameters as the parameters for the image processing of the main data when the analyzed parameters satisfy the measurement conditions.

2. The image processing device according to claim 1.

4. a guidance generating unit configured to generate guidance information for guiding a user to satisfy the measurement condition based on the analyzed parameter when the analyzed parameter does not satisfy the measurement condition; a guidance display unit configured to display the generated guidance information; Equipped with 4. The image processing device according to claim 3.

5. the main data is infrared image data, The sub-data includes at least one of distance data, component data, image data, and environmental data.

2. The image processing device according to claim 1.

6. The parameters are at least one of thermal tuning (level span), emissivity, atmospheric effects, metal emissivity, imaging angle, and spatial resolution.

6. The image processing device according to claim 5.

7. An image processing device according to any one of claims 1 to 6, At least one main camera that is communicatively connected to the image processing device and configured to capture an image of the measurement object to generate the main data; At least one sub-sensor that is communicatively connected to the image processing device and configured to sense the measurement object or its surroundings to generate the sub-data; An image processing system comprising:

8. An image processing device according to any one of claims 1 to 6, A hybrid main camera including at least one main camera communicably connected to the image processing device and configured to capture an image of the measurement object to generate the main data, and at least one sub-sensor configured to sense the measurement object or its surroundings to generate the sub-data; An image processing system comprising:

9. An image processing device analyzes a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; setting the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object by the image processing device; image processing the main data according to the set parameters; An image processing method comprising:

10. A process of analyzing a parameter based on at least one sub-data for parameter analysis obtained by sensing the measurement object or its surroundings; A process of setting the analyzed parameters as parameters for image processing of at least one main data for measurement obtained by photographing the measurement object; image processing of the main data in accordance with the set parameters; A program for causing an image processing device to execute the above.

Images