Imaging controller, imaging control method, and imaging control program

Abstract

SOLUTION: There is provided an imaging controller comprising: an image acquisition part which acquires an image imaged in a plant; an environmental information acquisition part which acquires environmental information in the plant; an image determination part which determines whether the imaged image is clear; and an imaging instruction part which instructs re-imaging of the image to an imaging device on the basis of at least one of an unclear region in the image and the environmental information in the case where the image is determined to be unclear. In the imaging controller, the imaging instruction part may instruct re-imaging in which at least a part is different to the imaging device in the case where a subject region corresponding to a subject in the image is unclear but a region other than the subject region is determined to be clear and in the case where the entire image is determined to be unclear.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an imaging control device, an imaging control method, and an imaging control program. [Background technology]

[0002] Patent document 1 states, "The abnormality cause estimation system 1 comprises an environmental information acquisition means 2 that acquires information about the environment of the camera 6, and an information processing device 3 that performs calculations regarding the abnormality of the camera 6 and its cause using information transmitted from the environmental information acquisition means 2, the camera 6, an image processing unit 71, and a robot control unit 72." (paragraph 0025). [Prior art document] [Patent documents] [Patent Document 1] JP 2018-113610 A Summary of the Invention [Means for solving the problem]

[0003] In a first aspect of the present invention, there is provided an imaging control device comprising an image acquisition unit that acquires an image captured within a plant, an environmental information acquisition unit that acquires environmental information within the plant, an image determination unit that determines whether the captured image is clear or not, and an imaging instruction unit that, if the image is determined to be unclear, instructs the imaging device to re-capture the image based on at least one of a blurred area in the image or the environmental information.

[0004] In the above-mentioned imaging control device, the imaging instruction unit may issue to the imaging device instructions to re-image that differ in at least some respects depending on whether it is determined that the subject area corresponding to the subject in the image is blurred but the area other than the subject area is clear, or whether it is determined that the entire image is blurred.

[0005] In any of the above-mentioned imaging control devices, when it is determined that the entire image is blurred, the imaging instruction unit may instruct the imaging device to re-image the image with at least a different portion based on whether the environmental information is within a normal range.

[0006] In any of the above-mentioned imaging control devices, if it is determined that the entire image is blurred and the environmental information is within an abnormal range, the imaging instruction unit may instruct the imaging device to re-image after a predetermined waiting time has elapsed.

[0007] In any of the above-described imaging control devices, when it is determined that the entire image is blurred and the environmental information is within a normal range, the imaging instruction unit may instruct the imaging device to re-image before the waiting time has elapsed, or may not instruct the imaging device to re-image.

[0008] In any of the above imaging control devices, when the image determination unit determines that a subject area corresponding to a subject in the image is blurred but an area other than the subject area is clear, the image determination unit detects whether or not halation is present in the subject area, and the imaging instruction unit may instruct the imaging device to re-image the image based on the detection of the halation.

[0009] In any of the above imaging control devices, when the halation is detected, the imaging instruction unit may instruct the imaging device to change at least one of the position or orientation of the imaging device and re-capture the image.

[0010] Any of the above imaging control devices may include a shooting condition determination unit that determines whether the shooting conditions are appropriate if at least some of the information from the subject cannot be obtained using the image, and the imaging instruction unit may instruct the imaging device to change the shooting conditions and re-capture the image if the shooting conditions are determined to be inappropriate.

[0011] In any of the above imaging control devices, the image acquisition unit acquires the image of a meter of equipment within the plant as the subject, and the imaging instruction unit does not need to instruct re-imaging of the image if information indicated on the meter is obtained from the image.

[0012] In a second aspect of the present invention, there is provided an imaging control method comprising: acquiring an image taken within a plant; acquiring environmental information within the plant; determining whether the captured image is clear; and, if it is determined that the image is blurred, instructing an imaging device to re-capture the image based on at least one of a blurred area in the image or the environmental information.

[0013] In a third aspect of the present invention, there is provided an imaging control program that, when executed by a computer, causes the computer to function as an image acquisition unit that acquires images captured within a plant, an environmental information acquisition unit that acquires environmental information within the plant, an image determination unit that determines whether the captured image is clear, and an imaging instruction unit that, if the image is determined to be unclear, instructs an imaging device to re-capture the image based on at least one of a blurred area in the image or the environmental information.

[0014] The above summary of the invention does not list all of the features of the present invention, and subcombinations of these features may also be inventions. [Brief explanation of the drawings]

[0015] [Figure 1] The configuration of an imaging control device 10 according to this embodiment is shown together with an imaging device 20, a sensor 30, and a database 40. [Figure 2] 2 shows a processing flow of the imaging control device 10 according to the present embodiment. [Figure 3] 2 shows a processing flow of the imaging control device 10 according to the present embodiment. [Figure 4] 2 shows a processing flow of the imaging control device 10 according to the present embodiment. [Figure 5] 4 shows an example of image data 400 captured by the imaging device 20 according to this embodiment. [Figure 6] 22 illustrates an example computer 2200 in which aspects of the present invention may be embodied, in whole or in part. DETAILED DESCRIPTION OF THE INVENTION

[0016] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0017] FIG. 1 shows the configuration of an imaging control device 10 according to this embodiment, along with imaging devices 20, sensors 30, and a database 40. The imaging control device 10 detects abnormalities in images captured inside a facility such as a plant, and controls imaging so that normal images can be obtained when an abnormality occurs. Plants in which the imaging control device 10 is installed include industrial plants such as chemical plants, plants that manage and control wellheads and surrounding areas of gas and oil fields, plants that manage and control power generation such as hydroelectric, thermal, and nuclear power, plants that manage and control energy harvesting such as solar and wind power, and plants that manage and control water, sewage, and dams. The imaging control device 10 is communicatively connected to one or more imaging devices 20 and one or more sensors 30. The imaging control device 10 may be connected to each imaging device 20 and each sensor 30 via a wireless network such as a mobile phone network, a wireless WAN, a wireless LAN, or Bluetooth (registered trademark), or may be connected to each imaging device 20 and each sensor 30 via a wired network such as wired Ethernet (registered trademark).

[0018] The imaging control device 10 may be a computer such as a PC (personal computer), tablet computer, smartphone, workstation, server computer, or general-purpose computer, or may be a computer system in which multiple computers are connected. Such a computer system is also considered a computer in a broad sense. The imaging control device 10 may also be implemented as one or more virtual computer environments executable within a computer. Alternatively, the imaging control device 10 may be a dedicated computer designed for imaging control of each imaging device 20, or may be dedicated hardware realized by a dedicated circuit.

[0019] The imaging control device 10 may be installed within a facility. Alternatively, the imaging control device 10 may be installed outside the facility or within another facility via a cloud computing system on the Internet, etc. The imaging control device 10 includes a database connection unit 100, an image acquisition unit 110, a shooting condition acquisition unit 120, an environmental information acquisition unit 130, an intra-image information detection unit 140, an image determination unit 160, a shooting condition determination unit 170, and an imaging instruction unit 180. The database connection unit 100 is connected to a database 40. The database connection unit 100 processes access to the database 40 from each unit within the imaging control device 10.

[0020] The image acquisition unit 110 is connected to the database connection unit 100. The image acquisition unit 110 is connected to the imaging device 20 via a network or the like. The image acquisition unit 110 acquires images captured within the facility. The image acquisition unit 110 may acquire images captured within the facility by receiving image data captured and transmitted by the imaging device 20.

[0021] The photographing condition acquisition unit 120 is connected to the database connection unit 100. The photographing condition acquisition unit 120 is connected to the imaging device 20 via a network or the like. The photographing condition acquisition unit 120 acquires the photographing conditions of images captured within the facility. The photographing condition acquisition unit 120 may acquire at least one of an exposure value, an ISO value, a shutter speed, an aperture value, or the like as the photographing conditions. The photographing condition acquisition unit 120 may acquire the photographing conditions of images captured within the facility by receiving photographing condition data transmitted by the imaging device 20. If the image data transmitted by the imaging device 20 includes photographing condition data, the image acquisition unit 110 may function as the photographing condition acquisition unit 120.

[0022] The environmental information acquisition unit 130 is connected to the database connection unit 100. The environmental information acquisition unit 130 is connected to the sensor 30 via a network or the like. The environmental information acquisition unit 130 acquires environmental information within the facility. The environmental information acquisition unit 130 may acquire at least one of the temperature, humidity, and illuminance within the facility as the environmental information within the facility. The environmental information acquisition unit 130 may acquire the environmental information within the facility by receiving the environmental information measured and transmitted by the sensor 30.

[0023] The intra-image information detection unit 140 is connected to the database connection unit 100 and the image acquisition unit 110. The intra-image information detection unit 140 detects information included in the image acquired by the image acquisition unit 110.

[0024] The image determination unit 160 is connected to the database connection unit 100 and the intra-image information detection unit 140. When the intra-image information detection unit 140 cannot detect information contained in the image, the image determination unit 160 determines whether the image is clear or not based on normal images stored in the database 40, and identifies any blurred areas in the image.

[0025] The shooting condition determination unit 170 is connected to the database connection unit 100, the shooting condition acquisition unit 120, and the intra-image information detection unit 140. If the intra-image information detection unit 140 cannot detect information contained in the image, the shooting condition determination unit 170 determines whether the shooting conditions received from the shooting condition acquisition unit 120 are appropriate, based on the normal shooting conditions stored in the database 40.

[0026] The imaging instruction unit 180 is connected to the database connection unit 100, the environmental information acquisition unit 130, the image determination unit 160, and the shooting condition determination unit 170. The imaging instruction unit 180 is connected to the imaging device 20 via a network or the like. The imaging instruction unit 180 may instruct the imaging device 20 to re-image based on at least one of the environmental information acquired by the environmental information acquisition unit 130, the determination result of the image determination unit 160, or the determination result of the shooting condition determination unit 170. Here, "re-image" refers to capturing an image of the same subject as the image acquired by the image acquisition unit 110. When the image is determined to be blurred, the imaging instruction unit 180 may instruct the imaging device 20 to re-image the image based on at least one of a blurred region in the image or environmental information. The imaging instruction unit 180 may issue to the imaging device 20 an instruction to re-image that differs at least in part depending on whether it is determined that a subject area corresponding to a subject in an image is blurred but an area other than the subject area is clear, or whether it is determined that the entire image is blurred. Here, the subject area refers to the area of ​​the acquired image that is occupied by the subject. When it is determined that the entire image is blurred, the imaging instruction unit 180 may issue to the imaging device 20 an instruction to re-image that differs at least in part depending on whether or not environmental information is within a normal range. The imaging instruction unit 180 may issue different instructions to re-image, such as whether or not to change the shooting conditions, whether or not to wait, etc., depending on whether or not the environmental information is within a normal range.

[0027] One or more imaging devices 20 are used to capture images inside the facility. The imaging device 20 may be a robot with an imaging function such as a camera, and may be equipped with an actuator or the like for moving inside the facility. The imaging device 20 may patrol the facility along a predetermined route. Alternatively, the imaging device 20 may be fixed inside the facility. In this case, the imaging device 20 may be able to change the direction in which it captures images.

[0028] One or more sensors 30 measure conditions within the facility. The sensors 30 may measure at least one of temperature, humidity, and illuminance. The sensors 30 may be included in the imaging device 20. Alternatively, the sensors 30 may be fixed at the same or different positions within the facility.

[0029] The database 40 stores captured images, shooting conditions, environmental information within the facility, and schedule information for the imaging device 20 and the sensor 30. The database 40 may be realized by at least a portion of the storage area of ​​an external storage device such as a hard disk drive connected to the imaging control device 10, or may be realized by a storage device external to the imaging control device 10 provided by, for example, a cloud storage service.

[0030] 2, 3, and 4 show processing flows of the imaging control device 10 according to this embodiment. For convenience of explanation, the processing flows in Fig. 2, 3, and 4 show a case where the imaging control device 10 controls imaging by one imaging device 20. The imaging control device 10 may execute the processing flows in Fig. 2, 3, and 4 for each of the multiple imaging devices 20.

[0031] In step 200 (S200), the imaging control device 10 instructs the imaging device 20 to move and capture images. Here, the imaging control device 10 may obtain a schedule for the imaging device 20 to patrol the facility by referring to schedule information recorded in the database 40 in association with the imaging device 20 to be processed. This schedule may include information necessary for determining the operation of the imaging device 20, such as the location of each imaging point where the imaging device 20 should capture images within the facility, the time to arrive at each imaging point, the travel route between imaging points, or the imaging direction at each imaging point. In accordance with the schedule, the imaging control device 10 instructs the imaging device 20 to move to the next imaging point and to capture images at the next imaging point. In response to this, the imaging device 20 moves to the next imaging point. If the imaging device 20 is fixed within the facility, the imaging control device 10 may instruct the imaging device 20 only to capture images.

[0032] In S210, the imaging device 20 captures an image of the facility and generates image data. The imaging device 20 may capture an image of a meter of equipment in the plant as a subject. The imaging device 20 transmits the captured image data to the imaging control device 10.

[0033] In S220, the image acquiring unit 110 acquires an image of the inside of the facility from the imaging device 20. The image acquiring unit 110 may acquire an image of a meter of equipment in the plant as a subject. The image acquiring unit 110 may acquire an image of equipment or equipment in the plant as a subject, or may acquire an image of the periphery of the equipment or equipment in the plant as a subject. The imaging condition acquiring unit 120 may acquire imaging conditions from the imaging device 20. The environmental information acquiring unit 130 may acquire environmental information in the facility from the sensor 30. The image acquiring unit 110, the imaging condition acquiring unit 120, and the environmental information acquiring unit 130 may record the acquired information, etc. in the database 40.

[0034] In S230, the intra-image information detection unit 140 detects information within the image acquired by the image acquisition unit 110. If the subject is a meter, the intra-image information detection unit 140 may detect information displayed on the meter. If the meter displays numerical values ​​and characters, the intra-image information detection unit 140 may detect text information, such as numerical values ​​and characters, displayed on the meter using character recognition. If the meter indicates a value based on the position of a needle, boundary surface, or the like relative to a scale, i.e., if it is an analog meter, the intra-image information detection unit 140 may detect the numerical value indicated by the needle or boundary surface from the positional relationship between the needle or boundary surface and the scale. If the meter indicates information by a change in hue, for example, a meter that displays a deeper red as pressure increases, the intra-image information detection unit 140 may detect the information displayed on the meter by quantifying the change in hue. If the subject is equipment, devices, or their surroundings within a plant, the intra-image information detection unit 140 may detect the position, outline, etc. of the equipment or devices within the image.

[0035] If the intra-image information detection unit 140 has detected information within the image (Yes in S250), the intra-image information detection unit 140 may record the detected information in the database 40. The imaging control device 10 ends the processing flow. Therefore, if the subject is a meter, the imaging instruction unit 180 does not need to instruct re-imaging of the image if the information indicated on the meter is obtained from the image.

[0036] If the intra-image information detection unit 140 fails to detect at least a portion of the information in the image (No in S250), the imaging control device 10 proceeds to S300. For example, if the intra-image information detection unit 140 fails to detect information displayed on at least a portion of the meter, which is the subject, or if the intra-image information detection unit 140 fails to detect at least a portion of the contour of the subject, the imaging control device 10 proceeds to S300. In S300, if the imaging condition determination unit 170 fails to obtain at least a portion of the information from the subject using the image, it determines whether the imaging conditions are appropriate. If the intra-image information detection unit 140 fails to obtain at least a portion of the information from the subject using the image, the imaging condition determination unit 170 may instruct the imaging condition acquisition unit 120 to acquire imaging conditions, or may read out from the database 40 the imaging conditions that the imaging condition acquisition unit 120 previously acquired in S220. The photographing condition determination unit 170 may determine whether the photographing conditions are appropriate based on a comparison between the photographing conditions acquired by the photographing condition acquisition unit 120 (including the photographing conditions acquired in advance by the photographing condition acquisition unit 120 in S220 and stored in the database 40) and the photographing conditions stored in the database 40. The photographing condition determination unit 170 may use predetermined standard photographing conditions for the same subject as the photographing conditions stored in the database 40, or may use conditions used when an image of the same subject was previously captured and from which information was detectable by the intra-image information detection unit 140. The photographing condition determination unit 170 may compare the acquired values ​​of each of the parameters, i.e., exposure value, ISO value, shutter speed, and aperture value, with the values ​​stored in the database 40, and determine that the photographing conditions are inappropriate if the difference in the numerical value of any one parameter exceeds a predetermined threshold.

[0037] If the shooting conditions are inappropriate (Yes in S302), the imaging control device 10 proceeds to S304. In S304, if the shooting conditions are determined to be inappropriate, the imaging instruction unit 180 instructs the imaging device 20 to change the shooting conditions and re-shoot the image. The imaging instruction unit 180 may instruct the imaging device 20 to change the shooting conditions to predetermined standard shooting conditions for the same subject stored in the database 40, or to the conditions used when an image of the same subject previously captured and stored in the database 40 was captured and in which the intra-image information detection unit 140 was able to detect information. In S210, upon returning from S304, the imaging device 20 re-shoots based on the changed shooting conditions. This allows the imaging control device 10 to acquire an image in which the intra-image information detection unit 140 can detect information.

[0038] If the shooting conditions are appropriate (No in S302), the imaging control device 10 proceeds to S306. In S306, the imaging instruction unit 180 determines whether the captured image is out of focus. The imaging instruction unit 180 may determine whether the captured image is out of focus based on edge detection. The imaging instruction unit 180 may detect edges around the subject in the captured image, and determine that the captured image is out of focus if the amount of change in brightness value in the detected range, a score indicating the amount of edge, or the like is below a predetermined threshold. Here, the imaging instruction unit 180 may identify the subject in the captured image as an object captured in an area including the focused position in the captured image. If data regarding the image or shape of the subject is stored in advance in the database 40, the imaging instruction unit 180 may identify, as the subject in the captured image, an object whose degree of match with the image or shape of the subject stored in the database 40 is equal to or greater than a threshold.

[0039] If the captured image is out of focus (Yes in S308), the imaging control device 10 proceeds to S310. In S310, the imaging instruction unit 180 instructs the imaging device 20 to reset the focus and recapture the image. The imaging instruction unit 180 may instruct the imaging device 20 to move to an imaging position where no objects other than the subject are located at the pixel position where focus is adjusted in the image, so that the subject is in focus, and to recapture the image. If the autofocus function of the imaging device 20 is turned off, the imaging instruction unit 180 may instruct the imaging device 20 to turn on the autofocus function and recapture the image. This allows the imaging control device 10 to prevent the recaptured image from being out of focus. In S210, which returns from S310, the imaging device 20 performs recapture.

[0040] If the captured image is not out of focus (No in S308), the imaging control device 10 proceeds to S314. In S314, the image determination unit 160 determines whether the captured image is clear. The image determination unit 160 may determine whether the captured image is clear based on a comparison between the captured image and past images of the same subject stored in the database 40. Here, the image determination unit 160 may use an image in which the intra-image information detection unit 140 was able to detect information as the past image of the same subject. The image determination unit 160 may compare the captured image with the past image of the same subject, and if there is a different area, determine that the captured image is blurred and identify that area as a blurred area.

[0041] If the blurred area identified by the image determination unit 160 is only the subject area (Yes in S316), the imaging control device 10 proceeds to S318. In S318, if the image determination unit 160 determines that the subject area corresponding to the subject in the image is blurred but the area other than the subject area is clear, it detects the presence or absence of halation in the subject area. Here, halation may indicate that an image becomes white and blurred due to strong light. Halation is likely to occur when the reflectivity of light on the surface of the subject is high, such as when a meter is covered with a cover such as glass. The image determination unit 160 may determine that halation is present in the captured image if the area of ​​the subject area in the captured image where the brightness exceeds a predetermined threshold exceeds a certain value.

[0042] If halation is present in the captured image (Yes in S318), the imaging control device 10 proceeds to S320. In S320, if halation is detected, the imaging instruction unit 180 instructs the imaging device 20 to recapture the image. If halation is detected, the imaging instruction unit 180 may instruct the imaging device 20 to change at least one of the position or orientation of the imaging device 20 and recapture the image. The imaging instruction unit 180 may instruct the imaging device 20 to move to a different imaging location and / or change the camera orientation and then recapture the image. The imaging instruction unit 180 may instruct the imaging device 20 to change at least one of the position or orientation of the imaging device 20 so that the light that caused the halation is not included in the image. This allows the imaging control device 10 to prevent halation from occurring in the recaptured image. Upon returning from S320 to S210, the imaging device 20 recaptures the image.

[0043] If the blurred region identified by the image determination unit 160 is not only the subject region but also the entire image (No in S316), the imaging control device 10 proceeds to the process at S322. In S322, the environmental information acquisition unit 130 acquires environmental information within the facility from the sensor 30. Alternatively, the environmental information acquisition unit 130 may have acquired the environmental information in advance at S220 or the like. The environmental information acquisition unit 130 may acquire the environmental information from the sensor 30, among one or more sensors 30 present in the facility, that is closest in linear distance to the imaging point where the imaging device 20 captured the image or the subject. If the imaging device 20 is equipped with a sensor 30, the environmental information acquisition unit 130 may acquire the environmental information from the sensor 30 provided in the imaging device 20 that captured the image. The environmental information acquisition unit 130 may acquire the environmental information from the sensor 30, among one or more sensors 30 present in the facility, that is located in the same room as the imaging point where the imaging device 20 captured the image. The environmental information acquisition unit 130 may record the acquired environmental information in the database 40.

[0044] The imaging instruction unit 180 determines whether the environmental information acquired by the environmental information acquisition unit 130 is within a normal range. The imaging instruction unit 180 may determine whether the environmental information acquired by the environmental information acquisition unit 130 is within a normal range by comparing the environmental information acquired by the environmental information acquisition unit 130 with the environmental information stored in the database 40. The imaging instruction unit 180 may use predetermined reference environmental information for the same subject as the environmental information stored in the database 40, or may use environmental information from a previous image of the same subject in which the intra-image information detection unit 140 was able to detect information. If the sensor 30 is included in the imaging device 20, the imaging instruction unit 180 may use past environmental information acquired from the sensor 30 included in the imaging device 20 that performed the imaging as the environmental information stored in the database 40. The imaging instruction unit 180 may use environmental information of a past location acquired from a sensor 30 located near the location where the imaging device 20 that performed the imaging was located before the imaging, as the environmental information stored in the database 40. The imaging instruction unit 180 compares the values ​​acquired by the environmental information acquisition unit 130 with the values ​​stored in the database 40 for each of the parameters of temperature, humidity, and illuminance within the facility, and if the difference in value for any parameter exceeds a predetermined threshold, it may determine that the parameter is abnormal and the environmental information is in the abnormal range.

[0045] If the temperature or humidity inside the facility acquired by the environmental information acquisition unit 130 is higher than the temperature or humidity at the previous location of the image capture device 20 and the difference between these temperatures or humidity levels is greater than a threshold, the camera lens of the image capture device 20 may become foggy, causing the entire image captured by the image capture device 20 to become unclear. If the humidity inside the facility acquired by the environmental information acquisition unit 130 is higher than the previous humidity or the reference humidity at the same location, etc. and the difference between these values ​​is greater than a threshold, fog, mist, etc. may occur inside the facility, causing the entire image captured by the image capture device 20 to become unclear. If the difference between the illuminance inside the facility acquired by the environmental information acquisition unit 130 and the previous illuminance or the reference value at the same location, etc. exceeds a threshold, using shooting conditions appropriate for the previous illuminance or the reference value may cause the entire image captured by the image capture device 20 to become unclear. The imaging instruction unit 180 may compare the values ​​acquired by the environmental information acquisition unit 130 with the values ​​stored in the database 40 for each parameter of temperature, humidity, and illuminance within the facility, and determine that the environmental information is within the normal range if there is no parameter whose numerical difference exceeds a predetermined threshold.

[0046] If the environmental information is within the abnormal range (Yes in S324), the imaging control device 10 proceeds to S330. If the environmental information indicates that the illuminance is abnormal (Yes in S330), the imaging control device 10 proceeds to S332. In S332, the imaging instruction unit 180 instructs the imaging device 20 to change the shooting conditions to match the illuminance and re-capture the image. If the illuminance is lower than a reference value or a previous illuminance, the imaging instruction unit 180 may instruct the imaging device 20 to perform at least one of the following: increase the ISO sensitivity, slow the shutter speed, or reduce the aperture value. In S210, which returns from S332, the imaging device 20 re-captures the image based on the changed shooting conditions. This allows the imaging control device 10 to obtain a clearer image.

[0047] If the environmental information other than the illuminance is abnormal (No in S330), the imaging control device 10 proceeds to S336. In S336, the imaging instruction unit 180 stores the environmental information acquired by the environmental information acquisition unit 130 in the database 40 as an abnormal value.

[0048] In S338, if the entire image is determined to be blurred and the environmental information is in the abnormal range, the imaging instruction unit 180 instructs the imaging device 20 to re-image after a predetermined waiting time has elapsed. The imaging instruction unit 180 may instruct the imaging device 20 to wait without moving until the predetermined time has elapsed and then re-image. The imaging instruction unit 180 may acquire information regarding the predetermined waiting time from the database 40. In S210 upon returning from S338, the imaging device 20 re-images based on the changed shooting conditions. As a result, if the entire image was blurred due to fogging of the camera lens caused by a sudden change in temperature or humidity, the imaging control device 10 can acquire a clear image captured after the waiting time has elapsed and the fogging of the camera lens has cleared. Furthermore, if the entire image was blurred due to fog, mist, or the like caused by a sudden increase in humidity at the imaging location, the imaging control device 10 can acquire a clear image captured after the waiting time has elapsed and the fog, mist, or the like has cleared.

[0049] If there is no halation in the captured image (No in S318) and if the environmental information is within the normal range (No in S324), the imaging control device 10 proceeds to S340. If it is determined that the entire image is blurred and the environmental information is within the normal range, the imaging instruction unit 180 instructs the imaging device 20 to re-image before the waiting time has elapsed, or does not instruct re-imaging. If the imaging instruction unit 180 instructs re-imaging (Yes in S340), the imaging control device 10 proceeds to S342. In S342, the imaging instruction unit 180 instructs the imaging device 20 to re-imaging before the waiting time has elapsed. In S210, which has returned from S342, the imaging device 20 re-imaging. If the imaging instruction unit 180 does not instruct re-imaging (No in S340), the imaging instruction unit 180 may instruct the imaging device 20 to move to a predetermined home position. If the entire image is determined to be unclear, the environmental information is within the normal range, and the shooting conditions are appropriate, it is possible that an abnormality has occurred in the imaging device 20, so by moving the imaging device 20 to the home position, it is possible to make it easier for a manager or the like to diagnose the abnormality. The imaging instruction unit 180 may notify the manager of the facility or the like that an abnormality has occurred. The imaging control device 10 ends the processing flow.

[0050] According to the imaging control device 10 described above, if the in-image information detection unit 140 cannot detect information in the captured image, it can identify and resolve the cause and instruct the imaging device 20 to re-image, so that images in which information can be detected can be automatically re-imaged, reducing the burden on the worker.

[0051] 5 shows an example of image data 400 captured by the imaging device 20 according to this embodiment. The imaging device 20 transmits the image data 400 to the imaging control device 10 (S220 in FIG. 2). The image data 400 includes an image of a pipe 410 and a meter 420. The meter 420 includes a numeric display area 425. In the example shown in this figure, the numeric display area 425 displays the number "1000." When the intra-image information detection unit 140 detects the number displayed on the meter, the numeric display area 425 becomes the subject area in the image data 400.

[0052] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where the blocks may represent (1) stages of a process in which operations are performed or (2) sections of an apparatus responsible for performing the operations. Particular stages and sections may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable medium, and / or a processor provided with computer-readable instructions stored on a computer-readable medium. Dedicated circuitry may include digital and / or analog hardware circuitry, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry, including logical AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, memory elements such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.

[0053] A computer-readable medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that the computer-readable medium having instructions stored thereon comprises an article of manufacture containing instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick, integrated circuit card, and the like.

[0054] The computer readable instructions may include either assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0055] The computer-readable instructions may be provided to a processor or programmable circuitry of a programmable data processing apparatus, such as a general-purpose computer, special-purpose computer, or other computer, either locally or over a wide-area network (WAN) such as a local area network (LAN), the Internet, etc., which executes the computer-readable instructions to create means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0056] 6 illustrates an example of a computer 2200 in which aspects of the present invention may be embodied, in whole or in part. Programs installed on the computer 2200 may cause the computer 2200 to function as or perform operations associated with an apparatus or one or more sections of the apparatus according to embodiments of the present invention, and / or to perform a process or steps of a process according to embodiments of the present invention. Such programs may be executed by the CPU 2212 to cause the computer 2200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0057] A computer 2200 according to this embodiment includes a CPU 2212, a RAM 2214, a graphics controller 2216, and a display device 2218, which are interconnected by a host controller 2210. The computer 2200 also includes input / output units such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card drive, which are connected to the host controller 2210 via an input / output controller 2220. The computer also includes legacy input / output units such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.

[0058] The CPU 2212 operates according to programs stored in the ROM 2230 and RAM 2214, thereby controlling each unit. The graphics controller 2216 acquires image data generated by the CPU 2212 into a frame buffer or the like provided in the RAM 2214 or into the graphics controller 2216 itself, and causes the image data to be displayed on the display device 2218.

[0059] The communications interface 2222 communicates with other electronic devices via a network. The hard disk drive 2224 stores programs and data used by the CPU 2212 in the computer 2200. The DVD-ROM drive 2226 reads programs or data from the DVD-ROM 2201 and provides the programs or data to the hard disk drive 2224 via the RAM 2214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0060] The ROM 2230 stores therein a boot program or the like that is executed by the computer 2200 upon activation, and / or programs that depend on the hardware of the computer 2200. The input / output chip 2240 may also connect various input / output units to the input / output controller 2220 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0061] The programs are provided by a computer-readable medium such as a DVD-ROM 2201 or an IC card. The programs are read from the computer-readable medium, installed in the hard disk drive 2224, RAM 2214, or ROM 2230, which are also examples of computer-readable media, and executed by the CPU 2212. Information processing described in these programs is read by the computer 2200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by realizing information manipulation or processing in accordance with the use of the computer 2200.

[0062] For example, when communication is performed between the computer 2200 and an external device, the CPU 2212 may execute a communication program loaded into the RAM 2214 and instruct the communication interface 2222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 2212, the communication interface 2222 reads transmission data stored in a transmission buffer processing area provided in the RAM 2214, the hard disk drive 2224, the DVD-ROM 2201, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer processing area or the like provided on the recording medium.

[0063] The CPU 2212 may also cause all or a necessary portion of a file or database stored on an external recording medium such as the hard disk drive 2224, the DVD-ROM drive 2226 (DVD-ROM 2201), an IC card, etc. to be read into the RAM 2214, and perform various types of processing on the data on the RAM 2214. The CPU 2212 then writes back the processed data to the external recording medium.

[0064] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 2212 may perform various types of processing on data read from the RAM 2214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 2214. The CPU 2212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored on the recording medium, the CPU 2212 may search for an entry that matches a condition specified by the attribute value of the first attribute from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0065] The above-described programs or software modules may be stored in a computer-readable medium on or near the computer 2200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable medium, thereby providing the programs to the computer 2200 via the network.

[0066] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0067] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0068] 10. Imaging control device 20 Imaging device 30 sensors 40 databases 100 Database Connection 110 Image acquisition unit 120 Shooting condition acquisition unit 130 Environmental Information Acquisition Department 140 Image information detection unit 160 Image Judgment Unit 170 Shooting condition determination unit 180 Imaging instruction unit 400 image data 410 Piping 420 meters 425 Numerical display area 2200 Computer 2201 DVD-ROM 2210 host controller 2212 CPU 2214 RAM 2216 Graphics Controller 2218 Display Device 2220 Input / Output Controller 2222 communication interface 2224 hard disk drive 2226 DVD-ROM drive 2230 ROM 2240 I / O chip 2242 keyboard

Claims

1. an image acquisition unit that acquires images taken within the plant; an environmental information acquisition unit that acquires environmental information within the plant; an image determination unit that determines whether the captured image is clear; an imaging instruction unit that, when the image is determined to be blurred, instructs an imaging device to re-image the image based on at least one of a blurred area in the image and the environmental information; An imaging control device comprising:

2. 2. The imaging control device according to claim 1, wherein the imaging instruction unit issues to the imaging device instructions to re-image the subject in the image, the instructions being at least partially different depending on whether it is determined that a subject area corresponding to the subject in the image is blurred but areas other than the subject area are clear, or whether it is determined that the entire image is blurred.

3. The imaging control device according to claim 2 , wherein, when it is determined that the entire image is unclear, the imaging instruction unit instructs the imaging device to re-image the image with at least a part of the image being different based on whether the environmental information is within a normal range.

4. 4. The imaging control device according to claim 3, wherein the imaging instruction unit instructs the imaging device to re-image after a predetermined waiting time has elapsed when the entire image is determined to be blurred and the environmental information is in an abnormal range.

5. 5. The imaging control device according to claim 4, wherein the imaging instruction unit instructs the imaging device to re-image before the waiting time has elapsed, or does not instruct the imaging device to re-image, when it is determined that the entire image is blurred and the environmental information is within a normal range.

6. When the image determination unit determines that a subject area corresponding to a subject in the image is unclear but an area other than the subject area is clear, the image determination unit detects whether or not halation is present in the subject area, The imaging instruction unit instructs the imaging device to re-image the image when the halation is detected. The imaging control device according to claim 2 .

7. The imaging control device according to claim 6 , wherein, when the halation is detected, the imaging instruction unit instructs the imaging device to change at least one of the position and the orientation of the imaging device and then re-capture the image.

8. a photographing condition determining unit that determines whether a photographing condition is appropriate when at least a part of information from the subject cannot be obtained using the image; When the photographing conditions are determined to be inappropriate, the photographing instruction unit instructs the photographing device to change the photographing conditions and photograph the image again. The imaging control device according to claim 1 .

9. the image acquisition unit acquires the image of a meter of a device in the plant as a subject; The imaging instruction unit does not instruct re-imaging of the image when the information displayed on the meter is obtained from the image. The imaging control device according to claim 1 .

10. Acquiring images taken within a plant; acquiring environmental information within the plant; determining whether the captured image is clear; if the image is determined to be blurred, instructing an image capture device to re-capture the image based on at least one of a blurred region in the image and the environmental information; An imaging control method comprising:

11. When executed by a computer, the computer is an image acquisition unit that acquires images taken within the plant; an environmental information acquisition unit that acquires environmental information within the plant; an image determination unit that determines whether the captured image is clear; an imaging instruction unit that, when the image is determined to be blurred, instructs an imaging device to re-image the image based on at least one of a blurred area in the image and the environmental information; An imaging control program that functions as follows.

Images