Photographing control apparatus, photographing control method, and storage medium

Abstract

The present invention provides an imaging control device, an imaging control method, and a storage medium, the imaging control device comprising: an image acquisition unit that acquires an image captured in a factory; an environment information acquisition unit that acquires environment information in the plant; an image determination unit that determines whether or not the captured image is clear; and an imaging instruction unit that, when it is determined that the image is not clear, instructs an imaging device to reimage the image on the basis of at least one of an unclear region in the image and the environmental information. In the image capturing control device, when it is determined that a subject region corresponding to a subject in the image is not clear and a region other than the subject region is clear, and when it is determined that the entire image is not clear, the image capturing control device determines that the subject region corresponding to the subject is clear and the region other than the subject region is clear. The imaging instruction unit may instruct the imaging device to perform at least partially different re-imaging.

Description

Technical Field

[0001] The present invention relates to a shooting control device, a shooting control method and a storage medium. Background Art

[0002] Patent document 1 states that "the abnormality cause inference system 1 comprises: an environmental information acquisition unit 2 for acquiring information related to the environment of the camera 6; and an information processing device 3 for performing operations related to the abnormality of the camera 6 and its cause using information sent from the environmental information acquisition unit 2, the camera 6, the image processing unit 71 and the robot control unit 72." (Paragraph 0025). Prior art literature Patent Document 1: Japanese Patent Application Publication No. 2018-113610 Summary of the Invention

[0003] In a first embodiment of the present invention, a shooting control device is provided, which comprises: an image acquisition unit for acquiring an image shot in a factory; an environmental information acquisition unit for acquiring environmental information in the factory; an image determination unit for determining whether the shot image is clear; and a shooting instruction unit for instructing the shooting device to shoot the image again based on at least one of the unclear area in the image and the environmental information when it is determined that the image is unclear.

[0004] In the above-mentioned shooting control device, when it is determined that the subject area corresponding to the subject in the image is not clear and the area outside the subject area is clear, and when it is determined that the image as a whole is not clear, the shooting instruction unit may instruct the shooting device to shoot again with at least a different part.

[0005] In any of the above-mentioned imaging control devices, when it is determined that the entire image is unclear, the imaging instruction unit may instruct the imaging device to re-shoot with at least a different portion based on whether the environmental information is within a normal range.

[0006] In any of the above-mentioned imaging control devices, when it is determined that the entire image is not clear and the environmental information is within an abnormal range, the imaging instruction unit may instruct the imaging device to perform imaging again after a predetermined standby time has elapsed.

[0007] In any of the above-mentioned shooting control devices, when it is determined that the entire image is not clear and the environmental information is within a normal range, the shooting instruction unit may instruct the shooting device to shoot again before the waiting time expires, or not instruct to shoot again.

[0008] In any of the above-mentioned shooting control devices, when it is determined that the subject area corresponding to the subject in the image is unclear and the area outside the subject area is clear, the image determination unit detects whether there is a halo in the subject area, and based on the detection of the halo, the shooting instruction unit instructs the shooting device to shoot the image again.

[0009] In any of the above-mentioned imaging control devices, when the halo is detected, the imaging instruction unit may instruct the imaging device to change at least one of a position and an orientation of the imaging device and to capture the image again.

[0010] The shooting control device may include a shooting condition determination unit. When at least a part of the information from the subject cannot be obtained using the image, the shooting condition determination unit determines whether the shooting conditions are appropriate. When it is determined that the shooting conditions are not appropriate, the shooting instruction unit instructs the shooting device to change the shooting conditions and shoot the image again.

[0011] In any of the above-mentioned shooting control devices, the image acquisition unit may acquire the image of the instrument of the equipment in the factory as the subject, and when the information represented by the instrument is obtained from the image, the shooting instruction unit may not instruct to shoot the image again.

[0012] In a second embodiment of the present invention, a shooting control method is provided, which includes: obtaining an image shot in a factory; obtaining environmental information in the factory; determining whether the shot image is clear; and if it is determined that the image is not clear, instructing a shooting device to shoot the image again based on an unclear area in the image and at least one of the environmental information.

[0013] In a third embodiment of the present invention, a storage medium is provided, in which a shooting control program is stored. A computer functions as an image acquisition unit, an environmental information acquisition unit, an image determination unit, and a shooting instruction unit by executing the shooting control program. The image acquisition unit acquires an image shot in a factory, the environmental information acquisition unit acquires environmental information in the factory, and the image determination unit determines whether the shot image is clear. If it is determined that the image is not clear, the shooting instruction unit instructs the shooting device to shoot the image again based on the unclear area in the image and at least one of the environmental information.

[0014] In addition, the above summary of the invention does not list all the features of the present invention. In addition, sub-combinations of these feature groups may also constitute inventions. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 The configuration of the imaging control device 10 according to this embodiment is shown together with the imaging device 20 , the sensor 30 , and the database 40 . Figure 2 The following shows the processing flow of the imaging control device 10 according to this embodiment. Figure 3 The following shows the processing flow of the imaging control device 10 according to this embodiment. Figure 4 The following shows the processing flow of the imaging control device 10 according to this embodiment. Figure 5 An example of image data 400 captured by the imaging device 20 of this embodiment is shown. Figure 6 An example of a computer 2200 is shown that can implement various aspects of the present invention in whole or in part. DETAILED DESCRIPTION

[0016] The present invention will be described below by way of embodiments of the invention, but the following embodiments do not limit the invention as defined in the claims. Furthermore, not all combinations of features described in the embodiments are essential to the solution provided by the invention.

[0017] Figure 1 The following figure shows the configuration of the imaging control device 10 of this embodiment, along with the imaging device 20, sensor 30, and database 40. The imaging control device 10 detects abnormalities in images captured within a facility such as a factory and, if an abnormality occurs, controls imaging to obtain normal images. Factories where the imaging control device 10 is installed include, in addition to chemical and other industrial plants, plants that manage and control wellheads and their surrounding areas, such as gas and oil fields; plants that manage and control hydropower, thermal power, and nuclear power generation; plants that manage and control environmental power generation, such as solar power or wind power; and plants that manage and control water supply and drainage systems, dams, and the like. The imaging control device 10 is communicatively connected to each of one or more imaging devices 20 and one or more sensors 30. The imaging control device 10 can connect to each of the imaging devices 20 and sensors 30 via a wireless network, such as a mobile phone network, wireless WAN, wireless LAN, or Bluetooth (registered trademark), or via a wired network, such as Ethernet (registered trademark).

[0018] The imaging control device 10 can be a computer such as a personal computer (PC), tablet computer, smartphone, workstation, server computer, or general-purpose computer, or a computer system comprising multiple connected computers. Such a computer system is also a computer in a broad sense. Furthermore, the imaging control device 10 can be implemented as a virtual computer environment in which one or more programs can be executed within a computer. Alternatively, the imaging control device 10 can be a dedicated computer designed for imaging control of each imaging device 20, or it can be dedicated hardware implemented using dedicated circuitry.

[0019] The imaging control device 10 can be installed within the facility. Alternatively, the imaging control device 10 can be installed outside the facility or in another facility via a cloud computing system on the Internet. The imaging control device 10 includes a database connection unit 100, an image acquisition unit 110, an imaging condition acquisition unit 120, an environmental information acquisition unit 130, an image information detection unit 140, an image determination unit 160, an imaging condition determination unit 170, and an imaging instruction unit 180. The database connection unit 100 is connected to the database 40. The database connection unit 100 handles access to the database 40 from various components within the imaging control device 10.

[0020] The image acquisition unit 110 is connected to the database connection unit 100. The image acquisition unit 110 is connected to the imaging device 20 via a network or the like. The image acquisition unit 110 acquires images captured within the facility. The image acquisition unit 110 can acquire images captured within the facility by receiving image data captured and transmitted by the imaging device 20.

[0021] The shooting condition acquisition unit 120 is connected to the database connection unit 100. The shooting condition acquisition unit 120 is connected to the imaging device 20 via a network or the like. The shooting condition acquisition unit 120 acquires shooting conditions for images captured within the facility. The shooting condition acquisition unit 120 can acquire at least one of exposure value, ISO value, shutter speed, and aperture value as a shooting condition. The shooting condition acquisition unit 120 can acquire shooting conditions for images captured within the facility by receiving shooting condition data transmitted by the imaging device 20. If the image data transmitted by the imaging device 20 includes shooting condition data, the image acquisition unit 110 can also function as the shooting condition acquisition unit 120.

[0022] Environmental information acquisition unit 130 is connected to database connection unit 100. Environmental information acquisition unit 130 is connected to sensor 30 via a network or the like. Environmental information acquisition unit 130 acquires environmental information within the facility. Environmental information acquisition unit 130 may acquire at least one of the following as environmental information within the facility: temperature, humidity, and illuminance. Environmental information acquisition unit 130 may acquire environmental information within the facility by receiving environmental information measured and transmitted by sensor 30.

[0023] The intra-image information detection unit 140 is connected to the database connection unit 100 and the image acquisition unit 110 . The intra-image information detection unit 140 detects information included in the image acquired by the image acquisition unit 110 .

[0024] The image determination unit 160 is connected to the database connection unit 100 and the intra-image information detection unit 140. If the intra-image information detection unit 140 fails to detect information included in the image, the image determination unit 160 determines whether the image is clear based on the normal image stored in the database 40 and identifies unclear areas in the image.

[0025] The imaging condition determination unit 170 is connected to the database connection unit 100, the imaging condition acquisition unit 120, and the intra-image information detection unit 140. If the intra-image information detection unit 140 fails to detect information included in the image, the imaging condition determination unit 170 determines whether the imaging conditions received from the imaging condition acquisition unit 120 are appropriate based on the normal imaging conditions stored in the database 40.

[0026] The shooting instruction unit 180 is connected to the database connection unit 100, the environmental information acquisition unit 130, the image determination unit 160, and the shooting condition determination unit 170. The shooting instruction unit 180 is connected to the camera 20 via a network or the like. The shooting instruction unit 180 can instruct the camera 20 to retake an image based on at least one of the environmental information acquired by the environmental information acquisition unit 130, the determination result of the image determination unit 160, and the determination result of the shooting condition determination unit 170. Here, "retake an image" means capturing the same subject as the image acquired by the image acquisition unit 110. If an image is determined to be unclear, the shooting instruction unit 180 can instruct the camera 20 to retake the image based on at least one of the unclear area in the image and the environmental information. If the subject area corresponding to the subject in the image is determined to be unclear while areas other than the subject area are clear, or if the entire image is determined to be unclear, the shooting instruction unit 180 can instruct the camera 20 to retake the image with at least a different portion. Here, the subject area refers to the area occupied by the subject in the acquired image. If the entire image is determined to be unclear, the shooting instruction unit 180 can instruct the imaging device 20 to retake the image with a different image quality at least in part, based on whether the environmental information is within a normal range. The shooting instruction unit 180 can instruct the imaging device 20 to retake the image with a different image quality, such as whether the shooting conditions need to be changed or whether a waiting time is required, based on whether the environmental information is within a normal range.

[0027] One or more cameras 20 are used to capture images within the facility. The camera 20 may be a robot equipped with a camera or other imaging capabilities, and may be equipped with actuators for movement within the facility. The camera 20 may roam within the facility along a predetermined path. Alternatively, the camera 20 may be stationary within the facility. In this case, the camera 20 may be capable of changing the direction of its capture.

[0028] One or more sensors 30 measure the conditions within the facility. Sensors 30 may measure at least one of temperature, humidity, and illumination. Sensors 30 may be included in camera 20. Alternatively, sensors 30 may be fixed at the same or different locations within the facility.

[0029] The database 40 stores captured images, shooting conditions, environmental information within the facility, and schedule information for the camera 20 and sensor 30. The database 40 can be implemented using at least a portion of the storage area of ​​an external storage device such as a hard disk drive connected to the camera control device 10. For example, the database 40 can also be implemented using a storage device external to the camera control device 10 provided by a cloud storage service or the like.

[0030] Figure 2 、 Figure 3 and Figure 4 1 shows the processing flow of the shooting control device 10 of this embodiment. Figure 2 、 Figure 3 and Figure 4 The processing flow of FIG. 1 shows a case where the photographing control device 10 controls the photographing of one photographing device 20. The photographing control device 10 can execute the process of controlling each of the plurality of photographing devices 20. Figure 2 、 Figure 3 and Figure 4 processing flow.

[0031] In step 200 (S200), the shooting control device 10 instructs the shooting device 20 to move and shoot. Here, the shooting control device 10 can refer to the schedule information recorded in the database 40 corresponding to the shooting device 20 of the processing object, and obtain the schedule for the shooting device 20 of the processing object to patrol within the facility. The schedule may include the location of each shooting location where the shooting device 20 should shoot within the facility, the time when it should arrive at each shooting location, the moving path between the shooting locations, or the shooting direction of each shooting location, etc., which are required to determine the action of the shooting device 20. The shooting control device 10 moves the shooting device 20 to the next shooting location as specified in the schedule, and provides the shooting device 20 with an instruction to shoot at the next shooting location. In response, the shooting device 20 moves to the next shooting location. In the case where the shooting device 20 is fixed in the facility, the shooting control device 10 can simply instruct the shooting device 20 to shoot.

[0032] In S210 , the imaging device 20 captures the interior of the facility and generates image data. The imaging device 20 may capture instruments of equipment within the factory as subjects. The imaging device 20 transmits the captured image data to the imaging control device 10 .

[0033] In S220, the image acquisition unit 110 acquires an image captured within the facility from the imaging device 20. The image acquisition unit 110 can acquire an image of instruments of equipment within the factory as the subject. The image acquisition unit 110 can acquire an image of facilities or equipment within the factory as the subject, and can acquire an image of the surrounding area of ​​facilities or equipment within the factory as the subject. The imaging condition acquisition unit 120 can acquire imaging conditions from the imaging device 20. The environmental information acquisition unit 130 can also acquire environmental information within the facility from the sensor 30. The image acquisition unit 110, the imaging condition acquisition unit 120, and the environmental information acquisition unit 130 can record the acquired information, etc. in the database 40.

[0034] In S230, the in-image information detection unit 140 detects information within the image acquired by the image acquisition unit 110. If the subject is an instrument, the in-image information detection unit 140 can detect the information displayed by the instrument. If the instrument displays numerical values ​​or characters, the in-image information detection unit 140 can detect the numerical values, characters, and other character information displayed by the instrument through character recognition. If the instrument is an analog instrument that displays values ​​based on the position of a needle, boundary surface, or the like relative to a scale, the in-image information detection unit 140 can detect the numerical value represented by the needle or boundary surface based on the positional relationship between the needle or boundary surface and the scale. If the instrument displays information based on changes in color tone, such as a meter that displays a richer red as pressure increases, the in-image information detection unit 140 can detect the information represented by the instrument by digitizing the change in color tone. If the subject is a facility or equipment within a factory, or its surroundings, the in-image information detection unit 140 can detect the location and outline of the facility or equipment within the image.

[0035] If the intra-image information detection unit 140 is able to detect information within the image ("YES" in S240), the intra-image information detection unit 140 may record the detected information in the database 40. The imaging control device 10 terminates the processing flow. Therefore, if the subject is an instrument and the information represented by the instrument is obtained from the image, the imaging instruction unit 180 may not instruct to re-capture the image.

[0036] If the in-image information detection unit 140 fails to detect at least a portion of the information within the image (No in S240), the imaging control device 10 advances the process to S300. For example, if the in-image information detection unit 140 fails to detect information represented by at least a portion of an instrument serving as the subject, or if the in-image information detection unit 140 fails to detect at least a portion of the subject's outline, the imaging control device 10 advances the process to S300. In S300, if at least a portion of the information from the subject cannot be obtained using the image, the imaging condition determination unit 170 determines whether the imaging conditions are appropriate. If the in-image information detection unit 140 fails to obtain at least a portion of the information from the subject using the image, the imaging condition determination unit 170 may instruct the imaging condition acquisition unit 120 to acquire the imaging conditions, or may read the imaging conditions previously acquired by the imaging condition acquisition unit 120 in S220 from the database 40. The shooting condition determination unit 170 can determine whether the shooting conditions are appropriate based on a comparison between the shooting conditions acquired by the shooting condition acquisition unit 120 (including the shooting conditions previously acquired and stored in the database 40 by the shooting condition acquisition unit 120 in S220) and the shooting conditions stored in the database 40. The shooting condition determination unit 170 can use a predetermined baseline shooting condition for the same subject, or can use the conditions for a previously captured image of the same subject in which the intra-image information detection unit 140 was able to detect information, as the shooting conditions stored in the database 40. The shooting condition determination unit 170 can compare the acquired values ​​for each of the parameters, including the exposure value, ISO value, shutter speed, and aperture value, with the values ​​stored in the database 40, and determine that the shooting conditions are inappropriate if even one parameter has a value difference exceeding a predetermined threshold.

[0037] If the shooting conditions are not appropriate ("Yes" in S302), the shooting control device 10 advances the processing to S304. If it is determined that the shooting conditions are not appropriate, in S304, the shooting instruction unit 180 instructs the shooting device 20 to change the shooting conditions and shoot the image again. The shooting instruction unit 180 can instruct the shooting device 20 to change the shooting conditions to the predetermined benchmark shooting conditions for the same subject stored in the database 40, or the conditions stored in the database 40 when shooting an image of the same subject that was shot in the past and the image information detection unit 140 can detect information. In S210 returned from S304, the shooting device 20 shoots again based on the changed shooting conditions. Thereby, the shooting control device 10 can obtain an image for which the image information detection unit 140 can detect information.

[0038] When the shooting conditions are appropriate ("No" in S302), the shooting control device 10 advances the processing to S306. In S306, the shooting instruction unit 180 determines whether the shot image is out of focus. The shooting instruction unit 180 can determine whether the shot image is out of focus based on edge detection. The shooting instruction unit 180 can perform edge detection on the periphery of the subject in the shot image, and determine that the shot image is out of focus when the amount of change in the brightness value in the detected range, the score representing the amount of edge, etc. are lower than a predetermined threshold. Here, the shooting instruction unit 180 can determine the object captured in the area including the in-focus position in the shot image as the subject in the shot image. When data related to the image or shape of the subject is pre-stored in the database 40, the shooting instruction unit 180 can also determine an object whose degree of consistency with the image or shape of the subject stored in the database 40 is above a threshold as the subject in the shot image.

[0039] When the captured image is out of focus ("Yes" in S308), the shooting control device 10 advances the processing to S310. In S310, the shooting instruction unit 180 instructs the shooting device 20 to reset the focus and shoot the image again. The shooting instruction unit 180 can instruct the shooting device 20 to move to a shooting location where objects other than the subject are not located at the pixel position for focusing in the image and shoot again so that the focus is on the subject. When the automatic focus function of the shooting device 20 is turned off, the shooting instruction unit 180 can also instruct the shooting device 20 to turn on the automatic focus function and shoot again. Thereby, the shooting control device 10 can prevent defocus from occurring in the image shot again. In S210 returned from S310, the shooting device 20 shoots again.

[0040] When the captured image is not out of focus ("No" in S308), the shooting control device 10 advances the processing to S314. In S314, the image determination unit 160 determines whether the captured image is clear. The image determination unit 160 can determine whether the captured image is clear based on a comparison between the captured image and past images of the same subject stored in the database 40. Here, the image determination unit 160 can use an image in which the information in the image detection unit 140 can detect information as a past image of the same subject. The image determination unit 160 can compare the captured image with past images of the same subject, and when there is a different area, determine that the captured image is not clear, and determine the area as an unclear area.

[0041] When the unclear area determined by the image determination unit 160 is only the subject area ("Yes" in S316), the shooting control device 10 advances the processing to S318. When it is determined that the subject area corresponding to the subject in the image is unclear and the area outside the subject area is clear, in S318, the image determination unit 160 detects whether there is a halo in the subject area. Here, halo can mean that the image is whitish or blurred due to strong light. Halo is likely to occur when the reflectivity of the light on the surface of the subject is high, such as when the instrument is covered by a cover such as glass. When the area of ​​the region in the subject area of ​​the captured image whose brightness exceeds a predetermined threshold exceeds a certain value, the image determination unit 160 can determine that there is a halo in the captured image.

[0042] When halo exists in the captured image ("Yes" in S318), the shooting control device 10 advances the processing to S320. In S320, when halo is detected, the shooting instruction unit 180 instructs the shooting device 20 to shoot the image again. When halo is detected, the shooting instruction unit 180 may instruct the shooting device 20 to change at least one of the position and orientation of the shooting device 20 and shoot the image again. The shooting instruction unit 180 may instruct the shooting device 20 to shoot the image again after performing at least one of moving to a different shooting location and changing the orientation of the camera. The shooting instruction unit 180 may instruct the shooting device 20 to change at least one of the position and orientation of the shooting device 20 so that the light that causes the halo is not included in the image. Thereby, the shooting control device 10 can prevent halo from occurring in the re-shot image. In S210 returning from S320, the shooting device 20 shoots again.

[0043] If the unclear area determined by the image determination unit 160 is not only the subject area but also the entire image (No in S316), the imaging control device 10 advances the process to S322. In S322, the environmental information acquisition unit 130 acquires environmental information within the facility from the sensor 30. Alternatively, the environmental information acquisition unit 130 may have already acquired environmental information in S220 or the like. The environmental information acquisition unit 130 may acquire environmental information from one or more sensors 30 located within the facility that has the shortest straight-line distance to the location or subject captured by the imaging device 20. If the imaging device 20 includes a sensor 30, the environmental information acquisition unit 130 may also acquire environmental information from the sensor 30 included in the imaging device 20 that captured the image. The environmental information acquisition unit 130 may also acquire environmental information from one or more sensors 30 located within the facility that is located in the same room as the location captured by the imaging device 20. The environmental information acquisition unit 130 may store the acquired environmental information in the database 40.

[0044] The shooting instruction unit 180 determines whether the environmental information obtained by the environmental information acquisition unit 130 is within a normal range. The shooting instruction unit 180 can determine whether the environmental information obtained by the environmental information acquisition unit 130 is within a normal range by comparing the environmental information obtained by the environmental information acquisition unit 130 with the environmental information stored in the database 40. The shooting instruction unit 180 may use predetermined baseline environmental information for the same subject, or may use environmental information from a previous image of the same subject that was captured and for which the in-image information detection unit 140 was able to detect information, as the environmental information stored in the database 40. If the sensor 30 is provided in the imaging device 20, the shooting instruction unit 180 may also use past environmental information obtained from the sensor 30 included in the imaging device 20 that performed the image capture as the environmental information stored in the database 40. The shooting instruction unit 180 may also use environmental information from a past location obtained from a sensor 30 located near the location where the imaging device 20 was located before the image capture as the environmental information stored in the database 40. The shooting indication unit 180 can compare the values ​​obtained by the environmental information acquisition unit 130 with the values ​​stored in the database 40 for the temperature, humidity and illumination parameters within the facility. Even if there is only one parameter whose numerical difference exceeds a predetermined threshold, it is determined that the parameter is abnormal and the environmental information is within the abnormal range.

[0045] If the temperature or humidity within a facility obtained by the environmental information acquisition unit 130 is higher than the temperature or humidity at the camera device 20's past location, and the difference between these values ​​is greater than a threshold, the camera lens of the camera device 20 may blur, causing the entire image captured by the camera device 20 to become unclear. If the humidity within a facility obtained by the environmental information acquisition unit 130 is higher than the past humidity or baseline humidity at the same location, and the difference between these values ​​is greater than a threshold, fog or mist may form within the facility, causing the entire image captured by the camera device 20 to become unclear. If the difference between the illuminance within a facility obtained by the environmental information acquisition unit 130 and the past illuminance or baseline value at the same location exceeds a threshold, the entire image captured by the camera device 20 may become unclear if appropriate shooting conditions are used for the past illuminance or baseline value. The shooting instruction unit 180 can compare the values ​​obtained by the environmental information acquisition unit 130 with the values ​​stored in the database 40 for each of the temperature, humidity, and illuminance parameters within the facility. If no parameters have a numerical difference exceeding a predetermined threshold, the environmental information is determined to be within a normal range.

[0046] When the environmental information is within the abnormal range ("Yes" in S324), the shooting control device 10 advances the processing to S330. When the illumination in the environmental information is abnormal ("Yes" in S330), the shooting control device 10 advances the processing to S332. In S332, the shooting instruction unit 180 instructs the shooting device 20 to change the shooting conditions in accordance with the illumination and shoot the image again. When the illumination is lower than the reference value or the past illumination, the shooting instruction unit 180 can instruct the shooting device 20 to further increase the ISO sensitivity and shoot again, further slow down the shutter speed and shoot again, and further reduce the aperture value and shoot again. In S210 returned from S332, the shooting device 20 shoots again based on the changed shooting conditions. As a result, the shooting control device 10 can obtain a clearer image.

[0047] If the environmental information is abnormal except for the illuminance (No in S330 ), the imaging control device 10 advances the process to S336 . In S336 , the imaging instruction unit 180 stores the environmental information acquired by the environmental information acquisition unit 130 in the database 40 as an abnormal value.

[0048] In S338, if it is determined that the entire image is unclear and the environmental information is within an abnormal range, the shooting instruction unit 180 instructs the camera 20 to shoot again after a predetermined standby time has elapsed. The shooting instruction unit 180 may instruct the camera 20 to wait without moving until the predetermined time has elapsed before shooting again. The shooting instruction unit 180 may obtain information related to the predetermined standby time from the database 40. In S210, which returns from S338, the camera 20 shoots again based on the changed shooting conditions. Thus, if the unclear image is caused by camera lens blur due to a sudden change in temperature or humidity, the shooting control device 10 can obtain a clear image captured after the standby time has elapsed and the camera lens blur has been eliminated. Furthermore, if the unclear image is caused by fog or haze, such as a sudden increase in humidity at the shooting location, the shooting control device 10 can obtain a clear image captured after the standby time has elapsed and the fog or haze has been eliminated.

[0049] When there is no halo in the captured image ("No" of S318) and when the environmental information is within the normal range ("No" of S324), the shooting control device 10 advances the processing to S340. When it is determined that the image as a whole is not clear and the environmental information is within the normal range, the shooting instruction unit 180 instructs the shooting device 20 to shoot again before the standby time elapses, or does not instruct to shoot again. When the shooting instruction unit 180 instructs to shoot again ("Yes" of S340), the shooting control device 10 advances the processing to S342. In S342, the shooting instruction unit 180 instructs the shooting device 20 to shoot again before the standby time elapses. In S210 returned from S342, the shooting device 20 shoots again. When the shooting instruction unit 180 does not instruct to shoot again ("No" of S340), the shooting instruction unit 180 may instruct the shooting device 20 to move to a predetermined starting position. If the image is determined to be overall unclear, the environmental information is within the normal range, and the imaging conditions are appropriate, the imaging device 20 may have experienced an abnormality. Therefore, by moving the imaging device 20 to its home position, a diagnosis by a manager or the like can be facilitated. The imaging instruction unit 180 can also notify the facility manager of the abnormality. The imaging control device 10 terminates the processing flow.

[0050] According to the shooting control device 10 shown above, when the information detection unit 140 in the image fails to detect the information in the captured image, the cause can be determined and eliminated and the shooting device 20 can be instructed to shoot again. Therefore, the image in which the information can be detected can be automatically shot again, thereby reducing the burden on the operator.

[0051] Figure 5 FIG. 4 shows an example of image data 400 captured by the image capturing device 20 of this embodiment. The image capturing device 20 transmits the image data 400 to the image capturing control device 10 ( Figure 2 (S220 of FIG. 4 ) In image data 400, piping 410 and meter 420 are captured. Meter 420 includes a numerical display area 425. In the example shown in this figure, a numerical value such as "1000" is displayed in numerical display area 425. When the in-image information detection unit 140 detects the numerical value indicated by the meter, numerical display area 425 becomes the subject area in image data 400.

[0052] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where a module may represent (1) a stage of a process for performing an operation or (2) a portion of a device having the function of performing an operation. Specific stages and portions may be implemented by dedicated circuits, programmable circuits supplied with computer-readable instructions stored on a computer-readable medium, and / or processors supplied with computer-readable instructions stored on a computer-readable medium. Dedicated circuits may include digital and / or analog hardware circuits, and may also include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits that include logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and other memory elements.

[0053] A computer-readable medium may include any tangible device capable of storing instructions for execution by an appropriate device. Consequently, a computer-readable medium having instructions stored therein includes an article containing instructions that can be executed to produce a means for performing the operations specified by the flowchart or block diagram. Examples of computer-readable media include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable media include floppy disks, magnetic disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disks (DVD), Blu-ray (registered trademark) disks, memory sticks, integrated circuit cards, and the like.

[0054] Computer-readable instructions include any of source code and object code described by any combination of one or more programming languages ​​including assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or object-oriented programming languages ​​such as Smalltalk (registered trademark), JAVA (registered trademark), C++, and existing procedural programming languages ​​such as the "C" programming language or similar programming languages.

[0055] The computer-readable instructions may be provided to a processor or programmable circuit of a programmable data processing device such as a general-purpose computer, a special-purpose computer, or other computer via a local area network (LAN) or a wide area network (WAN) such as the Internet, and the computer-readable instructions may be executed to create a means for performing the operations specified by the flowchart or block diagram. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

[0056] Figure 6 This figure illustrates an example of a computer 2200 capable of implementing various aspects of the present invention in whole or in part. Programs installed on computer 2200 enable computer 2200 to perform operations associated with devices according to embodiments of the present invention or functions of one or more components of such devices, or to execute such operations or such one or more components, and / or enable computer 2200 to perform processes according to embodiments of the present invention or stages of such processes. Such programs can be executed by CPU 2212 to cause computer 2200 to perform specific operations associated with some or all of the modules in the flowcharts and block diagrams described in this specification.

[0057] The computer 2200 of this embodiment includes a CPU 2212, a RAM 2214, a graphics controller 2216, and a display device 2218, which are interconnected via a main controller 2210. The computer 2200 also includes input / output units such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card drive, which are connected to the main controller 2210 via an input / output controller 2220. The computer also includes conventional input / output units such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.

[0058] The CPU 2212 controls each unit by operating according to programs stored in the ROM 2230 and the RAM 2214. The graphics controller 2216 acquires image data generated by the CPU 2212 from a frame buffer or the like provided in the RAM 2214 or from the graphics controller itself, and displays the image data on the display device 2218.

[0059] The communication interface 2222 is capable of communicating with other electronic devices via a network. The hard disk drive 2224 stores programs and data used by the CPU 2212 in the computer 2200. The DVD-ROM drive 2226 reads programs or data from the DVD-ROM 2201 and provides the programs or data to the hard disk drive 2224 via the RAM 2214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0060] The ROM 2230 stores therein a boot program or the like executed by the computer 2200 upon activation and / or programs that depend on the hardware of the computer 2200. The input / output chip 2240 may also connect various input / output units to the input / output controller 2220 via a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0061] The program is provided on a computer-readable medium such as a DVD-ROM 2201 or an IC card. The program is read from the computer-readable medium, installed in the hard disk drive 2224, RAM 2214, or ROM 2230, also examples of computer-readable media, and executed by the CPU 2212. The information processing described in these programs is read into the computer 2200, thereby enabling the program to cooperate with the various types of hardware resources described above. An apparatus or method can be constructed by implementing information manipulation or processing with the use of the computer 2200.

[0062] For example, when communication is performed between the computer 2200 and an external device, the CPU 2212 can execute a communication program loaded in the RAM 2214 and instruct the communication interface 2222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 2212, the communication interface 2222 reads transmission data stored in a transmission buffer area provided in a recording medium such as the RAM 2214, the hard disk drive 2224, the DVD-ROM 2201, or an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area provided on the recording medium.

[0063] Furthermore, the CPU 2212 can read all or a necessary portion of a file or database stored in an external recording medium such as the hard disk drive 2224, the DVD-ROM drive 2226 (DVD-ROM 2201), or an IC card into the RAM 2214, and perform various types of processing on the data in the RAM 2214. The CPU 2212 then writes the processed data back to the external recording medium.

[0064] Various types of information such as various types of programs, data, tables, and databases can be stored in a recording medium and subjected to information processing. The CPU 2212 performs various types of processing described in various places of this disclosure on the data read from the RAM 2214 and writes the results back to the RAM 2214. The various types of processing include various types of operations specified by the instruction sequence of the program, information processing, conditional judgment, conditional branching, unconditional branching, information retrieval / replacement, etc. In addition, the CPU 2212 can retrieve information in files, databases, etc. in the recording medium. For example, in the case where a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 2212 can retrieve an entry that is consistent with the condition specifying the attribute value of the first attribute from the plurality of entries, and read the attribute value of the second attribute stored in the entry, thereby obtaining the attribute value of the second attribute associated with the first attribute that meets the predetermined condition.

[0065] The programs or software modules described above can be stored in a computer-readable medium on or near the computer 2200. In addition, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as the computer-readable medium, thereby providing the program to the computer 2200 via the network.

[0066] While the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. As can be seen from the claims, embodiments with such modifications or improvements are also included in the technical scope of the present invention.

[0067] The order of execution of actions, processes, steps, and stages, etc., in the apparatus, system, program, and method described in the claims, specifications, and drawings is not specifically indicated as "before," "before," or the like. Furthermore, it should be noted that the actions, processes, steps, and stages may be executed in any order as long as the output of the previous process is not used in the subsequent process. Even if the action flow in the claims, specifications, and drawings is described using the phrases "first," "next," or the like for ease of explanation, it does not necessarily mean that the actions must be executed in that order. Description of Reference Numerals

[0068] 10 Shooting control device, 20 Shooting device, 30 Sensor, 40 Database, 100 Database connection unit, 110 Image acquisition unit, 120 Shooting condition acquisition unit, 130 Environmental information acquisition unit, 140 Image information detection unit, 160 Image determination unit, 170 Shooting condition determination unit, 180 Shooting instruction unit, 400 Image data, 410 Piping, 420 Instrument, 425 Numerical display area, 2200 Computer, 2201 DVD-ROM, 2210 Main controller, 2212 CPU, 2214 RAM, 2216 Graphics controller, 2218 Display device, 2220 Input / output controller, 2222 Communication interface, 2224 Hard disk drive, 2226 DVD-ROM drive, 2230 ROM, 2240 Input / output chip, 2242 Keyboard.

Claims

1. A shooting control device, characterized in that have: an image acquisition unit, acquiring images taken in the factory; an environmental information acquisition unit, which acquires environmental information within the factory; An image determination unit, configured to determine whether the captured image is clear; as well as The photographing instruction unit instructs the photographing device to photograph the image again based on at least one of an unclear area in the image and the environmental information when it is determined that the image is unclear.

2. The shooting control device according to claim 1, wherein: When it is determined that the subject area corresponding to the subject in the image is unclear and the area other than the subject area is clear, or when it is determined that the entire image is unclear, the shooting instruction unit instructs the shooting device to shoot again with at least a different part.

3. The shooting control device according to claim 2, wherein: When it is determined that the entire image is unclear, the imaging instruction unit instructs the imaging device to re-shoot the image with at least a different portion based on whether the environmental information is within a normal range.

4. The shooting control device according to claim 3, wherein: When it is determined that the entire image is not clear and the environmental information is within an abnormal range, the imaging instruction unit instructs the imaging device to perform imaging again after a predetermined waiting time has elapsed.

5. The shooting control device according to claim 4, wherein: When it is determined that the entire image is not clear and the environmental information is within a normal range, the imaging instruction unit instructs the imaging device to re-shoot before the waiting time elapses, or does not instruct re-shooting.

6. The shooting control device according to claim 2, wherein: When it is determined that a subject area corresponding to the subject in the image is unclear and an area other than the subject area is clear, the image determination unit detects whether halation exists in the subject area. When the halo is detected, the imaging instruction unit instructs the imaging device to capture the image again.

7. The shooting control device according to claim 6, wherein: When the halo is detected, the imaging instruction unit instructs the imaging device to change at least one of a position and a direction of the imaging device and to capture the image again.

8. The shooting control device according to claim 1, wherein: The imaging control device includes an imaging condition determination unit configured to determine whether imaging conditions are appropriate when at least a portion of information from the subject cannot be obtained using the image. When it is determined that the imaging condition is not appropriate, the imaging instruction unit instructs the imaging device to change the imaging condition and capture the image again.

9. The shooting control device according to any one of claims 1 to 7, characterized in that: The image acquisition unit acquires the image of an instrument of equipment in the factory as a subject, When the information indicated by the meter is obtained from the image, the imaging instruction unit does not instruct to re-image the image.

10. A shooting control method, characterized in that include: Obtain images taken inside the factory; obtaining environmental information within the factory; Determining whether the captured image is clear; as well as If it is determined that the image is not clear, the photographing device is instructed to retake the image based on at least one of an unclear area in the image and the environmental information.

11. A storage medium, characterized in that: The computer stores a photographing control program, and the computer functions as an image acquisition unit, an environmental information acquisition unit, an image determination unit, and a photographing instruction unit by executing the photographing control program. The image acquisition unit acquires images taken in the factory, The environmental information acquisition unit acquires environmental information within the factory, The image determination unit determines whether the captured image is clear. When it is determined that the image is unclear, the imaging instruction unit instructs the imaging device to re-photograph the image based on at least one of an unclear area in the image and the environmental information.

Images