State estimation system

Abstract

This system provides a condition estimation system that can prevent malfunctions in outdoor lighting equipment. [Solution] The state estimation system 1 is a state estimation system 1 for estimating the state of an outdoor lighting device 5, and comprises an acquisition unit 11 that acquires an image of the outdoor lighting device 5 and location information indicating the location where the image was taken, an image analysis unit 12 that analyzes the appearance of at least a part of the outdoor lighting device 5 included in the image acquired by the acquisition unit 11, estimates the state of the photographed outdoor lighting device 5, and estimates the abnormality level of the outdoor lighting device 5 based on the estimated state of the outdoor lighting device 5, and a storage unit 13. The image analysis unit 12 stores at least the location information and the abnormality level in the storage unit 13, and the abnormality level is an index that indicates whether or not the outdoor lighting device 5 needs repair, whether or not it needs to be replaced, the timing of the repair if it does need to be repaired, and the timing of the replacement if it does need to be replaced.

Description

Technical Field

[0004] ,

[0006] , , , , , ,

[0005] , , ,

[0003] , , , ,

[0001] The present disclosure relates to a state estimation system.

Background Art

[0002] Patent Document 1 discloses a reporting management device that manages reports related to equipment failures. The reporting management device includes a reporting collection unit that collects reports related to equipment failures, a main organization determination unit that determines the main organization of the equipment from the content of the reports, and an output unit that outputs report information related to the reports and the determination result of the main organization.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the reporting management device of Patent Document 1 merely outputs report information and the determination result of the main organization, and there is a problem that it is insufficient to prevent failures of an outdoor lighting device, which is an example of equipment.

[0005] ​​​​​​​​A state estimation system according to one aspect of the present disclosure is a state estimation system for estimating the state of an outdoor lighting device, comprising: an acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken; an image analysis unit that analyzes the appearance of at least a part of the outdoor lighting device included in the image acquired by the acquisition unit, estimates the state of the photographed outdoor lighting device, and estimates an abnormality level of the outdoor lighting device based on the estimated state of the outdoor lighting device; and a storage unit, wherein the image analysis unit stores at least the location information and the abnormality level in the storage unit, and the abnormality level is an index indicating one of the following: whether or not the outdoor lighting device needs repair, whether or not it needs to be replaced, the timing of the repair if it does need to be repaired, and the timing of the replacement if it does need to be replaced.

[0007] A state estimation system according to one aspect of the present disclosure is a state estimation system for estimating the state of an outdoor lighting device, comprising: an acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken; and an image analysis unit that analyzes the appearance of at least a part of the outdoor lighting device included in the image acquired by the acquisition unit and estimates the state of the photographed outdoor lighting device, wherein the image analysis unit causes a display unit to display a map showing at least the location information and information regarding the state of the outdoor lighting device. [Effects of the Invention]

[0008] According to the state estimation system disclosed herein, malfunctions in equipment such as outdoor lighting devices can be prevented. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a block diagram showing a state estimation system according to an embodiment. [Figure 2] Figure 2 is a schematic diagram showing how outdoor lighting equipment is photographed. [Figure 3] Figure 3 is a schematic diagram illustrating image recognition, the accumulation of recognition results, and the process of a human diagnosing the actual object. [Figure 4]Figure 4 shows a diagram illustrating the number, location information, and abnormality levels of outdoor lighting devices in a designated area, a map with icons indicating location information and abnormality levels, and detailed information indicated by the icons. [Figure 5] Figure 5 is a flowchart showing the processing operation of the state estimation system. [Figure 6] Figure 6 is a flowchart showing the processing operation of the image analysis algorithm. [Figure 7] Figure 7 is a block diagram showing a state estimation system related to other modified examples. [Modes for carrying out the invention]

[0010] The embodiments of this disclosure will be described below with reference to the drawings. The embodiments described below are all specific examples of this disclosure. Therefore, the numerical values, shapes, materials, components, arrangement and connection configurations of components, as well as the steps and order of steps shown in the following embodiments, are examples only and are not intended to limit this disclosure.

[0011] Each figure is a schematic diagram and is not necessarily a strictly accurate representation. Therefore, for example, the scale may not necessarily be consistent across all figures. Also, the same reference numerals are used for substantially identical components in each figure, and redundant explanations are omitted or simplified.

[0012] (Embodiment) <Overview> Outdoor lighting fixtures are installed in outdoor areas such as roads and parks. These fixtures gradually deteriorate and malfunction due to prolonged exposure to wind and rain. While these fixtures are managed by designated organizations such as factories, facilities, private companies, and government agencies, the large number of fixtures makes it difficult to constantly monitor their condition. Therefore, understanding the condition of these fixtures is essential for their management. To address this, users photograph the outdoor lighting fixtures using terminal devices such as smartphones, tablets, or cameras, and transmit the images from these devices to a condition estimation system. The condition estimation system then acquires the images from the terminal devices and determines the condition of the outdoor lighting fixtures based on the acquired images. In this scenario, the user is a citizen photographing the outdoor lighting fixtures.

[0013] <Configuration and Function> The state estimation system 1 according to the following embodiment will be explained with reference to Figures 1 to 4.

[0014] Figure 1 is a block diagram showing a state estimation system 1 according to an embodiment. Figure 2 is a schematic diagram showing the process of photographing an outdoor lighting device 5. Figure 3 is a schematic diagram showing image judgment, accumulation of judgment results, and a person diagnosing the actual object. Figure 4 is a diagram showing the quantity, location information, and abnormality level of outdoor lighting devices 5 in a predetermined area, a map with icons indicating location information and abnormality level drawn on it, and detailed information indicated by the icons.

[0015] As shown in Figure 1, the state estimation system 1 can estimate the state of the outdoor lighting device 5 based on images taken of the outdoor lighting device 5. The outdoor lighting device 5 is a street light or road light installed outdoors in a road, park, etc.

[0016] Specifically, the state estimation system 1 comprises an acquisition unit 11, an image analysis unit 12, a storage unit 13, a processing unit 14, a notification unit 15, a display unit 16, and an input unit 17.

[0017] The acquisition unit 11 acquires an image of the outdoor lighting device 5 and position information indicating the location where the image was taken. The position information is information indicating latitude, longitude, an address, or the like. In the present embodiment, the acquisition unit 11 acquires one or more images for each outdoor lighting device 5. The acquisition unit 11 is, for example, a communication unit that receives or transmits images.

[0018] For example, as shown in FIG. 2, the image is an image of the entire appearance of the outdoor lighting device 5, an image of the luminaire, an image of one side and the other side of the base portion of the pole of the outdoor lighting device 5, or the like. Also, the image is mainly a still image, but may be a moving image. The image of the luminaire may be an image of the lit luminaire or an image of the unlit luminaire.

[0019] [[ID=⑧]]As shown in FIG. 1, for example, the acquisition unit 11 is an input interface into which an image and position information associated with the image are input, a communication unit that receives the image and position information associated with the image, or the like. The acquisition unit 11 outputs the acquired image and the position information associated with the image to the image analysis unit 12.

[0020] The image analysis unit 12 estimates the abnormality level of the outdoor lighting device 5 as the state of the outdoor lighting device 5 photographed by analyzing the image acquired by the acquisition unit 11.

[0021] Specifically, as shown in Figures 1 and 3, the image analysis unit 12 estimates the state of the outdoor lighting device 5 in the image by analyzing the acquired image. For example, the image analysis unit 12 analyzes the state of the outdoor lighting device 5 in the image, including the presence or absence of corrosion, the degree of corrosion if present, the presence or absence of damage, the degree of damage if present, and the specifications of the outdoor lighting device 5. Based on this, the image analysis unit 12 estimates the abnormality level of the outdoor lighting device 5, which is the result of the analysis based on the image. The abnormality level is divided into two or more levels, for example, (A) new, (B) no abnormality, (C) repair plan within a few months to a few years, (D) repair immediately, (E) old product to be replaced, etc. In other words, the abnormality level is an indicator of whether or not the outdoor lighting device 5 needs repair, whether or not it needs to be replaced, the timing of the repair if it needs to be repaired, or the timing of the replacement if it needs to be replaced. Here, the specifications of the outdoor lighting device 5 include the height of the outdoor lighting device 5, the diameter of the pole, the brightness of the light fixture, the type of light fixture, etc.

[0022] Furthermore, the image analysis unit 12 analyzes the anomaly level using an image analysis algorithm that employs artificial intelligence. For example, the image analysis unit 12 may make decisions according to a learning model obtained by machine learning past sample data using the image analysis algorithm. The past sample data (reference images) are training data in which the anomaly levels of each of multiple images have been learned. The learning of the image analysis algorithm may be performed using one or more known statistical classification techniques.

[0023] Furthermore, the image analysis unit 12 updates the image analysis algorithm for estimating the anomaly level based on the content of the feedback input to the input unit 17.

[0024] Specifically, each time the image analysis unit 12 estimates an abnormality level of the outdoor lighting device 5 based on the analysis of the image, it outputs the estimated abnormality level to the display unit 16, etc. Based on the content displayed on the display unit 16, the operator compares the image with the abnormality level estimated by the image analysis unit 12 and diagnoses the actual device. For example, in Figure 3, even if the image analysis unit 12 diagnoses abnormality levels C and B in the two images, the operator's diagnosis of the actual device may result in abnormality levels D and B. The operator inputs the diagnosis result as feedback regarding the image analysis result to the input unit 17. As a result, the image analysis unit 12 updates its image analysis algorithm for estimating abnormality levels based on the feedback input to the input unit 17.

[0025] The input unit 17 is an operation input unit for receiving feedback from the operator regarding the results of image analysis. The operator inputs the diagnostic results into the input unit 17 in order to provide feedback to the image analysis unit 12 on whether the analysis results are correct. Here, the operator is the administrator of the state estimation system 1.

[0026] Furthermore, the image analysis unit 12 may also estimate the condition of the concrete or other foundation blocks for installing the outdoor lighting device 5 by analyzing the acquired images. The image analysis unit 12 may, for example, estimate the presence or absence of cracks in the foundation blocks, the size of the cracks, etc. The image analysis unit 12 may also estimate the level of abnormality in the condition of the foundation blocks.

[0027] Furthermore, the image analysis unit 12 may also estimate the location where the outdoor lighting device is installed (for example, in a grassy area beside a road), and the estimated result may be used to determine the abnormality level.

[0028] Furthermore, when the image analysis unit 12 estimates an abnormality level, it stores the abnormality level in the storage unit 13, linking at least the location information with the abnormality level. Preferably, when the image analysis unit 12 estimates an abnormality level, it stores the image, location information, and abnormality level in the storage unit 13, linking them together.

[0029] The storage unit 13 is a database that stores, for each outdoor lighting device 5, at least location information and anomaly level associated with it. Preferably, the storage unit 13 stores, for each outdoor lighting device 5, an image, location information, and anomaly level associated with it. The storage unit 13 may also store past sample data (reference images) and image analysis algorithms.

[0030] Furthermore, the image analysis unit 12 outputs the estimated abnormality level to the processing unit 14.

[0031] When the processing unit 14 obtains an abnormality level from the image analysis unit 12, it determines whether the estimated abnormality level is above a predetermined level. If the processing unit 14 determines that the estimated abnormality level is above a predetermined level, it controls the notification unit 15 to notify the notification unit 15 that the abnormality level is above a predetermined level. In other words, the processing unit 14 can control the operation of the notification unit 15.

[0032] The notification unit 15, under the control of the processing unit 14, notifies an external party that the abnormality level estimated by the image analysis unit 12 is above a predetermined level. The notification unit 15 includes, for example, a communication unit that notifies a predetermined organization, etc., via communication that the abnormality level is above a predetermined level, a display monitor that displays a pop-up notification that the abnormality level is above a predetermined level, and an audio unit that outputs an audio message that the abnormality level is above a predetermined level.

[0033] Furthermore, when the processing unit 14 obtains an anomaly level from the image analysis unit 12, it draws icons on the map indicating the location information and the anomaly level associated with the location information, as shown in Figure 4. The processing unit 14 controls the display unit 16 to display the drawn icons and the map on the display unit 16. In other words, the processing unit 14 is also a control processing unit that can control the operation of the display unit 16.

[0034] The display unit 16 displays at least the associated location information and abnormality level on the map for each outdoor lighting device 5. Preferably, the display unit 16 displays the associated image, location information, and abnormality level on the map for each outdoor lighting device 5.

[0035] <Processing Actions> Next, the processing operation of the state estimation system 1 according to this embodiment will be described.

[0036] (Example of operation 1) In this example, the overall processing operation of state estimation system 1 will be explained using Figure 5.

[0037] Figure 5 is a flowchart showing the processing operation of the state estimation system 1.

[0038] First, a preparation process is performed (S11). Specifically, the user uses a terminal device to obtain an application for taking images of the outdoor lighting device 5 from a cloud server or the like. This installs the application on the terminal device. Alternatively, the terminal device may use an application on the cloud server by accessing the cloud server. The user launches the application to prepare to take images of the outdoor lighting device 5. Then, the user takes images of the outdoor lighting device 5. At this time, by operating the application displayed on the terminal device, the terminal device acquires images of the entire exterior of the outdoor lighting device 5, an image of the light fixture, an image of one side of the base of the pole of the outdoor lighting device 5, and an image of the other side of the base of the pole of the outdoor lighting device 5. At this time, each time an image is taken, the application links the captured image with the location information acquired by the terminal device's GPS (Global Positioning System) function or the like. Once the user has finished taking photos, the user operates an application displayed on the terminal device, which then transmits the location information and the image linked to that location information to the state estimation system 1.

[0039] Next, the acquisition unit 11 of the state estimation system 1 acquires an image and location information associated with the image (S12). The acquisition unit 11 outputs the image and location information associated with the image to the image analysis unit 12.

[0040] Next, the image analysis unit 12 analyzes the image acquired from the acquisition unit 11. At this time, the image analysis unit 12 analyzes the abnormality level using an image analysis algorithm that utilizes artificial intelligence. By analyzing the acquired image, the image analysis unit 12 estimates the abnormality level of the outdoor lighting device 5 as the state of the photographed outdoor lighting device 5 (S13). In other words, based on the image, the image analysis unit 12 analyzes the state of the outdoor lighting device 5 in the image, such as the presence or absence of corrosion, the degree of corrosion if corrosion is present, the presence or absence of damage, the degree of damage if damage is present, the specifications of the outdoor lighting device 5, etc., and as a result of the analysis, estimates the abnormality level of the outdoor lighting device 5.

[0041] Next, when the image analysis unit 12 estimates an abnormality level, it stores the abnormality level in the storage unit 13, linking it with at least the location information (S14). This allows the storage unit 13 to store the abnormality level in association with at least the location information. Preferably, when the image analysis unit 12 estimates an abnormality level, it stores the image, location information, and abnormality level in the storage unit 13, linking them together. The storage unit 13 also stores the image, location information, and abnormality level in association with each outdoor lighting device 5. The image analysis unit 12 outputs the estimated abnormality level to the processing unit 14.

[0042] Next, the processing unit 14 obtains the abnormality level from the image analysis unit 12 and determines whether the estimated abnormality level is above a predetermined level (S15).

[0043] If the processing unit 14 determines that the estimated abnormality level is below a predetermined level (NO in S15), it terminates the flowchart.

[0044] On the other hand, if the processing unit 14 determines that the estimated abnormality level is above a predetermined level (YES in S15), it controls the notification unit 15 to notify the notification unit 15 that the abnormality level is above a predetermined level (S16). In other words, the notification unit 15, under the control of the processing unit 14, notifies the outside that the abnormality level estimated by the image analysis unit 12 is above a predetermined level. As a result, for example, the abnormality level of the outdoor lighting device 5 can be notified to a predetermined organization that has introduced the state estimation system 1, so that the predetermined organization can plan to carry out repairs or replacements of outdoor lighting devices 5 with an abnormality level above a predetermined level as soon as possible.

[0045] In such a state estimation system 1, a gamified element may be introduced to encourage user participation in acquiring images of the outdoor lighting device 5. For example, users may earn predetermined points by posting (sending) images of the outdoor lighting device 5 to the state estimation system 1 within the application. Furthermore, users may be given a virtual emblem or item upon accumulating a certain number of points. The number of points earned may also be ranked and made public to all users running the application. Additionally, the person with the most points in a designated area may be allowed to occupy a designated area on a virtual map. If a designated area is occupied, the user's avatar may be displayed. Users may also occupy other users' designated areas by posting images. Furthermore, points may be exchanged for goods. In addition, if there are events, event bonuses for acquiring points may be set. In this way, the user's ambition and competitive spirit can be stimulated, encouraging them to actively take pictures of the outdoor lighting device 5.

[0046] (Example of operation 2) In this example, the processing steps involved in updating the image analysis algorithm are explained using Figure 6.

[0047] Figure 6 is a flowchart showing the processing operation of the image analysis algorithm.

[0048] First, as shown in Figure 6, the image analysis unit 12 outputs the abnormality level, which is the result of estimation based on the image, to the display unit 16, etc. (S21). Based on the content displayed on the display unit 16, an operator at a designated organization compares the abnormality level estimated by the image analysis unit 12 with the image and diagnoses the actual object. In other words, the operator judges whether the abnormality level estimated by the image analysis unit 12 is correct by looking at the actual object.

[0049] Next, the operator inputs the diagnostic results into the input unit 17 in order to provide feedback to the image analysis unit 12 on whether the analysis results are correct. For example, as shown in Figure 3, even if the image analysis unit 12 diagnoses the abnormality levels of two images as C and B, the operator may diagnose the actual object as abnormality levels D and B. Therefore, if the abnormality levels are incorrect, the operator corrects the abnormality levels estimated by the image analysis unit 12 and inputs the corrected abnormality levels into the input unit 17 in order to provide feedback on whether the results of the image analysis are correct. In other words, the input unit 17 receives the content of the operator's feedback (diagnosis results) regarding the analysis results (S22). Note that if the abnormality levels are correct, the operator does not need to input feedback into the input unit 17.

[0050] Next, the input unit 17 outputs feedback regarding the results of the image analysis to the image analysis unit 12. Based on the feedback input to the input unit 17, the image analysis unit 12 updates the image analysis algorithm for estimating the anomaly level (S23). This updates the image analysis algorithm stored in the storage unit 13. The processing operation shown in Figure 6 then ends.

[0051] <Effects and Effects> Next, the effects and benefits of the state estimation system 1 according to this embodiment will be described.

[0052] As described above, the state estimation system 1 according to this embodiment is a state estimation system 1 for estimating the state of an outdoor lighting device 5, and comprises an acquisition unit 11 that acquires an image of the outdoor lighting device 5 and location information indicating the location where the image was taken, an image analysis unit 12 that analyzes the image acquired by the acquisition unit 11 to estimate the abnormality level of the outdoor lighting device 5 as the state of the photographed outdoor lighting device 5, and a storage unit 13. The image analysis unit 12 stores at least the location information and the abnormality level in the storage unit 13, linking them together.

[0053] According to this, the condition estimation system 1 can estimate the abnormality level of the outdoor lighting device 5 by acquiring an image of the outdoor lighting device 5 and analyzing the image of the outdoor lighting device 5. Therefore, a designated organization equipped with the condition estimation system 1 can understand the condition of the outdoor lighting device 5 without having to go to the location where the outdoor lighting device 5 is installed and inspect it.

[0054] Therefore, the state estimation system 1 can prevent malfunctions in the outdoor lighting device 5.

[0055] In particular, since administrative agencies and other organizations manage a large number of outdoor lighting devices 5, obtaining images of the outdoor lighting devices 5 allows them to easily understand the condition of the outdoor lighting devices 5, and thus develop repair or replacement plans for the outdoor lighting devices 5. As a result, malfunctions of the outdoor lighting devices 5 can be detected, preventing problems with the outdoor lighting devices 5 from occurring and thus preventing sudden accidents.

[0056] Furthermore, in the state estimation system 1 according to this embodiment, the storage unit 13 stores images, location information, and abnormality levels in association with each other.

[0057] According to this, the image, location information, and abnormality level of a single outdoor lighting device 5 can be managed together. Therefore, when managing multiple outdoor lighting devices 5, it becomes easier to understand the status of each outdoor lighting device 5.

[0058] Furthermore, in the state estimation system 1 according to this embodiment, the image analysis unit 12 analyzes the image acquired by the acquisition unit 11 to estimate the state of the outdoor lighting device 5, and also estimates the specifications of the outdoor lighting device 5.

[0059] According to this, the specifications of the outdoor lighting device 5 can be estimated from the image, making it easy to determine what equipment should be prepared based on the specifications of the outdoor lighting device 5 when repairing or replacing it.

[0060] Furthermore, the state estimation system 1 according to this embodiment further includes an input unit 17 for receiving feedback regarding the results of image analysis. The image analysis unit 12 analyzes the anomaly level using an image analysis algorithm that employs artificial intelligence. The image analysis unit 12 then updates the image analysis algorithm for estimating the anomaly level based on the feedback input to the input unit 17.

[0061] This allows for an improvement in the accuracy of the image analysis algorithm used to analyze the image. As a result, the image analysis unit 12 will be able to estimate the abnormality level of the outdoor lighting device 5 with greater accuracy.

[0062] Furthermore, the state estimation system 1 according to this embodiment further includes a display unit 16 that displays at least location information and anomaly levels associated with the location information on a map.

[0063] According to this, since the abnormal level can be displayed on the map, workers of a designated organization will be able to easily understand the location and level of the abnormal level of the outdoor lighting device 5.

[0064] Furthermore, the state estimation system 1 according to this embodiment also includes a notification unit 15 that notifies the outside that the abnormality level is above a predetermined level when the abnormality level is above a predetermined level.

[0065] In this way, once notification is received that the abnormal level is above a predetermined level, workers can easily identify the outdoor lighting devices 5 that have a high priority for repair or replacement. Workers can then plan to promptly repair or replace the outdoor lighting devices 5 whose abnormal level is above a predetermined level.

[0066] (Other variations) The state estimation system 1 relating to this disclosure has been described above based on the embodiments described above, but this disclosure is not limited to these embodiments. Various modifications to the embodiments that a person skilled in the art could conceive of may also be included in the scope of this disclosure, as long as they do not deviate from the spirit of this disclosure.

[0067] For example, the state estimation system 1a according to the above embodiment will be explained with reference to Figure 7. Figure 7 is a block diagram showing another modified example of the state estimation system 1a. The state estimation system 1a may further include a management unit 18 that manages the state of the outdoor lighting device 5 in City GML (Generalized Markup Language) format. In other words, the management unit 18 may manage the repair or replacement plan for the outdoor lighting device 5 by managing the state of the outdoor lighting device 5, which is stored linked to location information and abnormality levels, in City GML format. For example, when the repair or replacement time for the outdoor lighting device 5 approaches, the management unit 18 may output the repair or replacement plan in City GML format to a display unit 16 or the like. This allows a designated organization to grasp the repair or replacement plan for the outdoor lighting device 5, thereby preventing malfunctions of the outdoor lighting device 5.

[0068] Furthermore, in the state estimation system 1 according to the above embodiment, as shown in Figure 1, the terminal device may transmit images and location information associated with the images to the cloud server. In this case, the state estimation system 1 may also acquire images and location information associated with the images from the cloud server.

[0069] Furthermore, the image analysis unit of the state estimation system according to the above embodiment may be located on a cloud server. In this case, when the state estimation system acquires an image and location information associated with the image from a terminal device, it may transmit the acquired image and location information to the cloud server.

[0070] Furthermore, the processing unit, image analysis unit, etc., included in the state estimation system according to the above embodiment are typically implemented as LSIs, which are integrated circuits. These may be individually integrated into a single chip, or some or all of them may be integrated into a single chip.

[0071] Furthermore, integrated circuit implementation is not limited to LSIs; it may also be achieved using dedicated circuits or general-purpose processors. Field-Programmable Gate Arrays (FPGAs), which can be programmed after LSI manufacturing, or reconfigurable processors, which allow for the reconfiguration of the connections and settings of circuit cells within the LSI, may also be used.

[0072] In each of the above embodiments, each component may be implemented by dedicated hardware or by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0073] Furthermore, all figures used above are illustrative to illustrate the present disclosure, and the embodiments of this disclosure are not limited to the figures exemplified.

[0074] Furthermore, the division of functional blocks in the block diagram is just one example; multiple functional blocks can be implemented as a single functional block, a single functional block can be divided into multiple parts, or some functions can be moved to other functional blocks. In addition, the functions of multiple functional blocks with similar functions can be processed in parallel or time-sharing by a single piece of hardware or software.

[0075] Furthermore, the order in which each step in the flowchart is performed is illustrative for the purpose of specifically illustrating this disclosure, and may be in a different order. Also, some of the above steps may be performed simultaneously (in parallel) with other steps.

[0076] The following describes the features of the state estimation system based on the above embodiments.

[0077] <Technology 1> A state estimation system for estimating the state of outdoor lighting equipment, An acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken, An image analysis unit analyzes the appearance of at least a portion of the outdoor lighting device included in the image acquired by the acquisition unit, estimates the state of the photographed outdoor lighting device, and estimates the level of abnormality of the outdoor lighting device based on the estimated state of the outdoor lighting device. It includes a memory unit, The image analysis unit stores at least the location information and the abnormality level in the storage unit, linking them together. The aforementioned abnormality level is an indicator that shows whether or not the outdoor lighting device has been repaired, whether or not it has been replaced, the timing of the repair if it has been repaired, or the timing of the replacement if it has been replaced. State estimation system.

[0078] <Technology 2> A state estimation system for estimating the state of outdoor lighting equipment, An acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken, The system includes an image analysis unit that analyzes the appearance of at least a portion of the outdoor lighting device included in the image acquired by the acquisition unit and estimates the state of the photographed outdoor lighting device, The image analysis unit displays a map on the display unit that shows at least the location information and information regarding the status of the outdoor lighting device. State estimation system.

[0079] <Technology 3> The memory unit stores the image, the location information, and the abnormality level in association with each other. The state estimation system described in Technology 1.

[0080] <Technology 4> The image analysis unit analyzes the image acquired by the acquisition unit to estimate the state of the outdoor lighting device, and further estimate the specifications of the outdoor lighting device. A state estimation system described in one of the following three technologies.

[0081] <Technology 5> Furthermore, it includes an input unit for receiving feedback regarding the results of analyzing the aforementioned image, The aforementioned image analysis unit, The anomaly level is analyzed using an image analysis algorithm that employs artificial intelligence. Furthermore, the image analysis algorithm for estimating the abnormality level is updated based on the content of the feedback input to the input unit. A state estimation system described in any one of Techniques 1-4, without citing Technique 2.

[0082] <Technology 6> Furthermore, it includes a display unit that displays at least the location information and the abnormality level associated with the location information on a map. A state estimation system described in any one of Techniques 1-5, without citing Technique 2.

[0083] <Technology 7> Furthermore, the system includes a notification unit that notifies the outside that the abnormal level is above a predetermined level when the abnormal level is above a predetermined level. A state estimation system described in any one of Techniques 1-6, without citing Technique 2.

[0084] <Technology 8> Furthermore, it includes a management unit that manages the status of the outdoor lighting device in City GML (Generalized Markup Language) format. A state estimation system described in any one of Techniques 1-7, without citing Technique 2.

[0085] Furthermore, this disclosure also includes forms obtained by applying various modifications to each of the above embodiments that a person skilled in the art could conceive, as well as forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of this disclosure. [Explanation of Symbols]

[0086] 1. 1a State Estimation System 5. Outdoor lighting equipment 11 Acquisition Department 12 Image Analysis Unit 13 Storage section 15 Hochi Department 16 Display 17 Input section 18 Management Department

Claims

1. A state estimation system for estimating the state of outdoor lighting equipment, An acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken, An image analysis unit analyzes the appearance of at least a portion of the outdoor lighting device included in the image acquired by the acquisition unit, estimates the state of the photographed outdoor lighting device, and estimates the level of abnormality of the outdoor lighting device based on the estimated state of the outdoor lighting device. It includes a memory unit, The image analysis unit stores at least the location information and the abnormality level in the storage unit, linking them together. The aforementioned abnormality level is an indicator that shows whether or not the outdoor lighting device has been repaired, whether or not it has been replaced, the timing of the repair if it has been repaired, or the timing of the replacement if it has been replaced. State estimation system.

2. A state estimation system for estimating the state of outdoor lighting equipment, An acquisition unit that acquires an image of the outdoor lighting device and location information indicating the location where the image was taken, The system includes an image analysis unit that analyzes the appearance of at least a portion of the outdoor lighting device included in the image acquired by the acquisition unit and estimates the state of the photographed outdoor lighting device, The image analysis unit displays a map on the display unit that shows at least the location information and information regarding the status of the outdoor lighting device. State estimation system.

3. The memory unit stores the image, the location information, and the abnormality level in association with each other. The state estimation system according to claim 1.

4. The image analysis unit analyzes the image acquired by the acquisition unit to estimate the state of the outdoor lighting device, and further estimate the specifications of the outdoor lighting device. A state estimation system according to any one of claims 1 to 3.

5. Furthermore, it includes an input unit for receiving feedback regarding the results of analyzing the aforementioned image, The aforementioned image analysis unit, The anomaly level is analyzed using an image analysis algorithm that employs artificial intelligence. Furthermore, the image analysis algorithm for estimating the abnormality level is updated based on the content of the feedback input to the input unit. The state estimation system according to claim 1 or 3.

6. Furthermore, it includes a display unit that displays at least the location information and the abnormality level associated with the location information on a map. The state estimation system according to claim 1 or 3.

7. Furthermore, the system includes a notification unit that notifies the outside that the abnormal level is above a predetermined level when the abnormal level is above a predetermined level. The state estimation system according to claim 1 or 3.

8. Furthermore, it includes a management unit that manages the status of the outdoor lighting device in City GML (Generalized Markup Language) format. The state estimation system according to claim 1 or 3.

Images