State estimation system, cloud server, communication method, terminal device control method, and program

Abstract

To provide a state estimation system or the like capable of preventing malfunctions of outdoor lighting apparatuses.SOLUTION: A state estimation system 1 is an estimation system that estimates a state of an outdoor lighting apparatus 5, and comprises: an acquisition unit 11 for acquiring an image obtained by photographing the outdoor lighting apparatus 5 and position information indicating a photographing place of the image; and an image analysis unit 12 for estimating an abnormality level of the outdoor lighting apparatus 5 as the state of the photographed outdoor lighting apparatus 5 by analyzing the image acquired by the acquisition unit 11. Then, the image analysis unit 12 outputs at least the position information and the abnormality level of the outdoor lighting apparatus 5.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to a state estimation system, a cloud server, a communication method, a control method for a terminal device, and a program. [Background technology]

[0002] Patent Document 1 discloses a report management device that manages reports regarding equipment malfunctions. The report management device includes a report collection unit that collects reports regarding equipment malfunctions, a responsible organization discrimination unit that discriminates the responsible organization of the equipment from the contents of the report, and an output unit that outputs report information regarding the report and the discrimination result of the responsible organization. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-117878 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the report management device of Patent Document 1 simply outputs report information and the result of the determination of the supervisory organization, and has a problem in that it is insufficient in preventing malfunctions in outdoor lighting equipment, which is an example of equipment, before they occur.

[0005] Therefore, an object of the present disclosure is to provide a condition estimation system, a cloud server, a communication method, a control method for a terminal device, and a program that can prevent malfunctions in outdoor lighting devices before they occur. [Means for solving the problem]

[0006] A condition estimation system according to one aspect of the present disclosure is a condition estimation system that estimates a condition of an outdoor lighting device, and includes: an acquisition unit that acquires an image of the outdoor lighting device and location information indicating a location where the image was taken; and an image analysis unit that analyzes the image acquired by the acquisition unit to estimate an abnormality level of the outdoor lighting device as a condition of the outdoor lighting device that was taken, and the image analysis unit outputs the image, the location information, and the abnormality level of the outdoor lighting device in association with each other. and displaying, on a display unit, a map displaying at least the location information and the abnormality level associated with the location information, the abnormality level including a level indicating that the outdoor lighting device is normal. .

[0007] A cloud server according to an aspect of the present disclosure includes an acquisition unit that acquires an image of an outdoor lighting device and location information indicating a location where the image was taken, and an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device that was taken, and a communication unit that transmits the image acquired by the acquisition unit and the location information indicating a location where the image was taken to a state estimation system that is capable of linking and outputting the image, the location information, and the abnormality level of the outdoor lighting device. a display unit displays a map showing at least the location information and the abnormality level associated with the location information, the abnormality level including a level indicating that the outdoor lighting device is normal; .

[0008] Further, a communication method according to one aspect of the present disclosure is a communication method of a computer system operating as a cloud server, the communication method including: an acquisition step of acquiring an image of an outdoor lighting device and location information indicating a location where the image was captured; and a communication step of transmitting the image acquired in the acquisition step and the location information indicating a location where the image was captured to a state estimation system that includes an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the captured outdoor lighting device, and that is capable of outputting the image, the location information, and the abnormality level of the outdoor lighting device in association with each other. and displaying, on a display unit, a map displaying at least the location information and the abnormality level associated with the location information, the abnormality level including a level indicating that the outdoor lighting device is normal. .

[0009] Moreover, a program according to an aspect of the present disclosure is a program for causing a computer system to execute the communication method.

[0010] A control method for a terminal device according to one aspect of the present disclosure is a control method for a terminal device having a camera and a location information acquisition function, the control method including: an image capturing step of capturing an image of an outdoor lighting device by the camera based on an operation of a user of the terminal device; and a step of transmitting the image based on an operation of the user of the terminal device to a state estimation system that includes an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the captured outdoor lighting device, and that is capable of linking and outputting the image, location information indicating a location where the image was captured, and the abnormality level of the outdoor lighting device, or to a cloud server that is capable of communicating with the state estimation system. and displaying, on a display unit, a map displaying at least the location information and the abnormality level associated with the location information, the abnormality level including a level indicating that the outdoor lighting device is normal. .

[0011] Moreover, a program according to an aspect of the present disclosure is a program for causing a computer system to execute the control method. Effect of the Invention

[0012] According to the state estimation system and the like disclosed herein, malfunctions in facilities such as outdoor lighting devices can be prevented before they occur. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram showing a state estimation system according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing how an outdoor lighting device is photographed. [Diagram 3] FIG. 3 is a schematic diagram showing image judgment, accumulation of judgment results, and a person diagnosing the real thing. [Figure 4] FIG. 4 is a diagram showing the quantity, location information, and abnormality level of outdoor lighting devices in a specific area, a diagram showing a map on which icons indicating the location information and abnormality level are drawn, and detailed information indicated by the icons. [Diagram 5] FIG. 5 is a flowchart showing the processing operation of the state estimation system. [Figure 6] FIG. 6 is a flowchart showing the processing operation of the image analysis algorithm. [Figure 7] FIG. 7 is a block diagram showing a state estimation system according to another modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below shows a specific example of the present disclosure. Therefore, the numerical values, shapes, materials, components, arrangement and connection of the components, steps, order of steps, and the like shown in the following embodiments are merely examples and are not intended to limit the present disclosure.

[0015] Each figure is a schematic diagram and is not necessarily precisely illustrated. Therefore, for example, the scales and the like do not necessarily match in each figure. Furthermore, in each figure, the same reference numerals are given to substantially the same configurations, and duplicated explanations are omitted or simplified.

[0016] (Embodiment) <Summary> Outdoor lighting devices are installed outdoors, such as on roads and in parks. The outdoor lighting devices gradually deteriorate when exposed to wind and rain for a long period of time, and may break down due to the deterioration. The outdoor lighting devices are managed by designated institutions such as factories, facilities, private companies, and government agencies, but there are many installed devices, and it is difficult to always grasp the state of the outdoor lighting devices. For this reason, in order to manage the outdoor lighting devices, it is necessary to grasp the state of the outdoor lighting devices. Therefore, a user takes a picture of the outdoor lighting device using a terminal device such as a smartphone, tablet terminal, or camera, and transmits the image of the outdoor lighting device taken by the user from the terminal device to a state estimation system. As a result, the state estimation system can acquire the image from the terminal device, and judges the state of the outdoor lighting device based on the acquired image. Here, the user is a citizen who takes a picture of the outdoor lighting device.

[0017] <Configuration and Function> A state estimation system 1 according to the following embodiment will be described with reference to FIGS. 1 to 4. FIG.

[0018] Fig. 1 is a block diagram showing a condition estimation system 1 according to an embodiment. Fig. 2 is a schematic diagram showing an outdoor lighting device 5 being photographed. Fig. 3 is a schematic diagram showing image judgment, accumulation of judgment results, and a person diagnosing the actual object. Fig. 4 is a diagram showing the number, position information, and abnormality level of outdoor lighting devices 5 in a specified area, a diagram showing a map on which icons indicating the position information and abnormality level are drawn, and detailed information indicated by the icons.

[0019] 1, the state estimation system 1 can estimate the state of an outdoor lighting device 5 based on an image captured of the outdoor lighting device 5. The outdoor lighting device 5 is a street lamp, a road lamp, or the like installed outdoors on a road, in a park, or the like.

[0020] Specifically, the condition estimation system 1 includes an acquisition unit 11, an image analysis unit 12, a storage unit 13, a processing unit 14, a notification unit 15, a display unit 16, and an input unit 17.

[0021] The acquisition unit 11 acquires an image of the outdoor lighting device 5 and location information indicating the location where the image was captured. The location information is information indicating latitude, longitude, address, or the like. In this embodiment, the acquisition unit 11 acquires one or more images for each outdoor lighting device 5. The acquisition unit 11 is, for example, a communication unit that receives or transmits images.

[0022] For example, as shown in Fig. 2, an image of the entire exterior of the outdoor lighting device 5, an image of a lighting fixture, an image of one side and the other side of the base of the pole of the outdoor lighting device 5, etc. The images are mainly still images, but may be moving images. The image of the lighting fixture may be an image of a lit lighting fixture, or an image of a turned-off lighting fixture.

[0023] 1, for example, the acquisition unit 11 is an input interface to which an image and position information linked to the image are input, a communication unit that receives the image and the position information linked to the image, etc. The acquisition unit 11 outputs the acquired image and the position information linked to the image to the image analysis unit 12.

[0024] The image analysis unit 12 analyzes the image acquired by the acquisition unit 11, and estimates an abnormality level of the outdoor lighting device 5 as the state of the outdoor lighting device 5 captured in the photograph.

[0025] Specifically, as shown in FIG. 1 and FIG. 3, the image analysis unit 12 analyzes the acquired image to estimate the state of the outdoor lighting device 5 in the image. For example, the image analysis unit 12 analyzes the state of the outdoor lighting device 5 in the image, such as the presence or absence of corrosion, the degree of corrosion if corrosion is present, the presence or absence of damage, the degree of damage if damage is present, and the specifications of the outdoor lighting device 5. In this way, the image analysis unit 12 estimates the abnormality level of the outdoor lighting device 5, which is the result of the analysis based on the image. The abnormality level is divided into two or more levels, such as (A) new, (B) no abnormality, (C) repair plan within several months to several years, (D) prompt repair, and (E) old product to be replaced. In other words, the abnormality level is an index indicating the presence or absence of repair of the outdoor lighting device 5, the presence or absence of replacement, the repair timing if repair is present, or the replacement timing if replacement is present. Here, the specifications of the outdoor lighting device 5 are the height of the outdoor lighting device 5, the pole diameter, the brightness of the luminaire, the type of luminaire, and the like.

[0026] Furthermore, the image analysis unit 12 analyzes the abnormality level using an image analysis algorithm using artificial intelligence. For example, the image analysis unit 12 may determine the abnormality level according to a learning model obtained by machine learning past sample data using the image analysis algorithm. The past sample data (reference images) are teacher data that have learned the abnormality levels of each of a plurality of images. The learning of the image analysis algorithm may be performed using one or more statistical classification techniques known in the art.

[0027] Furthermore, the image analysis unit 12 updates the image analysis algorithm for estimating the abnormality level based on the content of the feedback input to the input unit 17 .

[0028] Specifically, the image analysis unit 12 outputs the estimated abnormality level to the display unit 16 or the like every time it estimates the abnormality level of the outdoor lighting device 5, which is the result of the analysis based on the image. As a result, based on the content displayed on the display unit 16, the worker compares the abnormality level estimated by the image analysis unit 12 with the image and diagnoses the actual object. For example, in FIG. 3, even if the image analysis unit 12 diagnoses two images as abnormal levels C and B, the worker may diagnose the actual object as abnormal levels D and B. The worker inputs the diagnosis result to the input unit 17 as feedback regarding the result of analyzing the image. As a result, the image analysis unit 12 updates the image analysis algorithm for estimating the abnormality level based on the feedback input to the input unit 17.

[0029] The input unit 17 is an operation input unit for receiving feedback from an operator regarding the result of analyzing the image. The operator inputs the diagnosis result to the input unit 17 in order to feed back to the image analysis unit 12 whether the analysis result is correct or not. Here, the operator is the administrator of the state estimation system 1.

[0030] The image analysis unit 12 may analyze the acquired image to estimate the condition of a foundation block, such as concrete, on which the outdoor lighting device 5 is to be installed. The image analysis unit 12 may estimate, for example, the presence or absence of cracks in the foundation block, the size of the crack gap, etc. The image analysis unit 12 may also estimate the abnormality level of the condition of the foundation block.

[0031] Furthermore, the image analysis unit 12 may be able to estimate the installation location of the outdoor lighting device (for example, a location in a patch of grass on the side of the road), and the result of this estimation may be used to determine the abnormality level.

[0032] Furthermore, when the image analysis unit 12 estimates the abnormality level, it links at least the position information and the abnormality level and stores them in the storage unit 13. Preferably, when the image analysis unit 12 estimates the abnormality level, it links the image, the position information, and the abnormality level and stores them in the storage unit 13.

[0033] The storage unit 13 is a database that stores at least location information and an abnormality level in association with each other for each outdoor lighting device 5. Preferably, the storage unit 13 stores an image, location information, and an abnormality level in association with each other for each outdoor lighting device 5. The storage unit 13 may also store past sample data (reference images) and image analysis algorithms.

[0034] Moreover, the image analysis unit 12 outputs the estimated abnormality level to the processing unit 14.

[0035] When the processing unit 14 acquires the abnormality level from the image analysis unit 12, the processing unit 14 judges whether the estimated abnormality level is equal to or higher than a predetermined level. If the processing unit 14 judges that the estimated abnormality level is equal to or higher than the predetermined level, the processing unit 14 controls the notification unit 15 to cause the notification unit 15 to notify that the abnormality level is equal to or higher than the predetermined level. In other words, the processing unit 14 can control the operation of the notification unit 15.

[0036] The notification unit 15 is controlled by the processing unit 14 to notify the outside that the abnormality level is equal to or higher than the predetermined level when the abnormality level estimated by the image analysis unit 12 is equal to or higher than the predetermined level. The notification unit 15 is, for example, a communication unit that notifies a predetermined institution or the like by communication that the abnormality level is equal to or higher than the predetermined level, a display monitor that notifies the fact that the abnormality level is equal to or higher than the predetermined level by pop-up, and an audio unit that outputs the fact that the abnormality level is equal to or higher than the predetermined level by voice.

[0037] Furthermore, when the processing unit 14 acquires the abnormality level from the image analysis unit 12, the processing unit 14 draws an icon indicating the location information and the abnormality level on a map based on the location information and the abnormality level linked to the location information, as shown in Fig. 4. The processing unit 14 controls the display unit 16 to cause the drawn icon and map to be displayed on the display unit 16. In other words, the processing unit 14 is also a control processing unit that can control the operation of the display unit 16.

[0038] The display unit 16 displays on the map at least the associated position information and the abnormality level for each outdoor lighting device 5. Preferably, the display unit 16 displays on the map the associated image, position information, and abnormality level for each outdoor lighting device 5.

[0039] <Processing Operation> Next, the processing operations of the state estimation system 1 according to this embodiment will be described.

[0040] (Example 1) In this operation example, the overall processing operation of the state estimation system 1 will be described with reference to FIG.

[0041] FIG. 5 is a flowchart showing the processing operation of the state estimation system 1.

[0042] First, a preparation step is performed (S11). Specifically, the user uses a terminal device to obtain an application or the like for photographing an image of the outdoor lighting device 5 from a cloud server or the like. As a result, the application is installed in the terminal device. The terminal device may access the cloud server to use the application on the cloud server. The user starts the application to prepare for photographing the outdoor lighting device 5 on the application. Then, the user photographs the outdoor lighting device 5. At this time, the user operates the application displayed on the terminal device, and the terminal device obtains an image of the entire exterior of the outdoor lighting device 5, an image of the lighting device, an image of one side of the base part of the pole of the outdoor lighting device 5, and an image of the other side of the base part of the pole of the outdoor lighting device 5. At this time, the application associates the photographed image with position information obtained by a GPS (Global Positioning System) function or the like of the terminal device every time an image is photographed. When the user finishes capturing an image, the user operates an application displayed on the terminal device, whereby the terminal device transmits the position information and the image linked to the position information to the state estimation system 1.

[0043] Next, the acquisition unit 11 of the state estimation system 1 acquires an image and position information associated with the image (S12). The acquisition unit 11 outputs the image and the position information associated with the image to the image analysis unit 12.

[0044] Next, the image analysis unit 12 analyzes the image acquired from the acquisition unit 11. At this time, the image analysis unit 12 analyzes the abnormality level using an image analysis algorithm using artificial intelligence. The image analysis unit 12 analyzes the acquired image to estimate the abnormality level of the outdoor lighting device 5 as the state of the photographed outdoor lighting device 5 (S13). That is, the image analysis unit 12 analyzes, for example, the state of the outdoor lighting device 5 in the image, such as the presence or absence of corrosion, the degree of corrosion if corrosion is present, the presence or absence of damage, the degree of damage if damage is present, and the specifications of the outdoor lighting device 5, based on the image, and estimates the abnormality level of the outdoor lighting device 5 as a result of the analysis.

[0045] Next, when the image analysis unit 12 estimates the abnormality level, it causes at least the position information and the abnormality level to be linked and stored in the storage unit 13 (S14). This allows the storage unit 13 to store at least the position information and the abnormality level in a linked manner. Preferably, when the image analysis unit 12 estimates the abnormality level, it causes the image, the position information, and the abnormality level to be linked and stored in the storage unit 13. In addition, the storage unit 13 stores the image, the position information, and the abnormality level in a linked manner for each outdoor lighting device 5. The image analysis unit 12 outputs the estimated abnormality level to the processing unit 14.

[0046] Next, when the processing unit 14 acquires the abnormality level from the image analysis unit 12, it determines whether or not the estimated abnormality level is equal to or higher than a predetermined level (S15).

[0047] When the processing unit 14 determines that the estimated abnormality level is less than the predetermined level (NO in S15), the processing unit 14 ends the flowchart.

[0048] On the other hand, when the processing unit 14 determines that the estimated abnormality level is equal to or higher than the predetermined level (YES in S15), it controls the notification unit 15 to notify the notification unit 15 that the abnormality level is equal to or higher than the predetermined level (S16). That is, when the abnormality level estimated by the image analysis unit 12 is equal to or higher than the predetermined level, the notification unit 15 is controlled by the processing unit 14 to notify the outside that the abnormality level is equal to or higher than the predetermined level. This makes it possible to notify the abnormality level of the outdoor lighting device 5 to a predetermined institution that has introduced the state estimation system 1, for example, so that the predetermined institution can make a plan to quickly carry out repair or replacement of the outdoor lighting device 5 whose abnormality level is equal to or higher than the predetermined level.

[0049] In such a state estimation system 1, a game feature may be introduced to encourage user participation in order to obtain an image of the outdoor lighting device 5. For example, on the application, a user may be able to earn a predetermined number of points by posting (transmitting) an image of the outdoor lighting device 5 to the state estimation system 1. Furthermore, when a certain number of points is earned, a virtual emblem or item may be provided to the user. Furthermore, the number of points earned may be ranked and made public to all users who run the application. Furthermore, a person with the most points in a predetermined area may be allowed to occupy a predetermined area on a virtual map. When a predetermined area is occupied, the user's avatar may be displayed. Furthermore, by posting an image, it may be possible to occupy a predetermined area of ​​another person. Furthermore, it may be possible to exchange the points for products. Furthermore, if there is a festival or the like, an event bonus for acquiring points may be set. In this way, the user's ambition, competitive spirit, etc. can be stimulated, and the user may be made aware of the need to actively photograph the outdoor lighting device 5.

[0050] (Example 2) In this operation example, the processing operation when updating the image analysis algorithm will be described with reference to FIG.

[0051] FIG. 6 is a flowchart showing the processing operation of the image analysis algorithm.

[0052] 6, the image analysis unit 12 outputs the abnormality level, which is the result of estimation based on the image, to the display unit 16 or the like (S21). As a result, based on the content displayed on the display unit 16, an operator at a predetermined institution compares the abnormality level estimated by the image analysis unit 12 with the image and diagnoses the actual item. In other words, the operator looks at the actual item and judges whether the abnormality level estimated by the image analysis unit 12 is correct.

[0053] Next, the worker inputs the diagnosis result to the input unit 17 in order to feed back to the image analysis unit 12 whether the analysis result is correct. For example, as shown in FIG. 3, even if the image analysis unit 12 diagnoses two images as abnormal levels C and B, when the worker diagnoses the actual objects, the abnormal levels may be D and B. For this reason, if the abnormality level is not correct, the worker corrects the abnormality level estimated by the image analysis unit 12, and inputs the diagnosis result to the input unit 17 in order to feed back whether the corrected abnormality level is the result of analyzing the images. That is, the contents of the feedback from the administrator regarding the analysis result (diagnosis result) are input to the input unit 17 (S22). Note that if the abnormality level is correct, the worker does not need to input the feedback to the input unit 17.

[0054] Next, the input unit 17 outputs feedback regarding the result of analyzing the image to the image analysis unit 12. As a result, the image analysis unit 12 updates the image analysis algorithm for estimating the abnormality level based on the content of the feedback input to the input unit 17 (S23). As a result, the image analysis algorithm stored in the storage unit 13 is updated. Then, the processing operation of FIG. 6 is terminated.

[0055] <Action and effect> Next, the effects of the state estimation system 1 according to the present embodiment will be described.

[0056] As described above, the condition estimation system 1 according to the present embodiment is an estimation system that estimates the condition of an outdoor lighting device 5, and includes an acquisition unit 11 that acquires an image of the outdoor lighting device 5 and location information indicating the location where the image was captured, an image analysis unit 12 that analyzes the image acquired by the acquisition unit 11 to estimate an abnormality level of the outdoor lighting device 5 as the condition of the captured outdoor lighting device 5, and a storage unit 13. The image analysis unit 12 associates at least the location information with the abnormality level and stores them in the storage unit 13.

[0057] According to this, the condition estimation system 1 can estimate the abnormality level of the outdoor lighting device 5 by acquiring an image capturing the outdoor lighting device 5 and analyzing the image capturing the outdoor lighting device 5. Therefore, a predetermined facility equipped with the condition estimation system 1 can grasp the condition of the outdoor lighting device 5 without having to go to the place where the outdoor lighting device 5 is installed and inspect it.

[0058] Therefore, the condition estimation system 1 can prevent malfunctions in the outdoor lighting device 5 before they occur.

[0059] In particular, since administrative agencies and the like manage a large number of outdoor lighting devices 5, by acquiring images of the outdoor lighting devices 5, the state of the outdoor lighting devices 5 can be easily understood, and repair or replacement plans for the outdoor lighting devices 5 can be made. As a result, malfunctions of the outdoor lighting devices 5 can be detected, and therefore malfunctions of the outdoor lighting devices 5 can be prevented in advance, and sudden accidents can also be prevented in advance.

[0060] Moreover, in the condition estimation system 1 according to the present embodiment, the storage unit 13 stores the image, the position information, and the abnormality level in association with each other.

[0061] This makes it possible to collectively manage the image, position information, and abnormality level of one outdoor lighting device 5. Therefore, when managing multiple outdoor lighting devices 5, it becomes easier to grasp the state of each outdoor lighting device 5.

[0062] Moreover, in the condition estimation system 1 according to the present embodiment, the image analysis unit 12 analyzes the image acquired by the acquisition unit 11, and thereby estimates the specifications of the outdoor lighting device 5 as the condition of the outdoor lighting device 5.

[0063] According to this, the specifications of the outdoor lighting device 5 can be estimated from the image, so that when repairing or replacing the outdoor lighting device 5, it can be easily determined what equipment should be prepared based on the specifications of the outdoor lighting device 5.

[0064] Moreover, the condition estimation system 1 according to the present embodiment further includes an input unit 17 for receiving feedback on the results of analyzing the image. Moreover, the image analysis unit 12 analyzes the abnormality level using an image analysis algorithm that uses artificial intelligence. Then, the image analysis unit 12 further updates the image analysis algorithm for estimating the abnormality level based on the feedback input to the input unit 17.

[0065] This makes it possible to improve the accuracy of the image analysis algorithm for analyzing the image, thereby enabling the image analyzer 12 to estimate the abnormality level of the outdoor lighting device 5 with higher accuracy.

[0066] Moreover, the condition estimation system 1 according to the present embodiment further includes a display unit 16 that displays at least the position information and the abnormality level linked to the position information on a map.

[0067] According to this, since the abnormality level can be displayed on the map, workers at a specified institution can easily grasp the position of the abnormality level of the outdoor lighting device 5 and the abnormality level.

[0068] Moreover, the condition estimation system 1 according to the present embodiment further includes a notification unit 15 that, when the abnormality level is equal to or higher than a predetermined level, notifies the outside that the abnormality level is equal to or higher than a predetermined level.

[0069] In this way, if a notification is received that the abnormality level is equal to or higher than the predetermined level, the worker can easily identify the outdoor lighting devices 5 that should be repaired or replaced with high priority. The worker can make a plan to quickly repair or replace the outdoor lighting devices 5 whose abnormality level is equal to or higher than the predetermined level.

[0070] (Other variations) Although the state estimation system 1 according to the present disclosure has been described based on the above-mentioned embodiments, the present disclosure is not limited to these embodiments. As long as the modifications do not deviate from the spirit of the present disclosure, modifications that a person skilled in the art may make to the embodiments may also be included in the scope of the present disclosure.

[0071] For example, the state estimation system 1a according to the above embodiment will be described with reference to FIG. 7. FIG. 7 is a block diagram showing the state estimation system 1a according to another modified example. The state estimation system 1a may further include a management unit 18 that manages the state of the outdoor lighting device 5 in City GML (Generalized Markup Language) format. That is, the management unit 18 may manage the state of the outdoor lighting device 5 in which the position information and the abnormality level are linked and stored in City GML format, thereby managing a repair plan or replacement plan for the outdoor lighting device 5. For example, when the time for repair or replacement of the outdoor lighting device 5 approaches, the management unit 18 may output the repair plan or replacement plan to the display unit 16 or the like in City GML format. This allows a predetermined organization to grasp the repair plan or replacement plan for the outdoor lighting device 5, thereby making it possible to prevent malfunctions of the outdoor lighting device 5 from occurring.

[0072] In the state estimation system 1 according to the above embodiment, the terminal device may transmit an image and location information associated with the image to a cloud server as shown in Fig. 1. In this case, the state estimation system 1 may be able to acquire the image and location information associated with the image from the cloud server.

[0073] The image analysis unit of the state estimation system according to the above embodiment may be provided in a cloud server. In this case, when the state estimation system acquires an image and location information associated with the image from a terminal device, the state estimation system may transmit the acquired image and location information associated with the image to the cloud server.

[0074] Moreover, the processing unit, image analysis unit, and the like included in the state estimation system according to the above embodiment are typically realized as an LSI, which is an integrated circuit. These may be individually implemented as single chips, or some or all of them may be included in a single chip.

[0075] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.

[0076] In each of the above embodiments, each component may be implemented by dedicated hardware or by executing a software program suitable for each component. Each component may be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0077] Furthermore, all the numbers used above are merely examples for the purpose of specifically explaining the present disclosure, and the embodiments of the present disclosure are not limited to the numbers exemplified.

[0078] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0079] In addition, the order in which each step is performed in the flowchart is merely for illustrative purposes and may be other than the above. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.

[0080] The features of the state estimation system described based on the above embodiments will be described below.

[0081] <Technology 1> A state estimation system for estimating a state of an outdoor lighting device, comprising: an acquisition unit that acquires an image of the outdoor lighting device and location information indicating a location where the image was taken; an image analysis unit that analyzes the image acquired by the acquisition unit to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured in the image, The image analysis unit outputs the abnormality level of the outdoor lighting device. State estimation system.

[0082] <Technology 2> The image analysis unit outputs the image, the position information, and the abnormality level in association with each other. The state estimation system according to technique 1.

[0083] <Technology 3> the image analysis unit analyzes the image acquired by the acquisition unit to estimate a state of the outdoor lighting device and also estimate specifications of the outdoor lighting device. The state estimation system according to any one of claims 1 to 2.

[0084] <Technology 4> further comprising an input unit for receiving feedback on a result of analyzing the image, The image analysis unit Analyzing the abnormality level using an image analysis algorithm using artificial intelligence; and updating the image analysis algorithm for estimating the abnormality level based on the content of the feedback input to the input unit. The state estimation system according to any one of the first to third aspects.

[0085] <Technology 5> displaying, on a display unit, a map showing at least the location information and the abnormality level associated with the location information; The state estimation system according to any one of the first to fourth aspects.

[0086] <Technology 6> When the abnormality level is equal to or higher than a predetermined level, the notification unit notifies an outside device that the abnormality level is equal to or higher than a predetermined level. The state estimation system according to any one of the first to fifth aspects.

[0087] <Technology 7> A management unit that manages the state of the outdoor lighting device in City GML (Generalized Markup Language) format. The state estimation system according to any one of the first to sixth aspects.

[0088] <Technology 8> an acquisition unit that acquires an image of the outdoor lighting device and location information indicating a location where the image was captured; an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured, and a communication unit that transmits the image captured by the acquisition unit and location information indicating a location where the image was captured to a state estimation system that is capable of outputting the abnormality level of the outdoor lighting device; Cloud server.

[0089] <Technology 9> an acquisition step of acquiring an image of the outdoor lighting device and location information indicating a location where the image was acquired; and a communication step of transmitting the image acquired in the acquisition step and location information indicating a location where the image was captured to a state estimation system that includes an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured, and that is capable of outputting the abnormality level of the outdoor lighting device. Communication methods.

[0090] <Technology 10> To execute the communication method described in Technology 9 in a computer system, program.

[0091] <Technology 11> A method for controlling a terminal device having a camera and a position information acquisition function, comprising: a photographing step of photographing an outdoor lighting device by the camera based on an operation of a user of the terminal device; and transmitting the image based on an operation of a user of the terminal device to a state estimation system including an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the captured outdoor lighting device, and that is capable of outputting the abnormality level of the outdoor lighting device, or to a cloud server that is capable of communicating with the state estimation system. A method for controlling a terminal device.

[0092] <Technology 12> To cause a computer system to execute the control method described in Technology 11, program.

[0093] In addition, the present disclosure also includes forms obtained by applying various modifications to the above-described embodiments that a person skilled in the art may conceive, and forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the spirit of the present disclosure. [Explanation of symbols]

[0094] 1, 1a State Estimation System 5. Outdoor lighting equipment 11 Acquisition Department 12 Image Analysis Section 13 Storage section 15. Notification Department 16 Display section 17 Input section 18 Management Department

Claims

1. A state estimation system for estimating a state of an outdoor lighting device, comprising: an acquisition unit that acquires an image of the outdoor lighting device and location information indicating a location where the image was taken; an image analysis unit that analyzes the image acquired by the acquisition unit to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured in the image, the image analysis unit outputs the image, the location information, and the abnormality level of the outdoor lighting device in association with each other; displaying, on a display unit, a map showing at least the location information and the abnormality level associated with the location information; The abnormality level includes a level indicating that the outdoor lighting device is normal. State estimation system.

2. the image analysis unit analyzes the image acquired by the acquisition unit to estimate the state of the outdoor lighting device and also estimate specifications of the outdoor lighting device. The state estimation system according to claim 1 .

3. further comprising an input unit for receiving feedback on a result of analyzing the image, The image analysis unit Analyzing the abnormality level using an image analysis algorithm using artificial intelligence; and updating the image analysis algorithm for estimating the abnormality level based on the content of the feedback input to the input unit. The state estimation system according to claim 1 or 2.

4. When the abnormality level is equal to or higher than a predetermined level, the notification unit notifies an outside device that the abnormality level is equal to or higher than a predetermined level. The state estimation system according to claim 1 or 2.

5. a management unit that manages the state of the outdoor lighting device in a CityGML (Generalized Markup Language) format; The state estimation system according to claim 1 or 2.

6. an acquisition unit that acquires an image of the outdoor lighting device and location information indicating a location where the image was captured; an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured, and a communication unit that transmits the image acquired by the acquisition unit and the location information indicating a location where the image was captured to a state estimation system that is capable of linking and outputting the image, the location information, and the abnormality level of the outdoor lighting device, displaying, on a display unit, a map showing at least the location information and the abnormality level associated with the location information; The abnormality level includes a level indicating that the outdoor lighting device is normal. Cloud server.

7. A communication method for a computer system operating as a cloud server, comprising: an acquisition step of acquiring an image of the outdoor lighting device and location information indicating a location where the image was captured; a communication step of transmitting the image acquired in the acquisition step and the location information indicating a location where the image was taken to a state estimation system that includes an image analysis unit that analyzes the image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured, and that is capable of linking and outputting the image, the location information, and the abnormality level of the outdoor lighting device, displaying, on a display unit, a map showing at least the location information and the abnormality level associated with the location information; The abnormality level includes a level indicating that the outdoor lighting device is normal. Communication methods.

8. A method for causing a computer system to execute the communication method according to claim 7, program.

9. A method for controlling a terminal device having a camera and a position information acquisition function, comprising: a photographing step of photographing an outdoor lighting device by the camera based on an operation of a user of the terminal device; a step of transmitting the image based on an operation of a user of the terminal device to a state estimation system that includes an image analysis unit that analyzes an image to estimate an abnormality level of the outdoor lighting device as a state of the outdoor lighting device captured, and that is capable of linking and outputting the image, location information indicating a location where the image was captured, and the abnormality level of the outdoor lighting device, or to a cloud server that is capable of communicating with the state estimation system; displaying, on a display unit, a map showing at least the location information and the abnormality level associated with the location information; The abnormality level includes a level indicating that the outdoor lighting device is normal. A method for controlling a terminal device.

10. A method for causing a computer system to execute the control method according to claim 9, program.

Images