Inspection support system

Abstract

To obtain an inspection support system that allows an inspection operator to perform inspection of instruments to be inspected without requiring the inspection operator to enter a building.SOLUTION: An inspection support system comprises: a photographing unit that photographs instruments to be inspected and outputs photographed images; a display output unit that outputs information for urging a user to photograph the instruments to be inspected by using the photographing unit; a first storage unit that stores facility information including the installation positions of the instruments to be inspected; and a second storage unit that stores inspection recording information in which the installation positions of the instruments to be inspected acquired from the facility information and the photographed images are associated with each other.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an inspection support system that supports the inspection of facilities or equipment installed in a building. [Background technology]

[0002] Periodic maintenance and inspection is required for equipment or devices such as fire alarm systems installed in buildings such as commercial buildings, office buildings, apartment buildings, etc. For example, as disclosed in Patent Document 1, in the maintenance and inspection of a fire alarm system, an inspection worker carrying a portable information terminal enters the building and inspects the detectors, which are the devices to be inspected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-140451 A Summary of the Invention [Problem to be solved by the invention]

[0004] Generally, inspections of target equipment are performed by specialized inspection workers, but if the inspection items include visual inspections, the inspection workers need to enter the building and rooms for the inspection. For example, if the target building is an apartment building or other dwelling, the inspection workers must coordinate a visit date with the residents, but scheduling is not easy. It is particularly difficult to coordinate visit dates with multiple residents within a set inspection period, and if the residents' desired visit dates overlap, it may be necessary to increase the number of inspection workers. In addition, inspection workers may have to visit the same building multiple times within the inspection period. This increases the inspection workers' workload.

[0005] For residents, arranging a visit date is a burdensome task, and some residents feel uncomfortable inviting inspection workers into their homes. If residents are unable to arrange a visit date for the inspection workers due to this background, the inspection workers will not be able to inspect the equipment to be inspected, which could result in the equipment not working properly when needed.

[0006] The present invention has been made in light of the above-mentioned problems, and provides an inspection support system that enables an inspection worker to inspect a target device without entering a building. [Means for solving the problem]

[0007] The inspection support system of the present invention includes an imaging unit that photographs an equipment to be inspected and outputs the photographed image, a display output unit that outputs information prompting a user to photograph the equipment to be inspected using the imaging unit, a first memory unit that stores equipment information including the installation position of the equipment to be inspected, and a second memory unit that stores inspection record information that corresponds the installation position of the equipment to be inspected obtained from the equipment information with the photographed image. Effect of the Invention

[0008] The inspection support system of the present invention encourages the user to take a picture of the equipment to be inspected. Since the system records inspection record information that associates the installation position of the equipment to be inspected with the photographed image, the inspection worker can perform the inspection work based on the recorded information without entering the building. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of an inspection support system according to an embodiment. [Diagram 2] 1 is a functional block diagram of an inspection support system according to an embodiment. [Diagram 3] FIG. 4 is a diagram illustrating an example of facility information according to an embodiment. [Figure 4] FIG. 11 is a diagram illustrating an example of inspection record information according to the embodiment. [Diagram 5] 10A to 10C are diagrams illustrating the flow of operations in a captured image acquisition process according to an embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a photographing prompting screen displayed on the mobile terminal according to the embodiment; [Figure 7] FIG. 11 is a diagram showing an example of a shooting screen displayed on a mobile terminal according to an embodiment. [Figure 8] FIG. 11 is a diagram illustrating an operation flow of an inspection process according to an embodiment. [Figure 9] 11 is a diagram illustrating a flow of a process for adjusting a visit schedule for an inspection worker to a user according to an embodiment. FIG. [Figure 10] FIG. 11 is a diagram showing an example of an inspection report according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiment, and various modifications can be made without departing from the spirit of the present invention. The present invention also includes all combinations of possible configurations among the configurations shown in the following embodiment. The device shown in the drawings is an example of the device of the present invention, and the device of the present invention is not limited to the device shown in the drawings. In each drawing, the same reference numerals are used to denote the same or equivalent parts, and this is common throughout the entire specification.

[0011] Embodiment (System Configuration) FIG. 1 is a diagram for explaining a configuration example of an inspection support system 100 according to an embodiment. In this embodiment, a system example will be explained in which a visual inspection of a detector 5, which is an example of an inspection target device, can be performed without an inspection worker entering a building in which the detector 5 is installed. The inspection support system 100 of this embodiment includes a mobile terminal 1 used by a user in a room in which the detector 5 is installed, a server device 2, and an operation terminal 3 used by an inspection worker. The mobile terminal 1, the server device 2, and the operation terminal 3 are communicatively connected via a network 4 that is the Internet, a telephone communication network, a dedicated communication line, or a combination of these.

[0012] The mobile terminal 1 is used by a user of the dwelling unit in which the detector 5 is installed to photograph the detector 5, and transmits the photographed images to the server device 2. The mobile terminal 1 is realized by a portable terminal such as a smartphone or a tablet computer. The server device 2 manages information including the photographed images transmitted from the mobile terminal 1, and transmits information required for inspection to the operation terminal 3. The operation terminal 3 obtains information such as the photographed images managed by the server device 2, and inputs the inspection results of the detector 5. The operation terminal 3 is, for example, a laptop computer, a desktop computer, a smartphone, a tablet computer, or a terminal dedicated to inspection work.

[0013] FIG. 2 is a functional block diagram of an inspection support system 100 according to an embodiment.

[0014] (Mobile device 1) The mobile terminal 1 includes a control unit 11, a storage unit 12, a communication unit 13, an image capturing unit 14, a position information acquiring unit 15, a display unit 16, and an operation unit 17.

[0015] The control unit 11 is a processing device that controls each unit included in the mobile terminal 1, and is configured with a processor such as a CPU (Central Processing Unit) that executes programs stored in memory. The control unit 11 includes an image management unit 111 and a display output unit 112. The functions of the image management unit 111 and the display output unit 112 are realized by the control unit 11 reading and executing a dedicated application program that has been installed in advance.

[0016] The image management unit 111 outputs a shooting instruction to the shooting unit 14, and also associates the captured image, which is the image captured by the shooting unit 14, with the shooting position acquired by the position information acquisition unit 15, and stores and manages the image in the memory unit 12.

[0017] The display output unit 112 generates data to be displayed on the display unit 16, and outputs the generated data to the display unit 16. The display output unit 112 generates data to be displayed on the display unit 16, based on various information (described later) output from the server device 2. The display output unit 112 may extract necessary data from the display data included in the application program of the mobile terminal 1.

[0018] The storage unit 12 stores data and programs used for control by the control unit 11, and also stores images captured by the imaging unit 14 and data on the shooting position acquired by the position information acquisition unit 15. The storage unit 12 is a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, or an external storage medium such as a memory card, or a combination of these.

[0019] The communication unit 13 is a communication interface circuit for communicating with the server device 2 or the operation terminal 3 via the network 4. The communication unit 13 outputs data acquired from the network 4 to the control unit 11, and transmits data output from the control unit 11 to the server device 2 or the operation terminal 3 via the network 4.

[0020] The photographing unit 14 is a camera built into the mobile terminal 1, which photographs still images or videos and stores them as photographed images. Note that the photographing unit 14 may be a camera module provided separately from the mobile terminal 1 and connected to the mobile terminal 1 via a cable or short-range wireless communication.

[0021] The position information acquisition unit 15 acquires the photographing position, which is the position where the photographing unit 14 photographed the inspection target device. In this embodiment, the photographing position is the position of the mobile terminal 1. The position information acquisition unit 15 is, for example, a GPS receiver that detects the position of the mobile terminal 1 based on radio waves from a satellite. The position information acquisition unit 15 may acquire the photographing position based on an input from a user. In this case, the display unit 16 displays a screen that prompts the input of the photographing position, such as an address, and the photographing position input by the user to the operation unit 17 is acquired by the position information acquisition unit 15. The position information acquisition unit 15 may also acquire the photographing position based on a two-dimensional code attached to the sensor 5. In this case, a two-dimensional code including information on the installation position is attached to the sensor 5 in advance, and the position information acquisition unit 15 reads the installation position of the sensor 5, i.e., the information on the photographing position, from the image of the two-dimensional code photographed by the imaging unit 14.

[0022] Display unit 16 is a device that displays information to the user, and is a display device capable of displaying graphics, such as a liquid crystal display, an organic EL display, or electronic paper. Note that, in the present embodiment, an example is shown in which information is visually presented to the user who uses mobile terminal 1 using display unit 16, but in addition to display unit 16, audio information may be output by a speaker (not shown).

[0023] The operation unit 17 receives operation input from the user. The operation unit 17 is a touch panel, a hardware key, or a combination of these. In this embodiment, the operation unit 17 will be described as a touch panel superimposed on the screen of the display unit 16.

[0024] (Server device 2) The server device 2 includes a control unit 21, a first storage unit 22, a second storage unit 23, a third storage unit 24, and a communication unit 25.

[0025] The control unit 21 is a processing device that controls each unit included in the server device 2, and is configured with a processor such as a CPU that executes programs stored in a memory. The control unit 21 includes an inspection record information generation unit 211, an information output unit 212, an image determination unit 213, a date management unit 214, a schedule adjustment unit 215, and a report output unit 216.

[0026] The inspection record information generating unit 211 generates inspection record information by associating the photographed image and the photographing position acquired from the mobile terminal 1 with the installation position of the inspection target device, and also associates the inspection result acquired from the operation terminal 3 with the inspection record information. The inspection record information is stored in the second storage unit 23.

[0027] The information output unit 212 generates and outputs information to be displayed to the user on the mobile terminal 1 and information to be displayed to an inspection worker on the operation terminal 3. The information output from the information output unit 212 is transmitted to the mobile terminal 1 or the operation terminal 3 via the communication unit 25. The information output unit 212 generates information to be output based on information from the image determination unit 213, the date management unit 214, the schedule adjustment unit 215, and the report output unit 216.

[0028] The image determination unit 213 performs image determination as to whether or not the captured image captured by the photographing unit 14 of the mobile terminal 1 meets the requirements necessary for visual inspection by the inspection worker. If the size of the inspection target device in the captured image is too small, only a part of the inspection target device is photographed, or the image is too dark, the inspection worker cannot visually inspect the inspection target device. For this reason, the image determination unit 213 determines whether or not the size of the inspection target device in the captured image, the brightness of the image, etc. meet predetermined conditions. The captured image that is determined by the image determination unit 213 to meet the requirements is managed as inspection record information by the inspection record information generation unit 211, and the captured image that is determined not to meet the requirements is discarded. If it is determined that the captured image does not meet the requirements, information prompting the user to retake the image is output from the information output unit 212 to the mobile terminal 1.

[0029] In this way, the image determination unit 213 determines whether the captured image satisfies the requirements, and if the requirements are not satisfied, the user is prompted to retake the image, allowing the inspection worker to obtain a captured image suitable for the inspection, thereby improving the accuracy of the inspection. Furthermore, it is preferable to output information prompting the user to retake the image before the inspection worker starts the inspection, that is, before the captured image is stored in the second storage unit 23 as inspection record information. In this way, after the inspection worker starts the inspection, the inspection work can be smoothly carried out, and an increase in the number of steps related to the inspection work can be suppressed.

[0030] The deadline management unit 214 manages the date of photography by the photography unit 14 for each inspection target device. In general, for a building in which multiple inspection target devices are installed, an inspection period is determined for each building or floor. The photography date is a date determined in advance to complete the inspection within the inspection period. In this embodiment, a photography period spanning multiple days is determined in advance for each inspection target device, and the first day of the photography period is called the first deadline, and the last day of the photography period, i.e., the photography date, is called the second deadline. The deadline management unit 214 includes a timer circuit (not shown), recognizes the date and time using this timer circuit, and determines that the first deadline and the second deadline have arrived based on the date and time. In addition to the first deadline and the second deadline, the deadline management unit 214 may manage a date prior to the first deadline as a notice date for the photography period for the user.

[0031] When the captured image of the inspection target device cannot be acquired within the image capturing period, the schedule adjustment unit 215 adjusts the schedule for the inspection worker to visit the user. When the deadline management unit 214 detects that the second deadline has arrived with no captured image acquired, the schedule adjustment unit 215 prompts the operation terminal 3 to input a candidate visit date, and transmits the candidate visit date transmitted from the operation terminal 3 to the mobile terminal 1. Furthermore, the schedule adjustment unit 215 acquires a desired visit date selected by the user from the candidate visit dates, and transmits the acquired desired visit date to the operation terminal 3, thereby notifying the inspection worker of the desired visit date.

[0032] Furthermore, the schedule adjustment unit 215 may store already determined visit dates for each building, and when prompting the operation terminal 3 to input a candidate visit date, if there is an already determined visit date, the schedule adjustment unit 215 may also transmit information about the determined visit date to the operation terminal 3. In this way, the inspection worker using the operation terminal 3 can select a candidate visit date taking into consideration the already determined visit date, improving the convenience for the inspection worker.

[0033] In this embodiment, an example is shown in which the inspection worker (operation terminal 3) selects candidate schedule dates and the user (mobile terminal 1) selects the desired visit date from the candidate schedule dates, but the roles of the inspection worker (operation terminal 3) and the user (mobile terminal 1) may be reversed.

[0034] The report output unit 216 generates and outputs an inspection report based on the inspection record information. The report output by the report output unit 216 is stored in the third storage unit 24. In response to a request from the operation terminal 3, the report output unit 216 transmits the generated report to the operation terminal 3.

[0035] The communication unit 25 is a communication interface circuit for communicating with the mobile terminal 1 or the operation terminal 3 via the network 4. The communication unit 13 outputs data acquired from the network 4 to the control unit 21, and transmits data output from the control unit 21 to the mobile terminal 1 or the operation terminal 3 via the network 4.

[0036] The first storage unit 22, the second storage unit 23, and the third storage unit 24 are non-volatile or volatile semiconductor memories such as RAM, ROM, flash memory, EPROM, EEPROM, etc., or external storage media such as memory cards, or combinations thereof. The first storage unit 22, the second storage unit 23, and the third storage unit 24 store equipment information, inspection record information, and reports, respectively.

[0037] FIG. 3 is a diagram for explaining an example of facility information 60 according to an embodiment. The facility information 60 is information for managing inspection target equipment and its installation location. The facility information 60 according to this embodiment includes an ID 61, a device name 62, an address 63, a room 64, and manager information 65. The ID 61 is information uniquely assigned to the inspection target equipment. The device name 62 is the name of the inspection target equipment, for example, a type name of the equipment, such as a detector or a transmitter. The address 63 and the room 64 are information indicating the installation location where the inspection target equipment is installed. In this embodiment, the installation location is indicated by the address 63 and the room 64, but the installation location may be indicated by information in which the address 63 and the room 64 are integrated. The manager information 65 is the contact information of the user who manages the inspection target equipment. When the inspection target equipment is a detector 5 installed in a dwelling, the contact information of the user who is the resident is recorded in the manager information 65. The user's contact information in the manager information 65 is information that becomes the destination when information is transmitted from the server device 2 to the mobile terminal 1. The administrator information 65 may further include the user's name, telephone number, etc. The facility information 60 only needs to include an ID 61 that identifies the equipment to be inspected and its installation location (address 63 and room 64), and other information may be omitted, or may further include other information used for generating an inspection report, etc.

[0038] The equipment information 60 is created in advance, for example, by an inspector of the equipment to be inspected, and is stored in the first storage unit 22 (see FIG. 2). The inspector creates the equipment information 60 based on an equipment diagram drawn when the building was constructed or remodeled. Note that, although the equipment information 60 is shown in table form in FIG. 3, the equipment information 60 may be in the form of an equipment diagram or a map. For example, the equipment to be inspected and its installation location may be shown on the equipment diagram of the building.

[0039] FIG. 4 is a diagram for explaining an example of inspection record information 70 according to an embodiment. The inspection record information 70 is information in which inspection information 70a and inspection result information 70b are paired. The inspection information 70a includes an inspection target device and its photographed image, and the inspection result information 70b is information indicating an inspection result by an inspection worker based on the inspection information 70a. Specifically, the inspection information 70a according to the present embodiment includes an ID 71, an installation position 72, a photographed date 73, a photographed position 74, and a photographed image 75, and the inspection result information 70b includes an inspection date 76 and an inspection result 77.

[0040] ID 71 is information uniquely assigned to the inspection target equipment, and is the same as ID 61 shown in FIG. 3. Installation position 72 is information indicating the installation position where the inspection target equipment is installed, and is information extracted from facility information 60 shown in FIG. 3. Photographing date 73 is the date on which the user photographed the inspection target equipment using the photographing unit 14 of the mobile terminal 1, and is acquired from the mobile terminal 1 together with the photographed image. Photographing position 74 is the photographing position of the inspection target equipment, and is acquired from the mobile terminal 1 together with the photographed image. Photographed image 75 is image data photographed by the photographing unit 14 of the mobile terminal 1.

[0041] The inspection date 76 is the date when the inspection worker inspected the equipment to be inspected, and is obtained from the operation terminal 3. The inspection result 77 is the result of the inspection worker inspecting the equipment to be inspected, and is obtained from the operation terminal 3. If the inspection has not been performed, information indicating that the inspection has not been performed, such as "not performed", is recorded in the inspection date 76 and the inspection result 77, as shown in FIG.

[0042] For one inspection target device, the photographed images used in the inspection and the inspection results may be managed in history. For example, when multiple inspections are performed on one inspection target device, the photographed date 73, photographed location 74, photographed image 75, inspection date 76, and inspection result 77 are recorded for multiple inspections for one set of ID 71 and installation location 72. In this way, the inspection worker can check the inspection history of the inspection target device over a long period of time.

[0043] (Operation terminal 3) 2, a description will be given of the operation terminal 3. The operation terminal 3 includes a display unit 31, an input unit 32, a control unit 33, and a communication unit .

[0044] The display unit 31 is a device that displays information to the user, and is a display device capable of displaying graphics, such as a liquid crystal display, an organic EL display, or electronic paper.

[0045] The input unit 32 receives information input from an inspection worker and is a keyboard, a mouse, a touch panel, or a combination of these.

[0046] The control unit 33 is a processing device that controls each unit included in the operation terminal 3, and is configured with a processor such as a CPU that executes a program stored in a memory. The control unit 33 includes an inspection processing unit 331.

[0047] The inspection processing unit 331 displays the captured images acquired from the server device 2 on the display unit 31, and acquires and manages the inspection results inputted by the inspection worker to the input unit 32. The inspection processing unit 331 transmits the inspection results to the server device 2 via the communication unit 34.

[0048] (Image acquisition processing) 5 is a diagram illustrating the flow of operations for acquiring a captured image according to an embodiment of the present invention. An example of an acquisition process of a captured image for inspection by the mobile terminal 1 and the server device 2 will be described with reference to FIG.

[0049] When the first date, which is the first day of the photography period for inspection, arrives (step S1), the server device 2 outputs photography request information to the mobile terminal 1 (step S2). The photography request information is information for encouraging the user of the mobile terminal 1 to photograph the equipment to be inspected. The photography request information includes the photography date (the second date, which is the last day of the photography period) and information for identifying the equipment to be inspected to be photographed.

[0050] The mobile terminal 1 that has acquired the photographing request information displays a photographing prompting screen that prompts the user to take a photograph based on the photographing request information (step S3). When the mobile terminal 1 receives the photographing request information, it starts a dedicated application that has been installed in advance, and displays the photographing prompting screen. Note that the server device 2 may transmit the photographing request information, which includes text requesting the user to take a photograph, to the mobile terminal 1 by email, and the user of the mobile terminal 1 may refer to the email and start the dedicated application.

[0051] FIG. 6 is a diagram showing an example of a photographing prompting screen 161 displayed on the mobile terminal 1 according to the embodiment. The photographing prompting screen 161 is displayed on the display unit 16 by the display output unit 112. The photographing prompting screen 161 includes elements E1, E2, E3a, E3b, E4, and E5. The element E1 is a message that prompts the user to take a photograph. The element E2 is a map such as a floor plan of the user's residence. The elements E3a and E3b are the installation positions of the inspection target devices. In the example of FIG. 6, the inspection target devices that have not been photographed are displayed in different forms, such as element E3a, and the inspection target devices that have been photographed are displayed in different forms, such as element E3b, to make it easier for the user to understand the photographing target. In particular, since the inspection target devices may be installed in places that are difficult to notice in daily life, such as in a closet, the element E3a of the photographing prompting screen 161 has a large effect of suppressing missed photographs. The element E4 is information indicating the installation position of the inspection target devices. Element E5 is a button to start photographing, and when element E5 is selected, the photographing unit 14 is activated and photographing becomes possible. For devices to be inspected such as common areas of an apartment building other than privately occupied areas, a representative such as the chairman of the board of directors or the manager of the apartment building may be the user, and the photographing prompting screen 161 may be displayed on the mobile terminal 1 of the representative. Also, the photographing prompting screen 161 may display the number of devices to be inspected or the number of devices to be inspected that have been photographed, or a message indicating that inspection is complete when photographing of all devices to be inspected has been completed.

[0052] The elements E1, E2, E3a, E3b, and E4 are transmitted from the server device 2 to the mobile terminal 1 based on the facility information 60 (see FIG. 3) stored in the first storage unit 22 (see FIG. 2) of the server device 2, and are displayed on the mobile terminal 1. The element E2, which is a map, and the elements E3a and E3b, which are inspection target devices, show the user the positions of the inspection target devices to be photographed.

[0053] In this way, by showing the user the position of the inspection target device to be photographed, it is possible to prevent missing an image of an inspection target device even if there are multiple inspection target devices.

[0054] Returning to Fig. 5, the description will be continued. The user of the mobile terminal 1 on which the photographing prompt screen 161 is displayed photographs the equipment to be inspected (step S4). Specifically, the user selects element E5 (photographing start button) shown in Fig. 6, which activates the photographing unit 14 and makes it possible to photograph.

[0055] Fig. 7 is a diagram showing an example of a photographing screen 162 displayed on the mobile terminal 1 according to the embodiment. The photographing screen 162 is displayed on the display unit 16 by the display output unit 112. The photographing screen 162 is an image captured by the photographing unit 14. The example of Fig. 7 illustrates a state in which a sensor is captured on the photographing screen 162. Furthermore, elements E10 and E11 are displayed on the photographing screen 162 of the present embodiment.

[0056] Element E10 is information indicating points to be noted by the user when photographing. Element E11 is a photographing guide, and is a figure indicating the size and angle of the inspection target device when photographing it. In the example of FIG. 7, element E10 guides the user to photograph the device so that the dashed line shape indicated by element E11 matches the outer shape of the inspection target device. Element E11 may include an example of a photographed image. Elements E10 and E11 are transmitted from the server device 2 to the mobile terminal 1 together with the photographing request information in step S2 of FIG. 5, or separately therefrom. In this way, elements E10 and E11 show the user how to photograph the inspection target device.

[0057] As in the present embodiment, by showing the user how to photograph the equipment to be inspected, even a user who is not familiar with photography can easily photograph images that can be used for inspection. By improving the quality of the photographed image, the inspection worker can obtain more accurate inspection results. In addition, since the number of times the user has to retake the photograph can be reduced, the user's effort in photographing can be reduced. In addition, in order to have the user photograph the equipment to be inspected from all directions, the element E10 may be configured to display a message urging the user to photograph together with the photographing direction multiple times. In addition, for example, when the equipment to be inspected is a sensor, the element E11 may display the sensor's confirmation light (not shown) as a mark for positioning, and when urging the user to photograph from different directions, the confirmation light may be displayed in different positions to show the user the photographing direction.

[0058] Returning to Fig. 5, the description will continue. When an image is captured in step S4, the mobile terminal 1 acquires the image capture position (step S5). As described in Fig. 2, when the position information acquisition unit 15 is a GPS receiver, it detects the position of the mobile terminal 1, and when the image capture position is acquired from a two-dimensional code, it prompts the user to capture the two-dimensional code attached to the equipment to be inspected, and reads the image capture position from the two-dimensional code. When the user is asked to input the image capture position, a screen prompting the user to input the image capture position is displayed on the display unit 16, and input from the user is accepted.

[0059] The photographing position acquired in step S5 is associated with the photographed image. Subsequently, when an operation to transmit the photographed image is performed on the mobile terminal 1 (step S6), the photographed image and the photographing position are transmitted to the server device 2 (step S7). Note that the mobile terminal 1 may receive input from the user regarding matters of concern or abnormalities regarding the inspection target device, and in this case, the information input by the user is transmitted to the server device 2 together with the photographed image, etc.

[0060] The server device 2 receives the photographed image and the photographing position (step S8), and stores the received photographed image, photographing position, and installation position in association with each other (step S9). In step S9, the photographed image, photographing position, and installation position are stored as inspection information 70a of the inspection record information 70 shown in Fig. 4. For example, the server device 2 extracts an installation position that matches the received photographing position from the equipment information 60, and sets the ID 61 associated with the extracted installation position (address 63 and room 64 in Fig. 3) together with information such as the installation position as the inspection information 70a.

[0061] Here, the captured images transmitted to the server device 2 in step S7 are limited to those captured from a screen that is started by selecting the element E5 "Start shooting" button in Fig. 6 using a dedicated application. Images that the user has saved in advance in the mobile terminal 1 cannot be transmitted to the server device 2 as captured images in step S7. Specifically, for example, the image management unit 111 attaches metadata to the captured images captured via the dedicated application, and transmits only the captured images with the metadata to the server device 2 with the captured location associated therewith. In this way, it is possible to prevent devices other than the original inspection target devices from being transmitted to the server device 2 and becoming the inspection target.

[0062] As described above, the inspection support system 100 of this embodiment includes a photographing unit 14 that photographs the equipment to be inspected and outputs the photographed image, a display output unit 112 that outputs information prompting the user to photograph the equipment to be inspected using the photographing unit, a first memory unit 22 that stores equipment information including the installation position of the equipment to be inspected, and a second memory unit 23 that stores inspection record information that associates the installation position of the equipment to be inspected obtained from the equipment information with the photographed image.

[0063] In this way, the inspection support system 100 of this embodiment prompts the user to take an image of the device to be inspected. Then, since the inspection record information that associates the installation position of the device to be inspected with the captured image is recorded, the inspection worker can perform the inspection work based on the recorded information without entering the building.

[0064] Furthermore, the inspection support system 100 of this embodiment includes a position information acquisition unit 15 that acquires the photographing position where the photographing unit 14 photographed the inspection target device. The installation position of the inspection target device acquired from the facility information in the first storage unit 22 and the photographed image and photographing position acquired from the mobile terminal 1 are associated with each other and stored in the second storage unit 23 as inspection record information, so that it is possible to avoid misidentifying the inspection target device. In other words, by confirming that the installation position of the inspection target device stored at the time of installation or the like matches the photographing position where the inspection target device was photographed, it is possible for the inspection worker to determine that the inspection target device in the photographed image is correct without visiting the building.

[0065] (Inspection process) Fig. 8 is a diagram illustrating an operational flow of the inspection process according to the embodiment. An example of an inspection using a captured image and a report creation process based on the inspection result by the operation terminal 3 and the server device 2 will be described with reference to Fig. 8.

[0066] The inspection worker performs an operation for acquiring the inspection data on the operation terminal 3 (step S10). This operation may be performed on a dedicated application for inspection or a general-purpose browser pre-installed on the operation terminal 3. Then, the operation terminal 3 transmits a request to transmit the inspection data to the server device 2 (step S11).

[0067] The server device 2 that has acquired the request to transmit the inspection data transmits the inspection data (step S12). The inspection data transmitted here includes data in which the captured image, the capture position, the installation position, and the ID stored in step S9 in Fig. 5 are associated with each other. In this embodiment, the server device 2 transmits the inspection information 70a in Fig. 4 to the operation terminal 3 as the inspection data.

[0068] The operation terminal 3 that has acquired the inspection data displays the inspection data on the display unit 31 (step S13). Specifically, at least the captured image, the captured position, and the installation position are displayed on the display unit 31. The inspection worker visually checks the inspection data and inputs the inspection result (step S14). Specifically, the inspection worker compares the captured position with the installation position to check whether they match. If the captured position and the installation position are different, there is a possibility that the user has captured a different device as the inspection target device, and the inspection worker inputs a result indicating that the inspection target is incomplete into the operation terminal 3. The inspection worker also visually checks the captured image, inspects predetermined items such as whether there is a defect or problem in the appearance of the inspection target device, and inputs the presence or absence of an abnormality. If the captured image is unclear or the intended inspection target device is not captured, the inspection worker inputs a result indicating that the captured image is incomplete into the operation terminal 3. The inspection items described here are only an example, and may be predetermined according to the inspection target device. Next, the operation terminal 3 transmits the inspection result together with the ID to the server device 2 (step S15).

[0069] The server device 2 that has received the inspection result records the inspection result in the inspection record information 70 (step S16). In detail, the inspection record information generating unit 211 of the server device 2 searches the inspection record information 70 shown in FIG. 4 using the ID included in the received inspection result as a key, and records the inspection result as the inspection result information 70b corresponding to the ID 71.

[0070] The processes shown in steps S10 to S16 may be performed for each inspection target device, or may be performed for multiple inspection target devices at once. In the latter case, a request to transmit the inspection data for the multiple inspection target devices is output in step S11, and the server device 2 transmits the inspection data for the multiple inspection target devices in step S12.

[0071] Next, the process of acquiring an inspection report including the inspection results will be described. The process of acquiring an inspection report can be executed at any timing after the inspection results are stored in step S16.

[0072] The inspection worker performs an operation to obtain the inspection report on the operation terminal 3 (step S17). This operation can be performed on a dedicated application or a general-purpose browser pre-installed on the operation terminal 3. Then, the operation terminal 3 transmits a request to transmit the inspection report to the server device 2 (step S18).

[0073] The server device 2 that has acquired the request to transmit the inspection report generates an inspection report and transmits it to the operation terminal 3 (step S19). In detail, the report output unit 216 of the server device 2 extracts data for which the inspection report is to be created from the inspection record information in the second storage unit 23, and generates the inspection report in a determined format. Note that, in step S17, the inspection worker may specify information to be included in the inspection report from the inspection record information in the second storage unit 23. In addition, the report output unit 216 of the server device 2 may generate an inspection report at any timing after the inspection results are saved, store it in the third storage unit 24, and transmit the stored inspection report in response to a request from the operation terminal 3 in step S19.

[0074] The operation terminal 3 receives the inspection report and displays it on the display unit 31 (step S20). The inspection worker may save the received inspection report as data in the operation terminal 3, or may print it out. The operation terminal 3 may be provided with a function for sending the inspection report by email or the like to a public institution or manager that has jurisdiction over the building.

[0075] (Adjustment of visit schedule) The inspection support system 100 of this embodiment allows an inspection worker to perform a visual inspection based on the image of the inspection target device taken by the user as described above, so that the inspection of the inspection target device is performed without the inspection worker visiting the user. However, even if the image taking prompt screen is displayed on the mobile terminal 1, there may be a user who does not take an image and transmits it, or who forgets to do so. In that case, the inspection target device of the user will not be inspected. For this reason, the inspection support system 100 of this embodiment supports the adjustment of the visit schedule of the inspection worker between the user using the mobile terminal 1 and the inspection worker using the operation terminal 3. This allows the inspection target device to be inspected by the inspection worker's visit.

[0076] 9 is a diagram for explaining the flow of a process for adjusting a visit schedule for a user by an inspection worker according to an embodiment. When the second date, which is the photographing date, arrives (step S21), the server device 2 requests the operation terminal 3 to set potential visit dates for a user associated with the mobile terminal 1 that has not received a photographed image (step S22). Specifically, the server device 2 uses a dedicated application or email or the like to transmit request information for setting potential visit dates, and prompts the inspection worker using the operation terminal 3 to input potential visit dates.

[0077] An inspection worker using the operation terminal 3 inputs one or more candidate visit dates to the operation terminal 3 (step S23). The input candidate visit dates are transmitted from the operation terminal 3 to the server device 2 (step S24).

[0078] When the server device 2 receives the candidate visit dates, it outputs information prompting the mobile terminal 1 to decide on a visit schedule (step S25).

[0079] When the mobile terminal 1 acquires information prompting the user to decide on a visit date, it displays a schedule adjustment screen (step S26). The schedule adjustment screen displays one or more potential visit dates and a message prompting the user to select one of them. When the user inputs a desired date selected from the potential visit dates (step S27), the selected desired date is transmitted from the mobile terminal 1 to the server device 2 (step S28). Note that if an image is captured and transmitted from the mobile terminal 1 to the server device 2 after the schedule adjustment screen is displayed in step S26, the schedule adjustment is canceled.

[0080] The server device 2 determines the received desired schedule as a visit schedule and transmits it to the operation terminal 3 (step S29). This allows the inspection worker using the operation terminal 3 to recognize the visit schedule.

[0081] In FIG. 9, the process flow is described assuming that the candidate visit dates input by the inspection worker match the user's desired schedule, but there may be cases where none of the candidate visit dates match the user's desired schedule. In this case, the mobile terminal 1 prompts the user to input another candidate visit date, transmits the input candidate visit date to the operation terminal 3 via the server device 2, and the inspection worker determines the visit date from among the candidate visit dates. This also makes it possible to support coordination of the visit schedule between the user and the inspection worker.

[0082] (Example of inspection report) FIG. 10 is a diagram showing an example of an inspection report according to the embodiment. The inspection report may be a table-format report in which the inspection target equipment, the photographed image, and the inspection result are associated with each other, but may also include a map as shown in FIG. 10. The inspection report 80 shown in FIG. 10 includes a facility diagram 81 of a building, an inspection target equipment 82 included in the facility diagram 81, and a photographed image 83 photographed by a user. The facility diagram 81 is a drawing created in units such as floors of a building, and is an example of a map showing the installation locations of the inspection target equipment. The facility diagram 81 is stored in advance in the third storage unit 24 of the server device 2 as data for the report in the form of image data or CAD data. The inspection target equipment 82 shown in FIG. 10 is a diagram showing a symbol of a sensor, but characters showing the inspection target equipment may be displayed as the inspection target equipment 82.

[0083] According to the inspection report 80 illustrated in FIG. 10, the inspection target device 82 and its captured image 83 are displayed in association with each other on the facility diagram 81, making it easier to visually grasp the inspection results.

[0084] (Variation 1) In the embodiment, an example has been shown in which the inspection support system 100 is configured with a mobile terminal 1, a server device 2, and an operation terminal 3. However, the specific device configuration for realizing each function of the inspection support system 100 is not limited to the example of the embodiment. For example, the functions of the server device 2 and the operation terminal 3 may be realized by one device, or some of the functions of the server device 2 may be realized by the mobile terminal 1 or the operation terminal 3. In addition, the functions of the server device 2 may be realized by a plurality of devices. In addition, the first storage unit 22, the second storage unit 23, and the third storage unit 24 may be distributed and arranged in a cloud server connected to the server device 2 via the network 4.

[0085] (Variation 2) In the embodiment, when the captured image cannot be acquired from the mobile terminal 1 associated with the inspection target device even on the second date, which is the last day of the image capturing period, the adjustment of the visit schedule of the inspection worker is supported. However, the user may be allowed to select whether to capture the image or to accept the visit of the inspection worker on the first date or before that. Specifically, when the date management unit 214 of the server device 2 detects that the first date or a predetermined date earlier than that has arrived, the information output unit 212 outputs to the mobile terminal 1 information on the inspection and inquiring whether the user will capture the image or the inspection worker will visit. The mobile terminal 1 displays the received information on the display unit 16 and confirms the user's preference. When the user inputs to the operation unit 17 that the captured image is desired, the process is executed following the explanation of FIG. 5. Also, when the user inputs to the operation unit 17 that the user will desire the visit of the inspection worker, the process is executed following the explanation of FIG. 9.

[0086] In this way, by allowing users to select the inspection method for the equipment to be inspected, users can select their preferred method based on their lifestyle, their strengths and weaknesses in photography, etc., thereby improving convenience for more users.

[0087] (Variation 3) In the embodiment, the location information acquisition unit 15 of the mobile terminal 1 acquires the photographing location using a GPS, an input from a user, or a two-dimensional code attached to the inspection target device. Instead of these, the photographing location may be acquired as follows. First, the inspection target device is provided with a short-distance wireless communication module such as a beacon, and transmits an ID that identifies the device. The mobile terminal 1 is provided with a communication module that receives a short-distance wireless signal transmitted from the inspection target device, and transmits the ID received when photographing the inspection target device to the server device 2 together with the photographed image. The server device 2 recognizes the photographing location of the inspection target device by referring to the facility information 60 (see FIG. 3) that associates the ID of the inspection target device with its installation location. That is, in this example, the mobile terminal 1 transmits the ID of the inspection target device to the server device 2 instead of the specific photographing location, and the server device 2 recognizes the specific photographing location. In this case, the communication module that receives the short-distance wireless signal of the mobile terminal 1 and the server device 2 function as a location information acquisition unit that acquires the photographing location. By doing so, there is no need to communicate the specific shooting location, i.e., the address which is the personal information of the resident, between the mobile terminal 1 and the server device 2. Alternatively, a barcode or two-dimensional code including an ID identifying the sensor 5 as information may be affixed to the sensor 5, the ID may be read by the mobile terminal 1 as described above, and the ID may be transmitted to the server device 2 together with the captured image, and the server device 2 may refer to the facility information 60 and recognize the shooting location based on the received ID. In this case, the photographing unit 14 which photographs the barcode or two-dimensional code, the reading unit which reads the ID, and the server device 2 function as a location information acquiring unit which acquires the shooting location.

[0088] (Variation 4) In the embodiment, it has been described that the inspection worker visually inspects the captured image. In addition to or instead of the visual inspection by the inspection worker, the captured image may be automatically inspected. Specifically, the inspection support system 100 includes an image recognition unit that compares a captured image taken for inspection with a normal image, which is an image of the inspection target equipment in a normal state, and determines whether or not there is an abnormality in the inspection target equipment in the captured image. The image recognition unit is realized by the server device 2, the operation terminal 3, or a device other than these in the embodiment. The judgment result of the image recognition unit is output to the operation terminal 3 and presented to the inspection worker. The report output unit 216 may generate an inspection report including the judgment result of the image recognition unit. In this way, by inspecting the inspection target equipment by image recognition, even small abnormalities that are difficult to see with the naked eye can be conveyed to the inspection worker. [Explanation of symbols]

[0089] 1 Mobile terminal, 2 Server device, 3 Operation terminal, 4 Network, 5 Sensor, 11 Control unit, 12 Memory unit, 13 Communication unit, 14 Photographing unit, 15 Location information acquisition unit, 16 Display unit, 17 Operation unit, 21 Control unit, 22 First memory unit, 23 Second memory unit, 24 Third memory unit, 25 Communication unit, 31 Display unit, 32 Input unit, 33 Control unit, 34 Communication unit, 60 Facility information, 61 ID, 62 Equipment name, 63 Address, 64 Room, 65 Administrator information, 70 Inspection record information, 71 ID, 70a Inspection information, 70b Inspection result information, 72 Installation location, 73 Photographing date, 74 Photographing location, 75 Photographed image, 76 Inspection date, 77 Inspection result, 80 Inspection report, 81 Facility diagram, 82 Inspected equipment, 83 Photographed image, 100 Inspection support system, 111 image management section, 112 display output section, 161 photography prompting screen, 162 photography screen, 211 inspection record information generation section, 212 information output section, 213 image judgment section, 214 deadline management section, 215 schedule adjustment section, 216 report output section, 331 inspection processing section.

Claims

1. an image capturing unit that captures an image of the inspection target device and outputs the captured image; a display output unit that outputs information that prompts a user to photograph the inspection target device using the photographing unit; A first storage unit that stores facility information including an installation location of the inspection target device; A second storage unit that stores inspection record information in which the installation position of the inspection target device acquired from the facility information is associated with the photographed image. Inspection support system.

2. A position information acquisition unit that acquires an image capturing position where the image capturing unit captures the image of the inspection target device, The second storage unit stores the inspection record information in which the installation position of the inspection target device, the photographed image, and the photographed position are associated with each other. The inspection support system according to claim 1.

3. The display output unit is Outputting either or both of information indicating the position of the inspection target device to be photographed and information instructing a method of photographing the inspection target device. The inspection support system according to claim 1.

4. an image determination unit that determines whether the captured image captured by the imaging unit satisfies a requirement, The display output unit is When the image determination unit determines that the captured image does not satisfy the requirements, information is output to prompt the user to retake the image. The inspection support system according to claim 1.

5. a date management unit that manages the photographing date of the photographing unit for each of the inspection target devices; and a schedule adjustment unit that outputs information to a user to prompt the user to decide a visit schedule for an inspection worker when the photographing date arrives and the photographed image is not output from the photographing unit. The inspection support system according to any one of claims 1 to 4.

6. A report output unit that outputs an inspection report of the inspection target device based on the inspection record information stored in the second storage unit. The inspection support system according to any one of claims 1 to 4.

7. The inspection report shall: The inspection target device includes a map showing an installation position of the inspection target device, and the photographed image displayed at the installation position of the inspection target device on the map. The inspection support system according to claim 6.

Images