Determination device, determination method, determination program, and determination system

Abstract

To provide a determination device for determining work contents.SOLUTION: A determination device includes: a detection part for detecting a difference between a first image obtained by imaging a device before a change based on change information and a second image obtained by imaging the device after the change based on the change information; a specification part for specifying correspondence between device information corresponding to the change information in metadata of the device and the difference; and a determination part for determining whether or not the difference corresponds to the change information on the basis of the correspondence between the device information and the difference.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present disclosure relates to a determination device, a determination method, a determination program, and a determination system. [Background technology]

[0002] Patent Document 1 describes a construction management system in which a person in charge of construction checks the details of construction work from a remote location when the person in charge is absent from the construction site. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-000278 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the construction management system described in Patent Document 1 requires the person in charge to check image data of the construction status together with the prime contractor.

[0005] The present disclosure aims to provide a determination device that solves the above-mentioned problems. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, there is provided a determination device comprising: a detection unit that detects a difference between a first image captured of a device before a change based on change information is made and a second image captured of the device after the change based on the change information is made; an identification unit that identifies a correspondence between device information in the metadata of the device that corresponds to the change information and the difference; and a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0007] According to one aspect of the present disclosure, there is provided a determination method comprising: a detection step of detecting a difference between a first image of a device before a change based on change information is made and a second image of the device after the change based on the change information is made; an identification step of identifying a correspondence between device information in the metadata of the device that corresponds to the change information and the difference; and a determination step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0008] According to one aspect of the present disclosure, there is provided a judgment program comprising: a detection step of detecting a difference between a first image of a device before a change based on change information is made and a second image of the device after the change based on the change information is made; an identification step of identifying a correspondence between device information in the metadata of the device that corresponds to the change information and the difference; and a judgment step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0009] According to one aspect of the present disclosure, there is provided a determination system comprising: a detection unit that detects a difference between a first image taken by a terminal of a device before changes based on change information are made and a second image taken by the terminal of the device after changes based on the change information have been made; an identification unit that identifies a correspondence between device information in the device's metadata that corresponds to the change information and the difference; a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference; and a notification unit that adds information indicating an area that corresponds to the difference to the second image and notifies the terminal of the determination made by the determination unit and the information indicating the area; and if the determination unit determines that the difference does not correspond to the change information, the notification unit adds a display to the second image indicating the difference that does not correspond to the change information based on the difference and the change information. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to provide a determination device that determines whether or not the work content matches the change information. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic diagram illustrating a determination system according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a schematic diagram illustrating a workflow according to one embodiment of the present disclosure. [Figure 3] FIG. 1 is a block diagram illustrating a terminal according to an embodiment of the present disclosure. [Figure 4] FIG. 2 is a block diagram illustrating a server according to one embodiment of the present disclosure. [Figure 5] FIG. 2 is a block diagram illustrating functional units of a server according to an embodiment of the present disclosure. [Figure 6] 1 is a schematic diagram illustrating an example of an apparatus according to an embodiment of the present disclosure. [Figure 7] FIG. 2 illustrates an example of metadata for a device according to an embodiment of the present disclosure. [Figure 8] 10 is a sequence chart illustrating a determination process according to an embodiment of the present disclosure. [Figure 9] FIG. 2 is a schematic diagram illustrating an example of a display screen of an application according to an embodiment of the present disclosure. [Figure 10] 1 is a schematic diagram illustrating a portion of an apparatus before operation according to one embodiment of the present disclosure. [Figure 11] 1 is a schematic diagram illustrating a portion of an apparatus after operation according to one embodiment of the present disclosure. [Figure 12] FIG. 10 is a schematic diagram illustrating an example of a notification display according to an embodiment of the present disclosure. [Figure 13] FIG. 1 is a block diagram illustrating a determination system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, a determination system according to an embodiment of the present disclosure will be described with reference to the drawings. In all the drawings, the same or corresponding components are designated by the same reference numerals, and common descriptions will be omitted.

[0013] [First embodiment] 1 is a schematic diagram showing a determination system according to an embodiment of the present disclosure. The determination system 1 includes a terminal 2A, a terminal 2B, and a server 3. In this embodiment, the terminal 2A, the terminal 2B, and the server 3 are connected via a network 9 so as to be able to communicate with each other.

[0014] Terminal 2A is an information processing device used by a worker at the work site, and transmits and receives data to and from terminal 2B and server 3. Terminal 2A may be, for example, a personal computer, laptop computer, tablet computer, smartphone, etc. In this embodiment, one terminal 2A is shown in FIG. 1, but the number of terminals 2A is not limited to one. For example, multiple workers may each have a terminal 2A. Multiple terminals 2A may communicate with server 3 and terminal 2B. Terminal 2A transmits image data or video data of device 5 captured at the work site to terminal 2B or server 3.

[0015] Terminal 2B is an information processing device used by a conductor at a location different from the work site, and transmits and receives data to and from terminal 2A and server 3. Terminal 2B may be, for example, a personal computer, laptop computer, workstation, hardware server, tablet computer, smartphone, etc. In this embodiment, one terminal 2B is shown in FIG. 1, but the number of terminals 2B is not limited to one. For example, multiple conductors may each have a terminal 2B. Multiple terminals 2B may communicate with terminal 2A and server 3. Terminal 2B, at a location different from the work site, receives image data or video data of device 5 from terminal 2A or server 3.

[0016] The server 3 is an information processing device that transmits and receives data to and from the terminal 2A and the terminal 2B. The server 3 may be, for example, a personal computer, a workstation, a hardware server, a software server, etc. If the server 3 is a hardware server, the server 3 may be, for example, a network server or a cloud server, etc. If the server 3 is a software server, the server 3 may be, for example, server software or a server program, etc. In the present embodiment, one server 3 is shown in FIG. 1 , but the number of servers 3 is not limited to one. Multiple servers 3 may be communicatively connected to each other to realize the functions of the determination system 1. The server 3 includes metadata 7 of the device 5, receives image data or video data from the terminal 2A, and performs image analysis and video analysis of the image data or video data using the received image data or video data and the metadata 7. The server 3 can also analyze the contents of the work procedure manual 8.

[0017] The device 5 is an information processing device on which an operator performs work such as installation, removal, and change of connection wiring in accordance with the contents of the work procedure manual 8. The device 5 may be, for example, a workstation, a hardware server, a redundant array of inexpensive disks (RAID) server, a router, a switching hub, a unified threat management (UTM) device, etc. Although the device 5 is shown as one device in FIG. 1, the device 5 may include multiple devices.

[0018] The metadata 7 is data including the appearance, dimensions, technical specifications, etc. of the device 5, and is stored in a memory area or database of the server 3. The metadata 7 describes the specifications of the device 5 and the specifications of multiple devices included in the device 5 based on a predetermined format. The number of metadata 7 is not limited to one, and there may be multiple metadata 7. For example, if there are multiple devices 5, there may be metadata 7 for each of the multiple devices 5. If there is a change in the information included in the metadata 7, data including information about the change in the metadata 7 may be treated as part of the metadata 7.

[0019] The work procedure manual 8 is a document that describes the work details such as installing and removing the device 5 and changing the connection of the connection wiring. The worker performs the work such as installing and removing the device 5 and changing the connection of the connection wiring at the work site in accordance with the contents of the work procedure manual 8. The supervisor confirms whether the worker performed the work in accordance with the contents of the work procedure manual 8. The work procedure manual 8 may be stored in the memory area or database of the server 3. The work procedure manual 8 may also be stored in the memory area of ​​the worker's terminal 2A and the supervisor's terminal 2B.

[0020] 2 is a schematic diagram illustrating a workflow according to an embodiment of the present disclosure. The worker and the leader are in different locations and send and receive commands and instructions via applications pre-installed on terminals 2A and 2B.

[0021] Before installing or removing a device 5, changing the connection of the connection wiring, or performing other work, a worker captures image data or video data of the device 5 (step P01). To simplify the explanation of this embodiment, the worker will be described assuming that he or she captures image data of the device 5. Following instructions and guidance from the application, the worker captures image data of the devices to be worked on that are described in the work procedure manual 8. Once the worker has captured image data for all of the devices to be worked on that are described in the work procedure manual 8, the supervisor checks the content of the image data against the content of the work procedure manual 8 (step P02) and notifies the worker that work can begin (step P03). As will be described later, the supervisor's work of checking the content of the image data against the content of the work procedure manual 8 in step P02 can also be automated by the determination system 1 disclosed herein.

[0022] The worker performs work such as installing and removing the device 5 and changing the connection wiring in accordance with the work procedure manual 8 (step P04). When the worker has completed all of the work described in the work procedure manual 8 (step P05), the worker, following the instructions and guidance of the application, captures image data of the devices to be worked on described in the work procedure manual 8 (step P06). When the worker has captured image data of all of the devices to be worked on described in the work procedure manual 8, the supervisor checks the contents of the image data and the contents of the work procedure manual 8 (step P07) and notifies the worker of permission to end the work (step P08). When the worker receives permission to end the work from the supervisor, he or she withdraws from the work site (step P09).

[0023] The judgment system 1 disclosed in the present application analyzes image data of the device 5 captured by the worker, and associates the device 5 contained in the image data before the work, the device 5 contained in the image data after the work, the metadata 7 of the device 5, and the contents of the work procedure manual 8, thereby automating the confirmation work of step P07.

[0024] 3 is a block diagram showing a terminal 2 according to an embodiment of the present disclosure. The terminal 2 includes a CPU 21, a ROM 22, a RAM 23, a storage device 24, an input / output IF (Interface) 25, a communication IF 26, and an imaging device 27. The CPU 21, the ROM 22, the RAM 23, the storage device 24, the input / output IF 25, the communication IF 26, and the imaging device 27 are connected via a bus 29 so as to be able to communicate with each other.

[0025] The CPU 21 is a central processing unit. The CPU 21 controls each part of the terminal 2 using an application program. The ROM 22 is a read only memory. The ROM 22 is made up of non-volatile memory and stores application programs for controlling each part of the terminal 2. The RAM 23 is a random access memory. The RAM 23 provides a memory area necessary for the operation of the CPU 21. The storage device 24 is a large-capacity storage device such as a hard disk drive.

[0026] The input / output IF 25 is an input / output interface that receives voice input from the user, outputs voice to the user, and transmits and receives data between the terminal 2 and other devices. The input / output IF 25 may include a mouse, a touch panel, a trackball, a keyboard, a speaker, etc. The conductor or worker can operate the terminal 2 via the input / output IF 25. The communication IF 26 performs data communication between the terminal 2 and the server 3 via wired and / or wireless communication. The imaging device 27 is an image capturing device such as a camera that captures images of objects around the conductor or worker in accordance with the conductor's or worker's operation or commands from an application, etc. The imaging device 27 includes an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a control circuit, a signal processing circuit, etc. The imaging device 27 may be an infrared camera or the like, and may be configured to capture not only two-dimensional image data but also three-dimensional image data including depth information.

[0027] Terminal 2A and terminal 2B may have the same or different hardware configurations. For example, terminal 2B operated by the conductor may not be equipped with imaging device 27. In this embodiment, for the sake of simplicity, it is assumed that terminal 2A and terminal 2B have the same hardware configuration.

[0028] 4 is a block diagram showing a server 3 according to an embodiment of the present disclosure. The server 3 includes a CPU 31, a ROM 32, a RAM 33, a storage device 34, an input / output IF (Interface) 35, and a communication IF 36. The CPU 31, the ROM 32, the RAM 33, the storage device 34, the input / output IF 35, and the communication IF 36 are connected via a bus 39 so as to be able to communicate with each other.

[0029] The CPU 31 is a central processing unit. The CPU 31 controls each part of the server 3 using an application program. The ROM 32 is a read-only memory. The ROM 32 is made up of non-volatile memory and stores application programs for controlling each part of the server 3. The RAM 33 is a random access memory. The RAM 33 provides a memory area necessary for the operation of the CPU 31. The storage device 34 is a large-capacity storage device such as a hard disk drive.

[0030] The input / output IF 35 is an input / output interface that receives voice input from the user, outputs voice to the user, and transmits and receives data between the server 3 and other devices (e.g., terminal 2A and terminal 2B). The input / output IF 35 may include a mouse, a trackball, a keyboard, a speaker, etc. The user can operate the server 3 via the input / output IF 35. The communication IF 36 performs mutual data communication between the server 3, terminal 2A, and terminal 2B via wired communication and / or wireless communication.

[0031] 5 is a block diagram illustrating a functional unit 300 of a server 3 according to an embodiment of the present disclosure. The functional unit 300 realizes the functions of the determination system 1 in the server 3. The functional unit 300 may be implemented by hardware, software, or firmware. When the functional unit 300 is implemented by hardware, the server 3 may be provided with a hardware configuration for implementing the functional unit 300 in addition to the configuration of the server 3 shown in FIG. 4. Alternatively, the configuration of the server 3 shown in FIG. 4 and the hardware configuration for implementing the functional unit 300 may be separated, and the server 3 and the functional unit 300 may be connected to be able to communicate with each other.

[0032] When the functional unit 300 is implemented by software or firmware, the storage device 34 stores a program that implements the functional unit 300. The RAM 33 reads the program, and the CPU 31 executes the program, thereby realizing the functions of the functional unit 300. In the following, this embodiment will be described using an example in which the functional unit 300 is implemented by software or firmware. That is, the server 3 stores the functional unit 300 in the storage device 34 as a determination application.

[0033] The functional unit 300 includes a control unit 301, an estimation unit 302, a detection unit 303, an extraction unit 304, an identification unit 305, a determination unit 306, a notification unit 307, a generation unit 308, and a database 309. The control unit 301 controls each unit of the functional unit 300, and manages data transmission and reception between each unit of the functional unit 300, the processing order, notifications to terminal 2A and terminal 2B, data transmission and reception between the hardware of the server 3 and the functional unit 300, etc.

[0034] The estimation unit 302 analyzes the image data of the device 5 before the work and the image data of the device 5 after the work, transmitted from the terminal 2A, and estimates device information, etc., of the device 5 captured in the image data. The device information estimated by the estimation unit 302 may include, for example, the position of the device 5 in the image data, feature values ​​of the device 5 in the image data, the product name of the device 5, the name of the manufacturer of the device 5, and version information of the device 5. Based on the estimated device information, etc., the estimation unit 302 estimates metadata 7 corresponding to the device 5 included in the image data. The estimation unit 302 may be implemented using a trained neural network. For example, the neural network may be trained using multiple sets of image data of the device 5 before the work, multiple sets of image data of the device 5 after the work, and catalog image data of the device 5 as training data. The product name of the device 5 may be the product name of the device 5, or may be the model number, part number, type, or model number of the device 5.

[0035] The detection unit 303 detects a difference between the image data of the device 5 before the work and the image data of the device 5 after the work. The detection unit 303 detects a difference between the device 5 before the work and the device 5 after the work based on the position of the device 5 estimated by the estimation unit 302 and the feature amount of the device 5. For example, the detection unit 303 may associate the feature amount of the device 5 in the image data of the device 5 before the work with the feature amount of the device 5 in the image data of the device 5 after the work, and detect a feature amount that cannot be associated as a difference. For example, if a connection wire is not connected to a connection terminal in the device 5 before the work and a connection wire is connected to the connection terminal in the device 5 after the work, the detection unit 303 detects a feature amount corresponding to the connection terminal. In other words, the detection unit 303 can detect changes between the device 5 before the work and the device 5 after the work. The detection unit 303 may be implemented using a trained neural network. For example, the neural network may be trained using image data of the device 5 before the work and image data of the device 5 after the work at another work site as training data.

[0036] The extraction unit 304 analyzes the contents of the work procedure manual 8 transmitted from the terminal 2A or 2B and extracts the details of the work contained in the contents. If the work procedure manual 8 is stored in the storage device 34 of the server 3, the extraction unit 304 may analyze the contents of the work procedure manual 8 directly from the storage device 34. For example, if the contents of the work procedure manual 8 are "connect the connection wire to the connection terminal," the extraction unit 304 extracts the contents of "connection terminal," "connection wire," and "connect." The extraction unit 304 may be implemented using a trained neural network. For example, the neural network may be trained using work procedure manuals 8 for past work as training data. Note that the contents of the work procedure manual 8 are not limited to descriptions written in the above-described manner. For example, the work procedure manual 8 may be described using terms contained in the metadata 7. A connection terminal may be described as a "port," and a symbol indicating a connection may be described as a "+."

[0037] The identifying unit 305 identifies information about the device 5 included in the metadata 7 that corresponds to the difference detected by the detecting unit 303. For example, if a connection wire is not connected to the connection terminal in the device 5 before the work, and a connection wire is connected to the connection terminal in the device 5 after the work, the identifying unit 305 identifies information about the connection terminal included in the metadata 7.

[0038] Based on the difference between the image data of the device 5 before the work and the image data of the device 5 after the work, the information included in the metadata 7, and the information included in the work procedure manual 8, the determination unit 306 determines whether or not the difference corresponds to the information included in the work procedure manual 8. For example, if a connection wire is not connected to the connection terminal in the device 5 before the work, and a connection wire is connected to the connection terminal in the device 5 after the work, the determination unit 306 determines whether or not the information on the connection terminal identified by the detection unit 303 and the identification unit 305 corresponds to the contents of the work procedure manual 8.

[0039] The determination unit 306 may determine whether the device 5 before the operation and the device 5 after the operation are the same device or different devices. For example, if the device in the image data before the operation and the device in the image data after the operation are different devices, the determination unit 306 may determine that the device in the image data before the operation and the device in the image data after the operation are different devices. Based on the feature amount of the device in the image data before the operation and the feature amount of the device in the image data after the operation detected by the detection unit 303, the determination unit 306 may calculate a certainty between the device in the image data before the operation and the device in the image data after the operation. For example, if the certainty between the feature amount of the device in the image data before the operation and the feature amount of the device in the image data after the operation is less than a predetermined threshold, the determination unit 306 may determine that the device in the image data before the operation and the device in the image data after the operation are different devices.

[0040] The notification unit 307 adds information indicating the difference to an area in the post-work image data corresponding to the difference between the device 5 in the pre-work image data and the device 5 in the post-work image data, and notifies terminal 2A or terminal 2B. Furthermore, if the determination unit 306 determines that the information on the connection terminal identified by the detection unit 303 and the identification unit 305 does not correspond to the description in the work procedure manual 8, the notification unit 307 notifies terminal 2A or terminal 2B of information regarding the determination of the determination unit 306. The notification unit 307 adds a notification indicating that work different from the description in the work procedure manual 8 has been performed to an area in the post-work image data where the information on the device 5 included in the metadata 7 corresponding to the difference does not match the description in the work procedure manual 8. If the determination unit 306 determines that the device in the pre-work image data and the device in the post-work image data are different devices, the notification unit 307 may notify terminal 2A or terminal 2B that the device in the pre-work image data and the device in the post-work image data are different devices.

[0041] The generation unit 308 generates a work report that describes the work performed by the worker. The work report includes, for example, the difference detected by the detection unit 303, information about the device 5 included in the metadata 7 that corresponds to the difference identified by the identification unit 305, and the determination result of the determination unit 306. For example, if the worker performs work in accordance with the contents of the work procedure manual 8, the work report may include an area of ​​difference in the image data after the work, information about the device 5 included in the metadata 7 that corresponds to the area of ​​difference, and a determination result by the determination unit 306, such as pass, which includes the area of ​​difference, the information about the device 5 included in the metadata 7, and the description of the work procedure manual 8 that corresponds to the difference. Alternatively, if a worker performs work that differs from the details described in the work procedure manual 8, the work report may include a difference area in the image data after the work, information about the device 5 included in the metadata 7 that corresponds to the difference area, the difference area and the information about the device 5 included in the metadata 7, and a determination result such as failure by the determination unit 306, indicating that the difference area and the information about the device 5 included in the metadata 7 do not correspond (match) with the details described in the work procedure manual 8. Note that the generation unit 308 may list the details described in the work procedure manual 8, the information about the device 5 that is included in the metadata 7 and is the work location of the device 5 that corresponds to the details described in the work procedure manual 8, the difference area in the image data after the work, and the pass or fail determination by the determination unit 306, and include these in the work report.

[0042] The database 309 stores data used in the function unit 300. The database 309 stores image data of the device 5, image data of the device 5 taken in the past by a worker, and metadata 7 of the device 5. When the estimation unit 302 and the detection unit 303 are implemented using a trained neural network, the database 309 may store coefficients used in the neural network, etc. The database 309 may also store templates of work reports generated by the generation unit 308, etc.

[0043] FIG. 6 is a schematic diagram illustrating an example of a device 5 according to an embodiment of the present disclosure. FIG. 7 is a diagram illustrating an example of metadata 7 of a device 5 according to an embodiment of the present disclosure. The device 5 is a 1U 19-inch rack device and may be a switching hub in this embodiment. The device 5 has multiple connection units 511-51L. The device 5 further includes a manufacturer name 52, a product name 53, and a number 54. The connection unit 511 may be, for example, a LAN (Local Area Network) cable outlet. The connection units 512-51L may have the same configuration as the connection unit 511. The manufacturer name 52 indicates information about the manufacturer. The product name 53 indicates the product name of the device 5. The product name of the device 5 may be the product name of the device 5, or may be the model number, part number, type, or model number of the device 5. The number 54 may be identification information or the like attached to the device 5 by the administrator of the device 5. For example, when a plurality of devices 5 are installed at a work site and the devices 5 have the same configuration, a manager of the devices 5 may assign different numbers 54 to the devices 5 to distinguish between the devices 5. In other words, the numbers 54 may be unique identification information of the devices 5.

[0044] A 19-inch rack device has a horizontal width of 19 inches and a vertical width that is a multiple of 1.75 inches. For example, a 1U 19-inch rack device has a vertical width of 1.75 inches, and a 3U 19-inch rack device has a vertical width of 5.25 (3 x 1.75) inches. Note that the depth of the device (not shown in FIG. 6) is not specified, and this embodiment will be described assuming that the depth of the device 5 is d0. Therefore, the horizontal width w0 is 19 inches, and the vertical width h0 is 1U (1.75 inches).

[0045] The metadata 7 is data that specifically describes the device configuration, specifications, etc. of the device 5, and for example, the metadata 7 includes information such as the positions of the connectors 511-51L on the exterior of the device 5. In this embodiment, the metadata 7 includes device information 71, manufacturer information 72, product name information 73, dimension information 74 of the device 5, and information 711-71L on the connectors 511-51L.

[0046] The device information 71 defines the product name of the device 5 ("DEVICE NAME"), the name of the manufacturer of the device 5 ("BRAND Co.LTD."), version information of the device 5 ("1.1.001"), etc. As shown in FIG. 6, the manufacturer information 72 has the upper left corner of the front of the device 5 as the origin O, and includes the position xp of the manufacturer name 52 on the X coordinate and the position yp of the manufacturer name 52 on the Y coordinate, as well as the width wp and the height hp of the manufacturer name 52. The product name information 73 includes the position xq of the product name 53 on the X coordinate and the position yq of the product name 53 on the Y coordinate, as well as the width wq and the height hq of the product name 53. The dimension information 74 includes the width w0, the height h0, and the depth d0 of the device 5 (not shown in FIG. 6).

[0047] The information 711 includes the position x1 of the connection unit 511 on the X coordinate and the position y1 on the Y coordinate, as well as the width w1 and height h1 of the connection unit 511. The information 711 may further include information about the connection terminal (that is, a port conforming to the "1000BASE-T" standard), etc. The information 712-71L includes the positions of the connection unit 512-51L on the X coordinate and the Y coordinate, as well as the width and height of the connection unit 512-51L. In other words, the metadata 7 includes geometrical layout information of the connection units 511-51L, the manufacturer name 52, and the product name 53 on the front surface of the device 5. Note that the metadata 7 may include layout information on the back surface of the device 5 in addition to layout information on the connection units 511-51L, etc. on the front surface of the device 5. For example, if the device 5 has connections on its back surface, the metadata 7 may include layout information on the connections on the back surface of the device 5. The metadata 7 may also include unique identification information assigned to the device 5 by an administrator of the device 5, the host name of the device 5, the MAC address of the device 5, the IP address of the device 5, etc. A conductor or an operator can edit the metadata 7. An administrator of the server 3 or an administrator of the determination system 1 may edit the metadata 7, or an administrator of the device 5 may edit the metadata 7.

[0048] Fig. 8 is a sequence chart showing a determination process according to an embodiment of the present disclosure. Fig. 9 is a schematic diagram showing an example of an application display screen according to an embodiment of the present disclosure, which is an example of an application display screen when a worker operates terminal 2A. Fig. 10 is a schematic diagram showing a portion of device 5 before work according to an embodiment of the present disclosure. Fig. 11 is a schematic diagram showing a portion of device 5 after work according to an embodiment of the present disclosure. Fig. 12 is a schematic diagram showing an example of a notification display according to an embodiment of the present disclosure.

[0049] First, the worker transmits the work procedure manual 8 to the server 3 from the terminal 2A (step S101). The supervisor may transmit the work procedure manual 8 to the server 3 from the terminal 2B. If the work procedure manual 8 is stored in the storage device 34 of the server 3, the worker or the supervisor may show the work procedure manual 8 to the server 3. In this embodiment, the sequence chart will be described assuming that the contents of the work procedure manual 8 include the content "connect the connection wiring 6 to the connection part 511 of the device 5." In this embodiment, the worker captures an image of the device 5 before the work (corresponding to step P01 in FIG. 2), performs the work of connecting the connection wiring 6 to the connection part 511 of the device 5 (corresponding to steps P04 and P05 in FIG. 2), and captures an image of the device 5 after the work (corresponding to step P06 in FIG. 2).

[0050] When the server 3 receives the work procedure manual 8 from the terminal 2A or 2B, the extraction unit 304 analyzes the contents of the work procedure manual 8 and extracts the work content included in the contents (step S103). The extraction unit 304 extracts the description "device 5," the description "connection unit 511," and the description "connect the connection wiring 6" from the contents of the work procedure manual 8.

[0051] After transmitting the work procedure manual 8 to the server 3 in step S101, the worker uses the terminal 2A to capture an image of the device 5 before the work is performed (step S105). The worker operates the terminal 2A and launches an application. The application may be configured to read the contents of the work procedure manual 8 in advance and display the application's operating procedure corresponding to the contents on the input / output IF 25. The worker uses the imaging device 27 to capture an image of the device 5 before the work and the connection unit 511 in accordance with the display 251A, display 252A, and display 253A of the application. That is, the worker captures an image of the device (corresponding to the device 5) and the location (corresponding to the connection unit 511) to be worked on that are described in the work procedure manual 8. It is desirable that the image of the device 5 before the work is captured so that the entire front of the device 5 fits within the angle of view, as shown in FIG. 6. It is desirable that the image of the connection unit 511 before the work is captured so that the entire connection unit 511 fits within the angle of view, as shown in FIG. 10. The worker may capture images of the device 5 and the connection part 511 from multiple different angles. Alternatively, the worker may use an infrared camera or the like to capture three-dimensional image data including depth information around the device 5 and the connection part 511. In displays 251A-253A, the application may prompt the worker to capture the manufacturer name 52 and the product name 53.

[0052] When the worker captures images of the device 5 and connection unit 511 before the work in accordance with the application displays 251A-253A, the worker transmits image data of the device 5 and connection unit 511 from terminal 2A to server 3 (step S107). Note that steps S105 and S107 may be performed in parallel. For example, in step S105, the worker may transmit the captured image data of the device 5 and connection unit 511 from terminal 2A to server 3 while capturing an image of the device.

[0053] When the server 3 receives the image data from the terminal 2A, the estimation unit 302 estimates the device information of the device 5, etc., contained in the image data (step S109). The estimation unit 302 may estimate the product name of the device 5 and the name of the manufacturer of the device 5 based on an image of the entire device 5 contained in the image data. Alternatively, the estimation unit 302 may estimate the product name of the device 5 and the name of the manufacturer of the device 5 based on an image of a portion of the device 5 contained in the image data. For example, the estimation unit 302 can estimate the product name of the device 5 and the name of the manufacturer of the device 5 based on the manufacturer name 52 and the product name 53. The estimation unit 302 estimates the feature amounts of the device 5 in the image data before the work. The estimated feature amounts of the device 5 are used by the detection unit 303 to detect differences.

[0054] The estimation unit 302 estimates the metadata 7 corresponding to the device 5 based on the estimated product name of the device 5 and the estimated name of the manufacturer of the device 5 (step S111). The estimation unit 302 compares the estimated product name of the device 5 and the estimated name of the manufacturer of the device 5 with the device information 71 included in the metadata 7, and estimates the metadata 7 that describes the device configuration, specifications, etc. of the device 5.

[0055] The server 3 transmits the image data transmitted from the terminal 2A to the terminal 2B (step S113). The server 3 may transmit the image data transmitted from the terminal 2A directly to the terminal 2B, or the server 3 may add the estimated product name of the device 5 and the estimated name of the manufacturer of the device 5 to the image data transmitted from the terminal 2A and transmit the image data to the terminal 2B.

[0056] The work and processing of steps S105-S113 may be performed in parallel for one device 5. For one device 5, the worker performs the work of steps S105 and S107 in accordance with the application displays 251A-253A, the server 3 executes the processing of steps S109-S113, and the conductor performs the work of step S115. For other devices 5, the worker similarly performs the work of steps S105 and S107, the server 3 executes the processing of steps S109-S113, and the conductor performs the work of step S115. In this way, by performing the work and processing of steps S105-S113 in parallel for multiple devices 5, it may be possible to reduce the time the conductor waits for image data for all devices 5 from the workers. Furthermore, terminal 2A may display the contents of the work procedure manual 8 corresponding to displays 251A-253A. By displaying the contents of the work procedure manual 8 corresponding to the image (displays 251A-253A) of the device 5 before the work, the worker can perform the work corresponding to the displays 251A-253A without making any mistakes.

[0057] The supervisor receives the image data transmitted from the server 3 on terminal 2B and, based on the image data, checks whether the device 5 corresponds to the contents of the work procedure manual 8 (step S115). The supervisor may check the configuration of the device 5 before the work begins. For example, the supervisor may check whether the connection between the device 5 and other devices connected to the device 5 matches the contents of the work procedure manual 8. The supervisor notifies terminal 2A of permission to work from terminal 2B (step S117), and the worker starts work such as installing or removing the device 5 or changing the connection of the connection wiring in accordance with the contents of the work procedure manual 8 (step S119). In this embodiment, the contents of the work procedure manual 8 include the task of "connecting the connection wiring 6 to the connection part 511 of the device 5." As shown in FIG. 11 , the worker connects the connection wiring 6 to the connection part 511.

[0058] When the worker finishes the work in step S119, he or she uses terminal 2A to capture an image of device 5 after the work is completed (step S121). The worker operates terminal 2A and captures an image of device 5 and connection portion 511 after the work is completed using imaging device 27 in accordance with application displays 251B, 252B, and 253B. It is desirable that the image of device 5 after the work is completed be captured so that the entire front of device 5 fits within the angle of view, as shown in FIG. 6. It is desirable that the image of connection portion 511 after the work is completed be captured so that the entire connection portion 511 fits within the angle of view, as shown in FIG. 11. The worker may capture images of device 5 and connection portion 511 from multiple different angles. Alternatively, the worker may use an infrared camera or the like to capture 3D image data including depth information around device 5 and connection portion 511. As in the process in step S105, the application may prompt the worker to capture the manufacturer name 52 and product name 53 in displays 251B-253B.

[0059] When the worker captures images of the device 5 and connection unit 511 after the work in accordance with the application's display 251B-253B, the worker transmits image data of the device 5 and connection unit 511 from terminal 2A to server 3 (step S123). Note that steps S121 and S123 may be performed in parallel. For example, in step S121, the worker may transmit the captured image data of the device 5 and connection unit 511 from terminal 2A to server 3 while capturing an image of the device.

[0060] When the server 3 receives the image data from the terminal 2A, the estimation unit 302 estimates the device information of the device 5, etc., contained in the image data (step S125). The estimation unit 302 estimates the feature amount of the device 5 in the image data after the operation. For example, the connection portion 511 in FIG. 10 has a rectangular connection area (i.e., an area that can be identified by the position x1, the position y1, the width w1, and the height h1 in FIG. 6) and a convex opening. In the connection portion 511, each corner of the rectangle and each corner of the convex shape may have a feature amount. On the other hand, the connection portion 511 in FIG. 11 has a rectangular connection area, but the convex opening is hidden by the connection wiring 6. In the connection portion 511, each corner of the rectangle and some corners of the convex shape may have a feature amount. Furthermore, the wiring portion 61 of the connection wiring 6 is substantially linear, and the wiring portion 61 may have a feature amount in the vicinity of the connection portion 511. The estimation unit 302 estimates the feature amount as in the above example.

[0061] The detection unit 303 detects a difference between the device 5 before the work and the device 5 after the work based on the feature amount of the device 5 included in the image data before the work estimated by the estimation unit 302 in step S109 and the feature amount of the device 5 included in the image data after the work estimated by the estimation unit 302 in step S125 (step S127). For example, the detection unit 303 may associate the feature amount of the connection portion 511 before the work with the feature amount of the connection portion 511 after the work, and detect a feature amount that cannot be associated between the image data before the work and the image data after the work as a difference. Alternatively, the detection unit 303 may calculate a difference between pixel values ​​of the image data before the work and pixel values ​​of the image data after the work.

[0062] The identifying unit 305 identifies information about the device 5 included in the metadata 7 that corresponds to the difference detected by the detecting unit 303 (step S129). Based on the coordinate information about the difference and the arrangement information about the connecting units 511-51L included in the metadata 7, the identifying unit 305 identifies that the connecting terminal corresponding to the difference is the connecting unit 511. For example, the identifying unit 305 identifies that the difference between the image data before the operation and the image data after the operation corresponds to the coordinates (information 711) of the connecting unit 511 in the metadata 7.

[0063] The determination unit 306 determines whether the difference detected by the detection unit 303, the connection unit 511 identified by the identification unit 305, and the description of the work procedure manual 8 correspond to each other (step S131). In this embodiment, the description of the work procedure manual 8 includes the task of "connecting the connection wiring 6 to the connection unit 511 of the device 5." For example, if there is a difference in the area corresponding to the coordinates of the connection unit 511 (information 711), the determination unit 306 can determine that the description of the work procedure manual 8 corresponds to the task indicated by the difference. For example, if there is no difference in the area corresponding to the coordinates of the connection unit 511 (information 711), the determination unit 306 can determine that the description of the work procedure manual 8 does not correspond to the task indicated by the difference. Alternatively, for example, if there is a difference in an area different from the area corresponding to the coordinates of the connection unit 511 (information 711), the determination unit 306 can determine that the description of the work procedure manual 8 does not correspond to the task indicated by the difference.

[0064] Notification unit 307 transmits the post-operation image data and the determination result of determination unit 306 to terminal 2A and terminal 2B (steps S133 and S135). Notification unit 307 adds information indicating a difference to an area of ​​the post-operation image data that corresponds to a difference between device 5 in the pre-operation image data and device 5 in the post-operation image data. For example, if the content of work procedure manual 8 includes the operation of "connecting connection wiring 6 to connection portion 511 of device 5" and there is a difference in the area corresponding to connection portion 511, notification unit 307 adds information 259A to an area including connection portion 511 and connection wiring 6, as shown in FIG. 12. Furthermore, if there is a difference in an area corresponding to connection portion 514, notification unit 307 adds information 259B and information 259C to an area including connection portion 514 and connection wiring 6. By having the notification unit 307 add information 259A, information 259B, and information 259C to the image data after the work, the worker and the supervisor can understand the correspondence between the contents of the work procedure manual 8 and the work actually performed by the worker.

[0065] In step S133, the conductor receives the image data after the work and the judgment result from judgment unit 306 on terminal 2B, and can confirm whether the work content performed by the worker corresponds to the contents described in work procedure manual 8. In step S135, the worker receives the image data after the work and the judgment result from judgment unit 306 on terminal 2A, and can confirm whether the work content performed by the worker corresponds to the contents described in work procedure manual 8.

[0066] If the determination unit 306 determines that the work performed by the worker does not correspond to the contents described in the work procedure manual 8, information 259B indicating the difference and information 259C indicating that the difference does not correspond to the contents described in the work procedure manual are displayed in an area corresponding to the difference between the device 5 in the image data before the work and the device 5 in the image data after the work, as shown in FIG. 12. Based on this information, the worker can perform the work of steps S119-S123 again and correct the work content that was performed incorrectly. The server 3 can perform the processes of steps S125-S135 again and transmit the image data after the work and the determination result by the determination unit 306 to terminal 2A and terminal 2B. Note that the commander may instruct the worker to correct the work content based on the image data after the work received in step S133 and the determination result.

[0067] The generation unit 308 generates a work report that describes the work performed by the worker (step S137). The work report may describe connection sections 511-51L that correspond to the difference between the device 5 in the image data before the work and the device 5 in the image data after the work. The work report may also describe the contents of the work procedure manual 8 that correspond to the difference. If the worker performed work that differs from the contents of the work procedure manual 8, the work report may describe the area of ​​the difference in the image data after the work and a connection section among the connection sections 511-51L that corresponds to the area of ​​the difference. For example, the work report may list the connection sections 511-51L of the work target in the contents of the work procedure manual 8, the area of ​​the image data after the work that corresponds to the coordinates (information 711-71L) of the connection sections 511-51L, and the determination result by the determination unit 306. The work report may include the date of the work, the name of the work site, and the name of the equipment to be photographed, as well as the contents of the work procedure manual 8, information about the equipment 5 included in the metadata 7 corresponding to the contents of the work procedure manual 8, and a judgment result displayed as "pass" or "fail." Furthermore, the work report may be linked to an application and display, for a certain task included in the work procedure manual 8, image data before the task, image data after the task, information about the equipment 5 included in the metadata 7 corresponding to the contents of the work procedure manual 8, and a judgment result displayed as "pass" or "fail." The commander can refer to the judgment result on terminal 2B and operate the application to check the image data before the task, image data after the task, and the judgment result for multiple tasks included in the contents of the work procedure manual 8.

[0068] Before starting work, the worker captures image data of the device to be worked on, as described in the work procedure manual 8, according to the instructions and guidance of the application. The worker performs work on the device 5 according to the contents of the work procedure manual 8, and then captures image data of the device to be worked on, as described in the work procedure manual 8, according to the instructions and guidance of the application. The determination system 1 can determine whether the work content performed by the worker corresponds to the contents of the work procedure manual 8 based on the image data before the work, the image data after the work, and the contents of the work procedure manual 8. This automates the task of a supervisor determining whether the work content performed by the worker corresponds to the contents of the work procedure manual 8 by referring to the image data before the work and the image data after the work. Furthermore, by the determination system 1 determining whether the work content performed by the worker corresponds to the contents of the work procedure manual 8, the accuracy of the determination can be improved even when the amount of work content is enormous. Furthermore, by having the worker capture image data according to the instructions and guidance of the application and having the supervisor refer to the image data, the time required for the worker to capture image data and the time required for the supervisor to check the image data can be reduced.

[0069] The determination system 1 disclosed herein may use not only the feature amount of the device 5 included in the image data but also identification information included in the connection wiring 6 connected to the device 5 to determine whether the difference between the device 5 in the image data before the work and the device 5 in the image data after the work corresponds to the description in the work procedure manual 8. For example, the work procedure manual 8 may describe that the connection unit 511 is connected to the connection wiring 6 associated with a tag having predetermined identification information. Based on the identification information included in the image data, the coordinate information of the tag having the identification information, and the coordinate information of the difference, the determination unit 306 may determine whether the description in the work procedure manual 8 corresponds to the work performed by the worker. The predetermined identification information of the tag may be directly written on the connection wiring 6. By writing the predetermined identification information on the connection wiring 6, the difference between the device 5 in the image data before the work and the device 5 in the image data after the work can include the predetermined identification information. Based on the coordinate information of the predetermined identification information in the image data after the work and the coordinate information of the difference, the determination unit 306 can also determine whether a certain connection wiring 6 is correctly or incorrectly connected to a connection unit described in the work procedure manual 8.

[0070] Alternatively, the determination system 1 disclosed herein may automate the confirmation task of step P02 in Fig. 2 based on image data after the task in past step P06, image data before the task in current step P01, information included in the metadata 7, and the contents of the current work procedure manual 8. For example, at a certain work site, a difference may be obtained between image data captured in a past step P06 and image data captured in the current step P01. The difference may be associated with the information included in the metadata 7 and the contents of the current work procedure manual 8, and the determination unit 306 may determine whether the configuration of the device 5 before the task corresponds to the contents of the work procedure manual 8.

[0071] This makes it possible to automate not only the conductor's confirmation of image data in step P07, but also the conductor's confirmation of image data in step P02.

[0072] [Other embodiments] 13 is a block diagram showing a determination system according to an embodiment of the present disclosure. The determination system 100 includes a detection unit 101, an identification unit 102, a determination unit 103, and a database 104. The detection unit 101 detects a difference between image data of a device before work is performed and image data of the device after work is performed. The identification unit 102 identifies a correspondence between the difference detected by the detection unit 101 and the device metadata, and acquires device information included in the metadata corresponding to the difference. The determination unit 103 determines whether the difference detected by the detection unit 101 corresponds to the work content of the device. The database 104 includes metadata and a work procedure manual describing the work content of the device.

[0073] Furthermore, the scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described computer program is recorded, but also the computer program itself.

[0074] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM (Compact Disc-Read Only Memory), a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment is not limited to programs that execute processing by themselves recorded on the recording medium, but also includes programs that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0075] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and detailed description of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0076] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0077] (Appendix 1) a detection unit that detects a difference between a first image of the device before the change based on the change information is made and a second image of the device after the change based on the change information is made; an identification unit that identifies a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0078] (Appendix 2) The device is connected to other devices via connecting wires, the difference includes the presence or absence of the connection wiring or identification information of the connection wiring, The determination device according to claim 1, wherein the determination unit determines whether or not a connection exists between the device and the other device, or whether or not the connection is correct, based on the presence or absence of the connection wiring or the identification information.

[0079] (Appendix 3) The determination device described in Appendix 1 further includes an estimation unit that estimates at least one of the product name of the device, the name of the manufacturer of the device, identification information of the device, and features of the connection terminals of the device in the first image and the second image.

[0080] (Appendix 4) The determination device described in Appendix 1, wherein the metadata includes at least one of the width of the device, the height of the device, the depth of the device, the number of connection terminals the device has, the coordinates of the connection terminals, the height of the connection terminals, the width of the connection terminals, identification information of the device, the host name of the device, the MAC address of the device, the IP address of the device, and characters written on the device.

[0081] (Appendix 5) The device is connected to other devices via connecting wires, the connection wiring has identification information within a field of view of the first image and within a field of view of the second image; the change information associates a connection terminal of the device with the identification information of the connection wiring; 4. The determination device according to claim 3, wherein the estimation unit estimates a feature amount of the connection wiring.

[0082] (Appendix 6) The determination device described in Appendix 1, further comprising a notification unit that adds information indicating an area corresponding to the difference in the second image and notifies the determination made by the determination unit and the information indicating the area.

[0083] (Appendix 7) The determination device described in Appendix 6, wherein, when the determination unit determines that the difference does not correspond to the change information, the notification unit adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

[0084] (Appendix 8) a detection step of detecting a difference between a first image of the device before the change based on the change information is made and a second image of the device after the change based on the change information is made; a specifying step of specifying a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determining step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0085] (Appendix 9) The device is connected to other devices via connecting wires, the difference includes the presence or absence of the connection wiring or identification information of the connection wiring, The determination method according to claim 8, wherein the determining step determines whether or not there is a connection between the device and the other device, or whether or not the connection is correct, based on the presence or absence of the connection wiring or the identification information.

[0086] (Appendix 10) The determination method described in Appendix 8, further comprising an estimation step of estimating at least one of the product name of the device, the name of the manufacturer of the device, identification information of the device, and features of the connection terminals of the device from the first image and the second image.

[0087] (Appendix 11) The determination method described in Appendix 8, wherein the metadata includes at least one of the width of the device, the height of the device, the depth of the device, the number of connection terminals the device has, the coordinates of the connection terminals, the height of the connection terminals, the width of the connection terminals, identification information of the device, the host name of the device, the MAC address of the device, the IP address of the device, and characters written on the device.

[0088] (Appendix 12) The device is connected to other devices via connecting wires, the connection wiring has identification information within a field of view of the first image and within a field of view of the second image; the change information associates a connection terminal of the device with the identification information of the connection wiring; 11. The determination method according to claim 10, wherein the estimation step estimates a feature of the connection wiring.

[0089] (Appendix 13) The determination method described in Appendix 8, further comprising a notification step of adding information indicating the area corresponding to the difference in the second image and notifying the determination in the determination step and the information indicating the area.

[0090] (Appendix 14) The determination method described in Appendix 13, wherein, if the determination step determines that the difference does not correspond to the change information, the notification step adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

[0091] (Appendix 15) a detection step of detecting a difference between a first image of the device before the change based on the change information is made and a second image of the device after the change based on the change information is made; a specifying step of specifying a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determining step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

[0092] (Appendix 16) The device is connected to other devices via connecting wires, the difference includes the presence or absence of the connection wiring or identification information of the connection wiring, 16. The determination program according to claim 15, wherein the determination step determines whether or not there is a connection between the device and the other device, or whether or not the connection is correct, based on the presence or absence of the connection wiring or the identification information.

[0093] (Appendix 17) The determination program described in Appendix 15, further comprising an estimation step of estimating at least one of the product name of the device, the name of the manufacturer of the device, identification information of the device, and features of the connection terminals of the device from the first image and the second image.

[0094] (Appendix 18) The determination program described in Appendix 15, wherein the metadata includes at least one of the width of the device, the height of the device, the depth of the device, the number of connection terminals of the device, the coordinates of the connection terminals, the height of the connection terminals, the width of the connection terminals, identification information of the device, the host name of the device, the MAC address of the device, the IP address of the device, and characters written on the device.

[0095] (Appendix 19) The device is connected to other devices via connecting wires, the connection wiring has identification information within a field of view of the first image and within a field of view of the second image; the change information associates a connection terminal of the device with the identification information of the connection wiring; 18. The determination program according to claim 17, wherein the estimation step estimates a feature amount of the connection wiring.

[0096] (Appendix 20) 16. The judgment program according to claim 15, further comprising a notification step of adding information indicating an area corresponding to the difference in the second image and notifying the judgment in the judgment step and information indicating the area.

[0097] (Appendix 21) A judgment program as described in Appendix 20, wherein, if the judgment step determines that the difference does not correspond to the change information, the notification step adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

[0098] (Appendix 22) a detection unit that detects a difference between a first image captured by a terminal of a device before a change based on the change information is made and a second image captured by the terminal of the device after the change based on the change information is made; an identification unit that identifies a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference; a notification unit that adds information indicating an area corresponding to the difference to the second image and notifies the terminal of the determination by the determination unit and the information indicating the area, A judgment system in which, if the judgment unit determines that the difference does not correspond to the change information, the notification unit adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

[0099] (Appendix 23) The device is connected to other devices via connecting wires, the difference includes the presence or absence of the connection wiring or identification information of the connection wiring, 23. The determination system of claim 22, wherein the determination unit determines whether or not there is a connection between the device and the other device, or whether or not the connection is correct, based on the presence or absence of the connection wiring or the identification information.

[0100] (Appendix 24) The determination system described in Appendix 22, further comprising an estimation unit that estimates at least one of the product name of the device, the name of the manufacturer of the device, identification information of the device, and features of the connection terminals of the device in the first image and the second image.

[0101] (Appendix 25) The determination system of Appendix 22, wherein the metadata includes at least one of the width of the device, the height of the device, the depth of the device, the number of connection terminals of the device, the coordinates of the connection terminals, the height of the connection terminals, the width of the connection terminals, identification information of the device, the host name of the device, the MAC address of the device, the IP address of the device, and characters written on the device.

[0102] (Appendix 26) The device is connected to other devices via connecting wires, the connection wiring has identification information within a field of view of the first image and within a field of view of the second image; the change information associates a connection terminal of the device with the identification information of the connection wiring; 25. The determination system according to claim 24, wherein the estimation unit estimates a feature of the connection wiring.

[0103] (Appendix 27) before the change based on the change information is made, the terminal displays a notification to capture an image of the device corresponding to the change information; 23. The determination system of claim 22, wherein after a change based on the change information is made, the terminal displays a notification to capture an image of the device corresponding to the change information.

[0104] (Appendix 28) A determination system as described in Appendix 22, wherein the modification information corresponding to the first image and the first image are displayed on the terminal before the modification based on the modification information is made.

[0105] (Appendix 29) displaying the first image and the second image adjacent to each other on the terminal; 23. The determination system of claim 22, wherein the modification information corresponding to the first image and the second image is displayed on the terminal.

[0106] (Appendix 30) the terminal transmits the first image and the second image to another terminal; the other terminal displays the first image and the second image adjacent to each other; 23. The determination system of claim 22, wherein the modification information corresponding to the first image and the second image is displayed on the other terminal. [Explanation of symbols]

[0107] 1: Judgment system 100: Judgment system 101: Detection unit 102: Specific part 103: Judgment section 104: Database 2A: Terminal 2B: Terminal 3: Server 301: Control unit 302: Estimation section 303: Detection unit 304: Extraction part 305: Specific part 306: Judgment section 307: Notification Department 308: Generation part 309: Database 5A: Equipment 5B: Equipment 6: Connection wiring 61:Wiring section 7: Metadata 8: Work procedure manual 9: Network

Claims

1. a detection unit that detects a difference between a first image captured of the device before the change based on the change information is made and a second image captured of the device after the change based on the change information is made; an identification unit that identifies a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

2. The device is connected to other devices via connecting wires, the difference includes the presence or absence of the connection wiring or identification information of the connection wiring, The determination device according to claim 1 , wherein the determination unit determines whether or not a connection exists between the device and the other device, or whether or not the connection is correct, based on the presence or absence of the connection wiring or the identification information.

3. 2. The determination device according to claim 1, further comprising an estimation unit that estimates at least one of a product name of the device, a manufacturer name of the device, identification information of the device, and a feature of a connection terminal of the device from the first image and the second image.

4. 2. The determination device of claim 1, wherein the metadata includes at least one of the following: a width of the device, a height of the device, a depth of the device, the number of connection terminals of the device, coordinates of the connection terminals, a height of the connection terminals, a width of the connection terminals, identification information of the device, a host name of the device, a MAC address of the device, an IP address of the device, and characters written on the device.

5. The device is connected to other devices via connecting wires, the connection wiring has identification information within a field of view of the first image and within a field of view of the second image; the change information associates a connection terminal of the device with the identification information of the connection wiring; The determination device according to claim 3 , wherein the estimation unit estimates a feature amount of the connection wiring.

6. The determination device according to claim 1 , further comprising a notification unit that adds information indicating an area corresponding to the difference to the second image and notifies the determination by the determination unit and the information indicating the area.

7. The determination device of claim 6, wherein, when the determination unit determines that the difference does not correspond to the change information, the notification unit adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

8. a detection step of detecting a difference between a first image of the device before the change based on the change information is made and a second image of the device after the change based on the change information is made; a specifying step of specifying a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determining step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

9. a detection step of detecting a difference between a first image of the device before the change based on the change information is made and a second image of the device after the change based on the change information is made; a specifying step of specifying a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determining step of determining whether the difference corresponds to the change information based on the correspondence between the device information and the difference.

10. a detection unit that detects a difference between a first image captured by a terminal of a device before a change based on the change information is made and a second image captured by the terminal of the device after the change based on the change information is made; an identification unit that identifies a correspondence between device information corresponding to the change information in the metadata of the device and the difference; a determination unit that determines whether the difference corresponds to the change information based on the correspondence between the device information and the difference; a notification unit that adds information indicating an area corresponding to the difference to the second image and notifies the terminal of the determination by the determination unit and the information indicating the area, A judgment system in which, if the judgment unit determines that the difference does not correspond to the change information, the notification unit adds a display indicating the difference that does not correspond to the change information to the second image based on the difference and the change information.

Images