Inspection equipment for equipment installation, inspection method for equipment installation, and inspection program for equipment installation.

Abstract

To inspect utility work simply with high accuracy.SOLUTION: One embodiment of the present invention is a utility work inspection device comprising: an acquisition unit that acquires, from a terminal device, inspection item information indicating that an inspection item is a battery for base stations that includes a plurality of battery cells, an inspection image in which the battery for base stations is imaged, and guide information regarding a guide image for capturing an image of the battery for base stations that is included in the inspection image; a recognition unit that calculates on the basis of the inspection image a confidence factor that indicates the likelihood of terminal parts of the battery cells and recognizes on the basis of the confidence factor whether or not the terminal parts are included in the inspection image; an inspection unit that carries out inspection of the entire utility work of the battery for base stations, on the basis of the number of terminal parts recognized by the recognition unit and the mutual positional relations of the terminal parts; and a notification unit that notifies the terminal device about a result of inspection carried out by the inspection unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0004] , , , , , , , , , , ,

[0005]

[0001] The present invention relates to an inspection device for facility construction, an inspection method for facility construction, and an inspection program for facility construction.

Background Art

[0002] Conventionally, techniques for inspecting construction states have been known. For example, Patent Documents 1 to 3 describe techniques for inspecting the construction state using a plurality of members with high accuracy. Patent Document 1 describes a technique for inspecting the construction state of hardware for branching of utility poles, and Patent Document 2 describes a technique for inspecting the construction state of support members of utility poles. Further, Patent Document 3 describes displaying a guide frame or mask of an inspection object according to a plurality of inspection items included in facility construction.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the inspection of the construction state described in the above Patent Documents 1 to 3, in many cases, inspection items for each inspection object and the required accuracy for each inspection item are defined, and it is desired to perform inspections simply and with high accuracy.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide an inspection device for facility construction, an inspection method for facility construction, and an inspection program for facility construction that can inspect facility construction related to a battery for a base station simply and with high accuracy. [Means for solving the problem]

[0006] (1) One aspect of the present invention includes an acquisition unit that acquires from a terminal device inspection item information indicating that the inspection item is a base station battery including a plurality of battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image; a recognition unit that calculates a confidence level indicating the certainty of the terminal portion of the battery cell based on the inspection image and recognizes whether or not the terminal portion is included in the inspection image based on the confidence level; an inspection unit that performs an inspection of the equipment installation of the entire base station battery based on the number of terminal portions recognized by the recognition unit and the positional relationship between the terminal portions; and a notification unit that notifies the terminal device of the results of the inspection performed by the inspection unit. The base station battery comprises multiple sets of multiple battery cells arranged in one direction, the guide image is a frame image surrounding one set of multiple battery cells, the acquisition unit acquires the position of the frame image in the inspection image as guide information, and the inspection unit determines that the positional relationship between the terminals is appropriate when the positions of multiple terminals included in the frame image among the terminals recognized by the recognition unit are arranged alternately across the center line of the frame image. It is an inspection device.

[0009] ( 2 ) One aspect of the present invention is an inspection device for the above-described equipment installation, wherein the guide image includes a frame image surrounding a connection portion connecting a wiring cable terminal and a battery cell, and a line image corresponding to the side surface of the wiring cable terminal, the recognition unit recognizes whether the connection portion is included in the inspection image based on a confidence level indicating the certainty of the outer casing of the connection portion, and recognizes whether the wiring cable terminal is included in the inspection image based on a confidence level indicating the certainty of the wiring cable terminal, and if the recognition unit recognizes that the connection portion and the wiring cable terminal are included, the inspection unit detects a black area in the overlapping area between a predetermined range of the line image and the area in which the wiring cable terminal is recognized by the recognition unit, and if the proportion of the black area occupying the overlapping area is less than a threshold, the inspection unit may determine that there is no gap near the wiring cable terminal, and if the proportion of the black area occupying the overlapping area is equal to or greater than a threshold, the inspection unit may determine that there is a gap near the wiring cable terminal.

[0010] ( 3One aspect of the present invention includes the steps of: a construction inspection server device obtaining from a terminal device inspection item information indicating that the inspection item is a base station battery including a plurality of battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image; the construction inspection server device calculating a confidence level indicating the certainty of the terminal portion of the battery cell based on the inspection image and recognizing whether or not the terminal portion is included in the inspection image based on the confidence level; the construction inspection server device performing an inspection of the entire base station battery installation work based on the number of recognized terminal portions and the positional relationship between the terminal portions; and the construction inspection server device notifying the terminal device of the inspection results. The base station battery comprises multiple sets of multiple battery cells arranged in one direction, the guide image is a frame image surrounding one set of multiple battery cells, the position of the frame image in the inspection image is acquired as guide information, and it is determined that the positional relationship between the terminals is appropriate when the positions of multiple terminals included in the frame image are arranged alternately across the center line of the frame image. This is a method for inspecting equipment installation work.

[0011] ( 4 ) One aspect of the present invention involves causing a computer to perform the following steps: acquiring from a terminal device inspection item information indicating that the inspection item is a base station battery including a plurality of battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image; calculating a confidence level indicating the certainty of the terminal portion of the battery cell based on the inspection image and recognizing whether or not the terminal portion is included in the inspection image based on the confidence level; performing an inspection of the entire base station battery installation work based on the number of recognized terminal portions and the positional relationship between the terminal portions; and having a construction inspection server device notify the terminal device of the inspection results. The base station battery comprises multiple sets of multiple battery cells arranged in one direction, the guide image is a frame image surrounding one set of multiple battery cells, the position of the frame image in the inspection image is acquired as guide information, and the positional relationship between the terminals is determined to be appropriate when the positions of multiple terminals included in the frame image are arranged alternately across the center line of the frame image. It is a program. [Effects of the Invention]

[0012] According to one aspect of the present invention, equipment installation work related to base station batteries can be inspected easily and with high precision. [Brief explanation of the drawing]

[0013] [Figure 1] It is a block diagram showing a configuration example of the facility construction inspection system of the embodiment. [Figure 2] It is a block diagram showing an example of an inspection target recognition unit. [Figure 3] It is a sequence diagram showing an example of the inspection process of the facility construction in the facility construction inspection system. [Figure 4] It is a flowchart showing an example of the inspection process of the facility construction in the construction inspection server device. [Figure 5] It is a diagram showing an example of a screen for selecting an inspection target. [Figure 6] It is a diagram showing an example of an overall guide image of the base station battery. [Figure 7] It is a diagram showing the relationship between the entire base station battery and the inspection standard. [Figure 8] It is a diagram for explaining an example of the arrangement of battery cells. [Figure 9] It is a diagram for explaining another example of the arrangement of battery cells. [Figure 10] It is a diagram showing an example of the recognition result by the inspection target recognition unit in the embodiment. [Figure 11] It is a flowchart showing an example of the inspection process of the entire base station battery by the inspection unit in the embodiment. [Figure 12] It is a diagram showing the relationship between the entire base station battery and the inspection standard. [Figure 13] It is a diagram showing an example of a properly constructed connection part. [Figure 14] It is a diagram showing an example of a connection part when the construction is not appropriate. [Figure 15] It is a diagram showing an example of a guide image of the connection part. [Figure 16] It is a diagram showing an example of the recognition result by the inspection target recognition unit in the embodiment. [Figure 17] It is a diagram for explaining an example of the inspection process of the connection part. [Figure 18] It is a flowchart showing an example of the inspection process of the connection part by the inspection unit in the embodiment. [Modes for carrying out the invention]

[0014] The following describes, with reference to the drawings, an inspection device for equipment installation, an inspection method for equipment installation, and an inspection program for equipment installation to which the present invention is applied.

[0015] The equipment installation inspection system of this embodiment uses images captured by on-site workers performing equipment installation at a base station to inspect the equipment installation. The equipment installation inspection system of this embodiment performs inspections easily and with high accuracy by determining whether or not the construction components to be inspected are present in the images captured by the on-site workers and whether or not the construction components are properly installed. Furthermore, by presenting the determination results (recognition results of construction components and inspection results) to the on-site workers, the equipment installation inspection system of this embodiment can reduce the effort required for on-site workers to take images, the effort required for equipment installation inspectors to perform inspections, and the effort required for re-installation in the event of defects in the equipment installation.

[0016] Figure 1 is a block diagram showing an example configuration of an equipment installation inspection system according to an embodiment. The equipment installation inspection system comprises, for example, one or more user terminal devices 100, an installation inspection server device 200, and a management terminal 300. The user terminal devices 100, the installation inspection server device 200, and the management terminal 300 are connected to, for example, a communication network NW. Each device connected to the communication network NW is equipped with a communication interface such as a NIC (Network Interface Card) or a wireless communication module (not shown in Figure 1). The communication network NW includes, for example, the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), a cellular network, etc.

[0017] The user terminal device 100 is a portable terminal device equipped with a camera, such as a smartphone or tablet. The user terminal device 100 starts a User Agent (UA), such as a browser or application program. The UA is an application for communication with the construction inspection server device 200, for example. The user terminal device 100 uses the construction inspection application as the UA to perform display processing and operation acceptance processing using content received from the construction inspection server device 200. The user terminal device 100 also uses the construction inspection application to provide operation information and captured images based on user operations to the construction inspection server device 200.

[0018] The construction inspection server device 200 is an information processing device that receives inspection requests for equipment construction and provides inspection results for equipment construction. The construction inspection server device 200 includes, for example, a collaboration API (Application Programming Interface) unit 210 and an inspection target recognition unit 220. Functional units such as the collaboration API unit 210 and the inspection target recognition unit 220 are realized by a processor such as a CPU (Central Processing Unit) executing a program stored in program memory. Furthermore, some or all of these functional units may be realized by hardware such as an LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), or FPGA (Field-Programmable Gate Array), or they may be realized by the cooperation of software and hardware.

[0019] The collaborative API unit 210 includes, for example, an API unit 212, an image processing unit 214, an inspection unit 216, and a control unit 218. The API unit 212 performs processing such as receiving various information from the user terminal device 100 and providing content to the user terminal device 100. The image processing unit 214 performs predetermined image processing on image data acquired from the user terminal device 100. Hereinafter, images used for inspection will be referred to as inspection images. The inspection unit 216 performs inspection processing of the equipment installation using the inspection images acquired by the API unit 212 and / or the inspection images processed by the image processing unit 214. The control unit 218 controls the image recognition engine in the inspection target recognition unit 220, such as starting it.

[0020] The inspection target recognition unit 220 includes, for example, multiple image recognition engines 222A, 222B, ... 222N (where N is a natural number). When referring to multiple image recognition engines collectively, they are simply referred to as image recognition engine 222. Each image recognition engine 222 corresponds to one of the multiple inspection items. The image recognition engine 222 performs recognition processing to recognize the construction member as the inspection target in the inspection item.

[0021] Figure 2 is a block diagram showing an example of an inspection target recognition unit. The inspection target recognition unit 220 includes, for example, a learning image database 230, a learning processing unit 232, a recognition processing unit 234, and a result output unit 236.

[0022] The learning image database 230 is a database that stores images acquired from, for example, the management terminal 300 as learning images. The learning image database 230 stores, for example, positive example images as learning images. A positive example image is an image of a target object in a normal state. A positive example image is, for example, an image of construction materials used in the construction of base station equipment. Construction materials are components of base station equipment such as base station batteries and fixing parts in battery cells contained in base station batteries. The positive example images are associated with tag information that includes the name of the construction material. In addition, information indicating, for example, the process name and the inspection item name may be associated with the positive example images. In addition, the learning image database 230 may store images of objects other than construction materials (objects in an abnormal state or defective products) as learning images, not limited to positive example images.

[0023] The learning processing unit 232 is supplied with training images from the training image database 230. The learning processing unit 232 performs recognition processing using the training images and obtains a judgment result. The learning processing unit 232 learns the processing parameters of the recognition processing unit 234 (recognition model 234A) so that the judgment result is that a construction member has been detected, and generates learning result data. The processing parameters of the recognition processing unit 234 (recognition model 234A) are, for example, filters (also called weights or biases) included in the neural network. The learning result data is stored in the learning result data storage unit 2341.

[0024] The recognition processing unit 234 includes, for example, a learning result data storage unit 2341 and a determination unit 2342. The learning result data storage unit 2341 stores the processing parameters of the recognition processing unit 234 as learning results, and the processing parameters of the recognition processing unit 234 are updated by the learning processing unit 232. When the recognition processing unit 234 acquires an inspection image, it extracts features using a recognition model 234A based on the processing parameters of the recognition processing unit 234. The determination unit 2342 detects construction members based on the extracted features. The recognition processing unit 234 outputs the determination result from the determination unit 2342 as the recognition result.

[0025] Figure 3 is a sequence diagram showing an example of the inspection process for equipment installation in the equipment installation inspection system. The user terminal device 100 transmits inspection item information to the construction inspection server device 200 based on user operations, and transmits inspection images and guide information corresponding to the inspection items to the construction inspection server device 200. Next, the construction inspection server device 200 transmits the recognition result of the object to be inspected included in the inspection image to the user terminal device 100, and further transmits the inspection result of the object to be inspected to the user terminal device 100. This allows the user to be notified whether the construction inspection server device 200 was able to accurately recognize the object to be inspected for the inspection items and object to be inspected specified by the user terminal device 100, and whether the construction of the object to be inspected was inspected to be carried out appropriately.

[0026] Figure 4 is a flowchart showing an example of the inspection process for equipment installation work in the construction inspection server device. First, the collaboration API unit 210 obtains the names of the inspection items in the equipment installation work based on the information received from the user terminal device 100 (step S100). At the time the names of the inspection items are obtained, the collaboration API unit 210 obtains the startup list of the inspection target recognition unit 220. The collaboration API unit 210 compares the names of the inspection items obtained in step S100 with the startup list (step S104) and determines whether the image recognition engine 222 corresponding to the obtained inspection item name is running or not (step S106). If the image recognition engine 222 corresponding to the inspection item name is not running (step S106: NO), the collaboration API unit 210 controls the system to start the image recognition engine 222 corresponding to the inspection item name (step S108).

[0027] The linked API unit 210 acquires an image file and an inspection information file (step S110) if the image recognition engine 222 corresponding to the inspection item name is running (step S106: YES), or after starting the image recognition engine 222 corresponding to the inspection item name in step S108. Next, the linked API unit 210 applies predetermined image processing to the inspection image contained in the acquired image file (step S112). Predetermined image processing includes, for example, edge sharpening processing and brightness correction processing. The user terminal device 100 passes the inspection image that has undergone the predetermined image processing to the image recognition engine 222 corresponding to the inspection item name.

[0028] The image recognition engine 222 performs recognition processing to determine whether or not a construction member (inspection target) corresponding to the inspection item name exists based on the image acquired from the cooperation API unit 210 (step S114). At this time, the image recognition engine 222 calculates a confidence score for each construction member. The image recognition engine 222 also calculates a confidence score for each construction member after image processing. If the confidence score for a construction member is above a predetermined value, the image recognition engine 222 determines that the construction member exists. If the image recognition engine 222 recognizes that a construction member exists (step S116: YES), it proceeds to step S120. If the image recognition engine 222 recognizes that a construction member does not exist (step S116: NO), it reacquires the inspection image (step S118). When the construction inspection server device 200 reacquires the inspection image, it sends a request to the user terminal device 100 to recapture the image.

[0029] The linked API unit 210 compares the confidence level of the construction member calculated by the image recognition engine 222 with a predetermined value (step S120). The linked API unit 210 uses the inspection image in which the construction member is recognized with a confidence level higher than the predetermined value to perform inspection item determination processing (step S122). The inspection item determination processing will be described later. As a result of the inspection item determination processing, the linked API unit 210 transmits the inspection result to the user terminal device 100 (step S124).

[0030] (Overall inspection of base station batteries) The following describes the overall inspection of base station batteries in base station equipment. Figure 5 shows an example of a screen for selecting an object to be inspected. The user terminal device 100 displays the object selection screen shown in Figure 5 based on user operations and recognizes which object to be inspected has been selected by accepting operations on the selection screen. In this embodiment, the objects to be inspected are the entire base station battery and the connection between the battery cells and the wiring cables. When the button corresponding to the entire base station battery is selected, the user terminal device 100 displays the screen shown in Figure 6.

[0031] Figure 6 shows an example of a guide image of the entire base station battery. The user terminal device 100 activates the camera device when a button corresponding to the entire battery is selected based on user operation. The base station battery in this embodiment includes, for example, a plurality of battery cells and wiring cables connecting the battery cells. The plurality of battery cells include three cell groups arranged in a row. That is, the base station battery as a whole comprises three sets of a plurality of battery cells arranged in one direction. Each battery cell has a red terminal and a black terminal. Wiring cables are connected to the red and black terminals. When the icon image for "entire base station battery" is selected, the user terminal device 100 displays an image captured by the camera device and a guide image for photographing the construction members to be photographed, as shown in Figure 6. The guide image is a guide frame for one cell group. To inspect the entire base station battery, the user terminal device 100 displays three guide frames corresponding to each of the three cell groups. This allows the user terminal device 100 to take inspection images so that each guide frame includes one cell group.

[0032] The user terminal device 100 may display a screen that includes a guidance message. The guidance message may be an image containing text such as, "Please take a picture so that all the battery cells arranged in a row in the guide frame are visible." The user terminal device 100 may also display a center line on each frame image to help align the frame image with the group of segments.

[0033] Figure 7 shows the relationship between the entire base station battery and the inspection standards. The equipment installation inspection system checks the arrangement of battery cells in each cell group to see if the polarity (+, -) is reversed. The equipment installation inspection system determines that the inspection is passed if the polarity (+, -) is not reversed in the cell group. The equipment installation inspection system determines that the inspection is failed if the polarity (+, -) is reversed in the cell group.

[0034] Figure 8 illustrates the arrangement of battery cells. The terminals corresponding to the red terminals are arranged in the order of down, up, down, up, down, up, down, down, up, relative to the reference line of the row of cells, from left to right. The reference line is a straight line along the direction in which the battery cells are lined up, and passes through the center of each battery cell. The equipment installation inspection system determines that the inspection is passed if the terminals are arranged with respect to the reference line as shown in Figure 8. The equipment installation inspection system determines that the inspection is failed because, as shown in Figure 9, the terminals corresponding to the terminals are arranged in the order of down, up, down, up, up, relative to the reference line, from left to right.

[0035] Figure 10 shows an example of the recognition result by the inspection target recognition unit 220 in the embodiment. The inspection target recognition unit 220 calculates a confidence level indicating the likelihood of the battery cell terminals based on the inspection image and recognizes whether or not the terminals are included in the inspection image based on the confidence level. As a result, the inspection target recognition unit 220 recognizes one red terminal for each battery cell and assigns the tag information "akatanshi" to the area recognized as the red terminal area.

[0036] Figure 11 is a flowchart showing an example of the inspection process for the entire base station battery by the inspection unit in the embodiment. First, the construction inspection server device 200 selects one group of cells included in the inspection image (step S200). The construction inspection server device 200 extracts the recognition results included in one guide frame from the recognition results recognized from the inspection image. If the position of the guide frame in the inspection image overlaps with the area to which the tag information "akatanshi" is assigned, the construction inspection server device 200 extracts the area to which the tag information is assigned as the recognition result.

[0037] Next, the construction inspection server device 200 determines whether a predetermined number of tag information "akatanshi" exists in the cell group (step S202). The predetermined number is, for example, 8. If 8 pieces of tag information do not exist (step S202: NO), the construction inspection server device 200 determines that the inspection of the cell group has failed (step S204). If 8 pieces of tag information exist (step S202: YES), the construction inspection server device 200 determines the center line of the guide frame from the position of the guide frame in the cell group (step S206). The construction inspection server device 200 determines whether the positional relationship between the determined center line and the centroids of the multiple regions to which the tag information "akatanshi" is attached is arranged from the right end to the left end in "down → up → down → up → down → up → down → up" (step S208). Based on the result determined in step S208, the construction inspection server device 200 determines whether the positional relationship between the center line and the multiple regions is appropriate (step S210). The construction inspection server device 200 determines that the inspection of the cell group is successful if the positional relationship with multiple areas is appropriate (step S210: YES) (step S212). The construction inspection server device 200 determines that the inspection of the cell group is unsuccessful if the positional relationship with multiple areas is not appropriate (step S210: NO) (step S214).

[0038] Next, the construction inspection server device 200 determines whether or not it has inspected all cell groups included in the inspection image (step S216). If the construction inspection server device 200 has not inspected all cell groups (step S216: NO), it returns to step S200. If the construction inspection server device 200 has inspected all cell groups (step S216: YES), it determines whether or not the inspection of all cell groups has passed (step S218). If the inspection of all cell groups has passed (step S218: YES), the construction inspection server device 200 notifies the user terminal device 100 that the inspection of the entire base station battery included in the inspection image has passed (step S220). If the inspection of all cell groups has not passed (step S218: NO), the construction inspection server device 200 notifies the user terminal device 100 that the inspection of the entire base station battery included in the inspection image has failed (step S220).

[0039] As described above, the equipment installation inspection system includes an API unit 212 (acquisition unit) that acquires from a user terminal device 100 inspection item information indicating that the inspection item is a base station battery containing multiple battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image; an inspection target recognition unit 220 that calculates a confidence level indicating the likelihood of the terminal portion of the battery cell based on the inspection image and recognizes whether or not the terminal portion is included in the inspection image based on the confidence level; an inspection unit 216 that performs an inspection of the equipment installation of the entire base station battery based on the number of terminal portions recognized by the inspection target recognition unit 220 and the positional relationship between the terminal portions; and an API unit 212 (notification unit) that notifies the user terminal device 100 of the results of the inspection performed by the inspection unit 216. This makes it possible to inspect equipment installation related to base station batteries simply and with high accuracy.

[0040] Specifically, in the equipment installation inspection system, a base station battery comprises multiple sets of battery cells arranged in one direction. The equipment installation inspection system determines that the positional relationship between terminals is appropriate if, for each set of battery cells (cell group), the multiple terminals provided on the set of battery cells are regularly arranged along one direction. This allows the equipment installation inspection system to easily and accurately inspect equipment installation based on the regularity of the positional relationship between terminals in multiple battery cells.

[0041] Furthermore, the equipment installation inspection system uses a frame image (guide frame) that encloses a group of cells as a guide image. The construction inspection server device 200 acquires the position of the guide frame in the inspection image as guide information. When the positions of multiple terminals included in the guide frame among the recognized terminals are arranged alternately across the center line of the frame image, the system determines that the positional relationship between the terminals is appropriate, thereby enabling simple and highly accurate inspection of equipment installation.

[0042] (Inspection of the fixed part) The following describes the inspection of the connection points of base station batteries in base station equipment. The equipment installation inspection system displays a selection screen for the object to be inspected, as shown in Figure 5, based on user input. If the connection between the battery cell and the wiring cable is selected, the system inspects the connection. The connection between the battery cell and the wiring cable is made by connecting the wiring cable to the red terminal and black terminal of the battery cell, respectively.

[0043] Figure 12 shows the relationship between the entire base station battery and the inspection standards, Figure 13 shows an example of a properly constructed connection, and Figure 14 shows an example of a poorly constructed connection. The equipment installation inspection system checks for any gaps between the wiring cable terminal and the battery cell terminal by viewing the connection from the side. The equipment installation inspection system determines that the inspection is passed if there is no gap between the wiring cable terminal and the battery cell terminal, as shown in Figure 13. The equipment installation inspection system determines that the inspection is failed if there is a gap between the wiring cable terminal and the battery cell terminal, as shown in Figure 14.

[0044] Figure 15 shows an example of a guide image for a connection. The user terminal device 100 activates the camera device when a button corresponding to the connection is selected based on user operation. The user terminal device 100 displays a dotted line, a guide frame, and a mask as a guide image. The user terminal device 100 also displays messages such as "Take a picture of the connection from directly to the side," "Include the bolt from head to tip within the frame," and "Align the side of the connection cable terminal with the dotted line." The mask is the area excluding the guide frame. This allows the user terminal device 100 to take a picture including the wiring cable terminal, battery cell terminal, bolt, and nut within the guide frame, and aligning the wiring cable terminal with the dotted line.

[0045] Figure 16 shows an example of the recognition result by the inspection target recognition unit 220 in the embodiment. The inspection target recognition unit 220 calculates a confidence score indicating the likelihood of the outer casing of the connection part based on the inspection image and recognizes whether or not the outer casing of the connection part is included in the inspection image based on the confidence score. As a result, the inspection target recognition unit 220 recognizes the outer casing of the connection part and assigns the tag information "nutall" to the area recognized as the outer casing of the connection part. The inspection target recognition unit 220 calculates a confidence score indicating the likelihood of the wiring cable terminal based on the inspection image and recognizes whether or not the wiring cable terminal is included in the inspection image based on the confidence score. As a result, the inspection target recognition unit 220 recognizes the wiring cable terminal and assigns the tag information "tanshi" to the area recognized as the wiring cable terminal.

[0046] Figure 17 is a diagram illustrating an example of the inspection process for the connection part. If the inspection unit 216 recognizes that the outer area and the wiring cable terminal area are included based on the inspection result of the inspection target recognition unit 220, it sets the area within a predetermined range from the dotted line as the wiring cable terminal vicinity area. The inspection unit 216 detects the black area in the overlapping area between the wiring cable terminal vicinity area and the wiring cable terminal area. The black area is determined based on the RGB data in the inspection image. If the proportion of the overlapping area occupied by the black area is less than a threshold, the inspection unit 216 determines that there is no gap between the wiring cable terminal and the battery cell terminal. If the proportion of the overlapping area occupied by the black area is equal to or greater than the threshold, the inspection unit 216 determines that there is a gap between the wiring cable terminal and the battery cell terminal.

[0047] In this embodiment, the region corresponding to the gap between the wiring cable terminal and the battery cell terminal was treated as a black region, but the system is not limited to this. If the equipment installation inspection system has collected a large number of training images in which there is a gap between the wiring cable terminal and the battery cell terminal, and has constructed an image recognition engine 222 that learns and recognizes the gap between the wiring cable terminal and the battery cell terminal, the gap region may be recognized by the image recognition engine 222.

[0048] Figure 18 is a flowchart illustrating an example of the inspection process of connection parts by the inspection unit in the embodiment. The process in Figure 18 describes the process of uploading inspection images of all connection parts included in the base station battery to the construction inspection server device 200 and then inspecting each connection part individually, but is not limited to this, and inspection may be performed each time an inspection image is acquired. First, the construction inspection server device 200 selects one connection part included in the inspection image (step S300). The construction inspection server device 200 extracts the recognition result included in the one connection part from the recognition results recognized from the inspection image.

[0049] Next, the construction inspection server device 200 determines whether the tag information "tanshi" included in the connection part exists on the dotted line in the guide image (step S302). If there is no area on the dotted line to which the tag information "tanshi" is assigned (step S302: NO), the construction inspection server device 200 determines that the inspection of the connection part has failed (step S304). If there is an area on the dotted line to which the tag information "tanshi" is assigned (step S302: YES), the construction inspection server device 200 detects the black area in the overlapping area between the predetermined range area from the dotted line and the area where the wiring cable terminal is recognized (step S306). The construction inspection server device 200 calculates the percentage of the predetermined range area from the dotted line that is occupied by the black area (step S308). The construction inspection server device 200 determines whether the percentage occupied by the black area is less than a threshold (step S310). The construction inspection server device 200 determines that the inspection of the connection is passed if the proportion occupied by the black area is less than the threshold (step S310: YES) (step S312). The construction inspection server device 200 determines that the inspection of the connection is failed if the proportion occupied by the black area is not less than the threshold (step S310: NO) (step S314).

[0050] Next, the construction inspection server device 200 determines whether or not it has inspected all connection points included in the inspection image (step S316). If the construction inspection server device 200 has not inspected all connection points (step S316: NO), it returns to step S300. If the construction inspection server device 200 has inspected all connection points (step S316: YES), it determines whether or not the inspection of all connection points has passed (step S318). If the inspection of all connection points has passed (step S318: YES), the construction inspection server device 200 notifies the user terminal device 100 that the inspection of the connection points for the base station battery has passed (step S320). If the inspection of all connection points has not passed (step S318: NO), the construction inspection server device 200 notifies the user terminal device 100 that the inspection of the connection points for the base station battery included in the inspection image has failed (step S320).

[0051] As described above, the equipment installation inspection system uses a guide image that includes a frame image surrounding the connection part connecting the wiring cable terminal and the battery cell, and a line image corresponding to the side of the wiring cable terminal. The inspection target recognition unit 220 recognizes whether the connection part is included in the inspection image based on the confidence level indicating the certainty of the outer casing of the connection part, and whether the wiring cable terminal is included in the inspection image based on the confidence level indicating the certainty of the wiring cable terminal. In the equipment installation inspection system, if the inspection target recognition unit 220 recognizes that the connection part and the wiring cable terminal are included, the inspection unit 216 detects a black area in the overlapping area between a predetermined range of the line image and the area in which the wiring cable terminal is recognized. If the proportion of the overlapping area occupied by the black area is less than a threshold, it is determined that there is no gap near the wiring cable terminal. If the proportion of the overlapping area occupied by the black area is equal to or greater than the threshold, it is determined that there is a gap near the wiring cable terminal. As a result, the equipment installation inspection system enables simple and highly accurate inspection of equipment installation work related to base station batteries.

[0052] Although various embodiments and modifications have been described, these are merely examples and are not limited to these. For example, one embodiment or modification, or a part of one embodiment or modification, may be combined with one or more other embodiments or modifications to realize one aspect of the present invention.

[0053] In this embodiment, programs for executing each process of the user terminal device 100 and the construction inspection server device 200 may be recorded on a computer-readable recording medium, and the programs recorded on the recording medium may be loaded into a computer system and executed to perform the various processes of the user terminal device 100 and the construction inspection server device 200 as described above.

[0054] Furthermore, the term "computer system" as used herein may include hardware such as the operating system and peripheral devices. Additionally, if a WWW system is being used, "computer system" shall also include the homepage provisioning environment (or display environment). Moreover, "computer-readable recording media" refers to storage devices such as flexible disks, magneto-optical disks, ROMs, writable non-volatile memory such as flash memory, portable media such as CD-ROMs, and hard disks built into computer systems.

[0055] Furthermore, "computer-readable recording media" refers to volatile memory (for example, DRAM (Dynamic)) within a computer system that acts as a server or client when a program is transmitted via a network such as the internet or a communication line such as a telephone line. This includes devices that retain programs for a certain period of time, such as Random Access Memory. Furthermore, the above-mentioned program may be transmitted from a computer system that stores the program in a memory device or the like to another computer system via a transmission medium or by transmission waves within the transmission medium.

[0056] Here, the "transmission medium" used to transmit the program refers to a medium that has the function of transmitting information, such as a network (communication network) like the Internet or a communication line (communication line) like a telephone line. Furthermore, the program described above may be intended to implement only a part of the functions mentioned above. Moreover, it may be a so-called differential file (differential program) that can implement the aforementioned functions in combination with a program already recorded in the computer system.

[0057] Although embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and includes designs that do not depart from the spirit of the invention. For example, an embodiment of the present invention may consist only of a user terminal device 100. [Explanation of symbols]

[0058] 100 User terminal devices 200 Construction Inspection Server Equipment 210 Integration API Department 212 API Department 214 Image Processing Unit 216 Inspection Department 218 Control Unit 220 Inspection target recognition unit 222 Image Recognition Engine

Claims

1. An acquisition unit acquires from a terminal device inspection item information indicating that the inspection item is a base station battery containing multiple battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image. A recognition unit calculates a degree of confidence indicating the likelihood of the terminal portion of the battery cell based on the inspection image and recognizes whether or not the terminal portion is included in the inspection image based on the degree of confidence. An inspection unit performs an inspection of the entire base station battery equipment installation based on the number of terminals and the positional relationship between the terminals recognized by the recognition unit, The system includes a notification unit that notifies the terminal device of the results of the inspection performed by the inspection unit, The base station battery comprises multiple sets of the battery cells arranged in one direction, The aforementioned guide image is a frame image that surrounds a set of multiple battery cells. The acquisition unit acquires the position of the frame image in the inspection image as the guide information. The inspection unit determines that the positional relationship between terminals is appropriate when the positions of multiple terminals included in the frame image, among the terminals recognized by the recognition unit, are arranged alternately across the center line of the frame image. This is an inspection device for equipment installation work.

2. The guide image includes a frame image surrounding the connection portion that connects the wiring cable terminal and each of the battery cells, and a line image corresponding to the side of the wiring cable terminal. The recognition unit recognizes whether the inspection image includes the connection part based on a confidence level indicating the likelihood of the outer casing of the connection part, and recognizes whether the inspection image includes the wiring cable terminal based on a confidence level indicating the likelihood of the wiring cable terminal. When the recognition unit recognizes that the connection part and the wiring cable terminal are included, the inspection unit detects a black area in the overlapping area between a predetermined range of the line image and the area in which the wiring cable terminal was recognized by the recognition unit. If the proportion of the overlapping area occupied by the black area is less than a threshold, the inspection unit determines that there is no gap near the wiring cable terminal. If the proportion of the overlapping area occupied by the black area is equal to or greater than the threshold, the inspection unit determines that there is a gap near the wiring cable terminal. An inspection device for equipment installation work as described in claim 1.

3. The construction inspection server device obtains from a terminal device: inspection item information indicating that the inspection item is a base station battery containing multiple battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image. The construction inspection server device calculates a confidence level indicating the certainty of the terminal portion of the battery cell based on the inspection image and recognizes whether or not the terminal portion is included in the inspection image based on the confidence level. The construction inspection server device performs an inspection of the entire base station battery equipment based on the number of recognized terminals and the positional relationship between the terminals, The construction inspection server device includes the step of notifying the terminal device of the inspection results, The base station battery comprises multiple sets of the battery cells arranged in one direction, The aforementioned guide image is a frame image that surrounds a set of multiple battery cells. The position of the frame image in the inspection image is obtained as the guide information. An inspection method for equipment installation, which determines that the positional relationship between terminals is appropriate when the positions of multiple terminals included in the frame image among the recognized terminals are arranged alternately across the center line of the frame image.

4. On the computer, Steps include obtaining from a terminal device: inspection item information indicating that the inspection item is a base station battery containing multiple battery cells, an inspection image of the base station battery, and guide information relating to a guide image for imaging the base station battery included in the inspection image; The steps include: calculating a degree of confidence indicating the likelihood of the terminal portion of the battery cell based on the inspection image, and recognizing whether or not the terminal portion is included in the inspection image based on the degree of confidence; A step of inspecting the entire equipment installation for the base station battery based on the number of recognized terminals and the positional relationship between the terminals, The construction inspection server device performs the step of notifying the terminal device of the inspection results, The base station battery comprises multiple sets of the battery cells arranged in one direction, The aforementioned guide image is a frame image that surrounds a set of multiple battery cells. The position of the frame image in the inspection image is obtained as the guide information. A program that determines that the positional relationship between terminals is appropriate when the positions of multiple terminals included in the frame image among the recognized terminals are arranged alternately across the center line of the frame image.

Images