Parts replacement work registration system and part replacement work registration method
The system simplifies the classification of pre- and post-replacement images by writing a specific figure on parts and using image analysis, enhancing the efficiency of work report preparation.
Patent Information
- Application Number
- JP2021181624
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-08
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-11-08
AI Technical Summary
During maintenance work on equipment like elevators, distinguishing between images of parts before and after replacement is difficult due to the lack of visible serial numbers, making it challenging to accurately register work completion reports.
A parts replacement work registration system that involves writing a specific figure on the part to be replaced, using image analysis to differentiate pre- and post-replacement images, and storing them in dedicated folders for easy classification.
Facilitates efficient classification of captured images, reducing labor in preparing work completion reports by ensuring accurate differentiation between old and new parts.
Smart Images

Figure 0007595551000001 
Figure 0007595551000002 
Figure 0007595551000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a part replacement work registration system and a part replacement work registration method. [Background technology]
[0002] Conventionally, during maintenance work on equipment such as elevators, some parts attached to the equipment are sometimes removed and replaced with new parts. When replacing with new parts, workers usually take pictures of the old and new parts with their own terminals and attach the pictures to a work report.
[0003] Patent Document 1 describes a technique for recognizing characters from an image of an object containing characters. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 10-21337 Summary of the Invention [Problem to be solved by the invention]
[0005] In part replacement work performed during maintenance work on elevators and the like, images of the parts before and after replacement are often indistinguishable from each other. Therefore, workers who prepare work reports attach to their work reports images of the parts before and after replacement, distinguishing between images of the parts before and after replacement based on slight differences in the degree of dirt on the parts.
[0006] As described in Patent Document 1, if the part to be replaced has a serial number, manufacturing number, etc., it is possible to distinguish between the part before and after replacement by recognizing the letters and numbers contained in the image. However, parts that are replaced during actual maintenance work rarely have serial numbers or the like written on them, making it difficult to distinguish between the part before and after replacement from the image.
[0007] An object of the present invention is to provide a part replacement work registration system and a part replacement work registration method that can easily register images of parts before replacement. [Means for solving the problem]
[0008] In order to solve the above problems, for example, the configurations described in the claims are adopted. The present application includes multiple means for solving the above-mentioned problems, and one example is a part replacement work registration system that registers the parts before and after replacement when a part installed on site is removed and replaced with another part by a worker during elevator maintenance work, and includes a specific image detection unit that detects a specific figure from image data of the part, and an analysis result output unit that determines that image data in which the specific image detection unit has detected the specific figure is image data of the removed part and stores it in a pre-replacement part image folder, and stores image data in which the specific figure is not detected in a post-replacement part image folder. Effect of the Invention
[0009] According to the present invention, a worker can simply write a specific predetermined figure on a part to be removed, and the image of the part with the figure written on it can be determined as an image of the part before replacement, and the image can be easily classified as either the part before replacement or the new part after replacement. Therefore, there is an effect of reducing the labor required for creating a work completion report. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]
[0010] [Figure 1] 1 is a diagram showing an example of maintenance work for an elevator to which a part replacement work registration system according to an embodiment of the present invention is applied; [Diagram 2] 1 is a block diagram showing an example of the configuration of a part replacement work registration system according to an embodiment of the present invention; [Diagram 3] 1 is a block diagram showing an example of a hardware configuration of a computer that functions as a part replacement work registration system according to an embodiment of the present invention. [Figure 4] FIG. 13 is a diagram showing an example of an image to be written to a part according to an embodiment of the present invention. [Diagram 5] 1 is a flowchart (part 1) showing the flow of a part replacement operation according to an embodiment of the present invention. [Figure 6] 11 is a flowchart (part 2) showing the flow of a part replacement operation according to an embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing an example of a work report according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, a part replacement work registration system according to one embodiment of the present invention (hereinafter, referred to as "this embodiment") will be described with reference to the accompanying drawings.
[0012] [Examples of maintenance work] FIG. 1 shows an example of a maintenance work to which the part replacement work registration system of this embodiment is applied. Here, an example of performing maintenance and inspection work on an elevator, which is a lifting machine, is given. In an elevator 10 shown in Fig. 1, a car 11 and a weight 12 are connected to a main rope, and the car 11 rises and falls when the main rope is wound up by a hoist 14 installed in a machine room 13. An elevator control panel (not shown) is also installed in the machine room 13. When a worker performs maintenance and inspection work, he or she enters the machine room 13 and inspects, adjusts, replaces, etc., the installed equipment.
[0013] For example, during maintenance and inspection work, a worker may remove some parts installed on an elevator control panel and replace them with new parts. In this case, the worker always carries the mobile terminal 100 and performs the replacement work based on a work plan displayed on the mobile terminal 100. The mobile terminal 100 is a dedicated terminal for maintenance and inspection work, but it may also be configured by installing a dedicated application program on a general-purpose terminal such as a smartphone or tablet terminal.
[0014] The mobile terminal 100 communicates with the work plan management server 20 and the manager terminal 30 via a network N such as a wireless telephone line. The mobile terminal 100 receives a work plan for maintenance and inspection work from the work plan management server 20. When a worker registers the start or end of work on the mobile terminal 100, the manager can check the registration status on the manager terminal 30. When a work completion report (described later) is created on the mobile terminal 100, the manager can also check the work completion report on the manager terminal 30.
[0015] [Mobile device configuration] Fig. 2 is a functional block diagram showing a process performed when the mobile terminal 100 carried by the worker registers a part replacement. The process by the configuration shown in Fig. 2 is executed when the worker operates the mobile terminal 100 to register an image of the replacement part. The mobile terminal 100 includes a camera 101, and when replacing a part, the worker takes pictures of both the part before removal and the part after replacement to obtain still image data.
[0016] Before removal, the worker draws a specific figure on the surface of the part with a writing implement such as a pen of a specific color (such as an oil-based pen). In this example, as shown in Fig. 4, a figure consisting of an x mark B1 surrounded by a circle B2 is drawn on the surface of part 15 before removal. Then, when the worker photographs part 15 before removal, the drawn x mark B1 and circle B2 are included in the image as shown in Fig. 4. The shapes used here should not be shapes that are commonly seen on general equipment and machinery (circles, straight lines, etc.), nor should they be shapes that are often drawn for purposes other than part replacement (X marks or check marks), and should be designs that anyone can draw easily. In the example of Figure 4, taking these points into consideration, a shape is used in which an X mark B1 is surrounded by a circle B2.
[0017] Returning to the explanation of FIG. 2, image data captured by the camera 101 is input into the mobile terminal 100 by the image input unit 102 and sent to the image analysis unit 110 . The image analysis unit 110 includes a circular image detection unit 111 , a circular area normalization unit 112 , an image black and white conversion unit 113 , a matching detection unit 114 , and an image template storage unit 115 . The circle image detection unit 111 is a specific image detection unit that performs a specific image detection process to detect marks written on parts, and in this example, detects circles within an image. Here, a technique such as Hough transform is used to detect a circular area from within the image.
[0018] When the circular image detection unit 111 detects a circle, it supplies the image data to the circular area normalization unit 112. The circular area normalization unit 112 enlarges or reduces the detected circular area to normalize it to a predetermined size. Furthermore, the circular area normalization unit 112 sends the normalized circular area to the image black and white conversion unit 113, which converts the normalized circular area into black and white binary image data.
[0019] The image black and white conversion unit 113 supplies the binarized image data of the circular area to the matching detection unit 114. The matching detection unit 114 compares the supplied image data of the circular area with a template of a specific image stored in the image template storage unit 115, and obtains a similarity. Then, when the similarity is equal to or higher than a certain level, the matching detection unit 114 detects that the image matches the template of the specific image. When the matching detection unit 114 detects the image, normalization has been performed by the circular area normalization unit 112 and binarization has been performed by the image monochrome conversion unit 113, so that the match or mismatch with the template can be detected by a relatively simple calculation process.
[0020] The result detected by the matching detection unit 114 is supplied to the analysis result output unit 103 as an output of the image analysis unit 110. The analysis result output unit 103 determines a storage folder for the image data input to the image input unit 102 based on the detection result of whether or not there is a match. That is, when the matching detection unit 114 detects a match with the template of the specific image, the analysis result output unit 103 stores the detected image data in the dedicated storage folder 104 for image data of old parts. In addition, when the matching detection unit 114 does not detect a match with the template of the specific image, the analysis result output unit 103 stores the detected image data in the dedicated storage folder 105 for image data of new parts.
[0021] The image data stored in the old part image data dedicated storage folder 104 and the image data stored in the new part image data dedicated storage folder 105 are read out by the form creation unit 106. The form creation unit 106 has a pre-replacement part selection unit 107 and a post-replacement part selection unit 108. The image of the pre-replacement part to be pasted on the form created by the form creation unit 106 is selected from the old part image data dedicated storage folder 104 by the pre-replacement part selection unit 107. Also, the image of the post-replacement part to be pasted on the form created by the form creation unit 106 is selected from the new part image data dedicated storage folder 105 by the post-replacement part selection unit 108. Furthermore, the form created by form creation unit 106 is judged by work content judgment unit 109. Work content judgment unit 109 recognizes the image attached to the image attachment field of the part before replacement on the electronic form and the image attached to the image attachment field of the part after replacement, and judges whether they match the work content indicated by text or the like on the electronic form. For example, when the work content indicates relay replacement, it judges whether the part before replacement and the part after replacement are relays.
[0022] FIG. 3 shows an example of the hardware configuration of an information processing device (computer device) configured as the mobile terminal 100.
[0023] The mobile terminal (computer device) 100 includes a CPU (Central Processing Unit) 100a, a main memory unit 100b, a non-volatile storage 100c, a camera 100d, a network interface 100e, an input / output unit 100f, and a display unit 100g, all of which are connected to a bus.
[0024] The CPU 100a is an arithmetic processing unit that reads out and executes program code of software that realizes the functions performed by the mobile terminal 100 from the main memory unit 100b or the non-volatile storage 100c. The software here includes software for supporting maintenance and inspection work. The CPU 100a reads out program codes from the main memory 100b or the non-volatile storage 100c and executes arithmetic processing in a work area in the main memory 100b, thereby configuring various processing function units in the main memory 100b. For example, the image analysis unit 110 and the analysis result output unit 103 shown in FIG. 2 are configured in the main memory 100b.
[0025] For example, a large-capacity information storage medium such as a hard disk drive (HDD), a solid state drive (SSD), or a memory card is used for the nonvolatile storage 100c. Software for implementing the functions performed by the mobile terminal 100 and data obtained by executing the program are also stored in the nonvolatile storage 100c. That is, the nonvolatile storage 100c constitutes a dedicated storage folder 104 for image data of old parts and a dedicated storage folder 105 for image data of new parts shown in FIG. 2.
[0026] The camera 100d captures still images and moving images. The network interface 100e transmits and receives data to and from other devices via a connected network. For example, the network interface 100e transmits and receives data to and from the work plan management server 20 and the manager terminal 30 shown in FIG. The input / output unit 100f receives operations by the holder (operator) of the mobile terminal 100, and outputs the reception result. The display unit 100g displays information necessary for performing work support. For example, the display unit 100g displays a work schedule, such as a work plan, transmitted from the work plan management server 20. After the work is completed, a work completion report is displayed on the display unit 100g. Furthermore, the display unit 100g also displays images captured by the camera 100d.
[0027] [Flow of parts replacement work in elevator maintenance] Next, the flow of parts replacement work in elevator maintenance work will be described with reference to Figs. First, a work plan for each worker is created by the manager's operation on the manager terminal 30 (step S11), and the created work plan is stored in the work plan management server 20 (step S12). The stored work plan is displayed on the mobile terminal 100 that is always carried by the worker to whom the corresponding work plan is assigned (step S13). The worker checks the work content displayed on his / her own mobile terminal 100 by the day of the work (step S14).
[0028] If the confirmed work is to replace a part in the elevator control panel, the worker prepares a replacement part (hereinafter referred to as a "new part") for the existing part (hereinafter referred to as an "old part") installed in the elevator control panel (step S15). Then, on the day of work, the worker brings the new part and heads to the work site (step S16). The work site is the building in which the elevator is installed, and the building manager is present in the manager's office, so the worker informs the manager that he will be starting maintenance work and obtains permission to work (step S17).
[0029] Next, the worker enters the machine room where the elevator control panel is installed (step S18), turns off the elevator's power supply, and after confirming safety (step S19), opens the cover of the control panel (step S20). The worker then visually confirms the installation positions of the old parts in the control panel (step S21), and visually confirms that the new parts he has brought are compatible with the old parts (step S22).
[0030] Here, the worker draws a specific figure (a figure consisting of a circle B2 surrounding an X mark B1) on the old part with an oil-based pen or the like as shown in FIG. 4 (step S23). After that, the worker activates the camera function of the mobile terminal 100 (step S24). Then, the worker uses the camera function of the mobile terminal 100 to take a picture of the old part (step S25). After taking the picture, the worker removes the old part (step S26) and installs the new part (step S27). After installing the new part, the worker takes a picture of the new part with the camera function of the mobile terminal 100 (step S28).
[0031] If there are multiple replacement jobs, the same procedure is followed: draw a figure on the old part, photograph it, then perform the replacement, and then photograph the new part. Once all the replacement jobs are complete, the worker turns on the power to the elevator control panel, restoring the elevator to a usable state (step S29). On the other hand, in the mobile terminal 100, after the shooting is completed, the image judgment system by the image analysis unit 110 shown in FIG. 2 is started (step S30).
[0032] Turning now to FIG. 6, the image judgment system judges whether or not the specific figure shown in FIG. 4 is present on the image of the image data (step S31). In step S31, if there is a specific graphic (YES in step S31), the image data of the part on which the specific graphic is drawn is stored in the storage folder 104 dedicated to image data of old parts (step S32). On the other hand, in step S31, if there is no specific graphic (NO in step S31), the image data is stored in the storage folder 105 dedicated to image data of new parts (step S33).
[0033] Next, the worker activates the work completion report creation function of the mobile terminal 100, and the worker creates a work completion report (step S34). A specific example of the work completion report will be described later, but since it is necessary to paste image data of the old parts and the new parts into the work completion report, the worker first opens the dedicated storage folder 104 for image data of old parts in the mobile terminal 100, and displays a list of the image data of the old parts on the mobile terminal 100 (step S35). Note that at this stage, the mobile terminal 100 may automatically open the dedicated storage folder 104 for image data of old parts and display a list of the contents of the folder.
[0034] The worker selects one of the displayed image data of the old parts and pastes it in the photo attachment field of the old parts in the work completion report (step S36). Note that if multiple parts have been replaced, there will be multiple image data of the old parts, but since all of them are image data of old parts, it is sufficient to select all of the image data and paste them in the photo attachment field of the old parts in the work completion report.
[0035] Next, the worker opens the new part image data dedicated storage folder 105 of the mobile terminal 100, and displays a list of the image data of the new part (step S37). The worker visually selects from the displayed image data of the new part those with the same specifications and shape as those in the photo attachment field for the old part (step S38).The worker then pastes the selected image data into the photo attachment field for the new part in the work completion report (step S39).This completes the work completion report.
[0036] Next, the worker submits the created work completion report to the building manager, reporting the completion of the work (step S40). Furthermore, after leaving the building where the work is being carried out, the worker returns to his / her place of work and submits a work completion report to the worker's manager, reporting the completion of the work (step S41). Upon receiving the report, the manager approves the work completion report (step S42), and registers the work completion report approved by the manager in the work plan management server 20 (step S43). This completes one task.
[0037] [Example of a work report] FIG. 7 shows an example of a task completion report created by the mobile terminal 100 of this embodiment. The work completion report is an electronic document that includes a column E1 for entering information about the work site where the work was performed, a column E2 for entering the details of the work, a column E3 for pasting image data of the old part, and a column E4 for pasting image data of the new part. In the example of Figure 7, to create a work completion report for when three parts have been replaced, three columns E3 for pasting image data of the old parts and three columns E4 for pasting image data of the new parts (E3-1 to E3-3, E4-1 to E4-3) are provided.
[0038] The column E1 for entering information about the work site where the work was performed and the column E2 for entering the work content are pre-filled with information registered in the work plan management server 20, and can be used as is without modification unless there are particular changes. Therefore, the main task required for the worker to complete the work completion report is to paste image data of the parts into columns E3 and E4.
[0039] Here, when pasting an image of the old part into column E3, as explained in step S35 of FIG. 6, the storage folder 104 dedicated to image data of old parts is opened, and by simply selecting from that folder, the image of the old part can be pasted without error into each of the three columns E3-1 to E3-3. Furthermore, when pasting an image of a new part into column E4, as explained in step S37 of FIG. 6, the dedicated storage folder 105 for image data of new parts is open, so that the image of the new part can be pasted without error simply by selecting from that folder an image of the same specifications and shape as the old parts pasted into columns E3-1 to E3-3.
[0040] As described above, the part replacement registration system of this embodiment eliminates the need to visually select images of old parts from images of new parts. In particular, the image of the old part can be mechanically pasted into the corresponding column of the work completion report, which is a simple task, and it is possible to significantly reduce the labor required for creating the work completion report.
[0041] [Variations] It should be noted that the embodiment examples described so far have been described in detail in order to explain the present invention in an easily understandable manner, and are not necessarily limited to those having all of the configurations described.
[0042] 7, mobile terminal 100 may automatically paste images stored in image data dedicated storage folder 104 for old parts into field E3 for pasting image data of old parts, based on the shooting order, etc. Alternatively, even if automatic pasting is not performed, mobile terminal 100 may be configured so that images stored in image data dedicated storage folder 104 for old parts can be pasted only into pasting field E3 for old parts, and may not accept the operation even if the worker performs an operation to paste into pasting field E4 for new parts.
[0043] Furthermore, when an image of an old part is pasted in the old part pasting field E3 by an operator or automatically, the mobile terminal 100 may search for an image of a new part having substantially the same specifications and shape from the new part image data dedicated storage folder 105, and automatically paste it in the corresponding new part pasting field E4. For example, when an image of a relay as an old part is pasted in the old part pasting field E3-1 shown in Fig. 7, the mobile terminal 100 executes a process of searching for an image of the same relay shape from the new part image data dedicated storage folder 105, and pasting it in the new part pasting field E4-1 corresponding to the field E3-1. By automatically pasting images of the old and new parts in this way, it becomes easier to create work completion reports.
[0044] Alternatively, when the attachment of images to the work completion report is completed on the mobile terminal 100, the mobile terminal 100 may determine whether the attachment fields E3 for the old parts and E4 for the new parts correspond to each other, and determine whether the work completion report as an electronic document has been created properly. For example, when an image of a relay as an old part is attached in the attachment field E3-1 for the old parts and an image of a new part other than the relay is attached in the attachment field E4-1 for the new parts, the mobile terminal 100 detects a mismatch between the old part and the new part by image recognition and displays a warning that the work completion report is not proper. This makes it possible to prevent mistakes in creating work completion reports. Furthermore, if the work details written in the work completion report include the name of the part to be replaced, the mobile terminal 100 may automatically use image recognition to find an image of a part having a shape corresponding to that part name, and paste it in the old part pasting field E3 and the new part pasting field E4 of the work completion report.
[0045] 2 and 3 is mounted on a mobile terminal dedicated to maintenance work that is always carried by a worker during work, but the device used is not particularly limited, and the mobile terminal may be mounted on, for example, a commonly used smartphone or tablet terminal. Also, a mobile terminal such as a notebook personal computer device, which is a separate device from the camera and the mobile terminal, may receive image data captured by the camera and process it.
[0046] Furthermore, the present invention is not limited to use in part replacement, but may also be used as a means for determining whether work is before or after work has been completed. For example, the present invention may be used as a means for determining whether work is before or after inspection during maintenance inspection.
[0047] In the above embodiment, the elevator is an example of a lift, and parts are replaced during maintenance work. However, the present invention can be applied to parts replacement of various other equipment. In the above-mentioned embodiment, the mobile terminal 100 carried by the worker is used to create a work completion report at the end of the work at the site. However, the image data stored in the old part image data dedicated storage folder 104 and the new part image data dedicated storage folder 105 may be used to create a work completion report at a later date on another terminal device. The old part image data dedicated storage folder 104 and the new part image data dedicated storage folder 105 may be prepared on any server such as the work plan management server 20, instead of being prepared in the mobile terminal 100 carried by the worker. Although the configurations of the old part image data dedicated storage folder 104 and the new part image data dedicated storage folder 105 have not been particularly described, the image data in each folder may be classified and stored, for example, by the work date or the shooting location. The mobile terminal 100 may automatically delete the image data in each folder when the work completion report is completed or when a predetermined number of days have passed since the work date.
[0048] In addition, in the configuration diagrams shown in Figures 2 and 3, only control lines and information lines that are considered necessary for explanation are shown, and not all control lines and information lines in the product are necessarily shown. In reality, it can be considered that almost all components are connected to each other. Furthermore, when the system of this example is configured with an information processing device such as a computer, the program that realizes the part replacement work registration method may be prepared in non-volatile storage or memory within the computer that constitutes the mobile terminal, or it may be stored on a recording medium such as an external memory, an IC card, an SD card, or an optical disk and transferred. [Explanation of symbols]
[0049] 10... elevator, 12... weight, 13... machine room, 14... hoist, 15... parts, 20... work plan management server, 30... administrator terminal, 100... mobile terminal, 100a... CPU, 100b... main memory unit, 100c... non-volatile storage, 100d... camera, 100e... network interface, 100f... input / output unit, 100g... display unit, 101... camera, 102... image input unit, 103... analysis result output unit, 104... dedicated storage folder for image data of old parts, 105... dedicated storage folder for image data of new parts, 110... image analysis unit, 111... circle image detection unit, 112... circle area normalization unit, 113... image black and white conversion unit, 114... matching detection unit, 115... image template storage unit
Claims
1. A part replacement work registration system that registers parts before and after replacement when a worker removes a part installed on site and replaces it with another part during maintenance work on an elevator, a specific image detection unit that detects a specific figure from image data obtained by photographing a part; and an analysis result output unit that determines that the image data in which the specific image detection unit detects the specific figure is image data of a removed part and stores the image data in a before-replacement part image folder, and stores image data in which the specific figure is not detected in a after-replacement part image folder. Parts replacement work registration system.
2. Execute a process of attaching the image data stored in the pre-replacement part image folder to an image attachment field for the pre-replacement part on an arbitrary mount provided in the electronic document.
2. The part replacement work registration system according to claim 1.
3. Further, a post-replacement part selection unit is provided for executing a process of searching for a part having the same shape as the image pasted in the image attachment field of the pre-replacement part from among the image data stored in the post-replacement part image folder and pasting the part in the image attachment field of the post-replacement part of any mount provided in the electronic document. The part replacement work registration system according to claim 2 .
4. Furthermore, the analysis result output unit includes a work content determination unit that recognizes an image attached to an image attachment field of the part before replacement in the electronic document and an image attached to an image attachment field of the part after replacement, and determines whether the images match the work content indicated in the electronic document. The parts replacement work registration system according to claim 3.
5. A part replacement work registration method for registering parts before and after replacement in an information processing terminal when a part installed on a site is removed and replaced with another part during maintenance work on an elevator by a worker, comprising: The process performed by the information processing terminal is as follows: A specific image detection process for detecting a specific figure from image data of the part; and an analysis result output process for determining that the image data in which a specific figure is detected by the specific image detection process is image data of a removed part and storing the image data in a before-replacement part image folder, and storing image data in which the specific figure is not detected in a after-replacement part image folder. How to register part replacement work.
Citation Information
Patent Citations
Device for recognizing character
JP1998021337A
Elevator maintenance system
JP2007084191A
Device for preparing maintenance work report of building equipment
JP2007091381A
Automatic arrangement system of maintenance person and automatic arrangement method of maintenance person
JP2018090392A
Preservation work support apparatus and preservation work support method
JP2018147156A
