Inspection Workflow Management System

JP7634066B1Active Publication Date: 2025-02-20HITACHI CONSTRUCTION MACHINERY CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023197083
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-11-21
Publication Date
2025-02-20
Estimated Expiration
2043-11-21

AI Technical Summary

Benefits of technology

【0007】 本発明によれば、過去の不具合事例に関する画像や動画、音(動画像データ)を点検結果や作業機械に関する情報と関連付け、これらの情報をキーワードとして関連する動画像データを抽出できるようにすることで、点検において発見された不具合が過去の不具合事例と同じかどうかを動画像データを利用して判断することが容易となり、不具合の原因の特定に要する時間の短縮につなげることが可能になる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007634066000001_ABST
    Figure 0007634066000001_ABST
Patent Text Reader

Abstract

To provide an inspection flow management system that shortens the time required to identify the cause of a malfunction in the maintenance and inspection of a work machine, and performs maintenance and inspection quickly and reliably. [Solution] In the management system, a terminal 30 is provided with a communication unit 31 that connects to a work machine 10 and acquires identification information of the work machine 10, a display unit 32 that displays an inspection workflow including an instruction to acquire video data of an inspection target portion of the work machine 10, an operation unit 35 that inputs inspection related information, a shooting unit 33 that acquires video data of the inspection target portion, and a search unit 36 ​​that extracts the video data of the inspection target portion, and a server 20 is provided with a storage unit 22 that stores machine attribute information of the work machine 10 and video data of the inspection target portion. The terminal also associates the identification information and inspection related information with the video data of the inspection target portion, and the server further associates machine attribute information with the video data and stores it in the storage unit 22. The search unit may also be provided in the server.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a system for managing an inspection workflow of a work machine. [Background technology]

[0002] Since the way of using a work machine such as a hydraulic excavator varies depending on the work site, the inspection points for maintenance work also vary depending on the work machine. Therefore, regardless of whether the maintenance personnel are experienced or not, they are required to quickly and reliably inspect many components, and efficient inspection is a challenge. Therefore, in Patent Document 1, a technology is known that outputs a maintenance inspection flow in order to efficiently perform maintenance and inspection of machines. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-178148 A Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned Patent Document 1 describes that when a malfunction is identified in a part included in the machine maintenance inspection flow, a procedure for dealing with the malfunction is output (paragraphs 0052, 0068-0070, Figure 7, etc.). However, the procedure is merely a simple response of inputting the state of the part to be inspected. Therefore, if the cause of the malfunction cannot be identified and a fundamental solution cannot be found, a request is made to a specialized treatment institution, and the problem of time required to complete the repair remains.

[0005] The present invention has been made in consideration of the above-mentioned problems, and has an object to shorten the time required to identify the cause of a malfunction in maintenance and inspection of a work machine, thereby enabling maintenance and inspection to be performed quickly and reliably. [Means for solving the problem]

[0006] In order to solve the above problems, an inspection workflow management system according to the present invention is an inspection workflow management system including a server that manages an inspection workflow that instructs the inspection procedure of a work machine, and a terminal connected to the server via a network, wherein the terminal includes a communication unit that connects to the work machine to be inspected and acquires identification information of the work machine, a display unit that displays the inspection workflow including an instruction to acquire video data of the inspection target part of the work machine, an operation unit that inputs inspection-related information corresponding to the inspection workflow, and a photographing unit that acquires video data of the inspection target part, the server includes a memory unit that stores machine attribute information of the work machine associated with the identification information and the video data of the inspection target part acquired by the terminal, the terminal associates the identification information with the inspection-related information for the video data of the inspection target part acquired by the photographing unit, and the server further associates machine attribute information with the video data of the inspection target part that has been associated and stores it in the memory unit, and the terminal or the server further includes a search unit that extracts video data of the inspection target part associated with at least one piece of information based on at least one of the identification information, the inspection-related information, and the machine attribute information input to the terminal. Effect of the Invention

[0007] According to the present invention, images, videos, and sounds (video data) relating to past malfunction cases are associated with inspection results and information related to the work machine, and this information can be used as keywords to extract related video data. This makes it easy to use the video data to determine whether a malfunction discovered during an inspection is the same as a past malfunction case, which can lead to a reduction in the time required to identify the cause of the malfunction.

[0008] Further features related to the present invention will become apparent from the description of the present specification and the accompanying drawings. In addition, the problems, configurations, and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]

[0009] [Figure 1] 1 is a conceptual diagram showing the overall configuration of the present invention. [Diagram 2] FIG. 1 is a block diagram showing a hardware configuration of an entire system according to a first embodiment of the present invention. [Diagram 3] 3 is a flow chart showing a process flow executed by the present invention. [Figure 4] FIG. 11 is a block diagram showing a hardware configuration of the entire system according to a second embodiment of the present invention. [Diagram 5] 10 is a flowchart showing a process flow executed in the second embodiment. [Figure 6] FIG. 2 is a diagram for explaining tagging performed in the present invention. [Figure 7] FIG. 1 is a diagram showing types of tagged data. [Figure 8] FIG. 13 is a block diagram showing a hardware configuration of the entire system according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [Example 1] Hereinafter, an embodiment will be described with reference to the drawings. In the embodiment, a hydraulic excavator will be described as an example of a work machine, but the work machine is not limited to a hydraulic excavator and may be a crane vehicle, a wheel loader, a forklift, a bulldozer, or a combination of these.

[0011] At the site where work machines are in operation, maintenance and inspection personnel (hereafter referred to as service personnel) use mobile terminals to inspect the work machines. Since the inspection points vary depending on the operating status of the target work machine, the inspection points are output / displayed on the display screen of the terminal according to the inspection target. The service personnel perform the inspection following a (digital) workflow. Here, a workflow refers to an inspection procedure that involves screen transitions, and if a malfunction is discovered during the processing of the procedure, video data is acquired and stored in association with information related to the malfunction. With this configuration, when a malfunction occurs, it becomes easy to use the video data to determine whether it is the same as a previous malfunction.

[0012] Management System The management system of this embodiment manages operation information sent from managed work machines and video data of inspection results sent from mobile terminals in association with any inspection procedure from a workflow that includes multiple inspection procedures, and provides this information to a service technician when a similar event occurs.

[0013] FIG. 1 is a conceptual diagram for explaining an overview of an inspection workflow management system according to an embodiment of the present invention. The management system 100 of this embodiment comprises a plurality of work machines 10, a maintenance management server 20 configured to be able to communicate with each of these work machines 10 via a network 40, and a terminal 30 capable of communicating with each of the server 20 and the work machines 10 via the network 40.

[0014] The work machine 10 is equipped with an operation sensor and wireless communication means on the vehicle body, and is capable of communicating with the maintenance management server 20 and terminal 30 via a network 40. The maintenance management server 20 is for performing maintenance management of the work machine 10, such as a hydraulic excavator. The work machine 10 that is the subject of maintenance management by the maintenance management server 20 is not limited to a hydraulic excavator, and may be, for example, a wheel loader, road machinery, dump truck, etc.

[0015] In response to a request from an inspector of the work machine 10, the maintenance management system 100 transmits to the terminal 30 a program relating to failure prediction and maintenance information for the work machine.

[0016] The terminal 30 is a portable notebook PC or a desktop PC installed in an office, but may also be, for example, a smartphone, tablet terminal, mobile phone, or PDA (Personal Data Assistant) carried by a maintenance worker or a user of the hydraulic excavator 10. The maintenance worker or user can request inspection information on a specific hydraulic excavator 10 from the server 20 by selecting the identification number of the specific hydraulic excavator 10 via the terminal 30.

[0017] The work machine 10 is equipped with sensors attached to each of its main locations to detect its operating conditions, and a controller that converts the operating conditions detected by the sensors into data and transmits the data to the server 20, for example, via a network 40.

[0018] FIG. 2 is a block diagram showing the hardware configuration of the entire system according to the present embodiment.

[0019] Terminal The terminal 30 has a communication unit 31 , a display unit 32 , an imaging unit 33 , a storage unit 34 , an operation unit 35 , a search unit 36 ​​, and a diagnosis unit 37 .

[0020] The communication unit 31 has a communication function such as wireless communication for connecting to the network 40. The display unit 32 is, for example, a display, and has a function of displaying a guidance screen relating to the inspection work and various pieces of information to the inspector.

[0021] The photographing unit 33 has a photographing function capable of photographing moving images. Also, for example, it may be connected wirelessly or wired to a terminal (for example, a smartphone) having a photographing function. The storage unit 34 has a memory function and stores a workflow showing an inspection procedure for the work machine. The operation unit 35 is made up of a touch panel provided on the display surface of the display unit 32, and performs input processing related to operations. The operation unit 35 also has a function of accepting input of inspection results, input of search conditions, etc. For example, an inspector can input inspection results, etc. by pressing / selecting an icon or button displayed on the display unit 32, or by inputting via a keyboard displayed on the display unit 32.

[0022] The search unit 36 ​​is capable of searching and extracting information by accessing various functions stored in the memory unit 22 (described later) of the maintenance management server 20. The diagnosis unit 37 identifies the cause of a malfunction based on sensor data acquired from the work machine 10, and displays the identification result on the display unit 32 and / or transmits it to the server 20.

[0023] Maintenance management server The maintenance management server 20 of this embodiment provides information to support maintenance work, such as the recommended timing for part replacement and the degree of deterioration, based on operation information and inspection results transmitted from a terminal 30 held by the work machine 10 or a serviceman. The maintenance management server 20 includes a calculation unit 21, a storage unit 22, an input / output unit 23, and a communication unit 24.

[0024] The calculation unit 21 has a CPU (Central Processing Unit) and executes various programs. The storage unit 22 has a memory function like the storage unit 34, and stores the operation information of the work machine 10 transmitted from the work machine 10 and the maintenance information transmitted from the terminal 30 in association with the individual identification information of the work machine 10. Data generated during processing by the calculation unit 21 is stored in the storage unit 22. Programs for implementing the various functions executed by the calculation unit 21 are also stored in the storage unit 22. The input / output unit 23 has, for example, a touch panel or the like and accepts various inputs. The communication unit 24 accepts operation instructions from the terminal 30, and transmits and receives data to and from outside the server, such as the work machine 10 and the terminal 30.

[0025] Server and terminal functions An application (inspection app) for performing inspections of the work machine 10 is pre-installed on the terminal 30, and by connecting to any work machine 10, identification information (e.g., model, serial number) of that work machine 10 is obtained.

[0026] The inspection app includes multiple programs corresponding to workflows for each machine. When connected to a target work machine 10, the inspection app on the terminal starts up and the identification information of the machine is automatically input to the terminal 30. Next, when an instruction to perform an inspection is given via the terminal 30, a workflow corresponding to the identification information acquired from the connected work machine 10 is displayed on the display unit of the terminal 30.

[0027] Here, a workflow indicates the inspection procedure for each malfunction in a work machine. A workflow is made up of multiple inspection procedures, and a detailed screen including specific inspection contents is displayed for each inspection procedure. Therefore, when a certain inspection procedure is confirmed, the display transitions to a screen showing the next inspection procedure. In addition, when a workflow is being performed, which inspection procedure is currently being performed out of the whole is displayed.

[0028] The service technician inspects the work machine 10 according to the workflow. If a malfunction is identified during the inspection procedure, a message is displayed on the terminal 30 instructing the service technician to obtain data (photos, video, audio) of the malfunction area as related information. The service technician operates the terminal 30 according to the instructions in the message and obtains the data of the malfunction area. The terminal 30 associates the obtained data with the identification information and workflow of the target work machine.

[0029] The terminal 30 uploads the data associated with the workflow to the maintenance management server 20 via the communication unit 31. The maintenance management server 20 accumulates the data in the storage unit 22, and thereafter, when there is a request from any terminal 30 wishing to see a video similar to the malfunction phenomenon, the maintenance management server 20 outputs and displays on the any terminal 30 the video data according to the conditions specified by the attributes of the work machine.

[0030] FIG. 3 is a flowchart showing the process executed by the system in this embodiment. First, in S1, a service technician connects the terminal 30 to the work machine 10 and selects information to identify the machine to be inspected, after which the inspection is started. Next, in S2, the communication unit 31 of the terminal 30 is started and a communication state is established with the work machine 10. In S3, a workflow (inspection procedure) is displayed on the display screen of the terminal 30. The workflow is stored in the terminal 30, but may also be stored in the server 20, in which case the terminal 30 acquires workflow information from the server 20.

[0031] In S4, the workflow progresses with the inspection as the screens displaying the inspection procedure change, and if the terminal 30 confirms that a defective area has occurred during this process, an instruction to acquire data (e.g., video images or audio) of the target area is displayed, and the necessary data is acquired via the imaging unit 33. In S5, an instruction to acquire a sensor value indicating the operating state of the defective area is displayed in the workflow, and the sensor value is acquired from the work machine 10 via the communication unit 31. In S6, the terminal 30 identifies the cause of the malfunction based on the acquired sensor value. At this time, the identification result of the malfunction may be displayed on the display unit 32.

[0032] In S7, the terminal 30, having identified the cause of the malfunction, ends the inspection. In S8, the terminal 30 transmits data (including video and audio) associating the work machine 10 to be inspected with the inspection results to the server 20 via the communication unit 31. In S8, the terminal 30 associates various information about the work machine 10 to be inspected with the inspection results to the acquired video data. Here, in this embodiment, this association is performed by "tagging", and details of this tagging will be described later. In S9, the terminal 30 transmits the associated video data (including video and audio) to the server 20 via the communication unit 31. In S10, the server 20 associates the received video data with the attribute information of the machine present on the server. In S11, the server 20 stores the video data associated with the attribute information of the machine in the storage unit 22. This ends the process.

[0033] As described above, by associating (tagging) the work machine information and the inspection results with the acquired video data and storing them in a server / terminal as in this embodiment, a serviceman who performs an inspection later can search for that information using keywords, etc., and refer to videos, etc. similar to the extracted malfunction phenomenon, thereby quickly identifying the cause of the malfunction.

[0034] The characteristics of the workflow described above are listed below. 1) The workflow begins with the display of an alarm that identifies where and what type of malfunction is occurring on the work machine based on operational status data detected by the work machine's sensors. 2) Next, a detailed screen will be displayed showing the checkpoints related to the problem. 3) Defects are often related to multiple locations in a complex manner. Since there are check items that need to be checked for each candidate that is thought to be related to the defect, the workflow is composed of multiple detailed screens for each inspection location. The detailed screens are displayed sequentially, but may contain reference video data. In that case, a display indicating "related video available" is displayed at the related location. Then, by selecting and specifying the display on the terminal, the video data stored on the server is displayed. The display may be performed each time the corresponding screen is transitioned to, at the beginning or end of the workflow, or a combination of these, and the timing of display is not important. In this way, the purpose is to identify possible locations that may be the cause of the malfunction by going through the confirmation items on each detailed screen and to obtain related video data. Because this is a workflow, once the necessary confirmation items on a detailed screen are completed, the system transitions to the next detailed screen, and if the confirmation items on any of the detailed screens identify possible causes of the malfunction, a detailed inspection is performed, such as checking sensor values, to further identify the root cause. The detailed screen of the workflow includes a text message regarding the confirmation items and a circuit diagram of the inspection location. 4) The acquisition of video data is at the discretion of the workflow executor.

[0035] Method for managing video data In the above, the video data is acquired on the terminal 30, and the detailed screen is associated with the identification information of the work machine to be inspected, which is so-called "tagging." The tagging results are displayed on the display unit 32 of the terminal 30, but it is also possible to display a message "acquired" on the detailed screen each time video data is acquired, or to display a list of the correspondence between the video data and the detailed screen at the end of the workflow. Note that the display format is merely an example and is not limited to this.

[0036] Tagging Tagging, which associates the video data acquired during the workflow with the inspection results and information about the work machine, is performed by the terminal 30 and the server 20. Hereinafter, the former will be referred to as "primary tagging" and the latter as "secondary tagging."

[0037] FIG. 6 is a conceptual diagram showing tagging. The primary tagging is performed by the terminal 30 when an inspection of any work machine 10 is performed in accordance with the workflow. Specifically, information relating to the work machine (machine identification information), information relating to the inspection (inspection-related information), and video data 200 acquired in the course of the workflow are associated with each other. The machine identification information and inspection-related information will be described later.

[0038] In secondary tagging, information that has been primarily tagged by the terminal 30 is further classified and associated by the server 20 based on attributes (machine attribute information) common to a plurality of work machines 10. That is, the information of each individual work machine 10 that has been primarily tagged is aggregated by being secondary tagged by the server 20. In this way, the workflow for each work machine 10 and the information of the work machine 10 that has been primarily tagged by the terminal 30 are secondary tagged and stored in the server 20.

[0039] FIG. 7 is a diagram showing types of tagged data. The "machine identification information" is information for identifying each individual work machine 10, such as, for example, "machine model" and "serial number," and is stored in the controller of the work machine 10. The "inspection related information" is information held for each workflow, such as, for example, "malfunction phenomenon to be inspected," "contents of inspection work," "inspected parts," and "parts from which video images were acquired." The "machine attribute information" is information on attributes common to work machines regardless of the machine model or serial number, such as, "information of the customer who owns the work machine (customer name, type of business, etc.)," ​​"region / country in which the work machine operates," "history of inspection and repair of the work machine (time, contents, etc.)," ​​"operating environment of the work machine (tropics, cold regions, highlands, flatlands, etc.)," ​​"work contents of the work machine (civil engineering, demolition, crushing stone, etc.)," ​​and "work load of the work machine (engine output, etc.)," ​​and is stored in the server 20 in association with the machine identification information.

[0040] Of the above information, the information associated by the primary tagging performed by the terminal 30 is machine identification information, which is information about each individual work machine 10, and inspection-related information, which is information obtained as a result of the inspection, and the information associated by the secondary tagging performed by the server 20 is machine attribute information, which is information commonly accumulated for a plurality of work machines.

[0041] In this way, the inspection results in the workflow for each work machine are associated with the video data (primary tagging), and furthermore, are classified and associated by the attributes of the work machine (secondary tagging), so when a malfunction occurs in a work machine and an inspection is performed, it is possible to easily search for video data acquired in past inspections of other work machines that have attributes in common with the work machine being inspected, such as other work machines of the same model, other work machines where the same malfunction has occurred, or other work machines operating in the same region / country, as related data, and refer to the extracted video data. This makes it possible to realize efficient inspections.

[0042] The tagged video data is stored in the server 20, and can be searched and extracted by the terminal 30. Specifically, when the above tagging information is input as a search condition into the terminal 30 while the workflow is in progress or before it starts, video data that meets the search condition is extracted from the video data stored in the server 20, and the extraction result is displayed on the display unit 32 of the terminal. The search condition may be any of the "machine identification information" and "inspection related information" set in the primary tagging, and the "machine attribute information" set in the secondary tagging, or a combination of these, or any other arbitrary condition may be specified.

[0043] By tagging the video data, it becomes possible to perform reverse lookup when searching and extracting similar cases later. The order of display may be varied depending on the number of extracted results. For example, a mark (e.g., "☆") indicating that the video data was helpful is selectable on the display unit 32 of the terminal 30, and when the extracted video data is helpful in identifying the cause of the defect, the operator of the terminal 30 selects the mark, and the selection of the mark is associated with the video data and stored in the storage unit 22 of the server. When searching and extracting video data, the terminal 30 determines whether or not there is video data associated with a mark, and if there is data, displays the extraction results on the display unit 32 in the order of the video data with the most number of times the mark was selected. The number of items to be displayed can be set arbitrarily.

[0044] In the above flowchart, the sensor value is acquired in S5, but a defect may be identified during the workflow. In that case, all the detailed screens included in the workflow may be interrupted without transition, and the workflow may be resumed after the defect is addressed.

[0045] [Example 2] FIG. 4 is a block diagram showing a hardware configuration of an inspection workflow management system according to a second embodiment of the present invention. The system according to the second embodiment differs from the system according to the first embodiment in that the maintenance management server 20 is provided with a registration management unit 25 for managing the "acquisition history of video data."

[0046] In the first embodiment, video data was acquired only for locations that the workflow executor judged necessary. However, even if video data for locations that are not necessary when inspecting the work machine being inspected is not necessary, it may be useful when inspecting another work machine. Therefore, acquisition of video data may not be based solely on the judgment of the workflow executor, but may be performed according to the display on the details screen.

[0047] Therefore, the registration management unit 25 manages the acquisition history (date and time) of the video data for each detailed screen. Then, during an arbitrarily set period, the number of times the video data for each detailed screen stored in the registration management unit 25 has been acquired may be referenced, and the more detailed screens that have been acquired the more necessary the video data may be deemed to be, and the acquisition of the video data may be promoted.

[0048] In addition to explanatory text messages, video images on the details screen help users to understand the inspection procedures smoothly. For this reason, there are some points where it is particularly important to acquire video data for reference in defect cases. In this embodiment, therefore, the video data required for each details screen of the workflow is specified in advance in the input / output unit 23 of the server 20. For example, a text message or icon may be displayed in a pop-up format at a specific point while the details screen is displayed, indicating that "video data is required."

[0049] FIG. 5 is a flowchart illustrating a process executed by the inspection workflow management system according to the second embodiment. This embodiment relates to registration and management of video data. The steps of this embodiment that differ from the process of the first embodiment in Fig. 3 are S51, S52, and S53. Therefore, a description of the other steps will be omitted.

[0050] In S51, the registration management unit 25 performs registration management. Specifically, the registration management unit 25 temporarily stores the acquired video data and displays it on the terminal 30, and also stores it in response to an instruction for final storage on the terminal 30 after the workflow is completed.

[0051] In S52, an instruction to acquire data is issued from the calculation unit 21 of the server. If there is an instruction to acquire data during the workflow (Y), the process proceeds to S53 and video data is acquired. The calculation unit 21, for example, has a function for determining whether or not there is a video, and determines which detailed screen in the workflow does not contain a video, and when a transition is made to a detailed screen that does not contain a video, a message is displayed to notify that effect. For example, a message stating "No video data" is displayed near the part for which video data acquisition has been specified. If there is no instruction to acquire data during the workflow (N), the process proceeds to S5 and sensor values ​​for the part to be inspected, etc. are acquired. Through these processes, it is possible to reliably recognize the acquisition of video data on the detailed screen of the workflow.

[0052] While the machine identification information is acquired directly from the work machine, the inspection-related information includes information entered by the serviceman. Therefore, there is a possibility of human input errors. Also, the video data acquired by the terminal may be inappropriate. For example, if a video image captures a part of the body different from the subject of the video data required for a certain detailed screen, or if the subject is not captured accurately, a problem occurs in that it is not possible to accurately associate it with the detailed screen. Therefore, when the video data is acquired, it is temporarily stored in the terminal (primary registration), and then the terminal is notified whether the video data to be registered and the associated primary tagged information are correct, and after confirmation, it is finally registered (secondary registration). In this way, by performing a two-stage registration management in which the acquirer of the video confirms that there are no errors in the acquired video and the information associated in the terminal, the video data can be reliably registered in the server.

[0053] [Variations] Finally, a modified example will be described with reference to FIG. Fig. 8 is a block diagram showing the hardware configuration of the entire system according to the modified example. As shown in Fig. 8, in the modified example, server 20 includes search unit 26 and diagnosis unit 27. Server 20 according to the modified example performs the same functions as search unit 36 ​​and diagnosis unit 37 of the terminal described above.

[0054] In the modified example, the terminal 30 does not have a search unit or a diagnosis unit, but the terminal 30 may also be provided with these functional units as in the above embodiment, so that the search or diagnosis can be performed by either the server 20 or the terminal 30.

[0055] The above-described embodiment of the present invention provides the following advantageous effects.

[0056] (1) An inspection workflow management system according to the present invention is an inspection workflow management system including a server that manages an inspection workflow that instructs the inspection procedure of a work machine, and a terminal connected to the server via a network, wherein the terminal includes a communication unit that connects to the work machine to be inspected and acquires identification information of the work machine, a display unit that displays an inspection workflow including an instruction to acquire video data of an inspection target part of the work machine, an operation unit that inputs inspection-related information corresponding to the inspection workflow, and a photographing unit that acquires video data of the inspection target part, the server includes a memory unit that stores machine attribute information of the work machine associated with the identification information and the video data of the inspection target part acquired by the terminal, the terminal associates the identification information with the inspection-related information for the video data of the inspection target part acquired by the photographing unit, and the server further associates machine attribute information with the video data of the inspection target part that has been associated and stores it in the memory unit, and the terminal or the server further includes a search that extracts video data of the inspection target part associated with at least one piece of information based on at least one of the identification information, inspection-related information, and machine attribute information input to the terminal.

[0057] With the above configuration, images, videos, and sounds (video data) related to past malfunction cases can be tagged to associate them with inspection results and information related to the work machine, and this information can be used as keywords to search for and extract related video data. This makes it easy to use the video data to determine whether a malfunction discovered during an inspection is the same as a past malfunction case, which can lead to a reduction in the time required to identify the cause of the malfunction.

[0058] (2) At least one of the terminal or the server further includes a diagnostic unit that identifies the cause of the malfunction of the inspection target part based on a sensor value that indicates the operating state of the inspection target part of the work machine, and when the video image data is acquired by the imaging unit, the terminal displays an instruction to acquire the sensor value on the display unit, and the diagnostic unit identifies the cause of the malfunction of the inspection target part based on the sensor value acquired by the terminal and displays the identification result on the display unit. As a result, for example, by displaying the identification result of the cause of the malfunction on the display unit, the system user can visually grasp the cause of the malfunction of the work machine.

[0059] (3) The server further includes a registration management unit that stores an acquisition history of video data of the inspection target part corresponding to the inspection workflow, and when the acquisition history of video data of the inspection target part corresponding to the inspection workflow displayed on the display unit is stored in the registration management unit, the terminal displays the video data of the inspection target part corresponding to the inspection workflow in a part of the display area of ​​the inspection workflow on the display unit. This enables a user of the system to easily know whether there is video data of the inspection target part corresponding to the inspection workflow.

[0060] (4) The registration management unit calculates the number of acquisitions based on the acquisition history of the video data of the inspection target part corresponding to the inspection workflow, and the terminal displays the number of acquisitions in the display area of ​​the inspection workflow. This makes it possible to set a high priority to video data that has been acquired many times, as it is highly necessary to acquire it.

[0061] (5) The terminal determines the display order of the extracted video data of the inspection target area on the display unit based on the usefulness of the video data. This enables the system user to grasp the importance of the video data at a glance, which is useful for maintenance inspection.

[0062] (6) The machine attribute information includes at least one of the following: information on the customer who owns the work machine, information on the area where the work machine operates, information on the inspection and repair history of the work machine, information on the work content of the work machine, information on the operating environment of the work machine, and information on the workload of the work machine. In this way, by including information on attributes common to multiple work machines in the machine attribute information, it becomes easy to search for and extract video data of similar malfunctions.

[0063] The present invention is not limited to the above-described embodiments, and various modifications are possible. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to an embodiment having all of the configurations described. It is also possible to replace a part of the configuration of one embodiment with the configuration of another embodiment. It is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to delete a part of the configuration of each embodiment, or to add or replace another configuration. [Explanation of symbols]

[0064] 10 work machine, 20 maintenance management server, 24 communication unit, 25 registration management unit, 30 terminal, 31 communication unit, 32 display unit, 33 photography unit, 35 operation unit, 36 search unit, 37 diagnosis unit

Claims

1. An inspection workflow management system including a server that manages an inspection workflow that instructs an inspection procedure for a work machine, and a terminal that is connected to the server via a network, the terminal has a communication unit that connects to the work machine to be inspected and acquires identification information of the work machine; a display unit that displays the inspection workflow including an instruction to acquire moving image data of an inspection target portion of the work machine; an operation unit for inputting inspection-related information corresponding to the inspection workflow; An imaging unit that acquires video image data of the inspection target area, the server includes a storage unit that stores machine attribute information of the work machine associated with the identification information and video data of the inspection target portion acquired by the terminal, The terminal associates the identification information with the inspection-related information for the video image data of the inspection target portion acquired by the imaging unit, The server further associates the machine attribute information with the video image data of the inspection target portion for which the association has been performed, and stores the machine attribute information in the storage unit; The terminal or the server further includes a search unit that extracts video data of the inspection target portion associated with at least one piece of information among the identification information, the inspection-related information, and the machine attribute information input to the terminal, based on the at least one piece of information. An inspection workflow management system comprising:

2. 2. The inspection workflow management system according to claim 1, At least one of the terminal and the server further includes a diagnosis unit that identifies a cause of a malfunction of the inspection target part based on a sensor value that indicates an operating state of the inspection target part of the work machine, When the video image data is acquired by the imaging unit, the terminal displays an instruction to acquire the sensor value on the display unit; The diagnosis unit identifies a cause of the malfunction of the inspection target portion based on the sensor value acquired by the terminal, and causes the display unit to display the identification result. An inspection workflow management system comprising:

3. 2. The inspection workflow management system according to claim 1, The server, The inspection system further includes a registration management unit that stores an acquisition history of moving image data of an inspection target portion corresponding to the inspection workflow, When an acquisition history of moving image data of an inspection target portion corresponding to the inspection workflow displayed on the display unit is stored in the registration management unit, the terminal displays the moving image data of the inspection target portion corresponding to the inspection workflow in a part of a display area of ​​the inspection workflow on the display unit. An inspection workflow management system comprising:

4. 4. The inspection workflow management system according to claim 3, The registration management unit calculates the number of acquisitions based on an acquisition history of the moving image data of the inspection target portion corresponding to the inspection workflow, The terminal displays the acquisition count in a display area of ​​the inspection workflow. An inspection workflow management system comprising:

5. 2. The inspection workflow management system according to claim 1, The terminal determines a display order of the extracted results of the moving image data of the inspection target portion on the display unit based on a degree of usefulness of the moving image data. An inspection workflow management system comprising:

6. 2. The inspection workflow management system according to claim 1, The machine attribute information includes at least one of information regarding a customer who owns the work machine, information regarding the area in which the work machine operates, information regarding the inspection and repair history of the work machine, information regarding the work content of the work machine, information regarding the operating environment of the work machine, and information regarding the workload of the work machine. An inspection workflow management system comprising:

Citation Information

Patent Citations

  • Maintenance and inspection system, method, and program for machinery

    JP2003178148A

  • Defect information management device

    JP2004110554A

  • Meter management device and meter management system

    JP2006284480A

  • Equipment inspection support system, method and program

    JP2007148938A

  • Common module failure information management device and method for managing common module failure information

    JP2008059396A