Work support system, work support method, work support terminal, and program

Abstract

To provide a work support system that assists workers throughout the entire process to ensure the efficient execution of tasks such as testing. [Solution] According to the embodiment, the work support system comprises a database storing information about the work object and a work support terminal having a display and worn and used by the worker. When the worker inputs a work object, the work support terminal searches the database for information about the specified work object and displays the retrieved information on the display.

Description

[Technical Field]

[0001] Embodiments of the present invention relate to a work support system, a work support method, a work support terminal, and a program for supporting work such as testing of electrical panels, for example. [Background Art]

[0002] Conventionally, manufacturing of electrical panels requires an enormous amount of work. Furthermore, tests are regularly performed on electrical panels even after their manufacture.

[0003] In the testing of electrical panels, there are many processes before the testing, such as determining the test object and test method, and moving to the work position.

[0004] For example, in the case of water supply and sewerage facilities, a large number of electrical panels exist over a wide area. For this reason, in order to perform testing on each electrical panel, an operator needs to move to the target electrical panel via an optimal route. However, depending on the pump station, there are factors that cannot be determined from the layout drawing, such as some areas being impassable due to construction work, or caution being required even if the areas are passable. Therefore, in order to ensure the safety of operators, selection of an optimal movement route to the target electrical panel is also essential. [Prior Art Documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2018-180868 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2014-123193 [Patent Document 3] Japanese Unexamined Patent Application Publication No. 2023-124133 [Patent Document 4] Japanese Unexamined Patent Application Publication No. 2020-149138 [Summary of the Invention] [Problem to be Solved by the Invention]

[0006] Thus, while there are many processes and factors to consider in electrical panel testing, the determination of the testing procedures and the time required for the work largely depend on the know-how and skill level of the worker.

[0007] Therefore, when tests are conducted by unskilled workers, it generally takes more time than when they are conducted by skilled workers.

[0008] In particular, as mentioned earlier, when testing numerous electrical panels spread across a wide area, multiple workers may collaborate on a single test. In such cases, if one worker fails to complete their assigned tasks within the allotted time, the test may ultimately not be completed on schedule.

[0009] Therefore, there is a need for technology that supports not only skilled workers but also unskilled workers in efficiently and reliably performing tasks such as testing in a short amount of time.

[0010] Regarding such work support technologies, for example, Patent Documents 1 and 2 disclose technologies that simplify the manufacturing of electrical panels, reduce the workload, and lower costs by utilizing augmented reality.

[0011] However, no technologies for improving work efficiency have been disclosed that take into account the presence of numerous electrical panels spread over a wide area, as well as the situation where multiple workers collaborate on the work.

[0012] The problem that this invention aims to solve is to provide a work support system, work support method, work support terminal, and program that support workers throughout the entire process in order to efficiently carry out tasks such as testing. [Means for solving the problem]

[0013] The work support system of this embodiment comprises a database storing information about the work object and a work support terminal having a display and worn and used by the worker. When the worker inputs information specifying the work object, the work support terminal searches the database for information about the specified work object and displays the retrieved information on the display.

[0014] The work support method of this embodiment includes the steps of: when an operator inputs a test target from a work support terminal they are wearing, the work support terminal searches for information about the test target from a database in which information about the test target is pre-registered; the work support terminal determines a test procedure based on the retrieved information; the operator performs the test on the test target according to the test procedure; and the work support terminal determines whether the performed test passed or failed and records the results of the tests that were determined to pass in the database.

[0015] The work support terminal of this embodiment is equipped with a work support device that includes a search unit for searching a database for work-related information, an instruction creation unit for creating instructions for the worker based on the information retrieved by the search unit, and a display that shows images representing the created instructions, and is worn and used by the worker.

[0016] The program of this embodiment enables the processor to perform the following functions in response to input from an operator specifying the test target: searching for information about the test target from a database; determining the test procedure based on the retrieved information; determining whether the test was successful or not when the operator performed the test on the test target according to the test procedure; and recording the results of tests that were determined to be successful in the database. [Brief explanation of the drawing]

[0017] [Figure 1]FIG. 1 is (a) a block diagram showing a configuration example of a work support system to which a work support method according to an embodiment of the present invention is applied, and (b) a flow diagram showing the flow of a test performed using the work support system. [Figure 2] FIG. 2 is a conceptual diagram showing a state where wearable glasses are worn by a worker. [Figure 3] FIG. 3 is a block diagram showing an example of the electronic configuration of a work support device mounted on wearable glasses. [Figure 4] FIG. 4 is a diagram showing an example of an initial menu screen displayed on a display. [Figure 5] FIG. 5 is a flowchart showing a detailed processing flow of test procedure determination (S2). [Figure 6] FIG. 6 is a diagram showing an example of a work procedure screen displayed on a display. [Figure 7] FIG. 7 is an example of an arrangement drawing displayed on a display. [Figure 8] FIG. 8 is an example of an image of an electrical panel displayed on a display. [Figure 9] FIG. 9 is an example of a sequence block diagram displayed on a display. [Figure 10] FIG. 10 is a flowchart showing a detailed processing flow of test execution (S3). [Figure 11] FIG. 11 is a diagram showing an example of a guidance screen displayed on a display. [Figure 12] FIG. 12 is a diagram showing an example of an operation instruction screen displayed on a display. [Figure 13] FIG. 13 is an example of a sequence diagram in which portions corresponding to correctly performed operations are specified. [Figure 14] FIG. 14 is a flowchart showing a detailed processing flow of result determination and recording (S4). DESCRIPTION OF EMBODIMENTS

[0018] Embodiments of the present invention will be described below with reference to the drawings. The drawings are schematic or conceptual, and the relationship between the thickness and width of each part, the ratio of the sizes of the parts, etc., are not necessarily the same as those of reality. Furthermore, even when representing the same part, the dimensions and ratios may be represented differently in the drawings. In this specification and each drawing, elements similar to those described in previously shown drawings are denoted by the same reference numerals, and detailed explanations and redundant explanations are omitted as appropriate.

[0019] Figure 1 shows (a) a block diagram illustrating an example configuration of a work support system to which the work support method of an embodiment of the present invention is applied, and (b) a flowchart illustrating the flow of a test performed using the work support system.

[0020] The work support system 10 includes a database 11 and multiple wearable glasses 12.

[0021] Database 11 stores information about equipment within the facility that is supported by the work support system 10.

[0022] The work support system 10 is applied to support tasks such as testing of any equipment. Below, as an example of the work support system 10, although not limited to this, we will describe its use in supporting the testing of water and sewage facilities. Therefore, in this embodiment, the database 11 and the pumping station database 11 will also be referred to as such.

[0023] The pumping station database 11 stores pumping station information. Pumping station information refers to all information related to the pumping station, and includes, for example, drawing data such as outline drawings, layout drawings, sequence block diagrams, and design drawings of electrical panels for the operation of water and sewage facilities and equipment controlled by those panels, as well as document data such as instruction manuals, procedures, and test procedures. Pumping station information may also include information on restricted areas, such as construction information within the pumping station.

[0024] Such an airport database 11 can be implemented using a storage device such as an SSD (Solid State Drive) or HDD (Hard Disk Drive). Alternatively, it can be implemented in a memory area of ​​a storage system such as a database server located in the cloud.

[0025] Figure 2 is a conceptual diagram showing wearable glasses being worn by a worker.

[0026] As shown in Figure 2, the wearable glasses 12 are glasses-type work support terminals worn and used by the worker S, and are equipped with a work support device 20.

[0027] The work support device 20 has a communication function and can access the machine database 11 to search for necessary information from the machine database 11, create instructions for worker S based on the searched information, and notify worker S of the created instructions by voice or image.

[0028] Figure 3 is a block diagram showing an example of the electronic configuration of a work support device mounted on wearable glasses.

[0029] The work support device 20 includes a CPU 22 connected to each other by a bus 21, a recording medium reading unit 23, a display 24 that provides display functionality, a microphone 25 that provides sound collection functionality, a speaker 26 that provides sound amplification functionality, a camera 27 that provides imaging functionality, a GPS 28 that provides positioning functionality, a communication unit 29 that provides wireless communication functionality, a storage device 30, and a memory 40.

[0030] The work support device 20 can wirelessly access the airport database 11 via the communication unit 29.

[0031] The work support device 20 can also communicate directly with other work support devices 20 via wireless communication using the communication unit 29.

[0032] In Figure 1(a), the wearable glasses 12(#2) of another worker S are shown simply to illustrate their relationship with wearable glasses 12(#1). Therefore, in Figure 1(a), to avoid complicating the drawing, wearable glasses 12(#2) are depicted as only communicating with wearable glasses 12(#1). However, like wearable glasses 12(#1), wearable glasses 12(#2) can also directly access the machine database 11 wirelessly via the communication unit 29.

[0033] Returning to the explanation of Figure 3, the CPU 22 of the work support device 20 is a processor that controls the operation of the electronic circuits of the work support device 20 according to various work support programs stored in the memory 40. In this way, the work support device 20 becomes a work support terminal in which software and hardware work together.

[0034] The storage device 30 consists of, for example, an SSD (Solid State Drive) or an HDD (Hard Disk Drive), and stores the machine list, construction project name list, test content list, and group list, etc., which are necessary for creating the test procedures described later. Note that the machine list, construction project name list, test content list, group list, etc., may be stored in the machine database 11 instead of the storage device 30.

[0035] Memory 40 stores various programs for work support, including a speech recognition program 41 for speech recognition, an image recognition program 42 for image recognition, a test procedure creation program 43 for creating test procedures, a search program 44 for searching, a group setting program 45 for group setting, a location identification program 46 for identifying the location of the worker S and the test target, a guidance program 47 for providing guidance information to the worker S, an instruction creation program 48 that instructs test operations according to the test procedure and determines whether the operations were performed correctly, a result determination and recording program 49 that determines and records the test results, and an overall control program 50 that controls the coordinated operation of these programs 41 to 49.

[0036] The speech recognition program 41, image recognition program 42, test procedure creation program 43, search program 44, group setting program 45, location identification program 46, guidance program 47, instruction creation program 48, result determination recording program 49, and overall control program 50 are executed by the CPU 22 and function as the speech recognition unit, image recognition unit, test procedure creation unit, search unit, group setting unit, location identification unit, guidance unit, instruction creation unit, result determination recording unit, and overall control unit of the work support device 20.

[0037] These programs 41-50 may be pre-stored in memory 40, or they may be read into memory 40 from an external recording medium 14 such as a memory card via the recording medium reading unit 23. These programs 41-50 are designed to be unrewritable.

[0038] In addition to the non-rewritable area where programs 41-50 are stored, the memory 40 also includes a writable data area 60 for storing rewritable data.

[0039] When the electronic circuits of the work support device 20 are activated by power-on or the like, the overall control program 50 displays the initial menu screen on the display 24.

[0040] Figure 4 shows an example of the initial menu screen displayed on the display.

[0041] An initial menu screen 100, as illustrated in Figure 4, is displayed on the display 24, prompting the worker S wearing the wearable glasses 12 to input the information necessary for creating the test procedure. Figure 4 shows examples of information necessary for creating the test procedure, such as the machine name 101, the project name 104, and the test details 107, but these are examples and not limiting.

[0042] Operator S can input the necessary information for creating a test procedure to the initial menu screen 100 displayed on the display 24 using voice commands or gestures.

[0043] First, let me explain voice input.

[0044] For example, when worker S selects machine name 101, he says "machine selection". This voice is picked up by microphone 25, and the voice signal a is output to memory 40.

[0045] The speech recognition program 41 recognizes the speech signal a as "kijou sentaku" (air washing machine) and outputs the recognition result b.

[0046] The overall control program 50 retrieves the airport list from the storage device 30 based on the recognition result b and displays it from the airport selection list 102. If the airport list is stored in the airport database 11 instead of the storage device 30, the overall control program 50 accesses the airport database 11 via the communication unit 29, retrieves the airport list from the airport database 11, and displays it from the airport selection list 102.

[0047] Operator S speaks the name of the desired airport, "Eieijo Suijou," from the list of airports displayed in the airport selection list 102. This voice is also picked up by the microphone 25, and the voice signal a is output to the memory 40.

[0048] The speech recognition program 41 recognizes the speech signal a as "AA Water Treatment Plant" and outputs the recognition result b.

[0049] Based on the recognition result b, the overall control program 50 recognizes that "AA Water Treatment Plant" has been selected as the plant name 101.

[0050] Similarly, the overall control program 50 can recognize that, for example, "AA Water Treatment Plant Renovation Project" has been selected as the project name 104, and that, for example, "Purchased Power - Private Power Generation Switching" has been selected as the test content 107. The project names displayed from the project name list 105 are based on the project name list stored in the storage device 30 or the station database 11, and the test content displayed from the test content list 108 is based on the test content list stored in the storage device 30 or the station database 11.

[0051] After the airport name 101, the project name 104, and the test content 107 are recognized, worker S says "create test procedure," and through the cooperation of the aforementioned microphone 25 and the voice recognition program 41, the overall control program 50 recognizes that the test procedure creation button 110 has been activated and causes the test procedure creation program 43 to create the test procedure.

[0052] Next, we will explain input using gestures.

[0053] A cursor is displayed on the display 24. When worker S selects the machine name 101, they move the cursor to the search button 103 using a gesture and activate the search button 103. When moving the cursor using a gesture, for example, if the cursor is below the search button 103, the worker points upwards with their hand (either the right or left hand). Camera 27 captures this action, and image information c is output from camera 27 to memory 40.

[0054] The image recognition program 42 recognizes the image information c, recognizes that the worker S wants to move the cursor upwards, and outputs the recognition result d.

[0055] The overall control program 50 moves the cursor upwards based on the recognition result d. Similarly, the cursor's position can be moved in any direction by the operator S's gestures.

[0056] When the cursor moves into the search button 103, worker S makes an OK sign with their hand. Camera 27 captures this action, and image information c is output from camera 27 to memory 40.

[0057] The image recognition program 42 recognizes the image information c, determines that worker S wants to activate the search button 103, and outputs the recognition result d.

[0058] Based on the recognition result d, the overall control program 50 activates the search button 103, retrieves the airport list from the storage device 30 or airport database 11, and displays it from the airport selection list 102.

[0059] Operator S moves the cursor from the list of pumps displayed in the pump selection list 102 to the location where the desired pump is displayed (for example, the location of "AA Water Treatment Plant"), and makes an OK sign with their hand. Camera 27 captures this action, and image information c is output from camera 27 to memory 40.

[0060] The image recognition program 42 recognizes the image information c, recognizes that the worker S wants to confirm the cursor position, and outputs the recognition result d.

[0061] Based on the recognition result d, the overall control program 50 determines the cursor position and recognizes that the plant indicated by the cursor (for example, "AA Water Treatment Plant") has been selected as plant name 101.

[0062] Similarly, the search button 106 is activated, and from the list of construction project names displayed in the list of construction project names 105, for example, "AA Water Treatment Plant Renovation Project" is selected, the search button 109 is activated, and from the list of test contents displayed in the list of test contents 108, for example, "Purchased Power - Private Generation Switching" is selected. As with voice recognition, the construction project names displayed in the list of construction project names 105 are based on the list of construction project names stored in the storage device 30 or the station database 11, and the test contents displayed in the list of test contents 108 are based on the list of test contents stored in the storage device 30 or the station database 11.

[0063] After the machine name 101, project name 104, and test content 107 are recognized, the operator S moves the cursor to the test procedure creation button 110 using a gesture as described above, and then activates the test procedure creation button 110. As a result, the overall control program 50 causes the test procedure creation program 43 to create the test procedure.

[0064] The explanation so far corresponds to the determination of the test subjects (S1) in Figure 1(b).

[0065] Next, we will explain the determination of the test procedure (S2) in Figure 1(b).

[0066] Figure 5 is a flowchart showing the detailed process flow for determining the test procedure (S2).

[0067] As mentioned above, the aerospace database 11 contains all kinds of aerospace information, including drawings and documents related to the aerospace (S21).

[0068] The work support device 10 accesses the machine database 11 via the communication unit 29 and searches for document data and drawing data of the test target using the search program 44 based on the selected machine name 101, project name 104, and test content 107 (S22). At this time, the search program 44 can perform the search using character recognition technology.

[0069] When performing a search using character recognition technology, the search program 44, for example, recognizes the characters written in all document data registered in the airport database 11 and outputs the document data containing the name of the test subject as search result e1. Similarly, for drawing data, the search program 44 recognizes the characters written in all drawing data registered in the airport database 11 and outputs the drawing data containing the name of the test subject as search result e2.

[0070] In step S22, the test procedure creation program 43 extracts the document data f1 necessary for the test from the search result e1 output from the search program 44, and the drawing data f2 necessary for the test from the search result e2 (S23).

[0071] This can be done, for example, by creating a list of document data f1 and drawing data f2 required for the test in advance, and then having the test procedure creation program 43 extract the document data f1 included in the list from the search result e1, and extract the drawing data f2 included in the list from the search result e2. However, the method for extracting the document data f1 and drawing data f2 required for the test is not limited to this, and other methods may be used.

[0072] The test procedure creation program 43 further determines the work content based on the information obtained from the document data f1 and drawing data f2 extracted in step S23 (S24). The test procedure creation program 43 also creates a work procedure screen 120 that displays the work content in a simplified manner and displays it on the display 24.

[0073] When determining the work content, the test procedure creation program 43 reads, for example, the changeover switches, operating switches, equipment numbers, and operation details described in the sequence block diagram, and identifies the electrical panel to be operated from the location number, or identifies the location of the electrical panel from the layout diagram.

[0074] Figure 6 shows an example of a work procedure screen displayed on a display.

[0075] The work procedure screen 120 displays the selected "AA Water Treatment Plant," "AA Water Treatment Plant Renovation Project," and "Purchased Power - Private Power Generation Switching" as the plant name 101, project name 104, and test content 107. The work procedure screen 120 also displays the items of the created work procedure, including work process 121, required number of workers 123 (3 people in this example), equipment 125, and drawings 127.

[0076] When worker S activates the display button 122 via the aforementioned voice and gesture instructions, the overall control program 50 displays the details of the work process 121 on the display 24. This allows worker S to confirm the details of the work process 121.

[0077] When worker S activates the display button 126 via the aforementioned voice and gesture instructions, the overall control program 50 displays the details of the equipment 125 on the display 24. This allows worker S to confirm the details of the equipment 125.

[0078] Examples of drawings 127 include, but are not limited to, layout drawings, outline drawings, and sequence block diagrams.

[0079] When worker S activates the layout diagram button 128 via the aforementioned voice and gesture instructions, the overall control program 50 displays the layout diagram of the machine and electrical panel related to the work on the display 24. Similarly, when worker S activates the outline diagram button 129, the overall control program 50 displays the outline diagram of the machine and electrical panel related to the work on the display 24, and when worker S activates the sequence block diagram button 130, the overall control program 50 displays the sequence block diagram of the machine and electrical panel related to the work on the display 24.

[0080] Figure 7 shows an example of a layout diagram displayed on a screen.

[0081] Figure 8 shows an example of an electrical panel image displayed on a screen.

[0082] Figure 9 shows an example of a sequence block diagram displayed on a screen.

[0083] As shown in Figures 7, 8, and 9, worker S no longer needs to carry around paper-based drawings, as he can view various drawings related to the machine and electrical panels on the display 24.

[0084] In the example shown in Figure 6, the required number of workers 123 is 3. When the required number of workers 123 is multiple, the work group setting screen 140 is also displayed on the display 24. From the work group setting screen 140, worker S can set up worker groups to share information such as the progress of the test and the test results.

[0085] When worker S activates the group display area 141 using the voice and gesture instructions mentioned above, the group setting program 45 displays a list of group names to which worker S has been pre-registered. The group list, which is a list of groups to which worker S has been pre-registered, is stored in the storage device 30 or the machine database 11, and the group setting program 45 retrieves the group list from the storage device 30 or the machine database 11 and displays it from the group display area 141.

[0086] When worker S selects a desired group from the group list displayed in the group display area 141 using the voice or gesture instructions mentioned above and activates the confirm button 142, the group setting program 45 confirms the group selected by worker S. Worker S can also create a new group list and confirm the group.

[0087] Work support devices 20 belonging to workers S assigned to the same group can communicate directly with each other, as shown in the relationship between wearable glasses 12(#1) and wearable glasses 12(#2) in Figure 1(a). Note that the number of workers S assigned to the same group is not limited to two, but may be three or more. If three or more workers S are assigned to the same group, direct group communication (broadcast communication) will occur between the three or more wearable glasses 12 worn by each worker S.

[0088] Next, operator S activates the test start button 143 using the voice and gesture instructions mentioned earlier. This puts the overall control program 50 into test start mode, and it executes the appropriate program according to the test content, test results, progress, etc.

[0089] The explanation so far corresponds to the determination of the test procedure (S2) in Figure 1(b).

[0090] Next, we will explain the execution of the test (S3) in Figure 1(b).

[0091] Figure 10 is a flowchart showing the detailed process flow for conducting the test (S3).

[0092] In the execution of the test (S3), the location identification program 46 first identifies the location of worker S (S31). Since the work support device 20 is equipped with a positioning means such as GPS 28, the location identification program 46 can identify the location of the work support device 20, that is, the location of worker S wearing the wearable glasses 12 (#1), based on the output from GPS 28. However, there is generally an error of several meters in the positioning results from GPS 28. Therefore, the location identification program 46 can also further identify the location of worker S based on an image c showing the worker's field of view, captured by the camera 27. This location identification can be performed by recognizing the names and numbers of the equipment shown in image c to determine which equipment worker S is near. If the names and numbers of the equipment are not shown in image c, the location of worker S can also be identified from the arrangement and shape of the equipment.

[0093] The location identification program 46 outputs worker location data g indicating the location of the worker S identified in this manner.

[0094] Next, the guidance program 47 uses the drawing data f2 extracted in step S23, particularly drawings such as layout plans, the document data f1 extracted in step S23, particularly information such as construction data within the machine shop, and the worker location data g to create a route that can appropriately guide worker S from their current location to the test target. The route created may not be just one, but may be multiple.

[0095] For example, if the guidance program 47 creates a first route that guides worker S from the current location to the test target via the shortest distance, but the construction data indicates that there are dangerous or impassable sections along this route, the guidance program 47 will also create a second route that bypasses the first route.

[0096] The guidance program 47 further creates guidance information h to guide worker S according to the created route, and guides worker S by outputting audio based on the guidance information h from speaker 26, or by displaying a guidance screen on display 24 in which characters, arrows, etc. indicating instructions based on the guidance information h are superimposed on an image, for example using augmented reality (S32).

[0097] Figure 11 shows an example of a guidance screen displayed on a display.

[0098] The guidance screen 200 illustrated in Figure 11 overlays text 202 and arrows 203 onto an image of an electrical panel 201, etc., using augmented reality. The guidance screen 200 also includes an audio icon 204, and activating this icon allows voice guidance, such as "Please turn right," to be output from the speaker 26. The guidance screen 200 also includes a layout diagram icon 205, and activating this icon 205 allows the display to be switched from the guidance screen 200 to the layout diagram 206, as shown on the right side of Figure 11.

[0099] The worker S can move to the test object reliably, safely, and efficiently by following the guidance screen 200 displayed on the display 24.

[0100] The location identification program 46 also identifies the location of worker S, who is moving according to such guidance, using the output from GPS 28, character recognition, and image recognition, as described above, and outputs worker location data g indicating the location of worker S.

[0101] Based on worker location data g, the guidance program 47 can notify worker S of their arrival at the test target via audio output from speaker 26 or image display from display 24. In particular, if multiple workers S belonging to the same group are working in different locations, the communication unit 29 can also notify the wearable glasses 12 (e.g., wearable glasses 12(#2)) of other workers S belonging to the same group. This notification allows each worker S belonging to the same group to understand that all members have completed their movement to the test target (S33).

[0102] Based on the worker location data g, when the guidance program 47 determines that worker S has arrived at the test target, the instruction creation program 48 is activated. The instruction creation program 48 is a program that instructs the test operations according to the test procedure created by the test procedure creation program 43.

[0103] The instruction creation program 48 first identifies the location of the part to be operated by processing and comparing the image information c captured by the camera 27 with the layout diagram and outline drawing of the test object, such as an electrical panel, as specified in the test procedure (S34). The part to be operated is, for example, if the test object is an electrical panel, the changeover switch and operating switch on the electrical panel.

[0104] Once the instruction creation program 48 has identified the location of the part to be operated on, it creates operation instruction screen data and operation instruction audio data that instruct the operator to perform the test on this part based on the test procedure, and instructs the operator S on the specific operation to be performed on the test by displaying the operation instruction screen on the display 24 and outputting the operation instruction audio from the speaker 26 (S35).

[0105] Figure 12 shows an example of an operation instruction screen displayed on a display.

[0106] The operation instruction screen 300 illustrated in Figure 12 overlays the operation switch to be selected, text 302 indicating the operation content, and instruction lines 303 onto an image of the electrical panel 301, which is the object of operation, using augmented reality. An icon 304 for starting the operation instruction voice is also overlaid using augmented reality.

[0107] Operator S can reliably and efficiently perform the test operation by viewing the operation instruction screen 300 displayed on the display 24 or by activating the icon 304 to listen to the operation instruction voice.

[0108] The instruction creation program 48 further processes the image information c of worker S captured by the camera 27 to estimate the worker S's movements, and if the validity of the movements is confirmed, for example, if the hand is touching the correct place, it determines that the test operation was performed correctly (S36).

[0109] The instruction creation program 48 further transmits information indicating that the operation was performed correctly to the work support device 20 of another worker S belonging to the same group via the communication unit 29. The transmitted information is received by the work support device 20 of the other worker S and displayed as text on the display 24 or output as audio from the speaker 26.

[0110] In this way, each worker S can share the progress of operations performed by other workers S belonging to the same group (S37). This allows for smooth operation even when performing operations that require coordination, such as operating the electrical panel in the central monitoring room after operating the electrical panel in a remote location.

[0111] The instruction generation program 48 can also provide images in sequence diagrams related to the test that clearly indicate the portion of the sequence corresponding to the correctly performed operation.

[0112] Figure 13 is an example of a sequence diagram that clearly indicates the parts corresponding to correctly performed operations.

[0113] The instruction creation program 48 can also display a sequence diagram 400 on the display 24, as illustrated in Figure 13, which clearly indicates the sequence portion corresponding to correctly performed operations. By looking at such a sequence diagram 400, the operator S can easily visually understand which operations related to which sequences have been performed and which operations related to which sequences have not yet been performed.

[0114] The explanation so far corresponds to the execution of the test (S3) in Figure 1(b).

[0115] Next, we will explain the determination and recording of the results (S4) in Figure 1(b).

[0116] During the execution of the test (S3), once all operations have been completed, the instruction creation program 48 terminates, and then the result determination recording program 49 begins to operate.

[0117] Figure 14 is a flowchart showing the detailed processing flow for determining and recording the results (S4).

[0118] Figure 14 also shows a detailed flow of the process in step S4 in Figure 1(b).

[0119] In the result determination and recording (S4), the result determination and recording program 49 first determines the test result (S41). For example, if the test subject is an electrical panel, the result determination and recording program 49 uses the camera 27 to capture an image of the panel display on the electrical panel. Then, it processes this image and determines that if the displayed value on the panel display shows the desired value, it is a pass; if it does not show the desired value, it is a fail.

[0120] Next, the result determination recording program 49 records the results of the tests that were determined to be passed in the airport database 11 (S42).

[0121] On the other hand, if the result judgment recording program 49 determines that the test is unsuccessful, it informs the operator S of the failure through audio output from the speaker 26 or text display from the display 24. In response, operator S repeats the operation and restarts the test.

[0122] The exam continues in this manner until a pass is determined.

[0123] Subsequently, if there are any remaining operations that have not yet been performed, the instruction creation program 48 issues instructions for the next step, and the operations from step S34 to S37 are repeated. Once all operations are performed and the results are satisfactory, the work support system 10 terminates its operation (S43).

[0124] Next, the effects achieved by the work support system 10 to which the work support method of the embodiment of the present invention is applied will be described.

[0125] For example, in tests at water and sewage facilities, some tests require verification of results at multiple locations, such as performing input work in a central monitoring room and then confirming whether the output is correct in response to the input in the electrical room or on-site. For such tests, worker S traditionally had to carry drawings and a communication device such as a mobile phone for travel to remote locations and communication with each site.

[0126] However, according to the work support system 10, the appropriate route to the test location can be communicated to worker S through images displayed on the display 24 of the wearable glasses 12 worn by worker S and audio output from the speaker 26. As a result, worker S can move to the test location reliably, safely, and efficiently without having to carry maps or other diagrams.

[0127] Furthermore, according to the work support system 10, the target of the test and the operating procedures can also be communicated to worker S through images displayed on the display 24 of the wearable glasses 12 worn by worker S, and through audio output from the speaker 26. This allows worker S to perform the test correctly and efficiently without making mistakes, even without carrying drawings or documents.

[0128] Furthermore, the work support system 10 automatically evaluates and records the work results after the test, significantly reducing the burden on worker S.

[0129] Furthermore, worker S can communicate directly with other workers S belonging to the same group using the wearable glasses 12. Therefore, each worker S can communicate with other workers S belonging to the same group and share the progress and results of their work in real time without having to carry a communication terminal such as a mobile phone.

[0130] As described above, with the work support system 10 to which the work support method of the embodiment of the present invention is applied, the worker S can obtain not only instructions on the operation procedure but also all work-related information, such as drawing data and document data, via the wearable glasses 12 equipped with the work support device 20. Therefore, complete hands-free operation is achieved, and the worker S can concentrate both hands on the operation.

[0131] Furthermore, instructions for the operating procedure are clearly communicated to the worker S through visual information displayed on the wearable glasses 12's display 24, for example using augmented reality, and audio information output from the speaker 26. Therefore, the worker S can easily and reliably understand the work content, enabling them to complete the test efficiently and quickly without making any mistakes.

[0132] Furthermore, the work support system to which the work support method of the embodiment of the present invention is applied can support the worker S throughout the entire testing process, such as by automatically determining and recording the test results using the work support device 20, thereby reducing the burden on the worker and significantly improving work efficiency.

[0133] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0134] 10. Work support system 11 Airport Database 12. Wearable glasses, work support devices 14 External recording media 20 Work support devices 21 Bus 22 CPU 23 Recording medium reading unit 24 displays 25 Mike 26 speakers 27 Cameras 28 GPS 29 Communications Department 30 Storage device 40 memory 41. Speech Recognition Program 42 Image Recognition Programs 43 Test Procedure Creation Program 44 Search Programs 45 Group Setting Program 46 Location Identification Program 47 Guidance Program 48 Instruction Generation Program 49 Result Judgment Recording Program 50 Overall control program 60 writable data areas 100 Initial menu screen 101 Airport name 102 Airport Selection List 103 Search button 104 Construction Project Name List of 105 construction project names 106 Search button 107 Exam Content 108 List of Exam Contents 109 Search button 110 Test Procedure Creation Button 120 Work procedure screen 121 Work process 122 Display button 123 Required number of workers 125 Equipment 126 Display button 127 Drawings 128 Layout diagram button 129 Outline drawing button 130 Sequence Block Diagram Button 140 Workgroup Settings Screen 141 Group display area 142 Confirm button 143 Start Exam button 200 guidance screen 201 Electrical Panel 202 characters 203 Arrow 204 Voice Icon 205 Layout diagram icon 206 Layout Plan 300 Operation instruction screen 301 Electrical Panel 302 characters 303 Direction line 304 Icons 400 Sequence Diagrams

Claims

1. A database containing information about the work to be done, It comprises a work support terminal having a display and worn and used by the worker, The aforementioned work support terminal is a work support system that, when the worker inputs a work target, searches the database for information related to the specified work target and displays the retrieved information on the display.

2. The aforementioned work support terminals are provided in multiple locations. The work support system according to claim 1, wherein work support terminals that are set to the same group among the plurality of work support terminals are capable of group communication.

3. The object of the work is an electrical panel. The aforementioned database is an airfield database that stores airfield information, which is information about the airfield to which the electrical panel belongs. The work support system according to claim 1 or 2, wherein the work support terminal comprises an electronic circuit into which a program for work support is incorporated, and is mounted on wearable glasses.

4. When a worker inputs a test target from a work support terminal they are wearing, the work support terminal searches for information about the test target from a database in which information about the test target is pre-registered. The aforementioned work support terminal performs the step of determining a test procedure based on the retrieved information, A step in which the worker performs a test on the test object in accordance with the test procedure, A work support method comprising the steps of: the work support terminal determining whether the conducted test passed or failed, and recording the results of the tests that were determined to have passed in the database.

5. The step further includes registering document data and drawing data relating to the test subject in the database as information relating to the test subject. The aforementioned search step includes the work support terminal using character recognition technology to search the database for document data and drawing data that contain the name of the test subject, The step of determining the aforementioned test procedure is: The aforementioned work support terminal performs the step of extracting document data and drawing data necessary for the test from the searched document data and drawing data, The work support method according to claim 4, further comprising the step of the work support terminal determining the test procedure based on information obtained from the extracted document data and drawing data.

6. When conducting the aforementioned test, The work support terminal includes the steps of identifying the worker's location and outputting worker location data, The work support terminal uses the extracted document data and drawing data necessary for the test, and the worker location data to create a route to guide the worker from their current location to the test target, and guides the worker according to the route. When the worker arrives at the test object, the work support terminal instructs the worker to perform the test operation according to the test procedure. The work support method according to claim 5, further comprising the step of the work support terminal determining whether the test operation was performed correctly based on the actions of the worker.

7. The work support method according to claim 6, further comprising the step of the work support terminal determining whether the test passed or failed based on the test results, and if it determined to have passed, recording the test results in the database.

8. A search unit that retrieves information related to the work from the database, An instruction creation unit creates instructions for the worker based on the information retrieved by the aforementioned search unit, A display on which an image representing the created instructions is shown. A work support terminal equipped with a work support device, which is worn and used by the worker.

9. A search unit that retrieves information about the test subject from a database in response to input from the operator specifying the test subject, A test procedure creation unit determines the test procedure based on the retrieved information, When the operator performs the test on the test subject in accordance with the test procedure, the result determination unit determines whether the performed test passed or failed, and records the results of the tests that were determined to pass in the database. A work support terminal equipped with a work support device, which is worn and used by the worker.

10. The search unit uses character recognition technology to search the database for document data and drawing data that contain the name of the test subject. The work support terminal according to claim 9, wherein the test procedure creation unit extracts document data and drawing data necessary for the test from the retrieved document data and drawing data, and determines the test procedure based on the information obtained from the extracted document data and drawing data.

11. The aforementioned work support device further, A location identification unit identifies the location of the worker and outputs worker location data, A guidance unit that uses the extracted document data and drawing data and the worker location data to create a route to guide the worker from their current location to the test target, and guides the worker according to the route, When the operator arrives at the test object, an instruction generation unit instructs the operator to perform the test operation according to the test procedure, The work support terminal according to claim 10, further comprising a result determination unit that determines whether or not the test operation was performed correctly based on the actions of the worker.

12. The work support terminal according to claim 11, wherein the result determination unit further determines whether the test is pass or fail based on the test results, and if it determines that the test is pass, it records the test results in the database.

13. A function that searches a database for information about a test target in response to input from the operator specifying the test target. A function to determine the test procedure based on the retrieved information. When the test is performed on the test subject by the operator in accordance with the test procedure, a function is provided to determine whether the performed test passed or failed. A program to enable the processor to record the results of tests that have been judged as passed in the aforementioned database.

Images