Wiring work support system and wiring work support method

Abstract

To provide a wire connection work support system and a wire connection work support method for improving work efficiency by reducing a burden on a worker during wire connection work of connecting a wire.SOLUTION: A wire connection work support system 100 includes an AR glass 10 attached to the head of a worker, and a server 30 communicatively connected to the AR glass. The AR glass includes at least one imaging unit 11 for imaging a terminal present in a visual line direction of the worker as a subject, a display unit 12 for displaying an augmented reality video within the visual field of the worker, and an information processing unit 13. The server includes a storage device 34 for storing wire connection data including information on color of a wire to be connected to the terminal. The information processing unit acquires a visual field image of the worker from a picked-up image of the at least one imaging unit, receives the wire connection data from the server, generates an augmented reality video by overlapping the image of the color of the wire to be connected to the terminal on an image of the terminal within the visual field image on the basis of the wire connection data, and displays the generated augmented reality video on the display unit.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a wiring work support system and a wiring work support method. [Background technology]

[0002] WO 2020 / 250928 (Patent Document 1) discloses a system for assisting cable connection work. This system includes a terminal device and a management server. The terminal device captures an image of the tip of the cable to be connected. The management server performs individual identification based on the surface pattern of the tip of the cable captured by the terminal device, and transmits work support information based on the results of the individual identification to the terminal device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2020 / 250928 Summary of the Invention [Problem to be solved by the invention]

[0004] When performing wiring work to connect wires to multiple terminals provided on an electrical device, a worker connects wires to each terminal while checking a wiring table that lists each terminal in a one-to-one correspondence with the type of wire connected to that terminal. Since the worker must compare the wiring table with the terminals while performing the work, there is a concern that as the number of terminals increases, the burden on the worker increases and work efficiency decreases. Furthermore, in electrical devices with multiple small terminals densely arranged, there is a concern that the worker may make a wiring error if he or she fails to check the terminals or the wiring table.

[0005] In the system described in Patent Document 1, virtual marking data consisting of character strings indicating the port name of the device to which the end of the cable should be connected and the port name of the device to which the other end of the cable is connected is generated and presented to the worker as work support information. However, there are still concerns about the visual effect of the data.

[0006] The present disclosure has been made to solve such problems, and an object of the present disclosure is to provide a wiring work support system and a wiring work support method that can reduce the burden on workers during wiring work to connect wires to terminals and improve work efficiency. [Means for solving the problem]

[0007] In one aspect of the present disclosure, a system for assisting wiring work is provided. The wiring work assistance system includes an eyeglass-type information terminal worn on the head of a worker and a server communicatively connected to the eyeglass-type information terminal. The eyeglass-type information terminal includes at least one imaging unit that captures an image of a terminal in the worker's line of sight as a subject, a display unit that displays an augmented reality image within the worker's field of view, and an information processing unit. The server includes a storage device that stores wiring data including information on the color of the wire to be connected to the terminal. The information processing unit acquires a field of view image of the worker from images captured by the at least one imaging unit and receives the wiring data from the server. Based on the wiring data, the information processing unit generates an augmented reality image by superimposing an image of the color of the wire to be connected to the terminal on an image of the terminal in the field of view image. The information processing unit displays the generated augmented reality image on the display unit.

[0008] Another aspect of the present disclosure provides a method for assisting wiring work using an eyeglass-type information terminal worn on a worker's head. The eyeglass-type information terminal includes at least one imaging unit and a display unit that displays an augmented reality image within the worker's field of view. The wiring work assistance method includes the steps of: capturing an image of a terminal located in the worker's line of sight as a subject with the at least one imaging unit; acquiring a field of view image of the worker from the captured image of the at least one imaging unit; acquiring wiring data including information on the color of the wire to be connected to the terminal; generating an augmented reality image by superimposing an image of the color of the wire to be connected to the terminal on an image of the terminal in the field of view image based on the wiring data; and displaying the generated augmented reality image on the display unit. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to reduce the burden on a worker during the wiring work of connecting wires to terminals and improve work efficiency. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is an overall configuration diagram of a wiring operation support system according to an embodiment of the present disclosure; [Figure 2] FIG. 2 is a diagram showing an example of a field of view image acquired by an imaging unit of the AR glasses. [Figure 3] FIG. 10 is a diagram illustrating an example of wiring data. [Figure 4] FIG. 1 illustrates an example of a hardware configuration of a wiring operation support system. [Figure 5] FIG. 1 is a diagram illustrating an example of a functional configuration of AR glasses. [Figure 6] FIG. 2 is a diagram illustrating an example of an AR image generated by an AR image generation unit. [Figure 7] FIG. 2 is a diagram illustrating an example of an AR image generated by an AR image generation unit. [Figure 8] 10 is a flowchart showing a part of a process executed by the wiring work support system. [Figure 9] FIG. 10 is a diagram illustrating an example of wiring data. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and description thereof will not be repeated.

[0012] <Configuration of the Wiring Work Support System> 1 is an overall configuration diagram of a wiring work support system according to an embodiment of the present disclosure. The wiring work support system 100 according to this embodiment is a system for supporting wiring work by an operator M using augmented reality (AR) technology. In this embodiment, the operator M performs work of connecting a plurality of wires to a plurality of terminals provided on a terminal block placed on a circuit board. The wiring work support system 100 is configured to support this wiring work.

[0013] 1, the wiring work support system 100 includes AR glasses 10 and a server 30. The AR glasses 10 and the server 30 are configured to be able to send and receive information bidirectionally via a communication network NW.

[0014] The AR glasses 10 are eyeglass-type information terminals worn on the head of the worker M. The AR glasses 10 are a type of smart glasses that are wearable terminals using a head-mounted display system. The AR glasses 10 recognize real space using an imaging unit 11 and display an augmented reality image (AR image) on a display unit 12 so as to match the real space. This allows the worker M to see the AR image as if it were in reality.

[0015] The AR glasses 10 include at least one imaging unit 11, a display unit 12, and an information processing unit (not shown). The at least one imaging unit 11 is a component for capturing an image of a subject in the line of sight of the worker M. In the example of FIG. 1, the AR glasses 10 include multiple imaging units 11a to 11d. Hereinafter, the multiple imaging units 11a to 11d may be collectively referred to as the "imaging unit 11." The multiple imaging units 11a to 11d are installed at appropriate distances on the outer edge of the display unit 12, so that the subject in the line of sight of the worker M can be captured within the imaging range. During wiring work, the imaging unit 11 captures an image of a terminal in the line of sight of the worker M as the subject. The AR glasses 10 acquire a field of view image that shows the field of view of the worker M from the images captured by the multiple imaging units 11a to 11d.

[0016] The display unit 12 is provided corresponding to both eyes of the worker M. The display unit 12 displays the AR image within the field of view of the worker M without obstructing the field of view of the worker M. In FIG. 1, the AR image is projected into the field of view of both eyes, but the AR image may be provided to one eye.

[0017] 2 is a diagram showing an example of a field of view image acquired by the imaging unit 11 of the AR glasses 10. As shown in FIG. 2, the field of view image includes a part of the board 50 and two terminal blocks 52 placed on the board 50.

[0018] Each terminal block 52 is provided with a plurality of terminals 54. The terminals 54 can be electrically connected to the wires by inserting the tip of the corresponding wire into a terminal hole formed in each terminal 54. The shape of the terminal block 52 is not limited to this. For example, the terminals 54 may be configured to be electrically connected to the wires by fastening each terminal 54 to the tip of the wire using a fastening member.

[0019] A substrate silk 56 is disposed near each terminal 54. In FIG. 2, the substrate silk 56 is disposed horizontally adjacent to the corresponding terminal 54. The substrate silk 56 is a pattern consisting of letters and / or symbols, etc., formed on the substrate 50 to display information about the corresponding terminal 54. The substrate silk 56 can be formed by printing on the substrate 50 using a screen printing method, an inkjet method, a photographic method, or the like.

[0020] 2, each board silk 56 has a rectangular shape and includes characters indicating the terminal number, which is identification information of the corresponding terminal 54. The position and shape of the board silk 56 are not limited to this, and it is sufficient that there is a one-to-one correspondence with the terminals 54.

[0021] Returning to Fig. 1, the server 30 has a function for managing the wiring work performed by the worker M. The server 30 stores wiring data including information on the wires to be connected to each terminal 54 of the terminal block 52 provided on the board 50 on which the wiring work is performed. Fig. 3 is a diagram showing an example of the wiring data.

[0022] As shown in FIG. 3, the wiring data includes identification information (terminal block number) for identifying the terminal block 52, identification information (terminal number) for identifying the terminal 54, and wiring color information indicating the color of the wiring to be connected to each terminal 54.

[0023] For example, in terminal block 52 with terminal block number "TA1," a "yellow" wire is connected to terminal 54 with terminal number "1SDA," and a "white (yellow)" wire is connected to terminal 54 with terminal number "1SDB." A "green" wire is connected to terminal 54 with terminal number "FG," and a "blue" wire is connected to terminal 54 with terminal number "24VA." A "white (blue)" wire is connected to terminal 54 with terminal number "24G." Note that "white (yellow)" wire refers to a wire consisting of two electric wires, one white and one yellow, and "white (blue)" wire refers to a wire consisting of two electric wires, one white and one blue.

[0024] In this way, in the wiring data, for each terminal 54, identification information (terminal number) for identifying the terminal 54 and wiring color information indicating the color of the wiring to be connected to the terminal 54 are associated with each other.

[0025] When the server 30 receives the visual field image data from the AR glasses 10, it analyzes the received visual field image to identify the terminal block 52 on which the worker M will perform the wiring work. Then, the server 30 transmits wiring data of the identified terminal block 52 to the AR glasses 10. The wiring data is used to generate an AR image in the AR glasses 10, as will be described later.

[0026] <Hardware configuration of the wiring work support system> Next, a description will be given of the hardware configuration of the wiring work support system 100 according to this embodiment.

[0027] (Hardware configuration of server 30) 4, the server 30 includes, as its main components, a CPU (Central Processing Unit) 31, a RAM (Random Access Memory) 32, a ROM (Read Only Memory) 33, a storage device 34, and a communication I / F 35. The CPU 31, RAM 32, ROM 33, storage device 34, and communication I / F 35 exchange various data via a communication bus 36.

[0028] The CPU 31 loads a program stored in the ROM 33 into the RAM 32 and executes it. The program stored in the ROM 33 describes the processes to be executed by the server 30.

[0029] The storage device 34 is a storage that stores various information, and stores information about the board 50, information about the terminal blocks 52 mounted on the board 50, and wiring data for each terminal block 52. The storage device 34 is, for example, a hard disk drive (HDD) or a solid state drive (SSD).

[0030] The communication I / F 35 is an input / output device for exchanging signals and data with external devices including the AR glasses 10. The communication I / F 35 transmits wiring data of the terminal block 52 where the worker M performs the wiring work to the AR glasses 10 via the communication network NW. The communication I / F 35 also receives data of the field of view image, data indicating the result of determining whether the wiring work is correct, and the like from the AR glasses 10.

[0031] (AR Glasses 10 hardware configuration) The AR glasses 10 include at least one imaging unit 11, a display unit 12, and an information processing unit 13.

[0032] At least one imaging unit 11 captures an image of a subject in the line of sight of the worker M. Each imaging unit 11 mainly includes an optical system such as a lens and an aperture, and a light receiving element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Oxide Semiconductor) image sensor. Each imaging unit 11 captures an image in accordance with a command from the information processing unit 13, and outputs image data obtained by the image capture to the information processing unit 13. In the example of FIG. 1, the AR glasses 10 have multiple imaging units 11a to 11d, and output image data obtained by the image capture by the multiple imaging units 11a to 11d to the information processing unit 13. The captured image is a real-time image of the subject in real space.

[0033] The information processing unit 13 is configured to include, as main components, a CPU 41, a RAM 42, a ROM 43, an input / output I / F 44, a storage device 45, and a communication I / F 46. The CPU 41, RAM 42, ROM 43, the input / output I / F 44, the storage device 45, and the communication I / F 46 exchange various data via a communication bus 47.

[0034] The CPU 41 loads a program stored in the ROM 43 into the RAM 42 and executes it. The program stored in the ROM 43 describes the processes to be executed by the information processing unit 13.

[0035] The input / output I / F 44 is an input / output device for exchanging various data between the information processing unit 13 and the imaging unit 11 and the display unit 12 .

[0036] The storage device 45 is a storage for storing various types of information, and stores the wiring data, the visual field image data, and data indicating the result of determining whether the wiring is correct or incorrect, received from the server 30. The storage device 45 is, for example, an HDD.

[0037] The communication I / F 46 is an input / output device for exchanging signals and data with the server 30. The communication I / F 46 transmits data of the field of view image, data indicating the result of determining whether the wiring is correct, and the like to the server 30 via the communication network NW. The communication I / F 46 also receives wiring data and the like of the terminal block 52 where the worker M performs wiring work from the server 30.

[0038] The information processing unit 13 acquires a visual field image of the worker M based on an image captured by at least one imaging unit 11. Then, the information processing unit 13 generates an AR image based on the acquired visual field image data and the wiring data from the server 30. The information processing unit 13 also determines whether the wiring performed by the worker M is correct or incorrect, and overlays the determination result on the AR image. A method for generating the AR image will be described later.

[0039] The display unit 12 is a transmissive display, and displays the AR video generated by the information processing unit 13 within the field of view of the operator M without blocking the operator M's field of view.

[0040] <Functional Configuration of AR Glasses 10> Next, the functions of the AR glasses 10 will be described. FIG. 5 is a diagram showing an example of the functional configuration of the AR glasses 10.

[0041] As shown in FIG. 5, the AR glasses 10 include a field-of-view image acquisition unit 80, a communication unit 82, an AR video generation unit 84, and a determination unit 86. The functions of the field-of-view image acquisition unit 80, the communication unit 82, the AR video generation unit 84, and the determination unit 86 can be realized by software processing in which the CPU 41 in the information processing unit 13 executes a program stored in the ROM 43. Note that at least a part of the functions of the field-of-view image acquisition unit 80, the communication unit 82, the AR video generation unit 84, and the determination unit 86 may be realized by hardware processing such as a dedicated electronic circuit.

[0042] The field-of-view image acquisition unit 80 acquires a field-of-view image indicating the field of view of the operator M from the captured images of at least one imaging unit 11. In a certain aspect, the field-of-view image acquisition unit 80 acquires a field-of-view image based on the captured images of the plurality of imaging units 11a to 11d and the position information of each imaging unit 11 with respect to the line of sight of the operator M. As shown in FIG. 2, the field-of-view image includes an image of the terminal block 52 where the operator M performs the connection work. The field-of-view image acquisition unit 80 outputs the acquired field-of-view image data to the communication unit 82, the AR video generation unit 84, and the determination unit 86.

[0043] The communication unit 82 has a communication function via the communication network NW. The communication unit 82 can exchange data with the field-of-view image acquisition unit 80, the AR video generation unit 84, and the determination unit 86. The communication unit 82 transmits the field-of-view image data from the field-of-view image acquisition unit 80 to the server 30.

[0044] The field of view image data is used by the server 30 to identify the terminal block 52 on which the worker M will perform wiring work. When the server 30 identifies the terminal block 52 by analyzing the field of view image, the server 30 reads out wiring data from the storage device 34, the wiring data including information on the wiring to be connected to each terminal 54 on the identified terminal block 52. The server 30 transmits the read wiring data to the AR glasses 10. As shown in FIG. 3 , the wiring data associates, for each terminal 54, identification information (terminal number) for identifying the terminal 54 with wiring color information indicating the color of the wiring to be connected to the terminal 54.

[0045] When the communication unit 82 receives the wiring data from the server 30, the communication unit 82 transmits the received wiring data to the AR image generation unit 84.

[0046] The AR image generation unit 84 generates an AR image using the field of view image data and the wiring data. Specifically, the AR image generation unit 84 first detects the identification information (terminal number) of each terminal 54 from the image of the terminal block 52 included in the field of view image. The AR image generation unit 84 can detect the terminal number by reading the terminal number written on the board silk 56 arranged near each terminal 54 from the image of the terminal block 52.

[0047] Next, the AR video generation unit 84 refers to the wiring data (see FIG. 3) to identify the color of the wire to be connected to each terminal 54 from the identification information (terminal number) of each terminal 54. Then, the AR video generation unit 84 generates the AR video by superimposing an image indicating the identified color of the wire on the field of view image.

[0048] Fig. 6 is a diagram showing an example of an AR image generated by the AR image generation unit 84. The AR image shown in Fig. 6 is obtained by superimposing an image showing wiring color information on the field of view image shown in Fig. 5. In the example of Fig. 6, the board silk 56 arranged adjacent to each terminal 54 is displayed colored in the color of the wiring to be connected to the corresponding terminal 54.

[0049] Specifically, in the terminal block 52 with the terminal block number "TA1," the board silk 56 corresponding to the terminal 54 with the terminal number "1SDA" is colored "yellow," which is the color of the wire to be connected to that terminal 54. The board silk 56 corresponding to the terminal 54 with the terminal number "1SDB" is colored "white (yellow)," which is the color of the wire to be connected to that terminal 54. The board silk 56 corresponding to the terminal 54 with the terminal number "FG" is colored "green," which is the color of the wire to be connected to that terminal 54. The board silk 56 corresponding to the terminal 54 with the terminal number "24VA" is colored "blue," which is the color of the wire to be connected to that terminal 54. The board silk 56 corresponding to the terminal 54 with the terminal number "24G" is colored "white (blue)," which is the color of the wire to be connected to that terminal 54. The "white (yellow)" substrate silk 56 is colored in two colors, white and yellow, and the "white (blue)" substrate silk 56 is colored in two colors, white and blue.

[0050] In the AR image, the board silk 58 corresponding to the terminals 54 to which no wiring is connected is displayed as a mask. In the example of Fig. 6, the board silk 58 is displayed in black. The color of the board silk 58 is not limited to black, and may be a color other than the color of the wiring.

[0051] The AR image generation unit 84 outputs the generated AR image to the display unit 12. The display unit 12 displays the AR image. The AR image displayed in the field of view allows the worker M to visually recognize the color of the wires to be connected to each terminal 54 of the terminal block 52 where the wiring work is to be performed. The worker M can also recognize that no wiring should be connected to the terminal 54 corresponding to the masked board silk 58.

[0052] This eliminates the need for the worker M to visually compare the wiring data with the terminal block 52 during the wiring work, thereby reducing the burden on the worker M. As a result, it is possible to improve the efficiency of the wiring work.

[0053] 6 shows a configuration in which the board silk 56 arranged adjacent to each terminal 54 in the field of view image is displayed in the color of the corresponding wiring, but the colored portion is not limited to the board silk 56. For example, each terminal 54 itself may be displayed in the color of the corresponding wiring.

[0054] Returning to FIG. 5 , the determination unit 86 determines whether the wiring is correct based on the visual field image data sent from the visual field image acquisition unit 80 during the wiring work. Specifically, the determination unit 86 detects the color of the wire connected to each terminal 54 by analyzing the visual field image. Next, the determination unit 86 determines whether the color of the wire indicated in the wiring data for each terminal 54 matches the color of the wire connected to that terminal 54. If the color of the wire indicated in the wiring data matches the color of the wire connected to that terminal 54, the determination unit 86 determines that the wiring of that terminal 54 is correct. On the other hand, if the color of the wire indicated in the wiring data does not match the color of the wire connected to that terminal 54, the determination unit 86 determines that the wiring of that terminal 54 is incorrect.

[0055] The determination unit 86 transmits data indicating the determination result as to whether the wiring is correct or incorrect to the communication unit 82 and the AR image generation unit 84. The communication unit 82 transmits data indicating the determination result to the server 30.

[0056] When the AR video generation unit 84 receives data indicating the determination result from the determination unit 86, the AR video generation unit 84 includes information indicating the received determination result in the AR video. Fig. 7 is a diagram showing an example of an AR video generated by the AR video generation unit 84. The AR video shown in Fig. 7 is obtained by superimposing information on the determination result on the AR video shown in Fig. 6.

[0057] As shown in FIG. 7 , a determination result image 62 indicating the determination result is displayed alongside the board silk 56 arranged adjacent to each terminal 54. The determination result image 62 includes the word "OK" indicating that the wiring is correct, or the word "NG" indicating that the wiring is incorrect. In the example of FIG. 7 , the color of the wire 60 connected to each of the terminals 54 with terminal numbers "1SDA," "1SDB," and "24VA" matches the color of the wire attached to the corresponding board silk 56, so the determination result image 62 indicating "OK" is displayed. On the other hand, the color of the wire 60 connected to each of the terminals 54 with terminal numbers "FG" and "24G" differs from the color of the wire attached to the corresponding board silk 56, so the determination result image 62 indicating "NG" is displayed.

[0058] The generation of the AR image by the AR image generator 84 described above is performed promptly in real time in response to the acquisition of the field of view image. Therefore, when the worker M connects a wire 60 to one terminal 54 of the terminal block 52, the correctness of the wiring of the terminal 54 is determined based on the color of the wire 60 and the color of the wiring indicated in the wiring data, and a determination result image 62 is displayed in the AR image. This allows the worker M to check the correctness of the wiring in real time from the AR image during the wiring work, making it possible to reduce the occurrence of wiring errors.

[0059] In addition, in Figure 7, a configuration is shown in which the judgment result image 62 is displayed alongside the board silk 56 arranged adjacent to each terminal 54, but the part where the judgment result image 62 is displayed is not limited to this, and it is sufficient if there is a one-to-one correspondence with the terminal 54.

[0060] <Control structure of the wiring work support system> Next, the control structure of the wiring work support system 100 will be described.

[0061] Fig. 8 is a flowchart showing part of the processing executed by the wiring work support system 100. In Fig. 8, the processing executed by the AR glasses 10 is shown on the left side, and the processing executed by the server 30 is shown on the right side. Each step is realized by software processing by the AR glasses 10 or the server 30, but may also be realized by hardware (electrical circuits) created within the AR glasses 10 or the server 30. Hereinafter, steps are abbreviated as S.

[0062] In S01, the AR glasses 10 capture an image of a subject in the worker M's field of view using at least one imaging unit 11.

[0063] In S02, the AR glasses 10 acquire a visual field image (see FIG. 2) showing the visual field of the worker M from the captured image of at least one imaging unit 11.

[0064] In S03, the AR glasses 10 transmit the visual field image data acquired in S02 to the server 30.

[0065] In S11, the server 30 receives the visual field image data from the AR glasses 10, and in S12, analyzes the visual field image data to identify the terminal block 52 on which the worker M will perform the wiring work.

[0066] In S13, the server 30 reads out the wiring data (see FIG. 3) of the identified terminal block 52 from the storage device 34. In S14, the server 30 transmits the read wiring data to the AR glasses 10.

[0067] In S04, the AR glasses 10 receive the wiring data of the terminal block 52 from the server 30. In S05, the AR glasses 10 generate an AR image (see FIG. 6) using the visual field image data acquired in S02 and the wiring data of the terminal block 52. In S05, the AR glasses 10 refer to the wiring data to identify the color of the wire to be connected to each terminal 54 from the identification information (terminal number) of each terminal 54, and generate the AR image by superimposing information indicating the identified wiring color on the visual field image.

[0068] In S06, the AR glasses 10 display the generated AR image on the display unit 12. As a result, for each terminal 54 included in the field of view image, information on the color of the wire to be connected to that terminal 54 is provided to the worker M. The worker M can perform the wiring work while referring to the provided wire color information.

[0069] In S07, the AR glasses 10 detect the colors of the wires connected to each terminal 54 based on the field of view image acquired during the wiring work.

[0070] In S08, the AR glasses 10 determine whether the wiring is correct for each terminal 54 by comparing the color of the wiring indicated in the wiring data with the color of the wiring connected to that terminal 54. In S08, if the color of the wiring indicated in the wiring data matches the color of the wiring connected to the terminal 54, it is determined that the wiring of that terminal 54 is correct. On the other hand, if the color of the wiring indicated in the wiring data does not match the color of the wiring connected to the terminal 54, it is determined that the wiring of that terminal 54 is incorrect.

[0071] In S09, the AR glasses 10 display information on the determination result superimposed on the AR image generated in S05. In response to the wiring 60 being connected to the terminal 54, a determination result image 62 indicating whether the wiring of the terminal 54 is correct or incorrect is displayed in the AR image (see FIG. 7).

[0072] In S10, the AR glasses 10 transmit to the server 30 data indicating the result of determining whether the wiring is correct or incorrect.

[0073] In S15, when the server 30 receives data indicating the determination result from the AR glasses 10, in S16, the server 30 adds the data of the determination result to the wiring data read out in S13. Fig. 9 is a diagram showing an example of the wiring data. The wiring data in Fig. 9 is the wiring data shown in Fig. 3 to which the data of the determination result has been added.

[0074] 9, the wiring data includes identification information (terminal block number) for identifying the terminal block 52, identification information (terminal number) for identifying the terminals 54, wiring color information indicating the color of the wiring to be connected to each terminal 54, and information indicating the result of determining whether the wiring is correct for each terminal 54. That is, for each terminal 54, the identification information (terminal number) for identifying the terminal 54, the wiring color information indicating the color of the wiring to be connected to that terminal 54, and the result of determining whether the wiring is correct are associated with each other.

[0075] In S17, the server 30 stores the wiring data (see FIG. 9) to which the determination result has been added in the storage device 34. The wiring data of each terminal block 52 stored in the storage device 34 is updated to include the determination result of whether the wiring is correct or incorrect in response to the wiring work being performed on the terminal block 52.

[0076] In this way, wiring data including the result of determining whether the wiring is correct or incorrect is stored in the storage device 34 of the server 30. A manager or the like who manages the wiring work of the worker M can easily manage the progress of the wiring work remotely from the wiring data stored in the storage device 34. In addition, the manager can give the worker M accurate instructions according to the progress of the wiring work.

[0077] In the above-described embodiment, a configuration has been described in which the AR glasses 10 generate AR video based on the field of view image and the connection data from the server 30 and display it on the display unit 12. However, the server 30 may display AR video based on the connection data and the field of view image data from the AR glasses 10 and transmit it to the AR glasses 10, and the AR video received by the AR glasses 10 may be displayed on the display unit 12.

[0078] <Effects of the embodiment> As described above, according to the wiring operation support system of this embodiment, the AR glasses 10 are configured to display, within the field of view of the worker, an AR image on which information indicating the color of the wire to be connected to the terminal where the wiring operation is to be performed is superimposed. This allows the worker to visually recognize the color of the wire to be connected to the terminal from the AR image, thereby reducing the burden on the worker. As a result, it is possible to improve the efficiency of the wiring operation.

[0079] Furthermore, in the wiring operation support system according to this embodiment, the AR glasses 10 are configured to display the judgment result of whether the terminal wiring is correct or incorrect superimposed on the AR image. Therefore, the worker can check the correctness of the wiring in real time from the AR image during the wiring operation, which makes it possible to reduce the occurrence of wiring errors.

[0080] Furthermore, in the wiring work support system according to this embodiment, the server 30 is configured to receive data indicating the determination result of whether the wiring is correct or incorrect from the AR glasses 10, and store the data in the storage device together with the wiring data. This allows a manager or the like who manages the wiring work to easily manage the progress of the wiring work remotely from the wiring data stored in the storage device. Furthermore, the manager can issue appropriate instructions to the worker M according to the progress of the wiring work.

[0081] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The present disclosure is defined by the claims rather than the above description, and it is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0082] 10 AR glasses, 11 imaging unit, 12 display unit, 13 information processing unit, 30 server, 31, 41 CPU, 32, 42 RAM, 33, 43 ROM, 34, 45 storage device, 35, 46 communication I / F, 44 input / output I / F, 50 circuit board, 52 terminal block, 54 terminal, 56, 58 circuit board silk, 60 wiring, 62 judgment result, 80 field of view image acquisition unit, 82 communication unit, 84 AR image generation unit, 86 judgment unit, 100 wiring work support system.

Claims

1. A system for supporting wiring work, comprising: a glasses-type information terminal to be worn on the head of a worker; a server communicatively connected to the glasses-type information terminal; The eyeglass-type information terminal includes: at least one imaging unit that captures an image of a terminal located in the line of sight of the worker as a subject; a display unit that displays an augmented reality image within the field of view of the worker; including an information processing unit, the server includes a storage device that stores wiring data including information on the colors of wires to be connected to the terminals; The information processing unit acquiring a visual field image of the worker from an image captured by the at least one imaging unit; receiving the wiring data from the server; generating the augmented reality image by superimposing an image of the color of a wire to be connected to the terminal on an image of the terminal in the field of view image based on the wiring connection data; displaying the generated augmented reality image on the display unit; a pattern on which information about the terminal is written is disposed near the terminal; The display unit displays, in the augmented reality image, the patterns corresponding to terminals for which no wiring work is to be performed as masks.

2. The information processing unit further includes: determining whether the wiring is correct or incorrect based on the field of view image and the wiring data; The wire connection work support system according to claim 1 , wherein the result of the judgment on the correctness of the wire connection is displayed superimposed on the augmented reality image.

3. the information processing unit transmits a determination result of whether the wiring is correct or incorrect to a server; 3. The wiring work support system according to claim 2, wherein the server adds the result of the judgment on the correctness of the wiring to the wiring data and stores the result in the storage device.

4. 4. The wiring operation support system according to claim 1, wherein the information processing unit displays the terminal or the vicinity of the terminal in the augmented reality image in a color corresponding to the color of the wire to be connected to the terminal.

5. The wiring work support system described in Claim 4, wherein the information processing unit displays the pattern in the augmented reality image by coloring it with the color of the wiring to be connected to the terminal.

6. A method for assisting a wiring operation using an eyeglass-type information terminal worn on the head of a worker, comprising: the glasses-type information terminal includes at least one imaging unit and a display unit that displays an augmented reality image within the worker's field of view; a step in which the at least one imaging unit captures an image of a terminal located in the line of sight of the worker as a subject; acquiring a visual field image of the worker from an image captured by the at least one imaging unit; acquiring wiring connection data including information on the color of a wiring to be connected to the terminal; generating the augmented reality image by superimposing an image of the color of a wire to be connected to the terminal on an image of the terminal in the field of view image based on the wiring connection data; displaying the generated augmented reality image on the display unit; a step of placing a pattern containing information about the terminal near the terminal, and overlaying the pattern on the augmented reality image to mask out the pattern corresponding to a terminal for which wiring work is not to be performed.

7. determining whether the wiring is correct or not based on the field of view image and the wiring data; The wire connection work support method according to claim 6 , further comprising the step of superimposing and displaying the result of the judgment on the correctness of the wire connection on the augmented reality image.

Images