Wiring connection work support system

Abstract

To provide a wiring connection work support system that does not cause a shift in the position of a target mark displayed on a display part of a wearable glass.SOLUTION: In a wiring connection work support system that includes a head-mounted display device and a terminal device and supports a work of connecting the ends of wiring to a terminal block having multiple insertion ports, relative position information of each insertion port with respect to a reference marker provided on the surface of the terminal block and having at least a frame shape surrounding the multiple insertion ports is stored in storage means of the head-mounted display device or a storage unit of the terminal device. Video processing means includes: means for recognizing the reference marker based on a video acquired by imaging means; and image composition means for acquiring relative position information of an insertion port designated by the terminal device from the storage means of the head-mounted display device or the storage unit of the terminal device, and superimposing and displaying the image of a target mark at a position of a work target insertion port in the video based on the relative position information and the reference marker.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a wiring connection work support system that supports the work of connecting wiring to a terminal block, and relates to technology that is effective when used in a wiring connection work support system that supports the work of connecting the end of a signal wire to a jack board to which a relay is connected, for example. [Background technology]

[0002] Conventionally, a wiring connection work support system that supports the work of connecting wiring ends to a jack board that serves as a terminal block has included a system in which a worker wears wearable glasses (head-mounted display device) equipped with an imaging means, a display means, and a wireless communication means on his or her head, and performs AR display (augmented reality) by superimposing a mark indicating the position where the wiring end should be inserted onto a video image captured by the imaging means of the wearable glasses and displaying it on the display means.

[0003] In such a system, the wearable glasses display a target mark in AR indicating the intended position for inserting the end of the wiring based on the wiring work instruction information received by wireless communication. For example, an AR marker that has previously stored the relative position information of the wiring insertion point is attached to the outside of the wiring insertion port of the jack board as an information and reference marker, and the video image captured by the imaging means is processed by a microprocessor installed in the wearable glasses to recognize the reference marker, and a target mark indicating the insertion point is displayed based on the relative position information with respect to the reference marker. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-203382 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-62026 Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional AR display technology described above, a target mark indicating the insertion point is displayed based on the relative positional relationship between the reference marker and the wiring location. Therefore, depending on the positional relationship (angle, distance) of the reference marker on the image captured by the imaging means of the wearable glasses, there may be a deviation of several millimeters in the displayed position of the target mark. Furthermore, when the reference marker is printed on a sticker and attached, it is difficult to attach the sticker in the specified position with high precision, and poor accuracy in the attachment position results in a deviation in the display position of the target mark on the wearable glasses. Furthermore, when the work object is a jack board, multiple wiring cables are connected, so there is a possibility that part of the reference marker will be hidden by the already connected wiring cables, in which case there is a problem that the information on the reference marker cannot be read by the imaging means of the wearable glasses.

[0006] Incidentally, a conventional invention relating to an MR display device that displays a virtual object superimposed on a video image captured by a camera on a tablet terminal device is described, for example, in Patent Document 1. Patent Document 1 describes a technology that recognizes a marker image from a video image, refers to display information for displaying a virtual object defined for each marker image, identifies a virtual object associated with the marker image and a display position, and displays the virtual object associated with the marker image in MR (mixed reality) at the display position defined by the display information of the video image. The invention of Patent Document 1 relates to an MR display device that displays a virtual object superimposed on a video image. However, because it uses markers, when applied to a system that assists in the task of connecting the end of a wire to a terminal block, there is the problem that, as mentioned above, if the accuracy of the marker placement is poor, a deviation of several millimeters will occur in the display position of the virtual object.

[0007] Patent document 2 describes an invention relating to a work process learning support system that displays work support information for each work process received from a content server, superimposed on a video image captured by a camera within the field of view of the wearer of a glasses-type wearable terminal. However, the invention in Patent Document 2 involves displaying cooking procedures as text data on a wearable device using AR, but does not mention displaying marks indicating positions using AR. Therefore, when applied to a wiring connection work support system, there is a problem in that the insertion position cannot be visually indicated.

[0008] The present invention has been made against the background described above, and aims to provide a wiring connection work support system that does not cause any misalignment in the position of the target mark displayed on the display unit of the wearable glasses. Another object of the present invention is to provide a wiring connection work support system that can grasp the correct position and display a target mark indicating the wiring insertion position in AR even if part of the image serving as a reference marker is hidden by the wiring. [Means for solving the problem]

[0009] In order to solve the above problems, the present invention provides: A wiring connection work assistance system that assists in the work of connecting ends of wiring to a terminal block having a plurality of sockets, the system comprising: a head-mounted display device having an imaging means, a wireless communication means, a transmission-type display device, an image processing means having a function of image processing the image acquired by the imaging means, and a storage means; and a terminal device that is capable of transmitting data to the head-mounted display device, the storage means of the head-mounted display device or the storage unit of the terminal device stores relative position information of each socket with respect to a reference marker provided on a surface of the terminal block and having at least a frame shape surrounding the plurality of sockets; The image processing means a means for recognizing the reference marker based on the image acquired by the imaging means; The relative position information of the insertion port instructed by the terminal device is acquired from the storage means of the head-mounted display device or the storage unit of the terminal device, and an image synthesis means for superimposing and displaying an image of a target mark on the position of the insertion port of the work target in the video based on the acquired relative position information and the recognized reference marker is provided.

[0010] According to the wiring connection work support system configured as described above, based on the reference marker composed of the colored area provided on the surface of the terminal block and the relative position information with respect to the reference marker, an image of a target mark is superimposed and displayed at the position of the insertion port of the work target in the video of the terminal block being photographed, so that there is no deviation in the position of the target mark. In addition, since the reference marker has at least a frame shape surrounding a plurality of insertion ports, the target mark is displayed at the position of the insertion port of the work target based on a marker much larger than the size of the insertion port, so that the accuracy of the display position of the target mark can be improved.

[0011] Here, preferably, the reference marker is configured to be colored with a color different from the base color of the terminal block and the color of the wiring to be connected. According to such a configuration, since the color of the reference marker is different from the surrounding colors, the reference marker can be surely recognized by image processing.

[0012] Also, preferably, the plurality of insertion ports are arranged in a matrix, and the reference marker is formed in a shape like a Chinese character "tian" (a square with a cross in the middle). According to such a configuration, even when a plurality of wirings are connected to the terminal block, the reference marker can be surely recognized.

[0013] Furthermore, preferably, the terminal block is arranged in one control panel together with a plurality of other terminal blocks, and a two-dimensional code including the identification information of the control panel is attached to the control panel. the image processing means includes code decryption means for decrypting the two-dimensional code included in the image, The image synthesizing means receives position information of the terminal block to be worked on from the terminal device, and based on the position information, displays an image serving as a marker superimposed on the position of the terminal block to be worked on in the image.

[0014] According to the above configuration, an image serving as a landmark is displayed at the position of the terminal block to be worked on, allowing the worker to easily find the terminal block to be worked on and avoiding connecting wiring to the wrong terminal block. [Effects of the Invention]

[0015] The wiring connection work support system according to the present invention can prevent misalignment of the target mark displayed on the display unit of the wearable glasses. Furthermore, even if a part of the image serving as the reference marker is hidden by the wiring, the correct position can be grasped and the target mark indicating the wire insertion position can be displayed in AR. [Brief explanation of the drawings]

[0016] [Figure 1] (A) is a front view showing an example of the configuration of an A-type jack board that is the target of support work by the wiring connection work support system of the present invention, (B) is a front view showing the state in which a reference marker is provided on the jack board of (A), and (C) is a diagram showing an AR display image in which a mark indicating the position is superimposed on a video image of the jack board of (B). [Figure 2] 1 is a block diagram showing an example of the configuration of wearable glasses that constitute the wiring connection work support system according to the present invention. FIG. [Figure 3] 10 is a flowchart showing an example of a procedure for connecting a wiring end to a jack plate in the wiring connection operation support system of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of a wiring connection work support system according to the present invention will be described with reference to the drawings. First, the configuration of an A-shaped jack plate as an example of a terminal block to be supported by the wiring connection work support system according to the embodiment will be described using FIG. 1. The A-shaped jack plate 10 is a terminal block installed in an instrument box for railway equipment and is used to attach a JRS standard A-shaped DC relay used for controlling a track circuit breaker or the like. A socket for mounting a relay is provided on the front surface, and on the back surface, as shown in FIG. 1(A), a jack portion 11 is provided in which a plurality of insertion ports 12 for inserting the ends (plugs) of the wiring are arranged in a matrix, and connection terminals are fixed inside each insertion port 12.

[0018] Also, as shown in FIG. 1(A), the A-shaped jack plate 10 has a board portion 13 provided beside the jack portion 11. This board portion 13 is arranged in a single switchboard together with a plurality of other board portions. Although not shown, a seal printed with a two-dimensional code such as an AR marker including the identification information of the switchboard is pasted on the switchboard. Furthermore, a plurality of screw holes for inserting fixing screws 15 for fixing the jack plate 10 to a switchboard or the like are provided at the peripheral edge of the jack plate 10. Generally, a plurality of jack plates 10 as shown in FIG. 1 are attached to the switchboard,

[0019] In the jack plate 10 in the embodiment, a paint of a color different from the original color of the insulating material (synthetic resin) forming the frame, that is, the base color of the frame, is applied all over the frame so as to represent a "field" character on the surface of the grid-shaped frame of the jack portion 11, as shown in FIG. 1(B). In the wiring connection work support system according to the present embodiment, the "field" character pattern P indicated by this paint is used as a reference marker for specifying the position of the insertion port 12, and as shown in FIG. 1(C), the system is configured to determine the position of a rectangular mark M indicating the insertion port 12 into which the end of the wiring is inserted in the wiring connection work and display it on the transmissive display portion on the front surface of the wearable glasses described later.

[0020] Furthermore, in the jack plate 10 of the present embodiment, even when a plurality of wirings are connected to the jack plate, the reference marker (pattern P) can be surely recognized by processing an image of the jack plate 10. Therefore, as the color of the reference marker, a color different from the color of the wiring cable connected to the jack plate 10 is selected. As a method for selecting the color of the reference marker, it is advisable to adopt a method of selecting a color that is relatively far from the colors of the plurality of wiring cables to be used, that is, a color with a large difference in hue and saturation, using a color chart represented by taking hue in the circumferential direction and saturation in the radial direction. Specifically, for example, when the colors of the wiring cables to be used are four colors of white, red, blue, and green, it is conceivable to select orange or purple as the color of the reference marker.

[0021] As described above, by applying a paint of a color different from the color of the wiring cable to the surface of the jack plate so as to mark the "field" - shaped pattern P all over the frame and using it as the reference marker, when connecting another wiring cable to the jack plate to which a plurality of wiring cables are already connected, even if a part of the jack plate or the reference marker is hidden by the already - connected wiring cables, there is an advantage that the reference marker can be recognized relatively accurately by image processing from the video image of the photographed jack plate.

[0022] FIG. 2 shows a block diagram showing a configuration example of wearable glasses constituting the wiring connection work support system according to the present invention. As shown in FIG. 2, the wearable glasses 20 used in the present embodiment include a video camera 21 for photographing the front of the glasses, a wireless communicator 22 for performing wireless communication with a work management computer (not shown), a data processing unit (video processing means) 23 for processing a video signal from the video camera 21, a transmissive display unit (display) 24 for displaying the video photographed by the video camera 21, a storage unit 25 for storing application programs, image data of target marks for indicating the insertion positions of the wiring ends, etc., a battery 26 for supplying a power voltage, and the like.

[0023] The data processing unit 23 is composed of a microprocessor (CPU), a non-volatile storage device such as a ROM that stores programs executed by the CPU, and a readable / writable storage device such as a RAM, and is equipped with a colored frame discrimination unit 31 that processes the video signal from the video camera 21 to discriminate a reference colored frame (reference frame) provided on the surface of the jack plate to be worked on, and a transmission / reception processing unit 32 that transmits image data captured by the video camera 21 to a work management computer (PC) via the wireless communication device 22 and receives work instruction information.

[0024] The data processing unit 23 also includes a code decoding unit 33 that converts and processes images of two-dimensional codes such as AR markers affixed to the switchboard to decode identification information for distinguishing it from other jack boards, a socket mark display position determination unit 34 that determines the relative position of the socket where the connection work is performed with respect to the reference frame based on the decoded information and reads a mark image of the socket from the memory unit 25, and an image synthesis processing unit 35 that generates an image in which the read socket mark image is superimposed on the determined position of the image captured by the video camera 21 and displays it on the transparent display unit 24 on the front of the wearable glasses.

[0025] Next, an example of a specific procedure for performing wiring connection work with support from the wiring connection work support system of this embodiment will be described using the flowchart in Figure 3. In the following description, it is assumed that a plurality of jack plates are attached to the distribution board to be worked on, and that a sticker with a printed two-dimensional code containing identification information for the distribution board is affixed to a predetermined position on the distribution board. It is also assumed that a storage device of a work support PC, which serves as a terminal device installed at a location remote from the site where the distribution board is located, stores, in list form, information indicating the type of jack plate provided on each of a plurality of distribution boards, including the distribution board, position information for each jack plate on the distribution board, and relative position information for the outlets on each jack plate to which wiring should be connected.

[0026] When the worker performing the wiring connection arrives at the site where the distribution board to be worked on is located, puts on the wearable glasses 20 on his head and turns on the power switch, power is supplied to the video camera 21 and filming begins, and the wearable glasses 20 transmits the captured video images to a work support PC located in a remote location (step S11).

[0027] Meanwhile, the work support PC, which has received the video image transmitted from the wearable glasses 20, displays the received video image of the switchboard on its monitor (step S21). Then, a list of jack boards arranged on the switchboard in the storage device is displayed on the monitor, and when the operator (work support person) selects the jack to be worked on and the outlet to which the wiring connection work will be performed from the list displayed on the monitor, the work support PC transmits to the wearable glasses 20 the identification information of the jack board, its position information on the switchboard, and relative position information (position with respect to the reference marker) of the outlet to which the wiring connection work will be performed (step S22). At this time, the work support PC may also transmit information about the cable to be connected to the selected outlet (for example, information such as color or a number written on a tag attached to the cable).

[0028] Then, when the switchboard is within the field of view and the switchboard is photographed, the wearable glasses 20, which have received the identification information and position information of the jack board, decode the two-dimensional code reflected in the video image, obtain position information of the jack board to be worked on based on the two-dimensional code (sticker) on the switchboard, and generate a mark (image serving as a landmark) indicating the position of the jack board to be worked on based on the obtained position information, which is displayed on the display unit on the front (step S12).When a worker who sees this video approaches the jack board to be worked on, an enlarged image of the jack board is displayed on the display unit.

[0029] The wearable glasses 20 receive the relative position information of the outlets sent from the work support PC, recognize the reference marker, calculate the position of the selected outlet, and display a target mark indicating the outlet on the display unit (step S13). After that, when the worker sees this image and inserts the end of the cable into the outlet where the target mark is displayed, the image of the work being done is sent to the work support PC (step S14). On the work support PC side, after checking the received video to confirm that the plugging work is complete, it determines whether there is a next outlet to plug into (step S23), and if there is a next outlet and that outlet is selected, it returns to step S22 and transmits relative position information of the next selected outlet to the wearable glasses 20. If there is no next outlet, that is, if the work of connecting cables to all the necessary outlets for the jack board to be worked on is completed, it returns to step S22 and transmits the identification information and position information of the next jack board to be worked on to the wearable glasses 20, and repeats the above process.

[0030] The wiring connection work support system of this embodiment, which can execute the process according to the above procedure, allows on-site workers to connect wiring cables to jack boards by providing appropriate instructions from a work support PC located away from the site where the jack board is installed, thereby improving work efficiency. Furthermore, since the target mark position is specified using the jack board frame itself as a reference marker rather than a 2D code sticker, a highly accurate target mark can be displayed superimposed on a video image on the display unit of the wearable glasses worn by the worker. As a result, cable connection work can be completed quickly and the wrong cable can be prevented from being connected to an incorrect outlet.

[0031] While the present invention has been described above as being limited to the above-described embodiments, various modifications and variations are possible. For example, in the above-described embodiments, the surface of the jack board frame is painted with paint of a color different from the color of the distribution cable to form a reference marker, but for jack boards with a small number of sockets, the surface of the jack board frame may be painted with paint to form a reference marker such as a reference marker.

[0032] In the above embodiment, the list of the position information of the jack board on the control panel and the work content, and the list of the relative position information of each outlet with respect to the reference marker on the jack board are stored in the storage unit of the work support PC, but the relative position information of each outlet with respect to the reference marker may be stored in the storage unit of the wearable glasses. Also, the identification information of the jack board and the identification information of the control panel may be converted into a barcode and displayed instead of an AR marker. [Explanation of symbols]

[0033] 10 Jack board 11 Jack Section 12 Outlet 13 Circuit board 15 Fixing screws 20 Wearable Glasses 21 Video camera 22 Radio communication device 23 Data processing unit (image processing means) 24 Transmissive display unit (display) 25 Memory section

Claims

1. A wiring connection work assistance system comprising: an imaging means, a wireless communication means, a transmission type display device, an image processing means having a function of image processing the image acquired by the imaging means, and a head-mounted display device having a storage means; and a terminal device capable of transmitting data to the head-mounted display device, the wiring connection work assistance system assisting in the work of connecting ends of wiring to a terminal block having a plurality of sockets, the storage means of the head-mounted display device or the storage unit of the terminal device stores relative position information of each socket with respect to a reference marker provided on a surface of the terminal block and having at least a frame shape surrounding the plurality of sockets; The image processing means a means for recognizing the reference marker based on the image acquired by the imaging means; and image synthesis means for acquiring relative position information of the socket indicated by the terminal device from a memory means of the head-mounted display device or a memory unit of the terminal device, and for superimposing an image of a target mark on the position of the socket to be worked on in the image based on the acquired relative position information and the recognized reference marker.

2. 2. The wire connection work support system according to claim 1, wherein the reference marker is colored in a color different from the background color of the terminal block and the color of the wire to be connected.

3. The plurality of outlets are arranged in a matrix, 3. The wiring connection work support system according to claim 1, wherein the reference markers are formed in a "T" shape.

4. The terminal block is disposed on one control panel together with a plurality of other terminal blocks, and a two-dimensional code including identification information of the control panel is attached to the control panel; the image processing means includes code decryption means for decrypting the two-dimensional code included in the image, The wiring connection work support system according to any one of claims 1 to 3, characterized in that the image synthesis means is configured to receive position information of the terminal block to be worked on from the terminal device, and based on the position information, to superimpose an image serving as a landmark on the position of the terminal block to be worked on in the image and display it.

Images