Processing system, processing method, and processing program

Abstract

To smoothly support progress of work performed by a worker.SOLUTION: A processing system 100 comprises: an instruction device 50 which instructs a worker's work target area; an imaging device 20 which captures the worker's periphery; an irradiating device 10; a communication device 30 which transmits image data captured by the imaging device 20 to a processing device; and the processing device 40 which communicates with the communication device 30 and the instruction device 50. The processing device 40, based on the image data captured by the imaging device 20, compares an irradiated area irradiated by the irradiating device 10 with the work target area, corrects a position of the irradiated area for the position of the work target area, and transmits instruction information for irradiating the corrected position to the communication device 30. The communication device 30 controls irradiation processing of the irradiating device according to the instruction information transmitted from an instruction unit.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a processing system, a processing method, and a processing program. [Background technology]

[0002] In recent years, AR glasses that are worn on a user's head like regular glasses have been used as HMDs (Head Mounted Displays) using Augmented Reality (AR) technology. For example, the AR glasses worn by a user can display and output information that assists the progress of work, thereby supporting the progress of work from a remote location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-185235 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the information displayed on the AR glasses was small and difficult to read, making it difficult to carry out work smoothly.

[0005] The present invention has been made in consideration of the above, and has an object to provide a processing system, a processing method, and a processing program that can smoothly support a worker in progressing with work. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the processing system of the present invention is a processing device having an instruction device that indicates a work target area of ​​a worker, an imaging device that images the surroundings of the worker, an irradiation device, a communication device that transmits image data captured by the imaging device to a processing device, and the processing device that communicates with the communication device and the instruction device, wherein the processing device has a first acquisition unit that acquires image data captured by the imaging device, a second acquisition unit that acquires the work target area indicated by the instruction device, an instruction unit that transmits instruction information to the communication device for controlling irradiation of the work target area by the irradiation device, and a correction unit that compares the irradiation area irradiated by the irradiation device and the work target area based on the image data acquired by the first acquisition unit, and corrects the position of the irradiation area to the position of the work target area, and the instruction unit transmits instruction information to the communication device for irradiating the position corrected by the correction unit, and the communication device controls the irradiation process of the irradiation device according to the instruction information transmitted from the instruction unit. Effect of the Invention

[0007] According to the present invention, it is possible to smoothly assist a worker in progressing with work. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of a processing system according to an embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an environment in which the processing system according to the embodiment is applied. [Figure 4] FIG. 4 is a diagram illustrating control of the irradiation area by the processing system according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating a configuration of a communication device. [Figure 6] FIG. 6 is a diagram showing the configuration of the processing device. [Figure 7]FIG. 7 is a diagram showing an example of irradiation by the irradiation device. [Figure 8] FIG. 8 is a diagram showing an example of irradiation by the irradiation device. [Figure 9] FIG. 9 is a diagram showing an example of irradiation by the irradiation device. [Figure 10] FIG. 10 is a diagram illustrating a computer that executes a program. [Figure 11] FIG. 11 is a diagram showing an example of irradiation by the irradiation device. [Figure 12] FIG. 12 is a diagram showing an example of irradiation by the irradiation device. [Figure 13] FIG. 13 is a diagram showing an example of irradiation by the irradiation device. [Figure 14] FIG. 14 is a diagram showing an example of irradiation by the irradiation device. [Figure 15] FIG. 15 is a diagram illustrating an example of a computer in which a communication device, a processing device, and an instruction device are realized by executing a program. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of a processing system, a processing method, and a processing program according to the present application will be described in detail with reference to the drawings. Note that the processing system, the processing method, and the processing program according to the present application are not limited to the embodiments.

[0010] In the following embodiments, the processing flow of a processing system, a processing method, and a processing program according to the embodiments will be described in order, and finally, the effects of the embodiments will be described.

[0011] [Embodiment Mode] First, an embodiment of the present invention will be described. The embodiment is a processing system that supports the following operations.

[0012] An instructor who remotely instructs a worker remotely instructs the worker on a work target area. In the processing system according to the embodiment, an irradiation device held by the worker illuminates the work target area, and the worker performs the instructed work on the components in the illuminated work target area. When the work target area instructed by the instructor is misaligned with the area illuminated by the irradiation device, the processing system according to the embodiment corrects the illumination area by performing image processing, so that the work target area instructed by the instructor matches the area illuminated by the illumination device. In this way, the processing device according to the embodiment provides an environment in which the worker can easily work.

[0013] Fig. 1 and Fig. 2 are diagrams for explaining the configuration of a processing system according to an embodiment. Fig. 3 is a diagram for explaining an environment to which a processing system according to an embodiment is applied. Fig. 4 is a diagram for explaining control of an irradiation area by a processing system according to an embodiment.

[0014] As shown in Figures 1 and 2, the processing system 100 of the embodiment performs a process of correctly illuminating the work target area as work support when a worker U1 at an on-site performs work on components, etc. in the work target area instructed by a supervisor U2 at a remote location.

[0015] The processing system 100 has an irradiation device 10, an imaging device 20, and a communication device 30 as devices on the worker U1 side. The processing system 100 has an instruction device 50 used by the instructor U2 as a device on the instructor U2 side. The processing system 100 has a processing device 40 that communicates with the communication device 30 and the instruction device 50. The communication device 30, the processing device 40, and the instruction device 50 can each communicate with the devices connected thereto via a network.

[0016] The irradiation device 10 performs irradiation under the control of the communication device 30. The irradiation device 10 is, for example, a pointer having a laser pointer and a two-axis motor that adjusts the irradiation angle of the laser pointer. The pointer may be capable of blinking, or may irradiate light of two or more colors. The irradiation device 10 is a small projector. A projector can irradiate an image. For this reason, the irradiation device 10 can irradiate an image in which a part of an irradiation area is a different color or brightness from the other areas, as well as an image including text, or an image in which only a predetermined area appears to blink.

[0017] The irradiation device 10 is attached to, for example, a helmet worn by the worker U1 on the head so as to irradiate an area L0 in the forward direction of the worker U1 as shown in Fig. 3. Since the irradiation device 10 is only required to be capable of irradiating the forward direction of the worker U1, it may be attached to a jacket, a belt, a work bag, etc. of the worker, not limited to a helmet, and may be fixedly disposed in the vicinity of the worker U1.

[0018] The imaging device 20 is a small camera that captures an image of the surroundings of the worker U1. The imaging device 20 is attached to, for example, a helmet worn by the worker U1 on his / her head. The imaging device 20 may be installed so as to capture an image of the area that is actually irradiated by the irradiation device 10.

[0019] The communication device 30 communicates with the irradiation device 10, the imaging device 20, and the processing device 40. The communication device 30 is a device carried by the worker U1, such as a PC, a tablet, or a smartphone. The communication device 30 may have a position detection function, an image recognition function, and a voice recognition function. The communication device 30 receives image data captured by the imaging device 20 from the imaging device 20 and transmits it to the processing device 40. The image data captured by the imaging device 20 is displayed on the screen of the instruction device 50 via the processing device 40. The communication device 30 controls the irradiation process of the irradiation device 10 according to the instruction information transmitted from the processing device 40.

[0020] The instruction device 50 is, for example, a device used by the instructor U2, such as a PC, a tablet, or a smartphone. The instruction device 50 generates target area instruction information indicating the work target area R1 (FIGS. 1 and 3) of the worker U1 in response to an input operation by the instructor U2 to the instruction device 50. When the instructor U2 specifies the work target area R1 in the image displayed on the screen (image captured by the imaging device 20) using an input device or the like, the instruction device 50 generates target area instruction information indicating that the work target area R1 is the work target area of ​​the worker U1. Note that when the instructor U2 specifies the work target area by voice, the instruction device 50 uses voice recognition and object recognition to determine the work target area R1 in the image displayed on the screen (image captured by the imaging device 20).

[0021] The processing device 40 is, for example, a server device. The processing device 40 compares the work target area R1 instructed by the instructor U2 with the area L0 irradiated by the irradiation device 10 based on the image data captured by the imaging device 20. When the work target area R1 and the area L0 actually irradiated by the irradiation device 10 are misaligned ((1) in FIG. 4), the processing device 40 corrects the area L0 irradiated by the irradiation device 10 and transmits instruction information to the communication device 30 to irradiate the corrected position.

[0022] The communication device 30 controls the irradiation process of the irradiation device 10 according to the instruction information transmitted from the processing device 40. By performing such a process, the processing system 100 matches the work target area R1 instructed by the instructor U2 with the area L1 irradiated by the irradiation device 10 ((2) in FIG. 4), providing an environment in which the worker U1 can easily work.

[0023] In the processing system 100, the imaging process by the imaging device 20, the image data transmission process by the communication device 30, the irradiation position correction process and the instruction information transmission process in the processing device 40, and the irradiation control process of the irradiation device 10 by the communication device 30 are executed in a short cycle (for example, 0.5 seconds). As a result, in the processing system 100, the position correction of the area L1 irradiated by the irradiation device 10 to the work target area R1 is performed almost in real time.

[0024] [Communication Device] Next, a description will be given of the communication device 30. Fig. 5 is a diagram showing the configuration of the communication device 30. The communication device 30 has a communication unit 31, a storage unit 32, and a control unit 33.

[0025] The communication unit 31 communicates with other devices wirelessly or via wires. The communication unit 31 is a communication interface that transmits and receives various information to and from other devices connected via a network or the like. The communication unit 31 is realized by a NIC (Network Interface Card) or the like, and communicates between other devices and a control unit 33 (described later) via electric communication lines such as a LAN (Local Area Network) or the Internet.

[0026] The storage unit 32 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or an optical disk. The storage unit 32 may be a semiconductor memory capable of rewriting data such as a random access memory (RAM), a flash memory, or a non-volatile static random access memory (NVSRAM). The storage unit 32 stores an operating system (OS) and various programs executed by the communication device 30. Furthermore, the storage unit 32 stores various information used in the execution of the programs. The storage unit 32 stores, for example, image data captured by the imaging device 20 and instruction information for the irradiation device 10 transmitted from the processing device 40.

[0027] The control unit 33 controls the entire communication device 30. The control unit 33 is, for example, an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 33 also has an internal memory for storing programs that define various processing procedures and control data, and executes each process using the internal memory. The control unit 33 also functions as various processing units by the operation of various programs. The control unit 33 has an imaging control unit 331 and an irradiation control unit 332.

[0028] The imaging control unit 331 controls the imaging process of the imaging device 20. The imaging control unit 331 causes the imaging device 20 to start the imaging process, for example, in accordance with the timing of the worker U1 starting work and entering the workplace. The imaging control unit 331 transmits image data captured by the imaging device 20 to the processing device 40 via the communication unit 31.

[0029] The illumination control unit 332 controls the illumination process of the illumination device 10. The illumination control unit 332 controls the illumination process of the illumination device 10 according to the instruction information transmitted from the processing device 40. For example, when the illumination device 10 is a pointer, the illumination control unit 332 causes the illumination device 10 to perform illumination while driving a two-axis motor of the pointer to change the illumination area. In addition, when the illumination device 10 is a projector, the illumination control unit 332 causes the illumination device 10 to illuminate an image instructed in the instruction information.

[0030] [Processing device] Next, a description will be given of the processing device 40. Fig. 6 is a diagram showing the configuration of the processing device 40. The processing device 40 has a communication unit 41, a storage unit 42, and a control unit 43.

[0031] The communication unit 41 communicates with other devices wirelessly or via wires. The communication unit 41 is a communication interface that transmits and receives various information to and from other devices connected via a network or the like. The communication unit 41 is realized by a NIC (Network Interface Card) or the like, and communicates between other devices and a control unit 43 (described later) via electric communication lines such as a LAN (Local Area Network) or the Internet.

[0032] The storage unit 42 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or an optical disk. The storage unit 42 may be a semiconductor memory in which data can be rewritten, such as a random access memory (RAM), a flash memory, or a non-volatile static random access memory (NVSRAM). The storage unit 42 stores an operating system (OS) and various programs executed by the communication device 30. Furthermore, the storage unit 42 stores various information used in the execution of the programs. The storage unit 42 has a map 421, machine data 422, sensor data 423, a schedule 424, and image data 425.

[0033] The map 421 is map data of a building (factory, inspection center, etc.) or site where the worker U1 works. The map 421 shows the layout position of each device, electrical wiring, communication wiring, various components, etc. in the building or site, and may include position information in the height direction in addition to the planar direction.

[0034] The machine data 422 includes identification information of devices installed in a building or on a site, the processing content performed by the device, processing history, maintenance history, as well as location information of the device's components (including operating components such as buttons, outlets, and doors, and installed components).

[0035] The sensor data 423 is collected from various sensors installed in a building or on a premises. The sensor data 423 includes detected environmental data such as temperature, humidity, flow rate, and air volume, as well as detected data on the communication volume, current, and voltage of various cables.

[0036] The schedule 424 is, for example, a timeline of the processes that each worker performs in a predetermined period of time. The schedule is set for each worker, and corresponds to the work period, the work location, the device to be used, and the work content.

[0037] The image data 425 is a group of image data of the surroundings of the worker captured by the imaging device 20.

[0038] The control unit 43 controls the entire communication device 30. The control unit 43 is, for example, an electronic circuit such as a central processing unit (CPU) or a micro processing unit (MPU), or an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 43 also has an internal memory for storing programs that define various processing procedures and control data, and executes each process using the internal memory. The control unit 43 also functions as various processing units by the operation of various programs. The control unit 43 has an image data acquisition unit 431 (first acquisition unit), a target area acquisition unit 432 (second acquisition unit), an irradiation instruction unit 433 (instruction unit), and an irradiation position correction unit 434 (correction unit).

[0039] The image data acquisition unit 431 receives image data transmitted from the communication device 30 and acquires image data of the surroundings of the worker captured by the imaging device 20.

[0040] The target area acquisition unit 432 acquires the work target area designated by the instruction device 50 based on the target area instruction information transmitted from the instruction device 50 .

[0041] The irradiation instruction unit 433 transmits to the communication device 30 target area instruction information for controlling the irradiation of the work target area by the irradiation device 10. First, when the irradiation instruction unit 433 acquires the work target area instructed by the instruction device 50, it generates instruction information for controlling the irradiation device 10 to irradiate the work target area and transmits it to the communication device 30.

[0042] When the irradiation device 10 is a pointer, the irradiation instruction unit 433 transmits to the communication device 30 instruction information including drive control information for the two-axis motor and the irradiation light and irradiation timing of the laser pointer. When the irradiation device 10 is a projector, the irradiation instruction unit 433 transmits to the communication device 30 instruction information including an image in which the work target area is white and the other areas are black, and the irradiation timing. Note that the color of the work target area is an example, and may be a color other than white.

[0043] Based on the image data acquired by the image data acquisition unit 431, the irradiation position correction unit 434 compares the irradiation area irradiated by the irradiation device 10 with the work target area, and corrects the position of the irradiation area to the position of the work target area.

[0044] The irradiation instruction unit 433 transmits instruction information for causing the irradiation device 10 to irradiate the position corrected by the irradiation position correction unit 434 to the communication device 30 via the communication unit 41. As a result, the communication device 30 controls the irradiation process of the irradiation device 10 according to the instruction information transmitted from the irradiation instruction unit 433.

[0045] [Irradiation example] 7 to 9 are diagrams showing examples of illumination by the illumination device 10. For example, as shown in Fig. 7, the illumination device 10 illuminates a work target area L11 in which cables to be worked on are arranged in a server rack, according to the control of the communication device 30. Also, as shown in Fig. 8, the illumination device 10 illuminates an area L12 in which buttons to be operated are arranged in a machine to be worked on, according to the control of the communication device 30.

[0046] When the projection device 10 is a laser pointer, the projection device 10 adjusts the projection angle of the laser pointer by driving a two-axis motor under the control of the communication device 30 to project the work target area L11. When the projection device 10 is a projector, the projection device 10 projects an image in which the work target area L11 is white and other areas are black.

[0047] Furthermore, in the case where the projection device 10 is a projector capable of projecting an image including text, as shown in FIG. 9, for example, the color of the work area L11 is changed from that of other areas, and an image including text T11 indicating the work content, "unplug the cable," is projected onto the top of the work area L11.

[0048] The text T11 is not limited to being displayed above the work area L11, but may be displayed in the vicinity of the work area L11. The text T11 may also be displayed so as to be connected to an arrow image pointing to the work area L11. The worker U1 can perform work while visually checking the text T11, which can improve work performance. When the text irradiation area is not flat, the text will be deformed if it is irradiated as is, so the processing device 40 may deform the image so as to correct the deformation of the text by image processing, and cause the projection device 10 to irradiate the image.

[0049] In this case, in the processing device 40, the irradiation instruction unit 433 refers to the machine data, the sensor data, and the process chart to determine the processing content of the worker, and creates image data including the text T11. Specifically, in the processing device 40, the irradiation instruction unit 433 creates image data in which the text T11 is placed on the work target area L11, the color of which is different from that of other areas. Then, in the processing device 40, the irradiation instruction unit 433 transmits to the communication device 30, together with the created image data, instruction information instructing the irradiation of the image, and causes the irradiation device 10 to irradiate the transmitted image data.

[0050] The text may be text indicating a caution in the work target area L11. The text may indicate sensor data or machine data related to a machine or member located in the work target area.

[0051] [Processing Procedure] FIG. 10 is a sequence diagram illustrating a processing procedure according to the embodiment.

[0052] As shown in FIG. 10, the imaging device 20 starts capturing an image of the surroundings of the worker U1 (step S1), and transmits the image data to the processing device 40 via the communication device 30 (steps S2 and S3).

[0053] The processing device 40 transmits image display control information for displaying the image data transmitted from the imaging device 20 on the screen of the instruction device 50 (step S4). The instruction device 50 displays an image on the screen according to the image display control data (step S5). When the processing device 40 receives image data transmitted from the communication device 30, it repeats a process of updating the image to be displayed on the screen of the instruction device 50 to the newly received image data, thereby causing the image captured by the imaging device 20 to be displayed on the screen of the instruction device 50 in real time.

[0054] The instruction device 50 generates instruction information indicating a work target area of ​​the worker U1 in response to an input operation by the instructor U2 (step S6), and transmits the target area instruction information to the processing device 40 (step S7).

[0055] Based on the target area instruction information transmitted from the instruction device 50, the processing device 40 acquires the work target area indicated by the instruction device 50, and transmits to the communication device 30 the target area instruction information that controls the irradiation of the irradiation device 10 to the work target area (steps S8, S9).

[0056] The communication device 30 controls the irradiation process of the irradiation device 10 in accordance with the instruction information transmitted from the irradiation instruction unit 433 (step S10), and causes the irradiation device 10 to irradiate the work target area (step S11).

[0057] The imaging device 20 transmits image data obtained by capturing an image of the surroundings of the worker U1 to the processing device 40 via the communication device 30 (steps S12 to S14).

[0058] Based on the image data transmitted from the communication device 30, the processing device 40 compares the irradiation area irradiated by the irradiation device 10 with the work target area instructed by the instructing device 50, and corrects the position of the irradiation area to the position of the work target area (step S15).

[0059] The processing device 40 transmits instruction information for irradiating the position corrected in step S15 to the communication device 30 via the communication unit 41 (step S16). The communication device 30 controls the irradiation process of the irradiation device 10 according to the instruction information (step S17), and causes the irradiation device 10 to irradiate the corrected position (step S18). The processes of steps S12 to S18 are repeatedly executed until the work on the work target area by the worker U1 is completed.

[0060] [Effects of the embodiment] In this manner, in the embodiment, when there is a misalignment between the work area specified by the instructor and the area irradiated by the irradiation device 10, the irradiation area is corrected, and the irradiation device 10 is controlled so that the work area specified by the instructor is accurately irradiated.

[0061] In particular, when the irradiation device 10 is attached to the helmet of the worker, the irradiation position of the irradiation device 10 also fluctuates according to the movement of the worker. Even in this case, in the embodiment, the irradiation area is corrected almost in real time, thereby realizing accurate irradiation of the work target area. Therefore, according to the embodiment, the worker can clearly recognize the work target area by accurate irradiation of the work target area by the irradiation device 10 even during work.

[0062] Therefore, in the embodiment, accurate irradiation of the work target area by the irradiation device 10 can provide an environment in which the worker can work easily, and can smoothly support the progress of the work by the worker.

[0063] [First Modification of the Embodiment] Furthermore, in the processing device 40, the irradiation instruction unit 433 may create, as instruction information to be transmitted to the communication device 30, instruction information for causing the irradiation device 10 to irradiate a contact-prohibited area for the worker U1 in addition to the work target area.

[0064] In this case, the processing device 40 instructs the touch-prohibited area to be illuminated under illumination conditions different from those for the work target area. The different illumination conditions include illumination with a different color light than that for the work target area and / or illumination at a different interval than that for the work target area. The communication device 30 controls the illumination process of the illumination device 10 according to this instruction information.

[0065] 11 is a diagram showing an example of illumination by the illumination device 10. For example, the illumination device 10 illuminates the contact-prohibited area L22 in a color (e.g., red) different from the color of the work target area L11. This allows the worker U1 to recognize the contact-prohibited area L22, and the worker U1 can perform work in the work target area L11 while paying attention not to contact the contact-prohibited area L22.

[0066] The irradiation instruction unit 433 identifies the contact prohibited area based on the machine data 422 and / or the sensor data 423. The irradiation instruction unit 433 may also identify the contact prohibited area based on instruction information indicating the contact prohibited area input from the instruction device 50.

[0067] When the projection device 10 is a projector, the projection instruction unit 433 may cause the projection device 10 to project an image including text indicating a caution in the touch-prohibited area L22. FIG. 12 is a diagram showing an example of projection by the projection device 10.

[0068] 12, the irradiation instruction unit 433 may cause the irradiation device 10 to irradiate an image including text T22 "communication rate: 30 Mbps" indicating the communication rate of the cable in the contact forbidden area L22, on the upper part of the contact forbidden area L22. At this time, the text T21 "communication rate: 0 Mbps" indicating the communication rate of the cable in the work target area L11 may be displayed so that the worker can recognize that there is no problem in unplugging the cable in the work target area L11.

[0069] In this way, by superimposing invisible information on the components in the work target area L11 and the contact prohibited area L22 in association with each other, the work performance of the worker U1 can be improved. The communication volume of each cable can be acquired from sensor data and machine data. The sensor data and machine data to be displayed may be any one or more of various data such as communication volume, current, voltage, temperature, flow rate, etc.

[0070] [Modification 2 of the embodiment] In addition, in the processing device 40, the irradiation instruction unit 433 may create instruction information to be transmitted to the communication device 30, such that, in addition to the work area where the worker U1 is currently working, the work area where the worker U1 is going to work next is illuminated.

[0071] In this case, the processing device 40 instructs the next work area to be illuminated under different illumination conditions than the work area currently being worked on by the worker U1. The different illumination conditions are a different color of light than the work area and / or illumination at a different interval than the work area. The communication device 30 controls the illumination process of the illumination device 10 according to this instruction information.

[0072] 13 is a diagram showing an example of illumination by the illumination device 10. For example, the illumination device 10 illuminates the work area L33 to be worked on next with a color (e.g., green) or brightness (e.g., darker than the work area L11) different from that of the work area L11. This allows the worker U1 to recognize the work area L33 to be worked on next, and allows the worker U1 to smoothly proceed with the work.

[0073] The irradiation instruction unit 433 may refer to the work schedule of the worker U1 and identify the work target area where the worker U1 will work next. The irradiation instruction unit 433 may also identify the work target area where the worker U1 will work next based on instruction information input from the instruction device 50 indicating the work target area where the worker U1 will work next.

[0074] In addition, when the projection device 10 is a projector, the projection instruction unit 433 may cause the projection device 10 to project an image including text indicating the work content and precautions in the work target area L33. FIG. 14 is a diagram showing an example of projection by the projection device 10.

[0075] As illustrated in FIG. 14, the irradiation instruction unit 433 may cause the irradiation device 10 to irradiate an image including text T11 indicating the work sequence and work content, such as “1. Unplug the cable,” at the bottom of the work target area L11, and text T33 indicating the work content, such as “2. Turn on,” at the top of the work target area L33.

[0076] At this time, the projection instruction unit 433 may project an image including text T32 indicating a caution such as "Do not unplug" for the cable in the contact forbidden area L22 onto the upper part of the contact forbidden area L22. Also, the projection instruction unit 433 may acquire the communication volume of the cable in each area from the sensor data and the machine data, and display an image indicating each of the acquired data (e.g., communication volume) in text, as in the first modification of the embodiment.

[0077] In addition, when the irradiation device 10 is a pointer, the processing device 40 may change the way of irradiating the pointer depending on the contents of the work instruction. For example, the processing device 40 may cause the irradiation device 10 to blink or change the spot diameter of the laser to irradiate.

[0078] For example, when the cable is to be unplugged, the processing device 40 causes the irradiation device 10 to blink twice in succession while irradiating the cable. When the cable is to be plugged in, the processing device 40 causes the irradiation device 10 to blink three times in succession while irradiating the place where the cable is to be plugged in. When the cable must not be unplugged, the processing device 40 causes the irradiation device 10 to blink at high speed while irradiating the cable.

[0079] Furthermore, when the projection device 10 is a projector, it can project images showing various kinds of information in the direction forward of the worker U1 in addition to the text related to the work area and the contact-prohibited area.

[0080] For example, the irradiation instruction unit 433 may cause the irradiation device 10 to emit an image showing the way from the position of the worker U1 to the position of the work target area. The irradiation instruction unit 433 may compare the position of the worker U1 detected by the position detection function of the communication device 30 with the position of the work target area determined by referring to the map 421 or the process chart 424, and obtain the way from the position of the worker U1 to the position of the work target area.

[0081] At this time, the processing device 40 may determine whether the work by the worker U1 has been completed and whether the work has been performed properly by analyzing the image data captured by the imaging device 20. If the work has not been performed properly, an alert may be output to the communication device 30 and / or the instruction device 50, and the processing device 40 may cause the illumination device 10 to illuminate text or a diagram showing the details of the work.

[0082] Furthermore, when a machine alarm is issued, the irradiation instruction unit 433 may cause the irradiation device 10 to emit an image showing a route from the position of the worker U1 to the machine for which the alarm is issued. The irradiation instruction unit 433 may acquire the position of the machine for which the alarm is issued by referring to the position of the worker U1 detected by the position detection function of the communication device 30, the sensor data 423, the map 421, and the process chart 424, and acquire the route from the position of the worker U1 to the machine for which the alarm is issued.

[0083] Furthermore, the irradiation instruction unit 433 may cause the irradiation device 10 to irradiate an image showing a manual in the form of text or figures while the worker U1 is working.

[0084] Furthermore, when the irradiation device 10 is a projector, in order to more easily and accurately identify the position when irradiating with the projector, markers may be provided and the position may be identified based on the markers. For example, a specific mark or two-dimensional code may be provided at the top left and bottom right of the rack to be worked on. The image including the mark or two-dimensional code captured by the imaging device 20 is processed by the processing device 40, and the position of the irradiation target is identified by recognizing the mark or two-dimensional code.

[0085] In addition, the processing device 40 has been described as an example in which an image including text is projected from the projection device 10, but if the worker is wearing earphones and a microphone, a voice message saying "Please unplug that cable" may be output from the earphones when the work area L11 is projected.

[0086] [System configuration of the embodiment] Each component of the communication device 30, the processing device 40, and the instruction device 50 is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of the functions of the communication device 30, the processing device 40, and the instruction device 50 is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed or integrated in any unit depending on various loads, usage conditions, etc.

[0087] Furthermore, all or any part of the processes performed in the communication device 30, the processing device 40, and the instruction device 50 may be realized by a CPU and a program analyzed and executed by the CPU. Furthermore, each process performed in the communication device 30, the processing device 40, and the instruction device 50 may be realized as hardware using wired logic.

[0088] Furthermore, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually. Alternatively, all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the process procedures, control procedures, specific names, and information including various data and parameters described above and shown in the drawings can be changed as appropriate unless otherwise specified.

[0089] [program] 15 is a diagram showing an example of a computer in which a communication device 30, a processing device 40, and an instruction device 50 are realized by executing a program. The computer 1000 has, for example, a memory 1010 and a CPU 1020. The computer 1000 also has a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. Each of these units is connected by a bus 1080.

[0090] The memory 1010 includes a ROM 1011 and a RAM 1012. The ROM 1011 stores a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to a display 1130, for example.

[0091] The hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, the programs that define the processes of the communication device 30, the processing device 40, and the instruction device 50 are implemented as program modules 1093 in which codes executable by the computer 1000 are written. The program modules 1093 are stored, for example, in the hard disk drive 1090. For example, the program modules 1093 for executing processes similar to the functional configurations in the communication device 30, the processing device 40, and the instruction device 50 are stored in the hard disk drive 1090. The hard disk drive 1090 may be replaced by an SSD (Solid State Drive).

[0092] Furthermore, setting data used in the processing of the above-described embodiment is stored as program data 1094, for example, in memory 1010 or hard disk drive 1090. Then, CPU 1020 reads out program module 1093 or program data 1094 stored in memory 1010 or hard disk drive 1090 into RAM 1012 as necessary, and executes the program.

[0093] Note that the program module 1093 and the program data 1094 are not limited to being stored in the hard disk drive 1090, but may be stored in, for example, a removable storage medium and read by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and the program data 1094 may be stored in another computer connected via a network (such as a local area network (LAN) or wide area network (WAN)). The program module 1093 and the program data 1094 may then be read by the CPU 1020 from the other computer via the network interface 1070.

[0094] Although the embodiment of the invention made by the present inventor has been described above, the present invention is not limited by the description and drawings which form a part of the disclosure of the present invention according to the present embodiment. In other words, other embodiments, examples, operation techniques, etc. made by those skilled in the art based on the present embodiment are all included in the scope of the present invention. [Explanation of symbols]

[0095] 10 Irradiation device 20 Imaging device 30 Communication Equipment 31,41 Communications Department 32,42 Storage part 33,43 Control section 40 Processing equipment 50 Indicating device 100 Processing Systems 331 Imaging control unit 332 Irradiation control unit 421 Map 422 Machine Data 423 Sensor Data 424 Process chart 425 Image data 431 Image data acquisition unit 432 Target Area Acquisition Unit 433 Irradiation instruction section 434 Irradiation position correction section

Claims

1. A processing system including an instruction device that indicates a work target area of ​​a worker, an imaging device that images an area around the worker, an irradiation device, a communication device that transmits image data captured by the imaging device to a processing device, and the processing device that communicates with the communication device and the instruction device, The processing device includes: A first acquisition unit that acquires image data captured by the imaging device; a second acquisition unit that acquires the work target area designated by the instruction device; An instruction unit that transmits instruction information to the communication device to control irradiation of the work target area by the irradiation device; A correction unit that compares an irradiation area irradiated by the irradiation device with the work target area based on the image data acquired by the first acquisition unit, and corrects the position of the irradiation area to the position of the work target area; having The instruction unit transmits to the communication device instruction information for causing the irradiation device to irradiate the position corrected by the correction unit, The processing system, wherein the communication device controls the irradiation process of the irradiation device in accordance with the instruction information transmitted from the instruction unit.

2. The processing system according to claim 1 , wherein the instruction unit transmits instruction information to the communication device for illuminating the area where the worker is prohibited from touching under illumination conditions different from illumination conditions for the area to be worked on.

3. 3. The processing system according to claim 2, wherein the instruction unit identifies the contact-prohibited area based on sensor data from a sensor and / or machine data from a machine installed in a workplace.

4. The processing system according to claim 1, characterized in that the instruction unit refers to the worker's schedule and transmits instruction information to the communication device for illuminating the work area on which the worker will next work under illumination conditions different from the illumination conditions for the work area on which the worker is currently working.

5. 5. The processing system according to claim 2 or 4, wherein the different illumination conditions include light of a different color from that of the work target area and / or illumination at different intervals from that of the work target area.

6. the projection device is a projector device that projects an image including text; The processing system according to claim 2 or 4, characterized in that the instruction unit transmits to the communication device instruction information instructing the projection of an image including text indicating work content or precautions in the area illuminated by the projection device, or an image including text indicating sensor data or machine data related to a machine or component located in the area.

7. A processing method executed by a processing device having an instruction device that indicates a work target area of ​​a worker, an imaging device that images an area around the worker, an irradiation device, a communication device that transmits image data captured by the imaging device to a processing device, and the processing device that communicates with the communication device and the instruction device, a step of the processing device acquiring image data captured by the imaging device; The processing device acquires the work target area designated by the designation device; A step in which the processing device transmits to the communication device instruction information for controlling the irradiation of the work target area by the irradiation device; The processing device compares an irradiation area irradiated by the irradiation device with the work target area based on the acquired image data, and corrects the position of the irradiation area to the position of the work target area; a step of transmitting, to the communication device, instruction information for causing the projection device to project the position corrected in the correction step by the processing device; a step of controlling, by the communication device, the irradiation process of the irradiation device according to the instruction information transmitted from the processing device; A processing method comprising the steps of:

8. A processing program for causing a computer to execute a processing method, A computer as a processing device acquiring image data captured by an imaging device that captures an image of the surroundings of the worker through communication with a communication device; acquiring a work target area indicated by an indicating device that indicates a work target area of ​​a worker; transmitting instruction information to the communication device for controlling irradiation of the work target area by an irradiation device; A step of comparing an irradiation area irradiated by the irradiation device with the work target area based on the acquired image data, and correcting the position of the irradiation area to the position of the work target area; transmitting, to the communication device, instruction information for causing the projection device to project the position corrected in the correction step; Run the command, Computers as communication devices a step of controlling the irradiation process of the irradiation device according to the instruction information transmitted in the transmitting step; A processing program characterized by executing the above.

Images