Work support system and work support method

Abstract

This system provides a work support system that enables training on operating rotating machinery without the need to prepare actual or simulated rotating machinery. [Solution] The work support system 1 is a system that supports a worker wearing a worker device equipped with a position and posture detection unit that detects the position and posture of the worker and a virtual object display unit that can display virtual objects. The work support system 1 includes a work data acquisition unit that acquires shape data showing the three-dimensional shape of a rotating machine and auxiliary data for assisting training on work on the rotating machine, a field of view data acquisition unit that acquires field of view data showing the worker's field of view based on the position and posture of the worker detected by the position and posture detection unit, and a visualization data generation unit that generates visualization data for displaying shape objects based on shape data and auxiliary objects based on auxiliary data using the virtual object display unit in the field of view shown by the field of view data.

Description

Technical Field

[0001] The present invention relates to a work support system and a work support method.

Background Art

[0002] Conventionally, in order to support workers in charge of installation, inspection, maintenance, etc. of rotating machinery, training of workers has been carried out using a training device. For example, Patent Document 1 discloses a training device including a training room in which a simulated object simulating an actual object is installed, and a control device that controls an air conditioner and an acoustic simulation device to control the inside of the training room to an actual environment.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the training device disclosed in Patent Document 1, it is necessary to prepare a simulated object simulating an actual object and a training room in which the simulated object is installed. However, since the content of the training varies depending on the type of rotating machinery to be trained and the content of the work, it has been difficult to prepare simulated objects and training rooms according to the content of various trainings.

[0005] In view of the above problems, an object of the present invention is to provide a work support system and a work support method capable of implementing training for work on rotating machinery without preparing an actual object or a simulated object of the rotating machinery.

Means for Solving the Problems

[0006] In order to achieve the above object, a work support system according to an aspect of the present invention is A work support system that assists a worker equipped with a worker device comprising: an input unit for receiving input operations from the worker; a position and posture detection unit for detecting the position and posture of the worker; and a virtual object display unit capable of displaying virtual objects in a virtual reality space, A work data acquisition unit acquires shape data representing the three-dimensional shape of a rotating machine and auxiliary data to assist in training for operations on the rotating machine as work data. A field of view data acquisition unit acquires field of view data indicating the worker's field of view in the virtual reality space based on the worker's position and posture detected by the position and posture detection unit. The system includes a visualization data generation unit that generates visualization data for displaying, using the virtual object display unit, a shape object based on the shape data acquired by the work data acquisition unit and an auxiliary object based on the auxiliary data acquired by the work data acquisition unit, as virtual objects in the field of view indicated by the field of view data acquired by the field of view data acquisition unit. [Effects of the Invention]

[0007] According to one aspect of the present invention, a work support system generates visualization data for displaying shape objects based on shape data and auxiliary objects based on auxiliary data as virtual objects in the view of the worker in the virtual reality space indicated by the view data, via a virtual object display unit. As a result, shape objects indicating the shape of the rotating machine and auxiliary objects for assisting training on the rotating machine are displayed as virtual objects in the virtual reality space based on the visualization data, so that the worker can view various parts of the rotating machine and the work on the rotating machine in the virtual reality space. The content of the work can be visualized in three dimensions. Therefore, training on operations involving rotating machinery can be conducted without the need to prepare actual or simulated rotating machinery.

[0008] Other issues, configurations, and effects will be clarified in the embodiments for carrying out the invention described later. [Brief explanation of the drawing]

[0009] [Figure 1] This is an overall configuration diagram showing an example of work support system 1. [Figure 2] This is a block diagram showing an example of worker device 2. [Figure 3] This is a block diagram showing an example of control device 3. [Figure 4] This is a hardware configuration diagram showing an example of the Computer 900. [Figure 5A] This flowchart shows an example of a work support method using work support system 1. [Figure 5B] This flowchart shows an example of a work support method using work support system 1. [Figure 6A] This figure shows a first display example in which a virtual object 11A is displayed in a virtual reality space. [Figure 6B] This figure shows a second display example in which a virtual object 11B is displayed in a virtual reality space. [Figure 6C] This figure shows a third display example in which the virtual object 11C is displayed in a virtual reality space. [Figure 6D] This figure shows a fourth display example in which a virtual object 11D is displayed in a virtual reality space. [Figure 6E] This figure shows a fifth display example in which a virtual object 11E is displayed in a virtual reality space. [Figure 6F] This figure shows a sixth display example in which the virtual object 11F is displayed in a virtual reality space. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments for implementing the present invention will be described with reference to the drawings. In the following, the scope necessary for explaining the present invention is schematically shown, and mainly the scope necessary for explaining the relevant part of the present invention will be described, and parts where the explanation is omitted are assumed to be based on known techniques.

[0011] (Configuration of the work support system 1) FIG. 1 is an overall configuration diagram showing an example of the work support system 1. The work support system 1 according to the present embodiment is a system that supports an operator U who is in charge of various operations such as installation, inspection, and maintenance of the pump 10 as a rotating machine, and is used to assist in training for various operations.

[0012] The work support system 1 mainly includes an operator device 2 and a management device 3 configured to be communicable with the operator device 2. The operator device 2 and the management device 3 are configured by, for example, general-purpose or dedicated computers (see FIG. 4 described later), and are configured to be able to transmit and receive various data to and from each other via the network 4. Note that the number of the operator device 2 and the management device 3 and the connection configuration of the network 4 are not limited to the example of FIG. 1 and may be appropriately changed.

[0013] The pump 10 is a device for transferring any fluid. The pump 10 is used, for example, as plant equipment installed in infrastructure facilities such as water supply and sewerage, water supply and drainage facilities installed in buildings, etc., and plants such as oil refining, power generation, manufacturing, and chemical processes.

[0014] The pump 10 is arbitrarily combined and configured with drive components such as a motor, an electric valve, and a solenoid valve, electrical components such as a sensor, an inverter, a converter, a control panel, and an operation display panel, and mechanical components such as an impeller, a rotating shaft, a bearing, a coupling, a joint, a seal, a casing, a pipe, and a manual valve. The operation of the pump 10 is controlled based on various operation parameters when the pump 10 is operating.

[0015] The operator device 2 is, for example, a portable device that is worn on the head or the like of the operator U. The operator device 2 is a device capable of realizing virtual reality (VR), and is composed of, for example, a wearable computer such as smart glasses or a head-mounted display. In the present embodiment, the case where the operator device 2 is configured by combining a grip controller of a gripping type with a head-mounted display will be mainly described.

[0016] When the operator device 2 is worn on the operator U, it acquires visual field data D1 indicating the visual field of the operator U in the virtual reality space, and transmits the visual field data D1 to the management device 3. When the operator device 2 receives an input operation of the operator U, it acquires input operation data D2 indicating the input operation, and transmits the input operation data D2 to the management device 3. Further, when the operator device 2 receives the visualization data D5 from the management device 3, it displays the virtual object 11 in the virtual reality space based on the visualization data D5, and receives the input operation of the operator U via the grip controller.

[0017] The management device 3 is a device that transmits and receives various types of information to and from the operator device 2. The management device 3 is composed of, for example, a server-type computer or a cloud-type computer. Note that the management device 3 may be composed of a stationary computer or a portable computer.

[0018] When the management device 3 receives the visual field data D1 and the input operation data D2 from the operator device 2, it generates visualization data D5 for displaying the virtual object 11 in the virtual reality space based on the visual field data D1 and the input operation data D2, and transmits the visualization data D5 to the operator device 2.

[0019] Network 4 is configured by wired communication, wireless communication, or a combination of wired and wireless communication according to any communication standard. Specifically, for example, it can utilize standardized communication networks such as the Internet, communication networks managed within a building such as a local network, or a combination of these communication networks. Typically, international standards are used as the communication standards for wireless communication. International standard communication methods such as IEEE 802.15.4, IEEE 802.15.1, IEEE 802.15.11a, 11b, 11g, 11n, 11ac, 11ad, ISO / IEC 14513-3-10, and IEEE 802.15.4g can be used. Furthermore, methods such as Bluetooth®, Bluetooth Low Energy, Wi-Fi, ZigBee®, Sub-GHz, EnOcean®, and LTE can also be used.

[0020] (Configuration of Operator Device 2) Figure 2 is a block diagram showing an example of the worker device 2. The worker device 2 comprises a terminal-side control unit 20, a terminal-side storage unit 21, a terminal-side communication unit 22, a terminal-side input unit 23, a position and orientation detection unit 24, and a virtual object display unit 25.

[0021] The terminal-side communication unit 22 functions as a communication interface that sends and receives various types of information to and from the management device 3 via the network 4. The terminal-side input unit 23 receives input operations from the worker U and is composed of, for example, a grip controller. The terminal-side input unit 23 may also receive input operations from the worker U via voice or gestures.

[0022] The position and orientation detection unit 24 detects the position and orientation of the worker U wearing the worker device 2. The position and orientation detection unit 24 is composed of, for example, an acceleration sensor or a gyroscope. The position and orientation detection unit 24 may further include a camera (image sensor) such as a CMOS sensor or CCD sensor having a predetermined resolution (number of pixels).

[0023] The virtual object display unit 25 displays virtual objects 11 placed in the virtual reality space according to the worker U's field of view, corresponding to the worker U's position and posture. The virtual object display unit 25 is positioned, for example, in front of one or both of the worker U's eyes when the worker U is wearing the worker device 2. In addition to displaying the virtual objects 11, various information may also be output as sound.

[0024] The terminal-side storage unit 21 stores various programs used in the operation of the operator device 2 (such as the operating system and the terminal-side control program 210), as well as various data.

[0025] The terminal-side control unit 20 operates according to the terminal-side control program 210, functioning as a field of view data acquisition unit 200, an operation data acquisition unit 201, and a virtual reality display processing unit 202.

[0026] The field of view data acquisition unit 200 acquires field of view data D1, which represents the field of view of worker U in the virtual reality space, based on the position and orientation of worker U detected by the position and orientation detection unit 24. The field of view data acquisition unit 200 then transmits the field of view data D1 to the management device 3. At that time, if the position and orientation of worker U detected by the position and orientation detection unit 24 change, the field of view data acquisition unit 200 acquires the updated field of view data D1 based on that change and transmits the updated field of view data D1 to the management device 3.

[0027] When the operation data acquisition unit 201 receives an input operation from the operator U via the terminal-side input unit 23, it acquires input operation data D2 indicating that input operation and transmits the input operation data D2 to the management device 3.

[0028] When the virtual reality display processing unit 202 receives visualization data D5 from the management device 3, it controls the virtual object display unit 25 based on the visualization data D5 to display the virtual object 11 on the virtual object display unit 25.

[0029] (Configuration of control device 3) Figure 3 is a block diagram showing an example of the management device 3. The management device 3 comprises a management control unit 30, a management storage unit 31, a management communication unit 32, a management input unit 33, and a management display unit 34.

[0030] The management-side communication unit 32 functions as a communication interface that sends and receives various types of information to and from the operator device 2 via the network 4. The management-side input unit 33 accepts input operations from the operator U. The management-side display unit 34 displays various types of information on a display screen. Note that the various types of information may also be output as sound, either in place of or in addition to the display screen.

[0031] The management-side storage unit 31 stores various programs used in the operation of the management device 3 (such as the operating system and the management-side control program 310), as well as various types of data (such as shape data D3 and auxiliary data D4).

[0032] Shape data D3 and auxiliary data D4 are data used when conducting training on the operation of the pump 10. Shape data D3 and auxiliary data D4 are, for example, pump The data is stored in association with different types and model names. Note that one auxiliary data D4 may be associated with multiple shape data D3s, or multiple auxiliary data D4s may be associated with one shape data D3.

[0033] Shape data D3 is data that shows the shape of the pump 10. Shape data D3 is created, for example, by the designer of the pump 10 and stored in the management-side storage unit 31. Shape data D3 stores, for example, the dimensions of each component that makes up the pump 10 and the assembled state when each component is assembled, in a data format such as CAD.

[0034] Auxiliary data D4 is data used to assist in training operations for the pump 10. Auxiliary data D4 is created by the designer of the pump 10 or by the manager who oversees various operations such as installation, inspection, and maintenance, and is stored in the management-side storage unit 31.

[0035] Auxiliary data D4 records the installation space where the pump 10 is installed, the work area to be worked on, the components of the pump 10 that are necessary for the work, the tools necessary for the work, and the details of the work. Furthermore, auxiliary data D4 is associated with multiple work processes when the work is performed according to a predetermined work sequence, and for each work process, it records, for example, the work area, the components to be worked on, the tools used, the details of the work, etc.

[0036] The installation space is the building or site where the pump 10 is installed, and may include not only above ground but also underground. The work area is the mounting position where the work target parts are attached, the removal position where the work target parts are removed, the work position where the work tools are used, etc., and there may be multiple work areas. In this case, the order of the work areas may be specified or not. The work target parts are, for example, assembly parts when assembling the pump 10, replacement parts when replacing some parts of the pump 10, etc. The work tools are, for example, tools, jigs, workbenches, step stools, etc., and may be general-purpose tools or specialized tools. The work content is text, diagrams, tables, etc. that explain the instructions and hints for the work.

[0037] Furthermore, the supplementary data may be recorded for each user level, corresponding to the user level when classifying the worker U who is the target of the training. User levels can be classified as, for example, beginner, intermediate, and advanced. Supplementary data associated with beginners may have a low training difficulty setting, while supplementary data associated with advanced users may have a high training difficulty setting.

[0038] The management control unit 30 operates according to the management control program 310, and functions as a work data acquisition unit 300 and a visualization data generation unit 301.

[0039] The work data acquisition unit 300 acquires shape data D3 and auxiliary data D4 as work data. For example, the work data acquisition unit 300 may acquire work data by referring to shape data D3 and auxiliary data D4 stored in the management-side storage unit 31, or it may acquire work data based on input operations entered via the management-side input unit 33.

[0040] The work data acquisition unit 300 may also acquire the modified shape data D3 by accepting changes to the shape data D3 through input operations input via the terminal-side input unit 23 or the management-side input unit 33. Furthermore, the work data acquisition unit 300 may acquire the modified auxiliary data D4 by accepting changes to the auxiliary data D4 through input operations input via the terminal-side input unit 23 or the management-side input unit 33. In addition, the work data acquisition unit 300 may acquire the auxiliary data associated with the user level by accepting the user level to be displayed through input operations input via the terminal-side input unit 23 or the management-side input unit 33. You may obtain D4.

[0041] The visualization data generation unit 301 generates visualization data D5 for displaying virtual objects 11, which are shape objects based on shape data D3 acquired by the work data acquisition unit 300 and auxiliary objects based on auxiliary data D4 acquired by the work data acquisition unit 300, in the field of view indicated by the field of view data D1 acquired by the field of view data acquisition unit 200, using the virtual object display unit 25. The visualization data D5 generated by the visualization data generation unit 301 is displayed on the virtual object display unit 25, allowing the worker U to visually perceive the virtual objects 11 in the virtual reality space. Details of the virtual objects 11 will be described later.

[0042] Furthermore, when the work data acquisition unit 300 receives a change to the shape data D3 or auxiliary data D4 and acquires the changed shape data D3 or auxiliary data D4, the visualization data generation unit 301 may generate visualization data D5 to display the shape object based on the changed shape data D3 and the auxiliary object based on the changed auxiliary data D4 as virtual objects 11. Also, when the work data acquisition unit 300 acquires auxiliary data D4 associated with the user level, the visualization data generation unit 301 may generate visualization data D5 to display the auxiliary object based on the auxiliary data associated with that user level as a virtual object 11.

[0043] (Hardware configuration of each device) Figure 4 is a hardware configuration diagram showing an example of computer 900. Each of the operator device 2 and the management device 3 is composed of a general-purpose or dedicated computer 900.

[0044] As shown in Figure 4, the computer 900 comprises, as its main components, a bus 910, a processor 912, memory 914, an input device 916, an output device 917, a display device 918, a storage device 920, a communication interface unit 922, an external device interface unit 924, an I / O device interface unit 926, and a media input / output unit 928. Note that the above components may be omitted as appropriate depending on the intended use of the computer 900.

[0045] The processor 912 consists of one or more arithmetic processing units (CPU (Central Processing Unit), MPU (Micro-Processing Unit), DSP (Digital Signal Processor), GPU (Graphics Processing Unit), NPU (Neural Processing Unit), etc.) and operates as a control unit (terminal-side control unit 20, management-side control unit 30) that oversees the entire computer 900. The memory 914 stores various data and programs 930 and consists of volatile memory (DRAM, SRAM, etc.) that functions as main memory, and non-volatile memory (ROM), flash memory, etc.

[0046] The input device 916 consists of, for example, a keyboard, mouse, numeric keypad, electronic pen, joystick, microphone, etc., and functions as an input unit (terminal-side input unit 23, management-side input unit 33). The output device 917 consists of, for example, a sound (voice) output device, a vibration device, etc., and functions as an output unit. The display device 918 consists of, for example, a liquid crystal display, an organic EL display, electronic paper, a projector, etc., and functions as an output unit (virtual object display unit 25, management-side display unit 34). The input device 916 and the display device 918 may be configured integrally, such as a touch panel display. The storage device 920 consists of, for example, an HDD, SSD, etc., and functions as a storage unit (terminal-side storage unit 21, management-side storage unit 31). The storage device 920 stores various data necessary for the execution of the operating system and program 930.

[0047] The communication I / F unit 922 is connected by wire or wireless to a network 940 such as the Internet or an intranet (which may be the same as network 4 in Figure 1) and functions as a communication unit (terminal-side communication unit 22, management-side communication unit 32) that sends and receives data with other computers according to a predetermined communication standard. The external device I / F unit 924 is connected by wire or wireless to external devices 950 such as cameras, printers, scanners, and reader / writers and functions as a communication unit that sends and receives data with external devices 950 according to a predetermined communication standard. The I / O device I / F unit 926 is connected to I / O devices 960 such as various sensors and actuators and functions as a communication unit that sends and receives various signals and data with the I / O devices 960, for example, detection signals from sensors and control signals to actuators. The media input / output unit 928 consists of, for example, a drive device such as a DVD drive or CD drive, a memory card slot, and a USB connector, and reads and writes data to media (non-temporary storage media) 970 such as DVDs, CDs, memory cards, and USB memory.

[0048] In the computer 900 having the above configuration, the processor 912 calls and executes the program 930 stored in the storage device 920 in the memory 914, and controls various parts of the computer 900 via the bus 910. The program 930 may also be stored in the memory 914 instead of the storage device 920. The program 930 may be recorded on the media 970 in an installable or executable file format and provided to the computer 900 via the media input / output unit 928. The program 930 may also be provided to the computer 900 by downloading it via the network 940 through the communication interface unit 922. Furthermore, the computer 900 may implement various functions realized by the processor 912 executing the program 930 using hardware such as an FPGA (Field-Programmable Gate Array) or ASIC (Application Specific Integrated Circuit).

[0049] Computer 900 is an electronic device of any form, consisting of, for example, a stationary computer or a portable computer. Computer 900 may be a client computer, a server computer, a cloud computer, or an embedded computer such as a control panel or controller (including microcontrollers, programmable logic controllers, and sequencers).

[0050] (Work support method) Figures 5A and 5B are flowcharts illustrating an example of a work support method by the work support system 1. Below, we will describe an example of the operation of the worker device 2 and the management device 3 when worker U, equipped with the worker device 2, is undergoing training for the installation of a vertical shaft type pump 10. In this case, it will be explained that the management-side storage unit 31 stores shape data D3 and auxiliary data D4, which represent the shape of the vertical shaft type pump 10 (an example of the pump 10), as initial data for the training target. The flowcharts shown in Figures 5A and 5B are executed when the worker device 2 receives an input operation from worker U, for example, instructing the installation of a vertical shaft type pump 10 as a training menu, and the position and orientation detection unit 24 starts detecting the position and orientation.

[0051] First, in step S100, the work data acquisition unit 300 of the management device 3 refers to the management-side storage unit 31 and acquires shape data D3 and auxiliary data D4 as work data.

[0052] Furthermore, in step S110, the field of view data acquisition unit 200 of the worker device 2 acquires field of view data D1 that shows the field of view of worker U in the virtual reality space, based on the position and orientation of worker U detected by the position and orientation detection unit 24. Then, the field of view data acquisition unit 200 The field of view data D1 is then transmitted to the management device 3.

[0053] Next, in step S120, when the visualization data generation unit 301 receives the field of view data D1 transmitted in step S110, it generates visualization data D5 for the virtual object display unit 25 to display as virtual objects 11 the shape objects based on the shape data D3 acquired in step S100 and the auxiliary objects based on the auxiliary data D4 acquired in step S100, for the field of view indicated by the field of view data D1, and transmits this data to the operator device 2.

[0054] Then, in step S130, when the virtual reality display processing unit 202 of the management device 3 receives the visualization data D5 transmitted in step S120, it displays the virtual object 11 based on the visualization data D5, thereby displaying the virtual object 11 in the virtual reality space.

[0055] Figure 6A shows a first example of displaying the virtual object 11A in a virtual reality space. Note that the virtual objects 11A to 11F shown in Figure 6A and Figures 6B to 6F described later are simplified representations of the shape data D3 and auxiliary data D4 for the sake of ease of explanation, and include parts that differ from the actual shape of the pump 10.

[0056] In Figure 6A, a shape object 12 and an auxiliary object 13 are shown as virtual objects 11A displayed in the virtual reality space.

[0057] The shape object 12 represents the three-dimensional shape of the pump 10, and in Figure 6A, the pump base portion 120 is shown as part of the components that make up the vertical shaft type pump 10.

[0058] The auxiliary object 13 is for training assistance, and in Figure 6A, it displays an installation space object 130 representing the installation space, a work process progress object 131A that can receive input operations to instruct the progress of the work process via the terminal-side input unit 23, and a controller object 132 representing the operation status of the terminal-side input unit 23.

[0059] The installation space object 130 visually represents a rectangular installation space and is displayed as an auxiliary object 13 that includes the above-ground space 130B and the underground space 130C, with the installation surface 130A, such as the floor or ground, as the boundary. In this case, the installation surface 130A and the underground space 130C are displayed in a semi-transparent state. The initial position 130D of the worker U is set on the installation surface 130A. Preferably, the initial position 130D is set to a height of about 1m, which is the line of sight of the worker U in the virtual reality space.

[0060] The work process progress object 131A is displayed, for example, on the wall surface of the ground space 130B as a button-type auxiliary object 13 that can accept input operations to instruct the start of training.

[0061] The controller object 132 is, for example, an auxiliary object 13 that mimics the shape of a grip controller. The controller object 132 is displayed in conjunction with the orientation of the grip controller, and the laser 132a corresponding to the orientation of the grip controller is displayed. Input operations for the work process progress object 131A are accepted, for example, when a predetermined button on the grip controller is pressed while the laser 132a is pointed at the virtual object 11 to be operated on.

[0062] Here, worker U, who has viewed Figure 6A, in the virtual reality space, for example, a shape object When the worker U changes their walking or posture to approach the pump base section 120, which is section 12, in step S200 shown in Figure 5A, the field of view data acquisition unit 200 acquires the changed field of view data D1 in response to the detection by the position and posture detection unit 24 that the position and posture of the worker U have changed, and transmits the changed field of view data D1 to the management device 3.

[0063] Next, in step S210, when the visualization data generation unit 301 receives the changed field of view data D1 transmitted in step S200, it generates visualization data D5 to display the shape object 12 based on the shape data D3 acquired in step S100 and the auxiliary object 13 based on the auxiliary data D4 acquired in step S100 as virtual objects 11 in the field of view indicated by the changed field of view data D1, and transmits it to the operator device 2.

[0064] Then, in step S220, when the virtual reality display processing unit 202 receives the visualization data D5 transmitted in step S210, it updates the virtual object 11 in the virtual reality space by displaying the virtual object 11 based on the visualization data D5.

[0065] Furthermore, when worker U, who has viewed Figure 6A, instructs, for example, the work process progress object 131A to start training in the virtual reality space, the operation data acquisition unit 201 acquires input operation data D2 indicating the input operation of worker U in step S300 shown in Figure 5B, and transmits the input operation data D2 to the management device 3.

[0066] Next, in step S310, when the visualization data generation unit 301 receives the input operation data D2 transmitted in step S300, it accepts the input operation of worker U indicated by the input operation data D2.

[0067] Next, in step S320, the work data acquisition unit 300 acquires the modified work data based on the input operation of worker U received in step S310. At this time, the work data acquisition unit 300 acquires at least one of the modified shape data D3 and the modified auxiliary data D4 as the modified work data.

[0068] Next, in step S330, the visualization data generation unit 301 generates visualization data D5 to display the shape object 12 based on the modified shape data D3 acquired in step S320 and the auxiliary object 13 based on the modified auxiliary data D4 acquired in step S320 as virtual objects 11 against the field of view indicated by the changed field of view data D1 transmitted in step S200, and transmits it to the operator device 2. Note that if the shape data D3 has not been changed as modified work data acquired in step S310, it is not necessary to update the shape object 12 based on the shape data D3, and if the auxiliary data D4 has not been changed, it is not necessary to update the auxiliary object 13 based on the auxiliary data D4.

[0069] Then, in step S340, when the virtual reality display processing unit 202 receives the visualization data D5 transmitted in step S330, it updates the virtual object 11 in the virtual reality space by displaying the virtual object 11 based on the visualization data D5.

[0070] Figure 6B shows a second display example in which the virtual object 11B is displayed in the virtual reality space. The updated virtual object 11B shown in Figure 6B is displayed in a different field of view than the virtual object 11A shown in Figure 6A, and also assists in the training in step 1.

[0071] The virtual object 11B shown in Figure 6B is the virtual object shown in Figure 6A, which is operated by worker U. In the virtual reality space where 11A is displayed, steps S200 to S220 are performed when approaching the pump base unit 120, and steps S300 to S340 are performed when the work process progress object 131A is instructed to start training, resulting in its display. In particular, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation for the work process progress object 131A, it updates the visualization data D5 to display the auxiliary object 13 based on the auxiliary data D4 associated with the work process to be performed in the next work sequence (procedure 1). As a result, the updated virtual object 11B (Figure 6B) is displayed.

[0072] In Figure 6B, auxiliary objects 13 based on auxiliary data D4 associated with the work process of step 1 to be displayed are shown, including a work process progress object 131B that can accept the progress of the work process, a work content object 133A that represents the work content of step 1, and work target location objects 134A to 134D that represent the work target locations of step 1.

[0073] The work process progress object 131B is displayed, for example, on the wall of the ground space 130B as a button-type auxiliary object 13 that can accept input operations to instruct the user to proceed to step 2. In this case, it is preferable that the work process progress object 131B be placed on a different wall from the work process progress object 131A in order to prevent erroneous operation. The work content object 133A is displayed as text representing the work content of step 1, for example, on the wall of the ground space 130B or at any other arbitrary location.

[0074] The work target object 134A to 134D is placed in the virtual reality space at a position corresponding to the work target, and is displayed as a button-type auxiliary object 13 that can receive input operations to specify the work target via the terminal-side input unit 23. In this embodiment, the work target object 134A to 134D is placed at four locations on the upper surface of the pump base 120 to be used for measuring the horizontality and checking the height of the pump base 120.

[0075] In the virtual reality space where the virtual object 11B shown in Figure 6B is displayed, the training in step 1 is performed when worker U performs an input operation on four work target objects 134A to 134D, for example, by pressing a predetermined button on the grip controller while the laser 132a is applied. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation on the work target objects 134A to 134D, it updates the visualization data D5 to change the display mode of the work target objects 134A to 134D. In Figure 6B, the display mode of the three work target objects 134A to 134C that received input operations has been changed from white to black. In addition to changing the color, the display mode may also be changed to, for example, a blinking state or to hidden. Furthermore, when an input operation on the work target objects 134A to 134D is received, a correct answer sound may be output.

[0076] Then, when input operations are received for the four work target object 134A to 134D, the training in step 1 is completed. Subsequently, when an input operation for the work process progress object 131B instructs the system to proceed to step 2, in steps S300 to S330, the visualization data generation unit 301 updates the visualization data D5 to display the auxiliary object 13 based on the auxiliary data D4 associated with the work process to be performed in step 2. As a result, the updated virtual object 11C (Figure 6C) is displayed.

[0077] Figure 6C shows a third display example in which the virtual object 11C is displayed in the virtual reality space. The updated virtual object 11C shown in Figure 6C assists in the training in step 2. It is.

[0078] In Figure 6C, auxiliary objects 13 based on auxiliary data D4 associated with the work process of step 2 to be displayed are shown, including a work process progress object 131C that can accept the progress of the work process, a work content object 133B that represents the work content of step 2, and work target part objects 135A and 135B that represent the parts that make up the pump 10 and are the work target parts necessary for the work.

[0079] The work process progress object 131C is displayed, for example, on the wall of the ground space 130B as a button-type auxiliary object 13 that can accept input operations to instruct the user to proceed to step 3. In this case, it is preferable that the work process progress object 131B be placed on a different wall from the work process progress object 131A in order to prevent erroneous operation. The work content object 133B is displayed as text representing the work content of step 2, for example, at an arbitrary location such as on the wall of the ground space 130B.

[0080] The work target component objects 135A and 135B are positioned away from the mounting position where the work target component is attached in the virtual reality space, and are displayed as auxiliary objects 13 that can receive input operations to specify or move the work target component via the terminal-side input unit 23. In this embodiment, the work target component object 135A is a shape object 12 corresponding to the lower part 121 of the pump, and the work target component object 135B is a shape object 12 corresponding to the discharge part 122 of the pump. Therefore, the work target component object 135A, as the lower part 121 of the pump, is an auxiliary object 13 associated with the work process in step 2.

[0081] In the virtual reality space where the virtual object 11C shown in Figure 6C is displayed, the training in step 2 is performed when worker U, as an input operation for the work target part object 135A, which is the lower part of the pump 121, presses a predetermined button on the grip controller while the laser 132a is applied to it, and moves it so that it is inserted into the inside of the pump base part 120. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation for the work target part object 135A, it updates the visualization data D5 to change the display manner of the work target part object 135A or move the display position of the work target part object 135A. In Figure 6C, the display position of the work target part object 135A that received the input operation has been moved to the normal mounting position of the lower part of the pump 121, but the display manner of the work target part object 135A may be changed. If the input operation for the work target part object 135A does not move it to the normal mounting position of the lower part of the pump 121, an incorrect sound may be output. Furthermore, when an input operation is received for the work target part object 135B (pump discharge section 122), an incorrect response sound may be output.

[0082] Then, as an input operation for the work target part object 135A, the pump lower part 121 is moved to the normal mounting position, completing the training in step 2. Subsequently, when an input operation for the work process progress object 131C instructs the system to proceed to step 3, in steps S300 to S330, the visualization data generation unit 301 updates the visualization data D5 to display the auxiliary object 13 based on the auxiliary data D4 associated with the work process performed in step 3. As a result, the updated virtual object 11D (Figure 6D) is displayed.

[0083] Figure 6D shows a fourth display example in which the virtual object 11D is displayed in the virtual reality space. The updated virtual object 11D shown in Figure 6D assists in the training in step 3.

[0084] In Figure 6D, auxiliary objects 13 based on auxiliary data D4 associated with the work process of step 3, which is the target of display, are shown, including a work process progress object 131D that can accept the progress of the work process, a work content object 133C that represents the work content of step 3, and a work target part object 135B that represents the work target part that is part of the pump 10 and is necessary for the work.

[0085] The work process progress object 131D is displayed, for example, on the wall of the ground space 130B as a button-type auxiliary object 13 that can accept input operations to instruct the user to proceed to step 4. In this case, it is preferable that the work process progress object 131D is placed on a different wall from the work process progress object 131C to prevent erroneous operation. The work content object 133C is displayed as text representing the work content of step 3, for example, at an arbitrary location such as the wall of the ground space 130B.

[0086] The work target part object 135B is positioned away from the mounting position where the work target part is attached in the virtual reality space, and is displayed as an auxiliary object 13 that can receive input operations to specify or move the work target part via the terminal-side input unit 23. In this embodiment, the work target part object 135B is a shape object 12 corresponding to the pump discharge unit 122. Therefore, the work target part object 135B as the pump discharge unit 122 is an auxiliary object 13 associated with the work process in step 3.

[0087] In the virtual reality space where the virtual object 11D shown in Figure 6D is displayed, the training in step 3 is performed when worker U, as an input operation for the work target part object 135B, which is the pump discharge unit 122, presses a predetermined button on the grip controller while the laser 132a is applied to it, for example, to move it to the upper part of the pump base unit 120. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation for the work target part object 135B, it updates the visualization data D5 to change the display mode of the work target part object 135B or move the display position of the work target part object 135B. In Figure 6D, the display position of the work target part object 135B that received the input operation has been moved to the normal mounting position of the pump discharge unit 122, but the display mode of the work target part object 135B may be changed. If the input operation for the work target part object 135B does not move it to the normal mounting position of the pump discharge unit 122, an incorrect sound may be output.

[0088] Then, as an input operation for the work target part object 135B, the pump discharge unit 122 is moved to its normal mounting position, completing the training in step 3. Subsequently, when an input operation for the work process progress object 131D instructs the system to proceed to step 4, in steps S300 to S330, the visualization data generation unit 301 updates the visualization data D5 to display the auxiliary object 13 based on the auxiliary data D4 associated with the work process performed in step 4. As a result, the updated virtual object 11E (Figure 6E) is displayed.

[0089] Figure 6E shows a fifth display example in which the virtual object 11E is displayed in the virtual reality space. The updated virtual object 11E shown in Figure 6E assists in the training in step 4.

[0090] In Figure 6E, the auxiliary object 13, based on the auxiliary data D4 associated with the work process of step 4 to be displayed, includes a work process progress object 131E that can accept the progress of the work process, a work content object 133D that represents the work content of step 4, and the work target area of ​​step 4. The diagram shows a work location object 134E representing the work area, and work tool objects 136A and 136B representing the work tools required for the work.

[0091] The work process progress object 131E is displayed on the wall of the ground space 130B, for example, as a button-type auxiliary object 13 capable of receiving input operations to instruct the user to proceed to step 5. In this case, it is preferable that the work process progress object 131E be placed on a different wall from the work process progress object 131D to prevent erroneous operation. The work content object 133D is displayed as text representing the work content of step 4, for example, at an arbitrary location such as the wall of the ground space 130B. The work target location object 134E is placed at a location corresponding to the work target location in the virtual reality space and is displayed as an auxiliary object 13 capable of receiving input operations to instruct the user to specify the work target location via the terminal-side input unit 23. In this embodiment, the work target location object 134E is the location where the horizontality of the bearing mounting surface is measured in the pump discharge section 122.

[0092] The work tool objects 136A and 136B are positioned away from the usage location where the work tool is used in the virtual reality space, and are displayed as auxiliary objects 13 that can receive input operations to specify or move the work tool via the terminal-side input unit 23. In this embodiment, work tool object 136A is a stepped work platform, and work tool object 136B is a spirit level.

[0093] In the virtual reality space where the virtual object 11E shown in Figure 6E is displayed, worker U performs an input operation on the work tool object 136A, which serves as a work step stool. For example, with the laser 132a shining on it, worker U presses a predetermined button on the grip controller to move it to the side of the pump discharge unit 122. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation on the work tool object 136A, it updates the visualization data D5 to change the display mode of the work tool object 136A or move the display position of the work tool object 136A. In Figure 6E, the display position of the work tool object 136A that received the input operation has been moved to the normal usage position of the work step stool, but the display mode of the work tool object 136A may also be changed. If the input operation on the work tool object 136A does not move it to the normal usage position of the work step stool, an incorrect sound may be output. Additionally, when an input operation is received for the working tool object 136B (level), an incorrect sound may be output.

[0094] Furthermore, the training in step 4 is performed when worker U climbs onto the work platform and presses a predetermined button on the grip controller while the laser 132a is pointed at the location where the horizontality of the bearing mounting surface is to be measured. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation for the work target object 134E corresponding to the work target area of ​​the pump discharge unit 122, it updates the visualization data D5 to change the display mode of the work target object 134E. In Figure 6E, the display mode of the work target object 134E that received the input operation has been changed from plain to hatched. In addition to changing the pattern, the display mode may also be changed to, for example, a change in color or a blinking state. Furthermore, when an input operation for the work target object 134E is received, a correct answer sound may be output.

[0095] Then, when input operations are received for the work tool object 136A and the work target object 134E, the training in step 4 is completed. Subsequently, when an input operation is received for the work process progress object 131D to instruct the system to proceed to step 5, in steps S300 to S330, the visualization data generation unit 301 displays an auxiliary object 13 based on the auxiliary data D4 associated with the work process to be performed in step 5. The visualization data D5 is updated accordingly. As a result, the updated virtual object 11F (Figure 6F) is displayed.

[0096] Figure 6F shows a sixth display example in which the virtual object 11F is displayed in the virtual reality space. The updated virtual object 11F shown in Figure 6F is intended to assist in the training in step 5.

[0097] In Figure 6F, auxiliary objects 13 based on auxiliary data D4 associated with the work process of step 5, which is the target of display, are shown: a work content object 133E representing the work content of step 5, and a work target location object 134F representing the work target location of step 5.

[0098] The work content object 133E is displayed as text representing the work content of step 5, for example, at an arbitrary location such as the wall surface of the ground space 130B. The work target location object 134F is placed in the virtual reality space at a location corresponding to the work target location and is displayed as an auxiliary object 13 that can receive input operations to specify the work target location via the terminal-side input unit 23. In this embodiment, the work target location object 134E is the location where the impeller lifting height of the pump discharge section 122 is measured.

[0099] In the virtual reality space where the virtual object 11F shown in Figure 6F is displayed, the training in step 5 is performed when worker U climbs onto a work platform and presses a predetermined button on the grip controller while the laser 132a is aimed at the location where the impeller lifting height is to be measured. At that time, in steps S300 to S330, when the visualization data generation unit 301 receives an input operation for the work target location object 134F corresponding to the work target location of the pump discharge unit 122, it updates the visualization data D5 to change the display mode of the work target location object 134F. In Figure 6F, the display mode of the work target location object 134F that received the input operation has been changed from a plain pattern to a hatched pattern. In addition to changing the pattern, the display mode may also be changed to, for example, a change in color or a blinking state. Furthermore, when an input operation for the work target location object 134F is received, a correct answer sound may be output.

[0100] Then, when an input operation is received for the work target object 134F, the training in step 5 is completed. In this embodiment, the completion of step 5 completes the series of training for the installation work of the pump 10.

[0101] As described above, the series of operations shown in Figures 5A and 5B are performed. Then, steps S200 to S220 are executed as needed in response to changes in the position and posture of worker U. Also, steps S300 to S340 are executed as needed in response to changes in work data due to input operations by worker U. As a result, the virtual objects 11 (11A to 11F) in the virtual reality space are updated as needed.

[0102] According to the work support system 1 and work support method of this embodiment, based on the visualization data D5 generated by the visualization data generation unit 301, a shape object 12 showing the shape of the pump 10 and an auxiliary object 13 for assisting training on working with the pump 10 are displayed as virtual objects 11A to 11F in the virtual reality space. As a result, the worker U can visually perceive each part of the pump 10 and the content of the work performed on the pump 10 in three dimensions in the virtual reality space. Therefore, training on working with the pump 10 can be performed without preparing a real or simulated pump 10.

[0103] In this case, auxiliary objects 13 include an installation space object 130, work process progress objects 131A-131E, a controller object 132, and a work content object. Objects 133A-133E, work area objects 134A-134F, work part objects 135A, 135B, and work tool objects 136A, 136B are combined to generate visualization data D5. This allows for training on various operations for the pump 10.

[0104] In particular, the work process progress objects 131A to 131E are configured to accept input operations that instruct the progress of the work process. When an input operation is accepted, an auxiliary object based on auxiliary data associated with the work process to be performed in the next work sequence is displayed. This allows for step-by-step and effective training for each work process. In addition, it is possible to incorporate game-like elements where missions are cleared sequentially.

[0105] Furthermore, the work target object 134A to 134F is positioned at a location corresponding to the work target and is configured to accept input operations that instruct the specification of the work target. When an input operation is accepted, the display mode is changed. This ensures that the worker U can reliably recognize the work target object that is the target of the work.

[0106] Furthermore, the work target part objects 135A and 135B are positioned away from the mounting position where the work target part is attached, and are configured to accept input operations to specify or move the work target part. When an input operation is accepted, the display mode is changed or the display position is moved. This ensures that the worker U can reliably recognize the work target part necessary for the work.

[0107] Furthermore, the work tool objects 136A and 136B are positioned away from the work tool's usage location and are configured to accept input operations to specify or move the work tool. When an input operation is received, the display mode is changed or the display position is moved. This ensures that the worker U can reliably recognize the work tools necessary for the task.

[0108] (Other embodiments) The present invention is not limited to the embodiments described above, and can be implemented with various modifications without departing from the spirit of the invention. All such modifications are included in the technical concept of the present invention.

[0109] In the above embodiment, the case where the rotating machine is a pump 10 was described as an example of a rotating machine, but the work support system 1 may also handle rotating machines other than the pump 10. Examples of rotating machines other than the pump 10 include, but are not limited to, compressors, blowers, turbines, motors, cylinders, etc.

[0110] In the above embodiment, the worker device 2 and the management device 3 were described as being composed of separate devices, but these two devices may be composed of a single device. For example, the work support system 1 may consist only of the worker device 2, provided that the worker device 2 also has the functions of the management device 3.

[0111] In the above embodiment, the case in which the work support system 1 operates according to the flowcharts shown in Figures 5A and 5B has been described, but the execution order of each step may be changed as appropriate, or some steps may be omitted. In the work support method shown in the flowchart, steps S100 and S320 correspond to the work data acquisition step, steps S110 and S200 correspond to the field of view data acquisition step, step S300 corresponds to the operation data acquisition step, steps S120, S210 and S330 correspond to the visualization data generation step, and steps S130, S220 and S340 correspond to the virtual reality display processing step. [Explanation of Symbols]

[0112] 1...Work support system, 2...Worker equipment, 3...Management equipment, 4...Network, 10... Pump (rotating machine), 11, 11A~11F... Virtual object 12... Shape object, 13... Auxiliary object, 20...Terminal-side control unit, 21...Terminal-side storage unit, 22...Terminal-side communication unit, 23...Terminal-side input unit, 24...Position and orientation detection unit, 25...Virtual object display unit, 30...Management control unit, 31...Management storage unit, 32...Management communication unit, 33...Management input unit, 34...Management display unit, 120...Pump base section, 121...Lower part of the pump, 122...Pump discharge section, 130... Installation space object, 131A~131E... Work process progress object, 132...Controller object, 133A~133E...Work content object, 134A~134F...Objects to be worked on, 135A, 135B...workable part object, 136A, 136B...Working tool objects, 200... Vision data acquisition unit, 201... Operation data acquisition unit 201, 202...Virtual reality display processing unit, 210...Terminal-side control program, 300...Work data acquisition unit, 301...Visualization data generation unit, 310...Management control program

Claims

1. A work support system that assists a worker equipped with a worker device comprising: an input unit for receiving input operations from the worker; a position and posture detection unit for detecting the position and posture of the worker; and a virtual object display unit capable of displaying virtual objects in a virtual reality space, A work data acquisition unit acquires shape data representing the three-dimensional shape of a rotating machine and auxiliary data to assist in training for operations on the rotating machine as work data. A field of view data acquisition unit acquires field of view data indicating the worker's field of view in the virtual reality space based on the worker's position and posture detected by the position and posture detection unit. The system includes a visualization data generation unit that generates visualization data for displaying, using the virtual object display unit, a shape object based on the shape data acquired by the work data acquisition unit and an auxiliary object based on the auxiliary data acquired by the work data acquisition unit, as virtual objects in the field of view indicated by the field of view data acquired by the field of view data acquisition unit. Work support system.

2. The aforementioned auxiliary data is, The installation space in which the aforementioned rotating machine is installed, The work area to be performed and The components that make up the rotating machine, which are the work-to-be-work-on parts necessary for the aforementioned work, The tools necessary for the aforementioned work, This is a record of the work performed during the aforementioned task. The aforementioned auxiliary object is, An installation space object representing the aforementioned installation space, A work target object representing the work target location, Based on the shape data, a work target object representing the work target part is generated, A work tool object representing the aforementioned work tool, Includes a work content object that represents the aforementioned work content, The work support system according to claim 1.

3. The aforementioned auxiliary data is, This is a record of each of the multiple work steps associated with the aforementioned work being performed in a predetermined work sequence. The aforementioned auxiliary object is, The input operation that instructs the progress of the aforementioned work process includes a work process progress object that can receive the input operation via the input unit, The aforementioned visualization data generation unit, The visualization data is generated to display the auxiliary object based on the auxiliary data associated with the work process to be displayed, When the input operation for the work process progress object is received via the input unit, the visualization data is updated to display the auxiliary object based on the auxiliary data associated with the work process to be performed in the next work sequence. The work support system according to claim 2.

4. The aforementioned work target object is, The auxiliary object is positioned in the virtual reality space at a location corresponding to the work target location and is capable of receiving the input operation that instructs the designation of the work target location via the input unit. The aforementioned visualization data generation unit, The input unit accepts the input operation for the work target object. When this happens, the visualization data is updated to change the display mode of the object at the work target. The work support system according to claim 2.

5. The aforementioned work-target part object is, The auxiliary object is positioned in the virtual reality space at a location away from the mounting position where the workpiece is attached, and is capable of receiving the input operation that instructs the designation or movement of the workpiece via the input unit. The aforementioned visualization data generation unit, When the input operation for the work target part object is received via the input unit, the visualization data is updated to change the display mode of the work target part object or to move the display position of the work target part object. The work support system according to claim 2.

6. The aforementioned work tool object is, The auxiliary object is positioned in the virtual reality space at a location away from the usage position where the work tool is used, and is capable of receiving the input operation that instructs the specification or movement of the work tool via the input unit. The aforementioned visualization data generation unit, When the input operation for the work tool object is received via the input unit, the visualization data is updated to change the display mode of the work tool object or move the display position of the work tool object. The work support system according to claim 2.

7. The aforementioned auxiliary data is, This data is recorded for each user level, corresponding to the user level at which the users targeted for the aforementioned training were classified. The aforementioned visualization data generation unit, To generate visualization data for displaying the auxiliary object based on the auxiliary data associated with the user level to be displayed, The work support system according to claim 1.

8. A work support method for a worker equipped with a worker device comprising a work support system consisting of one or more computers, the worker device comprising an input unit for receiving input operations from the worker, a position and posture detection unit for detecting the position and posture of the worker, and a virtual object display unit capable of displaying virtual objects in a virtual reality space, A work data acquisition process that acquires shape data showing the three-dimensional shape of a rotating machine and auxiliary data to assist in training for operations on the rotating machine as work data, A field of view data acquisition step, which acquires field of view data indicating the worker's field of view in the virtual reality space based on the worker's position and posture detected by the position and posture detection unit, The system includes a visualization data generation step which generates visualization data for displaying, as virtual objects, a shape object based on the shape data acquired in the work data acquisition step and an auxiliary object based on the auxiliary data acquired in the work data acquisition step, in the field of view indicated by the field of view data acquired in work data acquisition step, by the virtual object display unit, the shape object based on the shape data acquired in the work data acquisition step and the auxiliary object based on the auxiliary data acquired in the work data acquisition step, as virtual objects, the virtual object display unit. Work support method.

Images