Work assistance method and work assistance system
The work support method and system use a mobile terminal with space recognition capabilities to compare reference and target space meshes, ensuring workers are alerted to changes in their surroundings, enhancing safety during maintenance in dark environments.
Patent Information
- Application Number
- PCT/JP2024/016766
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-05
- Filing Date
- 2024-05-01
- Publication Date
- 2024-12-05
AI Technical Summary
Maintenance workers in dark environments, such as inside substrate processing equipment, face challenges in detecting changes in their surroundings, including foreign objects and removed gratings, which can lead to safety hazards like falls.
A work support method and system utilizing a mobile terminal with a display unit, communication unit, and space recognition unit to create and compare reference and target space meshes, issuing warnings when differences exceed a threshold, even in low illuminance conditions.
Enables workers to recognize changes in their surroundings accurately, preventing accidents by providing real-time warnings of potential hazards even in dark environments.
Smart Images

Figure JP2024016766_05122024_PF_FP_ABST
Abstract
Description
Work support method and work support system
[0001] The present invention relates to a method and system for supporting operations when performing predetermined operations such as maintenance operations on industrial equipment such as substrate processing apparatuses that perform predetermined operations on substrates. Substrates to be processed by the substrate processing apparatuses include, for example, semiconductor substrates, substrates for liquid crystal display devices, substrates for flat panel displays (FPDs), substrates for optical disks, substrates for magnetic disks, and substrates for solar cells.
[0002] Conventionally, in the manufacturing process of semiconductor devices, substrate processing apparatuses are used to perform various processes on substrates such as semiconductor substrates. Examples of substrate processing apparatuses include substrate cleaning apparatuses, heat treatment apparatuses, and inspection apparatuses. Typically, a large number of substrate processing apparatuses are arranged in an orderly fashion in a large clean room. Maintenance is performed on these substrate processing apparatuses at appropriate intervals. Patent Document 1 describes arranging a large number of substrate processing apparatuses at a relatively high density in a clean room and performing maintenance on the substrate processing apparatuses.
[0003] Japanese Patent Application Laid-Open No. 2020-4866
[0004] When performing maintenance on substrate processing equipment, workers may have to enter the equipment to perform the work. Usually, there is almost no lighting inside the substrate processing equipment, and the work must be done in a dark environment. In a dark environment, it is difficult to check the surrounding situation, and workers may not notice the presence of a foreign object. It may be dangerous for workers to perform the work without noticing the presence of a foreign object.
[0005] Typically, the floor of a clean room where many substrate processing equipment are installed is covered with rows of square punched plates called gratings. Piping and wiring for the substrate processing equipment are installed under the clean room floor, and some of the gratings may be removed for maintenance. While cones are usually placed around the area where the gratings have been removed to warn workers, this step is sometimes forgotten. This creates a risk of workers falling under the floor without realizing that the gratings have been removed. In particular, the dimly lit area of the clean room known as the yellow room, where ultraviolet light is blocked, increases the likelihood that workers will not notice that the gratings have been removed.
[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a work assistance method and a work assistance system that enable a worker to recognize changes in the surrounding situation even in a dark environment.
[0007] In order to solve the above problem, a first aspect of the present invention is a work support method for performing specified work on industrial equipment, comprising: a pre-registration step of registering a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using a mobile terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a spatial recognition step of scanning a space including the specified location using the mobile terminal at a specified timing to obtain a target spatial mesh; a comparison step of comparing the target spatial mesh with the reference spatial mesh; and an alert step of issuing an alarm if the difference between the target spatial mesh and the reference spatial mesh is greater than or equal to a specified threshold.
[0008] In a second aspect, in the work assistance method according to the first aspect, the spatial recognition step is executed when the illuminance around the worker wearing the mobile terminal falls below a predetermined reference value.
[0009] In a third aspect, in the work support method according to the first or second aspect, when a change occurs in the predetermined location, the reference space mesh is updated and re-registered.
[0010] In addition, a fourth aspect is a work support method according to any one of the first to third aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside the substrate processing apparatus.
[0011] In addition, a fifth aspect is a work support method according to any one of the first to third aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside a yellow room in which the substrate processing apparatus is located.
[0012] In addition, a sixth aspect is the task assistance method according to any one of the first to fifth aspects, wherein the mobile terminal is a pair of smart glasses.
[0013] In addition, a seventh aspect is a work support method for performing specified work on industrial equipment, comprising: a pre-registration step of registering a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using a mobile terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a spatial recognition step of scanning a space including the specified location using the mobile terminal at a specified timing to obtain a target spatial mesh; a comparison step of comparing the target spatial mesh with the reference spatial mesh; and a post-registration step of registering, when the difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold, any changes in the target spatial mesh from the reference spatial mesh detected in the comparison step as dangerous locations.
[0014] In addition, an eighth aspect is a work support method according to the seventh aspect, in which the registration of the erroneous detected dangerous spot is deleted in response to an input from the worker who confirms that the erroneous detected dangerous spot registered in the post-registration step is a erroneous detection.
[0015] In addition, a ninth aspect is the work support method according to the seventh or eighth aspect, further comprising a correction registration step of registering a dangerous spot in response to an input from a worker who has identified the dangerous spot when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold value.
[0016] In addition, a tenth aspect is a work assistance method according to any one of the seventh to ninth aspects, further comprising an alert issuing step of issuing an alert when it is detected that a worker wearing the mobile terminal has approached the dangerous location.
[0017] Furthermore, an eleventh aspect is a work support method according to any one of the seventh to tenth aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is smart glasses.
[0018] In addition, a twelfth aspect is a work support method for when a plurality of workers work on industrial equipment in a predetermined work area, comprising: a registration step of registering, in a server, a location of a change that has occurred in the work area as a dangerous location in response to an input from any of a plurality of workers, each of whom is wearing a portable terminal equipped with a display unit, a communication unit, and a spatial recognition unit; and an acquisition step of causing the portable terminal worn by each of the plurality of workers to acquire from the server information about the dangerous location registered in the registration step.
[0019] In addition, a thirteenth aspect is the work support method according to the twelfth aspect, further comprising an alert issuing step of issuing an alert when it is detected that any one of the plurality of workers has approached the dangerous location.
[0020] In addition, a fourteenth aspect is a work support method according to the twelfth or thirteenth aspect, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is smart glasses.
[0021] In addition, a fifteenth aspect is a work support system for performing specified work on industrial equipment using a mobile terminal, comprising: a mobile terminal having a display unit, a communication unit, and a spatial recognition unit; a memory unit that stores a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using the mobile terminal; a comparison unit that compares a target spatial mesh obtained by scanning a space including the specified location using the mobile terminal at a specified timing with the reference spatial mesh; and an alarm issuance unit that issues an alarm if the difference between the target spatial mesh and the reference spatial mesh is greater than or equal to a specified threshold.
[0022] In addition, in a sixteenth aspect, in the work support system according to the fifteenth aspect, the target space mesh is acquired when the illuminance around the worker wearing the mobile terminal falls below a predetermined reference value.
[0023] In a seventeenth aspect, in the task support system according to the fifteenth or sixteenth aspect, when a change occurs in the predetermined location, the reference space mesh is updated and re-stored in the storage unit.
[0024] In addition, an 18th aspect is a work support system relating to any one of the 15th to 17th aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside the substrate processing apparatus.
[0025] In addition, a 19th aspect is a work support system relating to any one of the 15th to 17th aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside a yellow room in which the substrate processing apparatus is located.
[0026] In addition, a twentieth aspect is the work assistance system according to any one of the fifteenth to nineteenth aspects, wherein the mobile terminal is a pair of smart glasses.
[0027] Further, a 21st aspect is a work support system for performing specified work on industrial equipment using a mobile terminal, the system comprising: a mobile terminal having a display unit, a communication unit, and a spatial recognition unit; a memory unit that stores a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using the mobile terminal; a comparison unit that compares a target spatial mesh obtained by scanning a space including the specified location using the mobile terminal at a specified timing with the reference spatial mesh; and a server that registers, when a difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold, a change in the target spatial mesh from the reference spatial mesh detected by the comparison unit as a dangerous location.
[0028] In addition, in a 22nd aspect, in the work support system according to the 21st aspect, in response to an input from a worker who confirms that a dangerous spot registered in the server is a false positive, the false positive dangerous spot is deleted from the server.
[0029] In addition, in a 23rd aspect, in the work support system according to the 21st or 22nd aspect, when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold, the dangerous spot is registered in the server in response to an input from a worker who has identified the dangerous spot.
[0030] In addition, a 24th aspect is a work assistance system according to any one of the 21st to 23rd aspects, further comprising a warning issuing unit that issues a warning when it detects that a worker wearing the mobile device has approached the dangerous location.
[0031] Furthermore, a 25th aspect is a work support system relating to any one of the 21st to 24th aspects, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is smart glasses.
[0032] A 26th aspect is a work support system for use when a plurality of workers work on industrial equipment in a predetermined work area, the system including a server that registers any changes that occur in the work area as dangerous areas in response to input from any of a plurality of workers, each wearing a portable terminal equipped with a display unit, a communication unit, and a spatial recognition unit, and the portable terminal worn by each of the plurality of workers acquires information about the dangerous areas registered in the server from the server.
[0033] In addition, a 27th aspect is the work assistance system according to the 26th aspect, further comprising a warning issuing unit that issues a warning when it detects that any one of the plurality of workers has approached the dangerous location.
[0034] Furthermore, a 28th aspect is a work support system according to the 26th or 27th aspect, in which the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is a smart glass.
[0035] According to the work support methods of the first to sixth aspects, if the difference between a reference space mesh obtained by scanning a space including a specified location in a normal state and a target space mesh obtained by scanning a space including the specified location at a specified timing is equal to or greater than a specified threshold, an alert is issued.Therefore, if a change occurs in the specified location, an alert is issued, allowing the worker to recognize changes in the surrounding situation even in a dark environment.
[0036] In particular, according to the work support method relating to the second aspect, the spatial recognition process is executed when the illuminance around the worker wearing the mobile device falls below a predetermined reference value, so that the worker can reliably check the surroundings when the environment is dark.
[0037] According to the work support methods of the seventh to eleventh aspects, if the difference between a reference spatial mesh obtained by scanning a space including a specified location in a normal state and a target spatial mesh obtained by scanning a space including the specified location at a specified timing is equal to or greater than a specified threshold, the changed portion of the target spatial mesh from the reference spatial mesh is registered as a dangerous portion.Therefore, when a change occurs around the worker, the changed portion is automatically registered as a dangerous portion, allowing the worker to recognize changes in the surrounding situation even in a dark environment.
[0038] In particular, according to the work support method of the ninth aspect, when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold, the dangerous area is registered in response to input from the worker who has identified the dangerous area, thereby further improving the accuracy of registering the dangerous areas.
[0039] According to the work assistance methods of the twelfth to fourteenth aspects, a change that occurs in the work area in response to an input from any one of a plurality of workers is registered in a server as a dangerous area, and the portable devices worn by each of the plurality of workers obtain information about the registered dangerous area from the server. This allows all of the plurality of workers to share information about the dangerous areas, and enables the workers to recognize changes in their surroundings even in dark environments.
[0040] According to the work support system of the fifteenth to twentieth aspects, if the difference between a reference space mesh obtained by scanning a space including a specified location in a normal state and a target space mesh obtained by scanning a space including the specified location at a specified timing is equal to or greater than a specified threshold, an alert is issued.Therefore, if a change occurs in the specified location, an alert is issued, allowing the worker to recognize changes in the surrounding situation even in a dark environment.
[0041] In particular, according to the work support system relating to the 16th aspect, the target space mesh is acquired when the illuminance around the worker wearing the mobile device falls below a predetermined reference value, so that the surroundings can be reliably checked in dark environments.
[0042] According to the work support system of the 21st to 25th aspects, if the difference between a reference spatial mesh obtained by scanning a space including a specified location in a normal state and a target spatial mesh obtained by scanning a space including the specified location at a specified timing is equal to or greater than a specified threshold, the changed portion of the target spatial mesh from the reference spatial mesh is registered as a dangerous portion.Therefore, when a change occurs around the worker, the changed portion is automatically registered as a dangerous portion, and the worker can recognize changes in the surrounding situation even in a dark environment.
[0043] In particular, according to the work support system of the 23rd aspect, when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold, the dangerous spot is registered in response to input from the worker who has identified the dangerous spot, thereby further improving the accuracy of registering the dangerous spot.
[0044] According to the work support system of the twenty-sixth to twenty-eighth aspects, a change that occurs in the work area in response to input from any one of a plurality of workers is registered on the server as a dangerous area, and the mobile devices worn by each of the plurality of workers obtain information about the dangerous areas registered on the server from the server. This allows all of the plurality of workers to share information about the dangerous areas, and allows workers to recognize changes in their surroundings even in dark environments.
[0045] 10 is a diagram schematically showing a general configuration of a work support system according to the present invention. FIG. 11 is a plan view showing an example of a layout of a plurality of substrate processing apparatuses. FIG. 12 is a plan view showing an example of an arrangement of the substrate processing apparatuses. FIG. 13 is a side view showing the configuration of the substrate processing apparatus. FIG. 14 is a plan view of the substrate processing apparatus. FIG. 15 is a diagram showing a general configuration of a processing unit. FIG. 16 is a perspective view showing the appearance of smart glasses. FIG. 17 is a block diagram showing the functional configuration of a control unit of the smart glasses, a server, a work support terminal, and a substrate processing apparatus. FIG. 18 is a flowchart showing the procedure of a work support method according to the present invention. FIG. 19 is a diagram showing an example of a reference space mesh for a target location in a normal state. FIG. 20 is a diagram showing an example of a space mesh created for the same target location as in FIG. 10. FIG. 21 is a diagram showing an example of a warning message displayed by a warning issuing unit. FIG. 22 is a flowchart showing the procedure of a work support method according to a third embodiment. FIG. 23 is a diagram for explaining additional registration and deletion of dangerous locations in the third embodiment. FIG. 24 is a diagram for explaining sharing of position information for dangerous locations in a fourth embodiment.
[0046] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Hereinafter, expressions indicating relative or absolute positional relationships (e.g., "in one direction," "along one direction," "parallel," "orthogonal," "center," "concentric," "coaxial," etc.) not only strictly represent the positional relationship but also represent a state of relative angular or distance displacement within a tolerance or a range that provides equivalent functionality, unless otherwise specified. Furthermore, expressions indicating an equal state (e.g., "identical," "equal," "homogeneous," etc.) not only represent a state of strict quantitative equality but also represent a state of difference that provides a tolerance or equivalent functionality, unless otherwise specified. Furthermore, expressions indicating a shape (e.g., "circular," "square," "cylindrical," etc.) not only represent a geometrically strict shape but also represent a shape within a range that provides equivalent functionality, such as irregularities or chamfers, unless otherwise specified. Furthermore, expressions such as "comprise," "comprise," "include," "have," etc., regarding components, are not exclusive expressions that exclude the presence of other components. Furthermore, the expression "at least one of A, B, and C" includes "A only," "B only," "C only," "any two of A, B, and C," and "all of A, B, and C."
[0047] First Embodiment FIG. 1 is a diagram illustrating a schematic configuration of a work support system according to the present invention. The work support system according to the present invention includes a substrate processing apparatus 50, a different type of substrate processing apparatus 90, smart glasses 10, a server 70, and a work support terminal 80. The smart glasses 10 and controllers of the substrate processing apparatuses 50 and 90 are connected to an information and communication network 5 (e.g., the Internet) via wireless communication. The work support terminal 80 and the server 70 are connected to the information and communication network 5 via a wired connection. Information can be transmitted and received between devices connected to the information and communication network 5, for example, information can be exchanged between the smart glasses 10 and the work support terminal 80. Note that whether each device is connected to the information and communication network 5 wirelessly or via a wired connection is not limited to the above example and can be any suitable connection (e.g., the work support terminal 80 may be connected to the information and communication network 5 wirelessly).
[0048] FIG. 2 is a plan view showing an example of the layout of multiple substrate processing apparatuses 50 and 90. As shown in FIG. 2, the multiple substrate processing apparatuses 50 and 90 are arranged in a clean room 40. The clean room 40 is located, for example, in a semiconductor device manufacturing factory, and is a room in which a certain level of air cleanliness is ensured and temperature and humidity are controlled. A portion of the clean room 40 is designated as a yellow room 49. The yellow room 49 is an area where ultraviolet light is blocked, for example, for a photolithography process. The inside of the yellow room 49 is a dimly lit environment that appears yellow to the human eye. The normal area of the clean room 40 and the yellow room 49 are separated by a wall, and the wall has a door 44 for access between the two. The normal area of the clean room 40 is equipped with general lighting equipment, such as fluorescent lights.
[0049] A plurality of substrate processing apparatuses 50 are arranged side by side in a normal area within the clean room 40. The substrate processing apparatuses 50 are apparatuses that perform processing unaffected by light from the external environment, such as substrate cleaning apparatuses. On the other hand, a plurality of substrate processing apparatuses 90 are arranged within the yellow room 49. The substrate processing apparatuses 90 are apparatuses that perform processing (e.g., photolithography processing) that handle photosensitive materials such as resist, such as coater developers. Because resist undergoes chemical reactions even with trace amounts of ultraviolet light contained in ordinary fluorescent lamps, the substrate processing apparatuses 90 are arranged in the yellow room 49, which completely blocks ultraviolet light.
[0050] 3 is a plan view showing an example of the arrangement of the substrate processing apparatus 90. A plurality of gratings 47 are regularly arranged and spread over the floor of the clean room 40 including the yellow room 49. The gratings 47 are rectangular punched plates. Each grating 47 is removable. Piping and wiring for the substrate processing apparatus 50 or the substrate processing apparatus 90 are provided under the floor of the clean room 40.
[0051] Fig. 4 is a side view showing the configuration of the substrate processing apparatus 50. Fig. 5 is a plan view of the substrate processing apparatus 50. The substrate processing apparatus 50 is, for example, a single-wafer type substrate cleaning apparatus that cleans substrates one by one. The substrate processing apparatus 50 has an indexer 51, a plurality of processing units 52, a transfer robot 56, and a main transport robot 57.
[0052] Carriers C each accommodating a plurality of substrates W are placed on the indexer 51. For example, three carriers C can be placed on the indexer 51. The transfer robot 56 is configured to be able to slide along the arrangement direction of the plurality of carriers C, to move up and down, to rotate, and to move its hand forward and backward. Unprocessed substrates W are removed from the carriers C placed on the indexer 51 by the transfer robot 56. Processed substrates W are stored in the carriers C placed on the indexer 51 by the transfer robot 56. The carriers C are, for example, FOUPs (front opening unified pods) that store substrates W in an enclosed space.
[0053] In the first embodiment, for example, three processing units 52 are stacked to form one stack. Then, for example, four stacks are arranged around the main transport robot 57 of the substrate processing apparatus 50. That is, one substrate processing apparatus 50 includes, for example, 12 (=3×4) processing units 52.
[0054] The main transport robot 57, which is disposed at the center of the four stacks, is configured to be capable of lifting and lowering, rotating, and moving its transport arm AM back and forth. The main transport robot 57 can transfer substrates W to and from all 12 processing units 52. The main transport robot 57 receives unprocessed substrates W from the transfer robot 56 and transfers them into any of the 12 processing units 52. The main transport robot 57 also removes processed substrates W from the processing units 52 and transfers them to the transfer robot 56.
[0055] The substrate processing apparatus 50 also includes a control unit 55. The control unit 55 is a general-purpose computer that controls the operations of the transfer robot 56, the main transport robot 57, and each of the processing units 52 provided within the apparatus. The control unit 55 has a touch panel that serves as an input / output interface provided on a wall surface of the apparatus, and a communication unit that communicates with the outside of the apparatus. While the control unit 55 is shown in the indexer 51 in FIGS. 4 and 5 for convenience of illustration, the present invention is not limited to this, and the control unit 55 may be provided at an appropriate position within the substrate processing apparatus 50.
[0056] 6 is a diagram showing a schematic configuration of the processing unit 52. The processing unit 52 includes a processing chamber 60, a spin holder 61, and a discharge nozzle 65. The processing chamber 60 is a hollow housing. The spin holder 61, the discharge nozzle 65, and the like are provided inside the processing chamber 60. The processing chamber 60 also has a loading / unloading port (not shown). The loading / unloading port is opened and closed by a shutter. With the loading / unloading port open, the main transport robot 57 loads and unloads a substrate W into and from the processing chamber 60. The loading / unloading port is closed during processing of the substrate W. The processing chamber 60 also has an air supply mechanism and an exhaust mechanism (not shown).
[0057] The rotation holder 61 includes a spin chuck 62 and a spin motor 63. The spin chuck 62 is a substrate holder that holds the substrate W in a horizontal position (a position in which the normal to the main surface of the substrate W is aligned vertically). The spin chuck 62 is, for example, a vacuum suction-type chuck. The spin chuck 62 has a disk shape with a diameter smaller than the diameter of the substrate W. The spin chuck 62 suction-holds the central portion of the lower surface of the substrate W. When the lower surface of the substrate W is suction-held by the spin chuck 62, the peripheral edge of the substrate W extends beyond the outer circumferential edge of the spin chuck 62. The spin chuck 62 may be another type of chuck, such as a clamping-type mechanical chuck.
[0058] The spin chuck 62 is connected to the spin motor 63 via a motor shaft. That is, the upper end of the motor shaft of the spin motor 63 is connected to the center of the lower surface of the spin chuck 62. When the spin motor 63 rotates the motor shaft while the substrate W is held by suction on the spin chuck 62, the substrate W and the spin chuck 62 rotate in a horizontal plane around a rotation axis extending in the vertical direction.
[0059] A cup 64 is provided to surround the spin chuck 62. The cup 64 can be raised and lowered by a lifting mechanism (not shown). The cup 64 has a cylindrical shape, and the upper part of the cup 64 is inclined so that it approaches the spin chuck 62 as it goes up. However, the inner diameter of the upper end part of the cup 64 is larger than the diameter of the substrate W. During processing of the substrate W, the upper end of the cup 64 is higher than the height position of the substrate W held by the spin chuck 62. Therefore, liquid scattered by centrifugal force from the substrate W rotated by the spin motor 63 is received and recovered by the cup 64. The liquid recovered by the cup 64 is discharged from a drain pipe provided at the bottom of the cup 64. The cup 64 may have a multi-stage structure in which multiple recovery ports are provided for different purposes.
[0060] The discharge nozzle 65 discharges a processing liquid onto the substrate W held on the spin chuck 62. The processing liquid is a term that encompasses various chemical liquids and pure water. Examples of chemical liquids include liquids for etching or liquids for removing particles. Specifically, SC-1 liquid (a mixed solution of ammonium hydroxide, hydrogen peroxide, and pure water), SC-2 liquid (a mixed solution of hydrochloric acid, hydrogen peroxide, and pure water), or hydrofluoric acid are used. The discharge nozzle 65 is moved by a drive mechanism (not shown) between a processing position above the spin chuck 62 and a standby position outside the cup 64. At the processing position, the discharge nozzle 65 discharges a chemical liquid onto the substrate W held on the spin chuck 62, thereby, for example, etching the substrate W. Furthermore, the discharge nozzle 65 discharges pure water onto the substrate W, thereby performing a pure water rinse process on the substrate W.
[0061] An operator who performs operations such as operating the substrate processing apparatus 50, 90 wears smart glasses 10. The smart glasses 10 are a type of wearable device that uses a head-mounted display (HMD). The smart glasses 10 are also devices that realize AR (Augmented Reality) or MR (Mixed Reality). For example, Microsoft's "HoloLens" (registered trademark) can be used as the smart glasses 10.
[0062] 7 is a perspective view showing the appearance of the smart glasses 10. The smart glasses 10 include a visor 11 and a headband 12. A worker wears the smart glasses 10 by placing the headband 12 on their head. The worker can adjust the length of the headband 12 to fit the size of their head. The headband 12 also includes a power button, a brightness button, a volume button, and the like.
[0063] The visor 11 includes various sensors and a display. The display is a see-through holographic lens. That is, the display can display a three-dimensional image in the worker's field of view using a hologram, and transmits light from real objects in the same way as regular eyeglass lenses. Therefore, a worker wearing the smart glasses 10 can view the displayed three-dimensional image while viewing real objects through the display.
[0064] The sensors of the visor 11 include, for example, multiple visible light cameras that mainly capture images in front of the visor 11, an infrared camera that tracks the worker's line of sight, a depth sensor that measures the distance to an object, and an inertial measurement sensor. The infrared camera tracks the line of sight by measuring the movement of the eyeballs of the wearer of the smart glasses 10. The depth sensor measures the distance to an object using, for example, a Time of Flight (ToF) method. The inertial measurement sensor is composed of an accelerometer, a gyroscope, a magnetometer, etc.
[0065] The smart glasses 10 also have a built-in computer including a CPU, memory, etc. The smart glasses 10 are also provided with a wireless communication mechanism, and the computer in the smart glasses 10 connects to the information communication network 5 using the wireless communication mechanism. The smart glasses 10 are also provided with a microphone, a speaker, a battery, etc.
[0066] 8 is a block diagram showing the functional configuration of the smart glasses 10, the server 70, the work support terminal 80, and the control unit 55 of the substrate processing apparatus 50. The smart glasses 10 include an imaging unit 21, a communication unit 22, a display unit 23, a storage unit 24, and a spatial recognition unit 25. The imaging unit 21 includes a visible light camera provided on the visor 11 described above. The imaging unit 21 includes, for example, four visible light cameras that capture images of the front and diagonally forward, and can capture images of the field of view of the worker wearing the smart glasses 10.
[0067] The communication unit 22 includes the wireless communication mechanism of the smart glasses 10 described above. The communication unit 22 transmits and receives data to and from the work support terminal 80 and the server 70 via the information and communication network 5. The communication unit 22 can also transmit and receive data directly to and from the control unit 55 of the substrate processing apparatus 50 if the distance is short. That is, the communication unit 22 can transmit data and commands to the control unit 55 of the substrate processing apparatus 50 directly or via the information and communication network 5.
[0068] The display unit 23 includes the display of the visor 11. The display unit 23 has a holographic processing device and displays a 3D image at a predetermined spatial position using hologram technology. Note that the 3D image displayed by the display unit 23 is not limited to a 3D shape, and may be a 2D image such as a document.
[0069] The storage unit 24 includes a memory and storage installed in the smart glasses 10. The memory and storage provided in the smart glasses 10 are, for example, a dynamic random access memory (DRAM) and a universal flash storage (UFS), respectively. The storage unit 24 stores applications and data used by the computer of the smart glasses 10.
[0070] The space recognition unit 25 includes the depth sensor of the smart glasses 10 described above. The depth sensor can measure the distance to an object. The space recognition unit 25 can perform space mapping by scanning the space using the depth sensor. Specifically, the space recognition unit 25 creates a space mesh, which is mesh data, by scanning the space.
[0071] The smart glasses 10 also include a comparison unit 31 and a warning issuance unit 36. The comparison unit 31 and the warning issuance unit 36 are function processing units that are realized by the CPU of the smart glasses 10 executing a predetermined processing program. The processing details of the comparison unit 31 and the warning issuance unit 36 will be described in more detail below.
[0072] The control unit 55 of the substrate processing apparatus 50 controls the operation of mechanisms provided in the processing unit 52, such as the discharge nozzle 65. The control unit 55 of the substrate processing apparatus 50 can communicate with the communication unit 22 of the smart glasses 10, and can also control the operation of various mechanisms provided in the processing unit 52 in accordance with operation instruction commands transmitted from the smart glasses 10. Note that the substrate processing apparatus 90 also has a control unit similar to the control unit 55.
[0073] The work support terminal 80 and the server 70 are installed, for example, in a factory of a vendor that manufactures and maintains the substrate processing apparatus 50 and / or the substrate processing apparatus 90. The work support terminal 80 and the server 70 are capable of communicating with the smart glasses 10 via the information and communication network 5. The work support terminal 80 and the server 70 are also capable of communicating with each other via the information and communication network 5.
[0074] The work support terminal 80 and the server 70 are general computer systems. That is, the work support terminal 80 and the server 70 include a CPU which is a circuit that performs various arithmetic processing, a ROM which is a read-only memory that stores basic programs, a RAM which is a readable and writable memory that stores various information, a storage unit (for example, a magnetic disk or SSD) that stores control software and data, and a communication unit that communicates with the information communication network 5.
[0075] The work support terminal 80 is a computer that, for example, allows a work supporter on the vendor side to support the work of a worker in the clean room 40. The work supporter can send various information from the work support terminal 80 to the smart glasses 10 worn by the worker in the clean room 40.
[0076] In the work support system according to the present invention, the server 70 is a computer that executes predetermined processes in response to requests from the smart glasses 10 and the work support terminal 80. The server 70 includes a storage unit 74 with a relatively large capacity. Large-sized data created by the smart glasses 10 and the work support terminal 80 may be stored in the storage unit 74.
[0077] Next, a work support method using the work support system having the above-described configuration will be described. FIG. 9 is a flowchart showing the steps of the work support method according to the present invention. First, as a preliminary process, a normal-state spatial mesh for any location in the clean room 40 is created and registered using the smart glasses 10 (step S1). Locations to be registered include, for example, the outer wall and interior of the substrate processing apparatus 50 and the floor of the clean room 40. In the first embodiment, for example, the space recognition unit 25 of the smart glasses 10 scans a space including the interior of the substrate processing apparatus 50 to create a spatial mesh, which is mesh data.
[0078] To operate the smart glasses 10 to create a spatial mesh, the worker wearing the smart glasses 10 simply turns on the scan mode. The worker selects the scan mode using a hand gesture from a menu screen displayed as a 3D image on the display unit 23, for example. The hand gesture is captured and detected by the imaging unit 21, and the computer of the smart glasses 10 recognizes from the detection result that the scan mode has been selected and turns on the scan mode. Alternatively, the worker may turn on the scan mode by pressing a predetermined button provided on the smart glasses 10. When the scan mode is turned on, the space recognition unit 25 of the smart glasses 10 starts scanning the space.
[0079] In step S1, the space recognition unit 25 of the smart glasses 10 scans a space including a target location in a normal state to create a space mesh. The normal state refers to a safe and constant state in which no foreign objects or the like are present. The space mesh acquired by the space recognition unit 25 scanning the space including the target location in a normal state is stored in the memory unit 24 as a reference space mesh. This results in the reference space mesh for the target location in a normal state being registered. Note that if the amount of data for the reference space mesh is large, it may be stored in the memory unit 74 of the server 70, for example.
[0080] FIG. 10 is a diagram showing an example of a reference space mesh for a target location in a normal state. As shown in the figure, the space mesh created by the space recognition unit 25 of the smart glasses 10 is represented by a mesh of many triangles. Various shapes, including curved and flat surfaces, are represented by a set of many connected triangles. Complex shapes including uneven surfaces are represented by a high density of triangles, while flat shapes are represented by a relatively low density of triangles.
[0081] The timing for creating and registering the reference space mesh by scanning the space including the target location in the normal state is, for example, when the substrate processing apparatus 50 is introduced into the clean room 40. Furthermore, whenever there is a change in the registered target location, it is preferable to scan the space using the smart glasses 10, update the reference space mesh, and re-register it. For example, when a new shelf is installed inside the substrate processing apparatus 50, the state in which the shelf exists is the new normal state, so the space including the interior of the substrate processing apparatus 50 where the shelf is installed is scanned by the space recognition unit 25 to update the reference space mesh.
[0082] Next, when a worker wearing the smart glasses 10 performs maintenance work on the substrate processing apparatus 50, for example, the smart glasses 10 scan the space at an appropriate timing to create a spatial mesh (step S2). The target for creating the spatial mesh is a space including the area where the worker plans to work. For example, in the first embodiment, the worker enters the substrate processing apparatus 50 to perform work, so the spatial recognition unit 25 of the smart glasses 10 scans the space including the interior of the substrate processing apparatus 50 to create a spatial mesh. Furthermore, for example, when the worker works outside but in the vicinity of the substrate processing apparatus 50, the spatial recognition unit 25 scans the space including the outer wall of the substrate processing apparatus 50 and the floor of the clean room 40 to create a spatial mesh. Figure 11 is a diagram showing an example of a spatial mesh created for the same target location as Figure 10.
[0083] The timing for creating the spatial mesh in step S2 can be, for example, by manually turning on the scan mode when the worker attempts to perform a safety check while working. Alternatively, the smart glasses 10 may automatically create a spatial mesh when it recognizes that the area around the worker wearing the smart glasses 10 has become dark. Specifically, when the brightness of the image captured by the imaging unit 21 of the smart glasses 10 is below a predetermined value, the smart glasses 10 determines that the illuminance around the worker has become dark and is below a reference value. This triggers the smart glasses 10 to create a spatial mesh.
[0084] Thereafter, the comparison unit 31 of the smart glasses 10 compares the spatial mesh (target spatial mesh) created in step S2 with the reference spatial mesh registered in step S1 (step S3). The comparison unit 31 compares the target spatial mesh with the reference spatial mesh and extracts the difference between them. In the above example, the triangular mesh of region D1 in the target spatial mesh shown in Figure 11 differs from the reference spatial mesh in Figure 10. The comparison unit 31 extracts region D1 as the difference between the target spatial mesh and the reference spatial mesh.
[0085] Next, the comparison unit 31 determines whether the difference between the target space mesh and the reference space mesh is equal to or greater than a predetermined threshold (step S4). In the above example, the comparison unit 31 determines whether the difference value obtained by quantifying the region D1, which is the difference between the target space mesh in Figure 11 and the reference space mesh in Figure 10, is equal to or greater than a threshold.
[0086] If the result of the determination is that the difference between the target space mesh and the reference space mesh is equal to or greater than the threshold, some change, such as a foreign object, has occurred in the target location when the target space mesh was created compared to the normal state when the reference space mesh was registered (e.g., new equipment has been installed inside the substrate processing apparatus 50). In this case, the process proceeds from step S4 to step S5, and the warning unit 36 issues a warning. Specifically, for example, the warning unit 36 displays a warning message as a 3D image on the display unit 23. FIG. 12 is a diagram showing an example of a warning message displayed by the warning unit 36. By displaying the warning message, the worker can recognize changes in the surrounding situation and pay attention to those changes, thereby ensuring the worker's safety. In the example of the first embodiment, the worker can recognize and pay attention to the newly installed equipment inside the substrate processing apparatus 50, thereby allowing the worker to work safely inside the substrate processing apparatus 50.
[0087] On the other hand, if the difference between the target space mesh and the reference space mesh is less than the threshold, it means that no significant changes have occurred in the target location when the target space mesh was created compared to the normal state when the reference space mesh was registered. In this case, the process proceeds from step S4 to step S6, and the worker continues with the desired work. Since no significant changes have occurred in the environment around the worker from the normal state, the worker can work safely.
[0088] In the first embodiment, the spatial mesh acquired by scanning a space including a target location in a normal state using the spatial recognition unit 25 of the smart glasses 10 is pre-registered as a reference spatial mesh. Then, at appropriate timing, the spatial mesh acquired by scanning the space using the smart glasses 10 (target spatial mesh) is compared with the reference spatial mesh, and an alert is issued if the difference between the two is equal to or greater than a predetermined threshold. If the difference between the target spatial mesh and the reference spatial mesh is equal to or greater than the threshold, this indicates that some change from the normal state has occurred in the target location. In such a case, an alert is issued, allowing the worker to recognize that a change from the normal state has occurred in the surrounding situation, thereby ensuring the worker's safety.
[0089] Here, it is possible to use image processing technology to compare an image of the target location in a normal state captured in advance using a typical known camera with an image of the target location captured by the same camera at an appropriate time thereafter, to detect differences between the two images and issue a warning. However, in a dark environment such as the interior of the substrate processing apparatus 50, a typical camera cannot capture clear images. Therefore, even if some change from the normal state has occurred in the target location, the change may not be detected as a difference.
[0090] In the first embodiment, the space recognition unit 25 of the smart glasses 10 creates a space mesh by scanning the space using a depth sensor. The depth sensor can capture the shape of the target location and create a space mesh even in a dark environment such as the inside of the substrate processing apparatus 50. Therefore, the smart glasses 10 can accurately extract the difference between the target space mesh and the reference space mesh and can correctly issue a warning based on the magnitude of the difference. In other words, by following the first embodiment, the worker can correctly recognize changes in the surrounding situation even in a dark environment such as the inside of the substrate processing apparatus 50.
[0091] Second Embodiment Next, a second embodiment of the present invention will be described. The configuration of the work support system in the second embodiment is the same as that in the first embodiment. The procedure of the work support method in the second embodiment is also generally the same as that in the first embodiment. In the second embodiment, a worker performs work in a yellow room 49.
[0092] In the second embodiment, too, the spatial mesh acquired by scanning the space within the yellow room 49 in a normal state using the spatial recognition unit 25 of the smart glasses 10 is registered in advance as a reference spatial mesh. Although the yellow room 49 is also a dark environment, the spatial recognition unit 25 scans the space using a depth sensor, and therefore can accurately create a spatial mesh within the yellow room 49. In the second embodiment, for example, the space including the floor of the yellow room 49 is scanned by the spatial recognition unit 25, and a reference spatial mesh is created and registered.
[0093] Next, the smart glasses 10 scan the space inside the yellow room 49 at an appropriate timing to create a target space mesh. Then, as in the first embodiment, the comparison unit 31 compares the target space mesh with the reference space mesh to extract the difference between them and determine whether the difference is equal to or greater than a predetermined threshold. If the result of the determination shows that the difference between the target space mesh and the reference space mesh is equal to or greater than the predetermined threshold, the warning issuance unit 36 issues a warning.
[0094] In the example of the second embodiment, it is assumed that part of the grating 47 is removed for maintenance of piping and the like installed under the floor of the yellow room 49. Even in such a case, the difference between the target space mesh and the reference space mesh is equal to or greater than the threshold value, so that a warning is issued, allowing the worker to recognize that the grating 47 has been removed, preventing the worker from falling and ensuring safety.
[0095] In the second embodiment, the space recognition unit 25 of the smart glasses 10 also creates a space mesh by scanning the space using a depth sensor. The depth sensor can capture the shape of the target location and create a space mesh even in a dark environment such as the yellow room 49. Therefore, the smart glasses 10 can accurately extract the difference between the target space mesh and the reference space mesh and can correctly issue a warning based on the magnitude of the difference. In other words, by following the second embodiment, the worker can correctly recognize changes in the surrounding situation even in a dark environment such as the yellow room 49.
[0096] Third Embodiment Next, a third embodiment of the present invention will be described. The configuration of the work assistance system in the third embodiment is the same as that in the first embodiment. In the third embodiment, the difference detection of the spatial mesh by the smart glasses 10 is further corrected, thereby enabling more accurate recognition of dangerous areas such as foreign objects and openings.
[0097] Fig. 13 is a flowchart showing the procedure of the work support method of the third embodiment. Steps S11 to S14 in Fig. 13 are generally similar to steps S1 to S4 in Fig. 9 . That is, first, a spatial mesh in a normal state (safe state) for the work area around the substrate processing apparatus 50 (or the substrate processing apparatus 90) is created and registered (step S11). As in the first embodiment, when the worker wearing the smart glasses 10 turns on the scan mode, the space recognition unit 25 of the smart glasses 10 scans the work area. The normal-state spatial mesh created by the scan is registered in the storage unit 24 as a reference spatial mesh.
[0098] Next, the worker wearing the smart glasses 10 scans the work area with the smart glasses 10 at an appropriate timing to create a spatial mesh (step S12). An appropriate timing is, for example, during a pre-inspection before work. Then, the comparison unit 31 of the smart glasses 10 compares the spatial mesh created in step S12 (target spatial mesh) with the reference spatial mesh registered in step S11 (step S13). The comparison unit 31 compares the target spatial mesh with the reference spatial mesh and extracts the difference between them. Next, the comparison unit 31 determines whether the difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a predetermined threshold (step S14). Specifically, the comparison unit 31 determines whether the difference, which is a numerical value of the difference, is equal to or greater than a threshold.
[0099] In the third embodiment, if the difference between the target space mesh and the reference space mesh is equal to or greater than a threshold, the process proceeds from step S14 to step S15, where the smart glasses 10 registers the difference as a dangerous location. The difference between the target space mesh and the reference space mesh being equal to or greater than a threshold indicates the possibility that a new dangerous location, such as a foreign object or opening, has been created since the reference space mesh was created. Examples of foreign objects include tools and parts. An opening is, for example, a hole created when the grating 47 is removed. Both of these are dangerous locations if a worker comes into contact with them unawares. When the difference between the target space mesh and the reference space mesh (e.g., area D1 in FIG. 11 ) is equal to or greater than a threshold, the smart glasses 10 determines that the change in the target space mesh from the reference space mesh is a dangerous location, and registers the location information of the dangerous location in, for example, the storage unit 74 of the server 70.
[0100] Next, the worker deletes the hazardous areas erroneously detected by the smart glasses 10 (step S16). The smart glasses 10 may erroneously detect hazardous areas when they detect a change in the target spatial mesh from the reference spatial mesh as a hazardous area. It is believed that erroneous detection by the smart glasses 10 occurs due to the following circumstances: When creating a spatial mesh in step S12, the worker wearing the smart glasses 10 walks around the work area, including the periphery of the substrate processing apparatus 50, with the scan mode turned on. At this time, the created spatial mesh may differ depending on the worker's walking style. For example, when the worker walks quickly, the smart glasses 10 scan at high speed, and a spatial mesh is formed from a collection of triangles with a relatively low density. Conversely, when the worker walks slowly, the smart glasses 10 scan at low speed, and a spatial mesh is created from a collection of triangles with a relatively high density. Even spatial meshes created for the same area in this way may vary depending on the worker's walking style. This variation may cause errors in the difference calculation, resulting in a space free of foreign objects or the like being erroneously detected as a hazardous area.
[0101] When the worker visually confirms, for example, that the dangerous area registered in the server 70 by the smart glasses 10 in step S15 is a false positive, the worker manually deletes the falsely detected dangerous area. For example, when the worker visually confirms that the location of the dangerous area registered in the server 70 by the smart glasses 10 is safe because no foreign object or the like is present at the location, the worker manually deletes the dangerous area from the server 70. Specifically, the worker performs an operation to delete the falsely detected dangerous area by using a hand gesture on the operation screen displayed as a three-dimensional image on the display unit 23 of the smart glasses 10, for example, and the smart glasses 10 delete the dangerous area from the server 70 in response to the input operation. Furthermore, when the worker confirms that the foreign object or the like detected as a dangerous area by the smart glasses 10 is not dangerous, even though it is not a false positive, the dangerous area may be deleted in the same manner as described above.
[0102] Next, the worker registers any dangerous areas that were not detected by the smart glasses 10 but that the worker found visually (step S17). The resolution of the depth sensor provided in the spatial recognition unit 25 of the smart glasses 10 may not be sufficient to detect small foreign objects (e.g., foreign objects with sides of 50 cm or less). Furthermore, when creating the spatial mesh in step S12, new dangerous areas such as foreign objects or openings may be added outside the field of view of the smart glasses 10. In such cases, dangerous areas that the smart glasses 10 cannot detect exist. If the worker visually confirms such dangerous areas such as foreign objects or openings that the smart glasses 10 could not detect, the worker manually registers the dangerous areas in the server 70. Specifically, the worker adds the dangerous areas that the worker found visually using hand gestures on the operation screen displayed as a stereoscopic image on the display unit 23 of the smart glasses 10. At this time, for example, a virtual object indicating the dangerous area may be placed at the location of the dangerous area that the worker found visually using hand gestures. Then, in response to the input operation, the smart glasses 10 register the position information of the added dangerous spot in the server 70.
[0103] After the registration of newly detected dangerous locations and the deletion of erroneously detected dangerous locations are completed, the warning unit 36 issues a warning when the worker wearing the smart glasses 10 approaches a dangerous location within the work area (step S18). Specifically, when the worker wearing the smart glasses 10 turns on the scan mode within the work area, the smart glasses 10 scan the work area to create a spatial mesh, and the worker's position is identified by comparing the spatial mesh with a previously created spatial mesh. When the smart glasses 10 detect that the identified worker's position and the position of a dangerous location registered in the server 70 are within a predetermined distance (e.g., 1 meter or less), the warning unit 36 issues a warning. The warning unit 36 displays a warning message, such as that shown in FIG. 12, on the display unit 23 as a three-dimensional image. The display of the warning message allows the worker to recognize the presence of a dangerous location, such as a foreign object or an opening, nearby and pay attention, thereby ensuring the worker's safety.
[0104] 14 is a diagram for explaining the additional registration and deletion of hazardous locations in the third embodiment. A substrate processing apparatus 50 is disposed in a work area 101. In step S12, a worker performing a pre-work inspection or the like wears smart glasses 10 and walks around the work area 101 with the scan mode turned on. The worker walks around the substrate processing apparatus 50, for example, along a path indicated by arrow AR14. As a result, a spatial mesh (target spatial mesh) for the work area 101 including the periphery of the substrate processing apparatus 50 is created. Note that a spatial mesh (reference spatial mesh) for the work area 101 in a normal state has been created in advance and registered in the storage unit 24.
[0105] The opening 105 is a hole created, for example, by removing the grating 47 after the reference space mesh is created when the work area 101 is in a normal state. When a worker performing a pre-work inspection approaches the opening 105, the difference between the created target space mesh and the reference space mesh may exceed a predetermined threshold. This means that the smart glasses 10 have detected the opening 105, which is a newly occurring change. The smart glasses 10 then determine that the opening 105, which is a change in the target space mesh from the reference space mesh, is a dangerous location, and registers the location information of the dangerous location (i.e., the location information of the opening 105) in the server 70.
[0106] Furthermore, the foreign object 106 is, for example, a tool placed in the work area 101 after the reference space mesh is created. When a worker approaches the foreign object 106, the difference between the created target space mesh and the reference space mesh may become equal to or greater than a predetermined threshold. This means that the smart glasses 10 have detected the foreign object 106, which is a newly occurring change. The smart glasses 10 then determine that the foreign object 106, which is a change in the target space mesh from the reference space mesh, is a dangerous location, and register the location information of the dangerous location (i.e., the location information of the foreign object 106) in the server 70.
[0107] On the other hand, the area 107 is a safe area where no foreign objects or the like are present. When a worker performing a pre-work inspection or the like approaches the safe area 107, the difference between the created target space mesh and the reference space mesh may exceed a predetermined threshold. In this case, as in the case described above, the smart glasses 10 determine that the area 107, where the target space mesh changes from the reference space mesh, is a dangerous area, and registers the location information of the area 107 in the server 70. However, this is a false detection by the smart glasses 10. The reason for such a false detection is as described above. When the worker visually confirms that the area 107, which is a dangerous area registered in the server 70, is safe and the detection is false, the worker manually deletes the registration of the falsely detected dangerous area from the server 70. The worker deletes the registration of the falsely detected dangerous area using the smart glasses 10 they are wearing.
[0108] Furthermore, like the foreign object 106, the foreign object 108 is a tool placed in the work area 101 after the reference space mesh is created. However, if the foreign object 108 is small, the difference between the created target space mesh and the reference space mesh may be less than a predetermined threshold even when the worker approaches the foreign object 108. In this case, the smart glasses 10 cannot detect the foreign object 108 as a hazardous area. Even in such a case, when the worker confirms the foreign object 108 visually or otherwise, the worker manually registers the foreign object 108 as a hazardous area in the server 70. The worker uses the smart glasses 10 that he or she is wearing to register the position information of the foreign object 108 in the server 70. Relatively large hazardous areas are detected and automatically registered by the smart glasses 10, while relatively small hazardous areas that cannot be detected by the smart glasses 10 are manually registered by the worker.
[0109] In this way, all dangerous locations, such as foreign objects or openings, present in the work area 101 are registered in the server 70. After that, when a worker wearing the smart glasses 10 enters the work area 101 and approaches a certain distance or less from a dangerous location (in the example of FIG. 14 , opening 105, foreign object 106, or foreign object 108), the warning issuing unit 36 issues a warning. The worker, recognizing the warning, knows that a dangerous location, such as a foreign object or opening, is nearby and takes caution. As a result, the safety of the worker can be ensured.
[0110] In the third embodiment, the smart glasses 10 register, as danger spots, locations where the target space mesh has changed from the reference space mesh, and their position information in the server 70. If the danger spot registered by the smart glasses 10 is a false positive, the worker deletes the registration of the danger spot. On the other hand, if the worker visually or otherwise confirms a danger spot that the smart glasses 10 was unable to detect, the worker manually registers the danger spot. In other words, the worker manually corrects (deletes or adds registrations) the automatic registration of danger spots by the smart glasses 10 based on visual or other confirmation. This improves the accuracy of the registration of danger spots, and the worker wearing the smart glasses 10 can reliably recognize danger spots.
[0111] <Fourth Embodiment> Next, a fourth embodiment of the present invention will be described. The configuration of the work support system in the fourth embodiment is the same as that in the first embodiment. In the fourth embodiment, when multiple workers are working in the same work area, they share information about hazardous locations.
[0112] 15 is a diagram for explaining the sharing of position information about hazardous locations in the fourth embodiment. A substrate processing apparatus 50 is placed in a work area 111. Three workers are working in the work area 111. All three workers are wearing smart glasses 10 while working. Each of the three workers may be working directly on the substrate processing apparatus 50, or may be working in a manner not directly related to the substrate processing apparatus 50.
[0113] Of the three workers, worker P1 removes one grating 47 to form an opening 115. After forming the opening 115, worker P1 uses the smart glasses 10 to register the opening 115 as a dangerous location in the server 70. Specifically, the worker P1 performs an operation to input position information of the opening 115 using hand gestures on an operation screen displayed as a three-dimensional image on the display unit 23 of the smart glasses 10, for example. The smart glasses 10 worn by worker P1 register the position information of the opening 115 in the server 70 in response to the input operation.
[0114] Next, the server 70 that has received the registration of the position information of the new dangerous area distributes the newly registered position information of the dangerous area to the smart glasses 10 worn by the remaining workers P2 and P3 of the three workers. As a result, the smart glasses 10 worn by each of the workers P2 and P3 acquire the position information of the newly registered dangerous area in the server 70. In other words, the position information of the dangerous area registered by the smart glasses 10 worn by the worker P1 who formed the opening 115 is shared with the smart glasses 10 worn by the other workers P2 and P3.
[0115] When a worker wearing the smart glasses 10 approaches an opening 115, which is a dangerous location, within the work area 111, the warning unit 36 issues a warning. Specifically, when a worker wearing the smart glasses 10 turns on the scan mode within the work area 111, the smart glasses 10 scan the work area 111 to create a spatial mesh, and the position of the worker is identified by comparing the spatial mesh with a previously created spatial mesh. When the smart glasses 10 detect that the identified worker's position and the position of the opening 115, which is a dangerous location, are within a predetermined distance (e.g., 1 meter or less), the warning unit 36 issues a warning. The warning unit 36 displays a warning message, such as that shown in FIG. 12 , on the display unit 23 as a three-dimensional image. The display of the warning message allows the worker to recognize the presence of a dangerous location, such as a foreign object or an opening, nearby and to pay attention, thereby ensuring the worker's safety.
[0116] In the fourth embodiment, multiple workers are working in the work area 111 while wearing smart glasses 10, and one of the workers recognizes a change that has occurred in the work area 111 as a dangerous spot and registers its location information in the server 70 using the smart glasses 10. When a new dangerous spot is registered in the server 70, the smart glasses 10 worn by the other workers acquires the location information of the newly registered dangerous spot from the server 70. This allows all of the multiple workers working in the work area 111 to share the location information of the dangerous spot that has occurred in the work area 111, and each worker can reliably recognize the dangerous spot.
[0117] <Modifications> Although the embodiments of the present invention have been described above, various modifications other than those described above are possible without departing from the spirit of the present invention. For example, in the first and second embodiments, when the difference between the target space mesh and the reference space mesh is equal to or greater than a threshold, in addition to issuing a warning, the operator may be allowed to select whether to register the target space mesh as a new reference space mesh. Specifically, the display unit 23 of the smart glasses 10 displays a warning message along with a selection button or a pull-down menu for selecting whether to update the registration as a 3D image. The operator can select whether to register the target space mesh as a new reference space mesh using a hand gesture. The hand gesture is captured and detected by the imaging unit 21, and the computer of the smart glasses 10 executes the operator's selection based on the detection result. Although the smart glasses 10 issue a warning when the difference between the target space mesh and the reference space mesh is equal to or greater than a threshold, they cannot determine whether the state of the target space mesh is safe or dangerous. When the state of the target space mesh is safe and stable, the operator may select to register the target space mesh as a new reference space mesh.
[0118] Furthermore, in the first embodiment, a spatial mesh is automatically created when the illuminance around the worker falls below a reference value. However, instead, the smart glasses 10 may automatically create a spatial mesh when the worker attempts to move across the floor of the clean room 40. Specifically, the smart glasses 10 may automatically create a spatial mesh when the imaging unit 21 of the smart glasses 10 worn by the worker detects an exposed floor in an image captured by the imaging unit 21. In this way, even if the grating 47 is removed in a normal area of the clean room 40, a target spatial mesh is automatically created, and a warning is issued when the difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a threshold, so that the worker can recognize that the grating 47 is removed.
[0119] In addition to or instead of displaying a warning message on the display unit 23, the warning unit 36 may emit a warning sound from the speaker of the smart glasses 10.
[0120] Furthermore, in each of the above embodiments, the comparison unit 31 and the warning issuance unit 36 were provided in the smart glasses 10, but this is not limited to this, and the comparison unit 31 and the warning issuance unit 36 may also be provided in the work support terminal 80, the server 70, or the control unit 55 of the substrate processing apparatus 50.
[0121] Furthermore, in the fourth embodiment, the worker who removed the grating 47 to form the opening 115 registered the opening 115 as a dangerous location, but the worker who placed a foreign object such as a tool may also register the foreign object as a dangerous location. Alternatively, a worker who did not form a dangerous location himself but noticed a new dangerous location may register the dangerous location in the server 70. In other words, any system may be used as long as the worker registers a change that has occurred in the work area as a dangerous location.
[0122] In the third and fourth embodiments, when a worker wearing the smart glasses 10 enters a work area, the display unit 23 of the smart glasses 10 may display a list of dangerous locations registered in the server 70. In this way, a worker entering a work area can check the dangerous locations in the area in advance.
[0123] Furthermore, in each of the above embodiments, the worker uses smart glasses 10, but this is not limited thereto. Instead of the smart glasses 10, a portable terminal such as a tablet terminal or a smartphone may be used. That is, any portable terminal equipped with an imaging unit, a communication unit, etc. is sufficient. However, since using a tablet terminal or the like would occupy the worker's hands while holding it, it is preferable to use a wearable terminal such as the smart glasses 10.
[0124] Furthermore, the substrate processing apparatus 50 installed in the normal area of the clean room 40 is not limited to a substrate cleaning apparatus, but may be any apparatus that performs a predetermined process on a substrate, such as a heat treatment apparatus, an exposure apparatus, a coating and developing apparatus, a measuring apparatus, or an inspection apparatus. When the substrate processing apparatus 50 is a substrate cleaning apparatus, it may be a single-wafer type cleaning apparatus that cleans substrates one by one, or a batch type cleaning apparatus that cleans multiple substrates at once.
[0125] Furthermore, the work support technology according to the present invention is not limited to substrate processing equipment, but may be applied to any industrial equipment that performs any type of processing, such as a printing processing equipment, a film forming equipment, a medical equipment, and an appearance inspection equipment.
[0126] 5 Information and communication network 10 Smart glasses 21 Imaging unit 22 Communication unit 23 Display unit 24 Memory unit 25 Spatial recognition unit 31 Comparison unit 36 Warning and reporting unit 40 Clean room 47 Grating 49 Yellow room 50, 90 Substrate processing apparatus 52 Processing unit 56 Transfer robot 57 Main transport robot 60 Processing chamber 61 Rotational holding unit 65 Discharge nozzle 70 Server 80 Work support terminal 101, 111 Work area 105, 115 Opening 106, 108 Foreign matter W Substrate
Claims
1. A work support method for performing specified work on industrial equipment, comprising: a pre-registration step of registering a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using a portable terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a spatial recognition step of scanning a space including the specified location using the portable terminal at a specified timing to obtain a target spatial mesh; a comparison step of comparing the target spatial mesh with the reference spatial mesh; and a warning step of issuing a warning if the difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold.
2. A work support method according to claim 1, wherein the spatial recognition step is executed when the illuminance around the worker wearing the mobile device falls below a predetermined reference value.
3. A work support method according to claim 1, wherein when a change occurs in the specified location, the reference space mesh is updated and re-registered.
4. A work support method according to claim 1, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside the substrate processing apparatus.
5. A work support method according to claim 1, wherein the industrial equipment is a substrate processing apparatus which performs a predetermined process on a substrate, and the predetermined location is the inside of a yellow room in which the substrate processing apparatus is located.
6. A work support method according to any one of claims 1 to 5, wherein the mobile terminal is a pair of smart glasses.
7. A work support method for performing specified work on industrial equipment, comprising: a pre-registration step of registering a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using a portable terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a spatial recognition step of scanning a space including the specified location using the portable terminal at a specified timing to obtain a target spatial mesh; a comparison step of comparing the target spatial mesh with the reference spatial mesh; and a post-registration step of registering, when a difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold, a change in the target spatial mesh from the reference spatial mesh detected in the comparison step as a dangerous location.
8. A work support method according to claim 7, further comprising the steps of: deleting the registration of a hazardous location that is a false positive in response to an input from a worker who confirms that the hazardous location registered in the post-registration step is a false positive.
9. A work support method according to claim 7, further comprising a correction registration step of registering a dangerous spot in response to an input from a worker who has identified the dangerous spot when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold value.
10. A work support method as claimed in any one of claims 7 to 9, further comprising an alert issuing step of issuing an alert when it is detected that a worker wearing the mobile device has approached the dangerous location.
11. A work support method according to claim 10, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is a pair of smart glasses.
12. A work support method for when a plurality of workers are working on industrial equipment in a specified work area, comprising: a registration step of registering, in a server, any changes that have occurred in the work area as dangerous spots in response to input from any of a plurality of workers, each of whom is wearing a mobile terminal equipped with a display unit, a communication unit, and a spatial recognition unit; and an acquisition step of the mobile terminal worn by each of the plurality of workers acquiring from the server information about the dangerous spots registered in the registration step.
13. A work support method according to claim 12, further comprising a step of issuing a warning when it is detected that any one of the plurality of workers has approached the dangerous location.
14. A work support method according to claim 12 or 13, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is a smart glass.
15. A work support system for performing specified tasks on industrial equipment using a mobile terminal, comprising: a mobile terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a memory unit that stores a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using the mobile terminal; a comparison unit that compares a target spatial mesh obtained by scanning a space including the specified location using the mobile terminal at a specified timing with the reference spatial mesh; and a warning issuance unit that issues a warning if a difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold value.
16. A work support system according to claim 15, wherein the work support system acquires the target space mesh when the illuminance around the worker wearing the mobile terminal falls below a predetermined reference value.
17. A work support system according to claim 15, wherein when a change occurs in said predetermined location, said reference space mesh is updated and re-stored in said storage section.
18. A work support system according to claim 15, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is inside the substrate processing apparatus.
19. A work support system as described in claim 15, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the predetermined location is the inside of a yellow room in which the substrate processing apparatus is located.
20. A work support system according to any one of claims 15 to 19, wherein the mobile terminal is a pair of smart glasses.
21. A work support system for performing specified tasks on industrial equipment using a mobile terminal, comprising: a mobile terminal equipped with a display unit, a communication unit, and a spatial recognition unit; a memory unit that stores a reference spatial mesh, which is mesh data obtained by scanning a space including a specified location in a normal state using the mobile terminal; a comparison unit that compares a target spatial mesh obtained by scanning a space including the specified location using the mobile terminal at a specified timing with the reference spatial mesh; and a server that registers, when a difference between the target spatial mesh and the reference spatial mesh is equal to or greater than a specified threshold value, a location of change in the target spatial mesh from the reference spatial mesh detected by the comparison unit as a dangerous location.
22. A work support system according to claim 21, wherein in response to an input from a worker who has confirmed that a dangerous spot registered in said server is a false positive, said dangerous spot that is a false positive is deleted from said server.
23. A work support system as claimed in claim 21, wherein, when the difference between the target spatial mesh and the reference spatial mesh is less than a predetermined threshold, the work support system registers the dangerous spot in the server in response to an input from a worker who has identified the dangerous spot.
24. A work support system according to any one of claims 21 to 23, further comprising an alarm issuing unit that issues an alarm when it is detected that a worker wearing the mobile device is approaching the dangerous location.
25. A work support system according to claim 24, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is a smart glass.
26. A work support system for use when multiple workers are working on industrial equipment in a specified work area, comprising: a server that registers any changes that occur in the work area as dangerous areas in response to input from any of multiple workers, each of whom is wearing a mobile device equipped with a display unit, a communication unit, and a spatial recognition unit; and the mobile device worn by each of the multiple workers acquires information about the dangerous areas registered in the server from the server.
27. A work support system according to claim 26, further comprising an alarm issuing unit which issues an alarm when it is detected that any one of the plurality of workers has approached the dangerous location.
28. A work support system according to claim 26 or 27, wherein the industrial equipment is a substrate processing apparatus that performs a predetermined process on a substrate, and the mobile terminal is a pair of smart glasses.
Citation Information
Patent Citations
Safety monitoring system for working machine
JP1993038655A
Transmission system of information on danger
JP2004145807A
Support information display method, maintenance support method for substrate processor, support information display control device, substrate processing system and program
JP2014164482A
Reminder information providing system
JP2017084059A
Working face monitoring system
JP2018017640A
