Methods of operating machine systems and machine systems

Abstract

The present invention relates to a method for operating a machine system (1), the machine system (1) comprising a plurality of machines (2). The machines (2), particularly machine tools with a numerical control or programmable logic controller (CNC) control system, are coupled to a computing system (3) of the machine system (1). The machine system (1) further includes human-machine interfaces (8; 9; 10; 11) for displaying information of the machines (2) and at least one machine operator detection unit (6; 7). The machine operator detection unit (6; 7) is adapted to detect whether a machine operator (4) is near and / or passes by the machine (2), and to collect machine operator behavior data (5). The machine operator detection unit (6; 7) is adapted to send the collected machine operator behavior data (5) to the computing system (3), the computing system (3) being adapted to select information to display to the machine operator (4) based on the machine operator behavior data (5), and to select at least one human-machine interface (8; 9; 10; 11) for displaying the information. Finally, each human-machine interface (8; 9; 10; 11) is adapted to display the selected information.

Description

Technical Field

[0001] The present invention relates to a method for operating a machine system comprising multiple machines, and a machine system comprising multiple machines. Background Technology

[0002] Operating a machine system consisting of multiple machines requires interaction between the machine system and the machine operator, which must be done by at least one machine operator.

[0003] As an example, German patent application DE102009002136A1 discloses a method for displaying a current task list on a graphical user interface of a control computer for a machining machine. When the task list is invoked, only those tasks running on the control computer are displayed; these tasks are listed in a published list. Only tasks published as functions of predetermined, dynamically monitored selection criteria are listed in the published list.

[0004] As another example, Korean patent application KR20090059693A discloses a user information recognition device for reading user identification information input by a user. The device uses an external storage device to store user information. It reads the user information stored in the external storage device and determines whether the user has usage rights by comparing the user identification information recognized from the device with the user information stored in the external storage device. When it is determined that the user has usage rights, it retrieves user interface configuration information stored in the external storage device and configures human-machine interface functional modules corresponding to the machine tool model specified for each user based on the user interface configuration information.

[0005] However, the interaction between machines and machine operators is still subject to strict rules. Summary of the Invention

[0006] One object of the present invention is to provide a method for operating a machine system comprising multiple machines, characterized by improving the interaction between the machine system and the machine operator. Another object of the present invention is to provide a machine system comprising multiple machines, characterized by improving the interaction between the machine system and the machine operator.

[0007] The above objective is achieved through the content of the independent claims.

[0008] On one hand, the present invention provides a method for operating a machine system comprising multiple machines. The machines can be any type of production machine, particularly machine tools equipped with numerical control (NC) or programmable logic controller (PLC) control systems.

[0009] The machine is coupled to the machine system's computing system. The computing system can be a central computing system or a distributed computing system, such as a cloud computing system. The computing system can also be a computing unit of one of the machines or a network of computing units of some of the machines. The computing system can control the machine and also receive information from the machine, such as error messages or alarms.

[0010] The machine system also includes a human-machine interface for displaying machine information, and at least one machine operator detection unit. The machine operator detection unit is adapted to detect whether a machine operator is approaching and / or passing by the machine. The machine operator detection unit can be assigned to the machines in the machine system, but it can also be located between machines or attached to the ceiling above the machines.

[0011] The machine operator detection unit is adapted to collect machine operator behavior data and send the collected data to the computing system. The computing system selects information to display to the machine operator based on the machine operator behavior data and selects at least one human-machine interface (HMI) to display the information. The selected information can be any information related to the machine system and the machine operator, such as informing the operator about the machine system and / or tasks that must be performed within it. Selection based on the machine operator behavior data can optimize the machine system's operation, for example, maximizing productivity or minimizing production costs. As an example, the selection criterion could be the distance between the machine operator and the machine requiring maintenance, prioritizing the machine closest to the operator for maintenance, which could be either routine machine maintenance or routine machine operation. Furthermore, the selection of the HMI for displaying the information can be based on the distance between the HMI and the operator, the HMI's visibility to the operator, or the appropriateness of the information displayed on the HMI; for example, a speaker might not be suitable for displaying charts. Based on this selection, the chosen HMI is suitable for displaying the selected information.

[0012] Because the information to be displayed to the machine operator and the human-machine interface for displaying that information are selected based on the machine operator's behavioral data, there is good interaction between the machine system and the machine operator. Therefore, the machine system can choose the information to display to the machine operator, enabling the machine operator to work more efficiently, thereby allowing the machine system to operate at its most efficient level.

[0013] In one example, the machine is integrated into the middleware operating system of the computing system. Using this method, communication between the machine and the computing system is fast, and the machine is easily addressed from the computing system.

[0014] In one example, the human-machine interface is a panel adapted to display selected information. The panel can display simple information, such as a few words, or complex information, such as charts or graphs. The panel can be a touchscreen display, allowing the machine operator to provide feedback via the panel. Additionally or alternatively, the human-machine interface can be a loudspeaker adapted to play selected information. The advantage of playing information through a loudspeaker is that the machine operator does not need to look at the display screen when receiving information.

[0015] In one example, the human-machine interface located in an area where the operator detection unit does not detect an operator is placed in standby mode. This method can save energy and extend the lifespan of the human-machine interface.

[0016] In one example, the machine operator detection unit includes a proximity sensor, a camera, a wireless communication unit, and / or a radio frequency identification (RFID) unit. The proximity sensor is adapted to detect the approach of a machine operator and is therefore preferably located on or near the machine to detect the distance between the operator and the machine. The camera can be located on or near the machine, but it can also be located more centrally, such as on the ceiling. Specifically, a wide-angle camera can cover a wide area. The wireless communication unit can include a wireless communication device carried or worn by the machine operator. The location of the machine operator can then be determined, for example, by the signal strength between the wireless communication device and one or more wireless transceivers. Similarly, the RFID unit can include an RFID tag carried or worn by the machine operator, and a corresponding RFID reader. Specifically, inputs from several parts of the machine operator detection unit, such as inputs from the proximity sensor for detecting a person's approach to the machine and inputs from the wireless communication device for identifying the person, are used to detect whether a machine operator is approaching and / or passing by the machine.

[0017] In one example, operator behavior data includes operator identity, operator location, operator speed, operator body movement direction, operator current work information, operator focus (i.e., operator attention control), operator attention, and / or operator vital signs. For example, operator identity can be obtained through identification results from wireless communication devices or RFID tags carried or worn by the operator. Operators can also be identified through image recognition results based on camera images. Operator location can be determined based on the distance between the operator and a proximity sensor, the signal strength of wireless communication and / or RFID signals, or analysis of images displaying the operator. Operator speed can be determined from the time series of the operator's location and the corresponding difference quotient. Operator body movement direction, operator focus, and / or operator attention can be determined based on analysis of camera images. Operator current work information can be determined based on analysis of camera images or through feedback from the machine the operator is currently working on. Finally, operator vital signs can be determined through an activity tracker worn by the operator.

[0018] In one example, machine operator behavior data is stored by a computing system, specifically in non-volatile memory. Then, machine operator behavior habits are determined based on this data, for example, through phenomenological models or artificial intelligence.

[0019] Phenomenological models can take a pre-defined machine operator path as input and fit the time required to cover certain parts of the path and the time required to complete a task on the machine based on machine operator behavior data. Artificial intelligence models can also be trained using existing machine operator behavior data. Therefore, the machine operator behavior habits can include information such as the time required for the machine operator to move from one machine to the next, the time required to perform certain tasks on the machine, and the times and durations at which the machine operator starts and stops work and / or rests. The selection of information to be displayed to the machine operator is also based on the determined machine operator behavior habits, thereby enabling the machine system to operate most efficiently. To make this selection, machine operator behavior can be predicted based on the determined machine operator behavior habits, and the effect of the information to be displayed to the machine operator can be modeled. Then, the information to be displayed to the machine operator can be selected and shown on the human-machine interface, thereby providing the most efficient operation of the machine system. As an example, displaying a maintenance alert to the machine operator before they leave to rest may be most effective, allowing them to perform maintenance on the machine so that it can continue operating while the operator is resting.

[0020] In one example, the selected information displayed to the machine operator is chosen from machine status information, production process information, tasks that must be performed on the machine, tasks that will be performed on the machine in the future, and / or warning information. The selection is based on the importance of the information, the urgency of the information, and / or the amount of information that the machine operator can absorb within a given timeframe.

[0021] In one example, in addition to displaying selected information via a human-machine interface, the computing system also triggers an alarm to alert the machine operator to the selected information, specifically when the selected information is an urgent and / or important task and / or a warning. The alarm is designed to draw the machine operator's attention to each selected piece of information.

[0022] In one example, the alarm is visually, auditorily, and / or tactilely perceptible, for example, using light signals, alarm sounds, or vibrations. The light signal may be flashing light, and the alarm sound may be a sound comprising one or more notes. Specifically, the alarm can be encoded; for example, a specific color of the light signal or a specific sequence of notes in the alarm sound can correspond to different levels or types of alarms. Tactile alarms can be generated by a human-machine interface carried or worn by the machine operator, such as a smartphone or smartwatch.

[0023] In one example, the at least one human-machine interface selected for displaying information is the master interface of the machine located near or near the machine operator. The human-machine interface can be directly attached to the corresponding machine or attached to a stand in front of or beside the machine. Alternatively, the at least one human-machine interface selected for displaying information can be a subordinate portable human-machine interface assigned to the machine operator. The subordinate portable human-machine interface can be a smartphone, smartwatch, or headset including a panel and a speaker. Specifically, one human-machine interface can be the master interface, and the other can be the subordinate human-machine interface. As an example, an alarm can be issued to the machine operator via the subordinate human-machine interface, while more information about the alarm is displayed on the master interface.

[0024] In one example, the way information is displayed depends on the specific human-machine interface (HMI) displaying the information, the identity of the machine operator, and / or the distance between the machine operator and the HMI. For example, information about a specific machine requiring repair might be displayed on a small display or via headphones, while a large display might show details of the repair request. In another example, an experienced machine operator might be asked to perform a more difficult task, while an inexperienced operator might simply be asked to notify a more experienced operator. In yet another example, if the machine operator is far from the machine requiring repair, a large panel could display large text indicating the repair request, making it readable from a distance. As the machine operator approaches the machine, the text might become smaller and display more information.

[0025] In one example, if the information displayed to the machine operator is a task to be performed, the machine operator performs the task and confirms its completion with the human-machine interface (HMI). Depending on the type of HMI, this could be done by pressing a button next to the panel, using the panel's touchscreen, or through voice input via a headset microphone. Furthermore, the machine operator can use the HMI to input the reason for any incomplete task. In the latter case, the computing system can reschedule the task, for example, by assigning it to another machine operator.

[0026] On the other hand, the present invention provides a machine system comprising multiple machines. The machines can be any type of production machine, specifically, machine tool equipment with a numerical control (NC) or programmable logic controller (PLC) control system.

[0027] The machine system also includes a computing system, wherein the machine is coupled to the computing system. The coupling may be a wired and / or wireless connection.

[0028] The machine system also includes a human-machine interface (HMI) for displaying machine information, and at least one machine operator detection unit adapted to detect whether a machine operator is approaching and / or passing by the machine, and to collect machine operator behavior data. The HMI can be a master HMI assigned to the machine and / or a subordinate HMI assigned to the machine operator. The machine operator detection unit can be assigned to the machines in the machine system, located between machines, and / or attached to the ceiling above the machines. The machine system operates as described above. Therefore, it can provide good interaction between the machine system and the machine operator, promoting efficient work by the machine operator and enabling the machine system to operate most effectively.

[0029] It is understood that the preferred embodiments of the present invention may also be any combination of dependent claims and corresponding independent claims.

[0030] These and other aspects of this disclosure will become apparent and will be elucidated from the embodiments described below. Attached Figure Description

[0031] Preferred embodiments of the invention will now be described by way of example and with reference to the accompanying drawings, wherein:

[0032] Figure 1 A schematic top view of a machine system is shown;

[0033] Figure 2 A schematic front view of a machine is shown;

[0034] Figure 3a An embodiment of a human-machine interface is shown, and

[0035] Figure 3b Another embodiment of the human-machine interface is shown. Detailed Implementation

[0036] Figure 1 A machine system 1 consisting of multiple machines 2 is shown. The machines 2 can be any type of production machine, specifically, machine tool equipment with a numerical control (NC) or programmable logic controller (PLC) control system.

[0037] The machine 2 is coupled to the computing system 3 of the machine system 1. This coupling can be a wired connection or a wireless connection, which is not shown in the figure for clarity. As an example, the machine 2 can be integrated into the middleware operating system of the computing system 3.

[0038] Figure 1 The diagram also shows a machine operator 4 performing tasks such as inspection, maintenance, or calibration on the machine, and the path walked by the machine operator 4, representing machine operator behavior data 5. In addition to the machine operator's location, the machine operator behavior data 5 may also include machine operator identity, machine operator speed, machine operator body movement direction, machine operator current work information, machine operator focus, i.e., machine operator attention control, machine operator attention, and / or machine operator vital signs.

[0039] Figure 2 A schematic front view of machine 2 is shown. Machine 2 includes a camera 6 and a proximity sensor 7, both used to collect machine operator behavior data 5.

[0040] The machine operator detection unit may also include a wireless communication unit or a radio frequency identification unit, but these are not shown in the figure for clarity.

[0041] The machine 2 also includes a panel 8 and a loudspeaker 9, which constitute the main human-machine interface. Information can be displayed to the machine operator 4 via the panel 8. If the panel 8 is a touchscreen, the machine operator 4 can also input information via the panel 8, such as information about completed or impossible tasks. The loudspeaker 9 can play audio information and / or alert the machine operator 4 to important information, warnings, or error messages.

[0042] Figure 3a and 3b Two examples of subordinate portable human-machine interfaces assigned to machine operator 4 are shown, in which... Figure 3a Smartphone 10 is shown. Figure 3b The headset 11 is shown. Information can be displayed to the machine operator 4 via the smartphone 10, and the machine operator 4 can input feedback on certain information. Information can be played to the machine operator 4 via the speaker 12 of the headset 11, and the machine operator 4 can respond via the microphone 13. Other examples of dependent portable human-machine interfaces include smart glasses and smartwatches.

[0043] In one example, camera 6, proximity sensor 7, and other machine operator detection units collect machine operator behavior data 5 and send it to computing system 3. The computing system 3 collects and stores the machine operator behavior data 5, and then determines machine operator behavior habits based on the data. These habits may include the time required for machine operator 4 to move from one machine 2 to the next, the path taken by machine operator 4 between machines 2, the time spent by machine operator 4 on each machine 2, the additional time required if there is a specific task to complete on a machine 2, and / or the timing and duration of machine operator 4's rest periods.

[0044] Based on the machine operator's behavioral habits, specifically based on machine operator behavior data 5, the computing system 3 selects the information to display to the machine operator 4 and the human-machine interface for displaying that information. For example, the computing system 3 receives an alarm from one of the machines 2, indicating that maintenance work must be performed within the next 15 minutes. In this example, the machine operator 4 happens to be near machine 2. Based on the operator's behavioral habits, the computing system 3 determines that the operator 4 will not return to machine 2 within one hour. Therefore, the computing system 3 reminds the machine operator 4 via the loudspeaker 9 that a task must be performed on machine 2 and displays details of the required maintenance work on the panel 8. After completing the maintenance work, the machine operator 4 confirms this by pressing a button on the panel 8.

[0045] Although the invention has been described in detail in the accompanying drawings and the foregoing description, such description should be regarded as illustrative or exemplary, and not restrictive; the invention is not limited to the disclosed embodiments.

[0046] By studying the accompanying drawings, the disclosure, and the appended claims, those skilled in the art can understand and implement other variations of the disclosed embodiments when practicing this invention. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite terms "a" or "an" do not exclude multiple. Any reference numerals in the claims should not be construed as limiting the scope of protection.

[0047] Figure Labels

[0048] 1 Machine System

[0049] 2 machines

[0050] 3. Computing System

[0051] 4 Machine Operators

[0052] 5 Machine operator behavior data

[0053] 6 cameras

[0054] 7 proximity sensors

[0055] 8 panels

[0056] 9 loudspeakers

[0057] 10 smartphones

[0058] 11 headphones

[0059] 12 speakers

[0060] 13 microphones

Claims

1. A method for operating a machine system (1), comprising: Multiple machines (2), among which, The machine (2) is coupled to the computing system (3) of the machine system (1), the machine system (1) including a human-machine interface (8; 9; 10; 11) for displaying information of the machine (2), and the machine system (1) including at least one machine operator detection unit (6; 7), wherein: The machine operator detection unit (6; 7) detects whether the machine operator (4) is near the machine (2) and / or passes by the machine (2), and collects machine operator behavior data (5). The machine operator detection unit (6; 7) sends the collected machine operator behavior data (5) to the computing system (3). The machine operator behavior data (5) is stored in the computing system (3). The machine operator behavior data (5) determines the machine operator's behavioral habits. The computing system (3) selects information to display to the machine operator (4) based on the machine operator behavior data (5) and the machine operator behavior habits, and selects at least one human-machine interface (8; 9; 10; 11) for displaying the information. The selected human-machine interface (8; 9; 10; 11) displays the selected information.

2. The method according to claim 1, wherein, The machine (2) is integrated into the middleware operating system of the computing system (3).

3. The method according to claim 1, wherein, The human-machine interface (8; 9; 10; 11) is a panel (8; 10) adapted to display selected information and / or a loudspeaker (9; 11) adapted to play selected information.

4. The method according to claim 1, wherein, The human-machine interface (8; 9; 10; 11) located in the area where the machine operator detection unit (6; 7) does not detect the machine operator (4) is placed in standby mode.

5. The method according to claim 1, wherein, The machine operator detection unit (6; 7) includes a proximity sensor (7), a camera (6), a wireless communication unit, and / or a radio frequency identification unit.

6. The method according to any one of claims 1 to 5, wherein, The machine operator behavior data (5) includes the machine operator (4) identity, machine operator (4) location, machine operator (4) speed, machine operator (4) body movement direction, machine operator (4) current work information, machine operator (4) focus, machine operator (4) attention and / or machine operator (4) vital signs.

7. The method according to claim 1, wherein, The selected information displayed to the machine operator (4) is chosen from machine (2) status information, production process information, tasks that must be performed on the machine (2), tasks that will be performed on the machine (2) in the future, and / or warning information.

8. The method according to claim 1, wherein, In addition to displaying the selected information through the human-machine interface (8; 9; 10; 11), the computing system (3) also triggers an alarm to remind the machine operator (4) of the selected information.

9. The method according to claim 8, wherein, The alarm is visually perceived, auditorily perceived, and / or tactilely perceived.

10. The method according to claim 1, wherein, At least one human-machine interface (8; 9; 10; 11) selected for displaying information is the master human-machine interface (8; 9) of the machine (2) located near or close to the machine operator (4) and / or the subordinate portable human-machine interface (10; 11) assigned to the machine operator (4).

11. The method according to claim 1, wherein, The way information is displayed depends on the specific human-machine interface (8; 9; 10; 11) displaying the information, the identity of the machine operator (4) and / or the distance between the machine operator (4) and the human-machine interface (8; 9; 10; 11).

12. The method according to claim 1, wherein, If the information displayed to the machine operator (4) is a task to be performed, the machine operator (4) performs the task and confirms the completion of the task with the human-machine interface (8; 9; 10; 11), or uses the human-machine interface (8; 9; 10; 11) to input the reason why the task was not completed.

13. A machine system (1), comprising: Multiple machines (2), The computing system (3) is coupled to the machine (2). The human-machine interface (8; 9; 10; 11) used to display information about the machine (2), and At least one machine operator detection unit (6; 7) detects whether a machine operator (4) is near the machine (2) and / or passes by the machine (2), and collects machine operator behavior data (5), wherein the machine system (1) operates in accordance with the method described in any one of claims 1 to 12.

Images