Operation control device and operation control method

Abstract

To provide an operation control device and the like which can appropriately control an operation of a work machine according to a body condition of an operator.SOLUTION: A device includes: an acquiring unit for acquiring data related to a vital data of an operator of a work machine; a determination unit for determining a body condition of the operator based on the data acquiring by the acquiring unit using a trained model; and a control unit for controlling operation of the work machine according to the determination result of the determination unit. When the determination result shows a poor body condition, the control unit stops the operation of the work machine. The trained model may be created per operator.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a motion control device and a motion control method. [Background technology]

[0002] Patent Document 1 discloses a shovel equipped with a safety function activation control unit that brakes the operation of the shovel when a deviation operation is detected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-059945 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology disclosed in Patent Document 1 does not allow the operation of the work machine to be appropriately controlled in accordance with the physical condition of the rider.

[0005] Therefore, in one aspect, an object of the present invention is to provide an operation control device and the like that can appropriately control the operation of a work machine in accordance with the physical condition of the rider. [Means for solving the problem]

[0006] In one embodiment, an acquisition unit that acquires data related to the vital signs of a rider of the work machine; a determination unit that determines the physical condition of the occupant based on the data acquired by the acquisition unit using a trained model; a control unit that controls the operation of the work machine in accordance with the determination result by the determination unit; An operation control device is provided, comprising: [Effects of the Invention]

[0007] According to one aspect, the present invention makes it possible to appropriately control the operation of a work machine in accordance with the physical condition of the rider. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an operation control device according to an embodiment of the present invention. [Figure 2] 10 is a flowchart illustrating an example of the operation of the operation control device. DETAILED DESCRIPTION OF THE INVENTION

[0009] FIG. 1 is a diagram showing the configuration of the operation control device of this embodiment.

[0010] 1, the motion control device 10 of this embodiment includes an acquisition unit 11 that acquires data related to the vital signs of a work machine occupant via a millimeter wave sensor 20 attached to the work machine, and a determination unit 12 that uses a trained model to determine the physical condition of the occupant based on the data acquired by the acquisition unit 11. The motion control device 10 also includes a control unit 13 that controls the operation of the work machine in accordance with the determination result by the determination unit 12, and an authentication unit 14 that performs facial authentication of the occupant based on data related to facial authentication of the occupant acquired by the acquisition unit 11 via the millimeter wave sensor 20. Note that work machines include heavy machinery, construction machinery, and forklifts.

[0011] The motion control device 10 can be installed anywhere, for example, on a work machine. Alternatively, the motion control device 10 may be provided as a server or external device. In the latter case, a communication means is provided on the work machine, and data from the millimeter wave sensor 20 can be acquired by the acquisition unit 11 via the communication means. Furthermore, the work machine can acquire a control signal from the control unit 13 via the communication means and use it to control the operation of the work machine.

[0012] Next, the operation of the operation control device 10 will be described.

[0013] FIG. 2 is a flowchart illustrating the operation of the operation control device.

[0014] In step S102 of FIG. 2, the control unit 13 determines whether or not there is a rider on the work machine, and if the determination is affirmative, the process proceeds to step S104.

[0015] In step S104, the authentication unit 14 performs face authentication of the passenger based on the data related to face authentication of the passenger acquired by the acquisition unit 11 via the millimeter wave sensor 20.

[0016] In step S106, the authentication unit 14 determines whether the occupant identified based on the facial authentication in step S104 is qualified to be an operator of a work machine, and if the determination is affirmative, the process proceeds to step S108, and if the determination is negative, the process proceeds to step S102. Note that qualified occupants for each (type of) work machine are registered in association with registration information related to facial features such as a facial photograph, and the authentication unit 14 can perform facial authentication of the occupant based on the registration information and the data related to the facial authentication of the occupant described above.

[0017] In step S108, the determination unit 12 uses the trained model to determine the physical condition of the identified occupant based on the data acquired by the acquisition unit 11 via the millimeter wave sensor 20.

[0018] In step S110, if it is determined in step S108 that there is no abnormality in the physical condition, the control unit 13 advances the process to step S112, and if it is determined in step S108 that there is an abnormality in the physical condition, the control unit 13 advances the process to step S114.

[0019] In step S112, the control unit 13 controls the operation of the work machine based on the operation of the rider, and the process proceeds to step S116.

[0020] In step S114, the control unit 13 stops the operation of the work machine and ends the processing.

[0021] In step S116, the control unit 13 determines whether or not the work has been completed, and if the determination is affirmative, the process ends, and if the determination is negative, the process proceeds to step S108.

[0022] 2, if the operator's physical condition is abnormal (if the operator is in poor health), the operation of the work machine is stopped (step S114). Therefore, even if the operator's physical condition becomes abnormal, operation based on an incorrect operation can be avoided, ensuring work safety.

[0023] Next, we will explain how to generate a trained model.

[0024] In this embodiment, a different trained model is generated for each qualified worker. Specifically, data related to each qualified worker's vital signs, such as pulse, blood pressure, and body temperature, acquired using the millimeter-wave sensor 20 when the worker is healthy, i.e., in good physical condition, is trained and reflected in the trained model. Data related to vital signs can be acquired, for example, by irradiating millimeter waves from the millimeter-wave sensor 20 onto the face or chest of the occupant. The accuracy of determining the physical condition can be improved by making the positional relationship between the millimeter-wave sensor 20 and the occupant during training similar to that when the occupant (qualified worker) actually rides the work machine. For example, data related to vital signs can be acquired using an actual machine equipped with the millimeter-wave sensor 20 and used for training.

[0025] Data relating to vital signs when healthy may differ for each occupant. According to this embodiment, a trained model is generated for each occupant (qualified person), so in step S108, a trained model corresponding to the qualified person who has ridden the work machine is used. This makes it possible to determine the physical condition of each occupant with high accuracy. Furthermore, because the occupant is identified by facial recognition, the occupant and the corresponding trained model can be identified without error, and no input work by the occupant is required for identification.

[0026] Furthermore, if one operator is qualified to operate multiple work machines (types), a different trained model may be generated for each work machine (type). For example, because the position at which the millimeter wave sensor 20 can be installed and the operator's posture differ depending on the work machine, the position and angle at which millimeter waves are irradiated on the operator's face may differ, which may result in differences in data related to vital signs. Furthermore, because the model of the millimeter wave sensor 20 installed varies depending on the time of installation of the work machine, differences in data related to vital signs may also occur. Furthermore, the frequency and amplitude of vibrations during work, which differ depending on the work machine, may affect data related to vital signs. Therefore, by generating a trained model corresponding to each work machine, it is possible to more accurately determine the physical condition of each qualified operator. In this case, data related to vital signs for each work machine may be acquired using an actual machine equipped with the millimeter wave sensor 20 and used for learning.

[0027] Depending on the type of work machine, when it is determined that the occupant's physical condition is abnormal, the operation of the work machine may be stopped after controlling the attitude of the work machine rather than immediately stopping the operation (step S114). For example, when it is determined that the occupant's physical condition is abnormal during work using a crane or the like, the control unit 13 may disable the occupant's operation, guide the crane to a stable attitude, and then stop the crane in that attitude. This ensures safety after operation is stopped. Furthermore, when it is determined that the occupant's physical condition is abnormal, in addition to controlling the operation of the work machine to stop, a predetermined notification (alarm) may be issued to the occupant or an outside person.

[0028] In the above embodiment, the millimeter wave sensor 20 is used to acquire data related to vital signs, but any other sensor may be used. For example, a LiDAR (Light Detection and Ranging) or an ultrasonic sensor may be used.

[0029] As described above, in this embodiment, the operation of the work machine can be appropriately controlled in accordance with the physical condition of the occupant. For example, if the physical condition of the occupant is determined to be abnormal, the operation of the work machine can be stopped, thereby ensuring work safety.

[0030] Although the embodiments have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications and changes are possible within the scope of the claims. In addition, it is also possible to combine all or a plurality of components of the above-described embodiments. [Explanation of symbols]

[0031] 10 Motion control device 11 Acquisition Department 12 Judgment section 13 Control Unit 14 Authentication Section 20 mmWave sensor

Claims

1. an acquisition unit that acquires data related to the vital signs of a rider of the work machine; a determination unit that determines the physical condition of the occupant based on the data acquired by the acquisition unit using a trained model; a control unit that controls the operation of the work machine in accordance with the determination result by the determination unit; An operation control device comprising:

2. The operation control device according to claim 1 , wherein the control unit stops operation of the work machine when the determination result indicates poor physical condition.

3. The motion control device according to claim 1 , wherein the trained model is generated for each passenger.

4. an authentication unit that performs face authentication of the passenger based on the data related to face authentication of the passenger acquired by the acquisition unit; The motion control device according to claim 1 , wherein the facial authentication data and the vital sign data are acquired via a common sensor.

5. an acquisition step of acquiring data relating to vital signs of a rider of the work machine; a determination step of determining the physical condition of the occupant based on the data acquired by the acquisition step using a trained model; a control step of controlling an operation of the work machine in accordance with a determination result in the determination step; An operation control method comprising:

Images