MACHINE CONTROL BASED ON BIOMETRY

A biometric sensor system in work machines adjusts equipment operation based on operator condition, addressing inefficiencies and ensuring safe operation by restricting equipment use when necessary.

DE102024120469A1Pending Publication Date: 2025-01-30CATERPILLAR PAVING PROD INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102024120469
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-24
Filing Date
2024-07-18
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

Existing work machine control systems do not effectively integrate biometric surveillance to manage operator skill and physiological conditions, leading to inefficient and potentially dangerous operation due to fluctuations in operator ability.

Method used

A biometric sensor system integrated into the control elements of work machines collects data on operator physiological parameters, determining a physiological profile to restrict equipment operation based on the operator's condition, ensuring safe and efficient machine operation.

Benefits of technology

The system enhances work machine efficiency and safety by adjusting equipment operation based on operator biometrics, preventing accidents and reducing inefficiencies caused by operator impairment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A control device (122) can receive sensor data from one or more sensors (204) of an operating element (202) of a working machine (100), collected from at least one hand of an operator using the operating element (202). Based on the sensor data, the control device (122) can determine at least one aspect of the operator's physiological profile or the amount of time the operator releases the operating element (202). Based on this at least one aspect of the operator's physiological profile or the amount of time the operator releases the operating element (202), the control device (122) can impose a limitation on the capability of a working tool (112) of the working machine (100).
Need to check novelty before this filing date? Find Prior Art

Description

field of technology

[0001] The present disclosure relates generally to work machines and, for example, work machine control based on biometrics. background

[0002] A work machine, such as a motor grader, backhoe loader, farm tractor, wheel loader, skid steer, and / or other heavy equipment, is used for a variety of tasks that require operator control of the work machine and various work tools associated with the work machine. The work machine and work tools can be complex and difficult to operate. Thus, any decline in the skill or ability of a work machine operator can significantly impact the operation of the work machine. In some cases, the operator's performance may fluctuate based on a physiological condition of the operator (e.g., the operator's heart rate, the operator's blood oxygen level, or the like). Accordingly, a deterioration in the physiological condition may cause the work machine to operate ineffectively and / or inefficiently.This may result in tasks being completed slowly and / or at a low quality level, requiring additional time to complete tasks, correction of completed tasks, and / or repetition of tasks.

[0003] U.S. Patent No. 9,775,565 (the '565 patent) discloses a system that monitors a vehicle operator's ethanol alcohol content by collecting perspiration from the operator's hands and, if appropriate, detecting the presence of ethanol in the perspiration. The '565 patent states that if the measurable ethanol in collected moisture from the operator's hands exceeds a preset threshold, the system could be configured to warn the operator to park the vehicle and thereafter disable the vehicle. Furthermore, the '565 patent discloses a system that monitors the operator's pulse rate and oxygen level. The '565 patent states that if the pulse rate and / or oxygen level are outside of normal parameters for an operator, the system will warn the operator to park the vehicle and thereafter disable the immobile vehicle.

[0004] The '565 patent does not describe integrating a monitoring system into the controls of a work machine (e.g., a joystick). For example, an operator of a work machine may operate and interact with controls of a work machine differently than an operator of a vehicle would operate and interact with a vehicle's steering wheel. Furthermore, the '565 patent does not describe limiting the capabilities of a work tool of a work machine (e.g., a bucket, shovel, or the like). For example, the work machine may be capable of moving, similar to a vehicle, but also be capable of operating the tool. Accordingly, when a work machine is disabled, there may be considerations for preventing damage to work being performed at a worksite that do not apply to a vehicle.

[0005] The control system of the present disclosure solves one or more of the above-mentioned problems and / or other problems in the art. Brief description

[0006] A work machine may include a work implement, an operating element including one or more biometric sensors positioned to be contacted by at least one hand of an operator using the operating element, and a controller. The controller may be configured to receive, from the one or more biometric sensors, biometric sensor data collected from the at least one hand of the operator. The controller may be configured to determine a physiological profile of the operator based on the biometric sensor data. The controller may be configured to cause a limitation of a capability of the work implement based on the physiological profile of the operator.

[0007] A control system for a work machine may include one or more sensors for an operating element of the work machine, configured to collect sensor data relating to an operator using the operating element. The control system may include a controller configured to receive, from the one or more sensors, sensor data collected from the at least one hand of the operator using the operating element. The controller may be configured to cause a limitation of a capability of an implement of the work machine based on the sensor data.

[0008] A method may include obtaining, by a controller and from one or more sensors of an operator's control of a work machine, sensor data collected from at least one hand of an operator using the operator's control. The method may include determining, by the controller and based on the sensor data, at least one of a physiological profile of the operator or an amount of time the operator releases the operator's control. The method may include causing, by the controller and based on the at least one of the physiological profile of the operator or the amount of time the operator releases the operator's control, a limitation of a capability of an implement of the work machine. Brief description of the drawings Fig. 1 is a perspective view of an exemplary machine. Fig. Figure 2 is a schematic diagram of an example control system. Fig. 3 is a flowchart of an example method related to controlling a device of a machine based on an operator impairment. Detailed description

[0009] This disclosure relates to a control system that can be applied to any machine that is mobile and / or that uses an implement. The machine may be, for example, a compactor, a paver, a cold planer, a grader, a backhoe loader, a wheel loader, a harvester, an excavator, a motor grader, a skid steer loader, a tractor, a bulldozer, or the like.

[0010] Fig. 1 is a perspective view of an exemplary machine 100. The machine 100 may perform earthmoving, excavation, or other work related to an industry, such as, among other examples, construction or mining. That is, the machine 100 is a work machine. For example, the machine 100, as shown in Fig. 1 illustrates a bulldozer. However, machine 100 may be another type of machine, as described above.

[0011] The machine 100 includes a frame 102 supported by a chassis 104 used to propel the machine 100 in a forward and / or reverse direction. Stated differently, the machine 100 is a mobile machine. The chassis 104 is configured to engage a ground surface, such as a road or other type of terrain. As shown, the chassis 104 includes a pair of tracked screeds 106 driven by respective drive wheels 108. Although the machine 100 is illustrated as having tracks 106, the chassis 104 may additionally or alternatively include one or more wheels for propelling the machine 100.

[0012] The frame 102 supports a prime mover 110. The prime mover 110 may include, among other examples, an engine (e.g., an internal combustion engine), such as a diesel engine, a gasoline engine, or a gas engine. Additionally or alternatively, the prime mover 110 may include an electric motor (e.g., for electrically powering the machine 100 or hybrid powering the machine 100 with the engine). The prime mover 110 is configured to provide power to drive the tracks 106. Further, the prime mover 110 is configured to provide power to an implement 112 (e.g., by driving one or more hydraulic pumps that provide pressurized fluid to one or more actuators of the machine 100).

[0013] In Fig. 1, the implement 112 (e.g., a work tool) is illustrated as a bucket. However, the implement 112 may be, among other examples, a bucket, a bucket, a moldboard, a compaction drum, a milling drum, a hook, and / or a ripper. The implement 112 may be moved relative to the frame 102. For example, the implement 112 may be pivotally connected to the frame 102 by arms 114 on each side of the machine 100. One or more first hydraulic cylinders 116 may be coupled to the frame 102 to support the implement 112 in the vertical direction and to allow the implement 112 to move vertically up or down. Additionally, one or more second hydraulic cylinders 118 may be included on each side of the machine 100 to allow an inclination or angle (e.g., an angle of attack) of the implement 112 to change.The first and second hydraulic cylinders 116, 118 may be actuators that receive actuation instructions to adjust, raise, lower, or otherwise move and / or position the implement 112. In some examples, the implement 112 may be connected to the frame 102 by a boom assembly (e.g., including a boom member and a stick member) configured to be articulated relative to the frame 102 by one or more hydraulic cylinders.

[0014] An operator station 120 may be supported on the frame 102. The operator station 120 may include one or more displays and / or one or more controls to operate and / or drive the machine 100. For example, the controls may include a joystick, a lever, and / or a knob, among other examples. The machine 100 includes a controller 122 for electrically controlling various aspects of the machine 100. The controller 122 may, for example, send and receive signals to and from various components of the machine 100 during operation of the machine 100.

[0015] In some implementations, the machine 100 may be remotely controllable by an operator located external to the machine 100 via a remote control device 124. The remote control device 124 may include one or more input devices configured to control the propulsion of the machine 100, the steering of the machine 100, and / or the actuation (e.g., movement) of the implement 112. For example, the input devices may include one or more joysticks, one or more control handles, and / or one or more touchpads. Based on inputs provided via the input devices, the remote control device 124 may transmit commands to the control device 122 (e.g., wirelessly as radio signals). The control device 122 may interpret the commands and cause the machine 100 to operate according to the commands.

[0016] As stated above, Fig. 1 is provided as an example. Further examples may differ from what is stated in relation to Fig. 1 is described.

[0017] Fig. 2 is a schematic diagram of an exemplary control system 200. The control system 200 may provide control of a drive system, a steering system, and / or an implement system of the machine 100. The control system 200 includes the controller 122 and an operator control element 202 (e.g., the operator station 120).

[0018] The control device 122 may include one or more memories and one or more processors communicatively coupled to the one or more memories. A processor may include a central processing unit, a graphics processing unit, a microprocessor, a controller, a microcontroller, a digital signal processor, a field-programmable gate array, an application-specific integrated circuit, and / or another type of processing component. The processor may be implemented in hardware, firmware, or a combination of hardware and software. The processor may be capable of being programmed to perform one or more operations or processes described elsewhere herein. A memory may include volatile and / or non-volatile memory.For example, the memory may include random access memory (RAM), read-only memory (ROM), a hard disk drive, and / or another type of storage (e.g., flash memory, magnetic storage, and / or optical storage). The memory may be a non-transitory, computer-readable medium. The memory may store information, one or more instructions, and / or software (e.g., one or more software applications) related to the operation of the controller 122. The controller 122 may be configured to perform one or more of the operations described herein.

[0019] The control element 202 is a device that is manually operated by an operator of the machine 100. The control element 202 may be a joystick, as shown in Fig. 2. Alternatively, the control element 202 may be a steering wheel, a lever, or another type of device controllable by at least one hand of the operator. In some implementations, the control element 202 is the remote control device 124. The control element 202 may be configured to control the propulsion of the machine 100, the steering of the machine 100, and / or the implement 112.

[0020] The control element 202 includes one or more sensors 204 (e.g., a plurality of sensors 204) positioned to be touched by at least one hand of an operator using the control element 202. For example, the one or more sensors 204 may be embedded in the control element 202 or attached to a surface of the control element 202. For example, the sensors 204 may include one or more first sensors 204 positioned to be touched by a first finger of the operator and one or more second sensors 204 positioned to be touched by a second finger of the operator. A sensor 204 may include a biometric sensor (e.g., a sensor that collects data related to a biometric associated with an individual).A sensor 204 may include, among other examples, a heart rate monitor, a pulse sensor, a blood oxygen sensor, a pulse oximeter, a respiration rate sensor, a blood alcohol sensor, and / or a touch sensor (e.g., a touch switch, a piezoelectric sensor, or the like).

[0021] Sensors 204 may be configured to collect sensor data related to an operator when the operator uses control element 202. For example, sensors 204 may collect sensor data continuously while the operator uses control element 202. One or more sensors 204 may collect biometric sensor data related to, among other examples, an operator's heart rate, an operator's blood oxygen level, an operator's respiration rate, and / or an operator's blood alcohol content. Additionally or alternatively, one or more sensors 204 (e.g., one or more touch sensors) may collect sensor data related to whether the operator (e.g., a hand of the operator) is in contact with control element 202.

[0022] The controller 122 may receive, from the sensor(s) 204, sensor data (e.g., biometric sensor data) collected from at least one hand of the operator (e.g., while the operator is using the control element 202). For example, the controller 122 may periodically (e.g., every 10 seconds, every 1 second, every 0.5 seconds, or the like) receive sensor data from the sensor(s) 204. As described above, the sensor data may relate to an operator's heart rate, an operator's blood oxygen level, an operator's respiration rate, an operator's blood alcohol content, and / or whether the operator (e.g., an operator's hand) is touching the control element 202.

[0023] In some implementations, to obtain the sensor data, the controller 122 may obtain first sensor data from the first sensor(s) 204 positioned to contact the operator's first finger, and second sensor data from the second sensor(s) 204 positioned to contact the operator's second finger. The first sensor data and the second sensor data may be collected by the first sensor(s) 204 and the second sensor(s) 204, respectively, simultaneously or sequentially (e.g., in rapid succession). The first sensor data and the second sensor data may be different (e.g., even though the first sensor data and the second sensor data were collected at the same or approximately the same time), due to noise (e.g., caused by machine vibration), due to the operator using an inappropriate hand position, and / or due to foreign substances (e.g.,Sweat, grease, dirt, or the like) that affect the measurements of the first sensor(s) 204 and the second sensor(s) 204.

[0024] The controller 122 may determine sensor data to be used by the controller 122 based on the first sensor data and the second sensor data. For example, the controller 122 may discard one of the first sensor data and the second sensor data, and the controller 122 may use the non-discarded one as the sensor data. The controller 122 may discard the first sensor data or the second sensor data if the first sensor data or the second sensor data has an amount of deviation from reference data (e.g., previous sensor data or standard data) that meets or exceeds a threshold. As another example, the controller 122 calculates an average of the first sensor data and the second sensor data, and the controller 122 may use the average as the sensor data.As another example, the controller 122 may perform a data fusion or sensor fusion technique on the first sensor data and the second sensor data, and the controller 122 may use the fused data as the sensor data.

[0025] Sensor data related to the operator's biometrics is collected, processed, and / or stored by machine 100 in accordance with applicable laws and regulations. Controller 122 may determine a physiological profile of the operator based on the sensor data. For example, as sensor data is obtained by controller 122, controller 122 may determine (e.g., update) the operator's physiological profile (e.g., in real time).

[0026] In some examples, the operator's physiological profile may indicate a set of biometrics for the operator (e.g., a heart rate, a blood oxygen level, and / or a blood alcohol level, among other examples). For example, the controller 122 may determine one or more biometrics for the operator based on the sensor data. In some examples, the operator's physiological profile may indicate a classification of the operator (e.g., no impairment, mild impairment, moderate impairment, severe impairment, or the like) based on a set of the operator's biometrics. The controller 122 may determine the classification of the operator using a machine learning model that (e.g.,based on historical biometric information associated with one or more operators) to output a classification of an operator based on an input of a set of biometrics for the operator. Additionally or alternatively, the controller 122 may determine the classification of the operator by comparing the biometrics to thresholds or reference biometrics (e.g., associated with an unimpaired physiological state) and calculating the classification based on amounts by which the biometrics deviate from the reference biometrics. In some examples, the physiological profile may specify a set of biometrics for the operator and associated classifications for the biometrics (e.g., "heart rate: high; blood oxygen level: very low"). The controller 122 may output classifications for biometrics (e.g.,very low, low, normal, high, very high, or the like) by comparing the biometrics with threshold or reference biometrics.

[0027] In some implementations, the controller 122 may detect whether the operator's hands are away from the control 202. For example, the controller 122 may detect an amount of time the operator releases the control 202 based on sensor data collected by the sensor(s) 204 (e.g., touch sensor(s)).

[0028] The controller 122 may cause one or more capabilities of the machine 100 to be limited based on the sensor data. In particular, the controller 122 may cause one or more capabilities of the machine 100 to be limited based on the operator's physiological profile and / or based on whether the operator has released the control element 202. For example, the controller 122 may cause a limitation of a capability of the device 112 and / or a limitation of a propulsion capability of the machine 100 (e.g., an ability of the machine 100 to move forward or backward) based on the operator's physiological profile.Additionally or alternatively, the controller 122 may cause the limitation of the capability of the device 112 and / or the limitation of the drive capability of the machine 100 based on the sensor data indicating that the operator has released the control element 202 for an amount of time (e.g., continuously or cumulatively) that meets a threshold (e.g., 20 seconds, 30 seconds, or the like).

[0029] The limitation of the capability of the device 112 may be a limitation of a movement of the device 112 (e.g., a throttling of the device 112, such as by placing an upper limit and / or a lower limit on an angular position of the device 112, an angle of attack of the device 112, a raising or lowering of the device 112, a lateral translation of the device 112, a rotation of the device 112, an oscillation of the device 112, or the like) or may be a deactivation of the device 112. To cause the limitation of the capability of the device 112, the controller 122 may block (e.g., reject or ignore) operator commands to move the device 112 in violation of the limitation, the controller 122 may remove or reduce power to the device 112, the controller 122 may limit an output of a pump that controls one or more hydraulic actuators for the device 112, or the like.The restriction of the driveability of the machine 100 may be a restriction of the driveability (e.g., a throttling of the driveability, such as by setting a speed limit for the driveability) or may be a disabling of the driveability (e.g., disabling forward and / or reverse drive of the machine 100, forcing the machine 100 into a parking lock, or the like). To cause the restriction of the driveability of the machine 100, the controller 122 may block (e.g., reject or ignore) operator commands to drive the machine 100 in violation of the restriction, the controller 122 may cause a throttling of the prime mover 110 of the machine 100, the controller 122 may cause engagement of a brake of the machine 100, the controller 122 may cause engagement of a parking lock of the machine 100, or the like.

[0030] In some examples, the controller 122 may cause the limitation of the capability of the device 112 (e.g., limiting the movement of the device 112 or disabling the device 112) in response to the physiological profile indicating a first physiological condition of the operator (e.g., moderate impairment of the operator). Further, the controller 122 may cause an additional limitation of the driveability of the machine 100 in response to the physiological profile indicating a second (e.g., worse) physiological condition of the operator (e.g., severe impairment of the operator). In other words, when the operator has an impairment level, the controller 122 may first limit the capability of the device 112, and as the operator's impairment level worsens, the controller 122 may further limit the driveability of the machine 100 (e.g.,, because operating the device 112 may require greater dexterity than controlling the drive of the machine 100. In this way, at an initial level of impairment, damage due to poor operation of the device 112 may be mitigated, but the machine 100 may continue to be operated to allow the machine 100 to be returned to a holding area to mitigate damage that may be caused by the mere presence of the machine 100 on a jobsite (e.g., due to a weight of the machine 100, due to interference by the machine 100 with other machines, or the like). However, at a higher level of impairment, the driveability of the machine 100 may also be limited to mitigate damage that may be caused by erratic or random driving of the machine 100.In some examples, the drive capability may be restricted first and the device 112 may be restricted second.

[0031] In some examples, to cause the restriction on the capability of the device 112 and / or the restriction on the drive capability of the machine 100, the controller 122 may adjust the restriction as the operator's physiological profile changes over time. For example, the controller 122 may cause a relaxation of the restriction based on improvements in the physiological profile (e.g., a decreasing deviation of the physiological profile from a physiological reference profile), and the controller 122 may cause a further restriction of the restriction based on a deterioration of the physiological profile (e.g., an increasing deviation of the physiological profile from a physiological reference profile).In some examples, to cause the limitation of the capability of the device 112 and / or the limitation on the drive capability of the machine 100, the controller 122 may cause the capability of the device 112 and / or the drive capability of the machine 100 to be gradually limited. For example, gradually limiting the capability of the device 112 and / or the drive capability of the machine 100 may include increasing (e.g., continuously or in steps) a limitation level of the device 112 and / or the drive up to a complete disabling of the device 112 and / or the drive. The controller 122 may gradually limit the capability of the device 112 and / or the drive capability of the machine 100 as the physiological profile of the operator changes.For example, the controller 122 may gradually limit the capability of the device 112 and / or the drive capability of the machine 100 in association with the physiological profile increasingly deviating from a physiological reference profile and / or the progressively downgrading of an operator classification.

[0032] The controller 122 may transmit a request for a new operator for the machine 100 to a device remote from the machine 100 (e.g., a back office device, a device associated with a jobsite supervisor, a device associated with an owner of the machine 100, an external control device, or an external display). Additionally or alternatively, the controller 122 may transmit an alert to the device remote from the machine 100 indicating a recommendation to monitor or intervene in the work machine. For example, the controller 122 may transmit the request and / or alert in response to causing the limitation of the capability of the device 112 and / or the limitation of the drive capability of the machine 100.As another example, the controller 122 may transmit the request and / or the warning in response to the operator's physiological profile indicating an impairment of the operator. In some examples, the controller 122 may transmit to the device an indication that the operator is impaired in response to the operator's physiological profile indicating an impairment of the operator. The indication may enable a supervisor of the operator to take appropriate action regarding the operator's impairment (e.g., shutting down the machine 100, replacing the operator with a new operator, or the like).

[0033] The control device 122 may receive input indicating that the machine 100 should be returned to normal operation (e.g., to operation without limiting the capability of the device 112 and / or limiting the drive capability of the machine 100). For example, the input may be provided via a console of the machine 100 or via a device remote from the machine 100 (e.g., a back office device, a device associated with a jobsite supervisor, or a device associated with an owner of the machine 100). The input may be provided by a jobsite supervisor for the machine 100, an owner of the machine 100, the new operator of the machine 100, or the like (e.g., having a password, key, or the like that allows the input to be provided).

[0034] As stated above, Fig. 2 is provided as an example. Further examples may differ from what is stated in relation to Fig. 2 is described.

[0035] Fig. 3 is a flowchart of an example method 300 related to controlling a device of a machine based on an operator impairment. One or more method blocks of Fig. 3 may be performed by a control device (e.g., the control device 122). Additionally or alternatively, one or more process blocks may be Fig. 3 be performed by another device or group of devices that are separate from or include the control device, such as another device or another component located inside or outside the machine 100.

[0036] As in Fig. 3, the method 300 may include obtaining, from one or more sensors of a control of a work machine, sensor data collected from at least one hand of an operator using the control (block 310). For example, the controller may receive, from one or more sensors of a control of a work machine, sensor data collected from at least one hand of an operator using the control, as described above. The one or more sensors may include one or more of a heart rate sensor, a blood oxygen sensor, or a blood alcohol sensor. The control may be a joystick or a remote control device for the work machine.

[0037] The one or more sensors may include one or more first sensors positioned to be touched by a first finger of the operator and one or more second sensors positioned to be touched by a second finger of the operator. Obtaining the sensor data may include obtaining first sensor data from the one or more first sensors and second biometric sensor data from the one or more second sensors, and determining the sensor data based on the first sensor data and the second sensor data.

[0038] As further stated in Fig. 3, the method 300 may include determining, based on the sensor data, at least one of a physiological profile of the operator or an amount of time the operator releases the control (block 320). For example, the controller may determine, based on the sensor data, at least one of a physiological profile of the operator or an amount of time the operator releases the control, as described above. For example, the one or more sensors may be touch sensors, and determining the amount of time the operator releases the control may include detecting, based on the sensor data from the one or more touch sensors, an amount of time the operator releases the control.

[0039] As further stated in Fig. 3, method 300 may include causing a limitation of a capability of an implement of the work machine based on at least one of the operator's physiological profile or the amount of time the operator releases the control (block 330). For example, the controller may cause a limitation of a capability of an implement of the work machine based on at least one of the operator's physiological profile or the amount of time the operator releases the control, as described above. The implement may be a compaction drum, a boom assembly, a milling drum, or a bucket. The limitation of the implement's capability may be deactivation of the implement.

[0040] Alternatively, the restriction on the capability of the implement may be a restriction on the movement of the implement.

[0041] Causing the limitation of the implement's capability may involve causing the implement's capability to gradually become limited as the operator's physiological profile changes. The operator's physiological profile and the amount of time the operator releases the control element may be determined, and the limitation of the implement's capability may be caused based on the operator's physiological profile and the amount of time the operator releases the control element.

[0042] Causing the limitation of the capability of the work machine may include causing the limitation of the capability of the work machine in response to the sensor data indicating a first physiological condition of the operator, and method 300 may include causing an additional limitation of a drive capability of the work machine in response to the sensor data indicating a second physiological condition of the operator. In some examples, method 300 may include transmitting, to a device, a request for a new operator for the work machine in response to causing the limitation of the capability of the work machine.

[0043] Although Fig. 3 example blocks of the method 300, in some implementations the method 300 may include additional blocks, fewer blocks, different blocks, or differently arranged blocks than those in Fig.3. Additionally or alternatively, two or more of the blocks of method 300 may be executed in parallel. Industrial applicability

[0044] The control system described herein can be used with any work machine that is mobile and / or that utilizes a work implement. For example, the control system can be used with a work machine that can be controlled by an operator using a control, such as a joystick or a remote control device. The work machine and work implement can be complicated and difficult for the operator to operate via the control. Thus, any decline in the operator's skill or ability can have a significant impact on the operation of the work machine. In some cases, the operator's performance may fluctuate based on a physiological condition of the operator (e.g., the operator's heart rate, the operator's blood oxygen level, or the like).Accordingly, a deterioration in physiological condition may result in the work machine operating ineffectively and / or inefficiently. This may result in tasks being performed slowly and / or at a low level of quality, requiring additional time to complete tasks, correction of completed tasks, and / or repetition of tasks, which may result in excessive machine hours being used, increased machine wear, and / or increased fuel consumption.

[0045] The control system described herein is useful for reducing or preventing ineffective and / or inefficient operation of a work machine caused by a deterioration in the physiological state of an operator. In particular, the control system may use sensors in a control element to capture biometrics associated with an operator, such as, among other examples, heart rate, blood oxygen level, and / or blood alcohol content. In some examples, the control system may use multiple sensors positioned in the control element to capture biometrics from different fingers of the operator, thereby improving the quality of the collected sensor data (e.g., using sensor fusion). Based on the captured biometrics, the control system may limit the capabilities of the work device and / or a drive capability of the work machine as needed.In this way, the control system can improve the efficiency and quality with which tasks are performed using the work machine. Accordingly, the control system can improve the speed with which tasks are performed using the work machine and / or reduce the need for the work machine (or another machine) to perform corrective or repetitive tasks, thereby saving machine hours, reducing machine wear, and / or saving fuel.

[0046] The foregoing disclosure provides illustrations and description, but is not intended to be exhaustive or to limit implementations to the precise forms disclosed. Modifications and variations may be made in light of the foregoing disclosure or learned from practice of implementations. Moreover, any of the implementations described herein may be combined unless the foregoing disclosure expressly provides a reason why one or more implementations may not be combined. Although particular combinations of features are recited in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various implementations.Although each dependent claim listed below may depend directly on only one claim, the disclosure of various implementations includes each dependent claim in combination with every other claim in the claim set.

[0047] As used herein, "a," "an," and "set" are intended to include one or more items and may be used interchangeably with "a, an, one, or more." Furthermore, the article "the," as used herein, is intended to include one or more items referred to in conjunction with the article "the," and may be used interchangeably with "the one or more." Further, the phrase "based on" is intended to mean "at least in part based on," unless expressly stated otherwise. Additionally, the term "or," when used in a series, is intended to be inclusive and may be used interchangeably with "and / or" unless expressly stated otherwise (e.g., when used in combination with "either" or "only one of"). QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 9,775,565

[0003]

Claims

[1] Work machine (100), comprising: a working tool (112); an operating element (202) comprising one or more sensors (204) positioned to be contacted by at least one hand of an operator using the operating element (202); and a control device (122) configured to: Obtaining, from the one or more biometric sensors (204), biometric sensor data collected from the at least one hand of the operator; Determining, based on the biometric sensor data, a physiological profile of the operator; and Cause, based on the physiological profile of the operator, a limitation of a capability of the work equipment (112). [2] The work machine (100) of claim 1, wherein limiting the capability of the work tool (112) is deactivating the work tool (112). [3] The work machine (100) of claim 1, wherein the limitation of the capability of the work tool (112) is a limitation of movement of the work tool (112). [4] The work machine (100) of any of claims 1-3, wherein the one or more biometric sensors (204) include one or more first biometric sensors (204) positioned to be touched by a first finger of an operator using the control element (202) and one or more second biometric sensors (204) positioned to be touched by a second finger of an operator using the control element (202). [5] Work machine (100) according to any one of claims 1-4, wherein the control device (122) for causing the limitation of the capability of the work device (112) is configured to: Causing the limitation of the capability of the work device (112) in response to the biometric sensor data indicating a first physiological state of the operator, and wherein the control device (122) is further configured to: Causing an additional restriction of a drive capability of the work machine (100) in response to the biometric sensor data indicating a second physiological state of the operator. [6] The work machine (100) of any of claims 1-5, wherein the one or more biometric sensors (204) comprise one or more of a pulse sensor, a blood oxygen sensor, or a blood alcohol sensor. [7] Control system for a work machine (100), comprising: one or more sensors (204) for an operating element (202) of the work machine (100) configured to collect sensor data relating to an operator using the operating element (202); and a control device (122) configured to: Obtaining, from the one or more sensors (204), sensor data collected from the at least one hand of the operator using the control element (202); and Causing, based on the sensor data, a restriction of a capability of a working device (112) of the work machine (100). [8] The control system of claim 7, wherein the control device (122) to cause the limitation of the capability of the work device (112) is configured to: Causing, based on the sensor data indicating that the operator has released the control element (202) for a period of time that meets a threshold, the limitation of the capability of the work device (112). [9] Control system according to one of claims 7-8, wherein the operating element (202) is a joystick or a remote control device of the work machine (100). [10] The control system of any of claims 7-9, wherein the control device (122) is further configured to: Transmitting, to a device remote from the work machine (100), an alert indicating a recommendation to monitor the work machine (100) or intervene with the work machine (100), or a request for a new operator for the work machine (100) in response to causing the limitation of the capability of the work device (112).

Citation Information

Patent Citations

  • Device and system for monitoring operator biometric condition and blood alcohol presence to prevent driving of a vehicle by an alcohol or otherwise impaired operator

    US9775565B1

  • US-PATENTNR.9,775,565