OBJECT DETECTION-ABUSE PREVENTION

Abstract

A system (200) for preventing misuse of an object detection system (150) of a work machine (100) may include an output device (214) and a controller (202) communicatively coupled to the output device (214). The output device (214) is configured to display a notification (410) indicating misuse of the object detection system (150). The controller (202) includes a processing circuit (204) comprising a memory (208) communicatively coupled to one or more processors (206).The memory (208) includes instructions thereon that, when executed by the one or more processors (206), cause the processing circuitry (204) to: detect a collision mitigation event of the work machine (100); classify the collision mitigation event as a misuse event; determine a misuse value associated with work machine operation based on the misuse event; compare the misuse value to a misuse threshold; and, if the misuse value exceeds the misuse threshold, provide the notification (410) indicating misuse of the object detection system (150) to the output device (214).

Description

Technical field

[0001] This application generally relates to hydraulic systems such as those used on work machines, including heavy construction equipment, agricultural equipment, and other machines used to perform work. More particularly, this application relates to work machines having systems for detecting objects. State of the art

[0002] In the context of construction, the environment of vehicles, and particularly work machines, can include unpredictable terrain and many types of varying objects / obstacles. While work machines operate on roads and / or construction site paths, the environment can also include undefined spaces surrounded by or encompassing other equipment, trailers, construction materials, ground features including mountains, holes, cliffs, hills, accumulations, people, other vehicles, and / or other obstacles or objects. The varying terrain and the presence of obstacles have been addressed in part by the development of object detection systems for work machines and their environment. A work machine can be equipped with sensor and control systems (e.g.Object detection systems (Object Detection Systems) that can detect the presence of an obstacle, hazard, or impending collision and implement collision mitigation events to warn the operator and / or prevent the collision. For example, object detection systems can trigger an alarm on the work machine when it approaches another vehicle, or they can automatically slow, stop, or prevent the operation of the work machine or a component thereof to prevent the work machine from colliding with a detected obstacle / object.

[0003] While object detection systems mitigate unintended collisions caused by inattentive or careless operators, these systems can tempt operators to overrely rely on their safety / control features. For example, some operators may be tempted to let the object detection system brake, slow down, or change the path of the work machine, rather than actively controlling the work machine to avoid the hazard / obstacle in the first place. In this way, an operator may detect an object in the path of the work machine and continue toward it, confident that the object detection system will activate to avoid the obstacle. Such behavior may be classified as misuse of the object detection system and increase the likelihood of collisions (e.g.,in cases where the object detection system fails to detect an obstacle that the operator knowingly approaches). This disclosure relates, in part, to solutions for preventing operator misuse of object detection systems and for encouraging / training operators to actively operate their work machines to avoid obstacles, using the object detection systems as a safety measure rather than as an "autopilot." Brief description

[0004] A first aspect provided herein relates to a system for preventing misuse of an object detection system of a work machine. The system includes an output device and a controller communicatively coupled to the output device. The output device is configured to display a notification indicating misuse of the object detection system. The controller includes processing circuitry including a memory communicatively coupled to one or more processors.The memory includes instructions that, when executed by the one or more processors, cause the processing circuitry to: detect a work machine collision mitigation event; classify the collision mitigation event as a misuse event; determine a misuse value associated with work machine operation based on the misuse event; compare the misuse value to a misuse threshold; and, if the misuse value exceeds the misuse threshold, provide the notification indicating misuse of the object detection system to the output device.

[0005] A second aspect provided herein relates to a method for preventing misuse of an object detection system of a work machine. The method may include the steps of: detecting, by one or more processors, a collision mitigation event of the work machine; classifying, by the one or more processors, the collision mitigation event as a misuse event; determining, by the one or more processors, a misuse value associated with work machine operation based on the misuse event; comparing, by the one or more processors, the misuse value to a misuse threshold; and, if the misuse value exceeds the misuse threshold, providing, by the one or more processors, a notification indicating misuse of the object detection system to an output device.

[0006] A third aspect provided herein relates to a work machine. The work machine includes an object detection system, an output device, and at least one processing circuit. The object detection system includes a sensor coupled to the work machine and a controller. The sensor is configured to detect an obstacle in a path of the work machine. The controller is configured to initiate a collision mitigation event to avoid the obstacle. The output device is configured to display a notification indicating misuse of the object detection system. The processing circuit includes at least one memory coupled to at least one processor.The memory has instructions stored therein that, when executed by the at least one processor, cause the at least one processor to: detect the work machine collision mitigation event, classify the collision mitigation event as a misuse event, determine a misuse value associated with work machine operation based on the misuse event, compare the misuse value to a misuse threshold, and if the misuse value exceeds the misuse threshold, provide the notification indicating misuse of the object detection system to the output device.

[0007] This summary is illustrative only and is not intended to be limiting in any way. Additional aspects, inventive features, and advantages of the presently described devices or processes will become apparent in the detailed description taken in conjunction with the accompanying figures, wherein like reference numerals refer to like elements. Short description of the drawings Fig. 1 is an exemplary perspective view of a work machine equipped with an object detection system; Fig. 2 is an illustration and schematic diagram of the exemplary work machine and object detection system of Fig. 1; Fig. 3 is a block diagram illustrating an exemplary configuration of an object detection system and an object detection misuse prevention system; Fig. 4 is a block diagram illustrating an exemplary configuration of an object detection misuse prevention system; Fig. 5 is a flowchart of an exemplary method for preventing misuse of an object detection system; Fig. 6 is an example user interface of an output device of an object detection misuse prevention system, the example interface including illustrative notifications indicating misuse of an object detection system. Detailed description

[0008] Before considering the figures, which further illustrate specific embodiments, it is to be understood that the present disclosure is not limited to the details or methodology set forth in the description or illustrated in the figures. It should also be understood that the terminology used herein is for the purpose of description only and should not be considered limiting. Example work machine

[0009] Fig. 1 shows an exemplary work machine 100 equipped with an embodiment of an object detection system 150. The work machine 100 may be configured to perform work such as excavation work. The work machine 100 is in Fig. 1 as an excavator, but may also be any other work machine 100 such as a bulldozer, compactor, mixer, scraper, motor grader, wheel loader, material hauler, and the like. The present disclosure is applicable to many machines, for example, a large off-road truck such as a dump truck commonly used in mines, construction sites, and quarries. The work machine 100 may have a high payload capacity and a travel speed of several miles per hour when fully loaded. Further, the work machine 100 may be required to operate in a variety of environments and at different elevations, and may be required to climb steep grades in dry or wet conditions.The work machine 100 may include a frame 102 and a power source 106 disposed on the frame 102, such as an electric motor, an internal combustion engine, or other power source. The work machine 100 may also include a traction system 104 operatively connected to the power source 106 and configured to move the work machine 100 with respect to the ground. The traction system 104 may include one or more tracks, wheels, skid feet, or other motion mechanisms. In further embodiments, the work machine 100 may be an electric machine with an electric drive. The electric drive may provide the electrical power to drive various components within the machine.In one embodiment, the onboard electrical power may be generated by a generator, alternator, or other power generating device that may be driven by an engine or other power source.

[0010] The work machine 100 may also include a control cab or station 108 and one or more work tools 110 controllable from the control cab or station 108. In the present example, the work tool 110 may include a series of hydraulically operated booms with a bucket, but as previously mentioned, the work machine 100 may take a variety of forms with corresponding work tools suitable for performing corresponding work. An operator located in the control cab 108 may control various functions of the work machine 100 by issuing various control commands via controls such as a joystick, a lever, a touch-based user interface, a drive lever, a brake pedal, a steering wheel, an emergency brake, or the like. Example object recognition system

[0011] The object detection system 150 may be configured to detect objects in the environment of the work machine 100 and may be further configured to selectively issue alerts and / or execute machine controls depending on the type of objects detected and the locations of those objects. For example, the work machine 100 may issue an alert when foreign objects, equipment, or other inanimate objects are detected and may execute machine controls when humans or other animate objects are detected. Furthermore, the object detection system 150 may issue alerts or actively manage controls / operation of the work machine 100 depending on the location of the inanimate objects or the animate objects. For example, the object detection system 150 may issue a siren, sound, or other audible warning in response to an obstacle approaching within ten, twenty, thirty, etc.foot and / or cause the work machine to automatically brake or stop movement in response to approaching an obstacle within five, ten, twenty, etc. feet. In other embodiments, even if an object is detected, the machine may not issue a warning (e.g., if the object is outside a predefined range of the path of travel of the work machine 100), or it may issue a warning without machine control.

[0012] As in Fig. 2, the object detection system 150 may include a first type of sensor device 152, which may be a camera or other image-based or photon sensor device, a second type of sensor device 154, which may be a radar, lidar, or ultrasonic radio frequency device, and a controller 156. The first type of sensor device 152 and the second type of sensor device 154 may be configured to detect objects in the environment of the work machine 100. One or more sensor devices 152 may be mounted and oriented on the work machine 100 to capture an image stream of an area on a particular side of the work machine 100 and / or a particular area generally adjacent to the work machine 100. Similarly, the second type of sensor device 154 may be configured to capture a data stream related to an area adjacent to the work machine.Like the first type of sensor device 152, the second type of sensor device 154 may be mounted and oriented on the work machine 100 to detect objects on a particular side of the work machine 100 and / or a particular area adjacent to the work machine 100. It should be understood that while the sensor device 154 shown in FIG. Fig. 2 illustrates first and second sensor devices 152 and 154, a greater or fewer number of sensor devices 152 and / or 154 (e.g., a third sensor device, a fourth sensor device, etc.) may be used depending on the desired configuration.

[0013] The first and second types of sensor devices 152, 154 may be combined into a single sensor device and / or unit. For example, the object detection system 150 may include a housing that is attachable to a surface of the work machine 100 with a bracket. The housing may accommodate both the first type of sensor device 152 and the second type of sensor device 154. The housing may be adjustable with respect to the work machine 100, and the devices 152, 154 may each be adjustable with respect to the housing. The housing may be a relatively rigid housing made of metal or another relatively strong material to protect the devices 152, 154.

[0014] As further explained in U.S. Patent Publication No. US 2023 / 0393267 A1, which is hereby incorporated by reference in its entirety, the object detection system 150 may detect certain objects (e.g., animate or inanimate) at certain distances from the work machine 100. While the distances from the work machine 100 may be adjustable, in one or more examples, a first distance may be a warning distance, at which the object detection system 150 issues a warning but may not resort to controlling the work machine 100. In some embodiments, this distance may be between about 2 to about 30 meters. A second distance may be a warning / control distance, at which the object detection system 150 issues a warning and resorts to controlling the work machine 100 to avoid contact with the identified object.Again, although adjustable, this distance may, in some embodiments, be between approximately 0 and approximately 6 meters. Other distances may also be used for the inner and outer limits of these distances, and the decision whether to provide warning, machine control, and / or both may also depend on the nature of the object and the confidence level of the sensor systems.

[0015] With reference to Fig. 2-3, the object detection system 150 may include a controller 156 configured to operate the one or more first type sensor devices 152 and the one or more second type sensor devices 154 on the work machine 100. The controller 156 may also be configured to process the image stream, data stream, etc. received from the devices 152, 154 to determine whether an object is present, where it is located, and / or to categorize the object. The controller 156 may also be configured to determine whether a warning should be issued or a machine control should be executed, and accordingly issue a warning and / or execute a machine control suitable to avoid contact between the work machine 100 and the object.The controller 156 may include a computing device having a processor, a computer-readable storage medium, and one or more inputs and outputs. The computer-readable storage medium may include machine-readable instructions for one or more algorithms to operate the one or more devices 152, 154, receive and process the data sensed thereby, and generate one or more outputs. The inputs may be particularly adapted to receive data from the one or more sensor devices 152, 154, and the outputs may be particularly adapted to issue warnings via an alert module 164 (e.g., sounds from a speaker, lights configured to flash or illuminate on a display, screens configured to display text, etc.) and / or may be particularly adapted to exercise machine controls via the control module 166 (e.g.,to cause automatic braking action of the traction system 104, to cause the power source 106 to produce less power and slow the work machine 100, etc.). For example, the sounds or lights may be within the cab 108 of the work machine 100 to alert the operator. Machine controls generally may include imposing restrictions on the operation of the work machine 100 and / or actively steering, braking, or controlling the work implement of the work machine 100 in a particular manner. The controller 156 may be integral to the electronic control module (ECM) of the work machine 100, or a separate computing device may be provided.

[0016] In some embodiments, the object detection system 150 may further include override functionality configured to enable an operator to ignore, disable, temporarily mitigate, or otherwise bypass the warnings and / or control commands of the object detection system 150. For example, an input device (e.g., of the display / user interface 162 in the operator's cab) such as a button, dial, knob, lever, switch, or the like may effect object detection override functionality. Override functionality may be defined as an operator manually overriding one or more properties of the object detection system 150. For example, an operator may desire to drive the work machine 100 very close (e.g., less than one foot, less than two feet) to an object.The object detection system 150 may detect the object and trigger a warning and / or prevent the work machine (or a work implement) from moving closer than, for example, ten feet (3 meters) to the obstacle. Accordingly, in one embodiment, the operator may override the object detection system 150 by pressing a button associated with the override functionality in the cab 108. A predefined time after pressing the button, or during the duration the button is held, the object detection system 150 may stop issuing machine control commands and allow the operator to move the work machine 100 closer to the object (e.g., less than ten feet, less than one foot, etc.) without causing the work machine 100 to slow down, stop, or the like. The object detection system 150 may include additional override functionality (e.g.,temporarily turning off the object detection system 150, causing the object detection system 150 to stop detecting on one or more pages, silencing the alarm, etc.) and ways of triggering the override functionalities (e.g., entering a code or command to cause an override, removing a component to cause an override, etc.), all of which are contemplated and fall within the scope of this disclosure.

[0017] In embodiments that include the override functionality of the object detection system 150, operators may be tempted to abuse the override functionality. For example, while some operators may abuse the object detection system 150 by overrelying on the control commands (e.g., holding the accelerator pedal and driving directly toward an obstacle, relying on the object detection system 150 to stop the work machine 100), some operators may abuse the object detection system 150 by underrelying on its functionality. For example, an operator may hold the override functionality button down with tape, always preventing the object detection system 150 from stopping, slowing, or issuing control commands to the work machine 100. Object detection abuse prevention system

[0018] With reference to Fig. 3 and Fig. 4 illustrates a system 200 for preventing misuse of an object detection system 150 of a work machine 100, according to one or more examples. The system 200 is configured to monitor the operation of a work machine 100 for events, activations, overrides, and the like associated with an object detection system 150 (e.g., a collision mitigation system) thereof. For example, the system 200 may monitor the work machine 100 and / or the object detection system 150 for collision mitigation events triggered, activated, or otherwise caused by the object detection system 150. As used herein, a "collision mitigation event" may include any machine controls and / or alarms caused by the object detection system 150 in response to detecting an object / obstacle.For example, the collision mitigation event may include automatically stopping the work machine 100 or a component thereof, activating an automatic braking system of the work machine 100, activating an automatic object avoidance system of the work machine 100, activating an automatic movement inhibition system of the work machine 100, changing a path of the work machine 100, preventing movement of the work machine 100, lowering the work machine 100, issuing one or more warnings associated with detecting an object, and the like. The system 200 may also monitor the work machine 100 and / or the object detection system 150 for the object detection override event. As used herein, an "object detection override event" may include any use of the override functionality associated with the object detection system 150 (e.g.,any operation that allows an operator to ignore, disable, temporarily mitigate, or otherwise circumvent the warnings and / or control commands of the object detection system 150). For example, the object detection override event may include pressing a button / switch / lever / etc. to activate the override functionality, turning off or disabling the object detection system 150, muting / dampening / obscuring a warning or notification associated with the object detection system 150, activating the override functionality for an unreasonable period of time (e.g., placing tape over the override functionality button to keep the button pressed continuously), activating the override functionality disproportionately frequently within a certain period of time (e.g.,thirty activations within one minute, one activation every ten seconds over a period of two minutes, etc.).

[0019] In this manner, the system 200 may collect data associated with the use and / or misuse of the object detection system 150. For example, the system 200 may detect and collect one or more collision mitigation events and / or object detection override events of a particular work machine 100 or associated with a particular operator. The system 200 may be further configured to use the data to determine whether each event is a misuse event or a reasonable use of the object detection system 150, as discussed herein.By monitoring the use of the object detection system 150 and classifying or otherwise detecting misuse events, the system 200 can, among other benefits, collect misuse data regarding the operation of the work machine 100, notify operators to cease misusing the systems, compile statistics about a fleet of work machines 100 or about a worksite regarding cumulative / average work machine operations, assist in the development of training platforms and protocols for work machine operators by comparing the operators' performance to that of their peers or an average misuse rating, determine if accidents / collisions / damage on the worksite are more frequently caused by operators who have a high misuse rating.

[0020] As in Fig. 4, the system 200 may include a controller 202 and at least one output device 214 configured to display a notification indicative of misuse of an object detection system 150 of a work machine 100. The controller 202 includes a processing circuit 204 having one or more processors 206 and at least one memory 208. In some embodiments, the memory 208 may include a misuse database 210 configured to store information associated with the operation of the object detection system 150 of the work machine 100, including whether the operation of the work machine 100 includes misuse events, a misuse score associated with the operation, a misuse score indicative of overall operator performance, etc.In some embodiments, the controller 202 may be communicatively coupled to one or more of the work machine 100, the object detection system 150, a remote computer system 212, and / or the output device 214.

[0021] The controller 202 may be a combination of, but is not limited to, a set of instructions stored in a computer memory 208, one or more processors 206 configured to execute the set of instructions, random access memory (RAM), read-only memory (ROM), flash memory, a data structure, and the like. The controller 202 may also share components with, be identical to, communicate with, or otherwise be interoperable with the object detection controller 156 of the object detection system 150, an engine control unit (ECU) of the work machine 100, and / or one or more components of the remote computer system 212.In this manner, and in some embodiments, the system 200 may offload some of the more computationally intensive functions to the remote computer system 212 while performing other functions and collecting misuse data from the work machine 100 and / or the object detection system 150.

[0022] The system 200 is configured (e.g., via the one or more processors 206) to detect a collision mitigation event and / or an object detection override event of the work machine 100. The system 200 may detect the collision mitigation event and / or the object detection override event by receiving one or more signals indicative of the corresponding event from the object detection system 150 and / or the work machine 100. In some embodiments, the system 200 may include one or more sensors configured to detect activation of an automatic braking system of the work machine 100 (e.g., voltage or electrical sensors configured to detect activation / performance of the object detection system 150 or a component thereof), to detect movements of the work machine that are not related to the position of the steering wheel, drive handle, or other components (e.g.,Position sensors / inclinometers disposed on the steering wheel and / or drive handle, and motion / speed sensors disposed on the work machine 100 and configured to detect a mismatch between the position of the controls and the movement of the work machine 100) and / or to detect activation of an override functionality (e.g., pressure sensors configured to detect a button press associated with an override functionality). In other embodiments, the system 200 may detect a collision mitigation event and / or an object detection override event based on communication with the remote computer system 212 (e.g., the object detection system 150 may communicate with the remote computer system 212 during a collision mitigation event, and the remote computer system 212 may send a corresponding alert to the system 200).

[0023] The system 200 is also configured to classify the collision mitigation event and / or the object detection override event as an abuse event. As used herein, an "abuse event" may be defined as any over-reliance, under-reliance, or other improper circumvention of the object detection system 150.For example, an over-reliance misuse event may include relying on the collision mitigation system to stop the machine, intentionally driving as if no collision event is occurring, holding down the accelerator pedal and driving directly toward an object so that the object detection system 150 stops the work machine 100 or avoids the object, failing to steer the machine to avoid an obstacle and instead relying on the properties of the object detection system 150 to avoid a crash, or otherwise actively failing to avoid the hazard and instead relying on the object detection system 150 to autonomously / semi-autonomously prevent the otherwise avoidable collision / crash.Examples of insufficient confidence abuse events include suppressing the override functionality for an unreasonably long period of time, suppressing the override functionality with tape, silencing an alarm associated with the object detection system, and the like. Other abuse events include removing and / or disabling components of the object detection system 150, and the like. Such events may be categorized as object detection override events because removing or disabling components of the object detection system 150 may improperly disable, temporarily degrade, or otherwise circumvent the functionalities of the object detection system 150.

[0024] Accordingly, the system 200 may classify a collision mitigation event as an abuse event based on the work machine parameters, operating conditions, and control commands that occur before, during, and after the collision mitigation event. For example, the system 200 may receive information / signals indicating a rotational speed (or velocity) of the work machine during the collision mitigation event, a direction of movement of the work machine during the collision mitigation event, an orientation of the work machine (e.g., north, south, opposite travel, etc.), the seating direction during the collision mitigation event (e.g., operator facing away from the obstacle, operator seat facing toward the obstacle, etc.), a drive handle position, a brake pedal position, a steering wheel position, a transmission gear, an emergency brake usage, a ramp rate of a control lever (e.g.,how quickly the operator moved the control lever) and other information about the machine indicating whether the operator actively allowed the collision mitigation event to occur or attempted to react to prevent the collision mitigation event. Similarly, the system 200 may determine the object detection override event as an abuse event based on the same information or based on a duration of the object detection override event or the frequency of the object detection override event (e.g., determining abuse if the override functionality is triggered immediately after the machine is started, is held down for more than 10 minutes, etc.).

[0025] For example, the system 200 may detect that an operator seat was facing north, the work machine was traveling north, the throttle was at full throttle, and no steering input occurred before or during a collision mitigation event, resulting in the object detection system 150 automatically decelerating the work machine to avoid colliding with a northbound obstacle. The system 200 may classify the collision mitigation event as an abuse event based on the parameters and machine information collected in the vicinity of the collision mitigation event. In particular, the information is indicative of abuse (e.g.,intentionally relying on the object detection system 150 without attempting to avoid the obstacle) because the operator seat was facing the obstacle, indicating that the obstacle was in the operator's line of sight, the throttle was at full throttle and directed toward the obstacle, and the operator made no attempt to steer to avoid the obstacle. In contrast, the system 200 may detect that a throttle position was north, an implement control was positioned to move the implement east, the operator quickly adjusted the throttle to south, and reduced the speed of an implement within five seconds of a collision mitigation event to prevent further movement of the implement. The system 200 may classify the event as a "normal event" (e.g.,not a misuse event) because the parameters and machine information indicate that the operator attempted to avoid the collision by changing the machine direction and slowing the implement before the collision mitigation event.

[0026] In some embodiments, when classifying an event as a misuse event, system 200 may be configured to assign a misuse score to the misuse event based on data from work machine 100 or object detection system 150. The misuse score may include applying a weighted modifier to the misuse event, determining a severity indicator associated with the misuse event, or the like. In this way, applying a misuse score allows system 200 to classify a first misuse event as more severe than a second misuse event. The misuse score may be based on an operator drive command (e.g.,a drive handle position, an accelerator pedal position, a deceleration pedal position, or a transmission gear), a number of collision mitigation events occurring within a time period of the misuse event, the time period of work machine operation, the object detection override status, the machine speed, the machine direction, and / or the seat direction. For example, a misuse rating may be calibrated on a scale of 1-10, assigned a modifier such as "minor, moderate, high, severe, etc.", result in the misuse event being counted twice or having a greater impact on the operator's driving record, etc. In some embodiments, higher misuse ratings may be associated with misuse events that include more parameters indicating intentional reliance on the object detection system 150 (e.g.,Full throttle, no steering, auto brake applied may result in a misuse rating of "high" because both parameters indicate no attempt to avoid the obstacle; full throttle, sudden steering wheel turn to the right, auto brake applied may result in a misuse rating of "low" because the sudden turn indicates unintended use of the object detection system 150, etc.).

[0027] The system 200 is further configured to determine a misuse score associated with work machine operation based on one or more misuse events associated with an operator. For example, the misuse score may indicate the cumulative performance of an operator on a particular day, over a defined period of time, at a particular worksite, when using a particular work machine, or the like. Accordingly, the misuse score may be determined and / or based on one or more misuse events and / or one or more misuse ratings. For example, the misuse score may include a total number of misuse events for a particular operator (e.g., 30 misuse events, 25 misuse events at Worksite A, etc.), a number of misuse events over a period of work machine operation (e.g.,40 abuse events in January, 5 abuse events per week, etc.), an average rate of abuse events per hour for an operator (e.g., 6 abuse events (ME) per hour), a ratio of abuse events to a total number of collision mitigation events (e.g., 1 abuse event for every two collision mitigation events, a 1:3 ratio of abuse events to collision events, etc.), a ratio of abuse events to normal events (e.g., 1 abuse event for every 5 normal events, etc.), or the like. The system 200 may be further configured to compare the abuse value to an abuse threshold.The abuse threshold may indicate an unacceptable level of object detection system abuse, an above-average abuse rate compared to other operator abuse rates, or another suitable metric for assessing operator performance. For example, the abuse threshold may include a predetermined total number of abuse events, a predetermined number of abuse events over the period of work machine operation, a predetermined average rate of abuse events per hour, or a predetermined ratio of abuse events to the total number of collision mitigation events.

[0028] The system 200 may be further configured to detect when the misuse value exceeds the misuse threshold. For example, the misuse threshold may be preset to an average rate of 3 misuse events per hour, a 1:3 misuse event to collision mitigation event ratio, a maximum of 10 misuse events in a week, or the like. The system 200 may compare the misuse value of an operator or work machine 100 and determine that the misuse value exceeds the misuse threshold (e.g., an operator performs an average of 5 misuse events per hour, has a 1:1 misuse event to collision mitigation event ratio, has reached their 11th misuse event in a 5-day window, etc.).Upon determining that the misuse value exceeds the misuse threshold, the system 200 may be configured to provide the output device 214 with a notification indicating misuse of the object detection system.

[0029] The output device 214 may be configured to display a notification indicating misuse of the object detection system 150 and / or the work machine 100. For example, the output device 214 may receive one or more signals from the controller 202 and / or the system 200 in response to a misuse value exceeding a misuse threshold. The output device 214 may include a work machine component (e.g., an in-cab display, a speaker, an alarm, a light, a beacon, a wearable device worn by the operator, etc.), a mobile device (e.g., a tablet, a phone, a laptop, a computer, etc. associated with the operator, the work machine, another operator, a supervisor of the operator, or the like), or the remote computer system 212.The notification indicating misuse may include, for example, an audible, visual, tactile, or other warning to an operator of the work machine (e.g., a text banner appearing on a display of the work machine 100 instructing the operator to actively avoid hazards). The notification may include a warning to an observer of the work machine (e.g., a flashing light on the exterior of the work machine 100 to alert other operators that the flashing work machine may pose a hazard to operation in their vicinity). The notification may also include a warning to a supervisor of the operator or a signal sent to a database to log, track, or otherwise store information regarding the misuse score. The system 200 may send additional warnings and / or combinations of the notifications discussed herein, as appropriate.Furthermore, the notifications, abuse scores associated with one or more operators / work machines 100, abuse ratings, algorithms / heuristics / models for calculating abuse scores, criteria / lookup tables / heuristics for classifying abuse events may be stored or otherwise logged in the abuse database 210 of the system 200.

[0030] In some embodiments, the controller 202 may optionally be configured to communicate with one or more remote computer systems 212 to receive a speed of the work machine 100, a throttle position, a steering wheel position, an orientation of the work machine 100, and / or other parameters, conditions, and information to determine whether a collision mitigation event is a misuse event. The remote computer system 212 may include, but is not limited to, remote or local databases or servers, other vehicles, processors, memory, and / or local or remote sensors. For example, the controller 202 may receive a signal corresponding to the speed of the work machine 100, the altitude at which the work machine is operating, the time of day, information about the vehicle's planned route, etc. Various operations described herein may be implemented on computer systems. Fig. 4 shows a block diagram of a representative object detection abuse prevention system 200, including one or more processors 206 and computer memory 208, which may be used to implement the present disclosure. The object detection abuse prevention system 200 may include a computing system, which may be implemented, for example, as a consumer device such as a smartphone, another mobile phone, a tablet computer, a wearable computing device (e.g., a smart watch, glasses, a head-mounted display device), a desktop computer, a laptop computer, or with distributed computing devices. In some embodiments, the controller 202 is the computing system. In other embodiments, the computing system is a portion or subsystem of the object detection abuse prevention system 200.In some embodiments, the computer system may include conventional computer components, such as one or more processors 206, storage device or computer memory 208, a network interface, a user input device, and a user output device 214.

[0031] A network interface coupled to or otherwise communicating with the computer system may provide a connection to a wide area network (e.g., the Internet), to which the WAN interface of a remote server system may also be connected. The network interface may include a wired interface (e.g., Ethernet) and / or a wireless interface implementing various RF data communication standards, such as Wi-Fi, Bluetooth, UWB, or cellular data network standards (e.g., 3G, 4G, 5G, 60 GHz, LTE, etc.).

[0032] A user input device may include any device (or multiple devices) through which a user can provide signals to the computer system; the computer system can interpret the signals as indicative of particular user requests or information. The user input device may include any or all of a keyboard, a touchpad, a touchscreen, a mouse or other pointing device, a scroll wheel, a click wheel, a knob, a button, a switch, a keypad, a microphone, sensors (e.g., a motion sensor, an eye-tracking sensor, etc.), and so on.

[0033] A user output device (e.g., output device 214) may include any device through which the computer system can provide information to a user. For example, output device 214 may include a display for displaying images generated by or communicated to a computer system (e.g., controller 202). The display may include various imaging technologies, such as a liquid crystal display (LCD), a light-emitting diode (LED), including organic light-emitting diodes (OLEDs), a projection system, a cathode ray tube (CRT), or the like, along with supporting electronics (e.g., digital-to-analog or analog-to-digital converters, signal processors, or the like). A device such as a touchscreen may be used to serve as both an input device and an output device. In addition to or instead of a display, other output devices 214 may be provided.Examples include indicator lights, loudspeakers, tactile 'display' devices, printers, and so on.

[0034] Some implementations include electronic components such as microprocessors and memory for storing computer instructions in a computer-readable storage medium (e.g., a non-transitory computer-readable medium). Many of the features described in this specification may be implemented as processes, which are specified as a set of program instructions encoded on a computer-readable storage medium. When executed by one or more processors, these program instructions cause the processors to perform various operations specified in the program instructions. Examples of program instructions or computer code include machine code, such as generated by a compiler, and files including higher-level code that are executed by a computer, electronic component, or microprocessor using an interpreter.By appropriate programming, the processor may provide various functions to the computer system, including the functions described herein that are performed by a server or client, or other functions associated with message management services.

[0035] It should be understood that the description of the computer system provided herein is for illustrative purposes only, and that variations and modifications in the configuration or implementation of the computer system are possible. Computer systems used in connection with the present disclosure may have other capabilities not specifically described herein. Further, although the computer system is described with reference to particular blocks, it should be understood that these blocks are defined for convenience of description and are not intended to imply a particular physical arrangement of the component parts. For example, different blocks may be located in the same device, in the same server rack, on the same motherboard, or on the same circuitry. Further, the blocks may not physically correspond to different components.Blocks may be configured to perform various operations, e.g., by programming a processor or providing appropriate control circuitry, and various blocks may or may not be reconfigurable depending on how the initial configuration is obtained. Implementations of the present disclosure may be realized in a variety of devices, including electronic devices implemented using any combination of circuitry and software. Commercial applicability

[0036] In operation and use, the object detection misuse prevention system 200 may include a method 300 for preventing misuse of an object detection system of a Fig. 5 and generate comprehensive data that can be advantageously used to evaluate an operator's performance, to create training platforms aimed at preventing misuse of the work machine's safety systems, to send notifications to the operator to stop their dangerous behavior, and / or to degrade the work machine 100 to an operator or issue commands to prevent dangerous worksite conditions or injuries. For example, Fig. 6 illustrates an exemplary graphical user interface (GUI) 400 of the system 200 provided to a user device 214. The data associated with the GUI 400 may be sent to the remote computer system 212 and may be retrieved by a supervisor, company, or the like to compare abuse scores across a fleet of operators. As shown in Fig. 6, the example GUI 400 illustrates results of the method 300 for a single example operator.

[0037] As illustrated, the process may include step 305 of detecting a collision mitigation event of work machine 100. As discussed above, system 200 may receive signals from work machine 100, object detection system 150, and / or sensors configured to detect operating parameters of work machine 100. The signals may include data indicative of a collision mitigation event, such as activation of object detection system 150. In embodiments where object detection system 150 of work machine 100 includes override functionality, the process may include step 310 of detecting an object detection override event of work machine 100, for example, by detecting a press of the override button of object detection system 150.

[0038] Once the system 200 detects a collision mitigation event and / or an object detection override event, the system 200 may classify the collision mitigation event and / or the object detection override event as an abuse event (or, in some embodiments, a normal event). For example, an object detection system 150 may trigger an autobrake function of a work machine 100 and transmit a signal indicative of the collision mitigation event to the system 200. In step 315, the method 300 may determine whether the collision mitigation event (e.g.,The system 200 may determine whether the autobrake function (the autobrake function) is a misuse event or a normal event based on data from the work machine or the object detection system, including at least one of an operator drive command, a number of collision mitigation events, a period of work machine operation, an object detection override status, a machine speed, a machine direction, or a seat direction. In a particular embodiment, the system 200 may determine that the throttle was at full throttle, the steering wheel was pointed toward the obstacle, an obstacle warning alarm was flashing for 10 seconds, and no emergency brake was activated prior to and up to the autobrake function.Accordingly, the process may conclude at this step that the autobrake function was an abuse event based on operating conditions indicating that the operator intentionally relied on the object detection system 150 to stop the work machine 100 without attempting to otherwise mitigate the collision.

[0039] After determining that the collision mitigation event and / or an object detection override event is a normal event (e.g., not an abuse event), the process may end and the system 200 may return to monitoring for subsequent collision mitigation events and / or object detection override events. Additionally, the system 200 may log, store, or otherwise track the normal event and associate the event with the respective work machine 100 and / or the operator of the work machine 100. For example, a determination that a collision mitigation event was not an abuse event may be logged in an account, file, operation history, performance chart, abuse database 210, etc., associated with that operator.Accordingly, a record associated with the operator may reflect that the operator has used the object detection system 150 appropriately (e.g., has not misused the object detection system 150).

[0040] After determining that the collision mitigation event and / or the object detection override event is an abuse event, the process may include the step 320 of assigning an abuse score for the abuse event. The abuse score may be based on data received from the work machine 100 and / or the object detection system 150. The data may include the conditions, parameters, control settings, and the like of the work machine 100 within a predetermined time period of the detected abuse event. For example, the data may include the throttle position, steering pattern, brake usage, seat direction, object detection override status, etc., of the work machine 10 seconds before the abuse event, up to 10 seconds after the abuse event, at the time the collision mitigation event occurred, at the beginning of the activation of the override functionality, etc.The abuse assessment may include applying a weighted modifier to the abuse event, determining a severity indicator associated with the abuse event, or the like.

[0041] The method 300 may also include step 325 of determining a misuse score associated with work machine operation based on the misuse event. As discussed above, the misuse score may be defined as a total number of misuse events, a number of misuse events over a period of work machine operation, an average rate of misuse events per hour, or a ratio of misuse events to a total number of collision mitigation events. Accordingly, the method 300 may update and / or recalculate the misuse score associated with the operator / work machine 100 after each new misuse event and / or logged or otherwise detected misuse score.

[0042] System 200 may also perform steps 330 and 335, comparing the misuse value to a misuse threshold, and, if the misuse value exceeds the misuse threshold, providing a notification indicating misuse of the object detection system to output device 214. The misuse threshold may correspond to the misuse value as discussed above. For example, the misuse threshold may be defined as a predetermined total number of misuse events, a predetermined number of misuse events over the period of work machine operation, a predetermined average rate of misuse events per hour, or a predetermined ratio of misuse events to the total number of collision mitigation events.Similarly, after each new misuse event and / or logged or otherwise detected misuse score, the method 300 may update and / or redetermine whether the misuse score exceeds the misuse threshold for the operator / work machine 100. In some embodiments, the method 300 may include sending additional intrusive, perceptual, audible, or harsh notifications in response to the misuse score exceeding a first misuse threshold, a second higher misuse threshold, a third higher misuse threshold, or the like. For example, the misuse threshold may be defined at 10 misuse events per week. Upon reaching the 11th misuse event, an operator may receive a notification instructing the operator to actively drive and stop over-relying on the object detection system 150. At the 20thAt the 30th misuse event, the operator may receive an audible warning, such as a recording, instructing the operator to actively avoid hazards, minimize use of the override functionality, etc. At the 30th misuse event, a supervisor may be given the opportunity to automatically degrade the operator's work machine 100 until the operator completes a training program or the like, or the system 200 may do so automatically.

[0043] With reference to Fig. 6, an exemplary user interface / GUI 400 of an output device 214 of an object detection misuse prevention system 200 is shown, wherein the exemplary user interface includes illustrative notifications 410 (in this embodiment, to a supervisor of the operator) indicating abusive / normal use of an object detection system 150. As in Fig. 6, the output device 214 may be a display device, a mobile device, a laptop, a tablet, or other device configured to receive data from the system 200 and / or its misuse database 210. For example, the misuse data collected by the system 200 may be stored based on the time of the misuse event, the operator associated with the event, the work machine associated with the event, and the associated rating of the event. Likewise, the misuse database may include graphs, charts, histograms, statistics, and other data related to the misuse scores (e.g., average misuse scores of a fleet of work machines, operator ratings from lowest to highest associated misuse score, etc.).

[0044] The GUI 400 may include one or more identifiers 405 associated with the abuse data, one or more graphics 410 (e.g., a table, chart, log, etc.) associated with the abuse data, one or more summaries 415 of the abuse data for one or more operators, a prompt 420 to display a more detailed abuse record, and / or one or more commands 425 responsive to a predetermined abuse value.

[0045] For example, the identifications 405 may include a report title, a machine number, or the like, indicating the work machine 100 associated with the misuse data, a name or identifier of an operator associated with the misuse data, and / or a location where the misuse data was collected. The one or more graphs 410 (here, an operator log detailing misuse events at specific times on a specific date) may additionally include misuse data and identifiers associated with the data. For example, the graph 410 includes a column with timestamps associated with each detected event, a description of each event (e.g., a list of parameters, control settings, etc.), and a time stamp.of work machine 100 at the time of the collision mitigation event and / or the object detection override event) and a classification and / or rating associated with the detected event. For example, the first entry in the log describes an event logged at 11:00:00 AM on Site A by operator Rodney Danger on machine number 123456789. System 200 detected a collision mitigation event during which the autobrake function of object detection system 150 was activated while machine number 123456789 was traveling at full throttle. System 200 also detected no braking activity, no attempt to slow down, or no other mitigation actions. Accordingly, GUI 400 indicates that system 200 classified the event as an abuse event with a rating of "High."In contrast, at 11:35:40, the system 200 detected a collision mitigation event, triggering an alarm and manually steering the work machine around the obstacle. Accordingly, the GUI 400 indicates that the system 200 classified the event as a normal event (e.g., the operator did not rely on the object detection system 150 and actively operated the work machine to avoid a collision).

[0046] Furthermore, the GUI 400 may include summary information 415, such as a current or cumulative abuse value associated with one or more operators, an average current or cumulative abuse value associated with a worksite, etc. As in Fig. 4, the operator log indicates that three abuse events occurred within a 30-minute window from 11:00:00 AM to 11:30:00 AM. Accordingly, and as an example, the system 200 may calculate that the operator has an abuse score of 6.0 abuse events per hour. The GUI 400 may display an operator's abuse score alongside a threshold abuse score and / or an average abuse score. In some embodiments, the GUI 400 may include a prompt 420 to display a more detailed display of the abuse data associated with one or more operators. For example, the detailed report may include a graphical representation depicting abuse events over time, a listing of events by severity, a table with a breakdown of the abuse events and their associated scores, or other suitable information.

[0047] Finally, the GUI 400 may include one or more commands 425 that may be selected in response to an abuse value exceeding a threshold abuse value. For example, as in Fig. 6, a supervisor viewing the GUI 400 may decide to send a notification directly to the operator to warn them to avoid misuse of the object detection system 150. Alternatively, the GUI 400 may include an option to review, edit, or annotate misuse data associated with one or more operators. Additionally, the GUI 400 and system 200 may enable downgrading of the work machine 100 (e.g., in response to an operator misusing the object detection system 150, reducing the speed, power, etc. of the work machine 100 to prevent dangerous machine operation).

[0048] As used herein with reference to numerical ranges, the terms "approximately," "about," "substantially," and similar terms generally mean + / - 10% of the disclosed values, unless otherwise noted. As used herein with reference to structural features (e.g., to describe shape, size, orientation, direction, relative position, etc.), the terms "approximately," "about," "substantially," and similar terms are intended to cover minor variations in structure that may result, for example, from the manufacturing or assembly process and are intended to have a broad meaning consistent with the common and accepted usage of those skilled in the art to which the subject matter of this disclosure relates.Accordingly, these terms are to be interpreted to indicate that insubstantial or inconsistent modifications or changes to the described and claimed subject matter are considered within the scope of the disclosure as recited in the appended claims. The term "coupled" and variations thereof, as used herein, means the direct or indirect connection of two elements to one another. Such a connection may be stationary (e.g., permanent or fixed) or movable (e.g., removable or detachable). Such a connection may be achieved by directly coupling the two elements to one another, by coupling the two elements using a separate intermediate element and any additional intermediate elements coupled together, or by coupling the two elements using an intermediate element that is integral with one of the two elements.When "coupled" or variations thereof are modified by an additional term (e.g., directly coupled), the general definition of "coupled" provided above is modified by the unambiguous meaning of the additional term (e.g., "directly coupled" means the connection of two elements without a separate intermediate element), resulting in a narrower definition than the general definition of "coupled" provided above. Such coupling may be mechanical, electrical, or fluidic.

[0049] References to the positions of elements (e.g., "top," "bottom," "above," "below") are used herein only to describe the orientation of the various elements in the figures. It should be understood that the orientation of various elements may vary according to other embodiments, and such variations are intended to be encompassed by the present disclosure.

[0050] The hardware and data processing components used to implement the various processes, operations, illustrative logic, logic blocks, modules, and circuits described in connection with the presently disclosed embodiments may be implemented or performed using a general-purpose single-chip or multi-chip processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof to perform the functions described herein. A general-purpose processor may be a microprocessor or any conventional processor, controller, microcontroller, or state machine.A processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. In some embodiments, certain processes and methods may be performed by circuitry specific to a given function. Memory (e.g., storage, memory unit, storage device) may include one or more devices (e.g., RAM, ROM, flash memory, hard disk storage) for storing data and / or computer code to complete or enable the various processes, layers, and modules described in the present disclosure.The memory may be or include volatile memory or non-volatile memory and may include database components, object code components, script components, or any other type of information structure for supporting the various activities and information structures described in the present disclosure. According to an exemplary embodiment, the memory is communicatively coupled to the processor via processing circuitry and includes computer code for executing (e.g., by the processing circuitry or processor) the one or more processes described herein.

[0051] The present disclosure contemplates methods, systems, and program products on any machine-readable media for performing various operations. Embodiments of the present disclosure may be implemented using existing computer processors, or by a dedicated computer processor for a suitable system integrated for this or another purpose, or by a hard-wired system. Embodiments within the scope of the present disclosure include program products comprising machine-readable media having machine-executable instructions or data structures stored thereon. Such machine-readable media may be any available media accessible by a general-purpose or special-purpose computer or other machine having a processor.For example, such machine-readable media may include RAM, ROM, EPROM, EEPROM, or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of machine-executable instructions or data structures and that can be accessed by a general-purpose or special-purpose computer or other machine having a processor. Combinations of the foregoing are also encompassed within the scope of machine-readable media. Machine-executable instructions include, for example, instructions and data that cause a general-purpose computer, a special-purpose computer, or a special-purpose processing machine to perform a particular function or set of functions.

[0052] Although the figures and description may illustrate a particular sequence of method steps, the sequence of such steps may vary from what is shown and described, unless otherwise noted above. Also, two or more steps may be performed simultaneously or partially simultaneously, unless otherwise noted above. Such variations may depend, for example, on the software and hardware systems chosen and on the designer's choices. All such variations are within the scope of this disclosure. Likewise, software implementations of the described methods could be performed using standard programming techniques with rule-based logic and other logic to implement the various connecting steps, processing steps, comparing steps, and decision steps.

[0053] It is important to note that the structure and arrangement of the various embodiments is illustrative only. Additionally, any element disclosed in one embodiment may be incorporated or used with any other embodiment disclosed herein. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 2023 / 0393267 A1

[0014]

Claims

[1] System (200) for preventing misuse of an object detection system (150) of a work machine (100), the system (200) comprising: an output device (214) configured to display a notification (410) indicating misuse of the object recognition system (150); a controller (202) communicatively coupled to the output device (214), the controller (202) comprising: a processing circuit (204) comprising a memory (208) communicatively coupled to one or more processors (206), the memory (208) storing instructions that, when executed by the one or more processors (206), cause the processing circuit (204) to: Detecting a collision mitigation event of the work machine (100); Classifying the collision mitigation event as an abuse event; Determining a misuse value associated with a work machine operation based on the misuse event; Comparing the abuse value with an abuse threshold; and if the misuse value exceeds the misuse threshold, providing the notification (410) indicating misuse of the object detection system (150) to the output device (214). [2] The system (200) of claim 1, wherein the processing circuit (204) is further configured to: Detecting an object detection override event; and Classifying the object detection override event as the abuse event based on a duration of the object detection override event or a frequency of the object detection override event. [3] The system (200) of claim 1, wherein the collision mitigation event comprises at least one of automatically stopping the work machine (100), activating an automatic braking system of the work machine (100), activating an automatic object avoidance system of the work machine (100), activating an automatic movement inhibition system of the work machine (100), changing a path of the work machine (100), or preventing movement of the work machine (100). [4] The system (200) of claim 1, wherein the processing circuit (204) is further configured to: Determining whether the collision mitigation event is to be classified as an abuse event or a normal event based on data from the work machine (100) or the object detection system (150), including at least one of an operator drive command, a number of collision mitigation events, a period of work machine operation, an object detection override status, a machine speed, a machine direction, or a seat direction. [5] The system (200) of claim 4, wherein the processing circuit (204) is further configured to: Assigning a misuse rating to the misuse event based on the data from the work machine (100) or the object detection system (150), including at least one of the operator drive command, the number of collision mitigation events, the period of work machine operation, the object detection override status, the machine speed, the machine direction, or the seat direction; and wherein: the operator drive command comprises at least one of a drive handle position, an accelerator pedal position, a deceleration pedal position, or a transmission gear. [6] System (200) according to claim 1, wherein: the misuse value includes at least one of a total number of misuse events, a number of misuse events over a period of machine operation, an average rate of misuse events per hour, or a ratio of misuse events to a total number of collision mitigation events; and the abuse threshold comprises at least one of a predetermined total number of abuse events, a predetermined number of abuse events over the period of work machine operation, a predetermined average rate of abuse events per hour, or a predetermined ratio of abuse events to the total number of collision mitigation events. [7] System (200) according to claim 1, wherein: the output device (214) comprises at least one of a work machine component, a mobile device, or a remote computer system (212); and the misuse notification (410) comprises at least one of a warning to an operator of the work machine (100), a warning to an observer of the work machine (100), or a warning to a supervisor of the operator. [8] The system of claim 7, wherein at least one of the operator warning, the observer warning, or the supervisor warning comprises: an audible warning, a light beacon activation, a notification displayed on a display of the work machine (100), a haptic warning to the component of the work machine, a signal sent to the remote computer system (212), a notification sent to the mobile device, or a combination thereof. [9] A method (300) for preventing misuse of an object detection system (150) of a work machine (100), the method comprising: Detecting, by one or more processors (206), a collision mitigation event of the work machine (100); classifying, by the one or more processors (206), the collision mitigation event as an abuse event; determining, by the one or more processors (206), a misuse value associated with a work machine operation based on the misuse event; Comparing, by the one or more processors (206), the abuse value with a abuse threshold; and if the misuse value exceeds the misuse threshold, providing, by the one or more processors (206), a notification (410) indicating misuse of the object detection system (150) to an output device (214). [10] The method (300) of claim 9, further comprising: Detecting, by the one or more processors (206), an object detection override event; and Classifying, by the one or more processors (206), the object detection override event as the abuse event based on a duration of the object detection override event or a frequency of the object detection override event. [11] The method (300) of claim 9, wherein the collision mitigation event comprises at least one of automatically stopping the work machine (100), activating an automatic braking system of the work machine (100), activating an automatic object avoidance system of the work machine (100), activating an automatic movement inhibition system of the work machine (100), changing a path of the work machine (100), or preventing movement of the work machine (100). [12] The method (300) of claim 9, wherein classifying the collision mitigation event as the misuse event further comprises: Determining, by the one or more processors (206), whether the collision mitigation event is the misuse event or a normal event based on data from the work machine (100) or the object detection system (150), including at least one of an operator drive command, a number of collision mitigation events, a period of work machine operation, an object detection override status, a machine speed, a machine direction, or a seat direction. [13] The method (300) of claim 12, further comprising: Assigning a misuse rating to the misuse event based on the data from the work machine (100) or the object detection system (150), including at least one of the operator drive command, the number of collision mitigation events, the period of work machine operation, the object detection override status, the machine speed, the machine direction, or the seat direction; and wherein: the operator drive command comprises at least one of a drive handle position, an accelerator pedal position, a deceleration pedal position, or a transmission gear. [14] The method (300) of claim 9, wherein: the misuse value includes at least one of a total number of misuse events, a number of misuse events over a period of machine operation, an average rate of misuse events per hour, or a ratio of misuse events to a total number of collision mitigation events; and the abuse threshold comprises at least one of: a predetermined total number of abuse events, a predetermined number of abuse events over the period of work machine operation, a predetermined average rate of abuse events per hour, or a predetermined ratio of abuse events to the total number of collision mitigation events. [15] The method (300) of claim 9, wherein: the output device (214) comprises at least one of a work machine component, a mobile device, or a remote computer system (212); Providing, by the one or more processors (206), the misuse notification (410) comprising at least one of a warning to an operator of the work machine (100), a warning to an observer of the work machine (100), or a warning to a supervisor of the operator; and at least one of the operator warnings, the observer warning, or the supervisor warnings comprises an audible warning, a beacon activation, a notification displayed on a display of the work machine (100), a haptic warning to the component of the work machine (100), a signal sent to the remote computer system (212), a notification sent to the mobile device, or a combination thereof.

Images