Systems and methods for maintaining power for continuous machine safety monitoring

Abstract

A machine (102) may include a safety monitoring system (118) and an engine start / stop system (ESS) (124), wherein the safety monitoring system (118) is configured to detect objects (126, 128) proximate to the machine (102) and classify characteristics of the objects (126, 128), and the ESS (124) is configured to start the engine (106) of the machine (102) based at least in part on the characteristics of the objects (126, 128). The machine (102) may also include a battery (120) and a charging system (122), wherein the battery (120) powers the operation of the safety monitoring system (118) and the charging system (122) charges the battery (120) when the engine (106) is on. The ESS (124) may monitor a charge level of the battery (120), determine whether the charge level is below a preselected threshold start level, and in response to determining that the charge level is below the preselected threshold start level, start the engine (106) based at least in part on a characteristic of the object (126, 128).

Description

Technical Field

[0001] The present invention relates to a system and method for maintaining a power supply for continuous machine safety monitoring, and more particularly, to a system and method for safely maintaining a power supply based on a detected object via a machine safety monitoring system for continuous machine safety monitoring. Background Art

[0002] Machines can be used to perform various tasks at a work site. For example, machines can be used to dig, move, shape, contour, and / or remove materials present at the work site, such as gravel, concrete, asphalt, soil, and / or other materials. When not in use, machines are typically left unattended at the work site overnight or until needed, and there is a risk of parts being stolen from the machine. Some machines may include systems for monitoring the area around the machine when the machine is not in use, such as monitoring whether a suspicious person is detected near the machine outside of working hours. However, such systems rely on power provided by the machine's internal battery to operate, and continuous monitoring of the area around the machine is limited by the capacity or alarm capacity of the internal battery.

[0003] U.S. Patent Publication No. 20200399863A1, published on December 24, 2020, by Aizawa et al. (the “'863 Publication”), describes a system and method for acquiring information related to a state of an area surrounding a work machine, transmitting information that can be acquired by a sensor or generated based on information acquired by the sensor to an external device, and activating a monitoring unit including a sensor and a transmitting unit when the work machine stops. Specifically, the '863 Publication describes a system and method for determining whether a field monitor function can be activated for a specific time period based on the remaining capacity of a battery by comparing the remaining capacity with a threshold value.

[0004] While the '863 publication describes activating or deactivating the presence monitoring function based on a threshold value of the remaining capacity of the machine's battery, the system described in the '863 publication is not configured to safely enable the presence monitoring function when the threshold value is reached based at least in part on detected objects in the surrounding area of the machine. As a result, when the battery is depleted and the remaining capacity falls below the threshold value, operation of the presence monitoring function of the '863 publication cannot be maintained.

[0005] The systems and methods described herein may be directed to addressing one or more of the possible issues described above. Summary of the Invention

[0006] According to a first aspect, a system may include a safety monitoring system and an engine start / stop system (ESS) configured to maintain power to a machine for continuous machine safety monitoring. The safety monitoring system may include sensors and / or detectors configured to detect objects near the machine and classify the characteristics of the objects by type and location. When the charge level of a battery of the machine powering the safety monitoring system drops below a preselected low threshold level, the ESS may start the machine's engine and, if the characteristics of the object indicate it is safe to start the engine, enable a charging system to charge the battery. After the engine is started, the ESS may shut down the engine in response to the charge level reaching a preselected high threshold level. The system may also include a warning mechanism configured to generate a warning in response to detecting an object and classifying the object as a person within a warning zone. The machine may further include an engine status monitor configured to monitor multiple components associated with the engine and, based on the status of the multiple components, enable or disable the ESS from starting the engine.

[0007] According to another aspect, a method for maintaining power to a machine for continuous machine safety monitoring may include detecting an object near the machine; classifying characteristics of the object; and in response to determining that a charge level of a battery of the machine has dropped below a preselected threshold low level, starting an engine of the machine based at least in part on the characteristics of the object.

[0008] According to yet another aspect, a machine may include: a frame; and a safety monitoring system and an engine start / stop system (ESS) mounted to the frame and configured to maintain power to the machine for continuous machine safety monitoring. The safety monitoring system may include sensors and / or detectors mounted to the frame and configured to detect objects near the machine and classify the characteristics, type, and location of the objects. The machine may also include an engine and a battery mounted on the frame. When the charge level of the battery powering the safety monitoring system drops below a preselected low threshold level, the ESS may start the engine to charge the battery if the characteristics of the object indicate that it is safe to start the engine. After the engine is started, the ESS may shut down the engine in response to the charge level reaching a preselected high threshold level. The machine may also include a warning mechanism configured to generate a warning in response to detecting an object and classifying the object as a person within a warning zone. The machine may further include an engine status monitor configured to monitor multiple components associated with the engine and enable or disable the ESS from starting the engine based on the status of the multiple components. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The detailed description is described with reference to the accompanying drawings. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same reference numbers in different figures indicate similar or identical items.

[0010] Figure 1 A block diagram depicting a schematic top view of an example environment including an example machine including example components and systems for safely maintaining power for continuous machine safety monitoring is shown.

[0011] Figure 2 A block diagram depicting another schematic top view of an exemplary environment is shown.

[0012] Figure 3 A flow chart representing an example process for safely maintaining power for continuous machine safety monitoring in an example environment is provided.

[0013] Figure 4 Provides representation Figure 3 Another flow chart of an exemplary detailed process of one of the blocks.

[0014] Figure 5 Provides representation Figure 3 Another flowchart of an exemplary detailed process of another block of FIG. DETAILED DESCRIPTION

[0015] The present invention generally relates to systems and methods for safely maintaining power to a safety monitoring system that performs continuous safety monitoring of a machine. As described below, in some examples, an engine start / stop system (ESS) in an engine can automatically start the machine's engine or other power source, thereby enabling a charging system to charge a battery that powers the safety monitoring system based on characteristics of objects detected by the safety monitoring system near the machine. In some examples, even when battery charging is required, the ESS can refrain from starting the engine to charge the battery if the characteristics of the objects detected by the safety monitoring system indicate that it is unsafe to start the engine. In some examples, after safely starting the engine, if the characteristics of the object change to indicate that it is no longer safe to continue running the engine, the ESS can shut down the engine. In some examples, the machine can be tethered to an external power source, such as an external generator and / or power line, and the ESS can automatically enable the external source to charge the battery when the battery is safe to do so.

[0016] Figure 1 is a block diagram depicting a schematic top view of an example environment, such as worksite 100 , in which an example machine 102 may be stored when not in use. Figure 1The exemplary machine 102 shown is an excavator. However, the machine 102 may be any type of machine configured to travel over terrain, such as an automobile, a truck, an agricultural vehicle, and / or a work vehicle, such as a wheel loader, a track loader, a skid steer loader, a motor grader, an on-highway truck, an off-highway truck, and / or any other machine known to those skilled in the art.

[0017] Machine 102 includes a chassis or frame 104 to which a power source, such as an engine 106, is attached. Engine 106 is configured to provide power for operation of machine 102, including, for example, operating a work tool, electronics, and steering, and / or for providing torque to drive members to propel or move machine 102 over terrain. For example, Figure 1 The illustrated machine 102 includes a pair of tracks 108 configured to propel the machine 102 across pavement, gravel, dirt, or other working surface at the worksite 100. Although the machine 102 includes tracks, it is contemplated that the machine 102 may include one or more wheels in place of or in addition to the tracks. The machine 102 also includes a cab 110 operatively connected to the frame 104 for protecting and / or providing comfort to an operator of the machine 102 and / or for protecting control-related devices of the machine 102. In some examples, the machine 102 may be semi-autonomous or fully autonomous and capable of operating without an onboard or remote operator, such as by remote control.

[0018] exist Figure 1 In the illustrated example, machine 102 includes a boom 112, a proximal end of which is operatively connected to frame 104 and configured to pivot relative to frame 104. Machine 102 also includes a rod 114 operatively connected to the distal end of boom 112 and configured to pivot relative to boom 112. Machine 102 also includes a boom actuator connected to frame 104 at one end and to boom 112 at an opposite end. The boom actuator is configured to extend and retract, thereby raising and lowering the distal end of boom 112, respectively. Machine 102 also includes a work tool 116 for performing operations associated with machine 102, such as digging, carrying, lifting, and / or depositing material. Machine 102 includes a work tool actuator, one end of which is coupled to frame 104 and / or the proximal end of boom 112. The work tool actuator is configured to extend and retract, thereby pivoting work tool 116, for example, between an upright orientation and an at least partially inverted orientation. In a vertical orientation, the work tool 116 can hold material, and in an at least partially inverted orientation, the work tool 116 can deposit or dump material. Other forms of work tools are contemplated. For example, while Figure 1The work tool 116 in FIG. 1 is shown as a bucket, but the work tool 116 may include an auger, a brush cutter, a broom, a grapple, a hammer, a grinder, a boring machine, a rotor, etc.

[0019] like Figure 1 As shown, machine 102 includes engine 106, safety monitoring system 118, battery 120, charging system 122, and engine start / stop system (ESS) 124, all of which may be mounted, attached, or coupled to frame 104. Figure 1 Safety monitoring system 118 and ESS 124 are schematically shown as separate, but in some examples, safety monitoring system 118 and ESS 124 may be included in a single system.

[0020] Machine 102 may include one or more processors that may execute any modules, components, or systems associated with machine 102. In some examples, the processors may include a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), any combination of CPUs, GPUs, and FPGAs, or other processing units or components known in the art. In addition, each processor may have its own local memory, which may also store program modules, program data, and / or one or more operating systems.

[0021] The computer-readable medium associated with machine 102 may include volatile memory (e.g., RAM), non-volatile memory (e.g., ROM, flash memory, micro hard drive, memory card, etc.), or some combination thereof. The computer-readable medium may be non-transitory computer-readable medium. The computer-readable medium may include or be associated with one or more of the aforementioned modules, which perform various operations associated with safety monitoring system 118, charging system, and / or ESS 124. In some examples, one or more modules may include or be associated with computer-executable instructions stored by the computer-readable medium and executable by one or more processors to perform these operations. Safety monitoring system 118, charging system 122, and ESS 124 may also include additional components not listed above, which may perform any of the functions associated with safety monitoring system 118, charging system 122, and / or ESS 124, respectively. Safety monitoring system 118, charging system 122, and / or ESS 124 may communicate with each other using any known wired and / or wireless communication protocols and / or networks.

[0022] As described above, machines such as machine 102 are used to perform various tasks at worksites such as worksite 100. However, when not in use, they are typically left unattended on the worksite overnight or until needed, posing a risk of parts being stolen from the machine. When machine 102 is shut down, ESS 124 can be automatically or manually activated. Safety monitoring system 118 of machine 102 can also be automatically or manually activated in response to machine 102 being shut down, detecting objects near machine 102 and classifying their characteristics. Furthermore, safety monitoring system 118 can also be active while machine 102 is in use. Because machine 102 is shut down, safety monitoring system 118 is powered by battery 120 of machine 102, and its operation may be limited by the capacity of battery 120 or the remaining capacity when the machine is shut down. Depending on the capacity or computational load of safety monitoring system 118, including classification of detected objects, analysis and processing of data, data storage, data transmission and reception, etc., if the safety monitoring system is supported solely by battery 120, the operating time of safety monitoring system 118 becomes shorter as the capacity of safety monitoring system 118 increases. A charging system 122, typically including an alternator and a voltage regulator (not shown), is configured to charge battery 120 when engine 106 is on. Engine 106, when on or running, enables charging system 122 to charge battery 120. However, as described above, machine 102 has been shut down, i.e., engine 106 is not running, for a day and left unattended at worksite 100. It is undesirable or impractical to personally monitor the battery charge level of battery 120 and manually start engine 106 whenever the battery charge level drops below a certain lower level, and then manually shut down engine 106 whenever the battery level reaches a certain higher level.

[0023] To address the aforementioned issues, an engine start / stop system (ESS) 124 may be employed. ESS 124 may be operably connected to safety monitoring system 118, battery 120, and engine 106. ESS 124 may be activated when machine 102 is inactive or shut down and safety monitoring system 118 is activated. As described above, safety monitoring system 118 may be automatically activated in response to machine 102 being shut down, or manually activated after machine 102 is shut down. ESS 124 may monitor the charge level of battery 120 and determine whether the charge level has fallen below a preselected threshold start level, such as a preselected low voltage and / or a preselected low battery capacity value. In response to determining that the charge level has fallen below the preselected threshold start level, ESS 124 may start engine 106 based, at least in part, on characteristics of the object classified by safety monitoring system 118.

[0024] The safety monitoring system 118 may classify the characteristics of the detected object based on the type of object and the location of the object relative to the machine 102 or relative to a particular portion of the machine 102. The safety monitoring system 118 may include a camera, which may be any known type of analog or digital image sensor, digital camera, and / or digital video camera, including a high dynamic range (HDR) camera, a light-sensitive camera, and / or an ultrasonic camera, and may provide two-dimensional image data, three-dimensional image data, an image sequence, grayscale image data, color image data, depth data, absorption data, and / or reflectance data. In addition or alternatively, the safety monitoring system 118 may include other suitable types of imagers and / or sensors, such as one or more light detection and ranging (LIDAR) sensors, one or more sound navigation and ranging (SONAR) sensors, one or more radio detection and ranging (RADAR) sensors, ultrasonic sensors, or any other suitable sensor type.

[0025] Figure 1 , two objects 126 and 128 are shown. In this example, safety monitoring system 118 may classify object 126 as a person and object 128 as a wheelbarrow as a non-person object. Safety monitoring system 118 may also determine location information associated with objects 126 and 128 and may classify object 126 (the person) as being located at a distance greater than a preselected distance from machine 102, as shown at location A, which is outside predetermined area 130 around machine 102 but within warning area 132, and classify object 128 (the wheelbarrow) as being located at a distance less than or equal to a preselected distance from machine 102, as shown at location B. Predefined area 130 may be an area defined by a preselected distance from machine 102, outside of which people are deemed safe when engine 106 is on. Predefined area 130 and warning area 132 may also be identical and cover the same area. Additionally or alternatively, some components of machine 102 may have their own unique preselected distances to ensure safety. For example, the preselected distance may be 1 m from the counterweight of the machine 102 , 2 m from a compartment door, 5 m from an access panel for the hydraulics of the machine 102 to avoid possible exposure to hydraulic fluid in the event of a leak, 10 m from the front of the machine to monitor extended linkages and attachments, etc.

[0026] Machine 102 may also include a warning mechanism 134 operably connected to safety monitoring system 118. Safety monitoring system 118 may also be configured to activate warning mechanism 134 and generate a warning in response to classifying the characteristics of object 126 as a person located at a preselected distance from the machine that is less than or equal to warning zone 132. The warning may include capturing and storing an image of object 126, time-stamping the image, sending the image to a pre-designated destination 136, such as an owner of machine 102, a user of machine 102, and / or a central office responsible for machine 102 and / or worksite 100, sending a notification to the pre-designated destination, and / or activating at least one of a visual warning or an audible warning at the machine, such as sounding an alarm and / or flashing lights.

[0027] exist Figure 1 In the example shown, ESS 124 can turn on engine 106 because safety monitoring system 118 has classified the characteristics of object 126 as a person, but outside of predetermined area 130 at a preselected distance from machine 102, and has classified the characteristics of object 128 within predetermined area 130 as a non-person (a wheelbarrow). Generally, ESS 124 can turn on engine 106 when safety monitoring system 118 has classified the characteristics of the object as 1) a non-person, or 2) outside predetermined area 130, or at a preselected distance from machine 102. After turning on engine 106, ESS 124 can turn off engine 106 in response to determining that the charge level of battery 120 has reached a preselected threshold stop level (e.g., a preselected high voltage and / or a preselected high battery capacity value). The preselected threshold stop level is higher than the preselected threshold start level.

[0028] Machine 102 may further include an engine status monitor 138 operatively connected to ESS 124 and configured to monitor various components associated with engine 106, such as oil level, coolant level, fuel level, previous engine shutdown procedures, and the like. Furthermore, engine status monitor 138 may be configured to monitor the parking brake of machine 102 to prevent machine 102 from moving when engine 106 is on. Engine status monitor 138 may determine the status or condition of each of the plurality of components. Engine status monitor 138 may enable ESS 124 to start engine 106 only in response to determining that the status of each of the plurality of components is in a satisfactory state, as indicated by passing a status check. After starting engine 106, ESS 124 may shut down or cause ESS 124 to shut down in response to determining that the status of one or more of the plurality of components has become unsatisfactory, such as when the oil level is or becomes too low, as indicated by failing a status check. The engine status monitor 138 may also inhibit the ESS 124 from starting the engine 106 in response to determining that the status of one or more of the plurality of components is unsatisfactory.

[0029] After turning on engine 106, ESS 124 may shut down engine 106 in response to safety monitoring system 118 reclassifying object 126 as a person and located at a location less than or equal to a preselected distance from machine 102, as shown at location C within predetermined area 130. This change may be due to object 126, previously classified as a person at location A, having moved to location C, as indicated by arrow 140. In this example, because a person is sufficiently close to machine 102, worksite 100 is now considered unsafe, i.e., potentially dangerous for a person to continue running engine 106. Although the charge level of battery 120 may indicate that the battery has not reached the preselected threshold stop level and still requires charging, concerns about the safety of the person may override the need to charge battery 120 for continued monitoring by safety monitoring system 118. After shutting down engine 106, ESS 124 may restart engine 106 in response to safety monitoring system 118 classifying object 126 as having moved outside predetermined area 130.

[0030] Figure 2 is a block diagram depicting another schematic top view of an exemplary environment 200. The exemplary environment 200 is similar to Figure 1Worksite 100 is shown in FIG. 1 , except that object 126 is now shown within predefined area 130 at location D, i.e., safety monitoring system 118 has classified the characteristics of object 126 as a person located at a location less than or equal to a preselected distance from machine 102. For example, even when ESS 124 determines that the charge level of battery 120 is below a preselected threshold start level, ESS 124 may refrain from starting engine 106 to avoid harm to the service personnel or others authorized to service machine 102. However, later, if the object moves as indicated by arrow 202 and safety monitoring system 118 continues to classify the characteristics of object 126 as a person, but is now outside of predefined area 130, ESS 124 may start engine 106.

[0031] Figure 3 An example process 300 is shown for safely maintaining power for continuous machine safety monitoring in an exemplary environment, such as a worksite. The process 300 is shown as a logical flow diagram, the operations of which represent a sequence of operations that can be implemented in hardware, software, or a combination thereof. In the context of software, these operations represent computer-executable instructions stored on one or more computer-readable storage media that, when executed by one or more processors, perform the operations. Generally, computer-executable instructions include routines, programs, objects, components, data structures, etc. that perform specific functions or implement specific data types. The order in which the operations are described is not intended to be construed as a limitation, and any number of the described operations can be combined in any order and / or in parallel to implement the process. Figure 3 The exemplary process 300 shown may be applicable to the Figure 1 and 2 The machine at the construction site.

[0032] As described above, machines such as machine 102 are used to perform various tasks on a worksite, but when not in use, they are typically left unnoticed on the worksite overnight or until needed, and there is a risk of parts being stolen from the machine. At block 302, machine 102 may be placed in an inactive state (shut down), for example, by turning off a key or dial, or a switch, and at block 304, the engine start / stop system (ESS) 124 of machine 102 may be automatically or manually activated in response to machine 102 being shut down. At block 306, safety monitoring system 118 may be automatically or manually activated in response to machine 102 being shut down. While activation of ESS 124 and safety monitoring system 118 are shown as separate blocks 304 and 306, in some examples, ESS 124 and safety monitoring system 118 may be activated simultaneously in response to machine 102 being shut down at block 302.

[0033] At block 308, the safety monitoring system 118 may monitor the surroundings of the machine 102 and detect objects near the machine 102, and at block 310, classify the characteristics of the detected objects. The safety monitoring system 118 may classify the characteristics of the detected objects based on the type of object and the location of the object relative to the machine 102 or a specific portion of the machine 102. The safety system 118 may include a camera, which may be any known type of analog or digital image sensor, digital camera, and / or digital video camera, including a high dynamic range (HDR) camera, a light-sensitive camera, and / or an ultrasonic camera, and may provide two-dimensional image data, three-dimensional image data, an image sequence, grayscale image data, color image data, depth data, absorption data, and / or reflectance data. In addition or alternatively, the safety monitoring system 118 may include other suitable types of imagers and / or sensors, such as one or more light detection and ranging (LIDAR) sensors, one or more sound navigation and ranging (SONAR) sensors, one or more radio detection and ranging (RADAR) sensors, or any other suitable sensor type.

[0034] Because machine 102 is shut down, safety monitoring system 118 is powered by battery 120 of machine 102, and the operation of safety monitoring system 118 may be limited by the capacity of battery 120 or the remaining capacity when the machine is shut down. Depending on the capabilities or computational load of safety monitoring system 118, including classification of detected objects, analysis and processing of data, data storage, data transmission and reception, etc., if the safety monitoring system is supported solely by battery 120, the operating time of safety monitoring system 118 becomes shorter as the capabilities of safety monitoring system 118 increase. At block 312, upon activation, ESS 124 may begin continuously monitoring the charge level of battery 120 and, at block 314, determine whether the charge level has dropped below a preselected threshold trigger level, such as a preselected low voltage and / or a preselected low battery capacity value. If the charge level has not dropped below the preselected threshold trigger level, ESS 124 may continue monitoring the charge level of battery 120 at block 312.

[0035] In response to determining that the charge level has dropped below the preselected threshold start level, the ESS 124 may check the characteristics of the object classified by the safety monitoring system 118 at block 316 and determine, at block 318, based at least in part on the characteristics, whether to start the engine 106. If the ESS 124 determines at block 318 that the characteristics of the object do not meet certain conditions (the "No" branch), the process may loop back to block 316, for example, after a preselected interval (such as 5 seconds) for the ESS 124 to check the characteristics of the object, which may have been updated. If the ESS 124 determines that the characteristics of the object meet certain conditions (the "Yes" branch), the engine state monitor 138 may check the status or condition of multiple components associated with the engine 106, such as oil level, coolant level, fuel level, previous engine shutdown procedures, parking brake of the machine 102, etc., and determine at block 320 whether the status of each of the multiple components is in a satisfactory state. If the status is unsatisfactory ("No" branch), which may be indicated by a failed status check, the engine status monitor 138 may inhibit the ESS 124 from starting the engine 106 at box 322. If the status is satisfactory ("Yes" branch), which may be indicated by a passed status check, the engine status monitor 138 may enable the ESS 124 to start the engine 106 at box 324, and the ESS may start the engine, thereby operating the charging system 122 to charge the battery 120. The engine status monitor 138 may continue to monitor the status of the engine 106 after the engine 106 is turned on, off, or the ESS 124 is turned off, in response to determining that the status of one or more of the plurality of components has changed to an unsatisfactory state, such as, for example, the oil level is or has become too low. The ESS 124 may then shut down the engine 106 at box 326 in response to determining that the charge level of the battery 120 has reached a preselected threshold value based on continuous monitoring of the charge level of the battery 120 (e.g., a preselected high voltage and / or a preselected high battery capacity value). The preselected threshold stop level is higher than the preselected threshold start level.The process may then loop back to block 312 and continue monitoring the charge level of the battery 120.

[0036] Figure 4 shows a method for analyzing the characteristics of the detected object Figure 3 Detailed example process of block 318 of FIG.

[0037] As mentioned above Figure 1 As discussed, at block 310, the safety monitoring system 118 may classify the characteristics of the detected object based on the type of object and the location of the object relative to the machine 102. At block 402, the ESS 124 may determine whether the detected object is located at a distance greater than a preselected distance from the machine 102 based on the characteristics of the object. Figure 1As discussed, the predetermined area 130 may be an area defined by a preselected distance from the machine 102, outside of which persons are considered safe when the engine 106 is on. If it is determined that the position of the object is greater than the preselected distance ("yes" branch), the process may proceed to block 320. However, if it is determined that the position of the object is not greater than the preselected distance, i.e., within the predetermined area 130 ("no" branch), then at block 404, the ESS 124 may determine whether the object is a person. If it is determined that the object is a person ("yes" branch), for example Figure 1 If the object 126 is located at position C in the vehicle, then at block 406, the ESS 124 may refrain from starting the engine. The process may then loop back to block 402 to determine the location of the object, e.g., if the object has moved outside of the predefined area 130. However, if it is determined that the object is not a person ("No" branch), e.g., Figure 1 If object 128 (wheelbarrow) is at position B, the process may proceed to block 320 .

[0038] Figure 5 A method for generating a warning based on the classification characteristics of a detected object is shown. Figure 3 An exemplary detailed process of block 310 is provided.

[0039] The machine 102 may also include a warning mechanism 134 operatively connected to the safety monitoring system 118. Figure 1 As discussed, at block 310, the safety monitoring system 118 may classify the characteristics of the detected object based on the type of object and the location of the object relative to the machine 102. At block 502, the safety monitoring system 118 may determine whether the detected object is located within the warning zone 132. Figure 1As shown, the predetermined area 130 and the warning area 132 may also be identical and cover the same area. Additionally, or alternatively, some components of the machine 102 may have their own unique preselected distances to ensure safety. For example, the preselected distances may be 1 meter from the counterweight of the machine 102, 2 meters from a compartment door, 5 meters from the access panel for the hydraulic system of the machine 102 to avoid potential exposure to hydraulic fluid in the event of a leak, 10 meters from the front of the machine to monitor extended linkages and attachments, etc. If the object is determined to be outside the warning area 132 ("No" branch), no warning is generated and the process proceeds to block 312. However, if the object is determined to be within the warning area 132 ("Yes" branch), at block 504, the safety monitoring system 118 may determine whether the object is a person. If the object is determined not to be a person ("No" branch), no warning is generated and the process proceeds to block 312. If the object is determined to be a person ("yes" branch), then at block 506, the safety monitoring system 118 may activate the warning mechanism 134, which may then generate a warning at block 508. The warning may include capturing and storing an image of the object 126, time-stamping the image, sending the image to a pre-specified destination 136, such as the owner of the machine 102, the user of the machine 102, and / or a central office responsible for the machine 102 and / or the worksite 100, sending a notification to the pre-specified destination, and / or activating at least one of a visual warning or an audible warning at the machine, such as sounding an alarm and / or flashing lights. After generating the warning, the process may proceed to block 312.

[0040] Industrial Applicability

[0041] Exemplary systems and methods of the present invention may be applied to various machines, such as automobiles, ships, trucks, agricultural vehicles, pavers, mining machines, and / or construction vehicles. The systems and methods described herein may be used in conjunction with the storage of such machines at a worksite. For example, when the machine is shut down, the machine's safety monitoring system and engine start / stop system (ESS) may be automatically or manually activated. For example, according to the examples described herein, the machine may also include an engine, a battery, and a charging system operably connected to the safety monitoring system and / or ESS. In some examples of the systems and methods, the battery-powered safety monitoring system may detect an object proximate to the machine and classify characteristics of the object, such as whether the object is a person and the object's position relative to the machine, and the ESS may monitor the battery's charge level, determine whether the charge level is below a preselected threshold activation level, and, in response to determining that the charge level is below the preselected threshold activation level, start the engine based at least in part on the characteristics of the object and charge the battery via the charging system, thereby allowing continued operation of the safety monitoring system.

[0042] For example, when not in use, a machine may be left unattended at a worksite such as a landfill, construction site, or mining operation, posing a risk of parts being stolen from the machine. At some such worksites, the machine's safety monitoring system may be activated to continuously monitor the machine's surroundings. However, because the machine is inactive, the safety monitoring system is powered solely by batteries, and the operating time of the safety monitoring system is limited by the battery's capacity. In some examples, the ESS may start the engine to charge the battery if the object is classified as safe based at least in part on the characteristics of an object classified by the safety monitoring system (i.e., an object classified as located at a distance greater than a preselected distance from the machine, indicating that the object is outside a predetermined area, or a non-human object such as a wheelbarrow, container, or another machine). In some examples, the ESS may refrain from starting the engine if the object's characteristics are classified as a person located at a distance less than or equal to a preselected distance from the machine, indicating that a person is within the predetermined area and too close to safely start the engine.

[0043] In some examples, the ESS can shut down the engine when the charge level reaches a preselected threshold stop level, or in response to the safety monitoring system detecting that a person is now too close to the machine to safely operate the engine by classifying the object as a person and is positioned at a location less than or equal to a preselected distance from the machine.

[0044] In some examples, the machine may further include an engine status monitor configured to monitor a plurality of components associated with the engine, such as oil level, coolant level, fuel level, previous engine shutdown procedures, etc. The engine status monitor may determine whether the engine is in an operating state by checking or determining a corresponding state of each of the plurality of components, and enable the ESS to start the engine if each of the plurality of components is in a satisfactory state. The engine status monitor may shut down the engine in response to determining that the state of one or more of the plurality of components has become an unsatisfactory state, or cause the ESS to shut down the engine, or prohibit the ESS from starting the engine in response to determining that the state of one or more of the plurality of components is in an unsatisfactory state.

[0045] In some examples, the safety monitoring system may also activate a warning in response to classifying the characteristics of the object as a person entering a warning zone defined by a preselected warning distance from the machine, which warning zone may be the same as or different from the predetermined zone. The warning may include capturing and storing an image of the object, time-stamping the image, sending the image to a pre-specified destination, such as the owner / user of the machine and / or a central office responsible for the machine / worksite, sending a notification to the pre-specified destination, and / or activating at least one of a visual warning, such as a flashing light, or an audio warning, such as a siren or horn, at the machine 102.

[0046] In some examples, the systems and methods described herein may provide the additional benefit of longer battery life by preventing the need for deep cycle charging of the battery.

[0047] Although various aspects of the present invention have been particularly shown and described with reference to the above examples, it will be understood by those skilled in the art that various additional embodiments may be contemplated by modifying the disclosed apparatus, systems, and methods without departing from the spirit and scope of the disclosure. Such embodiments should be understood to fall within the scope of the present invention as determined by the claims and any equivalents thereof.

Claims

1. A system comprising: A safety monitoring system configured to: Detect objects approaching the machine; as well as classifying characteristics of the object; a battery operatively connected to the safety monitoring system, the battery configured to provide power for operation of the safety monitoring system; a charging system operatively connected to the battery, the charging system being configured to charge the battery; an engine operatively connected to the charging system, the engine being configured to enable the charging system to charge the battery when the engine is turned on; as well as an engine start / stop system (ESS) operatively connected to the safety monitoring system, the battery, and the engine, the engine start / stop system ESS being configured to: determining that a charge level of said battery is below a preselected threshold activation level; as well as starting the engine based at least in part on a characteristic of the object and on a determination that the charge level is below the preselected threshold start level, Wherein, starting the engine based at least in part on the characteristic of the object includes: The security monitoring system classifies the characteristic of the object into at least one of the following: is located more than a preselected distance from the machine; or non-human; and After starting the engine, the engine start / stop system ESS is further configured to: The engine is shut down in response to determining that the charge level has reached a preselected threshold shut-down level.

2. The system according to claim 1, wherein the engine start / stop system ESS is further configured to: The safety monitoring system is activated in response to the machine being placed in an inactive state and the safety monitoring system being activated.

3. The system of claim 1 , wherein the safety monitoring system is further configured to: A warning is activated in response to classifying the characteristic of the object as a person located at a location less than or equal to a preselected distance from the machine.

4. The system of claim 3, wherein the warning comprises at least one of: capturing and storing an image of the object, adding a timestamp to the image; sending the image to a pre-specified destination; sending a notification to said pre-designated destination; or At least one of a visual warning or an audible warning is activated at the machine.

5. The system according to claim 1 , wherein the engine start / stop system ESS is further configured to: In response to determining that the charge level is below the preselected threshold start level, starting the engine is inhibited in response to the safety monitoring system classifying the characteristic of the object as a person located at a location less than or equal to the preselected distance from the machine.

6. The system according to claim 1 , wherein after starting the engine, the engine start / stop system ESS is further configured to: The engine is shut down in response to the safety monitoring system classifying the object as a person and located less than or equal to the preselected distance from the machine.

7. The system of claim 1 , further comprising: an engine status monitor operatively connected to the engine start / stop system ESS, the engine status monitor being configured to: determining respective states of a plurality of components associated with the engine; Enable the engine start / stop system ESS to: starting the engine in response to determining that a status of each of the plurality of components passes a status check, and shutting down the engine in response to determining that a status of one or more of the plurality of components fails the status check; as well as The engine start / stop system ESS is inhibited from starting the engine in response to determining that the status of the one or more of the plurality of components fails the status check.

8. A method comprising: Through the safety monitoring system: Detect objects approaching the machine; as well as classifying characteristics of the object; powering the operation of the safety monitoring system via a battery; Via the Engine Start / Stop System (ESS): determining that a charge level of said battery is below a preselected threshold activation level; starting an engine of the machine based at least in part on the characteristic of the object and on a determination that the charge level is below the preselected threshold start level; When the engine is turned on, charging the battery via a charging system activated by the engine; determining respective states of a plurality of components associated with the engine; In response to determining that a status of each of the plurality of components passes the status check: starting the engine, and after starting the engine, shutting down the engine in response to determining that a status of one or more of the plurality of components fails the status check; as well as Starting the engine is inhibited in response to determining that the status of the one or more of the plurality of components fails the status check.

9. The method according to claim 8, further comprising: The engine start / stop system ESS is activated in response to the machine being placed in an inactive state and the safety monitoring system being activated.

10. The method according to claim 8, further comprising: A warning is activated in response to classifying the characteristic of the object as a person located at a location less than or equal to a preselected distance from the machine.

11. The method according to claim 10, wherein the warning comprises at least one of the following: capturing and storing an image of the object, adding a timestamp to the image; sending the image to a pre-specified destination; sending a notification to said pre-designated destination; or At least one of a visual warning or an audible warning is activated at the machine.

12. The method of claim 8, wherein starting the engine based at least in part on a characteristic of the object comprises: Classify the characteristics of the object into at least one of the following: located more than a preselected distance from said machine; or Non-human.

13. The method according to claim 12, further comprising: In response to determining that the charge level is below the preselected threshold start level, starting the engine in response to classifying the characteristic of the object as a person located at a location less than or equal to the preselected distance from the machine is refrained.

14. The method according to claim 12, after starting the engine, further comprising: The engine is shut down in response to determining that the charge level has reached a preselected threshold shut-down level.

15. The method according to claim 12, after starting the engine, further comprising: The engine is shut down in response to classifying the object as a person and being located less than or equal to the preselected distance from the machine.

16. A system comprising: A safety monitoring system configured to: Detect objects approaching the machine; as well as classifying characteristics of the object; a battery operatively connected to the safety monitoring system, the battery configured to provide power for operation of the safety monitoring system; a charging system operatively connected to the battery, the charging system being configured to charge the battery; an engine operatively connected to the charging system, the engine being configured to enable the charging system to charge the battery when the engine is turned on; as well as an engine start / stop system (ESS) operatively connected to the safety monitoring system, the battery, and the engine, the engine start / stop system ESS being configured to: determining that a charge level of said battery is below a preselected threshold activation level; as well as starting the engine based at least in part on a characteristic of the object and on a determination that the charge level is below the preselected threshold start level, Wherein, starting the engine based at least in part on the characteristic of the object includes: The security monitoring system classifies the characteristic of the object into at least one of the following: is located more than a preselected distance from the machine; or non-human; and, After starting the engine, the engine start / stop system ESS is further configured to: The engine is shut down in response to the safety monitoring system classifying the object as a person and located less than or equal to the preselected distance from the machine.

Images