System and method for protecting cable tracking

Abstract

This disclosure provides a system and method for detecting motion events corresponding to at least one of a vehicle trailer assembly, a winch assembly, or a protective cable. The system captures images of the cable (e.g., a protective cable, winch cable, or trailer cable) using one or more cameras. The cable is identified in the captured images using processing circuitry. Movement of the cable is tracked in the captured images. Motion events of the cable are identified based on the movement. In response to the detection of the motion event, the system and the vehicle carrying the cable perform actions.

Description

[0001] Cross-references to related applications

[0002] This application claims the benefit of U.S. Provisional Patent Application No. 63 / 243,162, filed September 12, 2021, the disclosure of which is incorporated herein by reference in its entirety.

[0003] introduction

[0004] This disclosure relates to items for storage and connection, and more specifically to ensuring that items stored and connected to a vehicle are secure and stable. Summary of the Invention

[0005] This document discloses systems and methods for monitoring the cargo compartment (e.g., truck bed) of a vehicle. In some embodiments, data corresponding to a protective cable is analyzed while the vehicle is in operation (e.g., driven by a driver or autonomous control system) or stationary (e.g., when one or more vehicle systems are active and configured for monitoring mode). For example, the system monitors the position of the protective cable relative to the cargo compartment to determine whether the cable is damaged, loose, moved, or otherwise unsuitable and / or fails to adequately secure the goods in the cargo compartment, or is otherwise obstructed.

[0006] In some embodiments, the system includes one or more cameras configured to capture images of the vehicle cargo box and cables. In some embodiments, the cameras are configured to capture images of the exterior of the vehicle. Additionally, processing circuitry is configured to identify motion events of the cables (e.g., a protective cable, winch cable, or trailer cable) in the captured images. In some embodiments, the cable includes a reflective coating or reflective element. In response to the detection of a motion event, the vehicle may perform an action (e.g., closing the cargo box cover). The system also includes processing circuitry configured to detect the position and movement of the protective cable (e.g., relative to a fixed or locked position). Based on detecting the current range of motion and comparing it to at least one of a stable range of motion and an unstable range of motion of the cable, if the cable moves from a stable range of motion to an unstable range of motion, the system may report to the user that an action needs to be taken relative to the cable.

[0007] In some implementations, the system is configured to store at least one of images or videos from at least one of a plurality of cameras to establish a first motion-based event, which may correspond to a fixed or otherwise stabilized cable. The system also detects a second motion-based event. For example, when one end of the cable becomes loose from an anchor point corresponding to the vehicle cargo compartment, the cable's movement has a different image / video profile than when the cable is fixed to the anchor point. Based on the detection of the second motion-based event, the system then performs a comparison between at least one of the first motion event, a stable range of motion, or an unstable range of motion. Based on this comparison, the cable status is determined and reported to the vehicle user (e.g., depending on the comparison result, a head-up display or center console display may report a "fixed" or "loose" status, where a "loose" status may be paired with details such as "the cable is not secured to one of the two cargo compartment anchors").

[0008] In some implementations, the processing circuitry is further configured to (e.g., based on the cable's reflective properties) identify the cable in the captured image, track the cable's movement between captured images (e.g., compare mappings), and identify motion events (e.g., the cable becoming loose or broken at one or both ends) based on that movement.

[0009] In some implementations, the system detects a third motion-based event associated with the protective cable. In some implementations, one of the multiple cameras is positioned at the upper rear of the passenger compartment and has a view of the vehicle's external storage area. For example, the vehicle's external storage area may include a truck bed. Based on the detection of the third motion-based event, the system performs a second comparison between at least one of the cable position or movement and at least one of a first motion event, a second motion event, a stable range of movement, or an unstable range of movement. The second comparison may generate a response action, such as, for example, closing the motorized cable assembly. Other examples of response actions include generating one or more audible or video alarms that are similar to, the same as, or different from the cable state resulting in response to the detection of at least one of the first or second motion events (e.g., the cable is secured during the first event, becomes loose during the second event, and is then resecured during the third event).

[0010] In some implementations, the system detects collision events. For example, the system may detect a collision event based on one or more sound sensors configured to monitor rising sounds or an accelerometer sensor configured to monitor changes in speed. Based on the detection of a collision event, the system may prompt a user to take action relative to the cable. In some implementations, processing circuitry identifies a location of damage on the vehicle associated with the collision event based on at least one image from captured images. The processing circuitry provides the user with at least one image from captured images associated with the damage location to clarify any changes in state relative to the protective cable.

[0011] In some embodiments, the system and method include a vehicle sensor configured to detect motion-based events associated with a protective cable corresponding to a vehicle cargo compartment. The vehicle sensor may be configured to capture images or videos of at least one of the following: a portion of the cable, a portion of the vehicle cargo compartment, or both of the cable and the vehicle cargo compartment. The system automatically captures at least one image of the motion-based event via the vehicle sensor (e.g., capturing an image of the cable as it moves relative to at least one of a starting position or a fixed position at the start of a new vehicle journey). Processing circuitry also presents a user interface that allows the user to receive and view the data: a status icon corresponding to at least one of the cable or the vehicle cargo compartment (e.g., “Cargo compartment: Empty,” “Cargo compartment: Loaded,” “Cable: Secured,” “Cable: Loose,” “Cable: Disconnected,” or “Anti-theft alarm”).

[0012] In some implementations, the system determines that an enhanced monitoring mode is enabled for the vehicle. Based on the enabled monitoring mode, the system allows one or more vehicle sensors to capture motion-based events. In some implementations, the monitoring mode is automatically triggered when the vehicle is locked. In other implementations, the monitoring mode is enabled in response to the vehicle moving away from a trusted location. In some implementations, the monitoring mode corresponds to the instruction to close the vehicle cargo cover in response to a determination corresponding to at least one of a loose or disconnected protective cable (e.g., an automatic truck bed cover is extended over the truck bed corresponding to the vehicle cargo bed and locked to a closed position).

[0013] In some implementations, motion-based events associated with the vehicle are based on at least one or more of vehicle collision data, vehicle pressure data, or airbag deployment data. In response to receiving vehicle collision data, at least one of the protective cable status or vehicle cargo box status is generated for display and may include an audible indication of at least one of the protective cable status or vehicle cargo box status.

[0014] In some implementations, vehicle sensors are connected to an onboard computer configured to operate the vehicle. In some specific implementations, the onboard computer is configured to operate the vehicle as an autonomous vehicle. In some implementations, the onboard computer may communicatively connect to one or more of a mobile device (via wireless connection) or a cloud-based server. In some implementations, the system transmits stored images and videos of motion-based events to the cloud via the server in response to a request or automatically. In some implementations, the vehicle can process the video to reduce its size by performing analysis on the video and subtracting extraneous content. In some implementations, the vehicle may transmit a lower-quality version to the server and may request confirmation of the transmission of a higher-quality version.

[0015] In some implementations, the processing circuitry determines a collision event. The processing circuitry may determine a collision event in response to capturing at least one image of a motion-based event. The processing circuitry may identify the location of damage on the vehicle associated with the collision event based on at least one image. The processing circuitry may also provide at least one audio or video indication of at least one of the status of protective cables or the status of the vehicle's cargo compartment.

[0016] In some implementations, the processing circuitry determines the extent of damage to the vehicle based on at least one image of the motion-based event stored at a first storage location. When the extent of damage to the vehicle exceeds a threshold, the processing circuitry causes at least one image of the motion-based event to be stored at a second storage location located away from the first storage location.

[0017] In some implementations, the processing circuitry presents an alert for a motion-based event on a user interface. The processing circuitry may receive a selection to view at least one image of the motion-based event. For presentation on the user interface, the processing circuitry generates at least one image (e.g., an image or video corresponding to at least a portion of the protective cable or at least a portion of the vehicle cargo compartment, to adequately characterize whether one or both of the protective cable and the vehicle cargo compartment are in an unsecured or damaged state).

[0018] In some implementations, the processing circuitry classifies at least one image into an event-based category based on the event type of the motion-based event (e.g., storing the image based on at least one category such as "vehicle cargo box damage" or "protective cable damage").

[0019] In some implementations, the vehicle may include a reflective protective element (having reflective elements designed to maximize detection and suppress false alarms), a camera system, and an integrated package of monitoring systems configured to perform the various methods described herein.

[0020] In some embodiments, the vehicle may include a plurality of cameras configured to capture images of at least a portion of at least one of the vehicle cargo box, protective cables, trailer assembly, or winch assembly located at either the front or rear of the vehicle. Based on the detection of motion events with at least one of the listed components (e.g., by processing camera data with or without vehicle sensor data), tension on the trailer cable / winch cable corresponding to something being pulled toward the front or rear of the vehicle can be sensed. In response to the sensed tension, the torque or speed of either the winch assembly or the trailer assembly can be adjusted based on the sensed slack to stabilize either the winch assembly or the trailer assembly including the cable. Attached Figure Description

[0021] The present disclosure is described in detail with reference to the following accompanying drawings, which illustrate one or more various embodiments. The drawings are provided for illustrative purposes only and show only typical or exemplary embodiments. These drawings are provided to facilitate understanding of the concepts disclosed herein and should not be considered as limitations on the breadth, scope, or applicability of these concepts. It should be noted that these drawings are not necessarily drawn to scale for clarity and ease of illustration.

[0022] Figure 1 A block diagram of components of a vehicle system according to some embodiments of the present disclosure is shown, the system being configured to monitor the area surrounding the vehicle, the vehicle cargo compartment, and cable protection corresponding to the vehicle cargo compartment.

[0023] Figure 2 A block diagram of a vehicle system according to some embodiments of the present disclosure is shown, the system being configured to monitor the area surrounding the vehicle, the vehicle cargo compartment, and cable protection corresponding to the vehicle cargo compartment;

[0024] Figure 3 A top view of an exemplary vehicle configured with a system according to some embodiments of the present disclosure is shown, the system being configured to monitor the vehicle cargo compartment and cables corresponding to the vehicle cargo compartment;

[0025] Figure 4 An exemplary vehicle equipped with multiple cameras according to some embodiments of the present disclosure is shown, and a top view of the capture range of these cameras relative to protective cables in the vehicle cargo compartment, the multiple cameras being mounted on the vehicle.

[0026] Figure 5 An exemplary example of a vehicle featuring a graphical user interface according to some embodiments of this disclosure is depicted;

[0027] Figure 6An exemplary example of a system-featured vehicle according to some embodiments of the present disclosure is depicted, the system being configured to monitor and report the status of protective cables and the status of the vehicle cargo compartment;

[0028] Figure 7 A flowchart of an exemplary process according to some embodiments of the present disclosure is shown, the exemplary process being used to perform an action in response to detecting a movement event corresponding to at least one of the vehicle cargo box or the protective cable;

[0029] Figure 8 A flowchart of an exemplary process according to some embodiments of the present disclosure is shown, the exemplary process being used to perform an action in response to detecting a movement event corresponding to at least one of the vehicle cargo box or the protective cable;

[0030] Figure 9 A flowchart illustrating an exemplary process according to some embodiments of the present disclosure is shown, which is used to optimize power supply while operating in monitoring mode; and

[0031] Figure 10 A flowchart illustrating an exemplary process for operating a vehicle in monitoring mode according to some embodiments of the present disclosure is shown. Detailed Implementation

[0032] This document provides methods and systems for monitoring the cargo compartment of a vehicle (e.g., a truck bed) by analyzing data corresponding to a protective cable while the vehicle is either in operation (e.g., driven by a driver or an autonomous control system) or stationary (e.g., when one or more vehicle systems are active and configured for monitoring mode).

[0033] Figure 1 A block diagram of components of a system 100 for a vehicle 101 according to some embodiments of the present disclosure is shown. The system 100 is configured to monitor the area surrounding the vehicle. The system 100 may include more or fewer components than those referenced in the reference diagram. Figure 1 The elements depicted or described. Additionally, system 100 may be combined with or can be combined with... Figures 2 to 10 Any or all of the following. In some embodiments, vehicle 101 is configured to capture at least one of the images or videos for determining the status of the protected cable. Vehicle 101 may be an automobile (e.g., a coupe, sedan, truck, SUV, SUV, full-size van, minivan, delivery van, bus), motorcycle, aircraft (e.g., drone), vessel (e.g., boat), or any other type of vehicle. Vehicle 101 may include any kind of motor capable of generating power (e.g., throttle motor, hybrid motor, electric motor, battery-powered electric motor, hydrogen fuel cell motor).

[0034] Vehicle 101 may include processing circuitry 102, which may include processor 104 and memory 106. Processor 104 may include a hardware processor, a software processor (e.g., a processor emulated using a virtual machine), or any combination thereof. In some embodiments, the processing circuitry is part of an on-board computer configured to operate the vehicle. In some embodiments, the on-board computer may be configured to operate the vehicle autonomously or semi-autonomously. The on-board computer may include a communication driver that communicates with user equipment 138 and server 136. In some embodiments, processor 104 and memory 106 combined may be referred to as processing circuitry 102 of vehicle 101. In some embodiments, processor 104 alone may be referred to as processing circuitry 102 of vehicle 101. Memory 106 may include hardware elements for non-transitory storage of commands or instructions that, when executed by processor 104, cause processor 104 to operate vehicle 101 according to the embodiments described above and below. Processing circuitry 102 may be communicatively connected to components of vehicle 101 via one or more wires or via a wireless connection. For example, one or more captured images or videos related to a motion event may be automatically uploaded to server 136 (e.g., in compressed or full format), and user device 138 may access and view one or more captured images or videos. Alternatively, one or more captured images or videos may be remotely accessed from vehicle 101 (e.g., when the vehicle is connected to the Internet or only when connected via WiFi or plugged into a charger).

[0035] Processing circuitry 102 may be communicatively connected to input interface 116 (e.g., a steering wheel, touchscreen display, button, knob, microphone, or other audio capture device) via input circuitry 108. In some embodiments, at least one of the driver or occupants of vehicle 101 may be allowed to select specific settings in conjunction with operation of vehicle 101. In some embodiments, processing circuitry 102 may be communicatively connected to vehicle 101's GPS system 133 or other positioning device, wherein the driver may interact with the GPS system via input interface 116. GPS system 133 may communicate with at least one (or more) satellites and / or server 136 located remotely from vehicle 101 to determine the driver's location and provide navigation directions to processing circuitry 102. Alternatively, positioning devices may operate on terrestrial signals (such as cellular phone signals, Wi-Fi signals, or ultra-wideband signals) to determine the location of electric vehicle 101. The determined location may be in any suitable form, such as geographic coordinates, street address, nearby landmarks (such as identification of the nearest charging station), or a marked location associated with the vehicle (e.g., the location of the user's residence stored in memory 106).

[0036] Processing circuitry 102 can be communicatively connected to display 112, lamp 113, speaker 114, and horn 115 via output circuitry 110. Display 112 may be located above or within a head-up display on the dashboard or windshield of vehicle 101. For example, it may be used to generate an interface for a GPS system 133 or an infotainment system for display, and display 112 may include an LCD display, OLED display, LED display, or any other type of display. Lamp 113 may be located at one or more of the following: any location within the cabin of vehicle 101 (e.g., at the dashboard of vehicle 101), the exterior of the vehicle, the interior of a door, exterior hazard lights, exterior headlights, or exterior turn signals. In some embodiments, the lamp may be an LED lamp, and its brightness may increase based on the detection of motion events.

[0037] Processing circuitry 102 may communicatively connect (e.g., via sensor interface 117) to sensors (e.g., front sensor 124, rear sensor 126, truck bed sensor 127, left-side sensor 128, right-side sensor 130, cable sensor 137, orientation sensor 118, and speed sensor 120). Orientation sensor 118 may be an inclinometer, accelerometer, tilt meter, any other pitch sensor, or any combination thereof, and may be configured to provide processing circuitry 102 with vehicle orientation values ​​(e.g., vehicle pitch or vehicle roll). Speed ​​sensor 120 may be a speedometer, GPS sensor, or any combination thereof, and may be configured to provide processing circuitry 102 with a reading of the vehicle's current speed. At least one of the front sensor 124, rear sensor 126, truck bed sensor 127, left-side sensor 128, right-side sensor 130, or cable sensor 137 may be located at various positions on vehicle 101 and may include one or more of various sensor types (e.g., image sensor, ultrasonic sensor, radar sensor, LED sensor, LIDAR sensor (configured to: output light or radio wave signals; and measure at least one of the time to detect a returned signal or the intensity of the returned signal, thereby performing image processing on an image of the surrounding environment of vehicle 101 captured by the image sensor)). In some embodiments, processing circuitry 102 may, for example, consider acceleration / deceleration of vehicle 101 based on sensor data generated by orientation sensor 118, which may trigger motion events exceeding an event monitoring threshold.

[0038] The processing circuitry 102 may also be communicatively connected (e.g., via sensor interface 117) to the collision sensor 140 (e.g., airbag sensor 142, bumper 144, side 146, top 148). The collision sensor 140 may include an airbag system, such as window area sensors, airbag system components, and collision sensors. The airbag system includes a plurality of airbag sensors 142 arranged near one or more window areas or other areas of the vehicle and configured to transmit signals to the processing circuitry in response to airbag deployment. The vehicle collision sensor 140 typically includes a gyroscope, an accelerometer, or both. For example, the vehicle collision sensor 140 may include a MEMS accelerometer capable of detecting the deceleration of the vehicle and the vehicle's position during a collision. The vehicle collision sensor 140 may be located at various locations within the vehicle. For example, vehicle collision sensor 140 may be configured to detect impact, motion, and deceleration at the front, side 146, rear 144, top 148, or combinations thereof (e.g., at a corner of vehicle 101) of vehicle 101. In some embodiments, vehicle collision sensor 140 includes more than one sensor, each having similar circuitry and capabilities for detecting collision scenarios for vehicle 101. In some embodiments, vehicle collision sensor 140 includes more than one sensor, each having different capabilities, for example, designed for a specific location on the vehicle. In some embodiments, the sensors are configured to capture video. In some embodiments, the degree of damage may be determined based on damage occurring at a specific location on the vehicle. For example, the vehicle may be involved in a minor rear-end collision, and a position sensor for the bumper may indicate a low degree of damage based on signals from the sensor. In some embodiments, vehicle collision sensor 140 includes a seat sensor configured to detect whether someone is sitting in a specific seat.

[0039] Vehicle collision sensor 140 may communicate with processing circuitry 102. In some embodiments, processing circuitry 102 is configured to analyze data from vehicle collision sensor 140 and send one or more signals to activate one or more airbags 142 of the airbag system. Based on information from vehicle collision sensor 140, processing circuitry 102 may determine the type of impact (e.g., side, front, rear, corner, or rollover collision or water damage event) and vehicle occupancy (e.g., driver and occupants, if present) and initiate the deployment of the appropriate airbag of the airbag system for that impact type. Based on information from vehicle collision sensor 140, processing circuitry 102 may determine which camera captured an image or video of at least one of a collision, a vehicle compartment event, or a protective cable event to streamline processing. The captured image, multiple images, or video may correspond to at least one of a protective cable, an area including a protective cable, or cargo secured based on the arrangement of the protective cable. In response to a collision, issues related to the protective cable and cargo are analyzed to report the status of either or both of the protective cable and cargo.

[0040] In response to damage exceeding a damage threshold (e.g., multiple airbags deployed, bumper pressure exceeding limits determined by sensors), the system can process at least one of image, video, or other sensor data corresponding to the vehicle cargo compartment status and cable status. For example, the vehicle cargo compartment status can be at least one of "Cargo compartment: Open," "Cargo compartment: Closed," "Cargo compartment: Damaged," "Cargo compartment: Empty," and "Cargo compartment: Loaded." Similarly, the cable status can be at least one of "Cable: Secured," "Cable: Loose," "Cable: Cut," and "Cable: Anchor Damaged." In some embodiments, the cargo reporting status can be "Cargo: Displaced," "Cargo: Damaged," or "Cargo: Missing." In some embodiments, the severity of the incident can trigger at least one of additional or other activities (e.g., emergency response, incident cleanup, towing, alternative transportation).

[0041] In some implementations, processing circuitry 102 determines a collision event using an accelerometer sensor configured to monitor changes in speed. For example, if the vehicle's speed changes, processing circuitry 102 may perform a vehicle collision sensor check to ensure that all sensors on the vehicle's exterior are responsive. In response to a sensor not responding, processing circuitry 102 may determine that a collision has occurred and initiate a reporting process.

[0042] The processing circuitry 102 may also be communicatively connected to the cable assembly 150 or another means for securing cargo in or to an external storage compartment. The cable assembly 150 may include a motor 152, one or more sensors 154, and a reel 156. The motor 152 may include, for example, a DC motor (e.g., a permanent magnet motor, a brushed motor, or a brushless motor with a wound stator), an AC motor (e.g., an induction motor), any other suitable motor having any suitable number of poles and phases, or any combination thereof. For example, the motor 152 may include a permanent magnet DC motor configured to operate at 12VDC. A clutch is configured to engage and disengage the motor 152 from the reel 156. For example, in some embodiments, the clutch is controlled by the processing circuitry 102, which may provide control signals for engaging or disengaging the clutch. In an exemplary example, the clutch may disengage to allow free winding of the cable assembly. The reel 156 is optionally coupled to the motor 152 via a gear set to provide gear reduction and rotates with the motor shaft of the motor 152. The cable is wound around a reel 156 and is used to pull or draw the cable assembly from an open position to a closed position. Sensor 154 may include a voltage sensor, current sensor, temperature sensor, impedance sensor, position sensor (e.g., an encoder for determining the reel position), torque sensor, any other suitable sensor, or any combination thereof. While the power and control for the cable assembly 150 are coupled to vehicle 101, the cable assembly 150 may be integrated into at least one of the body or frame of the vehicle storage compartment, or it may be attached separately to the vehicle. In some embodiments, the cable assembly 150 may include power electronics (e.g., a motor driver) and may therefore be coupled to battery system 132 and configured to receive control signals (e.g., analog signals, PWM signals, digital signals, messages) from processing circuitry.

[0043] Processing circuitry 102 may be communicatively connected to battery system 132, which may be configured to provide power to one or more components of vehicle 101 during operation. In some embodiments, vehicle 101 may be an electric vehicle or a hybrid electric vehicle. In some embodiments, processing circuitry 102 may monitor the environment around the vehicle by utilizing multiple battery cells packaged together to form one or more battery modules or components to store energy and release energy upon request.

[0044] It should be understood that Figure 1 Only some of the components of vehicle 101 are shown, and it should be understood that vehicle 101 also includes other elements commonly found in any component corresponding to a vehicle (such as a vehicle that is substantially driven by an electric powertrain), such as motors, brakes, wheels, wheel controls, turn signals, windows, doors, etc.

[0045] Figure 2 A block diagram of a system 200 for a vehicle 200 according to some embodiments of the present disclosure is shown. This system is configured to monitor the vehicle cargo compartment and protect cables or other surrounding objects. System 200 may include more or fewer components than those described in the references. Figure 2 The elements depicted or described. Additionally, the system may be incorporated into or can be incorporated into. Figure 1 and Figures 3 to 10 The system 200 may include any or all of the following: a plurality of cameras 204, 206, 208, a motion event detection network 210, and a status monitoring module 218. In some embodiments, one or more components of the system 200 (e.g., the motion event detection network 210 and the status monitoring module 218) may be implemented by at least one of the processing circuitry of the processing circuitry of the processing circuitry of the processing circuitry of the server 136. One or more cameras of the cameras 204, 206, 208 may each correspond to one of the sensors 124, 126, 127, 128, 130, and 137.

[0046] Cameras 204, 206, and 208 can be mounted on any suitable interior or exterior portion of vehicle 101. In some embodiments, one or more of cameras 204, 206, and 208 may correspond to a monocular fisheye camera configured to cover a wide field of view around vehicle 101. Although Figure 2 Three cameras are depicted, but it should be understood that any suitable number of cameras can be used (e.g., fewer than three cameras or more than three cameras, such as four cameras positioned at the front, rear, and each side of vehicle 101, respectively). In some embodiments, five cameras may be positioned at the front, rear, and each side of vehicle 101, and facing the truck bed. Such cameras can be mounted at any suitable corresponding location on vehicle 101 to capture images of the entire area or environment surrounding vehicle 101 in motion event 202 while vehicle 101 is stationary or in motion. Motion event 202 may correspond to at least one of vehicle bed being opened, vehicle bed being loaded with a load, or vehicle bed being closed, and at least one of protective cable being secured, protective cable being unsecured, protective cable being disconnected, protective cable being moved, protective cable being loosened, or protective cable being damaged (e.g., as reported at least in part by a cable sensor that may correspond to a cable anchor). Motion event 202 may be characterized based on captured images of the cable, cargo secured by the cable, or at least one of the following: A series of images, including any suitable number of images, can be captured by cameras 204, 206, and 208. These cameras provide images of a cable including reflective material located thereon for storage, comparison, analysis, and status reporting. In some embodiments, images can be captured repeatedly (e.g., at a predetermined frequency to capture the environment surrounding vehicle 101 over time).

[0047] One or more images or frames captured by cameras 204, 206, 208 may be input to motion event detection network 210 (e.g., including frame queue 212 and neural network 214). Motion event detection network 210 may be configured to identify one or more candidate objects (e.g., the surface of a cable, the end of a cable, or other features of a cable including reflective materials) in the images captured by cameras 204, 206, 208 using any suitable image recognition technique. In some embodiments, processing circuitry 102 may manipulate any of the captured images in a series such that the candidate object is located in a similar position across all camera images. Motion event detection network 210 may be configured to output one or more 2D motion event analyses 216 for one or more candidate objects. For example, motion event detection network 210 may be configured to draw 2D boundary shapes (e.g., bounding boxes, boundary polygons, boundary triangles, boundary ellipses, or boundary circles, etc.) around candidate objects (e.g., vehicles, people, animals, protective cables, or other obstacles) positioned in front of, behind, or to the side of vehicle 101. Frame queue 212 may store multiple images of the surrounding environment of vehicle 101 captured by cameras 204, 206, 208, and such images may be input into neural network 214 in, for example, a first-in-first-out manner. Neural network 214 may be, for example, a convolutional neural network (CNN) or any other suitable machine learning model, trained to take images of the surrounding environment of vehicle 101 as input and output corresponding motion event analysis 216 for one or more candidate objects. The proximity of objects to vehicle 101 may be estimated based on the object detection representation. In some embodiments, when one or more of cameras 204, 206, 208 correspond to fisheye cameras that produce relatively large distortions based on their wide-angle lenses, images with distortions similar to those produced by fisheye camera lenses may be used to train neural network 214.

[0048] In some implementations, neural network 214 can be trained to learn patterns and features associated with certain categories of objects (e.g., people, cars, buses, motorcycles, trains, bicycles, safety cables, or backgrounds). In some implementations, such machine learning models can be trained to learn patterns and features associated with subcategories of a category (e.g., cars, vans, trucks). Classification can be performed by neural network 214, which includes one or more machine learning models, such as a CNN trained to receive input images of objects around a vehicle (e.g., where the image can be annotated with any suitable boundary shape relating to at least one of the object, the distance from the vehicle to the object annotation, or the category of the object annotation) and output the probability that these vehicles correspond to a particular vehicle category. Such a CNN can be trained on a training dataset containing images of vehicles manually labeled with their specific vehicle types. In some implementations, any combination of the following categories (e.g., background, airplane, bicycle, bird, boat, bottle, bus, car, cat, chair, cow, dining table, dog, horse, scooter, motorcycle, person, potted plant, sheep, sofa, train, TV monitor, truck, stop sign, traffic light, traffic sign, motor) can be used via at least one of the training or evaluation models. In some implementations, a confidence score can be output along with the predicted category to which the identified object belongs (e.g., 86% confidence that the object is a human).

[0049] In some implementations, any suitable batch size (e.g., 32, 64, or any suitable batch size for training the model) can be used to train the model, and the neg_pos_ratio used for hard negative sample mining can be any suitable value (e.g., 3, 5, or any suitable numerical value). In some implementations, any suitable weights can be applied to the object category (e.g., to account for entropy loss). For example, the categories of bicycle, bus, car, motorcycle, person, and train can be assigned the following corresponding weights: 1.25, 0.9, 0.9, 0.9, 0.9, 1.25, 0.9. In some implementations, considering the characteristics of the boundary shape of a particular object (e.g., a person), the prior box relative to the baseline can be updated.

[0050] The state detection module 218 may be configured to output a determination 220 of a cable problem (associated with motion event analysis 216) corresponding to at least one of a vehicle cargo compartment (e.g., a truck bed) or a vehicle 101 including protective cables. The state detection module 218 may include an outlier removal model and an object-to-vehicle distance estimation model. In some embodiments, one or more components of the state detection module 218 (e.g., the outlier removal model and the object-to-vehicle distance estimation model) may be implemented by at least one of the processing circuitry 102 or the processing circuitry of the server 136.

[0051] The state detection module 218 may receive one or more motion event analyses 216 from the motion event detection network 210 and perform preprocessing at 102, such as: extracting suitable features from at least one motion event analysis 216; converting the motion event analysis 216 into a vector or matrix representation; or matching the formatting of the motion event analysis 216 with the formatting, normalization, resizing, or minimization of template data. In some embodiments, the processing circuitry may perform one or more of the following image processing techniques: brightening an image or a portion thereof, darkening an image or a portion thereof, color shifting an image (e.g., from color to grayscale or other mappings in a color scheme), cropping an image, scaling an image, adjusting the aspect ratio of an image, adjusting the contrast of an image, performing any other suitable processing to prepare an image, or any combination thereof. Any suitable number of features of the candidate object (e.g., x-coordinate, y-coordinate, height, or width associated with the object) may be input to the state detection module 218.

[0052] The determination 220 of cable problems corresponding to components of vehicle 101 (as associated with motion event analysis 216) can determine whether there is movement or damage to at least one of the vehicle cargo / cargo compartment or protective cables. For example, a protective cable may be disconnected or obstructed, and determination 220 results in the generation of an instruction to close at least one of the vehicle cargo door or vehicle cargo cover.

[0053] In some implementations, motion event analysis 216 operates on captured images using a comparison map. For example, cables can be identified in images based on cable reflectivity, and differences in cable position between images can be used to determine cable movement. State detection 218 can be configured to determine the amount of cable movement (e.g., rate of change or absolute movement) and whether it is within acceptable limits. If the amount of movement exceeds a threshold, a motion event is determined. When the vehicle is moving, a motion event may indicate that the protective cable is loose or not secured. When the vehicle is stationary, a motion event may indicate that the cable or cargo associated with the cable is obstructed.

[0054] Figure 3 A top view 300 of an exemplary vehicle 302 according to some embodiments of the present disclosure is shown, the exemplary vehicle being configured with a monitored area for detecting problems corresponding to at least one of a vehicle cargo compartment or a protective cable corresponding to the vehicle cargo compartment. The top view 300 may include more or fewer reference areas. Figure 3 The elements depicted or described. Additionally, top view 300 may be combined with or can be combined with... Figure 1 , Figure 2 and Figures 4 to 10 In any one or all of them.

[0055] Top view 300 includes a depiction of vehicle 302 and the positions of cameras positioned around the vehicle. Vehicle 302 may include multiple cameras 304, 306, 308, 310, and 312, multiple event detection thresholds 320, 322, 324, and 326 (e.g., values ​​corresponding to sensor, video, or image analysis to determine motion events corresponding to at least one of the vehicle cargo compartment 328 and protective cables installed in the vehicle cargo compartment 328), and a proximity sensing module, not shown. In some embodiments, one or more components of system 200 (e.g., motion event detection network 210 and state detection module 218) may be implemented by processing circuitry 102 (or processing circuitry of server 136). One or more cameras among cameras 304, 306, 308, 310, and 312 may each correspond to one of sensors 124, 126, 127, 128, 130, and 137. Camera 304 is positioned on the first side of the vehicle, camera 306 is positioned on the front side of the vehicle, camera 308 is positioned on the second side of the vehicle, camera 312 is positioned on the rear side of the vehicle, and camera 310 is positioned on the upper rear of the passenger compartment and has a view of the vehicle's external storage areas. In some embodiments, any suitable number of cameras can be used, and a variety of different camera positions can be used (e.g., showing a variety of different angles at different distances from each other in various different environments).

[0056] The use of cameras 304, 306, 308, 310, and 312 can be used to form event detection thresholds 320, 322, 324, and 326. For example, by having the cameras capture images around the vehicle, an object exhibiting motion-based characteristics exceeding a motion event threshold can trigger an event detection action. For example, a first event detection threshold 324 of the plurality of event detection thresholds 320, 322, 324, and 326 can span any suitable distance from the vehicle, and each subsequent event detection threshold can be closer to the vehicle 302. For example, the first event detection threshold 324 can combine at least one of sensor data, video data, or camera data corresponding to a motion event occurring within a first proximity of the entire vehicle's surrounding environment, while the second event detection threshold 322 can combine at least one of sensor data, video data, or camera data corresponding to a motion event occurring within a second proximity of the entire vehicle's surrounding environment. The third event detection threshold 320 may combine at least one of sensor data, video data, or camera data corresponding to motion events occurring within a third proximity to the entire vehicle's surrounding environment, while the fourth event detection threshold 326 may combine at least one or only one of sensor data, video data, or camera data corresponding to motion events occurring within the vehicle's cargo compartment 328, illustrated by protective cables fixed to the vehicle's cargo compartment, including the two side walls. The proposed event detection thresholds are exemplary and should not be limited by the number of vehicles or the distance from the vehicles. In some embodiments, any two event detection thresholds may be used as part of an event detection system. In some embodiments, the captured image may include a fisheye image of any suitable size (e.g., a 1376×976 fisheye image).

[0057] In some embodiments, vehicle 302 includes at least one of trailer assembly 328 or winch assembly 330. For example, either or both of trailer assembly 328 and winch assembly 330 include components that can be monitored, such as protective cables (e.g., reflective materials that can be analyzed for position and motion characteristics via sensor data analysis, video data analysis, and / or image data analysis).

[0058] Figure 4 A top view 400 is shown of an exemplary vehicle configured with multiple cameras according to some embodiments of the present disclosure, and the capture range of the images from these cameras, which are mounted on the vehicle. The top view 400 may include more or fewer cameras than those in the reference view. Figure 4 The elements depicted or described. Additionally, top view 400 may be combined with or can be combined with... Figures 1 to 3 and Figures 5 to 10 In any one or all of them.

[0059] The top view 400 includes a depiction of vehicle 402 and the positions of cameras positioned around the vehicle. Vehicle 402 may include multiple cameras 404, 406, 408, 410, and 412, and corresponding image ranges 414, 416, 418, 420, and 422 for each camera 404, 406, 408, 410, and 412. In some embodiments, one or more components of system 200 (e.g., motion event detection network 210 and state detection module 218) may be implemented by at least one of processing circuitry 102 or processing circuitry of server 136. One or more cameras among cameras 404, 406, 408, 410, and 412 may correspond to... Figure 1 Sensors 124, 126, 127, 128, 130, and 137, and Figure 3 At least one of cameras 304, 306, 308, 310, and 312. One or more cameras among cameras 404, 406, 408, 410, and 412 can be similarly positioned, as described above. Figure 3 As described above. In some implementations, any suitable number of cameras can be used, and a variety of different camera positions can be used (e.g., showing a variety of different angles at different distances from each other in a variety of different environments).

[0060] Cameras 404, 406, 408, 410, and 412, and their respective captured images, can be used to determine or report at least one of the conditions of the vehicle cargo compartment or the protective cable. For example, by having the cameras capture images around the vehicle, an object appearing within the image range can trigger the capture of the images. In some embodiments, capturing images includes capturing video and audio. For example, a first image range 414 corresponds to an image captured by camera 404, a second image range 416 corresponds to an image captured by camera 406 (e.g., corresponding to the front winch assembly), a third image range 418 corresponds to an image captured by camera 408, a fourth image range 420 corresponds to an image captured by camera 410 (e.g., at least one of the vehicle cargo compartment 428, protective cables attached to the vehicle cargo compartment 428, or trailer assembly), and a fifth image range 422 corresponds to an image captured by camera 412 (e.g., corresponding to the trailer assembly). The captured image can be captured in response to one or more motion-based events detected by cameras 404, 406, 408, 410 and 412, or when cameras 304, 306, 308, 310 and 312 or any other sensor (e.g., an ultrasonic sensor, radar) detects an object within any of the event detection thresholds 320, 322, 324, 326.

[0061] In some implementations, vehicle 402 includes at least one of a trailer assembly or a front winch assembly. For example, either or both of the trailer assembly and the front winch assembly include components that can be monitored, such as protective cables (e.g., reflective materials that can be analyzed for position and motion characteristics via sensor data analysis, video data analysis, and / or image data analysis).

[0062] Figure 5 An exemplary example of a vehicle 500 featuring a graphical user interface 502 according to some embodiments of the present disclosure is depicted. The vehicle 500 may include more or fewer of the following: Figure 5 The elements depicted or described. Additionally, vehicle 500 may be combined with or can be combined with... Figures 1 to 4 and Figures 6 to 10 Any or all of them. In some implementations, the graphical user interface 502 may refer to being integrated into a vehicle (such as...). Figure 5 In the vehicle 500), components coupled to or accessible by the vehicle.

[0063] Vehicle 500 is equipped with a graphical user interface 502, which can be used to enable / disable vehicle systems including options to enable and disable monitoring modes, vehicle event detection modes, or any other modes, or to disable and disable any modes. For example, a user in vehicle 500 can use the graphical user interface 502 to access options on vehicle 500. In some embodiments, the graphical user interface 502 may be integrated into vehicle 500 or user equipment for accessing such vehicle systems while using vehicle 500. In some embodiments, the vehicle systems displayed on the graphical user interface 502 may be communicatively connected to user input to vehicle 500 (e.g., a microphone and speaker for providing voice commands). For example, a user may provide a voice command to activate a vehicle yaw mode, and an audio system integrated into vehicle 500 may translate such a command to enter vehicle monitoring mode.

[0064] Figure 6 A rear view of the monitoring system 600 is shown. The monitoring system 600 includes a vehicle 602, a vehicle camera 604, a protective cable 606, a vehicle sensor 608, and a trailer assembly 610. The monitoring system 600 may include more or fewer components than those shown in the reference diagram. Figure 6 The elements depicted or described. Additionally, the monitoring system 600 may be incorporated into or can be incorporated into... Figures 1 to 5 and Figures 7 to 10 In any one or all of them.

[0065] Cargo 612 is arranged in the rear cargo compartment (e.g., truck bed) corresponding to vehicle 602. Cargo 612 is at least partially secured to the cargo compartment of vehicle 602 by a protective cable 606. An unsecured protective cable 614 corresponds to an exemplary case where at least one connection of the protective cable 606 is lost. This can be achieved via camera 604 and vehicle sensor 608 (e.g., from...). Figure 1 , Figure 3 and Figure 4 The unsecured protective cable is detected by any or all of the following sensors: (any or all of the sensors). When the protective cable 606 is changed to an unsecured protective cable 614, a motion event (e.g., such as...) is detected based on at least one of camera data or sensor data (which can trigger a notification to be presented to the driver of vehicle 602). Figures 1 to 5 (As illustrated in the description and any or all examples described herein). In some embodiments, the camera is positioned at the upper rear of the vehicle's passenger compartment and has a view of the vehicle's cargo storage area. Actions performed in response to the vehicle detecting the depicted motion event include generating a notification to the user or performing a safety response (e.g., closing the cargo / storage area cover). Figure 6 In some embodiments not depicted, the cable is a trailer cable connected to the vehicle. The vehicle's processing circuitry is configured to identify motion events by recognizing slack in the trailer cable. Actions performed by the vehicle include adjusting the vehicle's speed to reduce slack in the trailer cable.

[0066] Figure 7 A flowchart of a process 700 for performing a response according to some embodiments of this disclosure is shown. Process 700 may include more or fewer components than those referenced. Figure 7 The elements depicted or described. Additionally, process 700 may be incorporated into or can be incorporated into... Figures 1 to 6 and Figures 8 to 10 Any or all of them. For example, process 700 may be executed at least in part by one or more of the processing circuits of processing circuit 102 or server 136.

[0067] At 702, processing circuitry 102 may capture images of at least a portion of the protective cable, or at least a portion of the vehicle cargo box, or more than one portion of the protective cable or the vehicle cargo box (e.g., captured by cameras 204, 206, 208, which may be wide-angle fisheye cameras as part of monitoring the vehicle to determine at least one of the vehicle cargo box status, trailer assembly status, winch assembly status, or protective cable status). In some embodiments, processing circuitry 102 captures images of whether the vehicle is in motion or stationary. In some embodiments, image capture may be in response to a user enabling a monitoring mode for monitoring the area surrounding the vehicle and various vehicle components to detect motion events exceeding an event threshold (e.g., component oscillation, component movement amount, component movement rate, component acceleration rate, frequency of sound generated by the component) corresponding to at least a portion of at least one of the vehicle cargo box, protective cable, trailer assembly, or winch assembly. In some embodiments, the processing circuitry may employ a neural network 214 to provide annotations appended thereto or otherwise input into the information metadata, wherein the annotations indicate at least one of a specific category (e.g., protective cable, person, car, bus, motorcycle, train, or bicycle) or vehicle-to-object distance annotations. In some embodiments, at least one of an image or video of at least one of a vehicle trailer assembly or winch assembly may also be captured.

[0068] At 704, processing circuitry 102 can detect a first motion-based event in the environment surrounding vehicle 101 (e.g., captured by cameras 204, 206, 208, which may be wide-angle fisheye cameras capable of detecting motion within a first event detection threshold 324). In some embodiments, the vehicle may be in a sleep mode, where only ultrasonic sensors monitor at least a portion of at least one of the vehicle cargo box, protective cables, trailer assembly, or winch assembly 101, and in response to the detection of the first motion-based event, the system can wake the vehicle and initiate camera-based monitoring for at least one of the motion event, collision, or impact. Any suitable number of images can be captured at any suitable capture rate. In some embodiments, the system can identify false detections by applying a time limit to the duration of the motion event within the first event detection threshold. For example, a person walking in front of the vehicle for less than a few seconds within a frame may not be a motion event.

[0069] The first motion-based event can be detected based on a variety of situations and scenarios. A first example of a motion-based event is: a vehicle is parked and an input from the environment (e.g., a person, another vehicle, or another object) collides or interacts with at least one of the vehicle, a protective cable, cargo secured by the protective cable, or cargo in a vehicle cargo compartment secured by the protective cable. A second example of a motion-based event is: a vehicle is in motion and an environmental event occurs causing a rapid change in at least one of the vehicle's rotational acceleration, lateral acceleration, or other acceleration, which causes a displacement of the position of at least one of the protective cable, cargo secured by the protective cable, or cargo in a vehicle cargo compartment. The second example corresponds to: the vehicle's driver seeing an approaching object and having to perform a rapid change in trajectory (e.g., a sharp turn) or an approaching object colliding with the vehicle while the vehicle is moving. In either the first or second example, once a motion-based event occurs, there is a risk of displacement or change in state of the protective cable or cargo (which may require the vehicle driver's attention), triggering a state presentation to inform the driver whether action should be taken relative to the vehicle cargo compartment, the cargo in the vehicle cargo compartment, or the protective cable.

[0070] If the processing circuitry detects a first motion-based event ("Yes" at step 704), the processing circuitry proceeds to step 706. Otherwise, if at least one detected image or video does not recognize the first motion-based event, or if the detection incorrectly identifies at least one object or at least one object in the image or video is outside the range of interest of vehicle 101 (e.g., 10 feet), at least one of the images or videos may be discarded, and the process returns to step 702. In some embodiments, the processing circuitry stores the images and allows them to be overwritten if they are not accessed and saved.

[0071] At 706, processing circuitry 102 may store images of a first motion-based event from the environment surrounding vehicle 101, such as those captured by one or more cameras 204, 206, 208, which may be wide-angle fisheye cameras or a combination of fisheye and standard cameras. In some embodiments, the object-to-vehicle distance may be determined using training data of neural network 214 or a portion thereof (e.g., annotations indicating the distance between the object and the test vehicle). In some embodiments, the object-to-vehicle distance estimate may be trained based on the use of at least one of a timeout sensor or training images in which the object is within 10 feet of the vehicle (e.g., manually labeled to indicate the distance from the object to the vehicle).

[0072] At 708, cameras 204, 206, and 208 can detect a second motion-based event in the environment surrounding vehicle 101, for example, captured by cameras 204, 206, and 208, which may be wide-angle fisheye cameras within a second event detection threshold 322. The second motion-based event may be in response to a first motion-based event, or it may be an independent event in which an object is detected within the second event detection threshold. In this case, detecting an object within the second event detection threshold also satisfies the detection of an object within the first event detection threshold. Any suitable number of images can be captured at any suitable capture rate. If the processing circuitry detects a second motion-based event ("Yes" at step 708), the processing circuitry proceeds to step 710. Otherwise, if at least one detected image or video does not recognize a second motion-based event, or if the detection incorrectly identifies at least one object or the detected at least one object is beyond the range of interest (e.g., 8 feet) from vehicle 101, at least one of the images or videos may be discarded, and the process returns to step 702.

[0073] At 710, processing circuitry 102 can perform a first response action. For example, processing circuitry 102 can use one or more audible or visual alarms to close windows, lock doors, or cover the vehicle cargo compartment. The system can perform the first response action to prevent loss or damage to goods in the cargo compartment due to movement events.

[0074] At 712, processing circuitry 102 can detect a third motion-based event in the environment surrounding vehicle 101, such as events captured by cameras 204, 206, 208, which may be wide-angle fisheye cameras within a third event detection threshold 320. If processing circuitry detects a third motion-based event ("yes" at step 708), processing circuitry proceeds to step 714. Otherwise, if at least one image or at least one video does not identify a third motion-based event, or if the detection incorrectly identifies at least one object or the detected at least one object is outside the range of interest of vehicle 101 (e.g., 4 feet), at least one of the at least one image or video may be discarded, and the process returns to step 702. The second response action may be one or more of the following: a visual alarm, an audible alarm, closing windows, locking doors, or closing the vehicle compartment. In some embodiments, the second response action may close a motorized cable assembly on the vehicle compartment. In some embodiments, the closed motorized cable assembly is located above the truck compartment. In some implementations, the truck bed includes multiple threshold triggers, each corresponding to an event detection threshold based on the proximity of a motion event to the truck bed. For example, a first event detection threshold for an object approaching the vehicle's perimeter may cause an alarm to flash or a horn to sound, and another event detection threshold for an object / motion event accessing a storage area (e.g., detecting an arm reaching into the truck bed) may cause the motorized cable assembly to shut down. In this case, the motorized cable assembly may begin shutting down as the alarm triggers a motion event. In some implementations, shutting down the motorized cable assembly may begin in response to an object or motion event approaching the first event detection threshold.

[0075] In some implementations, based on the output of the state detection module 218, the processing circuit 102 can determine whether the motion event analysis 216 is an outlier. For example, the processing circuit 102 can determine whether an object is located in at least one part of an image or video (e.g., the sky) where a particular category of object (e.g., a person) is identified as being unlikely to be detected or is beyond the range of interest of the vehicle 101 (e.g., 10 feet). If the output indicates that the motion event analysis 216 is either a misidentified object or is beyond the range of interest of the vehicle 101 (e.g., 10 feet), at least one of the at least one video or image can be discarded.

[0076] Figure 8 A flowchart of a process 800 for performing a response according to some embodiments of this disclosure is shown. Process 800 may include more or fewer than those described in the references. Figure 8 The elements depicted or described. Additionally, process 800 may be incorporated into or can be incorporated into... Figures 1 to 7 , Figure 9 and Figure 10 Any or all of them. For example, process 800 may be executed at least in part by one or more of the processing circuits of processing circuit 102 or server 136.

[0077] At 802, an image of at least a portion of the protective cable, or at least a portion of the vehicle cargo compartment, or both, is captured. If at 804, the cable is not identified in the image (No at 804), process 800 returns to process block 802. If at 804, the cable is identified in the captured image (Yes at 804), process 800 proceeds to process block 806. For example, the cable may be identified based on the detection of a reflective coating, stripe, pattern, paint, or other reflective material that can be identified in the captured image. At 806, the movement of the cable in the captured image is tracked. For example, the image is analyzed for an identifier (e.g., reflective material) that can be used to characterize aspects of the cable movement in the image compared to the expected movement. A neural network corresponding to the vehicle, configured to perform the processes of this disclosure, may be configured to store and discard images based on the detection of the cable and the recognition of motion events. In some embodiments, the neural network may discard images based on the expected cable behavior of known or previously identified motion events. Each image station can be iteratively updated using the newly collected data to improve warnings and notifications generated by the system. If no motion-based event is identified at 808 (No at 808), process 800 returns to process box 802. If a motion-based event is identified at 808 (Yes at 808), the vehicle performs an action at 810. For example, a motion-based event could relate to at least one of a protective cable, cargo secured by the cable, or cargo secured in the vehicle's cargo compartment. Any or all of these elements may move or be damaged. The action performed at 810 could include generating a status notification for any or all of the listed elements or performing a fixed movement, such as closing or locking the vehicle's cargo compartment (e.g., closing the cargo compartment cover to prevent loss of cargo) or slowing the vehicle based on damage.

[0078] Figure 9 A flowchart of process 900 according to some embodiments of the present disclosure is shown, which is used to optimize power supply while operating in monitoring mode. Process 900 may include more or fewer than those described in the reference. Figure 9 The elements depicted or described. Additionally, process 900 may be incorporated into or can be incorporated into... Figures 1 to 8 and Figure 10 In any or all of them. The processing circuit 102 can monitor the vehicle's power status to monitor the environment and the vehicle compartment of vehicle 101. For example, when the battery power is low, the system can be deactivated to avoid depleting the battery power.

[0079] At 904, the system begins in vehicle sleep mode. For example, when there is no motion event and no impending collision. In this mode, the vehicle retains battery power. At 902, in response to a motion event approaching the vehicle or an impending collision being detected, the system switches to vehicle standby mode. In standby mode, the vehicle can issue event detections, such as the first and second response actions discussed in more detail above. The monitoring mode begins at 906 in de-operation mode, and in response to a request or automatically based on locking the vehicle, the vehicle monitoring mode proceeds to step 908. In 908, the monitoring mode is entered and the surrounding environment is monitored. When the presence of an object (such as a motion event) is detected within the first event detection threshold 324 (e.g., large radius), then at 910, the system begins recording the vehicle's surrounding environment and at least a portion of at least one of the vehicle cargo box, protective cables, trailer assembly, or winch assembly. If the presence of the object ceases, the monitoring mode resumes to monitor the vehicle's surrounding environment and at least a portion of at least one of the vehicle cargo box, protective cables, trailer assembly, or winch assembly. Continuing to step 912, when a motion event is detected within the second event detection threshold 322 (e.g., a small radius, such as four feet), the system then begins recording the vehicle's surroundings and playing audible and visual alarms, as previously discussed. If the presence of a motion event exceeds the first threshold, the system returns to the previous steps. In each of the previous steps, as the vehicle transitions from a deactivated state to an activated state, the vehicle increases its power consumption, and when operating in battery-saving mode, the duration the vehicle remains in a higher power mode is reduced.

[0080] Figure 10 A flowchart of a process 1000 for operating a vehicle in monitoring mode according to some embodiments of the present disclosure is shown. Process 1000 may include more or fewer of the following: Figure 10 The elements depicted or described. Additionally, the frame 100 may be joined to or can be joined to Figures 1 to 9 In any one or all of them.

[0081] via Figure 10The depicted system includes four states of monitoring mode: preprocessing state 1002, disabled state 1004, enabled state 1006, and running state 1008. In preprocessing state 1002, the vehicle operator can set conditions for determining motion-based events and executing response actions based on these events. Additionally, the vehicle may include a storage device for capturing video content. In disabled state 1004, the vehicle operator has pre-programmed the monitoring mode but has selectively disabled it or is missing at least one criterion (e.g., missing storage device). In enabled state 1006, the vehicle is enabled and unlocked in monitoring mode. In this mode, the vehicle does not record anything. In running state 1008, the vehicle is locked and monitors motion events and is ready to execute all response actions.

[0082] The foregoing is merely illustrative of the principles of this disclosure, and various modifications can be made by those skilled in the art without departing from the scope of this disclosure. The above embodiments are presented for illustrative purposes and not for limitation. This disclosure may also take many forms other than those expressly described herein. Therefore, it should be emphasized that this disclosure is not limited to the methods, systems, and apparatus expressly disclosed, but is intended to include variations and modifications thereof, which are within the spirit of the following paragraphs.

[0083] While some parts of this disclosure may be exemplary, any such references are merely for providing context to this disclosure and do not constitute any admission that constitutes prior art.

Claims

1. A monitoring system, comprising: A camera, mounted on the vehicle and configured to capture multiple images of a storage area of ​​the vehicle, wherein the storage area is located outside the passenger compartment of the vehicle; and Processing circuit, the processing circuit being configured to: Identify at least the end of the cable that secures the goods to the storage area within the storage area in multiple captured images; The movement of the cable relative to the cargo is tracked based on multiple captured images; The motion events of the cable are identified based on the type of cable movement, and the motion events correspond to the cable state. as well as In response to the detected cable state, the vehicle performs an action, the action including adjusting the tension of the cable to adjust the cable state.

2. The monitoring system according to claim 1, wherein the cable is one of a protective cable, a winch cable, or a trailer cable.

3. The monitoring system according to claim 1, wherein the cable includes a reflective coating or a reflective element.

4. The monitoring system of claim 3, wherein the processing circuitry is configured to identify the cable in the captured image based on the identification of the reflective coating or the reflective element.

5. The monitoring system according to claim 1, wherein: The camera is positioned at the upper rear of the passenger compartment and has a field of view of the vehicle's storage area; and The actions performed by the vehicle include generating notifications to the user or executing security responses.

6. The monitoring system of claim 5, wherein when the vehicle moves, the action performed by the vehicle includes generating a notification to the user indicating that the cable or equipment may be loose.

7. The monitoring system of claim 5, wherein when the vehicle is stationary, the action performed by the vehicle includes the safety response.

8. The monitoring system of claim 1, wherein the action performed by the vehicle includes a safety response, the safety response including activating one or more of a visual alarm or an audible alarm.

9. The monitoring system according to claim 1, wherein: The cable is a winch cable connected to the winch. The processing circuit is configured to identify the motion event based on the movement type by recognizing the slack in the winch cable; and The actions performed by the vehicle include adjusting the torque supplied to the winch.

10. The monitoring system according to claim 1, wherein: The cable is a trailer cable connected to the vehicle; The processing circuitry is configured to identify the motion event based on the movement type by recognizing the slack in the trailer cable; and The actions performed by the vehicle include adjusting the speed of the vehicle.

11. A monitoring method, comprising: Capture multiple images of the vehicle's storage area, which is located outside the vehicle's passenger compartment; Identify at least the end of the cable that secures the goods to the storage area within the storage area in multiple captured images; The movement of the cable relative to the cargo is tracked based on multiple captured images; The motion events of the cable are identified based on the type of cable movement, and the motion events correspond to the cable state. as well as In response to the detected cable state, the vehicle performs an action, the action including adjusting the tension of the cable to adjust the cable state.

12. The monitoring method according to claim 11, wherein the cable is one of a protective cable, a winch cable, or a trailer cable.

13. The monitoring method according to claim 11, wherein the cable includes a reflective coating or a reflective element.

14. The monitoring method of claim 11, wherein identifying the cable in the captured image includes identifying at least one of the cable's reflective coating or reflective element.

15. The monitoring method according to claim 11, wherein: The camera is positioned at the upper rear of the passenger compartment and has a field of view of the vehicle's storage area. as well as The vehicle is made to perform actions, including generating a notification to the user or performing a safety response.

16. The monitoring method of claim 15, wherein when the vehicle moves, the action performed by the vehicle includes generating a notification to the user indicating that the cable or equipment may be loose.

17. The monitoring method of claim 15, wherein when the vehicle is stationary, the action performed by the vehicle includes the safety response.

18. The monitoring method of claim 11, wherein causing the vehicle to perform an action includes performing a safety response, the safety response including activating one or more of a visual alarm or an audible alarm.

19. The monitoring method according to claim 11, wherein: The cable is a winch cable connected to the winch. Identifying motion events includes identifying slack in the winch cable; and Making the vehicle perform the action includes adjusting the torque supplied to the winch.

20. The monitoring method according to claim 11, wherein: The cable is a trailer cable connected to the vehicle; Identifying motion events includes identifying slack in the trailer cable; and Making the vehicle perform the action includes adjusting the speed of the vehicle.

Images