Vehicle monitoring apparatus and method

Abstract

A vehicle is provided that includes a monitoring device including a drone housing and a drone configured to be stowable in the drone housing and deployable to fly near the vehicle. The drone includes a frame, at least one rotor connected to the frame, and at least one sensor connected to the frame. The at least one sensor is configured to monitor an area adjacent to the vehicle and provide a feedback signal when the drone is deployed. The vehicle further includes a control module operably connected to the drone. The control module is configured to output a warning signal indicative of a potential hazard to a driver of the vehicle. The warning signal is responsive to a feedback signal of at least one sensor of the drone.

Description

Technical Field

[0001] The present disclosure relates to a vehicle monitoring device for assisting a driver of a vehicle. Specifically, the present disclosure relates to a system and method for monitoring a vehicle by an aerial drone that can be stowed on the vehicle. Background Art

[0002] Modern vehicles include a range of onboard sensors to assist the driver as they perform various maneuvers. Such monitoring systems help the driver identify other vehicles, objects in the road, and pedestrians so that the driver can then change the speed and direction of the vehicle to avoid an accident. Some monitoring systems include optical sensors, such as side and / or rear cameras, thereby allowing the driver to observe specific areas around the vehicle.

[0003] Monitoring the surroundings of large tractors, such as trucks with trailers, is often more difficult due to their greater width. Additionally, due to the structure of the truck or trailer, it may not be possible to position the optical sensor in the necessary position to observe a specific area. Typically, the driver must exit the truck cabin and walk around the truck and trailer to visually inspect for any potential hazards. Furthermore, even after physically inspecting the surrounding area, the driver may need to lean out of the window, use auxiliary mirrors, and rely on muscle memory or instinct to perform a specific maneuver. Summary of the invention

[0004] According to one embodiment, a vehicle includes a monitoring device. The vehicle includes a drone housing and a drone, the drone being configured to be retractable in the drone housing and deployable to fly near the vehicle. The drone includes a frame, at least one rotor connected to the frame, and at least one sensor connected to the frame. The at least one sensor is configured to monitor an area adjacent to the vehicle when the drone is deployed and provide a feedback signal. The vehicle further includes a control module operably connected to the drone. The control module is configured to output a warning signal indicating a potential danger to a driver of the vehicle. The warning signal is responsive to a feedback signal of at least one sensor of the drone.

[0005] According to another embodiment, a monitoring device for a vehicle includes a drone configured to be stowed on the vehicle and to be deployed to fly near the vehicle. The drone includes a frame, at least one rotor connected to the frame, and at least one sensor connected to the frame. The at least one sensor is configured to monitor an area adjacent to the vehicle when the drone is deployed and provide a feedback signal. The monitoring device also includes a control module operably connected to the drone. The control module is configured to output a warning signal indicating a potential danger to a driver of the vehicle. The warning signal is responsive to a feedback signal from at least one sensor of the drone.

[0006] According to yet another embodiment, a method for monitoring a vehicle includes several steps. The method includes providing a drone, the drone including a frame, at least one rotor connected to the frame and at least one sensor connected to the frame, and a control module operably connected to the drone. The method also includes the steps of stowing the drone on the vehicle, unfolding the drone so that the drone flies near the vehicle, and monitoring an area adjacent to the vehicle through at least one sensor of the drone. The method includes the further step of outputting a warning signal to a driver of the vehicle by the control module in response to a feedback signal from at least one sensor of the drone. The warning signal indicates a potential hazard. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a side view of an embodiment of a vehicle of the present disclosure as described herein, the vehicle including a payload and an aerial drone vehicle monitoring device for monitoring the vehicle;

[0008] Figure 2 is a top view of a vehicle and a monitoring device thereof as described herein;

[0009] Figure 3 is a graphical representation of a display screen of a vehicle showing the surroundings and suggested route changes generated by a monitoring device as described herein;

[0010] Figure 4 is a graphical representation of a monitoring device as described herein;

[0011] Figure 5A-Figure 5B The figure shows a drone of a monitoring device as described herein;

[0012] Figure 6 is a diagrammatic representation of an embodiment of a locking mechanism for a housing of a drone for a monitoring device as described herein;

[0013] Figure 7 is a diagrammatic representation of another embodiment of a locking mechanism for a housing of a drone for a monitoring device as described herein;

[0014] Figure 8 is an embodiment of a housing for a drone of a monitoring device as described herein;

[0015] Fig. 9 is another embodiment of a housing for a drone of a monitoring device as described herein;

[0016] Fig.10 is another embodiment of a housing for a drone of a monitoring device as described herein;

[0017] Fig.11 is another embodiment of a housing for a drone of a monitoring device as described herein; and

[0018] Figure 12A-12B Another embodiment of a housing for a drone of a monitoring device as described herein is shown. DETAILED DESCRIPTION

[0019] The embodiments described herein relate to the arrangement of a vehicle monitoring device and its control logic for effectively monitoring a vehicle and its environment using an airborne aerial drone. The device and method can be applied to various types of passenger vehicles, commercial vehicles, and recreational vehicles, such as highways or semi-trailers, straight trucks, buses, fire trucks, RVs, etc. It is contemplated that the device and method can be applied to vehicles with a transmission system including a diesel, gasoline, or gas fuel engine, and can be applied to vehicles with an electric or hybrid electric transmission system. As a non-limiting example, it is further contemplated that the device and method can be applied to vehicles with manual transmissions, automatic transmissions, automated manual transmissions, continuously variable transmissions, hybrid electric transmissions, and hydraulic transmissions. It is further contemplated that the device and method can be applied to autonomous or semi-autonomous vehicles.

[0020] The present monitoring device and method assist the driver of a vehicle by monitoring the environment of the vehicle in real time. In addition, the monitoring device can process the sensed data and output a display to the driver, which shows the vehicle, its environment and a suggested course of action to avoid any potential danger.

[0021] Now go to Figure 1-Figure 4 , a vehicle 10 is shown implementing an embodiment of the present monitoring device 12. The vehicle 10 may be in the form of a towing vehicle 10 for transporting a payload 14. For example, the vehicle 10 may be a truck 10 having a trailer 14 attached thereto. The vehicle 10 may also include a cab 16 for accommodating a driver. The cab 16 may also house or otherwise support the monitoring device 12. It is contemplated that the monitoring device 12 may be mounted on the trailer 14.

[0022] The monitoring device 12 includes a drone 18, a drone housing 20, and a control module 22 for monitoring the vehicle 10, its payload 14, and / or the environment surrounding the vehicle 10 and / or payload 14. The monitoring device 12 allows the driver to easily perform various maneuvers without having to personally inspect the environment. The monitoring device 12 provides a complete 360-degree visibility around the vehicle 10, including any areas adjacent to the vehicle 10 and / or payload 14. The monitoring device 12 also processes the sensed data and provides an output to the driver to inform the driver where to position his vehicle 10 and / or payload 14. The output may be in the form of a display 24 showing the vehicle 10 and any potential hazards. The display 24 may further show a conditioned overlay of the vehicle 10 and / or the environment, showing how and where the vehicle 10 should be positioned to avoid any potential hazards. The overlay may be in the form of a projected vehicle position 26, which includes the vehicle 10 and payload 14, such as Figure 3 The monitoring device 12 allows the user to more easily perform any maneuver, especially in low visibility conditions. Various maneuvers may include maneuvers to avoid potential hazards or simply navigate specific turns, such as when turning at low speed or backing the truck 10 and trailer 14 into a given parking or loading spot. The monitoring device 12 also assists the driver in poorly lit or unsafe areas. Thus, the driver can rely on the monitoring device 12 and maintain the safety of his vehicle 10.

[0023] As used herein, the term potential hazard may refer to any road condition, any undesirable contact point between the truck 10 and the trailer 14, any weather condition, and / or any object (including other vehicles). In addition, as used herein, the term area adjacent to the vehicle 10 monitored by the monitoring device 12 may refer to any area above, below, in front of, behind, and / or beside the vehicle 10.

[0024] The vehicle 10 may include a controller 28 and various sensors 30 operably coupled to the controller 28. The various sensors 30 may include onboard sensors, off-board sensors, or other devices for sensing or otherwise identifying vehicle payload, vehicle speed, vehicle GPS location data, tire pressure, fuel supply to the engine, engine and / or drive shaft torque, other vehicle data or characteristics, predicted or expected traffic speed, road or map data, geographic data, and / or weather data. In addition, the vehicle 10 may include one or more distance sensors for identifying the distance between the vehicle 10 and the potential hazard. The vehicle 10 may also include a V2V device for identifying a vehicle to vehicle (V2V) device of other vehicles (not shown) and communicating with the V2V communication device. The distance sensor may be a radar sensor, a laser radar sensor, or an optical sensor. The controller 28 may also communicate with one or more remote databases via a network. (Multiple) databases 24 may include map data, geographic data, traffic data, and / or weather data. The controller 28 may also communicate with a user interface (such as display 24). The controller 28 may or may not be incorporated into the control module 22 of the monitoring device 12 .

[0025] The display 24 may be an audio and / or visual display. For example, the display 24 may be in the form of a display screen 24 embedded in the dashboard of the vehicle 10 or projected onto the windshield. The display screen 24 may be operably connected to the control module 22 and / or directly connected to the drone 18. The display screen 24 is configured to display data provided by the drone 18 in real time. Figure 3 As shown, the display 24 may show the vehicle 10 and its payload 14, potential hazards (including other vehicles (not numbered)), potential routes for performing a particular maneuver, vehicle coverage of a predicted vehicle location 26, and / or a turning radius and / or distance required to position the vehicle 10 at the predicted vehicle location 26, each of which is based at least in part on the sensory data provided by the drone 18. For example, Figure 3 As shown, the control module 22 can output a suggested turning maneuver to the right by 2 feet 3 inches (68 cm) based at least in part on the sensed drone data, and display the distance and suggested course of action on the display screen 24 accordingly.

[0026] The drone 18 is configured to be stowed in the drone housing 20 and to be deployed to fly near the vehicle 10. The drone 18 includes a frame 32, legs 34 connected to the frame 32, at least one rotor 36 (e.g., four rotors 36) connected to the frame 32, and at least one monitoring sensor 38 (e.g., a monitoring sensor 38) connected to the frame 32. Figure 5AThe drone 18 may further include an autopilot control module 40, additional sensors 42 (such as a gyroscope, a thermal sensor, a GPS location sensor, etc.), a communication device, and / or a rechargeable battery 44 ( Figure 4 and Figure 5A ). The airbag 46 can be coupled to the leg 34 of the drone 18 ( Figure 5B ). The airbags 46 may be configured such that when inflated, they lock the drone 18 within the drone housing 20 by pressing against or engaging a feature of the drone housing 20. As non-limiting examples, the feature of the drone housing 20 may be a lip, a ridge, or a recess. Alternatively, the airbags 46 may be attached to the drone housing 20 and may be configured such that when inflated, they engage the legs 34 of the drone 18 to lock the drone 18 within the drone housing 20.

[0027] Each sensor 38 of the drone 18 is configured to monitor an area adjacent to the vehicle 10 when the drone 18 is deployed. Each sensor 38 also provides a feedback signal to the autopilot control module 40, the control module 22, and / or the vehicle controller 28. Each sensor 38 may be a radar sensor, a lidar sensor, or an optical sensor such as a camera.

[0028] The autopilot control module 40 communicates with various sensors 38, 42 of the drone 18, the control module 22 of the monitoring device 12, and the vehicle controller 28. The autopilot control module 40 may be a separate control module located on the drone 18, or it may be at least partially incorporated into the control module 22 and / or the vehicle controller 28 of the monitoring device 12. The autopilot control module 40 allows the drone 18 to operate autonomously or semi-autonomously. In addition, when the vehicle 10 and its trailer 14 are moving at a low speed in a parking lot, the control module 22 and / or the autopilot control module 40 may operate individually and / or collaboratively to dynamically track the drone. The autopilot control module 40 may include one or more processors for processing feedback signals from various sensors 38, 42. The autopilot control module 40 may also automatically fly the drone 18 back to its housing 20 when the battery life of the battery 44 of the drone 18 drops below a predetermined threshold.

[0029] The control module 22 of the monitoring device 12 is operably connected to the drone 18. For example, the control module 22 may be operably connected to the monitoring sensor 38 and / or the autopilot control module 40. The control module 22 is also operably connected to the vehicle controller 28. The control module 22 may include one or more processors for processing the sensing data from the vehicle 10 and / or the drone 18. The control module 22 is configured to output a warning signal indicating a potential hazard to the driver. The control module 22 is further configured to output a steering signal indicating a steering adjustment to avoid the potential hazard. The warning signal is responsive to the feedback signal of the monitoring sensor of the drone 18. Upon receiving the feedback signal of the (multiple) sensors 38, 42 or other sensors 30 of the vehicle 10, the control module 22 will identify any potential hazard in the surrounding area or environment of the vehicle 10 and / or the payload 14. If there is a potential hazard, the control module 22 will calculate the distance between the vehicle 10 and the potential hazard based at least in part on the feedback signal of the monitoring sensor 38. Thereafter, the control module 11 will determine the current trajectory and generate a new corrected trajectory for avoiding any potential hazard. The control module 22 may then generate a real-time display 24 of the vehicle 10 and the area adjacent to the vehicle 10 based at least in part on the feedback signals from the monitoring sensors 38 of the drone 18 and the calculated distance between the vehicle 10 and the potential hazard.

[0030] The control module 22 may be further configured to generate dedicated surveillance zones 48 adjacent to the vehicle 10. Each dedicated surveillance zone 48 may be keyed to a specific area associated with the vehicle 10 or its payload 14. The control module 48 may send at least one command signal to the drone 18, causing the drone 18 to fly to the dedicated surveillance zone 48 and monitor the dedicated surveillance zone 48. Thus, the drone 18 may automatically navigate itself to the dedicated surveillance zone 48. Additionally or alternatively, the pilot may select one or more dedicated zones 48 from a menu in the display 24, which then directs the drone 18 to the selected zone 48.

[0031] In operation, the control module 22 can perform the following method. As an initial state, the control module 22 can store the drone 18 on the vehicle 10. Then, the drone 18 can be deployed so that the drone 18 flies near the vehicle 10. The drone 18 can be automatically deployed by the control module 22 when a specific speed, steering maneuver and / or dimly lit area is sensed. In addition, the drone 18 can be deployed when the control module 22 receives an input command from the driver. Then, the control module 22 will begin to monitor the area adjacent to the vehicle 10 and / or the payload 14 through the (multiple) sensors 38 of the drone 18. The control module 22 can guide the drone 18 to fly to the dedicated monitoring area 48 and / or perform a sweep of the vehicle 10 and / or the payload 14. Then, the control module 22 can identify any potential dangers. Whether or not any potential dangers are identified, the control module 22 can output a steering signal to the driver to assist them in steering the vehicle 10 in a given maneuver. If a potential hazard is identified, the control module 22 will output a warning signal to the driver in response to the feedback signals of the (multiple) sensors 38, 42 of the drone 18 indicating the potential hazard. In addition, if a potential hazard is identified, the control module 22 may output a steering signal indicating a steering adjustment to avoid the potential hazard. The steering signal may be based on at least the determined hazard, the real-time distance between the hazard and the vehicle 10 and / or the payload 14, and / or any other vehicle characteristics, such as speed, engine torque, position of the steering wheel, etc. The control module 22 may further output a display 24, such as a real-time map or graphic, which shows the current position of the vehicle 10 and / or the payload 14 relative to any potential hazard and its environment and an overlay of the projected position 26, the overlay of the projected position 26 thereby clearly showing the desired position change and how to achieve the desired position.

[0032] Now refer to Figure 5- Figure 7 , an embodiment of a drone housing 20 is shown. The drone housing 20 can be connected to and / or incorporated as a part of a vehicle (e.g., cab 16). The drone housing 20 includes a frame 50 having an interior compartment 52 configured to receive the drone 18, a selectively closable door 54 connected to the frame 50, a wireless charging station 56 configured to charge the battery 44 of the drone 18, and a locking mechanism 58 configured to selectively lock the drone 18 within the interior compartment 52.

[0033] The locking mechanism 58 may include a rotatable locking member 60, such as a shackle ( Figure 6). The locking mechanism 58 may also include one or more motors 62 connected to the locking member 60. Upon receiving a lock or unlock input signal from the control module 22, the motor(s) 62 will rotate the locking member 60 to lock or unlock the drone 18. As an alternative to a physical locking member 60, the locking mechanism 58 may include one or more electromagnets 64 ( Figure 7 ). For example, the base or floor of the drone housing 20 may include three electromagnets 64 for electromagnetically retaining the drone 18 within the interior compartment 52 of the drone housing 20.

[0034] Reference now Figure 8 , another embodiment of a drone housing 80 is shown. The drone housing 80 can be substantially similar to the drone housing 20 discussed above. The drone housing 80 is disposed within the roof fairing 16F of the cab 16. The housing 80 can extend downwardly and within the roof fairing 16F. The housing 80 can also have a relatively shallow depth corresponding to the overall height of the drone 18. Alternatively, the housing 80 can have a greater depth to easily accommodate the drone 18.

[0035] Reference now Fig. 9 , another embodiment of a drone housing 90 is shown, which can be substantially similar to the drone housing 20 discussed above. The drone housing 90 is incorporated into the roof fairing 16F near the front of the roof fairing 16F. The automatic doors (not numbered) of the housing 90 can be flush and match the surface contour of the surrounding body of the roof fairing 16F.

[0036] Reference now Fig.10 , another embodiment of a drone housing 100 is shown, which can be substantially similar to the drone housing 20 discussed above. The drone housing 100 is attached to the distal end of the roof fairing 16F. The drone housing 100 can extend rearwardly from the roof fairing 16F. Thus, the drone housing 100 does not substantially interfere with the aerodynamics of the roof fairing 16F.

[0037] Reference now Fig.11 , another embodiment of a drone housing 1100 is shown, which may be substantially similar to the drone housing 20 discussed above. The drone housing 1100 is attached to and embedded within the end of the roof fairing 16F. Therein, the drone housing 1100 extends into the end of the roof fairing 16F.

[0038] Reference now Figure 12A-12B, another embodiment of a drone housing 1200 for housing two or more drones 18 is shown. The drone housing 1200 may be substantially similar to the drone housing 20 discussed above. The drone housing 1200 is embedded within the top of the roof fairing 16F of the cab 16. The drone housing 1200 has a relatively large and oval automatic door (not numbered) for receiving two drones.

[0039] Although the illustrative arrangement and control logic thereof for implementing the monitoring device have been described with respect to at least one embodiment, as previously demonstrated, the arrangement and method can be further modified within the spirit and scope of the present disclosure. Therefore, the present application is intended to cover any changes, uses or adaptations of the arrangement and method using its general principles. Further, the present application is intended to cover the deviations from the present disclosure within known or customary practices in the relevant field of the present disclosure, and it falls within the limitations of the appended claims.

Claims

1. A vehicle with a monitoring device, the vehicle comprising: UAV shell; A drone, the drone being configured to be retractable in the drone housing and deployable to fly near the vehicle, the drone comprising: frame; at least one rotor connected to the frame; and at least one sensor coupled to the frame, the at least one sensor configured to monitor an area adjacent to the vehicle when the drone is deployed and provide a feedback signal; and A control module is operably connected to the drone, the control module is configured to output a warning signal indicating a potential danger to a driver of the vehicle, and the warning signal is responsive to the feedback signal of the at least one sensor of the drone.

2. The vehicle according to claim 1, characterized in that: The control module is further configured to output a steering signal indicative of a steering adjustment to avoid the potential hazard.

3. The vehicle of claim 1, further comprising: A display screen is operably connected to the control module, and the display screen is configured to display the feedback signal of the at least one sensor of the drone in real time.

4. The vehicle according to claim 1, characterized in that: The control module is configured to calculate a distance between the vehicle and the potential hazard based at least in part on the feedback signal from the at least one sensor of the drone.

5. The vehicle according to claim 4, characterized in that: The control module is configured to generate a real-time display of the vehicle and the area adjacent to the vehicle based at least in part on the feedback signal of the at least one sensor of the drone and the calculated distance between the vehicle and the potential hazard.

6. The vehicle according to claim 1, characterized in that: The control module is further configured to: Dynamically tracking the position of the drone; generating a dedicated surveillance zone adjacent to the vehicle; and At least one command signal is sent to the drone, so that the drone flies to the dedicated monitoring area and monitors the dedicated monitoring area.

7. The vehicle of claim 1, further comprising: a cab configured to accommodate the driver; as well as The drone housing is connected to the cab.

8. The vehicle according to claim 1, characterized in that: The drone housing comprises: a frame having an interior compartment configured to receive the drone; a selectively closable door connected to the frame; a charging station configured to charge a battery of the drone; and A locking mechanism is configured to selectively lock the drone within the internal compartment.

9. The vehicle according to claim 1, characterized in that: The vehicle is in the form of a truck towing a payload; and The drone is configured to monitor the truck, the payload attached to the truck, and an area adjacent to the truck and the payload.

10. A monitoring device for a vehicle, the monitoring device comprising: A drone configured to be stowed on the vehicle and to be deployed to fly near the vehicle, the drone comprising: frame; at least one rotor connected to the frame; and at least one sensor coupled to the frame, the at least one sensor configured to monitor an area adjacent to the vehicle when the drone is deployed and provide a feedback signal; and A control module is operably connected to the drone, the control module is configured to output a warning signal indicating a potential danger to a driver of the vehicle, and the warning signal is responsive to the feedback signal of the at least one sensor of the drone.

11. The monitoring device according to claim 10, characterized in that: The control module is further configured to output a steering signal indicative of a steering adjustment to avoid the potential hazard.

12. The monitoring device according to claim 10, further comprising: A display screen is operably connected to the control module, and the display screen is configured to display the feedback signal of the at least one sensor of the drone in real time.

13. The monitoring device according to claim 10, characterized in that: The control module is configured to calculate a distance between the vehicle and the potential hazard based at least in part on the feedback signal from the at least one sensor of the drone.

14. The monitoring device according to claim 13, characterized in that: The control module is configured to generate a real-time display of the vehicle and the area adjacent to the vehicle based at least in part on the feedback signal of the at least one sensor of the drone and the calculated distance between the vehicle and the potential hazard.

15. The monitoring device according to claim 10, characterized in that: The control module is further configured to: Dynamically tracking the position of the drone; generating a dedicated surveillance zone adjacent to the vehicle; and At least one command signal is sent to the drone, so that the drone flies to the dedicated monitoring area and monitors the dedicated monitoring area.

16. The monitoring device according to claim 10, further comprising: A drone housing is configured to be connected to the cab of the vehicle and to house the drone therein.

17. The monitoring device according to claim 16, characterized in that: The drone housing comprises: a frame having an interior compartment configured to receive the drone; a selectively closable door connected to the frame; a charging station configured to charge a battery of the drone; and A locking mechanism is configured to selectively lock the drone within the internal compartment.

18. The monitoring device according to claim 10, characterized in that: The vehicle is in the form of a truck towing a payload; and The drone is configured to monitor the truck, the payload attached to the truck, and an area adjacent to the truck and the payload.

19. A method for monitoring a vehicle, the method comprising the following steps: Providing a drone comprising a frame, at least one rotor connected to the frame and at least one sensor connected to the frame, and a control module operably connected to the drone; The drone is mounted on the vehicle; Deploy the drone so that the drone flies near the vehicle; monitoring an area adjacent to the vehicle via the at least one sensor of the drone; as well as In response to the feedback signal of the at least one sensor of the drone, the control module outputs a warning signal to the driver of the vehicle, wherein the warning signal indicates a potential danger.

20. The method of claim 19, further comprising the steps of: A steering signal is output by the control module to indicate a steering adjustment to avoid the potential hazard.

Images