SYSTEM AND METHOD FOR TRACKING OBJECTS RELATIVE TO A VEHICLE

Abstract

A method for tracking objects relative to a vehicle. The method involves identifying a route object list associated with a predetermined vehicle route. The route object list contains a list of objects to be carried on the vehicle for the predetermined route. At least one object associated with the vehicle is identified by at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared with the route object list associated with the predetermined route to identify at least one missing object in the current object list compared to the route object list. A user is notified of the absence of at least one object.

Description

INTRODUCTION

[0001] The present disclosure relates to a system and method for tracking objects relative to a vehicle.

[0002] When traveling in a vehicle, passengers typically have several items they want to take with them. For example, when traveling to the gym, passengers might have a sports bag, and when dropping the kids off at school, each child might have a backpack. However, it's easy to forget or leave behind certain items needed for a trip. Therefore, it's necessary to improve object management while traveling in a vehicle. DESCRIPTION

[0003] Disclosed herein is a method for tracking objects relative to a vehicle. The method includes identifying a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route. At least one object associated with the vehicle is identified using at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared to the route object list associated with the predetermined route to identify at least one missing object in the current object list compared to the route object list. A user is notified of the absence of at least one object.

[0004] Another aspect of the disclosure may be that the route object list contains a list of objects that were identified with the vehicle on a route immediately previously traveled by the vehicle.

[0005] Another aspect of the disclosure may include determining a future route for the vehicle.

[0006] Another aspect of the disclosure may be that determining the future route for the vehicle includes predicting a destination based on a travel history for the vehicle.

[0007] Another aspect of the disclosure may be that determining the future route for the vehicle includes receiving the route from a navigation system connected to the vehicle.

[0008] Another aspect of the disclosure may be that determining the future route for the vehicle includes identifying a newly traveled route by monitoring a vehicle path from an origin to a destination.

[0009] Another aspect of the revelation can be to link the current object list with the newly traveled route.

[0010] Another aspect of the disclosure may include identifying a user response to the notification and assigning an importance level to the at least one missing object based on the user response.

[0011] Another aspect of the disclosure may be that the at least one missing object is retained in the route object list when the user responds to the notification.

[0012] Another aspect of the disclosure may be that the at least one missing object is removed from the route object list if the user does not respond to the notification.

[0013] Another aspect of the disclosure may be that the current object includes at least one discoverable connected device.

[0014] Another aspect of the disclosure may be that the at least one sensor comprises an RFID reader and the at least one object connected to the vehicle contains an RFID tag.

[0015] A further aspect of the disclosure may be that the at least one sensor comprises at least one camera and the identification of the at least one object associated with the vehicle comprises capturing a plurality of images of an area surrounding the vehicle with the at least one camera and performing image recognition on the plurality of images.

[0016] Another aspect of the disclosure may be that the object detection comprises performing facial recognition and assigning at least one predetermined object to the route object list based on the facial recognition.

[0017] Another aspect of the disclosure may be that when comparing the current object list with the route object list, at least one additional object is identified in the current object list compared to the route object list.

[0018] Included herein is a non-transitory computer-readable medium containing programmed instructions suitable for performing a method. The method includes identifying a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route. At least one object associated with the vehicle is identified with at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared to the route object list associated with the predetermined route to identify at least one missing object in the current object list as compared to the route object list. A user is notified of the absence of at least one object.

[0019] A vehicle system is disclosed herein. The system includes a plurality of sensors and a controller that communicates with the plurality of sensors. The controller is configured to identify a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route. At least one object is associated with the vehicle when at least one sensor on the vehicle is identified to determine a current object list for the vehicle. The current object list is compared to the route object list associated with the predetermined route to identify at least one missing object in the current object list compared to the route object list. A user is notified of the absence of at least one object. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a schematic diagram of an example of an autonomous motor vehicle. Fig. 2 shows an example of a method for tracking objects relative to a vehicle.

[0020] The present disclosure may be modified or embodied in alternative forms, representative embodiments of which are shown in the drawings and described in detail below. The present disclosure is not limited to the embodiments described herein. Rather, the present disclosure is intended to cover alternatives that fall within the scope of the disclosure as defined by the appended claims. DETAILED DESCRIPTION

[0021] Those of ordinary skill in the art will recognize that terms such as "above," "below," "upward," "downward," "top," "bottom," "left," "right," etc., are used descriptively of the figures and do not represent limitations on the scope of the disclosure as defined by the appended claims. Furthermore, the teachings herein may be described in terms of functional and / or logical block components and / or various processing steps. It should be understood that such block components may include a number of hardware, software, and / or firmware components configured to perform the specified functions.

[0022] With reference to the figures, in which like numerals indicate like parts throughout the figures, like reference numerals referring to like components, Fig. 1 is a schematic view of a motor vehicle 10 positioned with respect to a road surface, such as a vehicle lane 12. As in Fig. 1, the vehicle 10 includes a vehicle body 14, a first axle having a first set of wheels 16-1, 16-2, and a second axle having a second set of wheels 16-3, 16-4 (e.g., individual left and right wheels on each axle). Each of the wheels 16-1, 16-2, 16-3, 16-4 is equipped with tires configured to make notional contact with the vehicle track 12. Although two axles with respective wheels 16-1, 16-2, 16-3, 16-4 are expressly shown, nothing precludes the motor vehicle 10 from having additional axles.

[0023] As in Fig. 1, a vehicle suspension system connects the vehicle body 14 to the respective wheel sets 16-1, 16-2, 16-3, 16-4 to maintain contact between the wheels and the road surface 12 and to maintain the handling of the motor vehicle 10. The motor vehicle 10 additionally includes a drivetrain 20 having one or more power sources 20A, which may be an internal combustion engine, an electric motor, or a combination of such devices, configured to transmit drive torque to the wheels 16-1, 16-2 and / or the wheels 16-3, 16-4. The motor vehicle 10 also employs vehicle operation or control systems, including devices such as one or more steering actuators 22 (e.g.,an electric power steering system) configured to steer the wheels 16-1, 16-2, a steering angle (θ), an accelerator device 23 for controlling the power output of the power source(s) 20A, a brake switch or braking device 24 for decelerating the rotation of the wheels 16-1 and 16-2 (e.g., via individual friction brakes located on the respective wheels), etc.

[0024] As in Fig. 1, the motor vehicle 10 includes at least one sensor 25A and an electronic control unit 26 that cooperate to control, guide, and maneuver the vehicle 10 at least partially in an autonomous mode in certain situations. As such, the vehicle 10 may be referred to as an autonomous vehicle. To enable efficient and reliable autonomous vehicle control, the electronic control unit 26 may be in communication with the steering actuator(s) 22 configured as an electric power steering system, the accelerator device 23, and the braking device 24. The sensors 25A of the motor vehicle 10 are capable of scanning the vehicle lane 12 and monitoring a surrounding geographical area as well as traffic conditions in the vicinity of the motor vehicle 10.

[0025] The sensors 25A of the vehicle 10 may include, among other things, at least one LIDAR ("Light Detection and Ranging") sensor, a radar, and a camera arranged around the vehicle 10 to detect boundary indicators, such as boundary conditions, of the vehicle lane 12. The sensors 25A may also be located in the passenger compartment of the vehicle 10 to monitor the occupants and cargo area of ​​the vehicle 10. The nature of the sensors 25A, their arrangement on the vehicle 10, and their operation for detecting and / or sensing the boundary indicators of the vehicle lane 12 and for monitoring the surrounding geographical area and traffic conditions will be understood by those skilled in the art and are therefore not described in detail here. The vehicle 10 may additionally be equipped with sensors 25B, such as RFID readers, mounted on the vehicle body.The sensors 25B may be positioned near entry points into the vehicle 10 to determine whether an object with an RFID tag enters the vehicle.

[0026] The electronic control unit 26 is in communication with the sensors 25A of the vehicle 10 to receive their respective measurement data related to the detection or sensing of the vehicle lane 12 and the monitoring of the surrounding geographical area and traffic conditions. The electronic control unit 26 may also be referred to as a control module, control unit, control device, control unit for the vehicle 10, computer, etc. The electronic control unit 26 may include a computer and / or processor 28, as well as software, hardware, memory, algorithms, connections (e.g., to the sensors 25A and 25B), etc., for managing and controlling the operation of the vehicle 10. Thus, a method described below and generally in Fig. 2, may be embodied as a program or algorithm that may be partially run on the electronic control unit 26. The electronic control unit 26 may include a device capable of analyzing data from the sensors 25A and 25B, comparing data, making the decisions necessary to control the operation of the vehicle 10, and performing the tasks necessary to control the operation of the vehicle 10.

[0027] The electronic control unit 26 may be embodied as one or more digital computers or host machines, each including one or more processors 28, read-only memory (ROM), random access memory (RAM), electrically programmable read-only memory (EPROM), optical drives, magnetic drives, etc., a high-speed clock, analog-to-digital (A / D) circuitry, digital-to-analog (D / A) circuitry, and input / output (I / O) circuitry, I / O devices and communication interfaces, as well as signal conditioning and buffer electronics. The computer-readable memory may comprise a non-volatile / tangible medium involved in providing data or computer-readable instructions. The memory may be non-volatile or volatile. Examples of non-volatile media include optical or magnetic hard drives and other persistent storage.An example of volatile media is dynamic random-access memory (DRAM), which can be used as main memory. Other examples of memory include flexible disks, hard disks, magnetic tape or other magnetic media, CD-ROMs, DVDs, and / or other optical media, as well as other possible storage devices such as flash memory.

[0028] The electronic control unit 26 includes a tangible, non-volatile memory 30 in which computer-executable instructions, including one or more algorithms, for controlling the operation of the motor vehicle 10 are stored. The algorithm(s) in question may, in particular, include an algorithm configured to monitor the location of the motor vehicle 10 and determine the course of the vehicle relative to a mapped vehicle trajectory on a particular road course, which is described in detail below.

[0029] The motor vehicle 10 also includes a vehicle navigation system 34, which may be part of the vehicle's integrated control system or serve as an add-on device for determining direction within the vehicle. The vehicle navigation system 34 is also operatively connected to a global positioning system (GPS) 36 utilizing a satellite in Earth orbit. The vehicle navigation system 34, in conjunction with the GPS 36 and the aforementioned sensors 25A, can be used to automate the vehicle 10. The electronic control unit 26 communicates with the GPS 36 via the vehicle navigation system 34. The vehicle navigation system 34 utilizes a satellite navigation device (not shown) to receive its position data from the GPS 36, which is then correlated with the vehicle's position relative to the surrounding geographic area.If directions to a specific waypoint are needed, a route plan to that destination can be created and calculated based on this information. The route can be adjusted on-the-fly based on terrain and / or traffic information. The current position of a vehicle 10 can be calculated using dead reckoning by using a previously determined position and extrapolating that position based on given or estimated speeds over elapsed time and heading using discrete checkpoints.

[0030] The electronic control unit 26 is usually configured, ie programmed, to determine the localization 38 (current position in the XY plane, shown in Fig. 1), the speed, acceleration, yaw rate, and intended path 40 and heading 42 of the motor vehicle 10 within the vehicle lane 12 are determined or identified. The location 38, intended path 40, and heading 42 of the motor vehicle 10 may be determined via the navigation system 34 receiving data from the GPS 36, while speed, acceleration (including longitudinal and lateral acceleration), and yaw rate may be determined from the vehicle sensors 25B. Alternatively, the electronic control unit 26 may utilize other systems or sensing sources remote from the vehicle 10, such as a camera, to determine the location 38 of the vehicle relative to the vehicle lane 12.

[0031] As mentioned above, the motor vehicle 10 may be configured to operate in an autonomous mode controlled by the electronic controller 26 to transport an occupant 62. In such a mode, the electronic control unit 26 may also receive data from the vehicle sensors 25B to guide the vehicle along the desired path, e.g., by regulating the steering actuator 22. The electronic control unit 26 may additionally be programmed to detect and monitor the steering angle (θ) of the steering actuator(s) 22 along the desired path 40, e.g., during cornering. In particular, the electronic control unit 26 may be programmed to detect and monitor the steering angle (θ) by receiving and processing data signals from a steering position sensor 44 (in Fig. 1) which is connected to the steering actuator(s) 22, the acceleration device 23 and the braking device 24.

[0032] Fig. 2 shows a method 100 for tracking objects relative to the vehicle 10. The method 100 can track various types of objects, such as people, bags, or equipment, as will be explained in more detail below. A feature of the method 100 is the development of packing lists, such as route object lists, to carry the vehicle 10 for a predetermined vehicle route. The route can be determined based on a predetermined origin location associated with a corresponding destination location, a destination location independent of the origin location, or an origin location independent of the destination location. The route object lists can also be shared among different vehicles in the same household, with a single account, a fleet of vehicles, or a discoverable device by having the electronic control unit 26 communicate via the cloud 54 to access stored data regarding the route object lists.

[0033] The method 100 begins at block 102 and then scans for objects at block 104. In the example shown, the method 100 begins scanning for objects before the driver begins a route (block 106). In this way, the method 100 can identify objects approaching the vehicle 10, such as a person with a proximity key.

[0034] The method 100 scans for objects in various ways. In one example, at block 104, the method 100 may identify discoverable devices that establish Bluetooth, Wi-Fi, or other types of wireless connections with the vehicle 10. The discoverable devices may include mobile devices, wearables, tablets, or proximity keys connected to the vehicle 10. The wearables are also useful in identifying a particular user or users within the vehicle 10 if a particular wearable is associated with a particular user.

[0035] In another example, in block 104, the method 100 uses the sensors 25B, such as the RFID tag reader, to identify RFID tags 52 associated with objects 50 ( Fig. 1). The RFID tags 52 can be assigned to specific objects 50, so that the method 100 can determine which objects 50 are being carried by the vehicle 10 by reading the RFID tags 52. Alternatively, a specific set of RFID tags 52 can be used with a group of predetermined objects associated with a predetermined route for the vehicle 10.

[0036] In another example, in block 104, the method 100 uses at least one camera of the sensors 25A to perform image recognition on images captured in an area surrounding the vehicle 10. The area surrounding the vehicle 10 may include at least an area within a predetermined distance from the vehicle 10, within a passenger compartment of the vehicle 10, or within a cargo area of ​​the vehicle 10. The image recognition performed in block 104 may include facial recognition to identify specific individuals or object recognition to identify specific objects. Additionally, facial recognition may include associating at least one predetermined object with the route object list based on the facial recognition.

[0037] The method 100 may then, at block 108, compare the plurality of currently detected objects with a plurality of previously detected objects from a route immediately previously traveled by the vehicle 10. If the plurality of currently detected objects does not match the plurality of previously detected objects, a warning or notification (block 110) is sent to the driver of the vehicle 10 that at least one object may be left behind. If the plurality of currently detected objects matches the plurality of previously detected objects, the method proceeds to block 112 to determine a route for the vehicle 10.

[0038] The method 100 may determine the route for the vehicle 10 in block 112 in various ways. In one example, the route for the vehicle 10 is determined based on the destination being entered into the navigation system 34 of the vehicle 10, where the navigation system 34 is capable of providing the current location of the vehicle 10 to determine the starting point of the route. The method 100 may also receive the destination independently of the navigation system 34, e.g., from a user's mobile device.

[0039] In another example, the route for the vehicle 10 is determined by predicting the destination based on the use of a trip history database for the vehicle 10 in conjunction with a current location of the vehicle 10. The trip history database may, for example, be managed by the controller 26 and may include dates, travel times, and origins with associated destinations for each trip.

[0040] If the route is not provided (block 114) and the route cannot be predicted (block 116), the vehicle 10 records the starting point where the current route began and the destination where the route ends (block 118) to create a new route for the vehicle 10, which may be stored in the trip history database. The plurality of currently detected objects are linked to the new route in block 120 before the method 100 ends in block 122.

[0041] Once the destination is selected in the navigation system 34 (block 114) or the route is predicted (block 116), the method 100 may then perform an additional search for objects (block 124) associated with the vehicle 10 or rely on the search for objects performed in block 104 to determine the current object list for the vehicle 10. The method 100 may then compare the current object list with the route object list associated with the route in block 124.

[0042] The method 100 may then determine whether the current object list contains at least one missing object compared to the route object list (block 126). If the method determines that at least one object is missing, the method 100 may alert the driver to the missing object (block 128) and provide the driver with an opportunity to take an action in response to the warning (block 130), such as obtaining the missing object.

[0043] If the driver chooses to ignore the message, the method 100 may adjust the weight or priority of the at least one missing object (block 132). The weight or priority corresponds to the level of importance that one of the users of the vehicle 10 assigns to the at least one missing item. The change in the weight or priority for the at least one missing object in the current object list is updated in block 120 to be associated with the route object list for the given route. If the at least one missing object is repeatedly left behind on a particular route and the driver continues to ignore the warning regarding the at least one missing object, the method 100 may update the route object list associated with the route to remove the at least one repeatedly missing object (block 120).If the driver decides to take action in response to the warning from block 128 (block 134), the method 100 maintains the missing object associated with the plurality of predetermined objects associated with the given route.

[0044] If the method 100 cannot identify at least one missing object in block 126, the method 100 also determines whether any additional objects have been identified in the current object list that were not included in the route object list for the given route (block 136). If it is determined that there are no additional objects in the current object list compared to the route object list, the method 100 proceeds to block 122 and ends. If the current object list contains objects that are not included in the route object list (block 138), the method 100 may update the route object list with the new objects in block 120 before ending in block 122.

[0045] Although various embodiments have been described, the description is intended to be exemplary rather than limiting. It will be apparent to those skilled in the art that many other embodiments and implementations are possible that fall within the scope of the embodiments. Any feature of one embodiment may be used in combination with, or substituted for, any other feature or element of another embodiment, unless expressly limited. Accordingly, the embodiments are not to be limited except in light of the appended claims and their equivalents. Furthermore, various modifications and changes may be made within the scope of the appended claims.

Claims

[1] A method for tracking objects relative to a vehicle, the method comprising: identifying a route object list associated with a predetermined vehicle route, the route object list containing a list of objects to be carried in the vehicle for the predetermined vehicle route; Identifying at least one object associated with the vehicle with at least one sensor on the vehicle to determine a current object list for the vehicle; Comparing the current object list with the route object list associated with the predetermined route to identify at least one missing object from the current object list compared to the route object list; and Notify a user that at least one object is missing. [2] The method of claim 1, wherein the route object list includes a list of objects identified with the vehicle from a route immediately previously traveled by the vehicle. [3] The method of claim 1, including determining a future route for the vehicle. [4] The method of claim 3, wherein determining the future route for the vehicle comprises predicting a destination based on using a travel history for the vehicle. [5] The method of claim 3, wherein determining the future route for the vehicle comprises receiving the route from a navigation system connected to the vehicle. [6] The method of claim 3, wherein determining the future route for the vehicle comprises identifying a newly traveled route by monitoring a vehicle path from an origin to a destination. [7] Method according to claim 6, including linking the current object list with the newly traveled route. [8] The method of claim 1, including detecting a user response to the notification and assigning an importance level to the at least one missing object based on the user response. [9] The method of claim 8, wherein the at least one missing object is retained in the route object list when the user responds to the notification. [10] The method of claim 8, wherein the at least one missing object is removed from the route object list if the user does not respond to the notification.

Images