System and method for tracking object relative to vehicle

Abstract

The invention relates to a system and method for tracking an object relative to a vehicle. A method of tracking an object relative to a vehicle. The method includes identifying a list of route objects associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for a predetermined vehicle route. At least one object associated with the vehicle is identified with at least one sensor on the vehicle to determine a current list of objects for the vehicle. The current object list is compared to a route object list associated with the predetermined route to identify at least one lost object from the current object list when compared to the route object list. A notification of the at least one lost object is provided to the user.

Description

Technical Field

[0001] The present disclosure relates to a system and method for tracking an object relative to a vehicle. Background Art

[0002] When traveling in a vehicle, passengers often have multiple objects that they wish to take with them. For example, when traveling to the gym, the passenger may have a gym bag, or when taking children to school, each child may have a backpack. However, it may be easy to forget or leave behind a particular object needed for the trip. Therefore, there is a need for improved object management when traveling in a vehicle. Summary of the invention

[0003] A method of tracking objects relative to a vehicle is disclosed herein. The method includes identifying a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route. At least one object associated with the vehicle is identified using at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared to the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared with the route object list. Notification of the at least one missing object is provided to a user.

[0004] Another aspect of the present disclosure may be that the route object list includes a list of objects identified by the vehicle from an immediately previous route traveled by the vehicle.

[0005] Another aspect of the present disclosure may include determining a future route for a vehicle.

[0006] Another aspect of the disclosure may be that determining a future route of the vehicle includes predicting a destination based on utilizing a travel history of the vehicle.

[0007] Another aspect of the disclosure may be that determining a future route for the vehicle includes receiving the route from a navigation system associated with the vehicle.

[0008] Another aspect of the disclosure may be that determining a future route for the vehicle includes identifying a new traveled route by monitoring a path of the vehicle from an origin location to a destination location.

[0009] Another aspect of the present disclosure may include associating a current object list with a newly traveled route.

[0010] Another aspect of the disclosure may include identifying a user response to the notification and assigning an importance level to at least one lost object based on the user response.

[0011] Another aspect of the present disclosure may be to maintain at least one lost object in the route object list if the user responds to the notification.

[0012] Another aspect of the disclosure may be to remove at least one lost object from the route object list if the user fails to respond to the notification.

[0013] Another aspect of the present disclosure may be that the current object includes at least one discoverable connected device.

[0014] Another aspect of the present disclosure may be that at least one sensor includes an RFID reader and at least one object associated with the vehicle includes an RFID tag.

[0015] Another aspect of the disclosure may be that the at least one sensor includes at least one camera, and identifying at least one object associated with the vehicle includes capturing multiple images of an area surrounding the vehicle using the at least one camera and performing image recognition on the multiple images.

[0016] Another aspect of the present disclosure may be that performing the object detection includes performing facial recognition, and associating at least one predetermined object with the route object list based on the facial recognition.

[0017] Another aspect of the disclosure may be that comparing the current object list to the route object list includes identifying at least one additional object in the current object list when comparing to the route object list.

[0018] Disclosed herein is a non-transitory computer readable medium containing programming instructions that, when executed by a processor, are operable to perform a method. The method includes identifying a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on a vehicle for the predetermined vehicle route. At least one object associated with the vehicle is identified using at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared to the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared to the route object list. Notification of the at least one missing object is provided to a user.

[0019] A vehicle system is disclosed herein. The system includes a plurality of sensors and a controller in communication with the plurality of sensors. The controller is configured to identify a route object list associated with a predetermined vehicle route. The route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route. At least one object associated with the vehicle is identified using at least one sensor on the vehicle to determine a current object list for the vehicle. The current object list is compared with the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared with the route object list. Notification of the at least one missing object is provided to a user.

[0020] According to one aspect of the present disclosure, a method for tracking objects relative to a vehicle is provided, the method comprising: identifying a route object list associated with a predetermined vehicle route, wherein the route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route; identifying at least one object associated with the vehicle using at least one sensor on the vehicle to determine a current object list for the vehicle; comparing the current object list with the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared with the route object list; and providing a notification of the at least one missing object to a user.

[0021] According to one aspect of the present disclosure, a non-transitory computer-readable medium containing programming instructions is provided, which, when executed by a processor, is operable to perform a method comprising the following steps: identifying a route object list associated with a predetermined vehicle route, wherein the route object list includes a list of objects to be carried on a vehicle for the predetermined vehicle route; identifying at least one object associated with the vehicle using at least one sensor on the vehicle to determine a current object list for the vehicle; comparing the current object list with the route object list associated with the predetermined vehicle route to identify at least one missing object from the current object list when compared with the route object list; and providing a notification of the at least one missing object to a user.

[0022] According to one aspect of the present disclosure, a vehicle system is provided, comprising: a plurality of sensors; and a controller, communicating with the plurality of sensors and configured to: identify a route object list associated with a predetermined vehicle route, wherein the route object list comprises a list of objects to be carried on a vehicle for the predetermined vehicle route; identify at least one object associated with the vehicle using at least one sensor on the vehicle to determine a current object list for the vehicle; compare the current object list with the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared with the route object list; and provide a notification of the at least one missing object to a user. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a schematic diagram of an example autonomous motor vehicle.

[0024] Figure 2 An example method for tracking an object relative to a vehicle is illustrated.

[0025] The present disclosure may be modified or embodied in alternative forms, representative embodiments of which are shown in the accompanying drawings and described in detail below. The present disclosure is not limited to the disclosed embodiments. On the contrary, the present disclosure is intended to cover alternatives within the scope of the present disclosure as defined by the appended claims. DETAILED DESCRIPTION

[0026] Those of ordinary skill in the art will recognize that terms such as "above," "below," "upward," "downward," "top," "bottom," "left," "right," and the like are used descriptively in the drawings and do not represent limitations on the scope of the present disclosure as defined by the appended claims. Furthermore, the teachings may be described herein in terms of functional and / or logical block components and / or various processing steps. It should be recognized that such block components may include multiple hardware, software, and / or firmware components configured to perform the specified functions.

[0027] Referring to the drawings, wherein like reference numerals refer to like components, Figure 1 A schematic diagram of a motor vehicle 10 is shown positioned relative to a road surface, such as a lane 12. Figure 1As shown, the vehicle 10 includes a body 14, a first axle having a first set of wheels 16-1, 16-2, and a second axle having a second set of wheels 16-3, 16-4 (such as separate left and right wheels on each axle). Each of the wheels 16-1, 16-2, 16-3, 16-4 employs a tire configured to provide frictional contact with the roadway 12. Although two axles with respective wheels 16-1, 16-2, 16-3, 16-4 are specifically shown, it is not excluded that the motor vehicle 10 has additional axles.

[0028] like Figure 1 As shown, the vehicle suspension system operatively connects the vehicle body 14 to the corresponding set of wheels 16-1, 16-2, 16-3, 16-4 for maintaining contact between the wheels and the roadway 12 and for maintaining the maneuverability of the motor vehicle 10. The motor vehicle 10 additionally includes a drive train 20 configured to transmit drive torque to the wheels 16-1, 16-2 and / or the wheels 16-3, 16-4, the drive train 20 having a power source or multiple power sources 20A that can be an internal combustion engine (ICE), an electric motor, or a combination of such devices. The motor vehicle 10 also employs a vehicle operation or control system, which includes devices such as one or more steering actuators 22 (e.g., electric power steering units) configured to steer the wheels 16-1, 16-2 by a steering angle (θ), an accelerator device 23 for controlling the power output of the (one or more) power sources 20A, a brake switch or device 24 for decelerating the rotation of the wheels 16-1 and 16-2 (such as via separate friction brakes located at the corresponding wheels), etc.

[0029] like Figure 1 As shown, the motor vehicle 10 includes at least one sensor 25A and an electronic controller 26, which cooperate in some situations in the autonomous driving mode to at least partially control, guide and manipulate the vehicle 10. As such, the vehicle 10 can be referred to as an autonomous vehicle. In order to achieve efficient and reliable autonomous driving vehicle control, the electronic controller 26 can be in operable communication with (one or more) steering actuators 22, accelerator devices 23, and brake devices 24 configured as electric power steering units. The sensors 25A of the motor vehicle 10 are operable to sense the lane 12 and monitor the surrounding geographic area and traffic conditions close to the motor vehicle 10.

[0030] The sensors 25A of the vehicle 10 may include, but are not limited to, at least one of a light detection and ranging (LIDAR) sensor, a radar, and a camera located around the vehicle 10 to detect boundary indicators (such as edge conditions) of the lane 12. The sensor 25A may also be located in the passenger compartment of the vehicle 10 to view the occupants and cargo areas within the vehicle 10. The types of sensors 25A, their locations on the vehicle 10, and their operations for detecting and / or sensing boundary indicators of the lane 12 and monitoring the surrounding geographic area and traffic conditions are understood by those skilled in the art and are therefore not described in detail herein. The vehicle 10 may additionally include a sensor 25B attached to the vehicle body, such as an RFID reader. The sensor 25B may be positioned adjacent to the entry point of the vehicle 10 to determine whether an object with an RFID tag enters the vehicle.

[0031] The electronic controller 26 is configured to communicate with the sensors 25A of the vehicle 10 for receiving their respective sensed data related to the detection or sensing of the lane 12 and the monitoring of the surrounding geographic area and traffic conditions. The electronic controller 26 may alternatively be referred to as a control module, a control unit, a controller, a vehicle 10 controller, a computer, etc. The electronic controller 26 may include a computer and / or processor 28 and include software, hardware, memory, algorithms, connections (such as to the sensors 25A and 25B), etc. for managing and controlling the operation of the vehicle 10. As such, the electronic controller 26 described below and in Figure 2 The method generally represented in may be embodied as a program or algorithm operable in part on the electronic controller 26. It should be understood that the electronic controller 26 may include a device capable of analyzing data from the sensors 25A and 25B, comparing the data, making decisions necessary to control the operation of the vehicle 10, and performing tasks necessary to control the operation of the vehicle 10.

[0032] The electronic controller 26 may be embodied as one or more digital computers or mainframes, each having one or more processors 28, read-only memory (ROM), random access memory (RAM), electrically programmable read-only memory (EPROM), optical drives, magnetic drives, etc., high-speed clocks, analog-to-digital (A / D) circuits, digital-to-analog (D / A) circuits and input / output (I / O) circuits, I / O devices and communication interfaces, and signal conditioning and buffering electronics. Computer-readable memory may include non-temporary / tangible media that participate in providing data or computer-readable instructions. The memory may be non-volatile or volatile. Non-volatile media may include, for example, optical or magnetic disks and other persistent memory. Example volatile media may include dynamic random access memory (DRAM), which may constitute main memory. Other examples of embodiments of memory include floppy disks, hard disks, tapes or other magnetic media, CD-ROMs, DVDs and / or other optical media, and other possible memory devices such as flash memory.

[0033] Electronic controller 26 includes tangible, non-transitory memory 30 having recorded thereon computer executable instructions including one or more algorithms for regulating the operation of motor vehicle 10. The subject algorithm(s) may specifically include an algorithm, described in detail below, configured to monitor the positioning of motor vehicle 10 and determine the vehicle's heading relative to a mapped vehicle trajectory on a particular road course.

[0034] The motor vehicle 10 also includes a vehicle navigation system 34, which can be part of the integrated vehicle control, or an additional device in the vehicle for finding driving directions. The vehicle navigation system 34 is also operably connected to a global positioning system (GPS) 36 using earth orbit satellites. The vehicle navigation system 34 connected to the GPS 36 and the above-mentioned sensor 25A can be used for the automation of the vehicle 10. The electronic controller 26 communicates with the GPS 36 via the vehicle navigation system 34. The vehicle navigation system 34 receives its position data from the GPS 36 using a satellite navigation device (not shown), which is then associated with the position of the vehicle relative to the surrounding geographic area. Based on such information, when directions to a specific waypoint are needed, the route to such a destination can be mapped and calculated. Real-time terrain and / or traffic information can be used to adjust the route. The current position of the vehicle 10 can be calculated via dead reckoning, that is, by using a previously determined position and advancing the position over the time and route passed through discrete control points based on a given or estimated speed.

[0035] The electronic controller 26 is generally configured, ie, programmed, to determine or identify the position 38 ( Figure 1), velocity, acceleration, yaw rate, and expected path 40 and heading 42. Position 38, expected path 40, and heading 42 of motor vehicle 10 may be determined via navigation system 34 receiving data from GPS 36, while velocity, acceleration (including longitudinal and lateral g), and yaw rate may be determined from vehicle sensors 25B. Alternatively, electronic controller 26 may determine vehicle position 38 relative to lane 12 using other systems or detection sources (e.g., cameras) remotely disposed from vehicle 10.

[0036] As described above, the motor vehicle 10 can be configured to operate in an automated driving mode directed by the electronic controller 26 to transport the occupants 62. In such a mode, the electronic controller 26 can also obtain data from the vehicle sensors 25B to guide the vehicle along a desired path, such as via adjusting the steering actuator 22. The electronic controller 26 can additionally be programmed to detect and monitor the steering angle (θ) of the steering actuator(s) 22 along the desired path 40, such as during a negotiated turn. Specifically, the electronic controller 26 can be programmed to detect and monitor the steering angle (θ) of the steering actuator(s) 22 along the desired path 40 via receiving and processing data from the steering position sensor 44 ( Figure 1 The steering angle (θ) is determined based on the data signal (shown).

[0037] Figure 2 A method 100 for tracking an object relative to a vehicle 10 is illustrated. The method 100 can track multiple different types of objects, such as a person, a bag, or a device, as will be explained in more detail below. One feature of the method 100 is to develop a packing list, such as a route object list for carrying onto the vehicle 10 for a predetermined vehicle route. The route can be determined based on a predetermined starting location associated with a corresponding destination location, a destination location independent of the starting location, or a starting location independent of the destination location. The route object list can also be shared between different vehicles in the same household with a single account, fleet, or discoverable device through the electronic controller 26, which communicates through the cloud 54 to access stored data about the route object list.

[0038] The method 100 begins at box 102 and then scans for objects at box 104. In the illustrated example, the method 100 begins scanning for objects before the driver begins the route at box 106. This allows the method 100 to identify objects as they approach the vehicle 10, such as a person with an approaching key.

[0039] The method 100 scans for objects in a variety of different ways. In one example, the method 100 can identify discoverable devices that form a Bluetooth, Wi-Fi, or other type of wireless connection with the vehicle 10 at box 104. The discoverable devices can include mobile devices, wearable devices, tablets, or proximity keys associated with the vehicle 10. When a particular wearable device is associated with a given user, the wearable device also helps identify one or more specific users in the vehicle 10.

[0040] In another example, the method 100 utilizes the sensor 25B (such as an RFID tag reader) at block 104 to identify a tag associated with the object 50 ( Figure 1 ) RFID tags 52 associated with the vehicle 10. The RFID tags 52 may be associated with specific objects 50 so that the method 100 can determine which objects 50 are carried with the vehicle 10 by reading the RFID tags 52. Alternatively, a specific set of RFID tags 52 may be used with a set of predetermined objects associated with a predetermined route of the vehicle 10.

[0041] In another example, the method 100 performs image recognition at box 104 on images captured from an area around the vehicle 10 using at least one camera from the sensor 25A. The area around the vehicle 10 may include at least one of an area within a predetermined distance of the vehicle 10, within a passenger compartment of the vehicle 10, or within a cargo compartment of the vehicle 10. The image recognition performed at box 104 may include facial recognition for identifying a specific person or object detection for identifying a specific object. Additionally, the facial recognition may include associating at least one predetermined object with a route object list based on the facial recognition.

[0042] The method 100 may then compare the plurality of currently identified objects to a plurality of previously identified objects from a route that the vehicle 10 has traveled immediately previously at box 108. If the plurality of currently identified objects fail to match the plurality of previously identified objects, a warning or notification that at least one object may have been left behind is sent to the driver of the vehicle 10 (box 110). If the plurality of currently identified objects match the plurality of previously identified objects, the method continues to box 112 to determine the route of the vehicle 10.

[0043] The method 100 may determine the route of the vehicle 10 at block 112 in a variety of different ways. In one example, the route of the vehicle 10 is determined based on a destination input into a navigation system 34 on the vehicle 10, which can provide the current location of the vehicle 10 for determining a starting point for the route. The method 100 may also receive a destination independent of the navigation system 34, such as from a user's mobile device.

[0044] In another example, the route of the vehicle 10 is determined by predicting a destination based on utilizing a trip history database of the vehicle 10 in combination with the current location of the vehicle 10. For example, the trip history database may be maintained by the controller 26 and include the date, travel time, and origin location of each trip with an associated destination location.

[0045] If no route is provided (block 114) and a route cannot be predicted (block 116), the vehicle 10 will record the starting point at the beginning of the current route and the destination at the end of the route (block 118) to establish a new route for the vehicle 10 that can be stored in a trip history database. A plurality of currently identified objects will be associated with the new route at block 120 before the method 100 ends at block 122.

[0046] If a destination is selected in the navigation system 34 (block 114) or a route is predicted (block 116), the method 100 may then perform an additional scan for objects associated with the vehicle 10 (block 124), or rely on the scan for objects performed at block 104 to determine a current object list for the vehicle 10. At block 124, the method 100 may then compare the current object list to a route object list associated with the route.

[0047] The method 100 may then determine whether the current object list includes at least one lost object when compared to the route object list (box 126). If the method determines that there is at least one lost object, the method 100 may warn the driver of the lost object (box 128) and give the driver an opportunity to take action in response to the warning (such as obtaining the lost object) (box 130).

[0048] If the driver decides to ignore the warning, the method 100 may adjust the weight or priority of the at least one lost object (box 132). The weight or priority corresponds to the level of importance set by one of the users of the vehicle 10 for the at least one lost object. The change in weight or priority for the at least one lost object in the current object list is updated at box 120 to be associated with the route object list for the given route. If at least one lost object is repeatedly left behind for a given route and the driver continues to ignore the warning about the at least one lost object, the method 100 may update the route object list associated with the route to remove the at least one object that was repeatedly lost (box 120). If the driver decides to take action in response to the warning from box 128 (box 134), the method 100 will maintain the lost object associated with the plurality of predetermined objects associated with the given route.

[0049] In addition, if the method 100 fails to identify at least one missing object at block 126, the method 100 will then determine if there are additional objects identified in the current object list that are not in the route object list for the given route (block 136). If it is determined that there are no additional objects in the current object list when compared to the route object list, the method 100 continues to block 122 and ends. If the current object list includes an object that does not appear in the route object list (block 138), the method 100 may update the route object list with the new object at block 120 before ending at block 122.

[0050] Although various embodiments have been described, this description is intended to be exemplary rather than restrictive. It will be apparent to those of ordinary skill in the art that more embodiments and implementations within the scope of the embodiments are possible. Unless specifically limited, any feature of any embodiment may be used in combination with any other feature or element in any other embodiment or be replaced with any other feature or element in any other embodiment. Therefore, the embodiments will not be limited except according to the attached claims and their equivalents. In addition, various modifications and changes may be made within the scope of the attached claims.

Claims

1. A method for tracking an object relative to a vehicle, the method comprising: identifying a route object list associated with a predetermined vehicle route, wherein the route object list includes a list of objects to be carried on the vehicle for the predetermined vehicle route; identifying at least one object associated with the vehicle using at least one sensor on the vehicle to determine a current object list for the vehicle; comparing the current object list with the route object list associated with the predetermined route to identify at least one missing object from the current object list when compared with the route object list; and A notification of the at least one missing object is provided to a user.

2. The method according to claim 1, wherein: The route object list includes a list of objects identified by the vehicle from an immediately previous route traveled by the vehicle. The method of claim 1 , comprising determining a future route of the vehicle.

4. The method according to claim 3, wherein: Determining a future route for the vehicle includes predicting a destination based on utilizing a travel history of the vehicle.

5. The method according to claim 3, wherein: Determining a future route for the vehicle includes receiving the route from a navigation system associated with the vehicle.

6. The method according to claim 3, wherein: Determining a future route for the vehicle includes identifying a new traveled route by monitoring the vehicle's path from an origin location to a destination location. The method of claim 6 , comprising associating the current object list with the newly traveled route.

8. The method of claim 1, comprising identifying a user response to the notification and assigning an importance level to the at least one lost object based on the user response.

9. The method according to claim 8, wherein: If the user responds to the notification, the at least one lost object is maintained in the route object list.

10. The method according to claim 8, wherein: If the user fails to respond to the notification, the at least one lost object is removed from the route object list.

Images