Systems and methods for notifying owners of lost items in their vehicles

Abstract

A method is provided to notify the owner of lost items in a vehicle with a passenger compartment. The method includes providing at least one sensor to sense the lost item in the passenger compartment. The method further includes sensing the lost item at a point relative to a spherical coordinate system to define sensed item data, and determining the position of the lost item in Cartesian coordinates based on the sensed item data to define position data. The method also includes transforming the sensed item data and the position data for visualization of the lost item to define an image of the lost item relative to the passenger compartment, and updating a list of lost items to include lost items with the item image. The method further includes identifying the owner of the lost item using a perception algorithm, providing a notification to the owner of the lost item, and providing visual access to the item image so that the owner can view the image.

Description

[0001] introduction. Technical Field

[0002] This disclosure relates to sensing lost items in a vehicle, and more particularly, to systems and methods for sensing lost items in a vehicle and notifying the owner of the lost items. Background Technology

[0003] As automotive technology continues to advance, especially in car-sharing, the number of vehicles with multiple users will continue to grow. With more users per vehicle, the likelihood of lost items also increases. Summary of the Invention

[0004] Therefore, although current methods for identifying lost items and notifying their owners have achieved their intended purpose, there is still a need for new and improved systems and methods for identifying lost items in vehicle passenger compartments and notifying their owners.

[0005] According to one aspect of this disclosure, a method is provided for notifying an owner of lost items in a vehicle having a passenger compartment. The method includes providing at least one sensor to sense the lost items in the passenger compartment. In this aspect, the method further includes sensing the lost items at points relative to a spherical coordinate system to define sensed item data, and determining the position of the lost items in Cartesian coordinates based on the sensed item data to define position data. The method also includes transforming the sensed item data and position data to visualize the lost items, thereby defining an image of the lost items relative to the passenger compartment. The method further includes updating a list of lost items to include lost items with images, and identifying the owner of the lost items using a perception algorithm. Furthermore, the method includes providing a notification to the owner of the lost items and providing visual access to the image of the items, allowing the owner to view the image.

[0006] In one example, a point relative to a spherical coordinate system is defined by a distance r, a first angle (θ), and a second angle (θ). φ Definition: Lost items have Cartesian coordinates, which have x-axis, y-axis, and z-axis derived as follows:

[0007] .

[0008] In another example, the step of determining the location of a lost item includes arranging the sensor to have two of the following motions: tilt, pitch, and sway rotation, when the sensor is sensing at a fixed location in the vehicle's passenger compartment. In yet another example, the step of determining the location of a lost item includes arranging the sensor to have one of the following motions: tilt, pitch, and sway rotation, when the sensor is sensing during motion along the x-axis, such that a first angle θ is calculated as:

[0009] .

[0010] In yet another example, the steps for determining the location of a lost item include arranging the sensor to have one of tilt, pitch, and yaw rotational motions while the sensor is sensing motion along the x and y axes, such that a second angle... φ Calculated as:

[0011] .

[0012] In one example, the at least one sensor is fixedly disposed in the vehicle passenger compartment. In another example, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis. In yet another example, the at least one sensor is disposed in the vehicle passenger compartment and is movable along both the x-axis and the y-axis. In yet another example, the at least one sensor may be an ultrasonic sensor, an RFID sensor, or any other suitable sensor without departing from the spirit or scope of this disclosure.

[0013] In one example, the steps to identify the owner of a lost item include scanning the vehicle's passenger compartment. The identification steps also include detecting users within the vehicle's passenger compartment. Furthermore, the identification steps include matching users with lost items using a perception algorithm.

[0014] According to another aspect of this disclosure, a system is provided for notifying an owner of lost items in a vehicle having a passenger compartment. The system includes at least one sensor disposed in the passenger compartment and arranged to sense the lost item at a point relative to a spherical coordinate system to define sensed item data. In this example, the system also includes an electronic control unit (ECU) disposed in the vehicle and communicating with the at least one sensor. Furthermore, the ECU is arranged to determine the position of the lost item in Cartesian coordinates based on the sensed item data to define position data. The ECU is also arranged to transform the sensed item data and position data to visualize the lost item, thereby defining an image of the lost item relative to the passenger compartment. Additionally, the ECU is arranged to update a list of lost items to include lost items with images. Furthermore, the ECU is arranged to identify the owner of the lost item using a perception algorithm.

[0015] In this respect, the system also includes a cloud server located remotely from the vehicle setup and communicating with the ECU. The cloud server is configured to provide notifications to the owner of the lost item. Furthermore, the cloud server is configured to provide visual access to an image of the item, allowing the owner of the lost item to view the image.

[0016] In one embodiment, a point relative to a spherical coordinate system is determined by a distance r, a first angle (θ), and a second angle (θ). φ The definition is as follows. Furthermore, lost items have Cartesian coordinates, which have x-axis, y-axis, and z-axis derived as follows:

[0017] .

[0018] In one embodiment, the ECU arranged to determine the location of a lost item includes a sensor that, when sensing at a fixed location in the vehicle's passenger compartment, is arranged to have two of the following movements: tilt, pitch, and sway rotation. In another embodiment, the ECU arranged to determine the location of a lost item includes a sensor that, when sensing in motion along the x-axis, is arranged to have one of the following movements: tilt, pitch, and sway rotation, such that a first angle θ is calculated as:

[0019] .

[0020] In another embodiment, the ECU arranged to determine the location of a lost item includes a sensor that, when sensing motion along the x and y axes, is arranged to have one of a tilt, pitch, and rocking rotational motion, such that a second angle... φ Calculated as:

[0021] .

[0022] In one embodiment, the at least one sensor is fixedly disposed in the vehicle passenger compartment. In another embodiment, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis. In yet another embodiment, the at least one sensor is disposed in the vehicle passenger compartment and is movable along both the x-axis and the y-axis. In yet another embodiment, the at least one sensor is one of an ultrasonic sensor and a radio frequency identification (RFID) sensor.

[0023] According to another aspect of this disclosure, a method is provided for notifying an owner of lost items in a vehicle having a passenger compartment. The method includes providing at least one sensor to sense the lost items in the passenger compartment. Furthermore, the method includes sensing the lost items at a point relative to a spherical coordinate system to define the sensed item data. In this regard, the point is defined by a distance r, a first angle (θ), and a second angle (r). φ Definition: Lost items have Cartesian coordinates, which have x-axis, y-axis, and z-axis derived as follows:

[0024] .

[0025] The method also includes determining the location of the lost item in Cartesian coordinates based on the sensed item data to define location data. The sensor is arranged to have two of the following motions when sensing in a fixed position within the vehicle's passenger compartment: tilt, pitch, and sway rotation. The sensor is also arranged to have one of these three motions when sensing in motion along the x-axis, such that a first angle θ is calculated as:

[0026] .

[0027] In this respect, when the sensor senses motion along the x and y axes, the sensor is arranged to have one of the following motions: tilt, pitch, and rocking rotation, such that the second angle... φ Calculated as:

[0028] .

[0029] Furthermore, the method includes transforming sensed item data and location data to visualize the lost item, thereby defining an image of the lost item relative to the vehicle's passenger compartment. Additionally, the method includes updating the list of lost objects to include lost items with item images. Furthermore, the method includes identifying the owner of the lost item using a perception algorithm. The method also includes providing a notification to the owner of the lost item. Finally, the method includes providing visual access to the item image, allowing the owner of the lost item to view the image.

[0030] This invention provides the following technical solution:

[0031] 1. A method for notifying the owner of lost items in a vehicle with a passenger compartment, the method comprising:

[0032] Provide at least one sensor to detect lost items in the vehicle's passenger compartment;

[0033] Detect lost items at points relative to a spherical coordinate system to define the data of the detected items;

[0034] The location of the lost item in Cartesian coordinates is determined based on the sensed item data to define the location data;

[0035] The sensed item data and location data are converted to visualize the lost item, thereby defining an item image of the lost item relative to the vehicle's passenger compartment;

[0036] Update the list of lost items to include lost items with item images;

[0037] The owner of the lost items is identified through a perception algorithm;

[0038] Notify the owner of the lost item; and

[0039] Provides visual access to an image of the item, allowing the image to be viewed by the owner of the lost item.

[0040] According to the method described in technical solution 1, a point relative to the spherical coordinate system is determined by a distance r, a first angle (θ), and a second angle (θ). φ The lost item is defined as having Cartesian coordinates, wherein the Cartesian coordinates have x-axis, y-axis, and z-axis derived as follows:

[0041] .

[0042] According to the method of technical solution 2, the step of determining the location of the lost item includes: when the sensor is sensing at a fixed location in the vehicle passenger compartment, the sensor is arranged to have two of the following: tilt, pitch and sway rotation.

[0043] According to the method described in technical solution 2, the step of determining the location of the lost item includes: when the sensor senses during motion along the x-axis, the sensor is arranged to have one of tilt, pitch, and rocking rotational motions, such that a first angle θ is calculated as:

[0044] .

[0045] According to the method described in technical solution 2, the step of determining the location of the lost item includes, when the sensor senses during motion along the x-axis and y-axis, the sensor is arranged to have one of tilt, pitch, and rocking rotational motions, such that the second angle... φ Calculated as:

[0046] .

[0047] According to the method described in technical solution 2, the at least one sensor is fixedly installed in the vehicle passenger compartment.

[0048] According to the method described in technical solution 2, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis.

[0049] According to the method described in technical solution 2, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis and y-axis.

[0050] According to the method described in technical solution 1, the at least one sensor is one of an ultrasonic sensor and an RFID sensor.

[0051] According to the method described in technical solution 1, the step of identifying the owner of the lost item includes:

[0052] Scan the vehicle's passenger compartment;

[0053] Detecting users in the vehicle's passenger compartment;

[0054] The user is matched with the lost item using a perception algorithm.

[0055] A system for notifying the owner of lost items in a vehicle with a passenger compartment, the system comprising:

[0056] At least one sensor is disposed in the vehicle's passenger compartment and arranged to sense lost items at points relative to a spherical coordinate system in order to define data on the sensed items.

[0057] An electronic control unit (ECU) is installed in the vehicle and communicates with the at least one sensor. The ECU is arranged to determine the position of a lost item in Cartesian coordinates based on sensed item data to define location data; the ECU is arranged to transform the sensed item data and location data to visualize the lost item, thereby defining an image of the lost item relative to the vehicle's passenger compartment; the ECU is arranged to update a list of lost items to include lost items with item images; and the ECU is arranged to identify the owner of the lost item using a perception algorithm.

[0058] A cloud server, located remotely from the vehicle and communicating with the ECU, is configured to provide notifications to the owner of the lost item and to provide visual access to an image of the item, allowing the owner to view the image.

[0059] According to the system described in technical solution 11, a point relative to the spherical coordinate system is defined by a distance r, a first angle (θ), and a second angle (θ). φ The lost item is defined as having Cartesian coordinates, wherein the coordinates have x-axis, y-axis, and z-axis derived as follows:

[0060] .

[0061] According to the system of technical solution 12, the ECU is arranged to determine the location of the lost item, including: when the sensor senses at a fixed location in the vehicle passenger compartment, the sensor is arranged to have two of the following: tilt, pitch and sway rotation movements.

[0062] According to the system of technical solution 12, wherein the ECU is arranged to determine the location of a lost item, including: when the sensor senses during motion along the x-axis, the sensor is arranged to have one of tilt, pitch, and sway rotational motions, such that a first angle θ is calculated as:

[0063] .

[0064] According to the system described in technical solution 12, wherein the ECU is arranged to determine the location of a lost item, including: when the sensor senses during movement along the x-axis and y-axis, the sensor is arranged to have one of tilt, pitch, and rocking rotational motions, such that a second angle... φ Calculated as:

[0065] .

[0066] According to the system described in technical solution 12, the at least one sensor is fixedly installed in the vehicle passenger compartment.

[0067] According to the system of technical solution 12, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis.

[0068] According to the system of technical solution 12, the at least one sensor is disposed in the vehicle passenger compartment and is movable along the x-axis and y-axis.

[0069] According to the system of technical solution 12, the at least one sensor is one of an ultrasonic sensor and an RFID sensor.

[0070] A method for notifying the owner of lost items in a vehicle with a passenger compartment, the method comprising:

[0071] Provide at least one sensor to detect lost items in the vehicle's passenger compartment;

[0072] Lost items are sensed at points relative to a spherical coordinate system to define the sensed item data, said point being defined by a distance r, a first angle (θ), and a second angle (r). φ The lost item is defined as having Cartesian coordinates, wherein the Cartesian coordinates have x-axis, y-axis, and z-axis derived as follows:

[0073] ;

[0074] The location of the lost item is determined in Cartesian coordinates based on the sensed item data to define location data, wherein the sensor is arranged to have two of the following motions when sensing at a fixed location in the vehicle passenger compartment: tilt, pitch, and sway rotation; wherein the sensor is arranged to have one of the following motions when sensing in motion along the x-axis: such that a first angle θ is calculated as:

[0075] ,

[0076] Wherein, when the sensor senses during motion along the x-axis and y-axis, the sensor is arranged to have one of the following motions: tilt, pitch, and rocking rotation, such that the second angle... φ Calculated as:

[0077] ,

[0078] The sensed item data and location data are converted for visualization of the lost item, thereby defining an item image of the lost item relative to the vehicle's passenger compartment;

[0079] Update the list of lost items to include lost items with images of the items described.

[0080] The owner of the lost items is identified through a perception algorithm;

[0081] Notify the owner of the lost item; and

[0082] Provides visual access to an image of the item, allowing the owner of the lost item to view the image.

[0083] Further areas of application will become apparent from the description provided herein. It should be understood that the descriptions and specific examples are for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description

[0084] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way.

[0085] Figure 1 This is a schematic diagram of a system for identifying the owner of lost items in a vehicle having a passenger compartment, according to an embodiment of the present disclosure.

[0086] Figure 2 This is a perspective side view of the vehicle's passenger compartment, which is implemented according to an example. Figure 1 The system.

[0087] Figure 3This is a diagram in a spherical coordinate system derived from Cartesian coordinates for lost items, as shown in one example.

[0088] Figure 4 This is for Figure 1 The flowchart shows a general method for identifying the owner of lost items in a vehicle with a passenger compartment.

[0089] Figure 5 Is an example of identification used according to this disclosure Figure 1 A flowchart of a system for identifying the owner of lost items in a vehicle with a passenger compartment.

[0090] Figure 6 This is another example of a method used according to this disclosure. Figure 1 A flowchart illustrating a system for identifying the owner of lost items in a vehicle with a passenger compartment. Detailed Implementation

[0091] The following description is exemplary in nature and is not intended to limit this disclosure, application, or use.

[0092] The embodiments and examples disclosed herein provide systems and methods for identifying the owner of lost items in the passenger compartment of a vehicle. These embodiments and examples provide an efficient, accurate, and cost-effective way to identify lost items and notify their owners. Such examples will not require the installation of new hardware in most existing vehicles, and will not require the installation of any additional hardware in new vehicles.

[0093] Figure 1 A system 10 according to one embodiment of the present disclosure is depicted for notifying the owner 12 of a lost item 14 in a vehicle 16 having a vehicle passenger compartment 18. As shown, the system 10 includes at least one sensor 20, an electronic control unit (ECU) 22 communicating with the sensor 20, and a cloud server 24 communicating with the ECU 22. Furthermore, the cloud server 24 communicates with a handheld device 26 of the owner 12 of the lost item 14.

[0094] like Figure 1-2 As shown, the at least one sensor 20 (e.g., an ultrasonic sensor) is disposed in the vehicle passenger compartment 18. Figure 2 In the illustrated embodiment, multiple sensors (20, 20a, 20b, 20c, 20d) are disposed within the vehicle passenger compartment 18 and have detection areas 20′, 20a′, 20b′, 20c′, 20d′. That is, without departing from the spirit or scope of this disclosure, the sensors may be disposed in the ceiling, floor, console, interior panel, or any other suitable location within the vehicle passenger compartment 18.

[0095] As discussed in more detail below, sensor 20 can be arranged to sense relative to Figure 3 The lost item 14 is located at point 30 in the spherical coordinate system 32 to define the sensed item data. In one embodiment, point 30 relative to the spherical coordinate system 32 is defined by a distance r, a first angle (θ), and a second angle (θ). φ (This is a limitation.) Furthermore, lost item 14 can be transformed in Cartesian coordinates with the following derived x, y, and z axes.

[0096] .

[0097] In one example, when sensor 20 senses from a fixed location in vehicle passenger compartment 18, sensor 20 is arranged to have two of the following rotational movements: tilt, pitch, and rocking. That is, sensor 20 may have a body 34 fixedly disposed in vehicle passenger compartment 18 and a lens 36 disposed within body 34. Furthermore, lens 36 may be arranged to perform rotational movements, such as tilt, pitch, and rocking, during operation.

[0098] In another example, when sensor 20 senses during a translational motion along the x-axis, sensor 20 is arranged to have one of a tilt, pitch, or yaw rotational motion, such that the first angle θ is calculated as:

[0099] .

[0100] Translational motion of sensor 20 can include forward / backward movement, left / right movement, and up / down movement. Therefore, sensor body 34 can be disposed in vehicle passenger compartment 18 and arranged to be movable along one of the x-axis, y-axis, and z-axis for translational motion. As an example, sensor 20 can have body 34 movably disposed on a portion of the interior panel of vehicle passenger compartment 18 along a linear track (forward / backward movement). Lens 36 can be disposed within body 34 and arranged for rotational movements, such as tilt, pitch, and yaw.

[0101] In yet another example, when sensor 20 senses during translational motion along the x and y axes, sensor 20 is arranged to have one of tilt, pitch, and yaw rotational motions, such that the second angle... φ Calculated as:

[0102] .

[0103] As in the preceding embodiments, the translational movement of sensor 20 may include forward / backward movement, left / right movement, and up / down movement. Therefore, sensor body 34 may be disposed in vehicle passenger compartment 18 and arranged to be movable along the x-axis and y-axis (e.g., forward / backward and left / right movement) for translational movement. For example, the sensor may have body 34 movably disposed along a circular track on a portion of the interior panel of vehicle passenger compartment 18. Lens 36 may be disposed within body 34 and arranged for rotational movements, such as tilting, pitching, and swaying.

[0104] The sensor can be a radio frequency identification (RFID) sensor. That is, the sensor can have an RFID reader, and the object can have an RFID tag, allowing the sensor to detect and obtain data on the object and its location. The RFID tag can provide readable data about the user and the object, thus providing information about the ownership of the lost item 14 and the user's location / destination.

[0105] It should be understood that the sensor may be an ultrasonic sensor, a radio frequency identification sensor, a radar sensor or any other suitable sensor, without departing from the spirit or scope of this disclosure.

[0106] refer to Figure 1 System 10 also includes an electronic control unit (ECU) 22 located in vehicle 16. As shown, ECU 22 communicates with sensor 20 and the handheld device 26 of the owner 12 of the lost item 14. It should be understood that ECU 22 includes modules and algorithms to assist in the control system 10.

[0107] Furthermore, ECU 22 is arranged to determine the position of lost item 14 in Cartesian coordinates based on the sensed item data to define position data. The position of lost item 14 can be determined in a variety of ways. For example, as discussed in one example above, when sensor 20 senses from a fixed location in vehicle compartment 18, sensor 20 is arranged to have at least two of the following rotational movements: tilt, pitch, and rocking. That is, sensor 20 may have a body 34 fixedly disposed in vehicle compartment 18 and a lens 36 disposed within body 34. Furthermore, lens 36 may be arranged to rotate during operation, such as tilting, pitching, and rocking, to sense lost item 14.

[0108] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0109] ,

[0110] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0111] The location of the lost item 14 can be determined in another suitable manner. For example, as described above, when the sensor 20 senses translational motion along the x-axis from within the vehicle compartment 18, the sensor 20 can be arranged to have at least one of tilt, pitch, and sway rotational motions, such that the first angle θ is calculated as:

[0112] .

[0113] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0114] ,

[0115] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0116] The location of the lost item 14 can be determined in another suitable manner. For example, as discussed in another example above, when sensor 20 senses translational movement along the x and y axes in the vehicle passenger compartment 18, sensor 20 can be arranged to have at least one of tilt, pitch, and yaw rotational movements, such that the second angle φ Calculated as:

[0117] .

[0118] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0119] ,

[0120] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0121] ECU 22 is also configured to convert sensed object data and location data for visualizing the lost item 14, thereby defining an image of the lost item 14 relative to the vehicle passenger compartment 18. Based on the sensed object data and location data, ECU 22 is able to convert the sensed object and location data into an object image through an algorithm module, thereby providing an image of the lost item 14 and its location relative to the sensor 20 in the vehicle passenger compartment 18. It should be understood that ECU 22 may include modules and algorithms to help convert the sensed object data and location data, thereby outputting an object image and providing the location of the lost item 14.

[0122] Furthermore, ECU 22 is configured to update a list of lost items to include lost items 14 with images of the items. The list is preferably stored in ECU 22 and may include a "lost" database of objects left or lost in the vehicle's passenger compartment 18. To detect if an object has been left or lost, ECU 22 may include an object detection module configured to compare images of the vehicle's passenger compartment 18. These images may be captured intermittently by sensor 20 as needed. The object detection module may include a first perception algorithm that compares images or data from the vehicle's passenger compartment 18. As new objects and new users are detected and paired, data for each new object is recorded in the object database. Similarly, left or lost objects can be detected when users enter and leave the vehicle's passenger compartment 18 with and without their respective objects. Objects detected without a paired user can be identified as "lost" by the first perception algorithm. Data for each "lost" object is recorded in the "lost" database.

[0123] Furthermore, ECU 22 is configured to identify the owner 12 of lost item 14 during the journey of vehicle 16. Typically, the owner 12 of lost item 14 can be identified by ECU 22 via a user detection module. In one example, the user detection module can be configured to compare images of vehicle cabin 18. These images can be captured intermittently by sensor 20 as needed. The user detection module may include a second perception algorithm comparing images or data of vehicle cabin 18. As new objects and users are detected and paired, data for each new user is recorded in a database. When a lost object is detected, the user paired with the lost object can be identified via the second perception algorithm. Data for each user with a lost item can be recorded in a "user" database.

[0124] In another example, using an ECU 22 with a user detection module, the user / owner 12 of the lost item 14 can be located / identified by recording the identifier of the trip with a trip identifier (ID) during the trip when the lost item 14 was detected in the vehicle 16. Subsequently, the trip ID and the owner 12 of the lost item 14 can be matched by searching in the database of trip IDs and users.

[0125] This matching by ECU 22 can occur through the following steps. In the first step, the new item in vehicle 16 is identified when the user enters the vehicle with it. Sensor 20 senses and identifies the new item in vehicle 16. That is, the new item in the vehicle's passenger compartment 18 is identified based on image / data comparison (e.g., via the user detection module). Therefore, the new item has not yet appeared before the user enters vehicle 16.

[0126] In the second step, after the trip ends and / or the paired user has left the vehicle, the new item remains in the vehicle. Using ECU 22's perception algorithm, the item can be identified as a valuable item, such as a backpack, tablet, wallet, or bag. In the third step, the item is marked as "left behind during trip xxx," where xxx is a unique ID of the trip based on time and potential locations (such as the start and end points).

[0127] In the fourth step, ECU 22, which has a user database that matches vehicle users with trip IDs, is accessed to match lost item 14 with its owner 12 by matching the trip ID with the user ID. This database may be the same as or similar to any suitable user database used for identifying users, matching passengers with vehicles / drivers, and charging passengers for pick-up / rental services.

[0128] Alternatively, other methods may be available for identifying the owner 12 of abandoned items without departing from the spirit or scope of this disclosure. An additional method may include situations where the vehicle has an identification mechanism (e.g., for payment or personalization). When a user enters the vehicle, the user can manually or via an identification mechanism within the vehicle to log in. The vehicle can then track the user within the vehicle. Examples of such identification mechanisms include fingerprint mechanisms, facial ID mechanisms using cameras, telephone pairing mechanisms, and manual login to the infotainment system.

[0129] Another method for identifying the owner 12 could include situations where the vehicle records an image of the driver's face, which can then be uploaded to a facial recognition service.

[0130] Another method for identifying the owner 12 of a lost item may include a manual request from the owner / user 12 of the lost item 14, which can be used to search within the lost item database.

[0131] In another method for identifying the owner 12, and within a predetermined space, the user's path and the location of the abandoned object can be generated by the ECU 22 using a positioning module equipped with a positioning algorithm. Assuming the user's path is also the location of the object before it was left behind, the positioning module is configured to retrieve the object's path. The object's path is then matched against the user's path. As an example, the user's path can be obtained using the user's ticket / mobile phone location / facial ID. When the timestamp of the user's path overlaps with the timestamp of the object's path, the object can be assigned to the user.

[0132] Another method for identifying the owner 12 can include using radio frequency identification (RFID). In this case, the owner's information can also be included in the RFID tag.

[0133] refer to Figure 1 System 10 also includes a cloud server 24 located remotely from vehicle 16. As shown, cloud server 24 communicates with ECU 22. In a preferred embodiment, cloud server 24 is arranged to provide notification to the owner 12 of lost item 14. When ECU 22 identifies the owner 12 of lost item 14 as described above, ECU 22 sends a signal to cloud server 24 to inform or notify the owner 12 that the item has been left in vehicle passenger compartment 18.

[0134] For example, cloud server 24 can notify the user via an application downloaded to the user's handheld device or phone 26. A notification can be sent from the application to the user informing them that the lost item 14 has been detected in the vehicle's passenger compartment 18 and that the user has been identified as its owner 12. It should be understood that cloud server 24 can notify the owner 12 of the lost item 14 via email, text message, telephone call, voicemail, or any other suitable means, without departing from the scope or spirit of this disclosure.

[0135] Furthermore, cloud server 24 is configured to provide visual access to an image of the lost item 14, allowing the owner 12 to view the image. Specifically, ECU 22 can transmit an image of the lost item 14 to cloud server 24, which can then be downloaded by the user for visual access. It should be understood that the image can be a captured photograph or a digitally visualized shape generated using data from sensors. The user can view the image via a phone application. It should be understood that cloud server 24 can provide visual access to the image via email, text message, or any other suitable means without departing from the scope or spirit of this disclosure.

[0136] In addition, users can initiate searches for lost items via phone / web application, thus facilitating independent inspection of lost items already paired with them, in addition to any notifications from the cloud server 24 hours a day.

[0137] Figure 4 An example of the present disclosure is shown for... Figure 1 The flowchart illustrates a general method 110 for system 10 to notify owner 12 of a lost item. As shown, method 110 includes system 10 sensing the presence of lost item 14 in box 112 to define sensed item data; transforming the sensed item data and location data in box 114 for visualizing lost item 14, thereby defining an item image; and determining the location / location of lost item 14 in box 116 to define location data. Furthermore, general method 110 includes updating the list of lost items with the item image and its corresponding data in box 118, and identifying the owner 12 of lost item 14. As shown, general method 110 includes allowing a user to initiate a search for lost item 14 in box 120, and allowing manual correction of the list in box 122. Additionally, general method 110 includes notifying owner 12 via vehicle / telephone notification in box 124, and allowing visual access to the item image.

[0138] According to one example of this disclosure, Figure 5 Depicting by Figure 1 The flowchart illustrates a method 210 implemented by system 10 to notify the owner 12 of a lost item 14 in a vehicle 16 having a vehicle passenger compartment 18. As shown, method 210 includes a step 212 of providing at least one sensor 20 to sense the lost item 14 in the vehicle passenger compartment 18. As described above with respect to system 10, the at least one sensor 20 may be an ultrasonic sensor and is disposed in the vehicle passenger compartment 18. However, it should be understood that the sensor may be an ultrasonic sensor, a radio frequency identification sensor, a radar sensor, or any other suitable sensor without departing from the spirit or scope of this disclosure.

[0139] like Figure 5 As shown, method 210 further includes sensing relative to spherical coordinate system 32 ( Figure 3 The step 214 involves defining the sensed item data by detecting the lost item 14 at point 30 relative to the spherical coordinate system 32. As discussed, the sensor 20 can be arranged to sense the lost item 14 at point 30 relative to the spherical coordinate system 32 to define the sensed item data. In one embodiment, the point 30 relative to the spherical coordinate system 32 is defined by a distance r, a first angle (θ), and a second angle (θ). φ (This is a limitation.) Furthermore, lost item 14 can be transformed in Cartesian coordinates with the following derived x, y, and z axes.

[0140] .

[0141] In one example, when sensor 20 senses from a fixed location in vehicle passenger compartment 18, sensor 20 is arranged to have two of the following rotational movements: tilt, pitch, and rocking. That is, sensor 20 may have a body 34 fixedly disposed in vehicle passenger compartment 18 and a lens 36 disposed within body 34. Furthermore, lens 36 may be arranged to perform rotational movements during operation, such as tilt, pitch, and rocking.

[0142] In another example, when sensor 20 senses during a translational motion along the x-axis, sensor 20 is arranged to have one of a tilting, oscillating, and rocking rotational motion, such that the first angle θ is calculated as:

[0143] .

[0144] Translational motion of sensor 20 can include forward / backward movement, left / right movement, and up / down movement. Therefore, sensor body 34 can be disposed in vehicle passenger compartment 18 and arranged to be movable along one of the x-axis, y-axis, and z-axis for translational motion. As an example, the sensor can have body 34 movably disposed on a portion of the interior panel of vehicle passenger compartment 18 along a linear track (forward / backward movement). Lens 36 can be disposed within body 34 and arranged for rotational movements, such as tilt, pitch, and yaw.

[0145] In yet another example, when sensor 20 senses during translational motion along the x and y axes, sensor 20 is arranged to have one of tilt, pitch, and yaw rotational motions, such that the second angle... φ Calculated as:

[0146] .

[0147] As in the preceding embodiments, the translational movement of sensor 20 may include forward / backward movement, left / right movement, and up / down movement. Therefore, sensor body 34 may be disposed in vehicle passenger compartment 18 and arranged to be movable along the x-axis and y-axis (e.g., forward / backward and left / right movement) for translational movement. For example, the sensor may have body 34 movably disposed along a circular track on a portion of the interior panel of vehicle passenger compartment 18. Lens 36 may be disposed within body 34 and arranged for rotational movements, such as tilting, pitching, and swaying.

[0148] Method 210 further includes a step 216 of determining the position of the lost item 14 in Cartesian coordinates based on the sensed item data to define position data. As described above, the ECU 22 is arranged to determine the position of the lost item 14 in Cartesian coordinates based on the sensed item data to define position data. The position of the lost item 14 can be determined in a variety of ways. For example, as discussed in one example above, when the sensor 20 senses from a fixed location in the vehicle passenger compartment 18, the sensor 20 is arranged to have at least two of the following rotational movements: tilt, pitch, and rocking. That is, the sensor may have a body 34 fixedly disposed in the vehicle passenger compartment 18 and a lens 36 disposed within the body 34. Furthermore, the lens 36 may be arranged to rotate during operation, such as tilting, pitching, and rocking, to sense the lost item 14.

[0149] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0150] ,

[0151] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0152] The location of the lost item 14 can be determined in another suitable manner. For example, as described above, when the sensor 20 senses translational motion along the x-axis from within the vehicle compartment 18, the sensor 20 can be arranged to have at least one of tilt, pitch, and sway rotational motions, such that the first angle θ is calculated as:

[0153] .

[0154] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0155] ,

[0156] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0157] The location of the lost item 14 can be determined in another suitable manner. For example, as discussed in another example above, when sensor 20 senses translational movement along the x and y axes from within the vehicle compartment 18, sensor 20 can be arranged to have at least one of tilt, pitch, and sway rotational movements, such that the second angle... φ Calculated as:

[0158] .

[0159] Based on the item data sensed from sensor 20, lost item 14 can be converted by ECU 22 in Cartesian coordinates with x-axis, y-axis, and z-axis derived as follows.

[0160] ,

[0161] This allows ECU 22 to determine the location of lost item 14 in Cartesian coordinates within the defined location data.

[0162] Method 210 further includes step 218, which converts the sensed item data and location data for visualizing the lost item 14, thereby defining an item image of the lost item 14 relative to the vehicle passenger compartment 18. As described above with respect to system 10, ECU 22 is arranged to convert the sensed item data and location data for visualizing the lost item 14, thereby defining an item image of the lost item 14 relative to the vehicle passenger compartment 18. Based on the sensed item data and location data, ECU 22 is able to convert the sensed item and location data into an item image through an algorithm module, thereby providing an image of the lost item 14 and its location relative to the sensor 20 in the vehicle passenger compartment 18. It should be understood that ECU 22 may include modules and algorithms to help convert the sensed item data and location data, thereby outputting an item image and providing the location of the lost item 14.

[0163] Method 210 further includes step 220, which updates the list of lost objects to include lost items 14 with images of the items. As described above, ECU 22 is arranged to update the list of lost objects to include lost items 14 with images of the items. The list is preferably stored in ECU 22 and may include a “lost” database of left-behind or lost objects in the vehicle compartment 18. To detect that an object has been left behind or lost, ECU 22 may include an object detection module arranged to compare images of the vehicle compartment 18. Such images may be captured intermittently by sensor 20 as needed. The object detection module may include a first perception algorithm that compares images or data of the vehicle compartment 18. As new objects and new users are detected and paired, data for each new object is recorded in the object database. Similarly, left-behind or lost objects may also be detected when users enter and leave the vehicle compartment 18 with and without their respective objects. Objects detected without a paired user may be identified as “lost” by the first perception algorithm. Data for each “lost” object is recorded in the “lost” database.

[0164] Method 210 further includes a step 222 of identifying the owner 12 of the lost item 14 using a perception algorithm. As described above, ECU 22 is configured to identify the owner 12 of the lost item 14 during the journey of vehicle 16. Typically, the owner 12 of the lost item 14 can be identified by ECU 22 via a user detection module. In one example, the user detection module can be configured to compare images of the vehicle's passenger compartment 18. Such images can be captured intermittently by sensor 20 as needed. The user detection module may include a second perception algorithm that compares images or data of the vehicle's passenger compartment 18. As new objects and users are detected and paired, data for each new user is recorded in a database. When a lost object is detected, the user paired with the lost object can be identified using the second perception algorithm. Data for each user with a lost item can be recorded in a "user" database.

[0165] In another example, using an ECU 22 with a user detection module, the user / owner 12 of the lost item 14 can be located / identified by recording the identifier of the trip with a trip identifier (ID) during the trip when the lost item 14 was detected in the vehicle 16. Subsequently, the trip ID and the owner 12 of the lost item 14 can be matched by searching in the database of trip IDs and users.

[0166] As described above, this matching by ECU 22 can occur through the following steps. In the first step, the new item is identified in vehicle 16 when the user enters the vehicle with it. Sensor 20 senses and identifies the new item in the vehicle. That is, the new item is identified in the vehicle's passenger compartment 18 based on image / data comparison (e.g., via the user detection module). Therefore, the new item is not present before the user enters the vehicle.

[0167] In the second step, after the trip ends and / or the paired user has left the vehicle, the new item remains in the vehicle. Using ECU 22's perception algorithm, the item can be identified as a valuable item, such as a backpack, tablet, wallet, or bag. In the third step, the item is marked as "left behind during trip xxx," where xxx is a unique ID of the trip based on time and potential locations (such as the start and end points).

[0168] In the fourth step, ECU 22, which has a user database that matches vehicle users with trip IDs, is accessed to match lost item 14 with its owner 12 by matching the trip ID with the user ID. This database may be the same as or similar to any suitable user database used for identifying users, matching passengers with vehicles / drivers, and charging passengers for pick-up / rental services.

[0169] Alternatively, without departing from the spirit or scope of this disclosure, there may be other methods for identifying the owner 12 of the lost items.

[0170] Method 210 further includes a step 224 of providing notification to the owner 12 of the lost item 14. As described above, the cloud server 24 is configured to provide notification to the owner 12 of the lost item 14. When the ECU 22 identifies the owner 12 of the lost item 14 as described above, the ECU 22 sends a signal to the cloud server 24 to inform or notify the owner 12 that an item has been left in the vehicle passenger compartment 18. For example, the cloud server 24 can notify the user via an application downloaded to the user's phone. A notification can be sent to the user from the application informing the user that the lost item 14 has been detected in the vehicle passenger compartment 18 and that the user has been identified as its owner 12. It should be understood that the cloud server 24 may notify the owner 12 of the lost item 14 via email, text message, telephone call, voicemail, or any other suitable means without departing from the scope or spirit of this disclosure.

[0171] Method 210 further includes step 226, which provides visual access to an image of the item so that the image can be viewed by the owner 12 of the lost item 14. As discussed with respect to system 10, cloud server 24 is configured to provide visual access to an image of the item so that the image can be viewed by the owner 12 of the lost item 14. That is, ECU 22 can transmit an image of the lost item 14 to cloud server 24, which can be downloaded by the user for visual access. The user can view the image of the item via a telephone application. It should be understood that cloud server 24 may provide visual access to the image of the item via email, text message, or any other suitable means without departing from the scope or spirit of this disclosure.

[0172] In addition, users can initiate searches for lost items via phone / web application, thus facilitating independent inspection of lost items already paired with them, in addition to any notifications from the cloud server 24 hours a day.

[0173] According to another example of this disclosure, Figure 6 Depicting by Figure 1 The flowchart illustrates a method 310 implemented by system 10 to notify owner 12 of lost item 14 in vehicle 16 having vehicle passenger compartment 18. As shown, method 310 includes providing at least one sensor 20 in block 312 to sense the lost item 14 in vehicle passenger compartment 18. Furthermore, method 310 also includes sensing relative to spherical coordinate system 32 (…). Figure 3 The lost item 14 at point 30 is used to define the sensed item data in box 314. In this respect, point 30 is defined by distance r, a first angle (θ), and a second angle (θ). φDefinition: Lost item 14 has Cartesian coordinates, which have x-axis, y-axis, and z-axis derived as follows:

[0174] .

[0175] Method 310 further includes determining the location of the lost item 14 in Cartesian coordinates based on the sensed item data in block 316 to define location data. When sensor 20 senses at a fixed location in the vehicle compartment 18, sensor 20 is arranged to have two of the following motions: tilt, pitch, and sway rotation. When sensor 20 senses in motion along the x-axis, sensor 20 is arranged to have one of the following motions: tilt, pitch, and sway rotation, such that the first angle θ is calculated as:

[0176] .

[0177] In this respect, when sensor 20 senses motion along the x-axis and y-axis, sensor 20 is arranged to have one of tilt, pitch, and rocking rotational motions, such that the second angle... φ Calculated as:

[0178] .

[0179] Furthermore, method 310 includes, in box 318, converting sensed item data and location data for visualizing lost item 14, thereby defining an item image of lost item 14 relative to vehicle passenger compartment 18. Additionally, method 310 includes, in box 320, updating the list of lost objects to include lost item 14 with item images. Furthermore, method 310 includes, in box 322, identifying the owner 12 of lost item 14 using a perception algorithm. Method 310 also includes, in box 324, providing a notification to the owner 12 of lost item 14. Furthermore, method 310 includes, in box 326, providing visual access to the item image, allowing the owner 12 of lost item 14 to view the image.

[0180] The description in this disclosure is merely exemplary in nature, and variations thereof without departing from the spirit and scope of this disclosure are intended to be within its scope. Such variations should not be considered as departing from the spirit and scope of this disclosure.

Claims

1. A method for notifying the owner of lost items in a vehicle with a passenger compartment, the method comprising: Provide at least one sensor to detect lost items in the vehicle's passenger compartment; Sensing lost items at points relative to a spherical coordinate system to define the data of the sensed items; The location of the lost item in Cartesian coordinates is determined based on the sensed item data to define the location data; The sensed item data and location data are converted to visualize the lost item, thereby defining an item image of the lost item relative to the vehicle's passenger compartment; Update the list of lost items to include lost items with item images; The lost items are tagged with a unique ID based on the time and potential location of the trip; The lost item is matched with its owner by matching the trip ID with the user ID; Notify the owner of the lost item; and Provides visual access to an image of the item, allowing the image to be viewed by the owner of the lost item.

2. The method according to claim 1, wherein, A point relative to a spherical coordinate system is defined by a distance r, a first angle (θ), and a second angle (θ). φ The lost item is defined as having Cartesian coordinates, wherein the Cartesian coordinates have x-axis, y-axis, and z-axis derived as follows: 。 3. The method according to claim 2, wherein, The steps for determining the location of the lost item include: when the sensor is sensing at a fixed location in the vehicle's passenger compartment, the sensor is arranged to have two of the following motions: tilt, pitch, and rocking rotation.

4. The method according to claim 2, wherein, The steps for determining the location of a lost item include: when the sensor senses during motion along the x-axis, the sensor is arranged to have one of tilt, pitch, and sway rotational motions, such that a first angle θ is calculated as: 。 5. The method according to claim 2, wherein, The step of determining the location of the lost item includes, when the sensor is sensing in motion along the x-axis and y-axis, the sensor is arranged to have one of tilt, pitch, and rocking rotational motions, such that the second angle φ Calculated as: 。 6. The method according to claim 2, wherein, At least one sensor is fixedly installed in the vehicle's passenger compartment.

7. The method according to claim 2, wherein, The at least one sensor is disposed in the vehicle's passenger compartment and is movable along the x-axis.

8. The method according to claim 2, wherein, The at least one sensor is disposed in the vehicle's passenger compartment and is movable along the x-axis and y-axis.

9. The method according to claim 1, wherein, The at least one sensor is either an ultrasonic sensor or an RFID sensor.

10. The method according to claim 1, wherein, The steps for identifying the owner of the lost item include: Scan the vehicle's passenger compartment; Detecting users in the vehicle's passenger compartment; The user is matched with the lost item using a perception algorithm.

11. A system for notifying the owner of lost items in a vehicle having a passenger compartment, the system comprising: At least one sensor is disposed in the vehicle's passenger compartment and arranged to sense lost items at points relative to a spherical coordinate system in order to define data on the sensed items. An electronic control unit (ECU) is installed in the vehicle and communicates with the at least one sensor. The ECU is arranged to determine the location of the lost item in Cartesian coordinates based on sensed item data to define location data. The ECU is arranged to transform the sensed item data and location data to visualize the lost item, thereby defining an item image of the lost item relative to the vehicle's passenger compartment. The ECU is arranged to update the list of lost items to include lost items with item images, to tag the lost item with a unique ID based on a trip based on time and potential location, and to match the lost item with its owner by matching the trip ID with a user ID. as well as A cloud server, located remotely from the vehicle and communicating with the ECU, is configured to provide notifications to the owner of the lost item and to provide visual access to an image of the item, allowing the owner to view the image.

12. The system according to claim 11, wherein, A point relative to a spherical coordinate system is defined by a distance r, a first angle (θ), and a second angle (θ). φ The lost item is defined as having Cartesian coordinates, wherein the coordinates have x-axis, y-axis, and z-axis derived as follows: 。 13. The system according to claim 12, wherein, The ECU is configured to determine the location of the lost item, including: when the sensor senses at a fixed location in the vehicle's passenger compartment, the sensor is configured to have two of the following: tilt, pitch, and sway rotation movements.

14. The system according to claim 12, wherein, The ECU is configured to determine the location of a lost item, including: when the sensor senses during motion along the x-axis, the sensor is configured to have one of tilt, pitch, and yaw rotational motions, such that a first angle θ is calculated as: 。 15. The system according to claim 12, wherein, The ECU is configured to determine the location of a lost item, including: when the sensor senses movement along the x-axis and y-axis, the sensor is configured to have one of tilt, pitch, and yaw rotational movements, such that a second angle... φ Calculated as: 。 16. The system according to claim 12, wherein, At least one sensor is fixedly installed in the vehicle's passenger compartment.

17. The system according to claim 12, wherein, The at least one sensor is disposed in the vehicle's passenger compartment and is movable along the x-axis.

18. The system according to claim 12, wherein, The at least one sensor is disposed in the vehicle's passenger compartment and is movable along the x-axis and y-axis.

19. The system according to claim 12, wherein, The at least one sensor is either an ultrasonic sensor or an RFID sensor.

20. A method for notifying the owner of lost items in a vehicle having a passenger compartment, the method comprising: Provide at least one sensor to detect lost items in the vehicle's passenger compartment; Lost items are sensed at points relative to a spherical coordinate system to define the sensed item data, said point being defined by a distance r, a first angle (θ), and a second angle (r). φ The lost item is defined as having Cartesian coordinates, wherein the Cartesian coordinates have x-axis, y-axis, and z-axis derived as follows: ； The location of the lost item is determined in Cartesian coordinates based on the sensed item data to define location data, wherein the sensor is arranged to have two of the following motions when sensing at a fixed location in the vehicle passenger compartment: tilt, pitch, and sway rotation; wherein the sensor is arranged to have one of the following motions when sensing in motion along the x-axis: such that a first angle θ is calculated as: ， Wherein, when the sensor senses during motion along the x-axis and y-axis, the sensor is arranged to have one of the following motions: tilt, pitch, and rocking rotation, such that the second angle... φ Calculated as: ， The sensed item data and location data are converted for visualization of the lost item, thereby defining an item image of the lost item relative to the vehicle's passenger compartment; Update the list of lost items to include lost items with images of the items described. The lost items are tagged with a unique ID based on the time and potential location of the trip; The lost item is matched with its owner by matching the trip ID with the user ID; a notification is sent to the owner of the lost item; and Provides visual access to an image of the item, allowing the owner of the lost item to view the image.

Images