Object Detection

Abstract

Identify objects within a specified distance from the vehicle. Assign a location within the vehicle to the object and detect the object at that location. Actuate vehicle components when the object is detected in the location.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to object detection. Background Art

[0002] The vehicle may transport a user and cargo to a destination. When the user arrives at the vehicle, he or she may have objects (e.g., luggage) that need to be stored in the vehicle during transportation. In an unmanned or autonomous vehicle, it may not be possible to communicate to the user the available locations for storing objects in the vehicle or to determine whether an object has been stored or retrieved from its designated location. Therefore, a current problem in autonomous vehicles is the lack of infrastructure for detecting objects and managing the location of objects in the vehicle. Summary of the invention

[0003] According to the present invention, there is provided a method comprising:

[0004] Identify objects within a specified distance of the vehicle and outside the vehicle via wireless protocols;

[0005] assigning identified objects to locations in the vehicle;

[0006] Detecting the location of an object; and

[0007] A vehicle component is actuated when an object is detected in position.

[0008] According to an embodiment of the present invention, the method further comprises: identifying the object based on one or more of the identifier transmitted via the wireless protocol and the image provided by the vehicle image sensor.

[0009] According to one embodiment of the invention, assigning the identified object to a location in the vehicle comprises comparing features of the object with features of the location.

[0010] According to one embodiment of the invention, the location is a storage bin.

[0011] According to one embodiment of the invention, the method further comprises receiving, in a transceiver in the storage bin, a transmission from a transmitter associated with the object.

[0012] According to one embodiment of the invention, the storage box comprises a closed space formed by solid walls.

[0013] According to an embodiment of the invention, one or more of the walls comprises a conductive layer.

[0014] According to one embodiment of the present invention, the method further comprises: receiving an acknowledgement of the transmission from the object transmitter from a transceiver in the storage bin.

[0015] According to one embodiment of the present invention, the vehicle component is one of a transmission, a powertrain, a brake, and a steering gear.

[0016] According to one embodiment of the invention, the wireless protocol is Bluetooth Low Energy (BLE).

[0017] According to the present invention, there is provided a system comprising a computer, wherein the computer is programmed to:

[0018] Identify objects within a specified distance of the vehicle and outside the vehicle through wireless protocols;

[0019] assigning identified objects to locations in the vehicle;

[0020] Detecting the location of an object; and

[0021] A vehicle component is actuated when an object is detected in position.

[0022] According to one embodiment of the invention, the computer is further programmed to: identify the object based on one or more of the identifier transmitted via the wireless protocol and the image provided by the vehicle image sensor.

[0023] According to one embodiment of the invention, the computer is further programmed to assign the identified object to a location in the vehicle by comparing characteristics of the object with characteristics of the location.

[0024] According to one embodiment of the invention, the location is a storage bin.

[0025] According to one embodiment of the invention, the computer is further programmed to: receive, in a transceiver in the storage bin, a transmission from a transmitter associated with the object.

[0026] According to one embodiment of the invention, the storage box comprises a closed space formed by solid walls.

[0027] According to an embodiment of the invention, one or more of the walls comprises a conductive layer.

[0028] According to one embodiment of the present invention, the computer is further programmed to receive an acknowledgement of the transmission from the object transmitter from a transceiver in the storage bin.

[0029] According to one embodiment of the invention, the vehicle component is one of a transmission, a powertrain, a brake, and a steering.

[0030] According to one embodiment of the invention, the wireless protocol is Bluetooth Low Energy (BLE). BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a block diagram of an example system for managing objects in and near a vehicle;

[0032] Figure 2is a side view of an exemplary location in an exemplary vehicle;

[0033] Figure 3 is a perspective view of the example object;

[0034] Figure 4 are views of exemplary objects and exemplary vehicles;

[0035] Figure 5 is an example process for detecting objects within a specified distance of a vehicle and assigning the objects to locations in the vehicle. DETAILED DESCRIPTION

[0036] A system includes a computer programmed to identify objects within a specified distance of a vehicle and outside the vehicle via a wireless protocol, assign the identified objects to a location in the vehicle, detect that the object is at the location, and actuate a vehicle component when the object is detected at the location.

[0037] The computer may also be programmed to identify the object based on one or more of the identifier transmitted via the wireless protocol and the image provided by the vehicle image sensor.

[0038] The computer may also be programmed to assign an identified object to a location in the vehicle by comparing characteristics of the object to characteristics of the location.

[0039] The location may be a storage box. The storage box may include an enclosed space formed by solid walls. One or more walls may include a conductive layer. The computer may also be programmed to receive a transmission from a transmitter associated with the object in a transceiver in the storage box. The computer may also be programmed to receive an acknowledgment of the transmission from the object transmitter from the transceiver in the storage box.

[0040] The vehicle component is one of a transmitter, a powertrain, a brake, and a steering.

[0041] The wireless protocol is Bluetooth Low Energy (BLE).

[0042] A method includes identifying an object within a specified distance of a vehicle or external to the vehicle via a wireless protocol, assigning the identified object to a location in the vehicle, detecting that the object is at the location, and actuating a vehicle component when the object is detected to be at the location.

[0043] The method may also include identifying the object based on one or more of the identifier transmitted via the wireless protocol and the image provided by the vehicle image sensor. Assigning the identified object to a location in the vehicle includes comparing characteristics of the object to characteristics of the location.

[0044] The location may be a storage box. The storage box may include an enclosed space formed by solid walls. One or more walls may include a conductive layer. The method may also include receiving a transmission from a transmitter associated with the object in a transceiver in the storage box. The method may also include receiving an acknowledgment of the transmission from the object transmitter from the transceiver in the storage box.

[0045] A computing device programmed to perform any of the above method steps is also disclosed. A vehicle comprising the computing device is also disclosed. A computer program product is also disclosed, comprising a computer readable medium storing instructions executable by a computer processor to perform any of the above method steps.

[0046] Figure 1 An example system 100 is shown that includes a computer 105 that is programmed to identify objects within a specified distance of a vehicle 101 and objects outside of the vehicle 101, and assign objects to locations in the vehicle 101. The computer 105 in the vehicle 101 is programmed to receive collected data 115 from one or more sensors 110. For example, the data 115 of the vehicle 101 may include the location of the vehicle 101, the location of the target, etc. The location data may be in a known form, such as geographic coordinates (e.g., latitude and longitude coordinates obtained by a navigation system (e.g., as known, using a global positioning system (GPS))). Other examples of data 115 may include measurements of vehicle 101 systems and components, such as vehicle speed, vehicle trajectory, etc.

[0047] As is known, the computer 105 is typically programmed for communication on a vehicle 101 network (e.g., including a communication bus). The computer 105 can send messages to and / or receive messages from various devices in the vehicle 101 (e.g., controllers, actuators, sensors (including sensor 110), etc.) through a network, bus, and / or other wired or wireless mechanism (e.g., a wired or wireless local area network in the vehicle 101). Alternatively or additionally, in the case where the computer 105 actually includes multiple devices, the vehicle network can be used for communication between devices represented as the computer 105 in the present disclosure. In addition, the computer 105 can be programmed to communicate with a network 125, which, as described below, can include various wired and / or wireless network technologies, such as cellular, Bluetooth, Bluetooth Low Energy (BLE), wired and / or wireless packet networks, etc.

[0048] The data storage device 106 may be of any known type, such as a hard drive, a solid state drive, a server, or any volatile or non-volatile medium. The data storage device 106 may store the collected data 115 sent from the sensor 110 .

[0049] Sensors 110 may include various devices. For example, as is known, various controllers in vehicle 101 may operate as sensors 110 to provide data 115 via a vehicle 101 network or bus, such as data 115 related to vehicle speed, acceleration, position, subsystem and / or component status, etc. In addition, other sensors 110 may include cameras, motion detectors, etc. (i.e., sensors 110) to provide data 115 for evaluating the location of an object, projecting a path of an object, evaluating the location of a road lane, etc. Sensors 110 may also include short-range radar, long-range radar, lidar, and / or ultrasonic sensors.

[0050] Collected data 115 may include various data collected in vehicle 101. Examples of collected data 115 are provided above, and furthermore, data 115 is generally collected using one or more sensors 110, and may additionally include data calculated therefrom in computer 105 and / or at server 130. In general, collected data 115 may include any data that may be collected by sensors 110 and / or calculated therefrom.

[0051] The vehicle 101 may include a plurality of vehicle components 120. As used herein, each vehicle component 120 includes one or more hardware components adapted to perform a mechanical function or operation (e.g., moving the vehicle, slowing or stopping the vehicle, steering the vehicle, etc.). Non-limiting examples of components 120 include propulsion components (which include, for example, an internal combustion engine and / or an electric motor, etc.), transmission components, steering components (which may include, for example, one or more of a steering wheel, a steering rack, etc.), braking components, parking assist components, adaptive cruise control components, adaptive steering components, storage boxes, cargo compartments, etc.

[0052] When the computer 105 operates the vehicle 101, the vehicle 101 is an "autonomous" vehicle 101. For the purposes of this disclosure, the term "autonomous vehicle" is used to refer to a vehicle 101 operating in a fully autonomous mode. The fully autonomous mode is defined as one in which each of the vehicle 101 propulsion means (typically through a powertrain including an electric motor and / or an internal combustion engine), braking means, and steering means are controlled by the computer 105. The semi-autonomous mode is one in which at least one of the vehicle 101 propulsion means (typically through a powertrain including an electric motor and / or an internal combustion engine), braking means, and steering means is at least partially controlled by the computer 105 rather than an operating human operator.

[0053] The system 100 may also include a network 125 connected to the server 130 and the data storage device 135. The computer 105 may also be programmed to communicate with one or more remote sites such as the server 130 via the network 125, such remote sites may include the data storage device 135. The network 125 represents one or more mechanisms by which the vehicle computer 105 may communicate with the remote server 130. Thus, the network 125 may be one or more of a variety of wired or wireless communication mechanisms, including any desired combination of wired (e.g., cable and fiber optic) and / or wireless (e.g., cellular, wireless, satellite, microwave, and radio frequency) communication mechanisms and any desired network topology (or topology when multiple communication mechanisms are utilized). Exemplary communication networks include wireless communication networks that provide data communication services (e.g., using Bluetooth, Bluetooth Low Energy (BLE), IEEE 802.11, vehicle-to-vehicle (V2V) such as dedicated short-range communication (DSRC), etc.), local area networks (LANs), and / or wide area networks (WANs) (including the Internet).

[0054] The vehicle 101 includes a plurality of storage locations exemplified herein by storage boxes 140. The storage boxes 140 may be disposed in the vehicle 101 compartment and supported by vehicle components (e.g., floor, seat, roof, etc.). The storage boxes 140 may contain objects in the vehicle 101 during transportation. The computer 105 may actuate a door 142 or hatch of the storage box 140 from a closed state to an open state to allow entry and exit of the object. For example, the computer 105 may actuate the door 142 of the storage box 140 to an open state upon detecting an approaching object to allow a user to store an object in the storage box 140. As described below, before moving the vehicle 101 to the next destination, the computer 105 may actuate the door 142 of the storage box 140 to a closed state after confirming that the object is in the storage box 140.

[0055] Storage bin 140 may include a transceiver 145. Transceiver 145 communicates with computer 105 via a vehicle network. As further described below, transceiver 145 may receive messages that object 160 may send, such as messages that transmitter 165 may send. Upon detecting a message from an object, transceiver 145 may send a message to computer 105 to confirm that the object is in storage bin 140. Transceiver 145 is implemented by an antenna, circuit, chip, or other electronic component that may facilitate wireless communication. Transceiver 145 may be programmed to communicate according to any number of wired or wireless communication protocols. For example, transceiver 145 may be programmed to communicate according to a satellite communication protocol, a cellular-based communication protocol (LTE (Long Term Evolution), 3G (third generation mobile communication), etc.), Bluetooth, Bluetooth low energy, Ethernet, controller area network (CAN) protocol, WiFi (wireless), local interconnect network (LIN) protocol, etc.

[0056] The system 100 may include a user device 150. As used herein, a "user device" is a portable computing device that includes a memory, a processor, a display, and one or more input mechanisms (e.g., a touch screen, buttons, etc.) and hardware and software for wireless communication as described herein. Thus, the user device 150 may be any of a variety of computing devices (e.g., a smart phone, a tablet computer, a personal digital assistant, etc.) that include a processor and a memory. The user device 150 may communicate with the vehicle computer 105 using the network 125. For example, the user devices 150 may be communicatively connected to each other and / or to the vehicle computer 105 using wireless technologies as described above. The user device 150 includes a user device processor 155.

[0057] The system 100 may include an object 160. The object may be any object that a user may transport in the vehicle 101. In other words, the user may carry the object 160 into the vehicle 101 and deliver the object 160 to a desired location in the vehicle 101. For example, the object 160 may be a suitcase, a package, a crate, or any other object 160 that a user may carry onto the vehicle 101.

[0058] The transmitter 165 can be attached, for example, by Velcro. The transmitter 165 may be secured to the object 160 by glue, one or more fasteners (e.g., rivets, staples, bolts, ropes or cords, etc.), or some other fastening device. The transmitter 165 may, for example, be embedded in a surface of the object 160 (e.g., a fabric covering) and / or supported by the object 160 so that the transmitter 165 is transported (e.g., carried) with the object 160. The transmitter 165 may communicate with the computer 105 and the transceiver 145 of the storage box 140. For example, the transmitter 165 may communicate with the computer 105 and / or the transceiver 145 via the network 125. The transmitter 165 may communicate directly with the computer 105, i.e., have communications sent or received without an intermediary device. For example, when the object 160 approaches the vehicle 101, the transmitter 165 may send a transmission directly to the computer 105 to allow the computer 105 to detect the object 160. Additionally or alternatively, the transmitter 165 may communicate with the computer 105 indirectly, i.e., by transmitting or receiving communications through an intermediate device, such as the transceiver 145 of the storage bin 140. For example, when the object 160 is placed in the storage bin 140, the transmitter 165 may indirectly send a transmission to the computer 105 (e.g., the transmission may be relayed to the computer 105 by the transceiver 145) to confirm that the object 160 is in the storage bin 140. The transmitter 165 may be a radio transmitter, a radar transmitter, an ultrasonic transmitter, and / or a sonar transmitter.

[0059] The transmitter 165 of the object 160 may include an antenna for transmitting a transmission that may be received by, for example, the computer 105 and / or the transceiver 145. The transmission may include a bearer message and an identifier that is unique to the object 160. The bearer message may include a strength indicator, such as a received signal strength indicator (RSSI). The transmission may include a radio wave transmission, an encoded digital message, a modulated analog message, etc. The transmitter 165 may include an electronic oscillator to generate the bearer message. The identifier may include information that may identify the object 160, such as a descriptor of the object 160, a characteristic of the object 160, etc. The transmitter 165 may include a modulator circuit for combining the identifier with the bearer message using known modulation techniques, such as amplitude modulation, frequency modulation, frequency shift keying (e.g., shifting between two frequencies to send digital data), etc. Upon detecting the transmission, the computer 105 may decode the transmission using known decoding techniques to identify the object 160, such as identifying the identifier in the transmission to determine the descriptor and / or characteristic of the object 160.

[0060] Figure 2 Exemplary storage locations in vehicle 101 are shown. A "storage location" is a space in vehicle 101 where object 160 can be stored or held, e.g., for transportation. Computer 105 can maintain a list of storage locations in vehicle 101 based on a three-dimensional Cartesian coordinate system or other coordinate system that can be mapped to a space within the vehicle body (e.g., a passenger compartment, a cargo hold, etc.). For example, computer 105 can maintain a list of possible storage locations based on a generally unique identifier and / or descriptor for each location (e.g., "trunk," "under the front passenger seat," etc.) and a set of coordinates (e.g., coordinates x, y, z) that specify the vehicle space associated with each respective location, specifying a triple of vertices of a rectangular solid that specifies the space as a storage location. For example, a storage location can be a storage box 140 disposed in the compartment of vehicle 101. Alternatively, the storage location can be in the vehicle cargo hold, such as in the trunk. Computer 105 may store a set of Cartesian coordinates indicating the space of storage bin 140 and / or may store an identifier for storage bin 140, which may also be associated with a transceiver 145 and / or sensor in storage bin 140 so that the storage location may be monitored as described herein.

[0061] The storage location (e.g., storage box 140) includes an enclosed space 146 formed by solid walls 144, e.g., objects can be stored in the enclosed space 146. The walls 144 can extend around the enclosed space 146 and support the storage box 140. For example, the walls 144 can be solid surfaces that extend continuously around the enclosed space 146 (e.g., each wall 144 can extend from one wall 144 to another wall 144), e.g., the walls 144 can be metal or plastic.

[0062] One or more of the walls 144 may be movable relative to the other walls 144. For example, the storage box 140 may include a door 142 that is selectively movable from a closed state to an open state. The door 142 may be hingedly attached to one of the walls 144. The computer 105 may actuate the door 142 from a closed state to an open state to allow the object 160 to enter and exit. For example, when the vehicle 101 detects an approaching object 160, the computer 105 may actuate the door 142 to an open state to allow the user to store the object 160 in the storage box 140. Before moving the vehicle 101 to the next destination, the computer 105 may actuate the door 142 to a closed state after confirming that the object 160 is in the storage box 140.

[0063] One or more of the walls 144 may include a conductive layer 148 extending across the wall 144. The conductive layer 148 may be configured to enhance wireless messages from a transmitter 165 associated with the object 160. For example, the conductive layer 148 may be a metal (e.g., copper, aluminum, iron, etc.) to reduce (e.g., block, deflect, interfere with, etc.) wireless messages from an external source (e.g., a user device 150 outside the storage box 140). As another example, the conductive layer 148 may be a conductive plastic, such as polyacetylene, polyphenylene vinylene, etc. When the conductive layer 148 reduces wireless messages from an external source, the wireless message from the transmitter 165 associated with the object 160 may be relatively stronger than the wireless message from the external source. (In this context, an “external source” is a source of RF (Radio Frequency) transmissions outside of the storage bin 140.) When the transceiver 145 receives a stronger message in the storage bin 140, the computer 105 can confirm that the object 160 is set in the memory, for example, the computer 105 can identify the message from the transmitter 165 associated with the object 160 based on the relative strength of the message from the transmitter 165.

[0064] The transceiver 145 may be disposed within the storage box 140. For example, the transceiver 145 may be attached to one wall 144 of the storage box 140. The transceiver 145 may recognize that the object 160 is stored in the storage box 140. For example, when the object 160 is disposed in the storage box 140, the transceiver 145 may receive a message from the transmitter 165 of the object 160. The transceiver 145 may send a message to the computer 105 to confirm that the object 160 is disposed in the storage box 140. When the computer 105 receives the confirmation message, the computer 105 may actuate the door 142 of the storage box 140 to a closed state.

[0065] Figure 3An exemplary object 160 is shown. Object 160 may be a luggage item (e.g., a suitcase, duffel bag, backpack, briefcase, etc.) that a user may transport in vehicle 101. Object 160 may include a transmitter 165, e.g., transmitter 165 is secured to object 160, e.g., by glue, Velcro, wire, and / or rivets, etc., before the user approaches vehicle 101. Optionally, when the user arrives at vehicle 101, the user may attach transmitter 165 to object 160, e.g., vehicle 101 may include transmitter 165 that the user may attach to object 160. Transmitter 165 may send a message identifying object 160 to computer 105 and / or transceiver 145. When the computer receives the message from transmitter 165 when object 160 approaches vehicle 101, the computer may actuate door 142 of storage box 140 to an open state. When an object has been placed in a storage location (e.g., storage box 140), transceiver 145 in storage box 140 may receive a message from transmitter 165, and transceiver 145 may also communicate with computer 105 via network 125 to actuate door 142 of storage box 140 to a closed state.

[0066] Figure 4 An exemplary object and an exemplary vehicle are shown. Vehicle 101 includes a plurality of seats 122. Seats 122 support users of the vehicle 101 compartment. Seats 122 may be provided in the vehicle 101 compartment to accommodate users and objects 160 (e.g., cargo, luggage, etc.). Vehicle 101 may be an autonomous service vehicle that may transport users and objects 160 to respective destinations.

[0067] The vehicle 101 may include a plurality of storage locations, such as storage boxes 140. A storage location may be a space in the vehicle 101 where objects 160 may be stored while the vehicle 101 is being transported. These locations may be provided in the vehicle 101 to accommodate users and objects 160. For example, the storage location may be one or more of a storage box 140 and / or a cargo compartment (e.g., a trunk) of the vehicle 101. Each storage location may be assigned to one of the seats 122. That is, each user in the vehicle 101 may use one of the storage locations to store an object 160 while the vehicle 101 is being transported. Alternatively or additionally, each storage location may be associated with a feature of the object 160, as described herein. The computer 105 may determine a specific storage location (e.g., a specific storage box 140) for each object 160, and detect the object 160 in the storage location. Thus, when one of the users arrives at the destination, the computer 105 may determine whether the user has left one or more objects 160 at the corresponding storage location.

[0068] The vehicle 101 may include a vehicle image sensor 110 for capturing images of the object 160. The vehicle image sensor 110 may be supported by the vehicle 101 and may face away from the vehicle 101 to detect the object 160 outside the vehicle. The vehicle image sensor 110 may be a camera that provides images from the visible spectrum, whereby the object 160 may be detected using conventional image analysis techniques. The computer 105 may maintain a database of stored object images based on features of the object 160 (i.e., features that may be identified based on image recognition techniques and used to determine the type of the object 160). For example, the computer 105 may maintain a list of possible objects based on a substantially unique identifier for each object type and / or a descriptor for each object type (e.g., "suitcase", "duffel bag", "laptop", etc.). As another example, the vehicle image sensor 110 may be a thermal imaging sensor, a radar, a lidar, etc.

[0069] The computer 105 may determine that the object 160 is approaching the vehicle 101 by receiving a message from the transmitter 165 via a wireless protocol within a specified distance from the vehicle 101. The specified distance is a distance value stored in a memory of the computer 105 and is determined as a distance from the vehicle 101 (e.g., a radius from a center point or some other point within the vehicle 101), wherein the object 160 is close to the vehicle 101 when the object 160 is at or within the specified distance. The specified distance may be set according to the location and / or environment around the vehicle 101. For example, the specified distance may be smaller in a high-density area (e.g., an area where multiple objects 160 may be relatively close to the vehicle 101) than in a low-density area to ensure correct identification of the object 160. The vehicle 101 may include a plurality of sensors (e.g., BLE proximity sensors) that may detect transmissions from a transmitter 165 attached to the object 160 when the object 160 is within the specified distance. For example, the computer 105 may be programmed to determine that the object 160 is within the specified distance based on image data received from the vehicle image sensor 110 within a field of view extending to the specified distance. As another example, the computer 105 may be programmed to determine a signal strength indicator associated with the transmitter 165 of the object 160, such as a received signal strength indicator (RSSI). The computer 105 may determine that the object 160 is within the specified distance based on the signal strength indicator (e.g., the signal strength indicator is above a signal strength threshold). Additionally or alternatively, the user may reserve a location for the object 160 in the vehicle 101. For example, the user device 150 may send a message via a wireless protocol to identify the object 160 to be stored in the storage location and ensure that the storage location is available for the object 160.

[0070] The wireless protocol can be any suitable wireless communication protocol. For example, the wireless protocol can be Bluetooth Low Energy (BLE). Alternatively, the wireless protocol can be Bluetooth, Wi-Fi, or any other suitable wireless communication.

[0071] The computer 105 may identify an object 160 in proximity to the vehicle upon detecting a transmission from the transmitter 165. For example, the transmission may include an identifier (e.g., a descriptor and / or feature of the object 160) that the computer 105 may detect, such as the computer 105 may decode the transmission to identify the object 160. The computer 105 may maintain a list of identifiers based on wireless communication characteristics (e.g., frequency and amplitude) that may be associated with different types of objects 160. For example, the computer may maintain a list of possible objects based on substantially unique identifiers and / or descriptors (e.g., "suitcase," "duffel bag," "laptop," etc.) for each object 160. Upon detecting a message from the transmitter 165, the computer 105 may compare the identifier to the stored list using known processing techniques to identify the object 160. As another example, the computer 105 may identify the object 160 through an image captured by the vehicle image sensor 110. The computer 105 may actuate the vehicle image sensor 110 to capture an image of the object 160 upon detecting a message from the transmitter 165 within a specified distance. Computer 105 may use known processing techniques to compare the image of object 160 with stored object images to identify object 160. Computer 105 may assign object 160 to storage bin 140 after identifying object 160.

[0072] The computer 105 may determine a characteristic of the object 160. An object characteristic is any physical property of the object 160. For example, the object characteristic may include the dimensions of the object 160 (if applicable), such as length, height, width, circumference, etc. As another example, the characteristic may be the mass or weight of the object 160. Additionally or alternatively, the characteristic may be a material characteristic of the object 160. The object 160 may, for example, contain hazardous materials, whereby it is desirable that the selected storage box 140 be suitable for storing and transporting hazardous materials. The vehicle 101 may include a plurality of sensors that may detect the characteristics of the object 160, such as the vehicle image sensor 110, a weight sensor disposed in the box 140, etc. Additionally or alternatively, the user may identify the characteristics of the object 160 via the user device 150.

[0073] The computer 105 may compare the characteristics of the object 160 to the storage characteristics (i.e., physical characteristics and / or capacity) of each storage bin 140 in the vehicle 101. The characteristics of the storage bin 140 may be the size (e.g., length, width, and height) and the constraints of the object 160 (e.g., whether the object contains hazardous materials). When the characteristics of the object 160 meet the constraints according to the characteristics of the storage bin 140 (e.g., airline carry-on baggage requirements, hazardous materials requirements, etc.), the computer 105 may assign the object 160 to the storage bin 140. When the object 160 meets the constraints, the computer 105 may assign the object 160 to an available storage bin 140, such as a storage bin 140 associated with the user's seat 122, and may actuate the door 142 of the storage bin 140 to an open state. Alternatively, if the object 160 exceeds the constraints, the computer 105 may assign the object 160 to the cargo compartment of the vehicle 101, and may actuate the door 142 (e.g., trunk lid) of the cargo compartment to an open state.

[0074] The computer 105 may actuate the vehicle 101 to proceed to the destination, such as actuating the navigation component to navigate the vehicle 101 to the destination and actuating the propulsion component to drive the vehicle 101 to the destination. When the object 160 is stored in the storage box 140, the transceiver 145 may receive a transmission from the transmitter 165 and send a confirmation to the computer 105 that the object 160 is in the storage box 140. When the computer 105 receives the confirmation from the transceiver 145, the computer 105 may actuate the door 142 of the storage box 140 to a closed state. When the door 142 of the storage box 140 is in the closed state, the computer 105 may actuate the vehicle component 120 to drive the vehicle 101 to the destination.

[0075] The computer 105 may detect a user leaving the vehicle 101 based on data from a user detection sensor 110 (e.g., a weight sensor 110 installed in the seat 122). Alternatively or additionally, the user detection sensor 110 may be some other sensor known to detect the presence of an occupant or user in the vehicle 101 (e.g., a camera, etc., as is known). For example, if the user detection sensor 110 is a weight sensor, the computer 105 may compare baseline data indicating that the seat 122 is unoccupied with a threshold reading (e.g., a pressure reading) corresponding to the collected pressure data 115 to determine whether the seat 122 is occupied or unoccupied. In addition, when the computer 105 determines that the user is not in the seat 122 upon arrival at the destination and the user was in the seat 122 before arrival at the destination, the computer 105 may determine that the user has left the seat 122.

[0076] The computer 105 may associate the storage location assigned to the seat 122 with the user in the seat 122. Thus, the computer 105 may search for the object 160 left in the storage location upon detecting that the user has left the seat 122. For example, if the computer 105 has assigned a storage box 140 to the user upon detecting the object 160, the computer 105 may send a message to the user device 150 indicating the storage box 140 and instructing the user to place his or her object 160 in the storage box 140. When the user leaves the vehicle 101 (e.g., as determined by a change in occupancy of the seat 122 from occupied to unoccupied), the transceiver 145 may send a message to the computer 105 upon receiving a message from the object 160 transmitter 165 that the object 160 is left in the storage box 140.

[0077] The computer 105 can detect that the user has left the vehicle 101 by detecting the location of the user device 150. The vehicle 101 can include a plurality of sensors 110, such as a BLE proximity sensor, that can detect the location of the user device 150 in the vehicle 101. The computer 105 can communicate with the user device 150 to provide data about the location of the user device 150. When the sensor 110 detects that the location of the user device 150 is outside the vehicle 101, the computer 105 can determine that the user who owns the user device 150 is outside the vehicle 101, that is, the user has left the vehicle 101.

[0078] When the vehicle 101 stops at the destination, the computer 105 may actuate the storage box 140 to an open state, and the transceiver 145 may receive a message from a transmitter 165 (e.g., object 160) left in the storage box 140 assigned to the user leaving at the destination. Upon receiving the message from the transmitter 165 assigned to the leaving user, the transceiver 145 may send a message to the computer 105, and the computer 105, upon receiving the message from the transceiver 145, may send a message to the user device 150 to remind the user to retrieve his or her object 160. When the computer 105 identifies the object 160 in the storage box 140 based on the message received at the transceiver 145, the computer 105 may actuate an output on the user device 150 to notify the user leaving at the destination. For example, the computer 105 may send a message to the user device 150, actuate a tactile feedback device in the user device 150, flash a light in the user device 150, actuate a speaker in the user device 150 to produce an audio prompt, etc. Alternatively or additionally, the computer 105 may actuate a visual display on the vehicle 101, such as a vehicle travel light bar, an electronic sign, such as one attached to the vehicle 101, that is configurable to display information (e.g., route, departure and / or arrival time, etc.) to a user of the vehicle 101. The computer 105 may wait for a predetermined period of time (stored in a data storage device and / or a server) and actuate a user output after a period of time has passed at the destination, such as to give the user time to retrieve and take away the object 160. In addition, the computer 105 may actuate the door 142 of the storage bin 140 to an open state. When the object 160 is removed from the storage bin 140, the conductive layer 148 may reduce a message (e.g., a message including an identifier of the object 160) sent by the transmitter 165 to the transceiver 145 to the transceiver 145, i.e., the transmitter 165 is an external source. In this case, the transceiver 145 may send a message to the computer 105 to confirm that the object 160 has been removed from the storage bin 140. After confirming that the object is removed from the storage box 140, the computer 105 may actuate the storage box 140 to a closed state and may drive the vehicle to the next destination.

[0079] Figure 5 An example process for detecting an object 160 within a specified distance of a vehicle 101 and assigning the object 160 to a storage location in the vehicle 101 is shown. The process 500 begins in block 505, where the computer 105 detects an object 160 approaching the vehicle 101. As described above, the computer 105 can detect when the object 160 is within a specified distance of the vehicle 101, such as detecting a signal strength indicator (e.g., RSSI) from the transmitter 165 above a signal strength threshold, receiving a message from the user device 150, etc. If the computer 105 detects the object 160 within the specified distance, the process 500 continues in block 510. Otherwise, the process remains in block 505.

[0080] In block 510, the computer 105 activates the vehicle image sensor 120 to detect an image of the object 160 within the specified distance. As described above, the computer 105 may compare the captured images of the object 160 to identify features of the object 160, such as size, weight, etc. The vehicle image sensor 120 may have a field of view extending to the specified distance to capture images of the object 160 within the specified distance.

[0081] Next, in block 515, the computer 105 assigns the object 160 to a storage location in the vehicle 101, such as a storage bin 140 associated with a seat 122, a cargo compartment (i.e., a trunk), etc. As described above, the computer 105 may determine characteristics of the object 160 and compare the characteristics of the object 160 to the characteristics of the storage bin 140. The computer 105 may assign the object 160 to a storage bin 140 capable of storing the object 160 during transportation based on the characteristics of the object 160. The computer 105 may actuate the assigned storage bin 140 to an open position to allow the object 160 to be stored.

[0082] Next, in block 520, computer 105 registers the wireless identifier of object 160. As described above, computer 105 may maintain a list of unique identifiers for objects 160. Computer 105 may store the identifier of object 160 to compare the identifier to messages received from transceiver 145, as described below.

[0083] Next, in block 525, the transceiver 145 may detect the object 160 in the assigned storage bin 140. As described above, the storage bin 140 typically includes a conductive layer 148 that may reduce the message from an external source (e.g., the user device 150). When the object 160 is stored in the assigned storage bin 140, the transceiver 145 may detect the message from the transmitter 165, which may include, for example, an identifier of the object 160, because the message from the transmitter 165 is stronger relative to the message from the external source. The transceiver 145 may send a confirmation message (e.g., including the identifier of the object 160) to the computer 105 that the object 160 is in the assigned storage bin 140. The computer 105 may compare the received identifier with the identifier registered in block 520 above to determine whether the object 160 is detected in the assigned storage bin 140. If the object 160 is detected in the assigned storage bin 140, the process 500 continues to block 540. Otherwise, process 500 continues to block 530 .

[0084] In block 530, the computer 105 actuates an output to the user device 150. For example, the computer 105 may send a message to the user device 150 via the network 125. Alternatively or additionally, the computer 105 may actuate a haptic device and / or a light and / or an audio prompt on the user device 150. As described above, the message may indicate that the user has left the object 160 in the storage bin 140.

[0085] Next, in block 535, the computer 105 detects whether the object 160 is in the storage bin 140. For example, as described above, if the object is in the storage bin 140, the transceiver 145 may detect the transmission from the transmitter 165. If the object 160 remains in the storage bin 140, the process 500 returns to block 530. Otherwise, the process 500 continues to block 540.

[0086] In block 540, the vehicle 101 proceeds to the destination. For example, the computer 105 may actuate vehicle 101 components (eg, propulsion components and navigation components) to drive and navigate the vehicle 101 to the destination.

[0087] In block 545, the computer 105 may determine that the vehicle 101 has arrived at the destination. The computer 105 may receive data 115, for example, from a navigation component, to determine that the vehicle 101 has arrived at the destination. If the vehicle 101 has arrived at the destination, the process 500 may continue to block 550. Otherwise, the process remains at block 545.

[0088] In block 550, the computer 105 actuates an output to the user device 150. For example, the computer 105 may send a message to the user device 150 via the network 125. Alternatively or additionally, the computer 105 may actuate a tactile device and / or a light and / or an audio prompt on the user device 150. As described above, the message may provide a reminder to the user to retrieve the object 160 from the storage bin 140.

[0089] Next, in block 555, the computer 105 may detect that the user has left the vehicle 101. As described above, the computer 105 may detect that the user has left the vehicle 101 by, for example, collecting data 115 from a user detection sensor 110 in a vehicle seat, arriving at a user's intended destination, collecting visual data 115 about the user, detecting a user device 150 outside the vehicle 101 cabin, shutting down the vehicle 101, etc. If the computer 105 detects that the user has left, the process 500 continues in block 560. Otherwise, the process 500 remains in block 555.

[0090] In block 560, the computer 105 may determine to retrieve the object 160 from the storage bin 140. As described above, the transceiver 145 may send a message to the computer 105 when the object 160 is removed from the storage bin 140. If the object 160 is removed from the storage bin 140, the computer 105 may actuate the storage bin 140 to the closed position and the process 500 ends. Otherwise, the process 500 returns to block 550 to remind the user to retrieve the object 160.

[0091] As used in this article, the adverb "substantially" modifying an adjective means that the shape, structure, measurement, value, calculation, etc. may deviate from the precisely described geometry, distance, measurement, value, calculation, etc. due to defects in materials, processing, manufacturing, data collector measurement, calculation, processing time, communication time, etc.

[0092] The computing devices 105 typically each include instructions that can be executed by one or more computers as shown above, and are used to perform the boxes and steps of the above-mentioned processes. Computer executable instructions can be compiled or interpreted from computer programs created using various programming languages ​​and / or technologies, which include but are not limited to separate or combined JavaTM, C, C++, Visual Basic, Java Script, Perl, HTML, etc. Typically, a processor (such as a microprocessor) receives instructions from a memory, a computer-readable medium, etc. and executes these instructions, thereby executing one or more processes including one or more of the processes described herein. Various computer-readable media can be used to store and transmit such instructions and other data. The files in the computing device 105 are typically a collection of data stored on a computer-readable medium such as a storage medium, a random access memory, etc.

[0093] Computer readable media include any media that participate in providing data (such as instructions) that can be read by a computer. Such media can take many forms including, but not limited to, non-volatile media, volatile media, etc. Non-volatile media include, for example, optical or magnetic disks and other permanent memories. Volatile media include, for example, dynamic random access memory (DRAM) that usually constitutes main memory. Common forms of computer readable media include, for example, floppy disks, floppy disks, hard disks, magnetic tapes, any other magnetic media, CD-ROMs (compact disc read-only memory), DVDs (digital video disks), any other optical media, punch cards, paper tapes, any other physical media with hole patterns, RAMs (random access memory), PROMs (programmable read-only memory), EPROMs (erasable programmable read-only memory), flash electrically erasable programmable read-only memory (FLASH-EEPROM), any other memory chips or memory boxes, or any other media from which a computer can read.

[0094] With respect to the media, processes, systems, methods, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be implemented with the described steps performed in an order different from that described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. For example, in process 500, one or more of the steps may be omitted, or may be performed in an order different from that described herein. Figure 5 The steps are performed in the order shown. In other words, the descriptions of systems and / or processes provided herein are for the purpose of illustrating certain embodiments and should not be construed as limitations on the disclosed subject matter.

[0095] Therefore, it should be understood that the present disclosure including the above description and the accompanying drawings and the following claims is intended to be illustrative rather than restrictive. After reading the above description, many embodiments and applications other than the provided embodiments will be apparent to those skilled in the art. The scope of the present invention should not be determined with reference to the above description, but with reference to the claims attached to the present disclosure and / or the claims included in the non-provisional patent application based on the present disclosure, and the full range of equivalents enjoyed by these claims to determine the scope of the present invention. It is expected and intended that future developments will appear in the technology discussed herein, and the disclosed systems and methods will be incorporated into future embodiments. In short, it should be understood that the subject matter of the present disclosure is capable of modification and variation.

[0096] Unless otherwise specified or the context requires otherwise, the articles "a" and "an" modifying a noun are to be understood as meaning one or more. The phrase "according to" includes a part or all of the basis.

Claims

1. A method for object detection, comprising: Identify objects within a specified distance of the vehicle and outside the vehicle via wireless protocols; assigning the identified object to a storage location in the vehicle; receiving, in a transceiver in the storage location, a transmission from a transmitter associated with the object to detect that the object is in the storage location; and A vehicle component is actuated upon detection of the object in the storage location. 2 . The method of claim 1 , further comprising identifying the object based on one or more of an identifier sent via the wireless protocol and an image provided by a vehicle image sensor.

3. The method of claim 2, wherein assigning the identified object to the storage location in the vehicle comprises: The characteristics of the object are compared to the characteristics of the storage location. The method of claim 1 , wherein the storage location is a storage bin.

5. The method of claim 4, wherein the storage box comprises an enclosed space formed by solid walls. The method of claim 5 , wherein one or more of the walls comprises a conductive layer.

7. The method of claim 4, further comprising receiving an acknowledgement of the transmission from the object transmitter from the transceiver in the storage bin.

8. The method of claim 1, wherein the vehicle component is one of a transmission, a drivetrain, a brake, and a steering.

9. The method of claim 1, wherein the wireless protocol is Bluetooth Low Energy (BLE).

10. The method of any one of claims 4-9, further comprising identifying the object based on one or more of an identifier sent via the wireless protocol and an image provided by a vehicle image sensor.

11. The method of any one of claims 2-3 and 8-9, wherein the location is a storage bin.

12. A computer programmed to perform the method of any one of claims 1 to 9.

13. A vehicle comprising the computer of claim 12.

14. A computer program product comprising a computer readable medium storing instructions executable by a computer processor to perform the method of any one of claims 1 to 9.

15. A system for object detection, comprising a computer, wherein the computer is programmed to: Identify objects within a specified distance of the vehicle and outside the vehicle through wireless protocols; assigning the identified object to a storage location in the vehicle; receiving, in a transceiver in the storage location, a transmission from a transmitter associated with the object to detect that the object is in the storage location; and A vehicle component is actuated upon detection of the object in the storage location.

Images