In-vehicle sensing modules for monitoring vehicles

Abstract

A sensing module for monitoring a cabin of a vehicle. It includes an environmental sensor configured to sense organic compounds in the ambient air of the cabin, and a particle sensor configured to detect particulate matter in the ambient air. The sensing module also includes a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the Internet. The sensing module has a housing configured to be mounted to a windshield of the vehicle. The housing supports the environmental sensor, the particle sensor, and the controller.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Patent Application Serial No. 62 / 952,618, entitled “In-Vehicle Sensing Module for Monitoring a Vehicle,” filed on December 23, 2019, U.S. Provisional Patent Application Serial No. 62 / 952,568, entitled “In-Vehicle Sensing Module for Monitoring a Vehicle,” filed on December 23, 2019, and U.S. Provisional Patent Application Serial No. 62 / 952,623, entitled “In-Vehicle Sensing Module Having Cloud Connectivity,” filed on December 23, 2019, the disclosures of which are incorporated herein by reference in their entireties.

[0003] This application is related to U.S. patent application serial number 17 / 116,133, filed on the same date hereof, and to U.S. patent application serial number 17 / 116,142, filed on the same date hereof, the disclosures of which are incorporated herein by reference in their entireties. Technical Field

[0004] The apparatus and methods disclosed herein relate to in-vehicle sensing, and more particularly to in-vehicle sensing modules. Background Art

[0005] Unless otherwise indicated herein, what is described in this section is not prior art to the claims in this application and is not admitted to be prior art by inclusion in this section.

[0006] In shared vehicle services, such as ride-sharing services, taxi services, and car rental services, shared vehicles are often driven by drivers or ridden by passengers who are not the vehicle owners. A common problem with such services is that customers may not care how the vehicle is treated during the short time they are a passenger or driver. In view of this, operators of such services often establish various rules or policies regarding how customers should treat the vehicle. However, modern forms of these services are technology-driven and often completely autonomous, requiring little or no direct interaction with the vehicle owner or service operator. Therefore, effectively enforcing these rules or policies can be challenging and sometimes costly. Therefore, it would be beneficial to provide a system that enables autonomous detection of problems within a vehicle, which minimizes the need for human intervention in enforcing the rules or policies and remediating violations. Summary of the Invention

[0007] In one embodiment, a sensing module for monitoring a vehicle's cabin includes an environmental sensor configured to sense organic compounds in the cabin's ambient air, and a particle sensor configured to detect particulate matter in the ambient air. The sensing module also includes a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit the data to a remote server via the internet. The sensing module includes a housing configured to be mounted to the vehicle's windshield. The housing supports the environmental sensor, the particle sensor, and the controller.

[0008] In another embodiment, a sensing module for monitoring a vehicle's cabin includes an environmental sensor configured to sense organic compounds in the ambient air of the cabin; a particle sensor configured to detect particulate matter in the ambient air, the particle sensor including an inlet; and a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the internet. The sensing module also includes a housing configured to be mounted to the vehicle's windshield. The housing defines an interior space within which the environmental sensor, the particle sensor, and the controller are supported, and the interior space has an inlet region from which the inlet of the particle sensor draws air. The inlet region is substantially isolated from the remainder of the interior space and has a volume that is less than 10% of the total volume of the interior space.

[0009] In yet another embodiment, a sensing module for monitoring a vehicle's cabin includes an environmental sensor configured to sense organic compounds in the cabin's ambient air; a particle sensor configured to detect particulate matter in the ambient air; and a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the Internet. A printed circuit board ("PCB") is supported in a housing and operably interconnects the controller, the environmental sensor, and the particle sensor. The controller and the environmental sensor are disposed on the PCB. Furthermore, the module includes at least one microphone disposed on the PCB and a housing configured to be mounted to the vehicle's windshield. The housing supports the environmental sensor, the particle sensor, the controller, and the PCB and includes at least one opening allocated to each microphone. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The foregoing aspects and other features of the in-vehicle sensing system are explained in the following description in conjunction with the accompanying drawings.

[0011] Figure 1 A simplified block diagram of a vehicle having an on-board sensing system including an on-board sensing module for monitoring the vehicle is shown.

[0012] Figure 2 Shown Figure 1 Exploded view of the vehicle sensing module.

[0013] Figure 3 Shown Figure 2 A photo of an on-board sensing module, which is arranged in the roof frame of the vehicle.

[0014] Figure 4 Shown by Figure 3 A photo captured by the vehicle's onboard sensing module, with the left-behind items marked with boxes.

[0015] Figure 5 Shown by Figure 3 A photo captured by the on-board sensing module of the vehicle, where the stain on the vehicle floor is marked with a square.

[0016] Figure 6 Shown by Figure 3 A photo captured by the vehicle's onboard sensing module, where debris on the vehicle floor and seats is marked with boxes.

[0017] Figure 7 An exploded view of another vehicle-mounted sensing module is shown.

[0018] Figure 8 Shown Figure 7 1 , a perspective view of an on-board sensing module with the housing cover shown as transparent and partially removed from the housing base.

[0019] Figure 9 Shown Figure 7 A top view of the vehicle sensing module with the housing cover removed and flipped over.

[0020] Figure 10 Shown Figure 7 A schematic diagram of the components of an on-board sensing module.

[0021] Figure 11 Shown Figure 7 A perspective view of the circuit board of the vehicle sensing module.

[0022] Figure 12 Shown is a vehicle mounted on a windshield Figure 7 Front view of the vehicle sensing module.

[0023] Figure 13 It shows the operation Figure 7 Process diagram of the method of the vehicle-mounted sensing module. DETAILED DESCRIPTION

[0024] To facilitate an understanding of the principles of the present disclosure, reference will now be made to the embodiments illustrated in the accompanying drawings and described in the following text. It should be understood that no limitation of the scope of the present disclosure is intended thereby. It should also be understood that the present disclosure encompasses any variations and modifications to the illustrated embodiments, and includes other applications of the principles of the present disclosure that would normally occur to one skilled in the art to which the present disclosure pertains.

[0025] System Overview

[0026] Figure 1 A simplified block diagram of a vehicle monitoring system 100 is shown having an onboard sensing system 104 for monitoring at least a cabin 108 of a vehicle 102. The vehicle monitoring system 100 is advantageously used in the context of a shared vehicle service, in which a shared vehicle 102 is driven or occupied by a driver who is not the owner of the shared vehicle 102. Such shared vehicle services may include, but are not limited to, car rental services, autonomous taxi services, or ride-sharing services. In many such shared vehicle services, customers can utilize the services of the shared vehicle service in an automated manner using a smartphone application, a website, an on-site kiosk, or the like, with little or no direct human intervention by the operator of the shared vehicle service.

[0027] The onboard sensing system 104 advantageously enables the operator of a shared vehicle to monitor the condition of the vehicle 102, enforce rules and policies, and provide additional benefits to customers with minimal human intervention. Such rules and policies may include a rule prohibiting smoking in the vehicle 102 or an additional fee for any required cleaning of the vehicle 102 after a customer's use. In addition, the operator may provide additional benefits to customers, such as a reminder of personal belongings left in the vehicle after the ride.

[0028] The onboard sensing system 104 includes an onboard sensing module 112 having one or more integrated sensors 116 configured to monitor at least the status of the cabin 108. In some embodiments, the onboard sensing system 104 also includes additional external sensors 120 and a gyroscope / accelerometer module 122 disposed on or throughout the vehicle 102, which are operably connected to the onboard sensing module 108 via one or more communication buses 124. In one embodiment, the onboard sensing module 112 and at least one integrated sensor 116 are integrated into a chassis and / or enclosure suitable for retrofitting to a specific make and model of vehicle 102. The sensors 116, 120 and algorithms (discussed below) used by the onboard sensing module 112 may also be specific to the specific make and model of vehicle 102. Alternatively, in some embodiments, the onboard sensing system 104 may be used in any desired vehicle, and the housing of the onboard sensing module 112 may be mounted on a surface within the cabin 108 of a shared vehicle 102, such as, for example, the dashboard or windshield.

[0029] In addition to the onboard sensing system 104, the vehicle 102 includes a vehicle electronic controller ("ECU") 128, a drive system 132, and a vehicle battery 136. In one embodiment, the vehicle ECU 128 is configured to operate the drive system 132 as well as various electronic devices of the vehicle, such as lights, locks, speakers, a display, etc. The vehicle ECU 128 can communicate with these various electronic devices and the drive system 132, as well as with the onboard sensing system 104, via one or more communication buses 124. In one embodiment, the vehicle ECU 128 communicates certain telemetry data, such as vehicle speed or direction of travel, to the onboard sensing module 112, and thus the vehicle ECU 128 can be considered one of the external sensors 120.

[0030] The drive system 132 of the vehicle 102 includes a drive motor, such as an internal combustion engine and / or one or more electric motors, that drives the wheels of the vehicle 102, and steering and braking components that enable the vehicle 102 to move in a controlled manner. The vehicle battery 136 is configured to provide operating power (e.g., via a 12V auxiliary power line 140, etc.) to the onboard sensing module 112, the external sensors 120, the gyroscope / accelerometer module 122, the vehicle ECU 128, and / or any other vehicle electronic devices of the vehicle 102.

[0031] Onboard sensing module 112 includes at least a processor, memory, and one or more integrated sensors 116 integrated into a common housing that is mounted within vehicle cabin 108. Onboard sensing module 112 is configured to monitor at least the status of vehicle cabin 108. Specifically, onboard sensing module 112 is configured to process sensor data received from sensors 116 and 120 to infer one or more qualities, conditions, or states of vehicle 102. For example, onboard sensing module 112 may detect whether vehicle 102 is empty, clean, damaged, affected by cigarette smoke or other unpleasant odors, and / or whether an object 102 has been left in vehicle 102. Onboard sensing module 112 utilizes appropriate algorithms, models (e.g., artificial neural networks), or thresholds to interpret the sensor data and enrich the data with metadata and event detection. As will be understood by those skilled in the art, the term "metadata" refers to any data that describes or provides information about other data (e.g., sensor data).

[0032] To this end, sensors 116, 120 may include a variety of sensors, including, for example, cameras, microphones, gyroscopes, accelerometers, smoke detectors or other air quality / particulate matter sensors, temperature sensors, and / or humidity sensors, depending on the specific quality, condition, or state of vehicle 102 to be monitored. Gyroscope / accelerometer module 122 may include, for example, a microphone, gyroscope, and accelerometer integrated into a single housing secured to the vehicle chassis.

[0033] The onboard sensing module 112 is configured to upload relevant sensor data, event data, or other metadata to a cloud storage backend 150 via a cellular internet connection for storage therein. The data uploaded to the cloud storage backend 150 is accessible to a third-party cloud backend 160. For example, the third-party backend 160 is associated with the shared vehicle services discussed above, such as car rental services, autonomous taxi services, or ride-sharing services. In this way, operators of shared vehicle services can monitor the condition of shared vehicles 102, enforce rules and policies, and provide additional benefits to customers with minimal human intervention.

[0034] In-vehicle sensing module with integrated camera

[0035] Figure 2 An exploded view of one embodiment of an in-vehicle sensing module 112 configured for installation in a roof console of a vehicle is depicted. The in-vehicle sensing module 112 includes a heat sink 200, a system-on-module (SoM) 204, a module printed circuit board (PCB) 208, a camera 212, a particle sensor 216, a plurality of LED arrangements 220, and a lower housing 224.

[0036] Heat sink 200 is formed from a thermally conductive material (e.g., aluminum alloy) and includes vents configured to allow air to flow away from the electronic components. Additionally, heat sink 200 includes a plurality of fins that dissipate heat from the electronic components. Heat sink 200 defines a plurality of holes or recesses in its sides that provide access to the connection terminals of module PCB 208 for connection to other components in vehicle sensing module 112.

[0037] SoM 204 includes several components on one or more discrete modules or printed circuit boards. In the illustrated embodiment, SoM 204 is configured as a single printed circuit board with several components arranged thereon. In particular, SoM 204 includes at least a controller or control electronics having a processor and associated memory. Those skilled in the art will recognize that a "processor" encompasses any hardware system, hardware mechanism, or hardware component that processes data, signals, or other information. A processor may include a system with a central processing unit, a graphics processing unit, a multi-processing unit, dedicated circuitry for implementing functionality, programmable logic, or other processing systems. Memory may be any type of device capable of storing information accessible by a processor, such as a memory card, ROM, RAM, a hard drive, a magnetic disk, flash memory, or any other computer-readable medium that functions as a data storage device, as will be appreciated by those skilled in the art. The memory is configured to store program instructions, as described below, which, when executed by the processor, enable the onboard sensing module 112 to perform various operations, including monitoring the cabin 108 of the shared vehicle 102.

[0038] The SoM 204 may also include one or more sensors 116 integrated directly thereon. The SoM 204 may include, for example, at least one temperature and / or humidity sensor, and a microphone integrated onto a printed circuit board. In further embodiments, the SoM 204 may also include an accelerometer, a gyroscope, a transceiver, and / or other sensors and electronic components.

[0039] The SoM 204 is disposed on and electrically connected to a module printed circuit board (PCB) 208. The module PCB 208 is operably connected to the vehicle battery 136 to receive power from the vehicle battery 136. The module PCB 208 also includes power electronics that convert the received power (e.g., 12V power) to a lower voltage (e.g., 3V) to power the components in the onboard sensing module 112. The module PCB 208 is configured as a compact board to enable the onboard sensing module 112 to have a smaller footprint. In one embodiment, the module PCB 208 has a width between approximately 5 inches and approximately 7 inches and a length between approximately 1.5 inches and approximately 2.5 inches. In another specific embodiment, the module PCB 208 is approximately 6 inches wide and approximately 2 inches long.

[0040] Furthermore, the module PCB 208 includes interfaces, connectors, and / or connectors for communicating with sensors included within or integrated within the onboard sensing module 112, such as, for example, the camera 212 and the particle sensor 216. Furthermore, the module PCB 208 has interfaces, connectors, and / or connectors for communicating with additional sensors, such as the external sensor packages discussed below, which are located elsewhere in the vehicle 102 outside the enclosure of the onboard sensing module 112. The interfaces, connectors, and / or connectors can be connected to a variety of communication buses, which can take the form of, for example, one or more I²C (Inter-Integrated Circuit) buses, I²S (Inter-Integrated Circuit Sound) buses, USB (Universal Serial Bus) buses, and / or CAN (Controller Area Network) buses. Accordingly, the module PCB 208 can include a suitable bus controller for communicating with the sensors via the communication bus.

[0041] Module PCB 208 also includes one or more radio transceivers, including at least one wireless telephone transceiver 232 configured to communicate with the Internet via a wireless telephone network, such as, for example, a Global System for Mobile Communications ("GSM"), Code Division Multiple Access ("CDMA"), and / or Long Term Evolution ("LTE") network. Additionally, the radio transceiver of module PCB 208 may also include a Bluetooth® or Wi-Fi transceiver configured to communicate locally with a smartphone or other smart device owned by a passenger or driver using vehicle 102, or with an external sensor package. The radio transceiver of module PCB 208 may include a corresponding antenna, as well as any processor, memory, oscillator, or other hardware conventionally included with a radio communication module. In the illustrated embodiment, the wireless telephone transceiver is operably connected to two flexible antennas 236 and 240 via module PCB 208. For example, antennas 236, 240 may be 4G broadband antennas configured to receive and transmit at frequencies between approximately 698 MHz and 3 GHz, although the reader will appreciate that other desired antennas may be used in other embodiments.

[0042] The module PCB 208 may also include additional sensors and electronic components. Furthermore, the reader should understand that any or all sensors and electronic components described as being included on the module PCB 208 may alternatively be disposed on the SoM 204. Similarly, any or all sensors and electronic components described as being included on the SoM 204 may alternatively be disposed on the module PCB 208.

[0043] The camera 212 of the onboard sensing module 112 is mounted on a camera PCB 248 that is operatively connected to the module PCB 208 for communication with the SoM 204 via, for example, a ribbon cable 252. The camera 212 also includes a camera lens 256 ( Figure 3 ), the camera lens 256 is directed through a lens opening 260 in the lower housing 224 and is configured to capture images of the vehicle cabin 108. The camera 212 includes an image sensor, such as a CCD (charge coupled device) or a CMOS (complementary metal oxide semiconductor), which is configured to capture images at optical wavelengths and / or infrared wavelengths.

[0044] Return Reference Figure 2The particle sensor 216 of the onboard sensing module 112 is disposed below the module PCB 208 and is mounted to the lower housing 224 by a sensor cover 268. Furthermore, the particle sensor 216 is operatively connected to the module PCB 208 via a particle sensor connector 272 (e.g., a ribbon cable) to receive power from the module PCB 208 and to communicate with the SoM 204 via the module PCB 208. The particle sensor 216 includes an air intake opening 276 that aligns with a particle sensor opening 280 defined in the lower housing 224 to allow ambient air in the cabin 108 to pass directly into the particle sensor 216. As discussed below, the particle sensor 216 is configured to sense the concentration of particulate matter in the ambient air and transmit an electrical signal corresponding to the detected particulate matter concentration to the SoM 204, which determines whether smoke or moisture is present in the cabin 108.

[0045] The onboard sensing module 112 of the illustrated embodiment has two LED arrangements 220, one positioned on each side of the camera 212. Each LED arrangement 220 includes two LEDs 288, an LED board 292, and an LED cover 296 that mounts the LED board 292 and LEDs 288 to the lower housing 224. The LED board 292 is operably connected to the module PCB 208 to receive power from the module PCB 208 and to communicate with the SoM 204 via the module LEDs 208. Each LED 288 is arranged to project light through an LED opening 300 defined in the lower housing 224. The LEDs 288 can be configured to project white light, infrared light, or light having another suitable wavelength into the cabin 108 of the vehicle 102. In one particular embodiment, one LED 288 of the LED arrangement 220 generates white light, while the other LED 288 generates infrared light.

[0046] The LEDs 288 are operated by a processor in the SoM 204 to illuminate the cabin 108 of the vehicle 102 so that the camera 212 can capture images of sufficient quality. Additionally, the LEDs 288 of the LED arrangement 220 can be arranged in a common plane on the lower surface of the lower housing 224 so that the light generated by the LEDs 288 can evenly illuminate the cabin 108.

[0047] The module PCB 208 is connected to the SoM 204 and the heat sink 200 via a plurality of fasteners 304, each of which extends upward through the module PCB 208, a corresponding spacer 308, the SoM 204, and into a threaded opening (not shown) in the heat sink 200. Thus, the heat sink 200, the SoM 204, and the module PCB 208 are configured as a self-contained unit. The self-contained unit of the heat sink 200, the SoM 204, and the module PCB 208 is secured to the lower housing 224 via a plurality of fasteners 312, which extend downward through corresponding openings in the heat sink 200 and the module PCB 208 and into threaded openings in the lower housing 224.

[0048] The camera 212 is secured to the lower housing 224 by a plurality of fasteners 316 that pass downwardly through the camera PCB 248 and into corresponding threaded openings in the lower housing 224. Similarly, the particle sensor 216 is mounted to the lower housing 224 by a plurality of fasteners 320 that pass through the particle sensor cover 268 and into corresponding threaded openings in the lower housing 224 to sandwich the particle sensor 216 between the particle sensor cover 268 and the lower housing 224. Each LED arrangement 220 is similarly mounted to the lower housing 224 by a plurality of fasteners 324 that pass through the LED cover 296 and LED board 292 into corresponding threaded openings in the lower housing 224 to sandwich the corresponding LED board 292 and LEDs 288 between the LED cover 296 and the lower housing 224.

[0049] Thus, the camera 212, particle sensor 216, and LED arrangement 220 are mounted to the lower housing 224 as a self-contained unit separate from the heat sink 200, SoM 204, and module PCB 208. In other words, the fasteners 316, 320, 324 that secure the camera 212, particle sensor 216, and LED arrangement 220 to the lower housing 224 do not interact with the heat sink 200, SoM 204, or module PCB 208. Similarly, the fasteners 312 that secure the heat sink 200, SoM 204, or module PCB 208 to the lower housing 224 do not interact with the camera 212, particle sensor 216, or LED arrangement 220. Thus, the heat sink 200, SoM 204, and module PCB 208 are arranged so as to be physically separated from the camera 212, particle sensor 216, and LED arrangement 220. Thus, heat generated by the electronic components in the module PCB 208 and the SoM 204 is not conducted downward into the camera 212, the particle sensor 216, or the LED arrangement 220, but instead is conducted upward through the heat sink 200 and out the top of the on-board sensing arrangement 112. Thus, the on-board sensing arrangement 112 provides effective thermal management to prevent or minimize overheating of components in the on-board sensing arrangement 112.

[0050] As in Figure 2 and Figure 3 As seen in FIG, the vehicle sensing module 112 is configured as a self-contained package. Therefore, the vehicle sensing module 112 can be easily installed as a retrofit in existing vehicles. The lower housing 224 can be modified to facilitate assembly in different vehicles, and the configuration of the heat sink 200, SoM 204, module PCB 208, camera 212, particle sensor 216, and LED arrangement 220 can be the same in different configurations of the lower housing 224.

[0051] like Figure 3 As depicted in FIG, in one particular embodiment, the onboard sensing module 112 is configured to be received in a receiver 340 in a roof bezel 344 of the vehicle 102. More specifically, the onboard sensing module 112 may be disposed behind a rearview mirror 348, and the receiver 340 may be a sunglass holder. Since many vehicles have sunglass holders in the roof bezel 344, the onboard sensing module 112 may be readily adaptable to a variety of different vehicles with minimal modification to the placement of the onboard sensing module 112 or the vehicle 102. For example, Figure 3 As shown in , the in-vehicle sensing module 112 may be configured such that the lower housing 224 aesthetically matches the roof frame 344 of the vehicle 102 .

[0052] In addition, if Figures 4 to 6As seen in FIG, by mounting the onboard sensing module 112 behind the rearview mirror 348, the camera 212 has a direct field of view of the floor and seats in the cabin 108 of the vehicle 102. Thus, the onboard sensing module 112 enables adequate visual coverage of the vehicle to be obtained with only one camera 212.

[0053] In addition, Figure 2 and Figure 3 In the configuration of the in-vehicle sensing module 112 shown in FIG, the particulate sensor opening 280 is positioned in the front portion of the lower housing 224 relative to the vehicle. Thus, as viewed from a passenger's perspective, the particulate sensor opening 280 is located behind the main portion, or lowered portion, of the lower housing 224. Consequently, the particulate sensor opening 280 is generally obscured from view by passengers of the vehicle 102. Consequently, passengers are less likely to be aware of the location of the particulate sensor opening 280 and, therefore, less likely to tamper with the particulate sensor opening 280 in an attempt to avoid detection of smoke or moisture in the cabin 108.

[0054] Furthermore, because air intake opening 276 of particulate sensor 216 is aligned with particulate sensor opening 280 of lower housing 224, ambient air may pass directly from cabin 108 into air intake opening 276. Thus, ambient air does not diffuse through the interior of lower housing 224 where it may be diluted or heated by components within lower housing 224.

[0055] As described above, the onboard sensing module 112 can be connected to sensors located outside the enclosure of the onboard sensing module 112. As an example, the gyroscope / accelerometer module 122 can be attached to the chassis of the vehicle 102 to provide improved sensitivity to minor damage to the vehicle 102. In one embodiment, the gyroscope / accelerometer module 122 also includes an additional microphone separate from the microphone in the SoM 204. The gyroscope / accelerometer module 122 can be operably connected to the onboard sensing module 112 via a cable or wired connection, or the gyroscope / accelerometer module 122 can be operably connected to the onboard sensing module 112 via known wireless connection methods.

[0056] In some embodiments, the onboard sensing module 112 may further include various indicator lights, user interfaces, speakers, etc. for locally transmitting information to or receiving information from the occupants of the vehicle.

[0057] Operation of an in-vehicle sensing system with a camera

[0058] In some embodiments, Figure 2-3The onboard sensing module 112 is configured to detect whether an occupant is smoking within the cabin 108 of the vehicle 102 based on sensor data received from a smoke detector or other air quality / particulate matter sensor, which may be provided and / or accessed at a predetermined rate (e.g., once per second). In one embodiment, the onboard sensing module 112 executes a smoke detection algorithm to monitor a profile of particulate matter concentration over time, such as detected by the particulate matter sensor 216, and compares the monitored particulate matter concentration to reference data. In the event of a smoke detection event, the onboard sensing module 112 may also operate the camera 212 to capture a photograph of the cabin 108 of the vehicle 102 and / or generate an audible alarm in the vehicle.

[0059] Furthermore, some embodiments of the onboard sensing module 112 are configured to detect whether damage has occurred to the vehicle 102, and in particular, to the body of the vehicle 102, during travel based on sensor data received from a gyroscope, accelerometer, vibration sensor, and / or microphone (e.g., received from the gyroscope / accelerometer module 122). In one embodiment, the onboard sensing module 112 executes a suitable learning algorithm (artificial neural network) to collect and analyze the sensor data to detect minor damage that has occurred. In one embodiment, based on the sensor data received from the sensors, the onboard sensing module 112 detects the location of the damage on the vehicle (e.g., the left front) and classifies the level of damage (e.g., severe or minor) based on the data received from the sensors.

[0060] In some embodiments, the onboard sensing module 112 is configured to detect whether an occupant of the vehicle has left behind an item, such as a phone, keys, or glasses. In one embodiment, after the ride is over and the user has exited the car, the onboard sensing module 112 operates the LEDs 288 to illuminate the cabin 108 and operates the camera 212 to capture a sample photo. The onboard sensing module 112 then executes appropriate algorithms to analyze the sample photo and determine optimized parameters (e.g., exposure, gain, gamma, etc.) for subsequent photos. Next, the onboard sensing module 112 operates the LEDs 288 and the camera 212 using the determined parameters to capture a set of photos to obtain the best results, and forms a high dynamic range (HDR) photo using the set of photos. The onboard sensing module 112 executes appropriate algorithms to analyze the HDR photo to detect lost or left items in the vehicle 102. The onboard sensing module 112 marks the lost or left item in the HDR photo, such as with a box (e.g., Figure 4 ), and also lists the items in the metadata. In one embodiment, the onboard sensing module 112 distinguishes and categorizes lost or left-behind items and includes these categorizations in the metadata. In this way, if a lost or left-behind item is detected, the user can be immediately notified. Furthermore, the operator can analyze the HDR photo and make corrections if any questions arise.

[0061] In some embodiments, the vehicle sensing module 112 is configured to detect whether the cabin 108 of the vehicle is clean or dirty. Dirt can take several forms, including dust, different types of soil, or even debris, scattered debris or residue. Common examples include sand or grass on the floor of the cabin 108 (e.g., Figure 5 ), as well as debris or other debris on the floor or seats of the cabin 108 (such as Figure 6 In one embodiment, as described above, the onboard sensing module 112 operates the LEDs 288 to illuminate the cabin 108 and operates the camera 212 to capture a sample photo and then an HDR photo for detecting lost or left behind items. The onboard sensing module 112 executes an appropriate algorithm to analyze the HDR photo to detect dirt or debris in the vehicle 102. The onboard sensing module 112 marks the dirt or debris in the HDR photo, such as with a box (e.g., Figure 5 and Figure 6 ), and lists the stain or debris in the metadata. In one embodiment, the onboard sensing module 112 categorizes the detected stain or debris (e.g., removable / immovable, trash, hazardous materials, liquids, etc.) and includes this classification in the metadata. This allows the operator to be immediately notified of any dirty vehicle conditions and decide how to proceed (e.g., whether the vehicle requires cleaning, repairs, etc.). Furthermore, the operator can analyze the HDR photo and make corrections if any questions arise.

[0062] In at least one embodiment, the onboard sensing module 112 is configured to transmit sensor data and processed results to a remote server backend. Specifically, the onboard sensing module 112 operates one or more of its transceivers (e.g., the wireless phone transceiver 232) to transmit raw sensor data, enriched or annotated sensor data, and / or detected event data, along with associated photos, to the remote server backend. In one embodiment, the remote server backend is associated with or accessible to the operator of the shared vehicle service for which the vehicle 102 is used. This allows the operator to evaluate the data and events on the backend and respond appropriately. Alternatively, the remote server backend may be associated with the OEM of the vehicle 102 or with some other interested party.

[0063] In-vehicle sensing system with environmental sensors

[0064] exist Figures 7 to 12 Another embodiment of the vehicle-mounted sensing module 400 is depicted in FIG. Figures 7 to 12The vehicle-mounted sensing module 400 replaces the vehicle-mounted sensing module 112 described above. However, the vehicle-mounted sensing module 400 is configured without a camera, so that the vehicle-mounted sensing module 400 can be compact and easily mounted on the vehicle windshield without blocking the driver's field of view.

[0065] The vehicle sensing module 400 includes a housing 404 that supports a PCB 408, a particle sensor 412, and a flexible antenna 416. The housing 404 includes a base 420 and a cover 424 (in the embodiment of FIG. 404 ) that together define an interior space 426. Figure 7-9 ), PCB 408 and particle sensor 412 are disposed within this interior space 426. Base 420 and cover 424 may be formed as plastic injection molded parts, although the reader will appreciate that base 420 and cover 424 may be formed from any desired material.

[0066] The base 420 has a sidewall 428 that extends around a portion of the outer perimeter of the base 420 to at least partially define the interior space 426. The base 420 also defines a plurality of protrusions that are used to assist in positioning and mounting the various components disposed within the interior space 426. One of the protrusions is configured as a divider 430 that, as will be discussed in further detail below, separates an inlet region 454 from which the particulate sensor 412 collects air from the remainder of the interior space 426.

[0067] The interior space 426 is substantially enclosed by the housing 404 to reduce the flow of air and any other contaminants into and out of the interior space 426. In one particular embodiment, air exchange into and out of the interior space 426 is enabled only through a plurality of groups of openings 432, 434, 436, and 438. Two of the groups of openings 432 and 434 open into the interiors of respective cylindrical protrusions 440 and 442 that protrude from the top of the cover 424 into the interior space 426. In particular, as will be discussed in detail below, the openings 432 and 434 provide a substantially uninterrupted path for sound waves to propagate from the cabin 108 to the microphone 580 disposed on the PCB 408.

[0068] The additional set of openings 436 allows ambient air to be drawn into the inlet 450 of the particle sensor 412, while the set of openings 438 enables air to be exhausted from the outlet 456 of the particle sensor 412 and enables air in the remainder of the interior space 426 to exit the interior space 426. Additionally, the cover 424 includes two dividers 444, 446 extending into the interior space 426 between the openings 436, 438. The two dividers 444, 446 cooperate with the divider 430 of the base 420 to substantially or completely isolate the openings 436, 438 from each other within the interior space 426 and to substantially or completely isolate the inlet region 454 from the remainder of the interior space 426. As used herein, substantially isolated means that there is no connection between the inlet region 454 and the remainder of the interior space 426, or between the openings 436, 438, having a nominal area perpendicular to the airflow greater than 10 mm. 2 In some embodiments, there is no gap connecting the inlet region 454 and the rest of the interior space with a nominal area perpendicular to the airflow greater than 5 mm. 2 In other embodiments, there is no gap greater than 3mm 2 The area of ​​the gap.

[0069] The cover 424 also includes sidewalls 448 that extend entirely around the cover 424 circumferentially so as to enclose the interior space 426. The sidewalls 448 surround the sidewalls 428 of the base 420 with the flexible antenna 416 interposed between the two sidewalls 428, 448. In the illustrated embodiment, the flexible antenna 416 extends entirely around two sides of the sidewalls 448 and partially around the other two sides of the sidewalls 448.

[0070] As in Figure 8 As best seen in FIG, particle sensor 412 has an inlet 450 and an outlet 452 disposed on the same side of particle sensor 412. Inlet 450 and outlet 452 are both disposed on a side of the particle sensor adjacent sidewall 448 such that only a relatively small volume of air exists between inlet 450 and outlet 452 and sidewall 448. Particle sensor 412 has a fan configured to generate an airflow that draws air into inlet region 454 and into inlet 450 of particle sensor 412.

[0071] In the illustrated embodiment, inlet region 454 encompasses a relatively small portion of interior space 426. Specifically, in one embodiment, the volume of inlet region 454 is less than 10% of the total volume of interior space 426. In other embodiments, the volume of inlet region 454 is less than 5%, less than 3%, or less than 2% of the total volume of interior space 426. Because the inlet region is relatively small compared to the total volume of interior space 426, air drawn into inlet region 454 has a small volume, and once drawn into inlet region 454, the air diffuses within this small volume. Consequently, the majority of the air drawn into inlet region 454 travels directly from opening 436 to inlet 450 of particulate sensor 412. Thus, in-vehicle sensing module 400 enables accurate sensing of particulate matter in the air of vehicle cabin 108.

[0072] Particle sensor 412 is configured to sense the concentration of particulate matter in the ambient air of cabin 108. In particular, particle sensor 412 is configured to detect at least particulate matter of a size or mass associated with smoke (and particularly tobacco and / or marijuana smoke), but may also detect particulate matter associated with other airborne particles or water vapor. Particle sensor 412 processes air received at inlet 450 to analyze the air for the presence and size of particulates and then discharges the air through outlet 452 into outlet region 456. The air discharged into outlet region 456 diffuses through interior space 426 and exits housing 404 via opening 438.

[0073] Now refer to Figure 10 and 11 , PCB 408 supports and electrically interconnects a plurality of electrical components, including at least a controller 460, an inertial measurement unit ("IMU") sensor 464, and an environmental sensor 468. The IMU sensor 464 includes one or more gyroscope sensors and one or more accelerometers. In a particular embodiment, the IMU sensor 464 may be a 6-axis sensor having a 3-axis gyroscope and a 3-axis accelerometer. The IMU sensor 464 is operably connected to the controller 460 to transmit information sensed by the IMU sensor 464 indicating the speed and movement of the onboard sensing module 400. The information sensed by the IMU sensor 464 is used by the controller 460 to determine whether the vehicle has been involved in a collision and the severity of any detected collision event.

[0074] The environmental sensor 468 is configured to analyze the air within the interior space 426 to determine one or more properties of the air in the vehicle cabin 108. In one particular embodiment, the environmental sensor 468 is configured to detect properties indicative of the quality of the air in the cabin, such as relative humidity, barometric pressure, temperature, and the presence of organic compounds, more particularly, the presence of volatile organic compounds (VOCs). Thus, the environmental sensor 236 includes a plurality of separate sensors integrated into a single package. However, it should be understood that separate discrete sensors may alternatively be provided, including a VOC sensor, a humidity sensor, a barometric pressure sensor, and a temperature sensor. The environmental sensor 468 is operably connected to the controller 460 so as to be monitored, for example, via I 2 C connection, transmits a signal indicative of the sensed parameter to the controller 460.

[0075] Controller 460 includes at least a processor 480 and associated memory 484. As described above, those skilled in the art will recognize that a "processor" includes any hardware system, hardware mechanism, or hardware component that processes data, signals, or other information. Thus, processor 480 may include a system with a central processing unit, a graphics processing unit, a multi-processing unit, dedicated circuitry for implementing functionality, programmable logic, or other processing systems. Memory 484 may be any type of device capable of storing information accessible by a processor, such as a flash memory card, ROM, RAM, a hard drive, a magnetic disk, or any other computer-readable medium that functions as a volatile or non-volatile data storage device, as will be recognized by those skilled in the art. Memory 484 is configured to store program instructions that, when executed by processor 480, enable onboard sensing module 400 to perform various operations, including monitoring the cabin 108 of shared vehicle 102, as described below.

[0076] In the illustrated embodiment, controller 460 takes the form of an Internet of Things (IoT) controller 460, which has integrated features and functionality exceeding those of a general-purpose multi-function controller. Thus, in the illustrated embodiment, IoT controller 460 is configured as a system-on-chip (SoC) that is disposed on PCB 408. Alternatively, IoT controller 460 may equally be configured as a system-on-module (SoM), with its subcomponents disposed on at least one separate PCB connected to PCB 408 by cables and / or modular connectors. In any case, IoT controller 460 includes integrated features and functionality exceeding those of processor 480 and memory 484.

[0077] In the illustrated embodiment, the IoT controller 460 also includes a radio communication module, which in the illustrated embodiment is a cellular telephone modem 488, which is operably connected to an antenna connector 496 on the PCB 408. The antenna connector 496 is connected to a flexible antenna 416, which is configured to improve cellular reception of the onboard sensing module 400. The cellular telephone modem 488 is configured to communicate with the antenna 416 to communicate with the Internet via a wireless telephone network, such as, for example, a GSM, Code CDMA, and / or LTE network. The reader should understand that although the illustrated embodiment depicts the cellular telephone modem 488 as being integrated with the controller 460, in other embodiments, the cellular telephone modem 488 may be disposed on the PCB 408 separately from the controller 460.

[0078] PCB 408 also includes a subscriber identity module ("SIM") card receiver 512 that is configured to receive a SIM card 516. SIM card receiver 512 is operatively connected to controller 460, and more specifically, to cellular telephone modem 488, to provide identification information to enable cellular telephone modem 488 to access a wireless telephone network, as is generally known in the art.

[0079] In some embodiments, the IoT controller 460 advantageously provides integrated Global Navigation Satellite System (GNSS) functionality. To this end, the IoT controller 460 includes a GNSS receiver and any other processors, memory, oscillators, or other hardware conventionally included in a GNSS module 492. The GNSS receiver is configured to receive signals from GNSS satellites, from which location data can be determined. The GNSS receiver can, for example, be configured to support one or more of GPS, GLONASS, BeiDou, and Galileo, or any other GNSS. The GNSS receiver is connected to a GNSS antenna 500 to enable reception of GNSS signals. In the illustrated embodiment, the GNSS antenna 500 is disposed in or on the PCB 408, but alternatively, it may be disposed separately within or outside the housing 404. It should be understood that in alternative embodiments, a separate GNSS module may be provided on the PCB 408, separate from the controller 460.

[0080] In some embodiments (not shown), the IoT controller 460 may also include an integrated Bluetooth® and / or Wi-Fi® transceiver configured to communicate locally with smartphones or other smart devices owned by passengers or drivers using the shared vehicle 102. Similarly, in some embodiments, a discrete Bluetooth® and / or Wi-Fi® transceiver may be provided on the PCB 408, separate from the controller 460.

[0081] In some embodiments, the IoT controller 460 advantageously includes a variety of integrated data / peripheral interfaces for operatively connecting to various additional components of the vehicle sensing module 400, including general purpose input / output (GPIO), serial peripheral interface (SPI), inter-integrated circuit (IC) and other components. 2 C or I2C), integrated circuit built-in audio (I 2 S or I2S), secure digital input output (SDIO), universal serial bus (USB), high-speed inter-chip USB (HSIC), and universal asynchronous receiver and transmitter (UART). In this way, the IoT controller 460 provides easy compatibility with a variety of external sensors that may be available within the shared vehicle 102, and provides compatibility with a variety of configurations of integrated sensors.

[0082] Additionally, PCB 408 may include a removable storage media holder 520, such as a Secure Digital ("SD") card reader, configured to receive and communicate with a removable memory storage device 524, such as a Secure Digital (SD), SD High Capacity (SDHC), or SD Extended Capacity (SDXC) memory card, or any equivalent type of removable memory card or other non-volatile memory technology. Removable storage media holder 520 may be connected to controller 460, such as via an SDIO interface. Controller 460 may be configured to write metadata from the processing of sensor data to removable memory storage device 524 and to read instructions, program code, or other information from removable memory storage device 524.

[0083] Additionally, in some embodiments, the PCB 408 may further include an external device connector 528 connected to the controller 460. The external device connector 528 enables an external computing device (such as a diagnostic tool) to be temporarily connected to the vehicle sensing module 400 to read or receive data from the vehicle sensing module 400. The external device connector 528 may be configured to enable wired communication between the controller 460 and the external computing device, and may take the form of a USB connector (e.g., USB-A, USB-C, micro USB, etc.).

[0084] Furthermore, PCB 408 includes an input / output ("I / O") connector 540 that connects to an external cable 544. The external cable 544 connects to I / O connector 540 and exits housing 404 via an opening 546 defined in housing 404. In one embodiment, external cable 544 includes a grommet 545 disposed at opening 546. The grommet 545 is configured to attach external cable 544 to housing 404 at opening 546 to provide strain relief. External cable 268 is configured to connect to one or more vehicle interfaces, buses, or systems (including at least power cable 140) of shared vehicle 102 via one or more wiring harnesses or equivalents to receive vehicle battery voltage 547 (e.g., 12V) from vehicle battery 136. Additionally, in at least some embodiments, external cable 544 is configured to connect to one or more communication buses 124 to receive data from external sensors and / or vehicle ECU 128. In one particular embodiment, external cable 544 connects to the roof console box of vehicle 102. The reader should understand that in some embodiments, the PCB includes or is operably connected to a dedicated battery that replaces the external cable 544 or serves as an auxiliary power source if power from the vehicle is interrupted.

[0085] The I / O connector 540 is operably connected to a power circuit 548 of the PCB 408, which is configured to convert power from the vehicle battery 136 into a suitable voltage for powering the controller 460 and other components of the on-board sensing. The power circuit 548 also includes a low-power mode circuit 552, which is configured to power only a selected subset of components of the on-board sensing module 400 in a low-power mode to avoid draining the vehicle battery 136 when the vehicle is turned off.

[0086] PCB 408 also includes an ignition sensing circuit 556, which is operably connected to I / O connector 540 and to controller 460. Ignition sensing circuit 556 is configured to monitor the input voltage provided by vehicle battery 136 to determine when the ignition of vehicle 102 has been activated. Ignition sensing circuit 556 then transmits an ignition signal to controller 460. As will be discussed further below, in at least some embodiments, onboard sensing module 400 switches from a low-power mode to an active state in response to the ignition signal. In other words, the ignition signal can serve as a wake-up signal for controller 460.

[0087] PCB 408 also includes a battery monitoring circuit 560, which is operably connected to controller 460 and I / O connector 540 and functions to monitor the status of the vehicle battery. For example, battery monitoring circuit 560 can be configured to monitor the voltage and current provided to vehicle sensing module 400. In some embodiments, the power state of vehicle sensing module 400 (e.g., off, on, low-power mode, active mode) is controlled or changed by controller 460 based on the voltage and current sensed by battery monitoring circuit 560.

[0088] PCB 408 also includes at least one microphone 580 operatively connected to controller 460. Each microphone 580 comprises any desired type of acoustic sensor configured to record sounds within cockpit 108. In one particular embodiment, each microphone 240 takes the form of a microelectromechanical system (MEMS) microphone mounted directly on PCB 208.

[0089] In the illustrated embodiment, PCB 408 includes two microphones 580 spaced apart from one another to record stereo audio in cabin 108. Each microphone 480 is surrounded by an acoustic sealing gasket 584, one end of which seals against PCB 408. The inner circumferential surface of each acoustic sealing gasket 584 seals against an associated one of the cylindrical protrusions 440, 442 on the interior side of housing cover 420. Thus, acoustic sealing gasket 584 acoustically isolates the volume in which microphone 580 is arranged, thereby reducing interference in the sound transmitted through openings 432, 434 and detected by microphone 580.

[0090] In some embodiments, the vehicle sensing module 400 includes an indicator light (eg, LED) 592 mounted on the PCB 408 or on the housing 404. The indicator light 592 is arranged to be visible through an opening 596 of the cover 424 and is configured to illuminate to indicate an operational status of the vehicle sensing module 400.

[0091] exist Figure 9 and 10 As seen, PCB 408 also supports particle sensor connector 600, which is operatively connected to controller 460 via electrical connections in PCB 408. Particle sensor connector 600 enables data to be transferred between controller 460 and particle sensor 412, and enables power circuitry to supply power to particle sensor 412.

[0092] In some embodiments, the PCB further includes a camera trigger circuit 608. The controller 460 is configured to operate the camera trigger circuit 608 to activate an external camera 612 disposed within the shared vehicle and configured to capture images of the cabin 108, so as to capture one or more photos within the vehicle cabin in the manner described above. The controller 460 is configured to receive the captured images from the external camera 612 via the camera trigger circuit 608 or via another data connection.

[0093] In the illustrated embodiment, as in Figure 12 As seen in FIG, the onboard sensing module 400 is configured to be mounted on the windshield 640 of the vehicle 102. Accordingly, the onboard sensing module 400 includes a double-sided adhesive pad 520 configured to secure the back side of the housing base 420 (i.e., the side opposite the interior space 426) to the vehicle's windshield 640. In some embodiments, the onboard sensing module 400 is configured to be secured to the windshield 640 on the side of the rearview mirror 644 opposite the driver's side (i.e., to the right of the rearview mirror 644 in a left-hand drive vehicle). The onboard sensing module 400 can be positioned between approximately 25 mm and 75 mm, or more specifically, approximately 50 mm, from the top of the windshield 640, and between 25 mm and 75 mm, or more specifically, approximately 50 mm, from the rearview mirror 644 or the external sensing module 648. This position allows the power cable 544 to be easily routed to the roof console frame 652 without obstructing the driver's view.

[0094] Operation of vehicle sensing modules with environmental sensors

[0095] Various methods and processes for operating the onboard sensing module 400 are described below. In these descriptions, statements that a method, processor, and / or system performs some task or function refer to a controller or processor (e.g., the controller 460 of the onboard sensing module 400) executing programmed instructions stored in a non-transitory computer-readable storage medium (e.g., the memory 484 of the controller 460 of the onboard sensing module 400 or the removable memory storage device 524) operatively connected to the controller 460 or processor 480 to manipulate data or operate one or more components of the vehicle monitoring system 100 or the onboard sensing module 400 to perform the task or function. Furthermore, the steps of the method may be performed in any practicable time sequence, regardless of the order in which the steps are shown or described in the figures.

[0096] Figure 13A method 700 is shown for operating the onboard sensing module 400 to monitor at least the cabin 108 of a shared vehicle 102. During operation of the shared vehicle 102, the method 700 advantageously captures and stores sensor data in non-volatile memory (e.g., the memory 484 and / or the removable memory storage device 524), for example, in the context of a shared vehicle service such as a car rental service, an autonomous taxi service, a ride-sharing service, or the like. Furthermore, the method 700 advantageously processes the sensor data to provide metadata, which is also stored in the non-volatile memory 484 and / or 524. The method 700 advantageously enables operators of such shared vehicle services to monitor the condition of the shared vehicles 102, enforce rules and policies, and provide additional benefits to customers with minimal human intervention.

[0097] Method 700 begins by turning on power to the onboard sensing module (block 710 ). Specifically, as described above, battery monitoring circuit 560 is configured to monitor the voltage and current of power line 140 provided via external cable 544 to external I / O connector 540 . In some embodiments, power line 140 is provided via the normally-on power line of shared vehicle 102 , which directly provides the battery voltage of vehicle battery 136 . It will be appreciated that, if accurately measured, the battery voltage of vehicle battery 136 can be used to estimate the state of charge of vehicle battery 136 . In one embodiment, battery monitoring circuit 560 measures the battery voltage provided via external cable 544 and, in response to the battery voltage exceeding a predetermined threshold voltage, provides an activation signal to controller 460 to at least partially activate onboard sensing module 400 . The predetermined threshold voltage is a battery voltage corresponding to a predetermined state of charge of the vehicle battery. In one embodiment, the predetermined state of charge is a state in which vehicle battery 136 can still provide sufficient current to start the vehicle. In this way, if the vehicle battery 136 is sufficiently charged, the onboard sensing module 400 will operate only on battery power; and will not cause the vehicle battery to be unnecessarily drained if the shared vehicle 102 is not started for an extended period of time.

[0098] In an alternative embodiment, the power line 140 connected via the I / O connector 540 is a switched / auxiliary power line of the shared vehicle 102 that provides the battery voltage of the vehicle battery 136 only when the ignition is activated to start the shared vehicle 102 (typically by switching an operating element of the ignition and depressing the brake) or when the auxiliary power source of the shared vehicle 102 is activated (typically by switching an operating element of the ignition without depressing the brake). Thus, in response to detecting the battery voltage from the vehicle battery 136, the battery monitoring circuit 560 provides a start signal to the controller 460 to at least partially start the shared vehicle 102.

[0099] Method 700 continues to operate the onboard sensing module in a low-power mode until a wake-up condition occurs (block 720). In particular, in response to the start-up signal, the onboard sensing module 400 begins operating in a low-power mode in which the controller 460 activates a subset of the components of the onboard sensing module 400 to start up. In particular, in one exemplary embodiment, in the low-power mode, only the IMU 564, the environmental sensor 568, the ignition sensing circuit 556, and the low power supply 552 of the power supply circuit 548 are activated. In addition, the controller 460 itself may operate in a low-power state in which certain functions or subcomponents, such as those related to cellular telephony and GNSS, are disabled.

[0100] The onboard sensing module 400 operates in a low-power mode until a wake-up condition is met, or more specifically, until the controller 460 receives a wake-up signal. In response to receiving the wake-up signal, the onboard sensing module 400 begins operating in an active mode, in which the controller 460 activates all components of the onboard sensing module 400 to start up. In one embodiment, the ignition sensing circuit 556 sends a wake-up signal to the controller 460 in response to detecting that the ignition of the shared vehicle 102 has been activated. In one embodiment, the IMU 564 sends a wake-up signal to the controller 460 in response to detecting a disturbance in the shared vehicle 102 (e.g., acceleration or gyroscope measurements exceeding a threshold or matching a predetermined profile), indicating, for example, that the driver has unlocked the shared vehicle 102 and entered the cabin 108. In one embodiment, if the cellular phone functionality of the controller 460 is operational during the low-power mode, the wake-up signal may be received from the cloud storage backend 150.

[0101] Method 700 continues by receiving sensor data from the integrated sensors and external sensors and writing the sensor data to local non-volatile memory (block 730). Specifically, in active mode, upon receiving a wake-up signal, controller 460 begins recording / writing sensor data from the integrated sensors and from the external sensors to removable memory storage device 524, memory 484, or some other non-volatile memory. In one embodiment, IoT controller 460 implements one or more ring buffers (which may also be referred to as circular buffers, circular queues, or cyclic buffers) on removable memory storage device 524 to manage the storage of newly measured sensor data and the deletion of old sensor data.

[0102] Method 700 continues by processing the sensor data to determine metadata (including event data) and writing the metadata to local non-volatile memory (block 740). In particular, controller 460 is configured to process sensor data received from integrated sensors or external sensors to enrich the data with metadata and, in particular, event detection. As described above, the sensors may include a variety of sensors, including cameras (e.g., external camera 612), microphones (e.g., microphone 580), gyroscopes and accelerometers (e.g., IMU 564), smoke detectors (e.g., particle sensor 412) or other air quality / particle sensors (e.g., environmental sensor 568), temperature sensors, and / or humidity sensors. Controller 460 processes the sensor data to determine one or more conditions, qualities, or states of shared vehicle 102 and / or detect the occurrence of one or more events related to the one or more conditions, qualities, or states of shared vehicle 102. IoT controller 460 stores the determined conditions, qualities, or states and the detected events associated therewith as metadata for the stored sensor data in memory 484 and / or on removable memory storage device 524.

[0103] In at least some embodiments, the controller 460 is configured to determine one or more conditions, qualities, or states of the shared vehicle 102 and / or detect the occurrence of one or more events related to one or more conditions, qualities, or states of the shared vehicle 102 using an algorithm or model, such as a machine learning model (e.g., an artificial neural network). In one embodiment, the controller 460 is configured to receive updates to the algorithm or model from the cloud storage backend 150 via its cellular telephone modem.

[0104] In some embodiments, in response to detecting a particular quality, condition, state, or event, the controller 460 operates the camera trigger circuit 608 to cause the vehicle camera 612 to capture an image or video of the cabin 108. The controller 460 stores the captured image as metadata for the sensor data from which the particular quality, condition, state, or event was detected in the memory 484 and / or the removable memory storage device 524.

[0105] In some embodiments, controller 460 is configured to determine whether shared vehicle 102 has been involved in a collision or otherwise mechanically damaged based on acceleration and gyroscope measurements provided by IMU 564 or similar external sensors (e.g., sensor 120). In one embodiment, controller 460 is configured to detect a collision or damage event in response to acceleration and / or gyroscope measurements exceeding a predetermined threshold or matching a predetermined acceleration profile. In one embodiment, controller 460 executes a machine learning model (e.g., an artificial neural network) to detect a collision or damage event based on the acceleration and / or gyroscope measurements. In one embodiment, controller 460 detects where damage occurred (e.g., left front) and classifies the severity or level of damage (e.g., severe) based on the acceleration and / or gyroscope measurements or other sensor data. In one embodiment, controller 460 executes a machine learning model (e.g., an artificial neural network) to classify a detected collision or damage event based on the acceleration and / or gyroscope measurements. In one embodiment, in response to a collision or damage event, the controller 460 operates the camera trigger circuit 608 to cause the vehicle camera 612 to capture an image or video of the cabin 108 .

[0106] In some embodiments, controller 460 is configured to determine whether the cabin 108 of shared vehicle 102 has an unpleasant or unusual odor based on VOC measurements provided by environmental sensor 568. In one embodiment, controller 460 is configured to detect an unpleasant / unusual odor event in response to a VOC measurement exceeding a predetermined threshold or matching a predetermined profile. In one embodiment, controller 460 executes a machine learning model (e.g., an artificial neural network) to detect an unpleasant / unusual odor event based on the VOC measurement. In one embodiment, in response to an unpleasant / unusual odor event, controller 460 operates camera trigger circuit 608 to cause vehicle camera 612 to capture an image or video of cabin 108.

[0107] Additionally, in some embodiments, controller 460 may be configured to identify and / or classify tastes or odors present in cabin 108 of shared vehicle 102 based at least on VOC measurements provided by environmental sensor 568. For example, based on the chemical profile of the VOCs sensed in cabin 108 and, in some embodiments, in combination with sensed temperature, humidity, atmospheric pressure, and particulate concentration, controller 460 identifies the smell as corresponding to a particular odor category. For example, in some embodiments, controller 460 is configured to identify and classify odors corresponding to one or more of: marijuana, tobacco, perfume, food, beverage, alcohol, urine, vomit, feces, animal odor, mold, gasoline, and other odors detectable to a user of vehicle 102. In one embodiment, controller 460 is configured to execute a machine learning model (e.g., an artificial neural network) to identify and classify odors in vehicle cabin 108 based on detected VOCs and, in some embodiments, temperature, humidity, pressure, and / or particulate measurements. In some embodiments, in response to detecting certain categories of odors, the controller 460 operates the camera trigger circuit 608 to cause the vehicle camera 612 to capture an image or video of the cabin 108 .

[0108] In some embodiments, controller 460 is configured to determine whether a driver or passenger is smoking within cabin 108 of shared vehicle 102 based on particulate matter measurements provided by particulate sensor 564. In one embodiment, controller 460 is configured to monitor a profile of particulate matter concentration over time and detect a smoking event in response to a profile of particulate matter concentration that matches a reference profile or exceeds a concentration threshold. In one embodiment, controller 460 executes a machine learning model (e.g., an artificial neural network) to detect smoking events based on the particulate matter measurements. In one embodiment, in response to a smoking event, controller 460 operates camera trigger circuit 608 to cause vehicle camera 612 to capture an image or video of cabin 108.

[0109] Method 700 continues by uploading at least the metadata to a cloud storage backend for remote storage (block 750). In particular, controller 460 is configured to operate cellular modem 488 to upload at least the determined metadata to cloud storage backend 150. The uploaded metadata includes at least the detected events and may include corresponding timestamps indicating the time at which each event occurred, as well as other contextual information about the detected events (e.g., images captured in response to the event detection). In some embodiments, controller 460 is configured to also upload raw sensor data (from which the events were detected) or intermediate data determined during the processing of sensor data to detect events. In some embodiments, controller 460 is configured to upload all raw sensor data, regardless of whether the sensor data corresponds to any detected events. In one embodiment, onboard sensing module 400 utilizes a secure and encrypted (TLS V1.2 encryption) connection to cloud storage backend 150 using a public key infrastructure (PKI) or equivalent. In one embodiment, authentication is ensured through the use of a certificate signed by an appropriate certificate authority.

[0110] Additional Examples

[0111] The reader should understand that, in some embodiments, the features disclosed above with respect to the onboard sensing module 112 are integrated into the onboard sensing module 400. For example, in some embodiments, the onboard sensing module 400 includes a camera, a heat sink, and / or a SoM configuration. Similarly, the onboard sensing module 112 includes the features described above with respect to the onboard sensing module 400. For example, in some embodiments, the onboard sensing module 112 includes an environmental sensor, or a SoM configured as described with reference to the onboard sensing module 400.

[0112] Furthermore, in various embodiments, any or all of the functions and operations described above with respect to the vehicle sensing module 112 are integrated into the vehicle sensing module 400. For example, in one embodiment of the vehicle sensing module 400, the controller 460 is configured to operate in the same manner as described above with reference to FIG. Figure 4-6 Photos captured by the integrated camera or by the external camera 612 are analyzed in a similar manner as described. Similarly, embodiments of the onboard sensing module 112 are configured to perform any one or more of the method steps of the method 700 described herein.

[0113] Although the present disclosure has been shown and described in detail in the drawings and foregoing description, it should be considered illustrative rather than restrictive in nature. It should be understood that only preferred embodiments have been presented and all changes, modifications and other applications that fall within the spirit of the present disclosure are intended to be protected.

Claims

1. A sensing module for monitoring a vehicle cabin, comprising: an environmental sensor configured to sense organic compounds in ambient air of the cabin; a particle sensor configured to detect particulate matter in the ambient air; a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the Internet; and a housing configured to be mounted to a windshield of the vehicle, the housing supporting the environmental sensor, the particle sensor, and the controller, wherein the housing defines a substantially enclosed interior space, the environmental sensor, the particle sensor, and the controller are arranged in the interior space, wherein the housing comprises a partition that at least substantially separates a first interior region of the interior space from a second interior region of the interior space, wherein the particle sensor comprises an inlet and an outlet, the inlet leading to the first interior region and the outlet leading to the second interior region, and Wherein, the volume of the first internal area is less than 10% of the total volume of the internal space.

2. The sensing module according to claim 1, wherein: The housing defines at least one first opening to the first interior region and at least one second opening to the second interior region.

3. The sensing module according to claim 2, wherein: The environmental sensor is arranged in the second inner area.

4. The sensing module according to claim 1, further comprising: a printed circuit board supported in the housing and operable to interconnect the controller, the environmental sensor, and the particle sensor, Wherein, the controller and the environmental sensor are arranged on the printed circuit board.

5. The sensing module according to claim 4, further comprising: At least one microphone is supported in the housing and is operably connected to the controller.

6. The sensing module according to claim 5, wherein: The housing includes at least one cylindrical protrusion and defines at least one third opening, the third opening leading to the at least one cylindrical protrusion; as well as Each of the at least one microphone is disposed in an associated one of the at least one cylindrical protrusion.

7. The sensing module according to claim 6, further comprising: An acoustic gasket seals against the printed circuit board and circumferentially seals against each of the at least one cylindrical protrusion to acoustically isolate an associated microphone within the cylindrical protrusion.

8. The sensing module according to claim 4, further comprising: A cellular telephone modem is disposed on the printed circuit board, the controller being configured to transmit the data to the remote server via the cellular telephone modem.

9. The sensing module according to claim 8, wherein: The controller is configured as a system on a chip, and the cellular telephone modem is integrated into the system on a chip.

10. The sensing module according to claim 4, wherein: The printed circuit board includes a connector configured to connect the printed circuit board to the particle sensor.

11. The sensing module according to claim 1, wherein: The environmental sensor is also configured to sense temperature, barometric pressure, and relative humidity of the surrounding air.

12. A sensing module for monitoring a cabin of a vehicle, comprising: an environmental sensor configured to sense organic compounds in ambient air of the cabin; a particle sensor configured to detect particulate matter in the ambient air, the particle sensor comprising an inlet; a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the Internet; and a housing configured to be mounted to a windshield of the vehicle, the housing defining an interior space in which the environmental sensor, the particulate sensor, and the controller are supported, the interior space having an inlet region from which the inlet of the particulate sensor draws air, the inlet region being substantially isolated from the remainder of the interior space and having a volume that is less than 10% of a total volume of the interior space.

13. A sensing module for monitoring a cabin of a vehicle, comprising: an environmental sensor configured to sense organic compounds in ambient air of the cabin; a particle sensor configured to detect particulate matter in the ambient air; a controller operably connected to the environmental sensor and the particle sensor and configured to receive sensor signals from the environmental sensor and the particle sensor and transmit data to a remote server via the Internet; a printed circuit board supported in the housing and operable to interconnect the controller, the environmental sensor, and the particle sensor, the controller and the environmental sensor being disposed on the printed circuit board; at least one microphone, the at least one microphone being disposed on the printed circuit board; as well as a housing configured to be mounted to a windshield of the vehicle, the housing supporting the environmental sensor, the particle sensor, the controller, and the printed circuit board, the housing including at least one opening assigned to each of the at least one microphone, wherein the housing defines a substantially enclosed interior space, the environmental sensor, the particle sensor, and the controller are arranged in the interior space, wherein the housing comprises a partition that at least substantially separates a first interior region of the interior space from a second interior region of the interior space, wherein the particle sensor comprises an inlet and an outlet, the inlet leading to the first interior region and the outlet leading to the second interior region, and Wherein, the volume of the first internal area is less than 10% of the total volume of the internal space.

14. The sensing module according to claim 13, wherein: Each microphone is arranged in a microphone space of the interior space, the microphone space being acoustically isolated from the rest of the interior space.

15. The sensing module according to claim 14, further comprising: An acoustic gasket circumferentially surrounds each of the at least one microphone to acoustically isolate the associated microphone space.

Images