System and method for ultra wide band based vehicle sensing
By adopting ultra-wideband technology in the vehicle sensing system and using UWB transceiver to perform dual-mode operation in the key off scenario, the problem of high energy consumption of the vehicle sensing system is solved, and efficient vehicle internal monitoring and energy management are achieved.
Patent Information
- Application Number
- CN202410776683.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-06-20
- Filing Date
- 2024-06-17
- Publication Date
- 2024-12-20
AI Technical Summary
Existing vehicle sensing systems consume a lot of vehicle energy during key-off scenarios and require the use of other vehicle components such as cameras for sensing, increasing energy consumption and complexity.
Using a vehicle sensing system based on ultra-wideband (UWB), the UWB transceiver uses the UWB transceiver to estimate the seating area configuration file and detect the presence of the occupant in radar mode, and operate through dual mode without departing from the mobile phone, that is, the key positioning function ( PaaK positioning and radar sensing) reduce energy consumption and control the operation of internal components of the vehicle.
It realizes monitoring the interior and exterior of the vehicle without consuming a lot of vehicle energy, saves dependence on other sensing devices, improves energy efficiency, and optimizes the internal environment of the vehicle through dynamic seating area adjustment and HVAC system control.
Smart Images

Figure CN119160104A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a vehicle sensing system and method, and more particularly, to a system and method for facilitating vehicle sensing using an ultra-wideband sensor. Background Art
[0002] Modern vehicles include sensors or sensing modules that monitor portions of the interior of the vehicle or portions of the exterior of the vehicle. For example, a vehicle may include a sensing module that can detect the presence of an object or occupant in the vehicle. The sensing module may include an ultrasonic sensor, a camera, etc. that monitors portions of the interior of the vehicle or portions of the exterior of the vehicle. While the sensing module may provide benefits to a vehicle user, the sensing module may draw a significant amount of vehicle energy. This may cause inconvenience to the user, especially if energy is consumed during a vehicle key-off scenario.
[0003] Therefore, there is a need for a system and method that can monitor both the interior and exterior of a vehicle without drawing significant amounts of energy from the vehicle. Summary of the invention
[0004] This disclosure describes an ultra-wideband (UWB) based vehicle sensing system. The system can utilize a UWB transceiver / sensor located in the vehicle in radar mode to estimate a seating area profile (such as footwell / legroom estimation, seating area inclination estimation, etc.) and determine occupant presence. The system can perform seating area adjustments based on the estimation of the seating area profile and occupant presence.
[0005] The system may cause the UWB transceiver to operate in dual mode in each UWB operation cycle (e.g., a first UWB cycle and a second UWB cycle). For example, the system may cause the UWB transceiver to operate in a first mode, in which the UWB transceiver can perform phone-as-a-key (PaaK) location. Similarly, the system may cause the UWB transceiver to operate in a second mode, in which the UWB transceiver can perform radar sensing or vehicle interior sensing using radar signals.
[0006] In some aspects, the system may cause the UWB transceiver to perform PaaK positioning and radar sensing in both a first UWB cycle and a second UWB cycle. For example, in the first UWB cycle, the system may cause the UWB transceiver to operate in a first mode for a first predetermined duration and in a second mode for a second predetermined duration. During the first predetermined duration of the first UWB cycle, the system may cause the UWB transceiver to transmit a UWB positioning signal. During the second predetermined duration of the first UWB cycle, the system may cause the UWB transceiver to transmit a radar pulse signal.
[0007] Additionally, during a third predetermined duration of the second UWB cycle, the system may cause the UWB transceiver to sample a positioning response signal (associated with the transmitted UWB positioning signal). Additionally, during a fourth predetermined duration of the second UWB cycle, the system may cause the UWB transceiver to sample a radar response signal (associated with the transmitted radar pulse signal). In some aspects, the first predetermined duration and the third predetermined duration may be equal to each other, and the second predetermined duration and the fourth predetermined duration may be equal to each other.
[0008] The system can also be configured to perform one or more actions (in addition to seating zone adjustments) by analyzing the radar response signal. For example, the system can control the operation of the vehicle's heating, ventilation and air conditioning (HVAC) system based on the radar response signal analysis, detect objects that fall into the vehicle during a key-off scenario, detect pet / occupant activity, etc.
[0009] The present disclosure describes a system and method for performing vehicle sensing using an existing vehicle UWB transceiver, thereby saving vehicle energy and eliminating the need to use other vehicle components (e.g., cameras) for sensing. The system uses a UWB transceiver to accurately estimate legroom, footrest space, etc. and perform dynamic seating area adjustments in the vehicle without manual intervention. The system also controls the operation of other vehicle components (e.g., HVAC systems, vehicle interior cameras, lights, etc.) based on radar response signal processing, thereby further saving vehicle energy. In addition, the system can cause the UWB transceiver to perform both PaaK positioning and radar sensing within the same polling duration (e.g., 100ms), thereby reducing energy consumption.
[0010] These and other advantages of the present disclosure are provided in detail herein. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the accompanying drawings, and some elements and / or components may not be present in various embodiments. The elements and / or components in the accompanying drawings are not necessarily drawn to scale. Throughout this disclosure, singular terms and plural terms may be used interchangeably, depending on the context.
[0012] Figure 1 An example vehicle is depicted in which techniques and structure for providing the systems and methods disclosed herein may be implemented.
[0013] Figure 2 A block diagram of an example system for performing vehicle sensing using an ultra-wideband (UWB) transceiver according to the present disclosure is shown.
[0014] Figure 3 An example operating cycle of a UWB transceiver located inside a vehicle according to the present disclosure is shown.
[0015] Figure 4 An example embodiment of performing vehicle sensing by using a UWB transceiver according to the present disclosure is shown.
[0016] Figure 5 It is shown that according to the present disclosure, by using Figure 4 An example embodiment of a UWB transceiver to control a vehicle.
[0017] Figure 6 A flow chart of an example method of controlling a vehicle using a UWB transceiver according to the present disclosure is depicted. DETAILED DESCRIPTION
[0018] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the disclosure are shown and which are not intended to be limiting.
[0019] Figure 1 An exemplary vehicle 100 is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented. The vehicle 100 may take the form of any passenger or commercial vehicle, such as, for example, an automobile, a work vehicle, a crossover vehicle, a truck, a minivan, a taxi, a bus, etc. In addition, the vehicle 100 may be a manually driven vehicle, and / or be configured to operate in a fully autonomous (e.g., unmanned) mode or a partially autonomous mode, and may include any powertrain, such as, for example, a gasoline engine, one or more electric actuation motors, a hybrid powertrain, etc.
[0020] The vehicle 100 may include a plurality of ultra-wideband (UWB) transceivers (such as UWB transceivers A1 to A6). The terms "UWB transceiver", "UWB sensor", "UWB anchor point", "UWB module", etc. may be used interchangeably herein. The UWB transceivers A1 to A6 may be installed at different locations in the vehicle 100, such as Figure 1 As shown. Figure 1 Six UWB transceivers are shown in FIG. 3 , but in other cases, more or less than six UWB transceivers may be employed.
[0021] In an exemplary aspect, UWB transceivers A1 to A4 may be located in an exterior portion of the vehicle, and UWB transceivers A5 and A6 may be located in an interior portion of the vehicle. For example, UWB transceiver A1 may be mounted on the driver's side front bumper, UWB transceiver A2 may be mounted on the passenger's side front bumper, UWB transceiver A3 may be mounted on the driver's side rear bumper, and UWB transceiver A4 may be mounted on the passenger's side rear bumper. In some aspects, one or more UWB transceivers may perform vehicle exterior portion sensing, for example, by using UWB transceivers A1, A2, A3, and A4. In some aspects, one or more UWB transceivers may perform vehicle interior portion sensing (or cabin monitoring), for example, by using UWB transceivers A5 and A6. In other aspects, the vehicle 100 may include a BUN (e.g., BLE, UWB, and / or NFC) module that may have a UWB transceiver. Depending on the size of the vehicle, the BUN and one UWB transceiver (e.g., UWB transceiver A5 or A6 and / or any other UWB transceiver) can perform partial vehicle interior sensing. In some aspects, UWB transceivers A5, A6, and BUN can perform partial vehicle interior sensing together. In other aspects, the vehicle 100 can include any other module (instead of the BUN) that can include BLE and UWB transceivers that can perform partial vehicle interior sensing.
[0022] The vehicle 100 may also include a vehicle sensing system or “system” (in Figure 2 100 ), the vehicle sensing system or "system" may be configured to control the operation of each UWB transceiver in the vehicle 100 (such as UWB transceivers A1 to A6 and the UWB transceiver in BUN). In some aspects, the system may be configured to operate each UWB transceiver in a first mode or a second mode. In the first mode, the UWB transceiver may be configured to perform phone-as-a-key (PaaK) location. In the second mode, the UWB transceiver may be configured to perform radar sensing. In other words, in the second mode, the UWB transceiver may be configured to act as a radar to perform vehicle interior partial sensing (and / or vehicle exterior partial sensing).
[0023] Based on the sensing of the vehicle interior portion, the system may be configured to perform one or more actions, including but not limited to automatic seating area adjustment, vehicle component (such as heating, ventilation and air conditioning (HVAC) system, lights, etc.) control, transmission of an alarm when an object or occupant may be left in the vehicle 100, etc. Some of the above actions may be performed in a key-off scenario, and some actions may be performed when the vehicle 100 may be in an active mode (e.g., when the vehicle 100 may be moving). For example, the system may transmit an alarm when an object or occupant may be left in the vehicle 100 during a key-off scenario. In some aspects, the system may detect the presence of an occupant when the vehicle 100 may be moving (or when the vehicle ignition may be on), and perform automatic seating area adjustment and / or control the HVAC system. The details of the system may be understood in conjunction with the figures described below.
[0024] The vehicle 100 and systems may be implemented and / or performed as described herein in this disclosure in accordance with the vehicle owner's manual and safety guidelines.
[0025] Figure 2 A block diagram of an example system 200 for performing vehicle sensing using an ultra-wideband (UWB) transceiver according to the present disclosure is shown.
[0026] System 200 may include a vehicle 202, which may be the same as vehicle 100. Vehicle 202 may include a vehicle computer 204, a vehicle control unit (VCU) 206, and a vehicle sensing system 208. VCU 206 may include a plurality of electronic control units (ECUs) 210 configured to communicate with vehicle computer 204 and / or vehicle sensing system 208.
[0027] The system 200 may also include a mobile device 212 that can connect to the vehicle computer 204 and / or the vehicle sensing system 208 using wired and / or wireless communication protocols and transceivers. The mobile device 212 can be associated with a user 214 (e.g., a vehicle owner). The mobile device 212 can be, for example, a mobile phone or smartphone, a tablet computer, a smart watch, a laptop computer, a computer, a wearable communication device, or any other similar device with wired / wireless communication capabilities. The mobile device 212 can be communicatively coupled to the vehicle 202 via one or more networks 216 and can execute a phone as a key (PaaK) application ("app") to access vehicle functions, the one or more networks can communicate via one or more wireless connections, and / or the mobile device can communicate using a near field communication (NFC) protocol, Protocol, Wi-Fi, ultra-wideband (UWB), and other possible data connection and sharing technologies to connect directly with the vehicle 202.
[0028] The network 216 illustrates an example communication infrastructure in which the connected devices discussed in the various embodiments of the present disclosure may communicate. The network 216 may be and / or may include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as, for example, Transmission Control Protocol / Internet Protocol (TCP / IP), Wi-Fi, UWB based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and Fifth Generation (5G), to name a few examples.
[0029] In some aspects, according to the present disclosure, the vehicle computer 204 and / or the vehicle sensing system 208 may be installed in the vehicle engine compartment (or elsewhere in the vehicle 202). In addition, the vehicle computer 204 may operate as a functional part of the vehicle sensing system 208. The vehicle computer 204 may be or may include an electronic vehicle controller having one or more processors 218 and a memory 220. In addition, the vehicle sensing system 208 may be separate from the vehicle computer 204 (e.g., Figure 2 ), or may be integrated as part of the vehicle computer 204.
[0030] The processor 218 may be configured to communicate with one or more memory devices (eg, memory 220 and / or memory 220) configured to communicate with a corresponding computing system. Figure 2 The processor 218 may utilize the memory 220 to store programs and / or store data in code form to perform various aspects of the present disclosure. The memory 220 may be a non-transitory computer-readable memory that stores vehicle sensing program code. The memory 220 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).
[0031] Additionally, the vehicle computer 204 and / or the vehicle sensing system 208 may be configured to communicate with one or more servers 222 and the mobile device 212. The server 222 may be part of a cloud-based computing infrastructure and may be associated with and / or include a telematics service delivery network (SDN) that provides services to the vehicle 202 and other vehicles that may be part of a fleet of vehicles ( Figure 2 In some aspects, the server 222 may host a PaaK application that may be installed on the mobile device 212.
[0032] According to some aspects, the VCU 206 can share a power bus with the vehicle computer 204 and the vehicle sensing system 208, and can be configured and / or programmed to coordinate vehicle systems, connected servers (e.g., server 222), and other vehicles operating as part of a vehicle fleet (e.g., Figure 2 210, such as a body control module (BCM) 224, an engine control module (ECM) 226, a transmission control module (TCM) 228, a telematics control unit (TCU) 230, a driver assistance technology (DAT) controller 232, etc. The VCU 206 may also include and / or communicate with a vehicle perception system (VPS) 234, which connects and / or controls one or more vehicle sensing systems 236. The vehicle sensing system 236 may include one or more vehicle sensors, including but not limited to door sensors, seating area sensors, vehicle proximity sensors, tire pressure sensors, vehicle interior and / or exterior cameras, etc.
[0033] In some aspects, the VCU 206 may control aspects of vehicle operation and implement one or more instruction sets received from the mobile device 212 , including instructions to operate as part of the vehicle sensing system 208 .
[0034] The TCU 230 may be configured and / or programmed to provide vehicle connectivity to wireless computing systems on and off the vehicle 202 and may include a navigation (NAV) receiver 238 for receiving and processing GPS signals, module (BLEM) 240, a Wi-Fi transceiver, one or more UWB transceivers (including UWB transceivers A1 to A6 and combined Figure 1 BUN described herein) and / or other wireless transceivers (e.g., BUNs described herein) that may be configured for wireless communication between the vehicle 202 and other systems (e.g., the mobile device 212), computers, and modules. Figure 2). The TCU 230 may be configured to communicate with the ECU 210 via a bus.
[0035] In one aspect, the ECU 210 may control various aspects of vehicle operation and communication using input from a human driver, input from an autonomous vehicle controller, the vehicle sensing system 208, and / or via wireless signal input received from other connected devices (such as a mobile device 212, a server 222, etc.) over a wireless connection.
[0036] BCM 224 generally includes an integration of sensors, vehicle performance indicators, and variable reactors associated with vehicle systems, and may include processor-based power distribution circuits that can control functions associated with the vehicle body (such as lights, windows, security devices, vehicle PaaK systems / units (which may include the use of UWB transceivers A1 to A6 and BUN to perform various functions, including high-accuracy positioning of mobile devices and vehicle interior sensing), vehicle interior and / or exterior cameras, audio systems including microphones, speakers, door locks and entry control), vehicle energy management, and various comfort controls. BCM 224 can also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 (not shown) to interact.
[0037] In some aspects, the DAT controller 232 may provide Level 1 to Level 3 autonomous driving and driver assistance functionality, which may include features such as active parking assist, trailer back-up assist, adaptive cruise control, lane keeping, and / or driver state monitoring. The DAT controller 232 may also provide various aspects of user and environmental input that may be used for user authentication.
[0038] In some aspects, the vehicle computer 204 and / or the vehicle sensing system 208 may be connected to an infotainment system 242, which may include a touch screen interface portion and may include a voice recognition feature, biometric capabilities that may identify a user based on facial recognition, voice recognition, fingerprint recognition, or other biometric means. In other aspects, the infotainment system 242 may also be configured to receive user commands via the touch screen interface portion, and / or display notifications, navigation maps, etc. on the touch screen interface portion.
[0039] The computing system architecture of the vehicle computer 204, VCU 206 and / or vehicle sensing system 208 may omit certain computing modules. Figure 2 The computing environment depicted in FIG. 1 is an example of possible implementations according to the present disclosure and, therefore, should not be considered limiting or exclusive.
[0040] According to some aspects, the vehicle sensing system 208 may be integrated with and / or executed as part of the ECU 210. The vehicle sensing system 208, whether it is integrated with the vehicle computer 204 or the ECU 210, or whether it operates as a standalone computing system in the vehicle 202, may include a transceiver 244, a processor 246, and a computer readable memory 248. The transceiver 244 may be configured to receive information / input from an external device or system (e.g., a mobile device 212, a server 222, etc.). In addition, the transceiver 244 may transmit notifications, information, or requests to the external device or system. In addition, the transceiver 244 may be configured to receive signals from the vehicle sensing system 236 and other vehicle components including the UWB transceivers A1 to A6 and BUN of the TCU 230.
[0041] The processor 246 and the memory 248 may be the same or similar to the processor 218 and the memory 220, respectively. Specifically, the processor 246 may utilize the memory 248 to store programs and / or store data in code form to perform various aspects according to the present disclosure. The memory 248 may be a non-transitory computer-readable memory that stores vehicle sensing program code, and may include a vehicle database 250 and a UWB information database 252. The vehicle database 250 may include information associated with the vehicle 202, such as a seating area profile, a vehicle type, occupant information associated with an occupant / vehicle owner located inside the vehicle 202 (such as an occupant profile), etc. The UWB information database 252 may store information generated by UWB transceivers (e.g., UWB transceivers A1 to A6 and BUN, as described above in conjunction with the vehicle database 250). Figure 1 The information measured / captured can be combined Figures 3 to 6 to understand the details of the UWB transceiver and vehicle sensing system 208 .
[0042] Figure 3 An example operation cycle 300 of a UWB transceiver (e.g., UWB transceiver A5 or A6) located inside a vehicle 202 according to the present disclosure is shown. Each UWB transceiver A5 or A6 may have an operation cycle (or PaaK polling rate) of a predetermined duration (e.g., 100 milliseconds (ms)) and may transmit or receive one or more pulses / signals during the duration. In each operation cycle, the UWB transceiver A5 / A6 may be configured to operate in a first mode and a second mode. As described above in conjunction with Figure 1 As described, UWB transceiver A5 / A6 can perform PaaK positioning in a first mode and radar sensing in a second mode. In other words, UWB transceiver A5 / A6 can perform dual functions (e.g., PaaK positioning and radar sensing) in the same operating cycle or polling rate.
[0043] In an exemplary aspect, UWB transceiver A5 / A6 may be configured to perform PaaK positioning and radar sensing in a first UWB cycle (e.g., cycle 300) and a second UWB cycle (not shown). The duration of each of the first UWB cycle and the second UWB cycle may be 100 ms. In other words, the duration of the first UWB cycle may be the same as the duration of the second UWB cycle (e.g., 100 ms). In some aspects, UWB transceiver A5 / A6 may transmit PaaK and radar signals in the first UWB cycle, and may sample received PaaK and radar response signals in the second UWB cycle, as described later in the description below.
[0044] In operation, processor 246 may activate a UWB transceiver (eg, UWB transceiver A5) at time “T1”, such as at Figure 3 In response to the activation, UWB transceiver A5 may wake up, as depicted in Figure 3 In the first mode, UWB transceiver A5 may perform PaaK positioning, as in Figure 3 , as depicted in block 304 of . In some aspects, UWB transceiver A5 may wake up and perform PaaK positioning within a first predetermined duration "D1" in the first UWB cycle 300. Specifically, to perform PaaK positioning, UWB transceiver A5 may transmit a UWB positioning signal within the first predetermined duration "D1". In an exemplary aspect, the total duration (e.g., D1+D2) of the first UWB cycle 300 may be 100ms, and the first predetermined duration "D1" may be 23ms. In other words, UWB transceiver A5 may be configured to perform PaaK positioning (or operate in the first mode) within 23ms of activation / wake-up.
[0045] The above example durations of 100 ms and 23 ms are for illustration purposes only, and the present disclosure is not limited to these example durations. Without departing from the scope of the present disclosure, UWB transceiver A5 may operate in the first mode for a duration other than 23 ms. Similarly, without departing from the scope of the present disclosure, the total duration of the first UWB cycle 300 may be different from 100 ms.
[0046] In response to the first predetermined duration "D1" expiring, the processor 246 may obtain (or generate) a trigger signal to switch the UWB transceiver A5 from the first mode to the second mode, which is depicted as Figure 3In some aspects, the processor 246 may obtain a trigger signal from a vehicle timer (not shown) via the transceiver 244. In response to obtaining the trigger signal, the processor 246 may switch the UWB operation mode from the first mode to the second mode. In an exemplary aspect, the UWB transceiver A5 may change the count of transmission pulses in the second mode; however, the pulse rate may remain unchanged.
[0047] In the second mode, the UWB transceiver A5 can perform radar sensing to monitor the interior of the vehicle, such as Figure 3 308 of . In some aspects, UWB transceiver A5 may operate in the second mode for a second predetermined duration "D2" in the first cycle 300 to perform radar sensing. UWB transceiver A5 may transmit a radar pulse signal for the second predetermined duration "D2" to perform radar sensing. The radar pulse signal may be generated by encoding the transmission signal as a radar. In some aspects, the second predetermined duration "D2" may be 67ms (e.g., when the total duration of the first UWB cycle 300 may be 100ms). In some aspects, when UWB transceiver A5 operates in the second mode, UWB transceiver A5 may transmit a predefined count of radar pulse signals, such as 5 to 7, for the second predetermined duration "D2".
[0048] When the second duration "D2" elapses, processor 246 may cause UWB transceiver A5 to move to an idle / low power state, which is depicted as Figure 3 Frame 310 in FIG.
[0049] In another aspect, when the next UWB cycle begins (ie, in the second UWB cycle, Figure 3 ), the processor 246 may cause the UWB transceiver A5 to operate in the first mode for a third predetermined duration. The third predetermined duration may be equal to the first predetermined duration. For example, the third predetermined duration may be 23 ms. In some aspects, the UWB transceiver A5 may sample the positioning response signal (associated with the UWB positioning signal transmitted by the UWB transceiver A5 in the first UWB cycle 300) for the third predetermined duration of the second UWB cycle.
[0050] In response to the passage of the third predetermined duration, the processor 246 may obtain (or generate) another trigger signal to switch the UWB transceiver A5 from the first mode to the second mode. In the second mode of the second UWB cycle, the UWB transceiver A5 may receive and sample a radar response signal reflected by one or more objects, target locations, or targets (e.g., seats, floors, occupants, etc. located inside the vehicle 202) in response to transmitting a radar pulse signal in the first UWB cycle 300 to perform radar sensing. Specifically, the radar pulse signal transmitted by the UWB transceiver A5 in the first UWB cycle 300 may pass through the vehicle seating area and other objects, and may facilitate accurate monitoring of the interior portion of the vehicle. For example, the UWB transceiver A5 may facilitate detection of objects / occupants or the positions of objects / occupants inside the vehicle 202, the distance between different objects (such as footrest space, legroom), etc. by transmitting a radar pulse signal and sampling the reflected radar response signal.
[0051] In some aspects, UWB transceiver A5 may operate in the second mode for a fourth predetermined duration in the second UWB cycle. The fourth predetermined duration may be equal to the second predetermined duration. For example, the fourth predetermined duration may be 67 ms. In this way, UWB transceiver A5 may perform two functions (i.e., PaaK positioning and radar sensing / measurement) sequentially in each UWB cycle.
[0052] Figure 4 An example embodiment of performing vehicle interior part sensing by using UWB transceivers A5, A6 and BUN according to the present disclosure is shown. Figure 5 To describe Figure 4 , Figure 5 An example embodiment of controlling a vehicle 202 by using UWB transceivers A5, A6, and BUN according to the present disclosure is shown.
[0053] As described above, the UWB transceivers A5, A6 and BUN (eg, Figure 4 The processor 246 may cause the UWB transceivers A5, A6, and BUN to transmit radar pulse signals in the second mode of the first UWB cycle. The radar pulse signals may pass out of or through the seating areas 402a, 402b, 402c (in Figure 4402) and is reflected from one or more objects / targets (e.g., occupant 502, pet, etc.). UWB transceivers A5, A6, and BUN may receive and sample the reflected radar response signals in the second mode of the second UWB cycle. Processor 246 may obtain the reflected radar response signals from UWB transceivers A5, A6, and BUN and may perform radar response signal processing, such as in Figure 5 504 to detect the presence of an object / occupant on the seating area 402. In addition, the processor 246 (or UWB transceivers A5, A6, and BUN) may send information associated with the reflected radar response signal to the UWB information database 252 for storage purposes.
[0054] Additionally, the processor 246 may determine / estimate a seating area profile associated with the seating area 402 based on the radar response signal processing, such as in Figure 5 506 of . In some aspects, the seating area profile may include information associated with footwell, legroom, seating area inclination, etc. In other words, the processor 246 may analyze the radar response signal reflected by the target / object inside the vehicle 202 and estimate the location of the seating area 402 inside the vehicle 202 (such as the distance between two rows of seating areas, the seating area inclination, etc.). In some aspects, the processor 246 may store the estimated seating area profile in the vehicle database 250.
[0055] Additionally, processor 246 may determine the presence of an occupant in seating area 402 based on the reflected radar response signal, such as in Figure 5 For example, the processor 246 may determine whether an occupant (e.g., occupant 502) is located inside the vehicle 202 and the occupant's position inside the vehicle 202. In some aspects, the processor 246 may store such information as occupant information in the vehicle database 250.
[0056] In response to determining the seating area profile and the occupant presence, the processor 246 may be configured to associate the seating area profile with the occupant presence and determine corresponding seating areas in the vehicle 202 that may be occupied by the occupant and seating areas that may be vacant.
[0057] Additionally, processor 246 may determine an occupant profile for each occupant of vehicle 202 based on radar response signal processing (e.g., Figure 5510 of ). Specifically, the processor 246 may “characterize” each occupant based on the radar response signal processing. For example, the processor 246 may characterize the occupant type (e.g., person, pet, or object), occupant physiology (adult or child, tall or short occupant, etc.) based on the radar response signal processing. In some aspects, the processor 246 may store such information as occupant information in the vehicle database 250.
[0058] In other aspects, in response to determining the corresponding seating areas that may be occupied by occupants and the seating areas that may be vacant and / or occupant characteristics in the vehicle 202, the processor 246 may perform one or more actions. For example, the processor 246 may control the operation of one or more vehicle components based on the above determination. Examples of vehicle component operation control are described below. The following examples should not be construed as limiting the scope of the present disclosure.
[0059] In some aspects, the processor 246 may be configured to perform dynamic seating area adjustments based on the above determinations, as depicted in block 512. As described above, the processor 246 determines the corresponding seating areas that may be occupied and the seating areas that may be vacant in the vehicle 202. Based on this determination, the processor 246 may determine updated seating area profiles for one or more seating areas. In other words, the processor 246 may determine updated legroom for different seating areas 402, updated inclination for different seating areas 402, etc. based on the seating areas that may be occupied and vacant.
[0060] In response to determining the updated seating area profiles for each seating area, the processor 246 may cause the seating area adjustments based on the updated seating area profiles. For example, if there is no occupant in the seating area 402c, the processor 246 may transmit one or more command signals to the BCM 224 to move the seating area (e.g., seating area 402b) rearward to provide more legroom to the occupant sitting in the seating area 402b. Thus, the processor 246 may dynamically adjust the seating area profiles based on whether an occupant is likely to sit in the seating area.
[0061] In further aspects, the processor 246 can correlate the occupant profile and the seating area profile and perform seating area adjustments based on the correlation. For example, the processor 246 can adjust the seating area 402 to provide more legroom for an adult seated in the vehicle 202 as compared to a child seated in the vehicle 202. Similarly, the processor 246 can adjust the seating area to provide more legroom when a tall adult is likely to sit in the seating area 402.
[0062] In additional aspects, the processor 246 can be configured to control the vehicle HVAC system based on the presence of an occupant in the seating area 402, such as in Figure 5 For example, when there may be no occupants sitting in the seating area 402c, the processor 246 may control the HVAC system so that no air may be directed to the seating area 402c, thereby saving vehicle energy.
[0063] As described above, processor 246 may be configured to monitor the interior portion of the vehicle based on radar response signal processing, which is depicted as Figure 5 In some aspects, the processor 246 may monitor a portion of the vehicle interior when the vehicle ignition may be off (or during a key-off scenario). The processor 246 may monitor a portion of the vehicle interior during a key-off scenario, and may determine that an object is present (such as an item or occupant left in the vehicle 202) based on the vehicle interior portion monitoring. In response to determining that an item or occupant may be left in the vehicle 202, the processor 246 may be configured to perform one or more actions. For example, in this case, the processor 246 may transmit a notification to the mobile device 212 associated with the user 214 to indicate the presence of the object in the vehicle 202.
[0064] In another aspect, the processor 246 can be configured to determine that the vehicle 202 may be in a standby mode. In response to determining that the vehicle 202 may be in a standby mode, the processor 246 can shut down modules associated with seating areas that may not be occupied, and can maintain modules associated with the driver's seating area in an operational state.
[0065] In further aspects, the processor 246 may be configured to trigger one or more vehicle features based on object detection inside the vehicle 202. For example, the processor 246 may trigger the vehicle camera 404 (in the event that the vehicle ignition is turned off) when the processor 246 determines that an occupant (e.g., a child or pet) may be left in the vehicle 202. Figure 4 ), which is depicted as Figure 5 In block 518 of FIG. The processor 246 may trigger (or turn on) the vehicle camera 404 in response to determining that the occupant is present to monitor occupant activity / movement. In an additional aspect, the processor 246 may transmit images / videos captured by the vehicle camera 404 to the mobile device 212 via the transceiver 244.
[0066] Figure 6 A flow chart of an example method 600 for controlling a vehicle 202 by using UWB transceivers A5, A6, and BUN according to the present disclosure is depicted. Figures 1 to 5 ) to describe Figure 6The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include the steps in an order different from that described in the example embodiments below.
[0067] refer to Figure 6 , at step 602, method 600 may begin. At step 604, method 600 may include activating, by processor 246, a UWB transceiver (e.g., UWB transceivers A5, A6, and / or BUN) in a first mode. In the first mode, processor 246 may cause UWB transceiver A5 to perform PaaK positioning (e.g., for a first predetermined duration), as described above.
[0068] At step 606, method 600 may include obtaining, by processor 246, a trigger signal to switch UWB transceiver A5 from the first mode to the second mode. In the second mode, processor 246 may cause UWB transceiver A5 to perform radar sensing (e.g., for a second predetermined duration). At step 608, method 600 may include causing, by processor 246, UWB transceiver A5 to transmit a radar pulse signal in response to obtaining the trigger signal.
[0069] At step 610, the method 600 may include receiving, by the processor 246, a radar response signal reflected by one or more targets / objects (e.g., target locations such as the seating area 402, occupants, etc.) inside the vehicle 202 in response to the transmitted radar pulse signal. At step 612, the method 600 may include determining, by the processor 246, a seating area profile and an occupant presence at the seating area based on the reflected radar response signal, as described above. At step 614, the method 600 may include performing, by the processor 246, a seating area adjustment based on the determination of the seating area profile and the occupant presence.
[0070] Method 600 may end at step 616 .
[0071] In the above disclosure, reference has been made to the accompanying drawings that form a part of the above disclosure, which illustrate specific embodiments in which the present disclosure may be practiced. It should be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present disclosure. References in this specification to "one embodiment," "embodiment," "example embodiment," etc. indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include the specific features, structures, or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when features, structures, or characteristics are described in conjunction with an embodiment, whether or not explicitly described, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments.
[0072] In addition, where appropriate, the functions described herein may be performed in one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As will be appreciated by those skilled in the art, components may be referred to by different names. This document is not intended to distinguish between components that have different names but the same function.
[0073] It should also be understood that the word "example" as used herein is intended to be non-exclusive and non-limiting in nature. More specifically, the word "example" used herein indicates one of several examples, and it should be understood that no undue emphasis or preference is placed on the specific example described.
[0074] Computer-readable media (also referred to as processor-readable media) include any non-transitory (e.g., tangible) media that participate in providing data (e.g., instructions) that can be read by a computer (e.g., by a processor of a computer). Such media can take many forms, including but not limited to non-volatile media and volatile media. A computing device may include computer-executable instructions, where the instructions are executable by one or more computing devices (such as those listed above) and stored on a computer-readable medium.
[0075] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced by performing the described steps in an order different from the order described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.
[0076] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Upon reading the above description, many embodiments and applications other than the examples provided will be apparent. The scope should not be determined with reference to the above description, but should be determined with reference to the entire scope of the appended claims and equivalents to which such claims are entitled. It is anticipated and expected that the technology discussed herein will develop in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In short, it should be understood that the present application is capable of modification and change.
[0077] Unless explicitly indicated to the contrary in this article, all terms used in the claims are intended to be given their ordinary meanings as understood by the skilled person described herein. Specifically, unless the claims state an explicit limitation to the contrary, the use of singular articles such as "one", "the", "said" and the like should be interpreted as describing one or more of the indicated elements. Unless otherwise specifically stated or understood in other ways within the context when used, conditional language such as, in particular, "can", "may", "can" or "may" is generally intended to express that certain embodiments may include certain features, elements and / or steps, while other embodiments may not include certain features, elements and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element and / or step in any way.
[0078] In one aspect of the invention, the method includes causing the UWB transceiver to operate in the second mode for a second predetermined duration in the first UWB cycle to perform the radar sensing; and causing the UWB transceiver to transmit the radar pulse signal for the second predetermined duration.
[0079] In one aspect of the invention, the method includes causing the UWB transceiver to sample a positioning response signal within a third predetermined duration in the second UWB cycle.
[0080] In one aspect of the invention, the method includes causing the UWB transceiver to sample the radar response signal for a fourth predetermined time duration in the second UWB cycle.
[0081] In one aspect of the invention, the method includes controlling a vehicle heating, ventilation and air conditioning (HVAC) system based on the occupant presence in the seating area.
[0082] According to the present invention, a non-transitory computer-readable storage medium is provided, on which instructions are stored, which when executed by a processor cause the processor to: activate an ultra-wideband (UWB) transceiver in a first mode, wherein the UWB transceiver is configured to operate in the first mode and a second mode, and wherein the UWB transceiver is configured to perform phone-as-a-key (PaaK) positioning in the first mode and to perform radar sensing in the second mode; obtain a trigger signal for switching the UWB transceiver from the first mode to the second mode; cause the UWB transceiver to transmit a radar pulse signal in response to obtaining the trigger signal; receive a radar response signal reflected from a target position inside a vehicle; determine a seating area profile associated with a seating area and the presence of an occupant in the seating area based on the radar response signal; and perform seating area adjustments based on the determination of the seating area profile and the presence of the occupant.
Claims
1. A vehicle, comprising: an ultra-wideband (UWB) transceiver configured to operate in a first mode and a second mode, wherein the UWB transceiver is configured to perform phone-as-a-key (PaaK) location in the first mode and to perform radar sensing in the second mode; a memory configured to store computer-executable instructions; as well as a processor configured to access the memory and execute the computer-executable instructions to: activating the UWB transceiver in the first mode; obtaining a trigger signal for switching the UWB transceiver from the first mode to the second mode; causing the UWB transceiver to transmit a radar pulse signal in response to obtaining the trigger signal; receiving a radar response signal reflected from a target location inside the vehicle; determining a seating area profile associated with a seating area and an occupant presence in the seating area based on the radar response signal; as well as A seating area adjustment is performed based on the determination of the seating area profile and the occupant presence.
2. The vehicle of claim 1, wherein the seating area profile includes information associated with footwell and legroom.
3. The vehicle of claim 1, wherein the processor is further configured to: determining an occupant profile based on the radar response signal; associating the occupant profile with the seating area profile; and The seating area adjustment is performed based on the correlation. 4 . The vehicle of claim 1 , wherein the processor is further configured to cause the UWB transceiver to perform the PaaK positioning and the radar sensing in a first UWB cycle and a second UWB cycle.
5. The vehicle of claim 4, wherein the processor is further configured to: causing the UWB transceiver to operate in the first mode for a first predetermined duration in the first UWB cycle to perform the PaaK positioning; and The UWB transceiver is caused to transmit a UWB positioning signal within the first predetermined time duration.
6. The vehicle of claim 4, wherein the processor is further configured to: causing the UWB transceiver to operate in the second mode for a second predetermined duration in the first UWB cycle to perform the radar sensing; and The UWB transceiver is caused to transmit the radar pulse signal during the second predetermined time duration.
7. The vehicle of claim 5, wherein the processor is further configured to cause the UWB transceiver to sample a positioning response signal for a third predetermined duration in the second UWB cycle.
8. The vehicle of claim 6, wherein the processor is further configured to cause the UWB transceiver to sample the radar response signal for a fourth predetermined duration in the second UWB cycle.
9. The vehicle of claim 1, wherein the processor is further configured to control a vehicle heating, ventilation and air conditioning (HVAC) system based on the occupant presence in the seating area.
10. The vehicle of claim 1, wherein the processor is further configured to: monitoring a vehicle interior portion based on the radar response signal when the vehicle ignition is off, wherein the monitoring includes detecting the presence of an object in the vehicle interior portion; and One or more actions are performed in response to detecting the presence of the object.
11. A method for controlling a vehicle, the method comprising: activating, by a processor, an ultra-wideband (UWB) transceiver in a first mode, wherein the UWB transceiver is configured to operate in the first mode and a second mode, and wherein the UWB transceiver is configured to perform phone-as-a-key (PaaK) location in the first mode and to perform radar sensing in the second mode; obtaining, by the processor, a trigger signal for switching the UWB transceiver from the first mode to the second mode; causing the UWB transceiver to transmit a radar pulse signal in response to obtaining the trigger signal; receiving, by the processor, a radar response signal reflected from a target location inside the vehicle; determining, by the processor, a seating area profile associated with a seating area and an occupant presence in the seating area based on the radar response signal; as well as A seating area adjustment is performed by the processor based on the determination of the seating area profile and the occupant presence.
12. The method of claim 11, wherein the seating area profile includes information associated with footwell and legroom.
13. The method of claim 11, further comprising: determining an occupant profile based on the radar response signal; associating the occupant profile with the seating area profile; as well as The seating area adjustment is performed based on the correlation.
14. The method of claim 11, further comprising causing the UWB transceiver to perform the PaaK positioning and the radar sensing in a first UWB cycle and a second UWB cycle.
15. The method of claim 14, further comprising: causing the UWB transceiver to operate in the first mode for a first predetermined duration in the first UWB cycle to perform the PaaK positioning; as well as The UWB transceiver is caused to transmit a UWB positioning signal within the first predetermined time duration.
