Multi-modal positioning
The multi-modal localization approach using V2X and sensor fusion addresses the inaccuracies and delays of GNSS and V2X failures, ensuring rapid and reliable UE positioning.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- QUALCOMM INC
- Filing Date
- 2024-12-24
- Publication Date
- 2026-07-02
AI Technical Summary
Existing methods for determining the location of user equipment (UE) using Global Navigation Satellite System (GNSS) signals are prone to inaccuracies and delays, especially in environments with signal obstructions, and V2X communication may fail, leading to unreliable positioning.
A multi-modal localization approach combining V2X communication with sensor-based localization, utilizing GNSS, inertial, optical, and RF sensors, and map data to determine UE position through a multi-hypothesis model, integrating various data sources for rapid and reliable positioning.
This method significantly reduces localization time, enhances reliability, and maintains accuracy even in scenarios where satellite or V2X communication is unavailable, enabling rapid lane-level localization.
Smart Images

Figure CN2024141713_02072026_PF_FP_ABST
Abstract
Description
MULTI-MODAL POSITIONINGBACKGROUND1. Field of Disclosure
[0001] The present disclosure relates generally to the field of wireless communications, and more specifically to determining the location of a user equipment (UE) . 2. Description of Related Art
[0002] Accurate positioning of a device such as user equipment (UE) is important for various applications. For example, performing localization of a vehicle and thereby knowing the position of the vehicle within an environment can promote effective operation of the vehicle, including advanced driver assistance systems (ADAS) . Some methods for positioning a UE or a vehicle rely on Global Navigation Satellite System (GNSS) signals. BRIEF SUMMARY
[0003] In one aspect of the present disclosure, a method of localizing a user equipment (UE) in an environment of a wireless network is disclosed. In some embodiments, the method may include requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; obtaining sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data including data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.
[0004] In another aspect of the present disclosure, a user equipment (UE) is disclosed. In some embodiments, the UE may include: one or more transceivers; one or more memories; and one or more processors communicatively coupled with the one or more transceivers and the one or more memories, the one or more processors configured to: request positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; obtain sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data including data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and determine a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.
[0005] In another aspect of the present disclosure, an apparatus is disclosed. In some embodiments, the apparatus may include: means for requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; means for obtaining sensor data responsive to an inability to localize a user equipment (UE) using the V2X communication, the sensor data including data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and means for determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.
[0006] This summary is neither intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in isolation to determine the scope of the claimed subject matter. The subject matter should be understood by reference to appropriate portions of the entire specification of this disclosure, any or all drawings, and each claim. The foregoing, together with other features and examples, will be described in more detail below in the following specification, claims, and accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS
[0007] FIG. 1 is a diagram of a positioning / sensing system, according to an embodiment.
[0008] FIG. 2 is a diagram of a 5th Generation (5G) New Radio (NR) positioning system, illustrating an embodiment of a positioning system (e.g., the positioning system of FIG. 1) implemented within a 5G NR communication network.
[0009] FIG. 3 is a diagram showing an example of a radio frequency (RF) sensing system.
[0010] FIG. 4 is a diagram showing a collection of different types of sensor data that may be obtained.
[0011] FIG. 5 is a diagram showing an example process for initializing a rapid localization process of a device with a fallback mechanism, according to some embodiments.
[0012] FIG. 5A is a diagram showing an example implementation of a V2X (vehicle-to-everything) communication-based localization that may be implemented in the example process of FIG. 5, according to some embodiments.
[0013] FIG. 6 is a block diagram showing an example process for a multi-hypothesis model that may be implemented by a UE in the example process of FIG. 5, according to some embodiments.
[0014] FIG. 7A depicts an example scenario in which a vehicle is on a path having multiple lanes.
[0015] FIG. 7B shows confidence levels associated with each lane of multiple lanes over time or evaluation rounds in the example scenario of FIG. 7A.
[0016] FIG. 8A depicts another example scenario in which a vehicle is on a path having multiple lanes.
[0017] FIG. 8B shows confidence levels associated with each lane of multiple lanes over time or evaluation rounds in the example scenario of FIG. 8A.
[0018] FIG. 9 is a flow diagram an example method of localizing a user equipment (UE) in an environment of a wireless network, according to some embodiments.
[0019] FIG. 10 is a block diagram of an embodiment of a UE, which can be utilized in embodiments as described herein.
[0020] Like reference symbols in the various drawings indicate like elements, in accordance with certain example implementations. In addition, multiple instances of an element may be indicated by following a first number for the element with a letter or a hyphen and a second number. For example, multiple instances of an element 110 may be indicated as 110-1, 110-2, 110-3 etc. or as 110a, 110b, 110c, etc. When referring to such an element using only the first number, any instance of the element is to be understood (e.g., element 110 in the previous example would refer to elements 110-1, 110-2, and 110-3 or to elements 110a, 110b, and 110c) .DETAILED DESCRIPTION
[0021] The following description is directed to certain implementations for the purposes of describing innovative aspects of various embodiments. However, a person having ordinary skill in the art will readily recognize that the teachings herein can be applied in a multitude of different ways. The described implementations may be implemented in any device, system, or network that is capable of transmitting and receiving radio frequency (RF) signals according to any communication standard, such as any of the Institute of Electrical and Electronics Engineers (IEEE) 802.15.4 standards for ultra-wideband (UWB) , IEEE 802.11 standards (including those identified as technologies) , the standard, code division multiple access (CDMA) , frequency division multiple access (FDMA) , time division multiple access (TDMA) , Global System for Mobile communications (GSM) , GSM / General Packet Radio Service (GPRS) , Enhanced Data GSM Environment (EDGE) , Terrestrial Trunked Radio (TETRA) , Wideband-CDMA (W-CDMA) , Evolution Data Optimized (EV-DO) , 1xEV-DO, EV-DO Rev A, EV-DO Rev B, High Rate Packet Data (HRPD) , High Speed Packet Access (HSPA) , High Speed Downlink Packet Access (HSDPA) , High Speed Uplink Packet Access (HSUPA) , Evolved High Speed Packet Access (HSPA+) , Long Term Evolution (LTE) , Advanced Mobile Phone System (AMPS) , or other known signals that are used to communicate within a wireless, cellular or internet of things (IoT) network, such as a system utilizing 3G, 4G, 5G, 6G, or further implementations thereof, technology.
[0022] As used herein, an “RF signal” comprises an electromagnetic wave that transports information through the space between a transmitter (or transmitting device) and a receiver (or receiving device) . As used herein, a transmitter may transmit a single “RF signal” or multiple “RF signals” to a receiver. However, the receiver may receive multiple “RF signals” corresponding to each transmitted RF signal due to the propagation characteristics of RF signals through multiple channels or paths.
[0023] Additionally, unless otherwise specified, references to “reference signals, ” “positioning reference signals, ” “reference signals for positioning, ” and the like may be used to refer to signals used for positioning of a user equipment (UE) . As described in more detail herein, such signals may comprise any of a variety of signal types but may not necessarily be limited to a Positioning Reference Signal (PRS) as defined in relevant wireless standards.
[0024] Further, unless otherwise specified, the term “positioning” as used herein may absolute location determination, relative location determination, ranging, or a combination thereof. Such positioning may include and / or be based on timing, angular, phase, or power measurements, or a combination thereof (which may include RF sensing measurements) for the purpose of location or sensing services.
[0025] In existing techniques for determining a position of a device such as a UE (e.g., a vehicle) , Global Navigation Satellite System (GNSS) signals can be used to obtain a position fix. However, GNSS signals can be noisy and produce inaccurate positions (e.g., with a 5-10 meter offset) , especially in environments with signal obstructions or multipath, such as urban jungles or inside tunnels where signals may not reach and thus become unavailable. Moreover, converging to an accurate global position fix using GNSS signals can take a long time to perform, e.g., several seconds or up to tens of seconds.
[0026] It is of interest to determine the location of a UE or vehicle without significant delay. For example, quickly performing granular localization of the vehicle to accurately determine a defined position of the vehicle may allow the driver or the vehicle itself (e.g., in the case of autonomous operation) to operate with greater safety and effectiveness. In some scenarios, granular localization can include lane-level localization to indicate which lane within a path the vehicle is on while stationary or in motion. In some examples, granular localization can result in determination of a position of the UE or vehicle in other types of defined positions, such as which parking space of a parking lot the vehicle is at.
[0027] To these ends, an approach that ensures accurate localization of a device while significantly reducing initialization time for localization is provided. In some embodiments, vehicle-to-everything (V2X) communication may be used as a first approach for determining a position of a UE (e.g., a vehicle) . Positioning information may be obtained from nearby devices, such as other vehicles, the network, the infrastructure, and so on. Such positioning information may be used to estimate a position of the vehicle, such as a lane that the vehicle is on, thus resulting in lane-level localization based on V2X. Rapid localization may be possible using V2X as an initial process, without relying on technologies that are slower to initialize or prone to error such as GNSS.
[0028] However, in some scenarios, V2X communication may fail or be unavailable for various reasons. If V2X fails, the UE may turn to a positioning method in which various available data may be fused as fallback method to V2X. For example, GNSS data (if available) , sensor data such as motion data (e.g., from an inertial measurement unit (IMU, including accelerometer and / or gyroscope data) , kinematic data (e.g., speed or velocity of a vehicle) , map data of the environment (which can provide lane information) , visual data (e.g., based on analysis of images from camera (s) equipped on the UE) , and / or RF data (e.g., object and distance detection using RF signals from RF sensors on the UE) may be integrated to estimate location information of the UE.
[0029] In some embodiments, a “multi-hypothesis model” may be created based on the location information, where the UE may be in one of multiple possible defined positions. For example, the UE may be a vehicle that is on one lane out of multiple lanes on a pathway. A probability or confidence level may be associated with each defined position (such as a lane) . Based on one or more rounds of evaluation of these confidence levels, the multi-hypothesis model can produce a determination of which position the UE is in (e.g., which lane out of multiple lanes) . Both V2X-and sensor-based localization can be useful in scenarios where when the vehicle is underground or inside a tunnel, where certain types of signals (e.g., GNSS) or information may be unavailable.
[0030] Particular aspects of the subject matter described in this disclosure can be implemented to realize one or more of the following potential advantages. In some examples, using V2X-based positioning to initialize localization of the UE, and sensor-based localization (e.g., using a multi-hypothesis model) as a fallback, can enable a rapid and reliable way to determine a position of a UE (such as vehicle) . These approaches can significantly reduce localization time compared to existing techniques, e.g., using GNSS or satellite communication. Seconds can be reduced to milliseconds in some cases. Other than rapid initialization, the described techniques are robust against communication failures. By providing multiple ways to obtain positioning, fusing multiple types of data, and considering multiple starting points (as opposed to a single hypothesis) , the UE can determine its position with greater reliability, especially in situations where certain modes of communication are not available, including where satellite positioning or even V2X-based positioning may fail or be unavailable. Parallel processing of possible positions can maintain the rapid convergence to a correct UE position by quickly identify and discarding unlikely positions.
[0031] Additional details will follow after an initial description of relevant systems and technologies.
[0032] FIG. 1 is a simplified illustration of a positioning / sensing system 100 in which a UE 105, location / sensing server 160, and / or other components of the positioning system 100 can use the techniques provided herein for a multi-modal determination of a UE 105 in an environment of a wireless network, according to an embodiment. The techniques described herein may be implemented by one or more components of the positioning / sensing system 100. In some embodiments, the UE 105 may perform techniques described herein. However, the techniques described herein are not limited to such components and may be implemented in other types of systems (not shown) . The positioning / sensing system 100 can include: a UE 105; one or more satellites 110 (also referred to as space vehicles (SVs) ) for a Global Navigation Satellite System (GNSS) (e.g., the Global Positioning System (GPS) , GLONASS, Galileo, or Beidou) and / or Non-Terrestrial Network (NTN) functionality; base stations 120; access points (APs) 130; location / sensing server 160; network 170; and external client 180. UE 105 may also refer to a mobile device (or vice versa) in some contexts of the present disclosure. Generally put, the positioning / sensing system 100 can estimate a location of the UE 105 based on RF signals received by and / or sent from the UE 105 and known locations of other components (e.g., GNSS satellites 110, base stations 120, APs 130) transmitting and / or receiving the RF signals. Additionally or alternatively, wireless devices such as the UE 105, base stations 120, and satellites 110 (and / or other NTN platforms, which may be implemented on airplanes, drones, balloons, etc. ) can be utilized to perform positioning (e.g., of one or more wireless devices) and / or perform RF sensing (e.g., of one or more objects by using RF signals transmitted by one or more wireless devices) . Additional details regarding particular location estimation techniques are discussed in more detail with regard to FIG. 2.
[0033] It should be noted that FIG. 1 provides only a generalized illustration of various components, any or all of which may be utilized as appropriate, and each of which may be duplicated as necessary. Specifically, although only one UE 105 is illustrated, it will be understood that many UEs (e.g., hundreds, thousands, millions, etc. ) may utilize the positioning / sensing system 100. Similarly, the positioning / sensing system 100 may include a larger or smaller number of base stations 120 and / or APs 130 than illustrated in FIG. 1. The illustrated connections that connect the various components in the positioning / sensing system 100 comprise data and signaling connections which may include additional (intermediary) components, direct or indirect physical and / or wireless connections, and / or additional networks. Furthermore, components may be rearranged, combined, separated, substituted, and / or omitted, depending on desired functionality. In some embodiments, for example, the external client 180 may be directly connected to location / sensing server 160. A person of ordinary skill in the art will recognize many modifications to the components illustrated.
[0034] Depending on desired functionality, the network 170 may comprise any of a variety of wireless and / or wireline networks. The network 170 can, for example, comprise any combination of public and / or private networks, local and / or wide-area networks, and the like. Furthermore, the network 170 may utilize one or more wired and / or wireless communication technologies. In some embodiments, the network 170 may comprise a cellular or other mobile network, a wireless local area network (WLAN) , a wireless wide-area network (WWAN) , and / or the Internet, for example. Examples of network 170 include a Long-Term Evolution (LTE) wireless network, a Fifth Generation (5G) wireless network (also referred to as New Radio (NR) wireless network or 5G NR wireless network) , a Wi-Fi WLAN, and the Internet. LTE, 5G and NR are wireless technologies defined, or being defined, by the 3rd Generation Partnership Project (3GPP) . Network 170 may also include more than one network and / or more than one type of network.
[0035] The base stations 120 and access points (APs) 130 may be communicatively coupled to the network 170. In some embodiments, the base station 120s may be owned, maintained, and / or operated by a cellular network provider, and may employ any of a variety of wireless technologies, as described herein below. Depending on the technology of the network 170, a base station 120 may comprise a node B, an Evolved Node B (eNodeB or eNB) , a base transceiver station (BTS) , a radio base station (RBS) , an NR NodeB (gNB) , a Next Generation eNB (ng-eNB) , or the like. A base station 120 that is a gNB or ng-eNB may be part of a Next Generation Radio Access Network (NG-RAN) which may connect to a 5G Core Network (5GC) in the case that Network 170 is a 5G network. The functionality performed by a base station 120 in earlier-generation networks (e.g., 3G and 4G) may be separated into different functional components (e.g., radio units (RUs) , distributed units (DUs) , and central units (CUs) ) and layers (e.g., L1 / L2 / L3) in view Open Radio Access Networks (O-RAN) and / or Virtualized Radio Access Network (V-RAN or vRAN) in 5G or later networks, which may be executed on different devices at different locations connected, for example, via fronthaul, midhaul, and backhaul connections. As referred to herein, a “base station” (or ng-eNB, gNB, etc. ) may include any or all of these functional components. An AP 130 may comprise a Wi-Fi AP or a AP or an AP having cellular capabilities (e.g., 4G LTE and / or 5G NR) , for example. Thus, UE 105 can send and receive information with network-connected devices, such as location / sensing server 160, by accessing the network 170 via a base station 120 using a first communication link 133. Additionally or alternatively, because APs 130 also may be communicatively coupled with the network 170, UE 105 may communicate with network-connected and Internet-connected devices, including location / sensing server 160, using a second communication link 135, or via one or more other mobile devices 145.
[0036] As used herein, the term “base station” may generically refer to a single physical transmission point, or multiple co-located physical transmission points, which may be located at a base station 120. A Transmission Reception Point (TRP) (also known as transmit / receive point) corresponds to this type of transmission point, and the term “TRP” may be used interchangeably herein with the terms “gNB, ” “ng-eNB, ” and “base station. ” In some cases, a base station 120 may comprise multiple TRPs, e.g., with each TRP associated with a different antenna or a different antenna array for the base station 120. As used herein, the transmission functionality of a TRP may be performed with a transmission point (TP) and / or the reception functionality of a TRP may be performed by a reception point (RP) , which may be physically separate or distinct from a TP. That said, a TRP may comprise both a TP and an RP. Physical transmission points may comprise an array of antennas of a base station 120 (e.g., as in a Multiple Input-Multiple Output (MIMO) system and / or where the base station employs beamforming) . According to aspects of applicable 5G cellular standards, a base station 120 (e.g., gNB) may be capable of transmitting different “beams” in different directions and performing “beam sweeping” in which a signal is transmitted in different beams, along different directions (e.g., one after the other) . The term “base station” may additionally refer to multiple non-co-located physical transmission points, where the physical transmission points may be a Distributed Antenna System (DAS) (a network of spatially separated antennas connected to a common source via a transport medium) or a Remote Radio Head (RRH) (a remote base station connected to a serving base station) .
[0037] As noted, satellites 110 may be used to implement NTN functionality, extending communication, positioning, and potentially other functionality (e.g., RF sensing) of a terrestrial network. As such, one or more satellites may be communicatively linked to one or more NTN gateways 150 (also known as “gateways, ” “earth stations, ” or “ground stations” ) . The NTN gateways 150 may be communicatively linked with base stations 120 via link 155. In some embodiments, NTN gateways 150 may function as DUs of a base station 120, as described previously. Not only can this enable the UE 105 to communicate with the network 170 via satellites 110, but this can also enable network-based positioning, RF sensing, etc.
[0038] Satellites 110 may be utilized in one or more ways. For example, satellites 110 (also referred to as space vehicles (SVs) ) may be part of a Global Navigation Satellite System (GNSS) such as the Global Positioning System (GPS) , GLONASS, Galileo or Beidou. Positioning using RF signals from GNSS satellites may comprise measuring multiple GNSS signals at a GNSS receiver of the UE 105 to perform code-based and / or carrier-based positioning, which can be highly accurate. Additionally or alternatively, satellites 110 may be utilized for NTN-based positioning, in which satellites 110 may functionally operate as TRPs (or TPs) of a network (e.g., LTE and / or NR network) and may be communicatively coupled with network 170. In particular, reference signals (e.g., PRS) transmitted by satellites 110 NTN-based positioning may be similar to those transmitted by base stations 120 and may be coordinated by a network function server, which may operate as a location / sensing server 160. In some embodiments, satellites 110 used for NTN-based positioning may be different than those used for GNSS-based positioning. In some embodiments NTN nodes may include non-terrestrial vehicles such as airplanes, balloons, drones, etc., which may be in addition or as an alternative to NTN satellites. NTN satellites 110 and / or other NTN platforms may be further leveraged to perform RF sensing. As described in more detail hereafter, satellites may use a JCS symbol in an Orthogonal Frequency-Division Multiplexing (OFDM) waveform to allow both RF sensing and / or positioning, and communication.
[0039] As used herein, the term “cell” may generically refer to a logical communication entity used for communication with a base station 120, and may be associated with an identifier for distinguishing neighboring cells (e.g., a Physical Cell Identifier (PCID) , a Virtual Cell Identifier (VCID) ) operating via the same or a different carrier. In some examples, a carrier may support multiple cells, and different cells may be configured according to different protocol types (e.g., Machine-Type Communication (MTC) , Narrowband Internet-of-Things (NB-IoT) , Enhanced Mobile Broadband (eMBB) , or others) that may provide access for different types of devices. In some cases, the term “cell” may refer to a portion of a geographic coverage area (e.g., a sector) over which the logical entity operates.
[0040] The location / sensing server 160 may comprise a server and / or other computing device configured to determine an estimated location of UE 105 and / or provide data (e.g., “assistance data” ) to UE 105 to facilitate location measurement and / or location determination by UE 105. According to some embodiments, location / sensing server 160 may comprise a Home Secure User Plane Location (SUPL) Location Platform (H-SLP) , which may support the SUPL user plane (UP) location solution defined by the Open Mobile Alliance (OMA) and may support location services for UE 105 based on subscription information for UE 105 stored in location / sensing server 160. In some embodiments, the location / sensing server 160 may comprise a Discovered SLP (D-SLP) or an Emergency SLP (E-SLP) . The location / sensing server 160 may also comprise an Enhanced Serving Mobile Location Center (E-SMLC) that supports location of UE 105 using a control plane (CP) location solution for LTE radio access by UE 105. The location / sensing server 160 may further comprise a Location Management Function (LMF) that supports location of UE 105 using a control plane (CP) location solution for NR or LTE radio access by UE 105.
[0041] In a CP location solution, signaling to control and manage the location of UE 105 may be exchanged between elements of network 170 and with UE 105 using existing network interfaces and protocols and as signaling from the perspective of network 170. In a UP location solution, signaling to control and manage the location of UE 105 may be exchanged between location / sensing server 160 and UE 105 as data (e.g., data transported using the Internet Protocol (IP) and / or Transmission Control Protocol (TCP) ) from the perspective of network 170.
[0042] As previously noted (and discussed in more detail below) , the estimated location of UE 105 may be based on measurements of RF signals sent from and / or received by the UE 105. In particular, these measurements can provide information regarding the relative distance and / or angle of the UE 105 from one or more components in the positioning / sensing system 100 (e.g., satellites 110, APs 130, base stations 120) . The estimated location of the UE 105 can be estimated geometrically (e.g., using multiangulation and / or multilateration) , based on the distance and / or angle measurements, along with known position of the one or more components.
[0043] Additionally or alternatively, the location / sensing server 160, may function as a sensing server. A sensing server can be used to coordinate and / or assist in the coordination of sensing of one or more objects (also referred to herein as “targets” ) by one or more wireless devices in the positioning / sensing system 100. This can include the UE 105, base stations 120, APs 130, other mobile devices 145, satellites 110, or any combination thereof. Wireless devices capable of performing RF sensing may be referred to herein as “sensing nodes. ” To perform RF sensing, a sensing server may coordinate sensing sessions in which one or more RF sensing nodes may perform RF sensing by transmitting RF signals (e.g., reference signals (RSs) ) , and measuring reflected signals, or “echoes, ” comprising reflections of the transmitted RF signals off of one or more objects / targets. Reflected signals and object / target detection may be determined, for example, from channel state information (CSI) received at a receiving device. Sensing may comprise (i) monostatic sensing using a single device as a transmitter (of RF signals) and receiver (of reflected signals) ; (ii) bistatic sensing using a first device as a transmitter and a second device as a receiver; or (iii) multi-static sensing using a plurality of transmitters and / or a plurality of receivers. To facilitate sensing (e.g., in a sensing session among one or more sensing nodes) , a sensing server may provide data (e.g., “assistance data” ) to the sensing nodes to facilitate RS transmission and / or measurement, object / target detection, or any combination thereof. Such data may include an RS configuration indicating which resources (e.g., time and / or frequency resources) may be used (e.g., in a sensing session) to transmit RS for RF sensing. According to some embodiments, a sensing server may comprise a Sensing Management Function (SMF or SnMF) .
[0044] Although terrestrial components such as APs 130 and base stations 120 may be fixed, embodiments are not so limited. Mobile components may be used. For example, in some embodiments, a location of the UE 105 may be estimated at least in part based on measurements of RF signals 140 communicated between the UE 105 and one or more other mobile devices 145, which may be mobile or fixed. As illustrated, other mobile devices may include, for example, a mobile phone 145-1, vehicle 145-2, static communication / positioning device 145-3, or other static and / or mobile device capable of providing wireless signals used for positioning the UE 105, or a combination thereof. Wireless signals from mobile devices 145 used for positioning of the UE 105 may comprise RF signals using, for example, (including Bluetooth Low Energy (BLE) ) , IEEE 802.11x (e.g., ) , Ultra Wideband (UWB) , IEEE 802.15x, or a combination thereof. Mobile devices 145 may additionally or alternatively use non-RF wireless signals for positioning of the UE 105, such as infrared signals or other optical technologies.
[0045] Mobile devices 145 may comprise other UEs communicatively coupled with a cellular or other mobile network (e.g., network 170) . When one or more other mobile devices 145 comprising UEs are used in the position determination of a particular UE 105, the UE 105 for which the position is to be determined may be referred to as the “target UE, ” and each of the other mobile devices 145 used may be referred to as an “anchor UE. ” For position determination of a target UE, the respective positions of the one or more anchor UEs may be known and / or jointly determined with the target UE. Direct communication between the one or more other mobile devices 145 and UE 105 may comprise sidelink and / or similar Device-to-Device (D2D) communication technologies. Sidelink, which is defined by 3GPP, is a form of D2D communication under the cellular-based LTE and NR standards. UWB may be one such technology by which the positioning of a target device (e.g., UE 105) may be facilitated using measurements from one or more anchor devices (e.g., mobile devices 145) .
[0046] According to some embodiments, such as when the UE 105 comprises and / or is incorporated into a vehicle, a form of D2D communication used by the UE 105 may comprise vehicle-to-everything (V2X) communication. V2X is a communication standard for vehicles and related entities to exchange information regarding a traffic environment. V2X can include vehicle-to-vehicle (V2V) communication between V2X-capable vehicles, vehicle-to-infrastructure (V2I) communication between the vehicle and infrastructure-based devices (commonly termed roadside units (RSUs) ) , vehicle-to-person (V2P) communication between vehicles and nearby people (pedestrians, cyclists, and other road users) , and the like. Further, V2X can use any of a variety of wireless RF communication technologies. Cellular V2X (CV2X) , for example, is a form of V2X that uses cellular-based communication such as LTE (4G) , NR (5G) and / or other cellular technologies in a direct-communication mode as defined by 3GPP. The UE 105 illustrated in FIG. 1 may correspond to a component or device on a vehicle, RSU, or other V2X entity that is used to communicate V2X messages. In embodiments in which V2X is used, the static communication / positioning device 145-3 (which may correspond with an RSU) and / or the vehicle 145-2, therefore, may communicate with the UE 105 and may be used to determine the position of the UE 105 using techniques similar to those used by base stations 120 and / or APs 130 (e.g., using multiangulation and / or multilateration) . It can be further noted that mobile devices 145 (which may include V2X devices) , base stations 120, and / or APs 130 may be used together (e.g., in a WWAN positioning solution) to determine the position of the UE 105, according to some embodiments.
[0047] In some embodiments, a computerized device or system configured to collect information about the UE 105 may be communicatively coupled with UE 105, or included or disposed in UE 105. Whether disposed in the UE 105 or coupled with the UE 105, this computerized device or system may be considered to be part of the UE 105 in some cases. In some implementations, this computerized device or system may include on-board diagnostics (OBD) 152, which may reside inside of (or coupled with) a vehicle and, among other things, track a motion parameter (e.g., speed or velocity) or other performance metric (s) of the vehicle. Coupling may be done via a controller area network (CAN) bus, as shown, and collectively the computerized device or system may be referred to as OBD / CAN. OBD 152 may collect information from its own sensors or other sensors of the vehicle, such as a vehicle speed sensor. OBD 152 may also display or provide information (e.g., regarding speed or other diagnostic information) to the UE 105 or its user. Vehicle speed may be useful reference information in embodiments that will be described below.
[0048] An estimated location of UE 105 can be used in a variety of applications, e.g., to assist direction finding or navigation for a user of UE 105 or to assist another user (e.g., associated with external client 180) to locate UE 105. A “location” is also referred to herein as a “location estimate” , “estimated location” , “location” , “position” , “position estimate” , “position fix” , “estimated position” , “location fix” or “fix” . The process of determining a location may be referred to as “positioning, ” “position determination, ” “location determination, ” or the like. A location of UE 105 may comprise an absolute location of UE 105 (e.g., a latitude and longitude and possibly altitude) or a relative location of UE 105 (e.g., a location expressed as distances north or south, east or west and possibly above or below some other known fixed location (including, e.g., the location of a base station 120 or AP 130) or some other location such as a location for UE 105 at some known previous time, or a location of a mobile device 145 (e.g., another UE) at some known previous time) . A location may be specified as a geodetic location comprising coordinates which may be absolute (e.g., latitude, longitude and optionally altitude) , relative (e.g., relative to some known absolute location) or local (e.g., X, Y and optionally Z coordinates according to a coordinate system defined relative to a local area such a factory, warehouse, college campus, shopping mall, sports stadium or convention center) . A location may instead be a civic location and may then comprise one or more of a street address (e.g., including names or labels for a country, state, county, city, road and / or street, and / or a road or street number) , and / or a label or name for a place, building, portion of a building, floor of a building, and / or room inside a building etc. A location may further include an uncertainty or error indication, such as a horizontal and possibly vertical distance by which the location is expected to be in error or an indication of an area or volume (e.g., a circle or ellipse) within which UE 105 is expected to be located with some level of confidence (e.g., 95%confidence) .
[0049] The external client 180 may be a web server or remote application that may have some association with UE 105 (e.g., may be accessed by a user of UE 105) or may be a server, application, or computer system providing a location service to some other user or users which may include obtaining and providing the location of UE 105 (e.g., to enable a service such as friend or relative finder, or child or pet location) . Additionally or alternatively, the external client 180 may obtain and provide the location of UE 105 to an emergency services provider, government agency, etc.
[0050] As previously noted, the example positioning / sensing system 100 can be implemented using a wireless communication network, such as an LTE-based or 5G NR-based network, or a future network (e.g., 6G network) . FIG. 2 shows a diagram of a 5G NR positioning / sensing system 200, illustrating an embodiment of a positioning / sensing system (e.g., positioning / sensing system 100) implementing 5G NR. The 5G NR positioning / sensing system 200 may be configured to enable wireless communication, determine the location of a UE 205 (which may be an example of UE 105 of FIG. 1) , performing RF sensing, or a combination thereof, by using access nodes, which may include NR NodeB (gNB) 210-1 and 210-2 (collectively and generically referred to herein as gNBs 210) , ng-eNB 214, and / or WLAN 216 to implement one or more positioning methods and / or one or more sensing methods. These access nodes can use RF signaling to enable the communication, implement the one or more positioning methods, and / or implement RF sensing. The gNBs 210 and / or the ng-eNB 214 may correspond with base stations 120 of FIG. 1, and the WLAN 216 may correspond with one or more access points 130 of FIG. 1. Optionally, the 5G NR positioning / sensing system 200 additionally may be configured to determine the location of a UE 205 by using an LMF 220 (which may correspond with location / sensing server 160) to implement the one or more positioning methods. The SMF 221 may be configured to coordinate RF sensing by the 5G NR positioning / sensing system 200. Here, the 5G NR positioning system 200 comprises a UE 205, and components of a 5G NR network comprising a Next Generation (NG) Radio Access Network (RAN) (NG-RAN) 235 and a 5G Core Network (5G CN) 240. A 5G network may also be referred to as an NR network; NG-RAN 235 may be referred to as a 5G RAN or as an NR RAN; and 5G CN 240 may be referred to as an NG Core network. Additional components of the 5G NR positioning / sensing system 200 are described below. The 5G NR positioning / sensing system 200 may include additional or alternative components.
[0051] The 5G NR positioning / sensing system 200 may further utilize information from satellites 110. As previously indicated, satellites 110 may comprise GNSS satellites from a GNSS system like Global Positioning System (GPS) or similar system (e.g., GLONASS, Galileo, Beidou, Indian Regional Navigational Satellite System (IRNSS) ) . Additionally or alternatively, satellites 110 may comprise NTN satellites. NTN satellites may be in low earth orbit (LEO) , medium earth orbit (MEO) , geostationary earth orbit (GEO) or some other type of orbit. NTN satellites may be communicatively coupled with the LMF 220 and may operatively function as a TRP (or TP) in the NG-RAN 235. As such, satellites 110 may be in communication with one or more gNB 210 via one or more NTN gateways 150. According to some embodiments, an NTN gateway 150 may operate as a DU of a gNB 210, in which case communications between NTN gateway 150 and CU of the gNB 210 may occur over an F interface 218 between DU and CU.
[0052] It should be noted that FIG. 2 provides only a generalized illustration of various components, any or all of which may be utilized as appropriate, and each of which may be duplicated or omitted as necessary. Specifically, although only one UE 205 is illustrated, it will be understood that many UEs (e.g., hundreds, thousands, millions, etc. ) may utilize the 5G NR positioning / sensing system 200. Similarly, the 5G NR positioning / sensing system 200 may include a larger (or smaller) number of satellites 110, gNBs 210, ng-eNBs 214, Wireless Local Area Networks (WLANs) 216, Access and mobility Management Functions (AMFs) 215, external clients 230, and / or other components. The illustrated connections that connect the various components in the 5G NR positioning / sensing system 200 include data and signaling connections which may include additional (intermediary) components, direct or indirect physical and / or wireless connections, and / or additional networks. Furthermore, components may be rearranged, combined, separated, substituted, and / or omitted, depending on desired functionality.
[0053] The UE 205 may comprise and / or be referred to as a device, a mobile device, a wireless device, a mobile terminal, a terminal, a mobile station (MS) , a Secure User Plane Location (SUPL) -Enabled Terminal (SET) , or by some other name. Moreover, UE 205 may correspond to a cellphone, smartphone, laptop, tablet, personal data assistant (PDA) , navigation device, Internet of Things (IoT) device, or some other portable or moveable device. Typically, though not necessarily, the UE 205 may support wireless communication using one or more Radio Access Technologies (RATs) such as using GSM, CDMA, W-CDMA, LTE, High Rate Packet Data (HRPD) , IEEE 802.11 Bluetooth, Worldwide Interoperability for Microwave Access (WiMAXTM) , 5G NR (e.g., using the NG-RAN 235 and 5G CN 240) , etc. The UE 205 may also support wireless communication using a WLAN 216 which (like the one or more RATs, and as previously noted with respect to FIG. 1) may connect to other networks, such as the Internet. The use of one or more of these RATs may allow the UE 205 to communicate with an external client 230 (e.g., via elements of 5G CN 240 not shown in FIG. 2, or possibly via a Gateway Mobile Location Center (GMLC) 225) and / or allow the external client 230 to receive location information regarding the UE 205 (e.g., via the GMLC 225) . The external client 230 of FIG. 2 may correspond to external client 180 of FIG. 1, as implemented in or communicatively coupled with a 5G NR network.
[0054] The UE 205 may include a single entity or may include multiple entities, such as in a personal area network where a user may employ audio, video and / or data I / O devices, and / or body sensors and a separate wireline or wireless modem. An estimate of a location of the UE 205 may be referred to as a location, location estimate, location fix, fix, position, position estimate, or position fix, and may be geodetic, thus providing location coordinates for the UE 205 (e.g., latitude and longitude) , which may or may not include an altitude component (e.g., height above sea level, height above or depth below ground level, floor level or basement level) . Alternatively, a location of the UE 205 may be expressed as a civic location (e.g., as a postal address or the designation of some point or small area in a building such as a particular room or floor) . A location of the UE 205 may also be expressed as an area or volume (defined either geodetically or in civic form) within which the UE 205 is expected to be located with some probability or confidence level (e.g., 67%, 95%, etc. ) . A location of the UE 205 may further be a relative location comprising, for example, a distance and direction or relative X, Y (and Z) coordinates defined relative to some origin at a known location which may be defined geodetically, in civic terms, or by reference to a point, area, or volume indicated on a map, floor plan or building plan. In the description contained herein, the use of the term location may comprise any of these variants unless indicated otherwise. When computing the location of a UE, it is common to solve for local X, Y, and possibly Z coordinates and then, if needed, convert the local coordinates into absolute ones (e.g., for latitude, longitude and altitude above or below mean sea level) .
[0055] Base stations in the NG-RAN 235 shown in FIG. 2 may correspond to base stations 120 in FIG. 1 and may include gNBs 210. Pairs of gNBs 210 in NG-RAN 235 may be connected to one another (e.g., directly as shown in FIG. 2 or indirectly via other gNBs 210) . The communication interface between base stations (gNBs 210 and / or ng-eNB 214) may be referred to as an Xn interface 237. Access to the 5G network is provided to UE 205 via wireless communication between the UE 205 and one or more of the gNBs 210, which may provide wireless communications access to the 5G CN 240 on behalf of the UE 205 using 5G NR. The wireless interface between base stations (gNBs 210 and / or ng-eNB 214) and the UE 205 may be referred to as a Uu interface 239.5G NR radio access may also be referred to as NR radio access or as 5G radio access. In FIG. 2, the serving gNB for UE 205 is assumed to be gNB 210-1, although other gNBs (e.g., gNB 210-2) may act as a serving gNB if UE 205 moves to another location or may act as a secondary gNB to provide additional throughput and bandwidth to UE 205.
[0056] Base stations in the NG-RAN 235 shown in FIG. 2 may also or instead include a next generation evolved Node B, also referred to as an ng-eNB, 214. Ng-eNB 214 may be connected to one or more gNBs 210 in NG-RAN 235, e.g., directly or indirectly via other gNBs 210 and / or other ng-eNBs. An ng-eNB 214 may provide LTE wireless access and / or evolved LTE (eLTE) wireless access to UE 205. Some gNBs 210 (e.g., gNB 210-2) and / or ng-eNB 214 in FIG. 2 may be configured to function as positioning-only beacons which may transmit signals (e.g., Positioning Reference Signal (PRS) ) and / or may broadcast assistance data to assist positioning of UE 205 but may not receive signals from UE 205 or from other UEs. Some gNBs 210 (e.g., gNB 210-2 and / or another gNB not shown) and / or ng-eNB 214 may be configured to function as detecting-only nodes may scan for signals containing, e.g., PRS data, assistance data, or other location data. Such detecting-only nodes may not transmit signals or data to UEs but may transmit signals or data (relating to, e.g., PRS, assistance data, or other location data) to other network entities (e.g., one or more components of 5G CN 240, external client 230, or a controller) which may receive and store or use the data for positioning of at least UE 205. It is noted that while only one ng-eNB 214 is shown in FIG. 2, some embodiments may include multiple ng-eNBs 214. Base stations (e.g., gNBs 210 and / or ng-eNB 214) may communicate directly with one another via an Xn communication interface. Additionally or alternatively, base stations may communicate directly or indirectly with other components of the 5G NR positioning / sensing system 200, such as the LMF 220 and AMF 215.
[0057] 5G NR positioning system / sensing 200 may also include one or more WLANs 216 which may connect to a Non-3GPP InterWorking Function (N3IWF) 250 in the 5G CN 240 (e.g., in the case of an untrusted WLAN 216) . For example, the WLAN 216 may support IEEE 802.11 Wi-Fi access for UE 205 and may comprise one or more Wi-Fi APs (e.g., APs 130 of FIG. 1) . Here, the N3IWF 250 may connect to other elements in the 5G CN 240 such as AMF 215. In some embodiments, WLAN 216 may support another RAT such as Bluetooth. The N3IWF 250 may provide support for secure access by UE 205 to other elements in 5G CN 240 and / or may support interworking of one or more protocols used by WLAN 216 and UE 205 to one or more protocols used by other elements of 5G CN 240 such as AMF 215. For example, N3IWF 250 may support IPSec tunnel establishment with UE 205, termination of IKEv2 / IPSec protocols with UE 205, termination of N2 and N3 interfaces to 5G CN 240 for control plane and user plane, respectively, relaying of uplink (UL) and downlink (DL) control plane Non-Access Stratum (NAS) signaling between UE 205 and AMF 215 across an N1 interface. In some other embodiments, WLAN 216 may connect directly to elements in 5G CN 240 (e.g., AMF 215 as shown by the dashed line in FIG. 2) and not via N3IWF 250. For example, direct connection of WLAN 216 to 5GCN 240 may occur if WLAN 216 is a trusted WLAN for 5GCN 240 and may be enabled using a Trusted WLAN Interworking Function (TWIF) (not shown in FIG. 2) which may be an element inside WLAN 216. It is noted that while only one WLAN 216 is shown in FIG. 2, some embodiments may include multiple WLANs 216.
[0058] Access nodes may comprise any of a variety of network entities enabling communication between the UE 205 and the AMF 215. As noted, this can include gNBs 210, ng-eNB 214, WLAN 216, and / or other types of cellular base stations. However, access nodes providing the functionality described herein may additionally or alternatively include entities enabling communications to any of a variety of RATs not illustrated in FIG. 2, which may include non-cellular technologies. Thus, the term “access node, ” as used in the embodiments described herein below, may include but is not necessarily limited to a gNB 210, ng-eNB 214 or WLAN 216.
[0059] In some embodiments, an access node, such as a gNB 210, ng-eNB 214, and / or WLAN 216, or NTN satellite 110, or a combination thereof (alone or in combination with other components of the 5G NR positioning / sensing system 200) , may be configured to, in response to receiving a request for location information from the LMF 220, obtain location measurements of uplink (UL) signals received from the UE 205) and / or obtain downlink (DL) location measurements from the UE 205 that were obtained by UE 205 for DL signals received by UE 205 from one or more access nodes. As noted, while FIG. 2 depicts access nodes (gNB 210, ng-eNB 214, WLAN 216, and NTN satellite 110) configured to communicate according to 5G NR, LTE, and Wi-Fi communication protocols, respectively, access nodes configured to communicate according to other communication protocols may be used, such as, for example, a Node B using a Wideband Code Division Multiple Access (WCDMA) protocol for a Universal Mobile Telecommunications Service (UMTS) Terrestrial Radio Access Network (UTRAN) , an eNB using an LTE protocol for an Evolved UTRAN (E-UTRAN) , or a beacon using a Bluetooth protocol for a WLAN. For example, in a 4G Evolved Packet System (EPS) providing LTE wireless access to UE 205, a RAN may comprise an E-UTRAN, which may comprise base stations comprising eNBs supporting LTE wireless access. A core network for EPS may comprise an Evolved Packet Core (EPC) . An EPS may then comprise an E-UTRAN plus an EPC, where the E-UTRAN corresponds to NG-RAN 235 and the EPC corresponds to 5GCN 240 in FIG. 2. The methods and techniques described herein for obtaining a civic location for UE 205 may be applicable to such other networks.
[0060] The gNBs 210 and ng-eNB 214 can communicate with an AMF 215, which, for positioning functionality, communicates with an LMF 220. The AMF 215 may support mobility of the UE 205, including cell change and handover of UE 205 from an access node (e.g., gNB 210, ng-eNB 214, WLAN 216, or NTN satellite 110) of a first RAT to an access node of a second RAT. The AMF 215 may also participate in supporting a signaling connection to the UE 205 and possibly data and voice bearers for the UE 205. The LMF 220 may support positioning of the UE 205 using a CP location solution when UE 205 accesses the NG-RAN 235 or WLAN 216 and may support position procedures and methods, including UE assisted or UE based and / or network based procedures / methods, such as Assisted GNSS (A-GNSS) , Observed Time Difference Of Arrival (OTDOA) (which may be referred to in NR as Time Difference Of Arrival (TDOA) ) , Frequency Difference Of Arrival (FDOA) , Real Time Kinematic (RTK) , Precise Point Positioning (PPP) , Differential GNSS (DGNSS) , Enhance Cell ID (ECID) , angle of arrival (AoA) , angle of departure (AoD) , WLAN positioning, round trip signal propagation delay (RTT) , multi-cell RTT, and / or other positioning procedures and methods. The LMF 220 may also process location service requests for the UE 205, e.g., received from the AMF 215 or from the GMLC 225. The LMF 220 may be connected to AMF 215 and / or to GMLC 225. In some embodiments, a network such as 5GCN 240 may additionally or alternatively implement other types of location-support modules, such as an Evolved Serving Mobile Location Center (E-SMLC) or a SUPL Location Platform (SLP) . It is noted that in some embodiments, at least part of the positioning functionality (including determination of a UE 205’s location) may be performed at the UE 205 (e.g., by measuring downlink PRS (DL-PRS) signals transmitted by wireless nodes such as gNBs 210, ng-eNB 214, WLAN 216, or NTN satellite 110, and / or using assistance data provided to the UE 205, e.g., by LMF 220) .
[0061] The Gateway Mobile Location Center (GMLC) 225 may support a location request for the UE 205 received from an external client 230 and may forward such a location request to the AMF 215 for forwarding by the AMF 215 to the LMF 220. A location response from the LMF 220 (e.g., containing a location estimate for the UE 205) may be similarly returned to the GMLC 225 either directly or via the AMF 215, and the GMLC 225 may then return the location response (e.g., containing the location estimate) to the external client 230.
[0062] A Network Exposure Function (NEF) 245 may be included in 5GCN 240. The NEF 245 may support secure exposure of capabilities and events concerning 5GCN 240 and UE 205 to the external client 230, which may then be referred to as an Access Function (AF) and may enable secure provision of information from external client 230 to 5GCN 240. NEF 245 may be connected to AMF 215 and / or to GMLC 225 for the purposes of obtaining a location (e.g., a civic location) of UE 205 and providing the location to external client 230.
[0063] As further illustrated in FIG. 2, the LMF 220 may communicate with the gNBs 210 and / or with the ng-eNB 214 using an NR Positioning Protocol annex (NRPPa) as defined in 3GPP Technical Specification (TS) 38.455. NRPPa messages may be transferred between a gNB 210 and the LMF 220, and / or between an ng-eNB 214 and the LMF 220, via the AMF 215. As further illustrated in FIG. 2, LMF 220 and UE 205 may communicate using an LTE Positioning Protocol (LPP) as defined in 3GPP TS 37.355. Here, LPP messages may be transferred between the UE 205 and the LMF 220 via the AMF 215 and a serving gNB 210-1 or serving ng-eNB 214 for UE 205. For example, LPP messages may be transferred between the LMF 220 and the AMF 215 using messages for service-based operations (e.g., based on the Hypertext Transfer Protocol (HTTP) ) and may be transferred between the AMF 215 and the UE 205 using a 5G NAS protocol. The LPP protocol may be used to support positioning of UE 205 using UE assisted and / or UE based position methods such as A-GNSS, RTK, TDOA, multi-cell RTT, AoD, and / or ECID. The NRPPa protocol may be used to support positioning of UE 205 using network based position methods such as ECID, AoA, uplink TDOA (UL-TDOA) and / or may be used by LMF 220 to obtain location related information from gNBs 210 and / or ng-eNB 214, such as parameters defining DL-PRS transmission from gNBs 210 and / or ng-eNB 214.
[0064] In the case of UE 205 access to WLAN 216, LMF 220 may use NRPPa and / or LPP to obtain a location of UE 205 in a similar manner to that just described for UE 205 access to a gNB 210 or ng-eNB 214. Thus, NRPPa messages may be transferred between a WLAN 216 and the LMF 220, via the AMF 215 and N3IWF 250 to support network-based positioning of UE 205 and / or transfer of other location information from WLAN 216 to LMF 220. Alternatively, NRPPa messages may be transferred between N3IWF 250 and the LMF 220, via the AMF 215, to support network-based positioning of UE 205 based on location related information and / or location measurements known to or accessible to N3IWF 250 and transferred from N3IWF 250 to LMF 220 using NRPPa. Similarly, LPP and / or LPP messages may be transferred between the UE 205 and the LMF 220 via the AMF 215, N3IWF 250, and serving WLAN 216 for UE 205 to support UE-assisted or UE-based positioning of UE 205 by LMF 220, described in more detail hereafter.
[0065] Positioning of the UE 205 in a 5G NR positioning / sensing system 200 further may utilize measurements between the UE 205 and one or more other UEs 255 via a sidelink connection SL 260. As shown in FIG. 2, the one or more other UEs 255 may comprise any of a variety of different device types, including mobile phones, vehicles, roadside units (RSUs) , other device types, or any combination thereof. One or more position measurement signals sent via SL 260 to the UE 205 from the one or more other UEs 255, to the one or more other UEs 255 from the UE 205, or both. Various signals may be used for position measurement, including sidelink PRS (SL-PRS) . In some instances, the position of at least one of the one or more of the other UEs 255 may be determined at the same time (e.g., in the same positioning session) as the position of the UE 205. In some embodiments, the LMF 220 may coordinate the transmission of positioning signals via SL 260 between the UE 205 and the one or more other UEs 255. Additionally or alternatively, the UE 205 and the one or more other UEs 255 may coordinate a positioning session between themselves, without an LMF 220 or even a Uu connection 239 to an access node of the NG-RAN 235. To do so, the UE 205 and the one or more other UEs 255 may communicate messages via the SL 260 using sidelink positioning protocol (SLPP) . In some scenarios, the one or more other UEs 255 may have a Uu connection 239 with an access node of the NG-RAN 235 and / or Wi-Fi connection with WLAN 216 when the UE 205 does not. In such instances, the one or more other UEs 255 may operate as relay devices, relaying communications to the network (e.g., LMF 220) from the UE 205. In such instances, a plurality of other UEs 255 may form a chain between the UE 205 and the access node.
[0066] In a 5G NR positioning / sensing system 200, positioning and sensing methods can be categorized as being “UE assisted” or “UE based. ” This may depend on where the request for determining the position of the UE 205 originated. If, for example, the request originated at the UE (e.g., from an application, or “app, ” executed by the UE) , the positioning method may be categorized as being UE based. If, on the other hand, the request originates from an external client 230, LMF 220, or other device or service within the 5G network, the positioning method may be categorized as being UE assisted (or “network-based” ) .
[0067] With a UE-assisted position method, UE 205 may obtain location measurements and send the measurements to a location server (e.g., LMF 220) for computation of a location estimate for UE 205. For RAT-dependent position methods location measurements may include one or more of a Received Signal Strength Indicator (RSSI) , Round Trip signal propagation Time (RTT) , Reference Signal Received Power (RSRP) , Reference Signal Received Quality (RSRQ) , Reference Signal Time Difference (RSTD) , Time of Arrival (TOA) , AoA, Receive Time-Transmission Time Difference (Rx-Tx) , Differential AoA (DAoA) , AoD, or Timing Advance (TA) for gNBs 210, ng-eNB 214, and / or one or more access points for WLAN 216. Additionally or alternatively, similar measurements may be made of sidelink signals transmitted by other UEs, which may serve as anchor points for positioning of the UE 205 if the positions of the other UEs are known. The location measurements may also or instead include measurements for RAT-independent positioning methods such as GNSS (e.g., GNSS pseudorange, GNSS code phase, and / or GNSS carrier phase for satellites 110) , WLAN, etc.
[0068] With a UE-based position method, UE 205 may obtain location measurements (e.g., which may be the same as or similar to location measurements for a UE assisted position method) and may further compute a location of UE 205 (e.g., with the help of assistance data received from a location server such as LMF 220, an SLP, or broadcast by gNBs 210, ng-eNB 214, or WLAN 216) .
[0069] With a network-based position method, one or more base stations (e.g., gNBs 210 and / or ng-eNB 214) , one or more APs (e.g., in WLAN 216) , or N3IWF 250 may obtain location measurements (e.g., measurements of RSSI, RTT, RSRP, RSRQ, AoA, or TOA) for signals transmitted by UE 205, and / or may receive measurements obtained by UE 205 or by an AP in WLAN 216 in the case of N3IWF 250, and may send the measurements to a location server (e.g., LMF 220) for computation of a location estimate for UE 205.
[0070] Positioning of the UE 205 also may be categorized as UL, DL, or DL-UL based, depending on the types of signals used for positioning. If, for example, positioning is based solely on signals received at the UE 205 (e.g., from a base station or other UE) , the positioning may be categorized as DL based. On the other hand, if positioning is based solely on signals transmitted by the UE 205 (which may be received by a base station or other UE, for example) , the positioning may be categorized as UL based. Positioning that is DL-UL based includes positioning, such as RTT-based positioning, that is based on signals that are both transmitted and received by the UE 205. Sidelink (SL) -assisted positioning comprises signals communicated between the UE 205 and one or more other UEs. According to some embodiments, UL, DL, or DL-UL positioning as described herein may be capable of using SL signaling as a complement or replacement of SL, DL, or DL-UL signaling.
[0071] Depending on the type of positioning (e.g., UL, DL, or DL-UL based) the types of reference signals used can vary. For DL-based positioning, for example, these signals may comprise PRS (e.g., DL-PRS transmitted by base stations or SL-PRS transmitted by other UEs) , which can be used for TDOA, AoD, and RTT measurements. Other reference signals that can be used for positioning (UL, DL, or DL-UL) may include Sounding Reference Signal (SRS) , Channel State Information Reference Signal (CSI-RS) , synchronization signals (e.g., synchronization signal block (SSB) Synchronizations Signal (SS) ) , Physical Uplink Control Channel (PUCCH) , Physical Uplink Shared Channel (PUSCH) , Physical Sidelink Shared Channel (PSSCH) , Demodulation Reference Signal (DMRS) , etc. Moreover, reference signals may be transmitted in a Tx beam and / or received in an Rx beam (e.g., using beamforming techniques) , which may impact angular measurements, such as AoD and / or AoA.
[0072] The principles described above with respect to positioning may be generally extended to RF sensing. That is, RF sensing may be UE based (e.g., originated from the UE) and / or UE assisted (e.g., originated from a non-UE entity) , and may involve UL signals, DL signals, or both. However, RF sensing may differ from positioning in various ways. For example, as previously noted and described in more detail below, RF sensing may involve the use of specific RF sensing signals. Further, RF sensing may be performed in a monostatic, bistatic, or multi-static manner, as described above, where RF sensing nodes comprise a UE (e.g., UE 205) and / or one or more access nodes (e.g., gNBs 210, ng-eNB 214, WLAN 216, NTN satellites 110, or any combination thereof) .
[0073] FIG. 3 is a diagram showing an example of an RF sensing system 305 and associated terminology. As used herein, the terms “waveform” and “sequence” and derivatives thereof are used interchangeably to refer to RF signals generated by a transmitter of the RF sensing system and received by a receiver of the RF sensing system for object detection. A “pulse” and derivatives thereof are generally referred to herein as waveforms comprising a sequence or complementary pair of sequences transmitted and received to generate a channel impulse response (CIR) . The RF sensing system 305 may comprise a standalone device or may be integrated into a larger electronic device (e.g., the UE disclosed herein) , such as a mobile phone, UE, a base station / access node, a satellite, or other type of sensing node as described herein. (Example components of a UE are illustrated in FIG. 10, discussed in detail hereafter. )
[0074] Sensing algorithms may utilize monostatic sensing or bistatic or multistatic sensing. Monostatic sensing involves using a pair of co-located transmitter and receiver to sense the environment, while bistatic or multistatic sensing involves using separated transmitters and receivers to sense environment.
[0075] It can be noted that although the example RF sensing system 305 of FIG. 3 is illustrated in a monostatic configuration, embodiments are not so limited. As noted elsewhere herein, RF sensing nodes may be configured to perform RF sensing in a monostatic, bistatic, or multi-static configuration, or any combination thereof (e.g., depending on the circumstances of a particular instance) . As such, components of an RF sensing system 305 within an RF sensing node may vary. For example, RF sensing nodes performing only transmitting or only receiving during RF sensing may include only respective components related to the transmitting or receiving. Again, embodiments may vary, depending on desired functionality.
[0076] With regard to the functionality of the RF sensing system 305 in FIG. 3, the RF sensing system 305 can detect the distance, direction, and / or speed of objects (e.g., an object 310) by generating a series of transmitted RF signals 312 (comprising one or more pulses) . Some of these transmitted RF signals 312 may reflect off of the object 310, and these reflected RF signals 314 (or “echoes” ) may then be processed by the RF sensing system 305 using beamforming (BF) and digital signal processing (DSP) techniques to determine the location of the object 310 (azimuth, elevation, velocity (e.g., from Doppler measurements) , and / or range) relative to the RF sensing system 305. Constant false alarm rate (CFAR) detection may be part of this processing, but may not necessarily be used in every instance, or “occasion, ” in which RF sensing is performed.
[0077] To enable RF sensing, RF sensing system 305 may in some implementations include a processing unit 315, a memory 317, a multiplexer (mux) 320, Tx processing circuitry 325, and Rx processing circuitry 330. Some implementations of the RF sensing system 305 may include additional components not illustrated, such as a power source, user interface, or electronic interface) . It can be noted, however, that these components of the RF sensing system 305 may be rearranged or otherwise altered in alternative embodiments, depending on desired functionality. Moreover, as used herein, the terms “transmit circuitry” or “Tx circuitry” refer to any circuitry utilized to create and / or transmit the transmitted RF signal 312. Likewise, the terms “receive circuitry” or “Rx circuitry” refer to any circuitry utilized to detect and / or process the reflected RF signal 314. As such, “transmit circuitry” and “receive circuitry” may not only comprise the Tx processing circuitry 325 and Rx processing circuitry 330 respectively but may also comprise the mux 320 and processing unit 315. In some embodiments, the processing unit 315 may compose at least part of a modem and / or wireless communications interface. In some embodiments, more than one processing unit may be used to perform the functions of the processing unit 315 described herein.
[0078] The Tx processing circuitry 325 and Rx circuitry 330 may comprise subcomponents for respectively generating and detecting RF signals. As a person of ordinary skill in the art will appreciate, the Tx processing circuitry 325 may therefore include a pulse generator, digital-to-analog converter (DAC) , a mixer (for up-mixing the signal to the transmit frequency) , one or more amplifiers (for powering the transmission via Tx antenna array 335) , etc. The Rx processing circuitry 330 may have similar hardware for processing a detected RF signal. In particular, the Rx processing circuitry 330 may comprise an amplifier (for amplifying a signal received via Rx antenna 340) , a mixer for down-converting the received signal from the transmit frequency, an analog-to-digital converter (ADC) for digitizing the received signal, and a pulse correlator providing a matched filter for the pulse generated by the Tx processing circuitry 325. The Rx processing circuitry 330 may therefore use the correlator output as the CIR, which can be processed by the processing unit 315 (or other circuitries) . Processing of the CIR may include object detecting, range, speed, or direction of arrival (DoA) estimation.
[0079] Beamforming is further enabled by a Tx antenna array 335 and an Rx antenna array 340. Each antenna array 335, 340 may include a plurality of antenna elements. It can be noted that, although the antenna arrays 335, 340 of FIG. 3 can include two-dimensional arrays, embodiments are not so limited. Arrays may simply include a plurality of antenna elements along a single dimension that provides for spatial cancelation between the Tx and Rx sides of the RF sensing system 305. As a person of ordinary skill in the art will appreciate, the relative location of the Tx and Rx sides, in addition to various environmental factors can impact how spatial cancelation may be performed.
[0080] It can be noted that the properties of the transmitted RF signal 312 may vary, depending on the technologies utilized. Techniques provided herein can apply generally to “mmWave” technologies, which typically operate at 57–71 GHz, but may include frequencies ranging from 30–300 GHz. This includes, for example, frequencies utilized by the 802.11ad Wi-Fi standard (operating at 60 GHz) . That said, some embodiments may utilize RF signals with frequencies outside this range. For example, in some embodiments, 5G frequency bands (e.g., 28 GHz) may be used.
[0081] Because RF sensing may be performed in the same frequency bands as communication (e.g., cellular and / or WLAN communication) , hardware may be utilized for both communication and RF sensing, as previously noted. For example, one or more of the components of the RF sensing system 305 shown in FIG. 3 may be included in a wireless modem (e.g., Wi-Fi, 5G, or other modems) . Additionally, techniques may apply to RF signals comprising any of a variety of pulse types, including compressed pulses (e.g., comprising Chirp, Golay, Barker, or Ipatov sequences) may be utilized. That said, embodiments are not limited to such frequencies and / or pulse types. Additionally, because the RF sensing system may be capable of sending RF signals for communication (e.g., using 802.11 communication technology) , embodiments may leverage channel estimation used in communication for performing the RF sensing as provided herein. Accordingly, the pulses may be the same as those used for channel estimation in communication.
[0082] As noted, the RF sensing system 305 may be integrated into an electronic device in which RF sensing is desired. For example, the RF sensing system 305, which can perform RF sensing, may be part of communication hardware found in a mobile device or UE (e.g., 105, 205) , including modern mobile phones. Other devices, too, may utilize the techniques provided herein. These can include, for example, other mobile devices (e.g., tablets, portable media players, laptops, wearable devices, other electronic devices (e.g., security devices, on-vehicle systems, specialized or dedicated RF sensing devices) , wireless nodes of the communication network (e.g., access nodes, such as base stations and / or satellites) , or the like. That said, electronic devices (e.g., RF sensing nodes) into which an RF sensing system 305 may be integrated are not limited to such devices.
[0083] In RF sensing, a wireless signal can be transmitted from one or multiple transmit points and received at one or multiple receive points after being reflected off a target. RF sensing can enable many candidate applications, including intruder detection, animal / pedestrian / unmanned aerial vehicle (UAV) intrusion detection in highways and railways, rainfall monitoring, flooding awareness, autonomous driving, automated guided vehicle (AGV) detection / tracking / collision avoidance, smart parking and assistance, UAV trajectory and tracking, crowd management, sleep / health monitoring, gesture recognition, XR streaming, public safety, search and rescue, and more. Further, RF sensing is expected to be incorporated into wireless standards (e.g., 5G, 6G) , and therefore may be performed in the future in a cellular network.
[0084] FIG. 4 is a diagram showing a collection of different types of sensor data that may be obtained. As illustrated, various types of data may be obtained.
[0085] In some cases, optical data 402 may be obtained by a UE (e.g., UE 105) , e.g., via one or more optical sensors disposed within a UE or communicatively coupled with the UE. An optical sensor may include an infrared (IR) sensor, an ultraviolet (UV) sensor, light detection and ranging (LIDAR) , a camera, or a light detector or a photosensor. An IR sensor may be configured to detect, e.g., IR radiation (e.g., between 700 nm to 1 mm in wavelength) , and produce thermal data or low-light visual data. A UV sensor may be configured to detect, e.g., ultraviolet radiation (e.g., between 10 nm to 400 nm in wavelength) .
[0086] In some cases, optical data 402 may include visual data 404, such as visual images or video, or image data for such images or video, obtained using a camera disposed in or coupled with the UE.
[0087] In some cases, radio frequency (RF) data 406 may be obtained by a UE, e.g., via an RF sensor. An example of an RF sensor may be a radar, which can detect (and / or emit) electromagnetic waves (e.g., outside the IR or UV spectrum) that reflect from objects outside of the UE and return to the radar sensor. The RF sensor may be configured to use the Doppler effect with the radio wave emissions to, e.g., determine the velocity of moving objects or determine the velocity of the UE with respect to a stationary object. Radio emissions and reflections with an RF sensor can also allow the sensor to detect obstacles (e.g., walls, other vehicles) .
[0088] Generally, optical data 402 and / or RF data 406 may be obtained using spatial sensing. However, the types of sensor data that may be obtained is not limited to these enumerated examples. In some applications, spatial sensing may also include other types such as acoustic sensing, e.g., sonar.
[0089] In some cases, location data 408 may be obtained by a UE, e.g., via one or more position methods described above, such as by obtaining location measurements, which may involve exchange of reference signals, assistance data, etc. as discussed above.
[0090] In addition, in some cases, location data 408 may include GNSS data 410. That is, one or more GNSS receivers disposed in the UE or communicatively coupled with the UE may obtain GNSS signals from one or more satellites. Examples of GNSS systems (GPS and others) are noted above, and may be used to obtain the GNSS data 410. In some implementations, position information from GNSS data may be used to determine the speed or velocity of a UE (e.g., a vehicle) . For example, by determining or estimating a position of the UE over time, velocity can also be determined or estimated based on the change in position over time. In some applications, velocity data of the UE can be determined and tracked over time as well. Examples are depicted in and discussed with respect to FIGS. 5 and 6.
[0091] In some scenarios, GNSS measurements included in GNSS data 410 (and / or other measurements obtained using sensors discussed herein) may experience a dilution of precision (DOP) . DOP may refer to an error propagation on positional measurement precision. Such errors in the measurements will affect the final state estimation. More or less DOP may occur depending on how much error there is in the measurements, geometry and position of the satellites, and / or the position of the UE. DOP can be expressed in various ways, including horizontal dilution of precision (HDOP) , vertical dilution of precision (VDOP) , position (3D) dilution of precision (PDOP) , time dilution of precision (TDOP) , and geometric dilution of precision (GDOP, the effect of geometry of the satellites on position error) . DOP may be representative of the quality of GNSS signals, and may also be a measure of the “goodness” of the positions of GNSS satellites relative to the receiver location. A better (lower) DOP value can also indicate the probability of a more accurate position solution.
[0092] In some cases, motion data 412 may be obtained by a UE, e.g., via an IMU (which may include an accelerometer, a gyroscope, and / or a magnetometer) or other motion sensor. Motion data 412 may include pose information, rotation information (including, e.g., angular rate, angular velocity, yaw rate) , acceleration information (including force) . “Pose” as used herein may refer to position and / or orientation.
[0093] In some cases, motion data 412 may include kinematic data 414 obtained by the UE, such as velocity of a UE, or vehicular speed obtained using OBD / CAN (e.g., OBD 152) . Such velocity is directly measurable using OBD 152. However, velocity can be measured in other ways, such as by using GNSS position information or other location data, or RF sensing, as discussed above.
[0094] In some embodiments, some or all of the sensed information discussed above can be collected as sensor data 420. The collected stored sensor data 420 may correspond to a period of time. In some cases, the stored sensor data 420 may be stored temporarily in cache. In some approaches, a period of time of interest may be selected from the stored sensor data 420. State data of a UE can encompass the sensor data 420 corresponding to the period of time. In some implementations, some or all of the sensor data 420 may be stored on the UE such that the UE can access and process (e.g., compare) the sensor data 420. In other implementations, some or all of the sensor data 420 may be stored elsewhere, such as a remote storage or server. Rapid Initialization and Fallback for Device Localization
[0095] As noted above, localization of a device (e.g., UE such as a vehicle) can be performed to obtain a position fix of the device or otherwise determining a location of the device within an environment. For example, GNSS data may be obtained by the UE, e.g., based on signals received from a GNSS satellite via a GNSS receiver. Localization may begin with obtaining an initial position of the UE based on the GNSS data and / or updating the position of the UE based on the GNSS data. In some cases, GNSS data may be combined with sensor data. For example, motion data from an IMU (including, e.g., an accelerometer and / or a gyroscope) can be integrated with the GNSS data. Integrating IMU data with GNSS data may smooth out errors in GNSS signals, and can corroborate measurements based on the GNSS signals (e.g., by indication that the UE is moving in a direction) . Further sensor data such as visual data (e.g., camera images) can be used to detect environmental objects, features, or other markers (e.g., lane markings) , and radar data from an RF sensor can also detect objects (e.g., roadside barriers) . In addition, the UE may obtain map data, which may include information about the environment, e.g., representations, layouts, or boundaries associated with roads, lanes, or other defined locations (e.g., parking lot spaces) in the environment, along with their absolute or relative locations. Map data may be known to a network and accessible by the UE, and may allow the UE to map or estimate its position, e.g., to the closest lane. If the combination of GNSS data with sensor data yields a position with an error within acceptable limits, the UE localization can be considered to be successful. If not within acceptable limits, the localization process may return to obtain new GNSS data and / or sensor data.
[0096] Such existing approaches for UE localization using GNSS data and sensor fusion techniques may require a lengthy calculation time to obtain the position fix (e.g., several seconds) , which may be disadvantageous in high-velocity applications with need for consistent and responsive positioning such as vehicle navigation. Moreover, such approaches may not be available in certain types of environments, such as underground, inside a tunnel, or urban jungles with multipath and other signal obstructions. In particular, GNSS signals may not reach the UE or a vehicle that is driving along paths that are underground or inside a tunnel.
[0097] FIG. 5 is a block diagram showing an example process 500 for initializing a rapid localization process of a device with a fallback mechanism, according to some embodiments. The example process 500 may accelerate initialization of vehicle localization using V2X (vehicle-to-everything) communication with a fallback “multi-hypothesis” model. In most scenarios, the initialization time can be significantly reduced from seconds to milliseconds using the disclosed process.
[0098] In some embodiments, the example process 500 may include a V2X communication-based localization 510 and / or a sensor-based localization 530, where the sensor-based localization 530 may be performed as a fallback option to the V2X communication-based localization 510.
[0099] In some embodiments, the V2X communication-based localization 510 may include V2X communication 512. V2X communications enable the exchange of information (e.g., positioning information) between devices, for example, between vehicles or between vehicle and network infrastructure. Various types of V2X communication can be performed between various types of devices. In different scenarios, a vehicle may perform V2X communication with various other entities and / or devices: one or more other nearby vehicles (vehicle-to-vehicle, V2V) , which can be used to obtain an initial estimate of the vehicle ‘s position in global coordinates or relative positions of two vehicles; the infrastructure (vehicle-to-infrastructure, V2I) such as traffic lights, lane markers, or parking meters; the network (vehicle-to-network, V2N) ; one or more pedestrians (vehicle-to-pedestrian, V2P) and their devices (e.g., UEs) ; one or more houses (vehicle-to-home, V2H) or other structures having associated position information (e.g., latitudinal and longitudinal information) ; and / or one or more devices (vehicle-to-device, V2D) using short-range protocols such as Bluetooth or Wi-Fi Direct. Thus, V2X may leverage cellular-based communication or WLAN-based communication.
[0100] As such, V2X communication 512 may involve communication by a UE or vehicle with at least one other vehicle or device, and may result in sending and receiving of positioning information. In some examples, positioning information received from other entities and / or devices may include relative positions of the vehicle and the other entity or device, or global coordinates of the other entity or device (which may also be derived from the relative positions) . Other information such as speed or velocity of the other entity or device may also be received. For example, rotation information may help localize the UE or vehicle in some scenarios (e.g., on curved roads) . In addition, the V2X communication 512 may involve estimation of a distance between the two devices (vehicles in this case) , e.g., using sidelink signals exchanged between the vehicles. For instance, signal-based measurements may be performed, such as round trip signal propagation delay or Round Trip Time (RTT) or Time Difference Of Arrival (TDOA) .
[0101] Based on V2X communication 512, the UE or vehicle may evaluate whether sufficient localization information was successfully obtained, at block 514.
[0102] If localization information has been successfully obtained, localization process 516 may be performed to determine a position of the UE or vehicle. The localization process 516 may result in an output of the determined position or location 545. For example, the localization process 516 may result in a determination of which specific lane the vehicle is on out of multiple lanes. In some implementations of the localization process 516, the vehicle may perform lane mapping based on map data of the environment or region (which may be received from any of the above entities or devices including the network, or may already be possessed by the vehicle) . A lateral offset from the mapped lane may also be determined. That is, the lane that the vehicle is on may be determined from multiple lanes using the information and the map data.
[0103] As an illustrative example, V2V information may indicate that the vehicle is to the right of a second vehicle from which the information was received. The second vehicle may be on the second lane of a four-lane road. V2N information may indicate that the vehicle is to the left of a base station. Given mapping data and measurements between the vehicle and the second vehicle and / or the base station, it may be determined that the vehicle is on the fourth lane from the left. In some implementations, offset or error information may also be determined. This lane position may be output as lane-level location information.
[0104] In other scenarios, other types of granular locations can also be determined via the localization process 516, such as a parking space on a parking lot or along a row of street parking meters, floor level of a structure, etc.
[0105] Using the V2X communication-based localization 510 of the example process 500 may be a rapid way to initialize a localization process 516 and output a position fix or location 545 of the UE as discussed above. Initialization time may be in the millisecond range, as opposed to seconds that may be needed in existing approaches for localization.
[0106] Turning briefly to FIG. 5A, a diagram shows an example implementation of the V2X communication-based localization 510 as implemented by a UE (such as a vehicle) in the example process of FIG. 5, according to some embodiments. In some implementations, V2X communication 512 may include sending a V2X request 552 to a network 550 of the environment which is accessible by a UE (e.g., via wireless communication) . In some scenarios, the network 550 may include a device (e.g., a UE, a vehicle) and / or access points or base stations. The vehicle and at least a portion of these network entities may be configured for V2X communication with one another.
[0107] In some cases, V2X request 552 may include a request by the vehicle for localization information 554 to a network entity (e.g., another vehicle, a device, base station, infrastructure) . In response to the V2X request 552, the vehicle may receive the localization information 554 and perform V2X communication 512 and / or localization process 516. The localization information 554 may be an example of the localization information received at block 514, which may include localization information obtained via V2X.
[0108] However, there are various reasons and scenarios in which V2X communication 512 may fail. For example, a response to a V2X request (e.g., 552) may not be received. In some examples, V2X communication 512 may be unavailable, e.g., if a V2X communication link is not available, a V2X-capable device or network node is not in range, the vehicle or UE experiences hardware failure, etc. Put another way, in some cases, at least a portion of the V2X network may be inoperative, or maybe there may not be any UEs or vehicles nearby.
[0109] In some cases, the localization process 516 may fail. For instance, positioning information (e.g., 554) may be insufficient, the position information may contain too much noise or may be corrupt, or a determined position fix obtained based on position information received via V2X may have an unacceptable amount of error. In some instances, the determined position may not correlate with map data or have a mismatch with the map data, such that the received positioning information cannot be resolved using or matched with the map data. As an example, the estimated position may not overlap to a sufficient extent with the map data, where determined position of the vehicle is outside of lanes (or other defined positions) indicated by the map data. If the vehicle is determined to be driving over a lake, for example, it may be considered a mismatch with map data that provides a road or lane nearby.
[0110] In some cases, V2X-or GNSS-based positioning may fall below a threshold confidence level. In some cases, V2X communication may be given multiple tries to successfully initialize or perform, but failing after a threshold number of attempts may be considered failure of V2X-based localization 510 (including V2X communication 512 and / or localization process 516) .
[0111] Hence, V2X-based localization 510 may experience failure or unavailability of V2X communication 512, failure to obtain localization information (e.g., at block 514) , or failure of localization process 516) .
[0112] However, in some embodiments, the example process 500 may fall back to a different type of localization process as disclosed herein. More specifically, a sensor-based localization 530 may be performed based on failure or unavailability of V2X-based localization 510 according to one or more of the above failure or unavailability conditions. Put another way, sensor-based localization 530 may be performed responsive to an inability to localize the UE using the V2X communication, the inability to localize determined based on a lack of response to the request, or a failure to localize the UE using positioning information received via the V2X communication.
[0113] The sensor-based localization 530 may include a “multi-hypothesis model” in which a position of the UE or vehicle may be determined based on multiple hypotheses of which among multiple possible defined positions the UE could be, which in some approaches can be narrowed iteratively until the highest-confidence hypothesis is selected and output as the position of the UE.
[0114] It will be appreciated that, with a single hypothesis, the positioning system might struggle if the initial position estimate from GNSS is significantly off. The multi-hypothesis model mitigates this by considering multiple starting points, increasing the chance that one of them is closer to the true position. All (or some of) the possible positions (e.g., lanes) are evaluated in parallel, each being updated and corrected based on incoming sensor data. The parallel processing helps in quickly identifying and discarding unlikely positions.
[0115] In some approaches, the sensor-based localization 530 may include obtaining one or more types of sensor data via a receiver or a sensor of a UE (e.g., implemented as a vehicle) , which may be those illustrated and discussed with respect to FIG. 4. For example, GNSS signals may be obtained using a GNSS receiver of the UE, and the UE may thereby obtain GNSS data 532. As further examples, various types of motion, visual, and / or RF data may be obtained using respective types of sensors, such as an IMU, a camera or other visual sensor, and / or RF sensor (e.g., radar) , respectively.
[0116] In some embodiments, sensor-based localization 530 may include collection of GNSS data 532. In some implementations, the GNSS data 532 may be used to obtain a position 533 of the UE or a vehicle. In some cases, the position 533 may be an initial position. In some cases, such as when a final position is not obtained or able to be obtained (e.g., at block 540) , the position of the UE may be updated based on additional GNSS data 532.
[0117] In some embodiments, the sensor-based localization 530 may include collection of motion data 534 associated with the UE or vehicle (e.g., using an IMU of the UE or vehicle) . In some cases, motion data 534 may include kinematic data, such as velocity of the UE or the vehicle. In some implementations, motion data 534 and / or kinematic data associated with the UE or vehicle may be integrated with GNSS data 532 (to obtain integrated data 535) . For example, GNSS data may be combined or fused with sensor data as mentioned above.
[0118] In some embodiments, the sensor-based localization 530 may include collection of other types of data 536, such as visual data, RF data, and / or map data of the environment (e.g., from a network entity) . In some example, the UE may be equipped with a camera and / or an RF sensor to obtain sensor data such as visual data and / or RF data, respectively. Such sensor data may enable the UE to detect the presence of and / or identify objects or features thereof (such as edges of objects) in the environment. For instance, the camera may be configured to capture a scene of the environment (e.g., as one or more images or a video) , such as a portion of the proximate surroundings of the UE.In some examples, lane markings may be visually identified. Other vehicles, road signage, etc. may also be visually identified. The radar of the UE may be configured to detect objects as well as determine a distance to such objects, such as roadside barriers, road signage, other vehicles in the lane or other lanes, etc.
[0119] In some implementations, camera images can be analyzed using computer vision techniques and algorithms. Various computer vision and imaging techniques may be used to identify and characterize objects or persons. As but an illustrative example, a person in an image captured by the camera may be identified as a person (e.g., a pedestrian) using one or more of these techniques. In some cases, a probability of the object being a person may be determined and compared against a threshold, where meeting or exceeding the threshold may result in an output. In some cases, a vehicle may have multiple cameras (e.g., on the left and the right side, front, and / or back) .
[0120] For instance, analysis logic may be implemented by a model (or a device or system implementing the model, or a component of the device or system, such as a processor apparatus) to perform an image processing routine such as segmentation or other edge finding routine. For instance, an edge detection method such as segmentation may be used to find edges or boundaries of objects in the environment within an image or video (multiple image frames) . For instance, keypoints may be identified and matched between multiple images, e.g., using image processing algorithms such as scale-invariant feature transform (SIFT) feature detectors, and / or feature matching algorithms such as Fast Library for Approximate Nearest Neighbors (FLANN) -based methods to choose the best algorithm and optimum parameters (or using similar methods optimized for fast nearest neighbor search in large datasets) and find matches. Further processing of camera images may include (a) data reduction, (b) denoising (e.g., gaussian blur) and / or (c) edge detection thresholding (e.g., a Canny sequence of filter) . The analysis logic may also employ a threshold-based method or its own machine learning-based or deep learning model to identify objects, boundaries, or edges in an image.
[0121] Visual analysis of camera data can also be performed to estimate distances to certain objects or features, such as markets of each lane, which may also provide information as to where the vehicle is.
[0122] Radar-based sensing may also be implemented in some cases, e.g., using principles described with respect to FIG. 3. For example, the RF sensing system 305 may be used to detect the distance, direction, and / or speed of objects of an object 310.
[0123] In some implementations, optical signals may be obtained, such as infrared, ultraviolet and / or LIDAR (e.g., 402) , which can be used to detect certain objects and features, including in low-light environments.
[0124] In some embodiments, the sensor-based localization 530 may include a localization process 538, which may be different from localization process 516 used in the V2X-based localization 510 discussed above. In some implementations, localization process 538 may involve determining a position of the UE based on one or more of the various types of data above, e.g., GNSS data, motion data, kinematic data, map data, visual data, and / or RF data. As noted above, lane markings and features in the environment can be information used to determine a position of the UE, e.g., a lane position of the vehicle.
[0125] In some examples, the position of the UE may be determined based on correlation of map data of the environment with sensor data (e.g., motion data, visual data, and / or RF data) . In some cases, the position of the UE to be determined may be one of a plurality of defined positions in the environment. For instance, sensor data may indicate that the vehicle is at a general location (e.g., on a road or highway based on lane markings, signage, foliage, other cars, velocity of vehicle, etc. ) , while map data accessed or received by a vehicle may indicate that the vehicle is on one of multiple lanes of the road. In some implementations, a multi-hypothesis model may then be created from the map data, where the model may indicate that the vehicle is on one of multiple possible defined positions (e.g., on the lanes, or parking spots) .
[0126] As such, the localization process 538 (using the map data and the obtained GNSS, motion, kinematic visual, and / or RF data) may result in lane-level localization in which an output includes a lane which the vehicle is on (whether the vehicle is traveling on the lane or stationary on the lane) , e.g., based on the abovementioned type (s) of data, position 533, and / or integrated data 535.
[0127] In some implementations, the vehicle may perform the V2X communication 512 and the localization process 538 simultaneously in parallel. That is, while in some implementations, tasks 1 and 2 as shown in FIG. 5A may be initiated separately with task 2 responsive to, e.g., inability to localize the UE using task 1 or failure of task 1, or both tasks may be initiated at the same time in some implementations. Both of these localization processes V2X communication 512 and localization process 538 can retrieve localization information, where V2X communication 512 may gain localization information based on V2X communication (e.g., from other vehicles) , and localization process 538 may gain localization information from the UE or vehicle itself. This way, time to initialization of localization of the UE or vehicle may be further reduced, e.g., to milliseconds.
[0128] In some implementations, subsequent to successful initialization, the V2X communication-based localization 510 and / or the sensor-based localization 530 may be stopped, put in a lower power or lower priority mode (e.g., sleep) , or switched to a backend or background process. The UE or vehicle may instead perform subsequent positioning based on the initial location of the UE (e.g., location 545) .
[0129] FIG. 6 is a block diagram showing an example process 600 for a multi-hypothesis model that may be implemented by a UE in the example process of FIG. 5, according to some embodiments. In some implementations, the UE may be a vehicle.
[0130] In some embodiments, the example process 600 may include obtaining an initial vehicle position 603. In some implementations, the initial vehicle position 603 may be determined using GNSS data 632 and / or motion data 634 (e.g., as discussed above) . In some embodiments, the example process 600 may further include creating a localization model 608 based on map data 636. As noted above, a multi-hypothesis model may be created from the map data 636. For example, the map data 636 may indicate that the vehicle is on a road having four lanes. Hence, the localization model 608 would indicate that the vehicle is on one lane of four lanes. Implementing the localization model 608 may produce an output that includes a determination of which lane the vehicle is on.
[0131] The localization model 608 (multi-hypothesis model) may be used to determine a position of the vehicle within a plurality of defined positions such as lanes. In some implementations, the example process 600 may include, at block 610, determining the confidence associated with the defined positions. In some examples, the multi-hypothesis model may be configured to converge upon an output indicating the position of the vehicle within a particular lane within multiple lanes.
[0132] In some approaches, a probability or confidence level or score may be determined for each defined position (in this case, a lane) by considering motion data 634 (e.g., obtained via IMU) and / or sensor data 637 (e.g., obtained via a camera and / or an RF sensor) . For example, image and / or RF analysis may reveal that the vehicle is closer to a landmark on the left side of the road than on the right side of the road. In some cases, offset and error information may be used to determine the confidence level.
[0133] The multi-hypothesis model may consider multiple possible starting points, e.g., multiple lanes of a road that the vehicle is on. In some approaches, each lane may, initially, have a confidence level associated therewith, and all of the lanes may be evaluated in parallel, e.g., based on the obtained motion data 634 and / or sensor data 637. More specifically, motion data 634 can provide accurate directional and / or velocity information of the vehicle as well as continuously track the vehicle’s orientation. Camera data may be used to compare environmental objects and markers (lane markings, traffic signs, road edges, etc. ) and distances thereto (e.g., using image analysis) . Radar may be used to detect objects (e.g., roadside barriers) and distances.
[0134] In one or more subsequent rounds of evaluation, one or more lanes may be eliminated based on the confidence level. More specifically, in each round of evaluation (e.g., at block 612) , each of the probability or confidence scores may be compared against a set threshold (e.g., 80%, 90%) . In some approaches, each lane associated with a probability lower than the threshold may be discarded as being an unlikely lane. On the other hand, in some approaches, the lane (or lanes up to a certain quantity) with the highest probability may be kept. In each subsequent round of evaluation, a probability or confidence level or score may be determined for each of the remaining lanes using the aforementioned obtained data, which may be obtained additionally to the data 634 and 637 acquired above. Similar to prior rounds of evaluation, some lanes may be discarded while some lanes may be kept. This process may continue until one lane with the highest confidence is left. The final remaining lane may be indicated in the output defined position 640 (e.g., lane) , thereby completing performance of lane-level localization using the multi-hypothesis model.
[0135] However, there may be cases in which none of the lanes may have confidence scores that meet the threshold because of sensor error, unstable GNSS data, unavailable GNSS data, etc. In some configurations, the vehicle may perform the aforementioned lane evaluation up to a maximum number of tries (e.g., 5 or 10 times) . If no output can be generated despite one or more attempts (the number of attempts depending on the implementation) , the model may be considered to have failed. If the multi-hypothesis model fails, it may result in failure of ADAS or self-driving system of the UE or vehicle. However, in some approaches, example process 600 may revert to another process, such as the previously performed V2X-based localization 510, as it is possible that V2X may succeed or be available after time has passed or traversing some distance (e.g., the vehicle may leave a tunnel) . In some approaches, the previously performed V2X-based localization 510 or example process 600 may be reattempted after some time. Alternatively, a purely GNSS-based localization using GNSS signals may be used if the multi-hypothesis model fails.
[0136] To illustrate the multi-hypothesis model, FIG. 7A depicts an example scenario in which a vehicle 705 is on a path having multiple lanes. The vehicle 705 may be an example of the UE (e.g., 105) or vehicle mentioned throughout the present disclosure. The vehicle 705 may be traversing or stationary in an outside or open field environment in the example scenario.
[0137] In some cases, the vehicle 705 may initially perform (or attempt to perform) V2X communication (for example, V2X communication 512) with at least one vehicle 745a and / or 745b. In some approaches, if V2X communication is successful with at least one vehicle, the vehicle 705 may perform a localization process based on the V2X communication. For example, localization information received from the at least one other vehicle may be used to determine or estimate a position of the vehicle 705. In some examples, this may be done according to localization process 516 to obtain positioning information with respect to the other vehicle (s) , such as distance between the vehicle 705 and the other vehicle (e.g., 745a or 745b) , velocity of the other vehicle, global coordinates of the other vehicle (e.g., based on GNSS signals received at the other vehicle’s GNSS receiver) , relative positions (e.g., the other vehicle may be at a particular direction and angle from the vehicle 705) , rotation information of the other vehicle may contribute to localization in some scenarios (e.g., on curved roads) , or combinations thereof. Further, map data of the environment may be obtained (e.g., from a base station 720 or other access point) to map the positions of the other vehicle to a lane. Based on such positioning information, the vehicle 705 may determine that the other vehicle (e.g., 745a) is on lane 2 of the four lanes and that the vehicle 705 is on lane 1. This approach may allow rapid initialization and localization of the vehicle 705.
[0138] However, V2X communication may fail or be unavailable (or deemed so, e.g., after a threshold number of attempts) for reasons discussed above. In such cases, the vehicle 705 may fall back to a different type of localization process, such as a sensor-based localization process using a multi-hypothesis model. In some scenarios, the vehicle 705 may obtain one or more of various types of sensor data, including, e.g., GNSS data from a GNSS receiver, motion data from an inertial sensor (e.g., IMU) , kinematic data from an OBD, visual data such as image (s) from a camera, RF data from an RF sensor, or combinations thereof. A multi-hypothesis model may be constructed based on such sensor data and / or map data, which could indicate that the vehicle 705 is on one of four lanes. Sensor data may include information regarding distances to one or more obstructions, landmarks, or other physical objects or markings in the environment, e.g., building 710a, natural obstruction (e.g., tree 710b) , road sign 710c, and / or lane marking (s) 710d. Myriad other types of environmental objects may provide a reference point for the vehicle 705. In some examples, an image of the building 710a in a leftward direction and an image of the lane marking 710d in a rightward direction may be captured by the vehicle 705 using one or more cameras equipped by the vehicle 705. Multiple images may be taken over time in some cases. In some examples, an RF image of the road sign 710c and / or a distance thereto may be obtained using a radar equipped by the vehicle 705. In some examples, images of the base station 720, other vehicles 745a, 745b, and / or tree 710b may also be obtained. Based on analysis of the image data and / or other sensor data, the vehicle 705 may determine salient information about its position, such as distances to the various objects and / or markings (including change in distances over time) , global position using GNSS data. Any positioning information that may still be usable from prior V2X communication attempt (s) may also be used. Some or all of these types of information can be integrated to estimate location information of the UE.
[0139] In some implementations, based on the location information, respective confidence levels associated with each lane of multiple lanes (e.g., spatially varying positions 1 through 4) in the example scenario of FIG. 7A may be determined over time or evaluation rounds, as shown in FIG. 7B. In an initial evaluation of the confidence levels or probabilities that the vehicle 705 is on respective lanes (or other defined positions in the environment) , multiple lanes may be initially associated with a confidence level that is above a threshold 750. In some examples, the position with the highest confidence (lane 1) may be selected, and the model may produce a determination that the vehicle 705 is on lane 1. In the illustrated example, however, lanes 1 and 2 may be evaluated based on threshold and have sufficient confidence (e.g., based on exceeding the threshold 750) , while lanes 3 and 4 may not. In the subsequent round of evaluation, lanes 3 and 4 may be discarded and not be considered for evaluation. In the next round of evaluation, probabilities or confidence levels for remaining lanes 1 and 2 may be considered. In some approaches, the remaining probabilities may be compared, and the highest one may be retained. In some approaches, the threshold 750 may still need to be met for the remaining lane to be output from the multi-hypothesis model. In some approaches, the threshold may be updated and adjusted (e.g., to be higher in this case than before) to a new threshold 750’ . In this case, the confidence level associated with lane 1 exceeds the new threshold 750’ and is higher than that of lane 2 (and is also the highest) . Therefore, lane 1 may be output as the final position, completing the sensor-based localization of the vehicle 705.
[0140] In some cases, however, the above approach of using the multi-hypothesis model may not be successful, and the lane on which the vehicle 705 is may not be determined or identified-failure of ADAS or self-driving system. In some cases, however, further sensor data and / or GNSS data may be acquired to determine confidence levels of the lanes (or a portion thereof) and reevaluated through the multi-hypothesis model for elimination. In some such cases, the localization process may revert back to another process, such as a previously performed V2X-based localization, or GNSS-based localization using GNSS signals.
[0141] In some scenario, GNSS data 532 may not be acquirable to be used with sensor data. FIG. 8A depicts an example scenario in which a vehicle 805 is on a path having multiple lanes. Here, vehicle 805 may be traversing or stationary in an underground or enclosed environment, such as a tunnel.
[0142] Similar to the scenario of FIG. 7A, various environmental objects may be proximate to the vehicle 805, such as other vehicles 845a, 845b, 845c. V2X communication with one or more of the other vehicles may be successful or unsuccessful. As discussed, successful V2X communication to receive positioning information from the one or more other vehicles may result in rapid initialization and localization of the vehicle 805. If V2X communication fails or is unsuccessful, the vehicle 805 may fall back to a different type of localization process, such as a sensor-based localization process using a multi-hypothesis model. However, in this scenario, GNSS data may be inaccessible or unavailable because of the type of environment. Hence, vehicle 805 may obtain sensor data, including motion data, kinematic data, visual data, and / or RF data using respective sensors on board the vehicle 805. As an example, image data and / or RF-based distance information may be obtained with respect to one or more of the other vehicles. In some implementations, map data may be accessed or retrieved for use with the sensor data to create the multi-hypothesis model and determine confidence levels associated with respective lanes (or other defined positions in the environment) .
[0143] As shown in FIG. 8B, which shows confidence levels associated with each lane of multiple lanes over time or evaluation rounds in the example scenario of FIG. 8A, an initial evaluation of the confidence levels may result in relatively higher confidence levels in lane positions 1, 2 and 3. In some examples, the position with the highest confidence level (lane 3) may be the position determined by the model for the vehicle 805. In some examples, the confidence levels associated with each position may be compared against a threshold 850. Since the confidence levels associated with lanes 2 and 3 exceed the threshold, in one or more subsequent rounds of evaluation, these lanes may be evaluated, and the other lanes 1 and 4 may not be considered. Through successive rounds of evaluation (in some approaches, based on any modified or new threshold (s) ) , the multi-hypothesis model may narrow down the position of the vehicle 805 to lane 3.
[0144] As such, without availability of GNSS signals or even V2X communication, a device such as a UE or vehicle may quickly and accurately perform localization, in these examples, lane-level localization. However, if the multi-hypothesis model fails, failure of ADAS or self-driving system may occur. In some cases, it may revert to performing V2X-or GNSS-based localization (e.g., after some time) as noted above. Even in the FIG. 8A scenario, the vehicle 805 at a future time may be in an open field environment (e.g., coming out of the tunnel or underground path) or another scenario where V2X communication is available or does not fail.
[0145] It will be appreciated that, in various implementations, the described approaches may be used with myriad types of UE, such as a smartphone or other mobile device carried by a pedestrian, which may be equipped with one or more the types of sensors described herein.
[0146] Finally returning to FIG. 5, at block 540, the sensor-based localization 530 may include determining whether a final position has been obtained. In some implementations, the multi-hypothesis model as discussed with respect to FIGS. 6 through 8B may output a determination of a position the UE is at. If this information has been obtained, the UE localization is successfully initialized and complete. For example, “lane 1” may be the final position, which may be stored or sent as location 545 of UE position, e.g., to be used in a downstream process such as navigation, ADAS, user display, etc. If no final position has been obtained, the sensor-based localization 530 may return to obtain further sensor data, such as GNSS data 532 (or other types of data shown in FIG. 5) . In some implementations, as alluded to above, the sensor-based localization 530 may “fall back” to V2X-based localization 510 or GNSS-based positioning.
[0147] One advantage of the present disclosure is rapid initialization, where, by prioritizing V2X communication, accurate localization can be achieved without a lengthy initialization period as in prior solutions (such as purely GNSS-based positioning) . However, if or when the V2X-based localization 510 fails (which in some approaches may be based on, e.g., V2X-based position falling below a threshold confidence, or V2X failing after a threshold number of tries) or is unavailable, the UE or vehicle may switch to a fallback process, e.g., to the multi-hypothesis model implemented by the sensor-based localization 530. The fallback process may then be used instead of V2X to determine the position using a modified localization process, e.g., to determine lane position of the vehicle in lane-level localization. Further, faster convergence can be achieved. The combined use of V2X communication and a fallback localization model allows for quick convergence to the correct vehicle position.
[0148] A further advantage includes robustness to communication failures. The fallback localization model ensures continued accurate localization if V2X communication is unreliable.
[0149] These advantages provide the UE with a robust, quick, and reliable way to determine its position even in traditionally unfavorable locations such as underground, in an urban jungle, in a tunnel, etc. Example Methods
[0150] FIG. 9 is a flow diagram of an example method 900 of localizing a user equipment (UE) in an environment of a wireless network, according to some embodiments. Structure for performing the functionality illustrated in one or more of the blocks shown in FIG. 9 may include hardware and / or software components of the UE, such as, for example, a controller apparatus, a computerized system, or a computer-readable apparatus including a storage medium storing computer-readable and / or computer-executable instructions that are configured to, when executed by at least one processor apparatus, cause the at least one processor apparatus or a computerized apparatus to perform the operations. Example components of a UE are illustrated in FIG. 10, which is described in more detail below.
[0151] It should also be noted that the operations of FIG. 9 may be performed in any suitable order, not necessarily the order depicted in FIG. 9. Further, the process shown in FIG. 9 may include additional or fewer operations than those depicted in FIG. 9.
[0152] At block 910, the method 900 may include requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication. In some embodiments, the UE may include a vehicle.
[0153] In various scenarios, the V2X communication with the entity of the wireless network may include: vehicle-to-vehicle (V2V) communication between the UE and another vehicle, vehicle-to-infrastructure (V2I) communication between the UE and an infrastructure entity, vehicle-to-network (V2N) communication between the UE and a wireless node of the wireless network, vehicle-to-pedestrian (V2P) communication between the UE and a UE associated with a user, vehicle-to-home (V2H) communication between the UE and a UE associated with a building, or a combination thereof.
[0154] Means for performing functionality at block 910 may comprise processor (s) 1010, wireless communication interface 1030, and / or other components of a UE, as illustrated in FIG. 10.
[0155] At block 920, the method 900 may include obtaining sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof. The inability to localize may be determined based on a lack of response to the request, or a failure to localize the UE using positioning information received via the V2X communication.
[0156] In some embodiments, the inability to localize the UE may be determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof.
[0157] Means for performing functionality at block 920 may comprise processor (s) 1010, sensor (s) 1040, GNSS receiver 1080, and / or other components of a UE, as illustrated in FIG. 10.
[0158] At block 930, the method 900 may include determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of the sensor data with map data of the environment. In some embodiments, the plurality of defined positions in the environment may include a plurality of lanes; and the position of the UE may include a lane of the plurality of lanes.
[0159] In some embodiments, the sensor-based localization process may include: determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; and determining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level.
[0160] In some embodiments, the sensor-based localization process may include performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level.
[0161] Means for performing functionality at block 930 may comprise processor (s) 1010 and / or other components of a UE, as illustrated in FIG. 10.
[0162] In some embodiments, the method 900 may further include determining the position of the UE based on the positioning information and based on the sensor data concurrently. In some scenarios, the position of the UE may be determined based on the positioning information (e.g., V2X-based localization) first, or based on the sensor data (e.g., sensor-based multi-hypothesis localization model) first. In some implementations, the method 900 may further include concurrently receiving the positioning information from the entity of the wireless network via the V2X communication, and determining the position of the UE based on the positioning information.
[0163] In some embodiments, the method 900 may further include determining the position of the UE based on the V2X communication by: receiving the positioning information via the V2X communication; and determining, at a time other than a time during which the position of the UE is determined using the sensor-based localization process, a second position of the UE based on the positioning information, wherein the position of the UE may include a localized position within the environment, the localized position including a lane of a plurality of lanes. Apparatus
[0164] FIG. 10 is a block diagram of an embodiment of a UE 105, which can be utilized as described herein above (e.g., in association with FIGS. 5 –9) . For example, the UE 105 can perform one or more of the functions of the method shown in FIG. 9] . It should be noted that FIG. 10 is meant only to provide a generalized illustration of various components, any or all of which may be utilized as appropriate. It can be noted that, in some instances, components illustrated by FIG. 10 can be localized to a single physical device and / or distributed among various networked devices, which may be disposed at different physical locations. Furthermore, as previously noted, the functionality of the UE discussed in the previously described embodiments may be executed by one or more of the hardware and / or software components illustrated in FIG. 10.
[0165] The UE 105 is shown comprising hardware elements that can be electrically coupled via a bus 1005 (or may otherwise be in communication, as appropriate) . The hardware elements may include a processor (s) 1010 which can include without limitation one or more general-purpose processors (e.g., an application processor) , one or more special-purpose processors (such as digital signal processor (DSP) chips, graphics acceleration processors, application specific integrated circuits (ASICs) , and / or the like) , and / or other processing structures or means. Processor (s) 1010 may comprise one or more processing units, which may be housed in a single integrated circuit (IC) or multiple ICs. As shown in FIG. 10, some embodiments may have a separate DSP 1020, depending on desired functionality. Location determination and / or other determinations based on wireless communication may be provided in the processor (s) 1010 and / or wireless communication interface 1030 (discussed below) . The UE 105 also can include one or more input devices 1070, which can include without limitation one or more keyboards, touch screens, touch pads, microphones, buttons, dials, switches, and / or the like; and one or more output devices 1015, which can include without limitation one or more displays (e.g., touch screens) , light emitting diodes (LEDs) , speakers, and / or the like.
[0166] The UE 105 may also include a wireless communication interface 1030, which may comprise without limitation a modem, a network card, an infrared communication device, a wireless communication device, and / or a chipset (such as a device, an IEEE 802.11 device, an IEEE 802.15.4 device, a Wi-Fi device, a WiMAX device, a WAN device, and / or various cellular devices, etc. ) , and / or the like, which may enable the UE 105 to communicate with other devices as described in the embodiments above. The wireless communication interface 1030 may permit data and signaling to be communicated (e.g., transmitted and received) with TRPs of a network, for example, via eNBs, gNBs, ng-eNBs, access points, various base stations and / or other access node types, and / or other network components, computer systems, and / or any other electronic devices communicatively coupled with TRPs, as described herein. The communication can be carried out via one or more wireless communication antenna (s) 1032 that send and / or receive wireless signals 1034. According to some embodiments, the wireless communication antenna (s) 1032 may comprise a plurality of discrete antennas, antenna arrays, or any combination thereof. The antenna (s) 1032 may be capable of transmitting and receiving wireless signals using beams (e.g., Tx beams and Rx beams) . Beam formation may be performed using digital and / or analog beam formation techniques, with respective digital and / or analog circuitry. The wireless communication interface 1030 may include such circuitry.
[0167] Depending on desired functionality, the wireless communication interface 1030 may comprise a separate receiver and transmitter, or any combination of transceivers, transmitters, and / or receivers to communicate with base stations (e.g., ng-eNBs and gNBs) and other terrestrial transceivers, such as wireless devices and access points. The UE 105 may communicate with different data networks that may comprise various network types. For example, a WWAN may be a CDMA network, a Time Division Multiple Access (TDMA) network, a Frequency Division Multiple Access (FDMA) network, an Orthogonal Frequency Division Multiple Access (OFDMA) network, a Single-Carrier Frequency Division Multiple Access (SC-FDMA) network, a WiMAX (IEEE 802.16) network, and so on. A CDMA network may implement one or more RATs such as WCDMA, and so on. includes IS-95, IS-2000 and / or IS-856 standards. A TDMA network may implement GSM, Digital Advanced Mobile Phone System (D-AMPS) , or some other RAT. An OFDMA network may employ LTE, LTE Advanced, 5G NR, and so on. 5G NR, LTE, LTE Advanced, GSM, and WCDMA are described in documents from 3GPP. is described in documents from a consortium named “3rd Generation Partnership Project 2” (3GPP2) . 3GPP and 3GPP2 documents are publicly available. A wireless local area network (WLAN) may also be an IEEE 802.11x network, and a wireless personal area network (WPAN) may be a Bluetooth network, an IEEE 802.15x, or some other type of network. The techniques described herein may also be used for any combination of WWAN, WLAN and / or WPAN.
[0168] The UE 105 can further include sensor (s) 1040. Sensor (s) 1040 may comprise, without limitation, one or more inertial sensors and / or other sensors (e.g., accelerometer (s) , gyroscope (s) , camera (s) , magnetometer (s) , altimeter (s) , microphone (s) , proximity sensor (s) , light sensor (s) , barometer (s) , and the like) , some of which may be used to obtain position-related measurements and / or other information. For example, an inertial measurement unit (IMU) may include accelerometer (s) , gyroscope (s) , and / or magnetometer (s) . In some embodiments, the sensor (s) 1040 may include a radar or RF sensor configured to emit and receive RF signals, which may be used to generate RF images or representations, or determine a location, distance, direction, speed, and other physical information with respect to an object, according to principles discussed in FIG. 3. In some embodiments, the sensor (s) 1040 may include an OBD, which may be configured to determine kinematic data or a motion parameter, such as speed or velocity (e.g., if the UE 105 is implemented or operated as a vehicle) .
[0169] Embodiments of the UE 105 may also include a Global Navigation Satellite System (GNSS) receiver 1080 capable of receiving signals 1084 from one or more GNSS satellites using an antenna 1082 (which could be the same as antenna 1032) . Positioning based on GNSS signal measurement can be utilized to complement and / or incorporate the techniques described herein. The GNSS receiver 1080 can extract a position of the UE 105, using conventional techniques, from GNSS satellites of a GNSS system, such as Global Positioning System (GPS) , Galileo, GLONASS, Quasi-Zenith Satellite System (QZSS) over Japan, IRNSS over India, BeiDou Navigation Satellite System (BDS) over China, and / or the like. Moreover, the GNSS receiver 1080 can be used with various augmentation systems (e.g., a Satellite Based Augmentation System (SBAS) ) that may be associated with or otherwise enabled for use with one or more global and / or regional navigation satellite systems, such as, e.g., Wide Area Augmentation System (WAAS) , European Geostationary Navigation Overlay Service (EGNOS) , Multi-functional Satellite Augmentation System (MSAS) , and Geo Augmented Navigation system (GAGAN) , and / or the like.
[0170] It can be noted that, although GNSS receiver 1080 is illustrated in FIG. 10 as a distinct component, embodiments are not so limited. As used herein, the term “GNSS receiver” may comprise hardware and / or software components configured to obtain GNSS measurements (measurements from GNSS satellites) . In some embodiments, therefore, the GNSS receiver may comprise a measurement engine executed (as software) by one or more processors, such as processor (s) 1010, DSP 1020, and / or a processor within the wireless communication interface 1030 (e.g., in a modem) . A GNSS receiver may optionally also include a positioning engine, which can use GNSS measurements from the measurement engine to determine a position of the GNSS receiver using an Extended Kalman Filter (EKF) , Weighted Least Squares (WLS) , particle filter, or the like. The positioning engine may also be executed by one or more processors, such as processor (s) 1010 or DSP 1020.
[0171] The UE 105 may further include and / or be in communication with a memory 1060. The memory 1060 can include, without limitation, local and / or network accessible storage, a disk drive, a drive array, an optical storage device, a solid-state storage device, such as a random access memory (RAM) , and / or a read-only memory (ROM) , which can be programmable, flash-updateable, and / or the like. Such storage devices may be configured to implement any appropriate data stores, including without limitation, various file systems, database structures, and / or the like.
[0172] The memory 1060 of the UE 105 also can comprise software elements (not shown in FIG. 10) , including an operating system, device drivers, executable libraries, and / or other code, such as one or more application programs, which may comprise computer programs provided by various embodiments, and / or may be designed to implement methods, and / or configure systems, provided by other embodiments, as described herein. Merely by way of example, one or more procedures described with respect to the method (s) discussed above may be implemented as code and / or instructions in memory 1060 that are executable by the UE 105 (and / or processor (s) 1010 or DSP 1020 within UE 105) . In some embodiments, then, such code and / or instructions can be used to configure and / or adapt a general-purpose computer (or other device) to perform one or more operations in accordance with the described methods.
[0173] It will be apparent to those skilled in the art that substantial variations may be made in accordance with specific requirements. For example, customized hardware might also be used and / or particular elements might be implemented in hardware, software (including portable software, such as applets, etc. ) , or both. Further, connection to other computing devices such as network input / output devices may be employed.
[0174] With reference to the appended figures, components that can include memory can include non-transitory machine-readable media. The term “machine-readable medium” and “computer-readable medium” as used herein, refer to any storage medium that participates in providing data that causes a machine to operate in a specific fashion. In embodiments provided hereinabove, various machine-readable media might be involved in providing instructions / code to processors and / or other device (s) for execution. Additionally or alternatively, the machine-readable media might be used to store and / or carry such instructions / code. In many implementations, a computer-readable medium is a physical and / or tangible storage medium. Such a medium may take many forms, including but not limited to, non-volatile media and volatile media. Common forms of computer-readable media include, for example, magnetic and / or optical media, any other physical medium with patterns of holes, a RAM, a programmable ROM (PROM) , erasable PROM (EPROM) , a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read instructions and / or code.
[0175] The methods, systems, and devices discussed herein are examples. Various embodiments may omit, substitute, or add various procedures or components as appropriate. For instance, features described with respect to certain embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. The various components of the figures provided herein can be embodied in hardware and / or software. Also, technology evolves and, thus many of the elements are examples that do not limit the scope of the disclosure to those specific examples.
[0176] It has proven convenient at times, principally for reasons of common usage, to refer to such signals as bits, information, values, elements, symbols, characters, variables, terms, numbers, numerals, or the like. It should be understood, however, that all of these or similar terms are to be associated with appropriate physical quantities and are merely convenient labels. Unless specifically stated otherwise, as is apparent from the discussion above, it is appreciated that throughout this Specification discussion utilizing terms such as “processing, ” “computing, ” “calculating, ” “determining, ” “ascertaining, ” “identifying, ” “associating, ” “measuring, ” “performing, ” or the like refer to actions or processes of a specific apparatus, such as a special purpose computer or a similar special purpose electronic computing device. In the context of this Specification, therefore, a special purpose computer or a similar special purpose electronic computing device is capable of manipulating or transforming signals, typically represented as physical electronic, electrical, or magnetic quantities within memories, registers, or other information storage devices, transmission devices, or display devices of the special purpose computer or similar special purpose electronic computing device.
[0177] Terms, “and” and “or” as used herein, may include a variety of meanings that also is expected to depend, at least in part, upon the context in which such terms are used. Typically, “or” if used to associate a list, such as A, B, or C, is intended to mean A, B, and C, here used in the inclusive sense, as well as A, B, or C, here used in the exclusive sense. In addition, the term “one or more” as used herein may be used to describe any feature, structure, or characteristic in the singular or may be used to describe some combination of features, structures, or characteristics. However, it should be noted that this is merely an illustrative example and claimed subject matter is not limited to this example. Furthermore, the term “at least one of” if used to associate a list, such as A, B, or C, can be interpreted to mean any combination of A, B, and / or C, such as A, AB, AA, AAB, AABBCCC, etc.
[0178] Having described several embodiments, various modifications, alternative constructions, and equivalents may be used without departing from the scope of the disclosure. For example, the above elements may merely be a component of a larger system, wherein other rules may take precedence over or otherwise modify the application of the various embodiments. Also, a number of steps may be undertaken before, during, or after the above elements are considered. Accordingly, the above description does not limit the scope of the disclosure.
[0179] In view of this description embodiments may include different combinations of features. Implementation examples are described in the following numbered clauses: Clause 1. A method of localizing a user equipment (UE) in an environment of a wireless network, the method including: requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; obtaining sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data. Clause 2. The method of clause 1, wherein: the UE comprises a vehicle; the plurality of defined positions in the environment comprise a plurality of lanes; and the position of the UE comprises a lane of the plurality of lanes. Clause 3. The method of clause 1, wherein the sensor-based localization process comprises: determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; and determining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level. Clause 4. The method of clause 1, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level. Clause 5. The method of clause 1, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof. Clause 6. The method of clause 1, wherein the V2X communication with the entity of the wireless network comprises: vehicle-to-vehicle (V2V) communication between the UE and another vehicle, vehicle-to-infrastructure (V2I) communication between the UE and an infrastructure entity, vehicle-to-network (V2N) communication between the UE and a wireless node of the wireless network, vehicle-to-pedestrian (V2P) communication between the UE and a UE associated with a user, vehicle-to-home (V2H) communication between the UE and a UE associated with a building, or a combination thereof. Clause 7. The method of clause 1, further comprising determining the position of the UE based on the positioning information and based on the sensor data concurrently. Clause 8. The method of clause 1, further comprising determining the position of the UE based on the V2X communication by: receiving the positioning information via the V2X communication; and determining, at a time other than a time during which the position of the UE is determined using the sensor-based localization process, a second position of the UE based on the positioning information via V2X communication, wherein the position of the UE comprises a localized position within the environment, the localized position comprising a lane of a plurality of lanes. Clause 9. A user equipment (UE) comprising: one or more transceivers; one or more memories; and one or more processors communicatively coupled with the one or more transceivers and the one or more memories, the one or more processors configured to: request positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; obtain sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and determine a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data. Clause 10. The UE of clause 9, wherein: the UE comprises a vehicle; the plurality of defined positions in the environment comprise a plurality of lanes; and the position of the UE comprises a lane of the plurality of lanes. Clause 11. The UE of clause 9, wherein the sensor-based localization process comprises: determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; and determining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level. Clause 12. The UE of clause 9, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level. Clause 13. The UE of clause 9, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof. Clause 14. The UE of clause 9, wherein the one or more processors are further configured to determine the position of the UE based on the positioning information and based on the sensor data concurrently. Clause 15. The UE of clause 9, wherein the one or more processors are further configured to determine the position of the UE based on the V2X communication by: receiving the positioning information via the V2X communication; and determining the position of the UE based on the positioning information via V2X communication, wherein the position of the UE comprises a localized position within the environment, the localized position comprising a lane of a plurality of lanes. Clause 16. An apparatus comprising: means for requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication; means for obtaining sensor data responsive to an inability to localize a user equipment (UE) using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; and means for determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data. Clause 17. The apparatus of clause 16, wherein: the UE comprises a vehicle; the plurality of defined positions in the environment comprise a plurality of lanes; and the position of the UE comprises a lane of the plurality of lanes. Clause 18. The apparatus of clause 16, wherein the sensor-based localization process comprises: means for determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; and means for determining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level. Clause 19. The apparatus of clause 16, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level. Clause 20. The apparatus of clause 16, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof.
Claims
A method of localizing a user equipment (UE) in an environment of a wireless network, the method including:requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication;obtaining sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; anddetermining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.The method of claim 1, wherein:the UE comprises a vehicle;the plurality of defined positions in the environment comprise a plurality of lanes; andthe position of the UE comprises a lane of the plurality of lanes.The method of claim 1, wherein the sensor-based localization process comprises:determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; anddetermining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level.The method of claim 1, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level.The method of claim 1, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof.The method of claim 1, wherein the V2X communication with the entity of the wireless network comprises:vehicle-to-vehicle (V2V) communication between the UE and another vehicle,vehicle-to-infrastructure (V2I) communication between the UE and an infrastructure entity,vehicle-to-network (V2N) communication between the UE and a wireless node of the wireless network,vehicle-to-pedestrian (V2P) communication between the UE and a UE associated with a user,vehicle-to-home (V2H) communication between the UE and a UE associated with a building, ora combination thereof.The method of claim 1, further comprising determining the position of the UE based on the positioning information and based on the sensor data concurrently.The method of claim 1, further comprising determining the position of the UE based on the V2X communication by:receiving the positioning information via the V2X communication; anddetermining, at a time other than a time during which the position of the UE is determined using the sensor-based localization process, a second position of the UE based on the positioning information via V2X communication, wherein the position of the UE comprises a localized position within the environment, the localized position comprising a lane of a plurality of lanes.A user equipment (UE) comprising:one or more transceivers;one or more memories; andone or more processors communicatively coupled with the one or more transceivers and the one or more memories, the one or more processors configured to:request positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication;obtain sensor data responsive to an inability to localize the UE using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; anddetermine a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.The UE of claim 9, wherein:the UE comprises a vehicle;the plurality of defined positions in the environment comprise a plurality of lanes; andthe position of the UE comprises a lane of the plurality of lanes.The UE of claim 9, wherein the sensor-based localization process comprises:determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; anddetermining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level.The UE of claim 9, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level.The UE of claim 9, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof.The UE of claim 9, wherein the one or more processors are further configured to determine the position of the UE based on the positioning information and based on the sensor data concurrently.The UE of claim 9, wherein the one or more processors are further configured to determine the position of the UE based on the V2X communication by:receiving the positioning information via the V2X communication; anddetermining the position of the UE based on the positioning information via V2X communication, wherein the position of the UE comprises a localized position within the environment, the localized position comprising a lane of a plurality of lanes.An apparatus comprising:means for requesting positioning information from an entity of the wireless network via vehicle-to-everything (V2X) communication;means for obtaining sensor data responsive to an inability to localize a user equipment (UE) using the V2X communication, the sensor data comprising data representative of the environment which is received via a Global Navigation Satellite System (GNSS) receiver, an inertial sensor, an optical sensor, a radio frequency (RF) sensor, or a combination thereof; andmeans for determining a position of the UE within a plurality of defined positions in the environment using a sensor-based localization process, the sensor-based localization process based at least on correlation of map data of the environment with the sensor data.The apparatus of claim 16, wherein:the UE comprises a vehicle;the plurality of defined positions in the environment comprise a plurality of lanes; andthe position of the UE comprises a lane of the plurality of lanes.The apparatus of claim 16, wherein the sensor-based localization process comprises:means for determining a confidence level associated with each of the plurality of defined positions based at least on the sensor data; andmeans for determining the position of the UE based on at least on the confidence level associated with the determined position meeting or exceeding a threshold level.The apparatus of claim 16, wherein the sensor-based localization process comprises performing one or more rounds of evaluation, each round comprising discarding at least one defined position from the plurality of defined positions based on a probability associated with the discarded at least one defined position being below a threshold level.The apparatus of claim 16, wherein the inability to localize the UE is determined based on a lack of response to the request, a failure to localize the UE using positioning information received via the V2X communication, an insufficient amount of the positioning information received via the V2X communication, a mismatch of the positioning information received via the V2X communication with the map data associated with the environment, or a combination thereof.