RF Sensing Image Representation and DETR for Dynamic Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wireless communication systems face challenges in accurately obtaining localization information for target objects in dynamic environments due to difficulties in distinguishing between static objects and changing quantities of devices and device positions, leading to increased complexity in identifying and determining localization information.

Innovation Solution

Utilizing radio frequency (RF) sensing and computer vision techniques, including cooperative multi-static RF sensing and a detection transformer (DETR) model, to generate images representative of channel energy responses (CERs) that are processed to improve localization accuracy and handle varying quantities of objects and devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional RF sensing methods are used to obtain localization information, then the system can operate with existing infrastructure, but the accuracy deteriorates in dynamic environments with varying quantities of devices and objects

Engineering Contradiction:
Improvelocalization accuracyVSAvoidhandling dynamic environment changes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent transforms RF sensing data into image representations, adding a visual dimension to the data. This allows the application of computer vision techniques (trained on static object images) to dynamic RF environments, effectively solving the adaptability problem by mapping the problem to a different domain where existing solutions can be applied.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces traditional signal processing methods with a transformer-based deep learning model. This substitution enables the system to automatically learn and adapt to dynamic environmental changes, improving both localization accuracy and adaptability to varying device and object quantities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If traditional data processing methods are used for RF sensing results, then the system architecture remains simple, but the complexity increases when handling varying quantities of objects and devices

Engineering Contradiction:
Improvesystem architecture simplicityVSAvoidhandling varying device quantities
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

By converting RF sensing data into image representations, the patent enables the use of transformer models that can naturally handle variable数量的 objects through attention mechanisms. This dimensionality change allows the system to scale to varying device quantities without fundamentally changing the core architecture.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The transformer-based DETR model serves multiple functions: it processes variable数量的 objects, performs localization, and handles dynamic environmental changes all within a single unified architecture. This multi-functionality reduces overall system complexity despite the advanced techniques employed.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If visualization-based data representation is implemented, then localization accuracy improves, but computational requirements and processing complexity increase

Engineering Contradiction:
Improvelocalization accuracyVSAvoidcomputational processing power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent performs data visualization (converting RF data to images) as a preliminary step before applying the transformer model. This preprocessing action simplifies the subsequent processing by transforming complex RF data into a format that leverages efficient computer vision algorithms, potentially reducing overall computational requirements.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances localization accuracy for target objects in dynamic environments by reducing complexity through visualization-based data representation and transformer-based architectures, supporting varying device and object quantities over time.

Implementation Method 1

RF sensing is a technology that enables wireless communication devices to acquire information about characteristics of the environment and/or objects within the environment. RF sensing uses RF signals to determine the distance (range), angle, and/or instantaneous linear velocity

Methodology Applied
Scientific EffectRadio frequency sensing: Radar

Data Source

PatentUS20250254550A1Object localization using radio frequency sensing and computer vision
Publication Date: 2025.08.07 QUALCOMM INC
  • US20250254550A1 patent drawing
  • US20250254550A1 patent drawing
  • US20250254550A1 patent drawing

AI summary

In some aspects, a user equipment (UE) may receive, from a network node, sensing configuration information for a sensing session, the sensing configuration information indicating one or more transmission reception points (TRPs). The UE may obtain, via one or more radio frequency (RF) sensing measurements of the one or more TRPs, sensing measurement information, the sensing measurement information including channel energy responses (CERs) for respective TRPs of the one or more TRPs. The UE may transmit, to the network node, sensing result information that is associated with the sensing measurement information, the sensing result information being associated with one or more images that are representative of the CERs. Numerous other aspects are described.