Integrated sensing and communication enabled by networked hybrid quantum-classical machine learning

Abstract

Devices with communication capabilities, such as commercial Wi-Fi devices, can be used in an Integrated Sensing and Communication (ISAC) system to collaboratively exchange data and monitor the environment. Such devices typically require diverse signal processing, such as machine learning inference, that requires high-power operation for real-time sensing and computing. The present invention provides a method for achieving energy-efficient computing by utilizing the capabilities of data communication to access distributed computing resources, including classical and quantum computers, over a network. The system and method are based on the recognition that computationally intensive processing is offloaded to a networked classical-quantum hybrid computing to build a dynamic computing graph. Some embodiments use automated classical-quantum machine learning, whose circuits and hyperparameters are automatically tuned through gradient or heuristic optimization for Wi-Fi indoor monitoring and human tracking. In some embodiments, the system and method can reduce power consumption and the number of trainable parameters by integrating classical and quantum neural networks. In some embodiments, signal processing, such as noise removal, filtering, and detection, is achieved using a classical-quantum hybrid processor on the network.

Description

[Technical Field]

[0001] The present invention relates to machine learning and inference systems for sensing via signals for data communication, and more specifically to hybrid quantum-classical machine learning systems for wireless sensor networks, Wi-Fi® indoor monitoring, body area sensor networks, terahertz spectroscopy, coherent optical sensing, millimeter-wave localization, driving navigation, and object tracking. [Background technology]

[0002] Communication devices, such as mobile phones, Wi-Fi access points, and Internet of Things (IoT) appliances, have become nearly ubiquitous in everyday life. Communication devices are primarily used to exchange data from one point to another through wired or wireless medium channels by modulating signals, such as electromagnetic waves. To exchange data securely and reliably, various signal processing methods, such as error control coding, data compression, pulse shaping, and channel estimation, are implemented.

[0003] Over the past decade, communication devices equipped with sensing capabilities have attracted significant attention as a new technology framework called integrated sensing and communications (ISAC). Because data communication relies on a channel link that changes in response to environmental changes, such as the movement of surrounding objects, communication devices can inherently sense environmental conditions by estimating the channel during data communication without relying on other external sensors. For example, Wi-Fi sensing or wireless local area network (WLAN) sensing uses Wi-Fi access points or Wi-Fi mobile devices to achieve indoor monitoring in addition to data communication. Several research groups have focused on WLAN sensing by leveraging 802.11 standard technologies for novel industrial and commercial applications. Some WLAN sensing frameworks use either channel state information (CSI) from the physical (PHY) layer or received signal strength indicator (RSSI) measurements from the medium access control (MAC) layer. RSSI measurements suffer from measurement instability and coarse channel information granularity, which lead to limited sensing accuracy. CSI measurements have high sensing granularity but require access to a PHY layer interface and high computing power to process large amounts of subcarrier data.

[0004] One WLAN sensing application, indoor localization, provides a method for locating an object within an enclosed area. The object may be a device that transmits and / or receives signals to and from other devices, or it may be an entity without such capabilities. Some indoor localization industrial applications, such as locating objects in hospitals, warehouses, shopping malls, and factories, require accurate indoor localization. Some conventional indoor localization approaches require the installation of dedicated hardware in the indoor area. However, these types of conventional approaches are undesirable because of the expensive dedicated hardware required for the indoor localization system. One example of this approach is an ultra-wideband (UWB) wireless localization system, which is expensive and is used as a last resort for communities. Other examples include systems based on light detection and ranging (LIDAR), radar, or ultrasound, which, like UWB localization systems, require high installation and maintenance costs. Therefore, an ISAC capable of accurate detection without the need for external sensors is a viable solution for various applications.

[0005] However, the dependency and correlation between channel conditions and target sensing factors is often weak, making it difficult to accurately estimate sensing values ​​from communication signals. To solve this problem, machine learning and deep learning methods based on deep neural networks (DNNs) have been used in ISAC. For example, WLAN sensing first collects a large amount of data during communication, which is then used as a fingerprinting database to train a DNN model to predict sensing factors online. DNNs can be used in image classification, speech recognition, computational sensing, compressed sensing, data analysis, feature extraction, signal processing, and artificial intelligence. There are many DNN architectures, including multilayer perceptrons, recurrent networks, convolutional networks, transformer networks, attention networks, long-short-term memory, generative adversarial networks, autoencoders, U-shaped networks, residual networks, reversible networks, loop networks, clique networks, implicit layers, and their variants. Although the high performance of DNNs has been demonstrated in many practical systems, training and deploying them on resource-constrained hardware with low memory and processing power for real-time applications has remained a challenge. This is in part because typical DNNs have a large number of trainable parameters, such as weights and biases, and many artificial neurons throughout deep hidden layers, which also require a large number of arithmetic multiplications and floating-point operations. In addition, they require large amounts of training data and training iterations, which generally leads to high power requirements.

[0006] In addition to standard DNNs, the emerging framework of quantum neural networks (QNNs), leveraging quantum processing units (QPUs), has been introduced as an alternative computational paradigm for the future era of quantum supremacy. QNNs can solve some of the problems of classical DNN approaches through exponentially large parallel computations with fewer parameters. Quantum computers have the potential to achieve computationally efficient signal processing compared to classical digital computers, not only in terms of execution time but also in terms of energy consumption, by leveraging quantum mechanisms such as superposition and entanglement. Nevertheless, quantum processors are difficult to embed in mobile devices because they require careful maintenance.

[0007] Quantum machine learning (QML) is considered a potential driver in sixth-generation (6G) applications. Over the past few years, several companies, including IBM®, Google®, and Honeywell®, have produced commercial quantum computers. For example, IBM announced a 433-qubit QPU publicly available via its cloud service in 2022 and plans to produce an 1121-qubit QPU by 2023. While several groups have reported achieving quantum supremacy for specific problems, quantum advantages have not been fully verified for general problems. It is not long before noisy intermediate-scale quantum (NISQ) computers will be widely used for a variety of practical applications. While quantum-enabled algorithms for wireless communication systems have been investigated, most existing research assumes fault-tolerant QPUs, which exceed the capabilities of near-term NISQ devices.

[0008] In addition to machine learning inference, communication devices require a variety of signal processing methods that require high-power operation for real-time sensing and computing. Therefore, there is a need to develop ISAC systems and methods that enable low-cost, low-power, and reduced-hardware deployment. Summary of the Invention

[0009] The present invention recognizes that communication devices can access external computing resources without implementing them on-premise, and that the hybrid use of quantum and classical computing processors provides high-performance, low-power, and flexible signal processing. The present invention is based on the use of both classical deep neural networks (DNNs) and quantum neural networks (QNNs) in a networked manner with appropriate load balancing by distributing operational resources over the network, and the sensing equipment has a data access point that is inherently easy to communicate with remote servers to execute arbitrary heterogeneous computing graphs through DNNs and QNNs. QNNs include quantum convolution, quantum graph neural networks (QGNNs), tensor networks, quantum autoencoders, quantum generative adversarial networks, quantum reservoir networks, quantum implicit layers, etc.

[0010] Thus, the present invention recognizes that integrated sensing and communications (ISAC) systems have the capability to access remote quantum computing servers, such as Amazon Braket and IBM Quantum. The present invention uses hybrid classical-quantum machine learning to exploit this capability for sensing and data analysis, allowing ISAC systems to be deployed with low cost and power overhead. In some embodiments, several Wi-Fi access points monitor indoor / outdoor environments and surrounding users during communication, channel acquisition, and beam tracking. The Wi-Fi access points employ hybrid use of cloud-based or on-premise DNNs and QNNs, when available.

[0011] In some embodiments, terahertz time-domain spectroscopy systems, biosignal sensing systems, and LIDAR / radar / sonar imaging systems can access servers using both classical and quantum computers, and measurement data is analyzed using networked classical-quantum hybrid machine learning for feature extraction. In some embodiments, the hybrid architecture on the computing graph within networked DNNs and QNNs is adaptively tuned through an automated machine learning (AutoML) framework involving either deep reinforcement learning, Bayesian optimization (BO), or metaheuristic optimization to design quantum ansatz, embedding, measurement circuits, specifications, quantization, and hypernetwork architectures to construct variational quantum circuits (VQCs). In some embodiments, signal processing for data communication and analysis, such as encoding, decoding, modulation, demodulation, equalization, detection, pulse shaping, compression, decompression, noise reduction, and compressed sensing, is further offloaded to the networked quantum-classical hybrid computer. Networked quantum-classical hybrid machine learning has the nontrivial advantage that it utilizes communication capabilities to simultaneously achieve communication and sensing, along with distributed computing load balancing for classical and quantum computers, which can significantly improve the performance of signal processing and inference without additional hardware implementation. In particular, managing multiple CPUs and QPUs simultaneously is difficult with conventional techniques due to the enormous number of potential distributed patterns of operations directed to multiple CPUs and QPUs, and the large variations in accuracy, latency, power requirements, and fidelity of different CPUs and QPUs. The present invention provides a method for controlling a computing graph over a network to manage appropriate load balancing of individual CPUs and QPUs so that total cost and efficiency are sufficiently maintained. Additionally, the present invention provides a method for integrating QNNs into DNNs in a flexible manner by utilizing the capabilities of seamlessly reconfigurable distributed computing over a network.For example, some parts of signal processing, such as convolutional layers and activations in DNNs, are adaptively distributed across different central computing units (CPUs), graphics computing units (GPUs), field programmable gate arrays (FPGAs), and quantum processing units (QPUs).

[0012] Some embodiments of the present invention provide a system deployed for integrated computing, sensing, and communication, the system including at least one communication link, at least one classical computing processor configured with a set of trainable parameters, at least one quantum computing processor configured with a variation circuit according to a set of variational parameters, and at least one memory bank coupled to the at least one classical computing processor and the at least one quantum computing processor via the at least one communication link, the at least one memory bank storing instructions implementing a set of hybrid classical-quantum computing methods for data communication, machine learning, and environmental sensing. For example, the trainable parameters are weights and biases, and a large number of artificial neurons are located throughout a deep hidden layer requiring a large number of arithmetic multiplications and floating-point operations. The instructions, when executed by at least one classical computing processor and at least one quantum computing processor, perform steps including: causing the at least one classical processor to exchange data through at least one communication link to adjust a set of trainable parameters and a set of variational parameters and update data in at least one memory bank according to a set of computing methods; and causing the at least one quantum processor to perform a measurement of the quantum state according to the set of computing methods, taking into account the set of variational parameters and the data in the at least one memory bank. By way of example, the set of computing methods may include an adaptive filtering algorithm, a gradient descent algorithm, a feature extraction algorithm, a classification algorithm, a regression algorithm, a prediction algorithm, a compressed sensing algorithm, an estimation algorithm, an inference algorithm, a deep neural network, machine learning, a denoising algorithm, encoding, decoding, modulation, demodulation, or equalization.

[0013] According to some embodiments of the present invention, there is provided a computer-implemented method for signal processing, communication, and sensing performed by at least one classical computing processor and at least one quantum computing processor. The at least one classical computing processor and at least one quantum computing processor are coupled through at least one communication link to a memory bank storing instructions implementing a set of classical-quantum hybrid computing methods. The instructions perform the following steps, including exchanging a set of data between the at least one memory bank and the at least one classical computing processor and the at least one quantum computing processor through at least one communication link; distributing a set of sub-instructions to the at least one classical computing processor and the at least one quantum computing processor; adjusting a set of variational parameters for the at least one quantum computing processor; adjusting a set of trainable parameters for the at least one classical computing processor; and modifying the set of data according to the set of sub-instructions, the set of variational parameters, and the set of trainable parameters.

[0014] Thus, embodiments can achieve low-power, reduced-hardware signal processing for data communications and sensing with accurate DNN and QNN inference through the use of networked hybrid quantum-classical computing over communications, which can be used for real-time applications requiring low-power, resource-constrained deployments.

[0015] The accompanying drawings, which are included to provide a further understanding of the invention, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. [Brief explanation of the drawings]

[0016] [Figure 1A] FIG. 1 illustrates an exemplary system for Wi-Fi human surveillance enabled by networked hybrid quantum-classical machine learning, according to some embodiments. [Figure 1B] FIG. 1 illustrates an exemplary deployment of a networked hybrid quantum-classical machine learning enabled Wi-Fi indoor surveillance system according to some embodiments. [Figure 2A] FIG. 1 illustrates an exemplary scenario for a Wi-Fi indoor surveillance system, according to some embodiments. [Figure 2B] FIG. 1 illustrates an exemplary scenario for a Wi-Fi indoor surveillance system, according to some embodiments. [Figure 3A] FIG. 1 illustrates an exemplary transmitter-receiver system for integrated communication and sensing, according to some embodiments. [Figure 3B] FIG. 1 illustrates an exemplary transmitter-receiver system for integrated communication and sensing, according to some embodiments. [Figure 4A] 1 illustrates an exemplary diagram of communication channels for collaborative data exchange and sensing, according to some embodiments. [Figure 4B] 1 illustrates an exemplary diagram of communication channels for collaborative data exchange and sensing, according to some embodiments. [Figure 4C] 1 illustrates an exemplary diagram of communication channels for collaborative data exchange and sensing, according to some embodiments. [Figure 5] FIG. 1 shows an exemplary schematic diagram of a quantum neural network using variational quantum circuits for Wi-Fi sensing, according to some embodiments. [Figure 6A] 1A-1C illustrate exemplary types (a)-(i) of exemplary Ansatz-based variational quantum circuits according to some embodiments. [Figure 6B]FIG. 1 illustrates an exemplary method for designing QNN Ansatz and hyperparameters through an AutoML framework, according to some embodiments. [Figure 6C] FIG. 10 illustrates exemplary performance plots of different inference methods compared to an Auto-Ansatz designed hybrid DNN·QNN for a Wi-Fi sensing system, according to some embodiments. [Figure 7] FIG. 1 illustrates an exemplary block diagram of a computing graph representing signal processing distributed across multiple classical computing processors and quantum computing processors in networked hybrid quantum-classical computing, according to some embodiments. [Figure 8A] FIG. 1 illustrates an exemplary system for a networked hybrid quantum-classical machine learning enabled IoT wireless monitoring system, according to some embodiments. [Figure 8B] FIG. 1 illustrates an exemplary block diagram of networked hybrid quantum-classical computing, according to some embodiments. [Figure 8C] FIG. 1 illustrates an exemplary block diagram of networked hybrid quantum-classical computing, according to some embodiments. [Figure 8D] FIG. 1 illustrates an exemplary block diagram of networked hybrid quantum-classical computing, according to some embodiments. [Figure 9A] FIG. 1 illustrates an exemplary system for integrated communications and sensing enabled by networked hybrid quantum-classical computing, according to some embodiments. [Figure 9B] FIG. 1 illustrates an exemplary system for integrated communications and sensing enabled by networked hybrid quantum-classical computing, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0017] Various embodiments of the present invention will now be described with reference to the drawings. It should be noted that the drawings are not drawn to scale, and that elements of similar structure or function are designated by similar reference numerals throughout the drawings. It should also be noted that the drawings are intended only to facilitate the description of specific embodiments of the present invention. They are not intended to provide an exhaustive description of the present invention, nor are they intended to limit the scope of the present invention. In addition, aspects described in connection with a specific embodiment of the present invention are not necessarily limited to that embodiment, and may be practiced in any other embodiment of the present invention.

[0018] Some embodiments of the present disclosure provide systems and methods for integrated sensing and communication (ISAC) enabled by networked quantum-classical hybrid computing to improve signal processing and machine learning performance while reducing power consumption and hardware resources in communication devices, including mobile phones, Wi-Fi access points, and Internet of Things (IoT) appliances. Networked quantum-classical hybrid computing is implemented using a computational graph over a data communication network that uses at least one classical computing processor and at least one quantum computing processor, balancing the load across the different processors to meet certain requirements, including power efficiency, computational accuracy, and completion latency. Some other embodiments include, but are not limited to, inference and prediction for digital pre-distortion, channel equalization, channel estimation, nonlinear turbo equalization, speech recognition, image processing, biosignal sensing, LIDAR / radar / sonar / terahertz imaging, compressive sensing, deep learning, deep reinforcement learning, etc. Wi-Fi Sensing for Indoor Surveillance

[0019] In the case of Wi-Fi sensing, access points in the 802.11 standard can leverage the capabilities of Wi-Fi devices to easily access distributed computers to collect beam scanning measurements that can be associated with classes of human gestures, object behavior, and environmental changes as fingerprinting data for training deep neural network (DNN) and quantum neural network (QNN) models. Specifically, the present invention uses at least one classical computing processor and at least one quantum computing processor on the network. Therefore, some computationally heavy signal processing can be offloaded to an external central processing unit (CPU) and quantum processing unit (QPU). In addition, the use of quantum computing devices that utilize entanglement and superposition can improve computational efficiency beyond that of CPUs. Depending on the type of operation, the present disclosure allocates portions of the signal processing diagram to distributed CPUs and QPUs with appropriate load balancing for real-time applications. Figure 1 shows a Wi-Fi human monitoring system enabled by networked hybrid quantum-classical machine learning. This is an extension of the Wi-Fi sensing system that leverages data communication signals to sense the surrounding environment by further utilizing communication capabilities to access distributed CPUs and QPUs.

[0020] FIG. 1A illustrates an exemplary Wi-Fi sensing system according to the present invention. The exemplary configuration uses several Wi-Fi stations 13 and 17 in an indoor environment or a specific outdoor area. This embodiment of the Wi-Fi sensing system enables environmental sensing as well as data communication via the Wi-Fi stations, including, but not limited to, human identity recognition, object recognition, human / object counting, human activity / motion detection, human posture / location recognition, patient vital sign detection, and the like. For example, as shown in FIG. 1A , a subject performs several different postures, including different gestures 15, such as "sit," "stand with left arm raised," and the like. For each posture, the communication device records training and test data for different periods of time, with sufficient time intervals between successive sessions. The data can be expanded to improve Wi-Fi sensing performance for some embodiments.

[0021] By employing networked classical and quantum machine learning, the Wi-Fi sensing system can efficiently predict human posture using Wi-Fi signals without relying on other sensing modalities such as cameras. While Wi-Fi stations 13 and 17 establish data access with other wireless devices, the Wi-Fi stations acquire measured wireless signals, such as beam signal-to-noise ratio (SNR) 14 and channel state information (CSI). The measured wireless signals 14 are further used to predict environmental changes, such as human posture 15. The prediction is based on networked machine learning methods executed on distributed classical and quantum computers 12 and 11 via data links 16 and 18 for accessing the cloud network 10. The estimated environmental changes are sent back to the Wi-Fi stations.

[0022] Because ultra-granular mmWave channel state information (CSI) is typically not accessible from commercial-off-the-shelf (COTS) devices without additional overhead, some embodiments use medium-granularity Wi-Fi measurements in the beam angle domain—beam signal-to-noise ratio (SNR)—generated from a beam training (also known as beam alignment) phase. For each probing beam pattern (also known as beam sector), the beam SNR is collected by the 802.11ad device as a measure of beam quality. Such beam training is performed periodically to adapt the beam sector to environmental changes.

[0023] For example, the system can collect beam SNRs at 60 GHz using an 802.11ad-compliant router. The router supports single-stream communication using analog beamforming on a multi-element planar array. From one beam training, one Wi-Fi station can collect several beam SNRs across discrete transmit beam patterns. The measured beam SNRs are shared with networked CPUs and QPUs via Ethernet cables or different communication links to train DNNs and QNNs (e.g., through the IBM Quantum Cloud Service). The exemplary system can be deployed in a standard indoor environment setting.

[0024] The hybrid use of distributed CPUs and QPUs allows for flexible control of computational load balancing in the present invention. Due to the diverse specifications of CPUs and QPUs in the cloud and the enormous size of possible methods, assigning specific operations to different processors is difficult. For example, IBM QPUs have chips of different sizes, corresponding to quantum bit (qubit) counts ranging from 5 to 433. Fidelity, coherence time, quantum volume, and required power consumption also vary widely. In addition, the availability of cloud CPUs and QPUs changes over time depending on demand. The present invention uses a controller to assign specific operations to distributed CPUs and QPUs according to these factors, and the total resource budget is maintained at a target value according to the acceptable accuracy error. In addition, QNN architectures are automatically designed using Bayesian optimization, reinforcement learning, or metaheuristic optimization methods to explore different quantum ansatz to maximize inference accuracy while minimizing circuit size. A compact QNN architecture enables power-efficient inference. Quantum Machine Learning (QML) and Transfer Learning

[0025] A key challenge in Wi-Fi sensing is that Wi-Fi measurements or the surrounding environment can change over a measurement session, and these changes reduce the efficiency of machine learning models due to domain shifts. Some embodiments address the domain shift problem using a networked hybrid quantum-classical transfer learning framework.

[0026] This invention is based on the recognition that the quantum machine learning (QML) framework is suitable for Wi-Fi sensing systems and the development of QPUs is growing rapidly. Some modern DNN methods have already been migrated to the quantum domain, such as quantum convolutional layers, quantum autoencoders, quantum graph neural networks (GNNs), and quantum generative adversarial networks (GANs). More importantly, QML is more suitable for ISAC and Wi-Fi sensing because cloud quantum servers such as IBM Quantum and Amazon Braket are easily accessible without additional hardware.

[0027] Like DNNs, QNNs have been proven to possess the universal approximation property (UAP). Therefore, increasing the number of qubits and quantum entanglement layers can achieve the performance of conventional DNNs. In addition, quantum circuits are analytically distinguishable, which enables stochastic gradient descent (GDS) optimization of QNNs. Nevertheless, QNNs suffer from a gradient vanishing problem known as the barren plateau. To mitigate this problem, the simplified two-design (S2D) Ansatz has been proposed to achieve shallow entanglers for nearly any unit approximation. Because classical deep learning has become extremely energy-intensive, offloading heavy signal processing from the CPU to the QPU is crucial for future sustainable computing.

[0028] 1B illustrates various other scenarios for the ISAC system in some embodiments, such as intruder detection for security surveillance, indoor localization for moving people, posture recognition, fall detection for elderly monitoring, motion detection, occupancy monitoring, etc.

[0029] Figure 2A illustrates exemplary scenarios of posture recognition, occupancy detection, and localization in Wi-Fi sensing, and Figure 2B illustrates exemplary scenarios of security monitoring, energy management, elderly care, remote operation, gesture recognition, and biometric signal processing, according to some embodiments.

[0030] 3A and 3B illustrate an exemplary communication channel dependent on environmental conditions, enabling environmental sensing based on communication channel measurements without relying on external sensors. A communication device 101 transmits radio waves through a transmitter 201 using multiple antenna elements 203 to form a beam 205 toward the channel. Another communication device 102 receives radio waves through a receiver 202 using multiple antenna elements 204 to form a beam 206. This exemplary system uses the beam information and channel measurements to enable environmental sensing as well as the primary function of data communication. The transmitter 101 may be, for example, a handheld phone, and the receiver 102 may be a Wi-Fi access point. The Wi-Fi access point receives a signal waveform 1701 from the channel, which is modified by physical layer operations 1703, such as equalization and demodulation. The waveform is further modified by medium access control (MAC) operations 1705, such as packet synchronization and scheduling. At the physical layer, all CSI information can be used for environmental sensing. The MAC layer can instead use partial CSI 1710 or beam SNR. Environmental sensing includes, for example, indoor localization 1707 of a handheld phone 101. In particular, radio waves from multiple antennas in the millimeter wave (mmWave) band have rich spatial characteristics, as shown in Figures 4A, 4B, and 4C. Through Wi-Fi stations 41, fine-grained channel state information (CSI) 42 across the subcarrier spectrum and medium-grained beam signal-to-noise ratio (SNR) 43 can be jointly used in some embodiments to complement the physical characteristics of different radio bands.

[0031] Figure 5 shows an example QNN model used for Wi-Fi sensing using an S2D Ansatz consisting of Pauli-Y rotations and alternating controlled Z entanglements. This Ansatz is a variational quantum circuit (VQC) 50 based on a simplified version of a 2-dimensional circuit, whose statistical properties are identical to those of an ensemble random unitary with respect to the Haar measure up to the first two moments. In an n-qubit variational quantum circuit 50, there are 2(n-1)L variational parameters {θ} 58 on an L-layer S2D Ansatz. The VQC includes a quantum state preparation module, a state evolution module, and a state measurement module. Beam SNR measurement data 14 is first provided to the VQC through a preprocessing layer 51, and the preprocessed data is embedded in the VQC through an angle embedding layer 52. The embedding layer prepares the quantum state. This includes angle embedding, amplitude embedding, quantum approximation optimization algorithm embedding, IQP embedding, and Mottonen state preparation. After the state preparation module, a state evolution module is executed. As the state evolution module, entanglement layers 53 and 54 are repeated L times. After the entanglement layer, a state measurement module 55 is used to convert the quantum state into classical data. The quantum measurement module includes expectation values, probabilities, samples, variances, etc. For quantum state preparation, angle embedding or amplitude embedding is used in some embodiments. The quantum state evolution module can use different Ansatzes, such as the Quantum Approximation Optimization Algorithm (QAOA) Ansatz, Tree Tensor Network (TTN) Ansatz, Matrix Product State (MPS) Ansatz, Multiscale Entanglement Renormalization Ansatz (MERA), Strong Entanglement Layer Ansatz, Basic Entangler Layer Ansatz, Random Layer Ansatz, Continuous Variable (CV) Neural Network Layer, etc., as shown in FIG. 6. After the quantum measurement 55, the measured data is post-processed by an output layer 56, which provides a score for prediction, such as human pose 59. The predicted classes are then quantified by a loss function such as cross-entropy loss 57 to update the quantum variation parameters 58 using gradient methods, metaheuristic optimization methods, or variations thereof.

[0032] In some embodiments, to provide multidimensional beam SNR, an input linear layer is used in the CPU to initialize quantum states in the QPU for the rotation angles of the Pauli-Y gates. Multiclass pose estimation is provided by quantum measurements on Hamiltonian observables of the Pauli-Z operation, followed by an output layer that matches dimensions in some embodiments. Variational and trainable parameters for the input and output layers are optimized by adaptive momentum gradient methods to minimize the softmax cross-entropy loss. While QNNs are not necessarily superior to DNNs in prediction accuracy, they can be used in parallel with a small number of quantum gates. n Manipulating individual quantum states can improve computational efficiency.

[0033] Because the best QNN hyperparameters (e.g., qubit size n and layer size L) are highly dataset-dependent, tuning them typically requires a significant amount of manual effort. Additionally, there are many different types of quantum ansatz in the literature to explore. The present invention provides a method for automatically tuning the hyperparameters of a networked DNN-QNN hybrid architecture by exploring various ansatz options suitable for distributed CPUs and QPUs. Figure 6A illustrates some possible ansatz: angle embedding, IQP embedding, tensor networks such as QAOA, TTN, MPS, and MERA, basic entanglers, strongly entangled layers, and random layers. Some embodiments use an automated machine learning framework (AutoML) to optimize the QNN ansatz and hyperparameters.

[0034] FIG. 6B illustrates an exemplary method for designing QNN Ansatz and hyperparameters through an AutoML framework, according to some embodiments. The automated QNN Ansatz and hyperparameter design method searches for an optimal QNN circuit by using training data 60, which is further used to train candidate QNN circuits 61. Using validation data 62, the candidate QNN circuits are profiled, and a pruning mechanism 63 can stop training operations if the candidate profile is unlikely. If pruning is not required, the profile information is used to determine how to sample the next candidate 64. According to the sampled candidate values, a new QNN circuit is constructed (65) and retrained. For example, some embodiments use Bayesian optimization (BO) based on a tree-Parzen estimator (TPE) and hyperband pruning for efficient exploration of different hyperparameters. This, in some embodiments, automatically explores a diverse set of quantum Ansatz, qubit sizes, layer sizes, and learning rates without requiring human effort in Ansatz / hyperparameter tuning.

[0035] The present invention recognizes that designing QNN Ansatz is challenging due to the Baren-Plateau problem, in which the gradient variance of a randomly selected QNN circuit decays exponentially. Furthermore, the present invention recognizes that QNNs can be more compact than DNNs because an exponentially large state space can be expressed in terms of the number of qubits. The present method and system provide a method for achieving compact and power-efficient QNN design by simultaneously considering the trainability and size of the QNN Ansatz. Specifically, to address the Baren-Plateau problem, shallower and smaller QNN Ansatz are searched for using BO and RL optimization methods. Additionally, the present invention's networked hybrid quantum computing process controls the allocation of QNN and DNN operations to multiple QPUs and CPUs so that the total resource budget is maintained within a target range. Using a networked QPU-CPU hybrid provides high flexibility in adjusting the workload according to demand and acceptable accuracy. Additionally, by utilizing the capabilities of networked CPUs and QPUs, QNN layers can be seamlessly integrated with DNN layers. In some embodiments, the AutoML framework of FIG. 6B is further extended to automatically design the allocation of operations to multiple CPUs and QPUs in a network in addition to quantum ansatz.

[0036] Figure 6C shows an exemplary performance plot of different inference methods compared to a hybrid DNN-QNN designed by automated Ansatz for a Wi-Fi sensing system, according to some embodiments. This demonstrates the advantages of the present invention in an experiment. The experimental setup uses two Wi-Fi stations: one in front of the subject and the other behind the subject. Both stations are placed approximately 2 meters apart on a 1.2-meter-high stand. The subject is asked to perform a total of eight postures. Seven independent measurement sessions with different durations are recorded for each posture. The first four sessions are used as training data, and the last three sessions are used as test data. The total number of measurement samples is 42,915 and 1,040 for training and testing, respectively. We collect 60 GHz beam SNR using an 802.11ad-compliant TP-Link Talon AD7200 router. This router supports single-stream communication using analog beamforming on a 32-element planar array. From one beam training, one Wi-Fi station can collect 36 beam SNRs across discrete transmit beam patterns. AutoQML (Automatic Ansatz) explores 2000 trials of hyperparameter tuning, and each model is trained for up to 100 epochs using adaptive momentum gradient methods. Bayesian optimization uses categorical sampling of different Ansatz (Figure 6A (c)-(i)) and different embedding methods (Figure 6A (a) and (b)). The number of qubits and the number of entangler layers are also sampled from 5 to 15 and 1 to 5, respectively. In addition, an initial learning rate of 10 -3 ~10 -1The learning rate is adaptively decreased over 10 epochs, with a training loss plateau of 0.5x. Figure 6C shows the test accuracy as a function of the number of labeled training samples. Performance can exceed 90% accuracy for DNN, QNN, and SVM when a sufficient amount of labeled data is available. We confirm that small-scale QNNs designed by AutoQML can improve on baseline QNN models and achieve slightly better state-of-the-art performance than large-scale DNNs. More specifically, the QNN model consists of 12 variational parameters, while the DNN model requires 3500 trainable parameters. Using QNNs can significantly reduce computational complexity for Wi-Fi sensing and human monitoring systems. Functional analysis of variance (fANOVA) scores show that the choice of quantum Ansatz is the most important hyperparameter, with a greater impact than the learning rate parameter. Compressed Sensing and Communications

[0037] The present invention provides a method for distributing operations in signal processing methods for data communication and sensing across multiple CPUs and QPUs in a network. Figure 7 shows an exemplary signal processing diagram, in which some of the computational modules, such as quantization 71, normalization 72, fast Fourier transform (FFT) 73, QNN 74, cosine 76, convolutional neural network (CNN) 75, QNN 74, average 77, and comparison 78, are assigned to different CPUs and QPUs. The signal processing diagram determines the computation graph across the networked quantum-classical hybrid computing. In some embodiments, the trainable parameters of CPUs 71, 73, 75, and 77 and the variational parameters of QPUs 72, 74, 76, and 78 can be adjusted by backpropagating loss gradients along the computation graph. The present invention provides a method for controlling the allocation of operations across distributed CPUs and QPUs according to processor specifications, such as required power consumption, latency to complete operations, and accuracy of operations. The controller explores the optimal combination that enables power-efficient quantum and classical computing through the use of Bayesian optimization, reinforcement learning, or metaheuristic optimization methods.

[0038] FIG. 8A also illustrates an exemplary system used for grant-free multi-user, multi-device communication in which grant-free Internet of Things (IoT) devices are connected to a communication device. In this embodiment, multiple IoT devices 27 simultaneously access a wireless base station 25. The base station 25 offloads time-consuming signal processing to a distributed central processing unit (CPU) 22 and a quantum processing unit (QPU) 21 via a communication link 26. The CPU 22 and the QPU 21 perform cooperative operations by exchanging messages over links 23 and 24, enabling channel estimation and user identification for grant-free IoT communication with reduced computational power. Using networked quantum-classical hybrid computing 20, many devices can be collaboratively accessed using quantum multi-user detection, turbo equalization, and compressed sensing.

[0039] In some embodiments, such hybrid quantum-classical computing is used in grant-free wireless access systems with an indefinite number of devices communicating with a quantum processor-enabled base station. Such wireless networks are subject to the compressed sensing (CS) problem to estimate the presence of devices, e.g., in narrowband Internet of Things (NB-IoT) systems.

[0040] While most CS methods assume i-d device activity, typical grant-free networks may face correlated user activity due to a shared-medium environment. One prior-art CS technique is the well-known Orthogonal Approximation Message Passing (OAMP) algorithm. The OAMP algorithm can typically achieve better convergence performance than traditional CS techniques such as the Fast Iterative Soft Thresholding Algorithm (FISTA) and the standard AMP algorithm. The OAMP algorithm inherits a two-step iterative process: a decorrelated linear estimation (LE) step and a divergence-free nonlinear estimation (NLE) step. The OAMP alternating process maintains the orthogonality of the LE and NLE estimation errors and generally achieves superior convergence performance for solving linear recovery problems.

[0041] The present invention provides a method for improving CS methods by using networked hybrid quantum-classical processing. Specifically, some embodiments integrate quantum circuits into compressed sensing algorithms so that correlations between device activities can be exploited by VQC-based denoising in the NLE step.

[0042] 8B and 8C show an exemplary schematic diagram of such VQC-based compressed sensing, in which the NLE step 820 uses four subprocesses: embedding 822, denoising 824, state preparation based on estimation error 825, and VQC 823. The LE estimation 821 is refined by the denoising function 824 in the NLE step using a VQC-based scaling operation. In this embodiment, the use of a QPU for VQC enables an efficient NLE step for compressed sensing, especially in the presence of unknown correlation in grant-free device communication. In another embodiment, turbo decoding is realized by hybrid use of a CPU and a QPU in addition to compressed sensing. In this case, VQC-based decoding is realized by a QPU within the loop of the LE step 811 and the NLE step 812. Turbo decoding 813 includes QAOA-based decoding 814 and log-likelihood ratio (LLR) calculation 815.

[0043] Instead of using traditional stochastic gradient descent to gradually adjust trainable parameters in VQC, which requires numerous information exchanges between a classical computer and a quantum processor, some embodiments use a learning-by-learning (L2L) method based on a reinforcement learning framework to discover variational parameters in a small number of information exchanges. The L2L method can accelerate the optimization step during the discovery of trainable / variational parameters in VQC. For example, in a scenario where parameters are learned for use in QAOA, the inputs of the classical neural network are initialization and expectations over the QAOA cost Hamiltonian. Figure 8D shows an exemplary signal processing system utilizing a CPU 802 for a long-short-term memory (LSTM) module and a QPU 801 for QAOA decoding. QAOA decoding is used to identify communicating devices in an iterative approach, with multiple QAOA operations 804, 806, and 808 performed to refine the device identification. QAOA decoding obtains multiple variational parameters, beta and gamma, which are optimized by multiple LSTM cells 805, 807, and 809 for each QAOA decoding iteration. After hybrid use of the CPU and QPU for iteration 803, a final estimate of the device identity is provided. This L2L-based method allows for alternative optimization of variational parameters without the need for gradient backpropagation. System Implementation

[0044] 9A is a diagram of some components of a processing system that can be used for some operations for one or all embodiments of the present disclosure, according to some embodiments of the present disclosure. The processing system 1000A is interconnected via a bus system 1066 that interconnects the components of the system. The system 1000A may include one or more central processing units (“processors”) 1061. The processor 1061 may be a server computer, a third-party computer, a personal computer (PC), a client computer, a user device, a tablet PC, a laptop computer, a mobile phone, a smartphone, a web device, a network router, a switch or bridge, a console, or any machine configured to execute instructions in accordance with operations performed by a computing system. Additionally, the processing system 1000A may include data storage 1062, a stored module 1063, and a set of instructions 1064.

[0045] Processing system 1000A may include a primary memory 1071, which may include other types of memory (not shown), such as databases, non-volatile memory machine-readable media, servers, etc., depending on the user requirements and operating components. The primary memory, along with the above components, may store instructions, applications, programs, modules, computer programs, all of which may be executed by one or more processors of the system.

[0046] Continuing with reference to FIG. 9A , system 1000A may include a human-machine interface (HMI) 1081, which is a user interface or dashboard that connects a person to a machine, system, or device. Other terms for HMI include man-machine interface (MMI), operator interface terminal (OIT), local operator interface (LOI), or operator terminal (OT). HMI and graphical user interface (GUI) are similar, and thus, GUIs are often utilized within HMIs for visualization functions. Depending on the user's system and operational requirements, HMIs can be used to visually display data, track production time, trends, and tags, oversee KPIs, and monitor machine inputs and outputs. Some components that may be connected to the HMI or to bus system 1066 include a keyboard 1082, a display device 1083, a controller 1084, and input / output devices 1085, as well as other similar components associated with the above terms known to function in specific industries.

[0047] Other components of system 1000A may include controller interface 1086, controller 1087, external computers and computer systems 1072, network interface 1088, and at least one network 1089. Network interface 1088 may include a network adapter, which assists processing system 1000A in managing data within network 1089 with entities that may, but need not, be external to processing system 1000A (i.e., network equipment, etc.), typically configured through any known and / or convenient communication protocol supported by processing system 1000A and external entities. Network adapter 1089 may include a network adapter card, a wireless network interface card, a router, an access point, a wireless router, a switch, a multi-layer switch, a protocol converter, a gateway, a bridge, a bridge router, a hub, a digital media receiver, and / or a repeater. Network adapter 1089 may include a firewall that can govern and / or manage permissions to access data within the computer network and track levels of trust between different machines and / or applications. A firewall may be any number of modules having any combination of hardware and / or software components capable of enforcing a predetermined set of access rights between a particular set of machines and applications, machines and / or applications, for example, regulating traffic flow and resource sharing among these varying entities. A firewall may further manage and / or have access to access control lists that detail permissions, including, for example, access and operation rights of objects by individuals, machines, and / or applications, and the circumstances under which the permissions are established.

[0048] 9A , network 1089 may include a communication system that can communicate wirelessly or be wired to other components, such as devices, machines, etc., that can be used in embodiments of the present disclosure. For example, network 1089 can communicate with cloud 1090, which can include data storage 1091, modules 1092, a set of instructions 1093, and a quantum processing unit (QPU) 1094, as well as other components and aspects known in the understanding of clouds within the cloud industry. Note that bus system 1066 may be a separate bus, a specific connection from one component or subsystem to another, or both connected by a bridge, adapter, or controller. Bus 1066 may be configured to relay data packets between components of network equipment (i.e., network ports, other ports, etc.).

[0049] 9B is a block diagram illustrating some components of a computer that can be used with or in combination with some or all of the components of FIG. 9A, according to some embodiments of the present disclosure. Component 1000B may include a computer 1011 having a processor 1040, computer-readable memory 1012, storage 1058, and a user interface 1049 to a display device 1052 and keyboard 1051, connected via a bus 1056. For example, the user interface 1049 may interact with the processor 1040 and computer-readable memory 1012. 1049 is a user-by-user input When input is received from the surface of the interface 1057 or the keyboard 1053 , the data is acquired and stored in the computer readable memory 1012 .

[0050] The computer 1011 may include a power supply 1054, which may optionally be located external to the computer 1011, depending on the application. A user input interface 1057 may be connected through the bus 1056, adapted to connect to a display device 1048, which may include, among other things, a computer monitor, a camera, a television, a projector, or a mobile device. A printer interface 1059 may also be connected through the bus 1056, adapted to connect to a printing device 1032, which may include, among other things, a liquid inkjet printer, a solid ink printer, a mass-produced commercial printer, a thermal printer, a UV printer, or a dye-sublimation printer. A network interface controller (NIC) 1034 is adapted to connect to a network 1036 through the bus 1056, and may, among other things, render data or other information on a third-party display device, a third-party imaging device, and / or a third-party printing device external to the computer 1011. The computer / processor 1011 may include a GPS 1001 connected to the bus 1056. Through the network 1036, at least one classical computing processor, such as a central processing unit (CPU) 1091 and a field programmable gate array (FPGA) 1092, and at least one quantum computing processor (QPU) 1093 are used to execute signal processing methods for data communication and sensing.

[0051] 9B , inter alia, data or other data can be transmitted through a communication channel of the network 1036 and / or stored in a storage system 1058 for archiving and / or further processing. Additionally, time-series data or other data can be received wirelessly or wired from a receiver 1046 (or an external receiver 1038) or transmitted wirelessly or wired via a transmitter 1047 (or an external transmitter 1039), both of which are connected through a bus 1056. The computer 1011 can be connected to an external sensing device 1044 and an external input / output device 1041 via an input interface 1008. The input interface 1008 can be connected to one or more input / output devices 1041, an external memory 1006, an external sensor 1004, which can be connected to a machine-like device 1002. The controller 1042 can be connected to a device 1043. Additionally, another computer 1045 can be connected to the bus 1056. For example, the external sensing device 1044 may include sensors that collect data before, during, and after the machine's collected time-series data. The computer 1011 may be connected to another external computer 1042. An output interface 1009 may be used to output processed data from the processor 1040. Additionally, a user interface 1049 in communication with the processor 1040 and the non-transitory computer-readable storage medium 1012 receives input from a user via a surface 1052 of the user interface 1049, and acquires and stores area data in the non-transitory computer-readable storage medium 1012. Additionally, a controller 1061 may be connected to the bus 1056 to control devices associated with embodiments of the systems and methods of the present disclosure. Additional Features

[0052] In an aspect, at least one communication link comprises an interface, gateway, switching hub, router, access point, or variations thereof, and at least one communication link is based on electrical wired communication, optical fiber communication, radio wireless communication, free space optical communication, visible light communication, power line communication, magnetic coupling communication, acoustic communication, millimeter wave / terahertz communication, etc.

[0053] In an aspect, the at least one classical computing processor is based on a central processing unit (CPU), a graphics processing unit (GPU), a tensor processing unit (TPU), a field programmable gate array (FPGA), a microprocessor (uP), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a complex programmable logic device (CPLD), or the like.

[0054] In an embodiment, at least one quantum computing processor is based on superconducting quantum physics, trapped ion quantum physics, photonic quantum physics, neutral atoms, nuclear magnetic resonance, quantum annealing, boson sampling, a quantum physics emulator, or a variation thereof.

[0055] In some embodiments, the variational quantum circuit further includes a quantum state preparation module, a quantum state evolution module, and a quantum state measurement module. The quantum state preparation module is based on angle embedding, amplitude embedding, basis embedding, displacement embedding, quantum approximate optimization algorithm (QAOA) embedding, squeezing embedding, instantaneous quantum polynomial (IQP) time embedding, Mottonen state preparation Ansatz, or variations thereof. The quantum state evolution module is based on simplified two-design Ansatz, QAOA Ansatz, tree-tensor network (TTN) Ansatz, matrix product state (MPS) Ansatz, multiscale entanglement renormalization Ansatz (MERA), strongly entangled layer Ansatz, basic entangler Ansatz, random layer Ansatz, continuous variable (CV) neural network layer, or variations thereof. The quantum state measurement module is based on expectation values, sampling values, variance values, probabilities, quantum states, computation-based quantum density matrices, or variations thereof.

[0056] In another aspect, the classical-quantum hybrid computing method is based on adaptive filtering algorithms, gradient descent algorithms, feature extraction algorithms, classification algorithms, regression algorithms, prediction algorithms, compressive sensing algorithms, estimation algorithms, inference algorithms, deep neural networks, machine learning, denoising algorithms, encoding, decoding, modulation, demodulation, equalization, or variants thereof for signal processing in data communications and sensing.

[0057] In certain embodiments, trainable parameters for classical computing processors are tuned based on stochastic gradient descent (SGD), elastic backpropagation, root mean square (RMS) propagation, Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithm, adaptive momentum (Adam) optimization, metaheuristic optimization, evolutionary algorithms such as simulated annealing (SA), genetic algorithms (GA), simplex methods such as Nelder-Mead, adaptive subgradient, adaptive delta, covariance matrix adaptation (CMA), evolutionary strategies (ES), swarm intelligence such as ant colony optimization (ACO), particle swarm optimization (PSO), etc., deep learning, reinforcement learning (RL) such as policy gradient methods, Bayesian optimization (BO) such as Gaussian processes (GP), and variations thereof.

[0058] In certain embodiments, variational parameters for the quantum processing device are adjusted based on SGD, parameter shift rule, adjoint method, finite difference, policy gradient, elastic backpropagation, RMS propagation, BFGS algorithm, Adam, simplex method, adaptive subgradient, adaptive delta, metaheuristic optimization, SA, GA, evolutionary algorithm, CMA-ES, differential evolution (DE), swarm intelligence, deep learning, RL, BO, or variations thereof.

[0059] In an aspect, the exchange of data is based on encoding, decoding, modulation, demodulation, compression, decompression, equalization, transmitting, receiving, relaying, filtering, measuring, synchronization, queuing, scheduling, delay, multiplexing, demultiplexing, sampling, resampling, authentication, scrambling, interleaving, beamforming, shaping, etc.

[0060] In certain embodiments, the classical-quantum hybrid computing method is based on an adaptive filtering algorithm, a gradient descent algorithm, a feature extraction algorithm, a classification algorithm, a regression algorithm, a prediction algorithm, a compressed sensing algorithm, an estimation algorithm, an inference algorithm, a deep neural network, machine learning, a denoising algorithm, encoding, decoding, modulation, demodulation, equalization, or variations thereof.

[0061] In another embodiment, sub-instructions are distributed to networked CPUs and QPUs to determine resource allocation and operation types. At least one controller including a memory and a processor that stores the distributed sub-instructions can construct a computing graph and backpropagate the computing graph to calculate loss gradients across multiple CPUs and QPUs so that trainable parameters and variational parameters are adjusted. In classical computing processors, deep neural networks are constructed by a set of trainable parameters. In quantum computing processors, variational quantum circuits are specified by a set of variational parameters.

[0062] In one aspect, the training data and test data are based on timestamps, temperature measurements, sound volume, light measurements, image data, video data, magnetic flux measurements, accelerometer output measurements, pressure measurements, vibration measurements, infrared light measurements, humidity measurements, power measurements, particle density measurements, odor measurements, radiation measurements, other digital data, and other analog data. The data is related to the environmental state to be estimated, such as the behavior type, state, posture, and position of an object, such as a stationary object, a moving object, an animate object, or an inanimate object, such as surrounding furniture, materials, buildings, plants, pets, computers, robots, users, or communication devices.

[0063] In an aspect, the wireless channel attribute data is based on one or a combination of a signal strength amount, a noise strength amount, an interference strength amount, a signal-to-noise ratio (SNR) amount, a signal-to-interference-noise ratio (SINR) amount, a set of channel state information, a time-of-arrival amount, an angle of arrival (AoA), an angle of departure (AoD), a power delay profile (PDP), a power spectral density (PSD), a delay Doppler spectrum, an angular power spectrum, a beam power profile, or other data.

[0064] In an embodiment, the disparate data is acquired by one or a combination of visual / imaging sensors, temperature sensors, radiation sensors, proximity sensors, pressure sensors, position sensors, photoelectric sensors, particle sensors, motion sensors, metal sensors, level sensors, leak sensors, humidity sensors, gas / chemical sensors, force sensors, flow sensors, flaw sensors, flame sensors, electrical sensors, contact sensors, non-contact sensors, or other sensor devices.

[0065] In another aspect, the estimated environmental state is determined over a period of time and includes one or a combination of at least one object behavior type, at least one object state, at least one object pose, or at least one object position, wherein the at least one object is one of a stationary object, a moving object, a living thing, a non-living thing such as one or a combination of surrounding furniture, surrounding materials, surrounding buildings, surrounding plants, surrounding pets, surrounding computers, surrounding robots, surrounding users, or wireless devices.

[0066] In another aspect, the environmental state includes one or a combination of the following: activity of at least one living thing, at least one posture of an object or living thing, occupancy of an object or living thing, amount of objects or living things in an area of ​​the environment, indoor traffic volume, location of an object or living thing, location of an outdoor object or outdoor living thing within range of the wireless device, a stationary or moving robot or non-living thing, a set of instructions related to indoor navigation, or a set of instructions related to indoor parking assistance.

[0067] In yet another embodiment, the parameterized model is based on a trained deep neural network, where the deep neural network is trained online by accessing a communications network or offline by accessing stored measurement data to acquire at least one type of measurement from a first wireless band and at least one type of measurement from a second wireless band. The set of fused measurements is input to the deep neural network to generate an estimated environmental state of the environment. A loss value is calculated based on a difference between the generated estimated environmental state and a stored estimated environmental state accessed from the stored measurement data. The set of trainable parameters of the deep neural network is updated by a set of training rules, where the set of training rules is based on a gradient method. The deep neural network includes one or a combination of first network blocks that encode the set of fused measurements into an encoded vector depending on whether the two types of measurements to be fused are in different types of measurement formats, such as uniformly aligned asynchronous and uncoordinated measurement formats. The second network block converts the encoded vector into a feature vector so that the feature vector is insensitive to the different types of measurement formats. The third network block generates an estimated environment state based on the feature vector and a set of fusion measurements, the fourth network block reconstructs the set of fusion measurements from the feature vector, and the fifth network block regularizes the feature vector for disentanglement in an adversarial manner.

[0068] In an aspect, the at least one type of measurement from the first radio band is a medium-grained beam signal-to-noise ratio (SNR) measurement in the 60 GHz millimeter-wave band, and the at least one type of measurement from the second radio band is a fine-grained channel state information (CSI) measurement at sub-6 GHz from multiple spatial streams, whereby the fusion includes fusing the fine-grained CSI measurements at sub-6 GHz from the multiple spatial streams with the fine-grained CSI measurements at sub-6 GHz from the multiple spatial streams. The fine-grained CSI measurements include complex-valued amplitudes at orthogonal frequency division multiplexing (OFDM) subcarrier tones, such that the fine-grained CSI measurements are equivalent to a power delay profile (PDP) in the time domain, reflecting power distribution along the propagation path, and the medium-grained beam SNR provides a spatial-domain channel measurement across multiple beamforming directions or beam spaces.

[0069] In another aspect, environmental condition coverage is automatic based on the generation of estimated environmental conditions. A computing processor is configured to access each of the modules via data storage through an executable program, each module including one or more predetermined rules. The estimated environmental conditions are input into each model in an iterative manner to generate an output of either an alert action or no action. If an alert action is generated by a module, it indicates a violation of at least one predetermined rule. The computing processor converts the alert action into an alert signal and transmits the alert signal via a transceiver to a communications network. The alert signal is received and input into an alert processing module associated with the system to generate an output including one or more corrective actions along with a set of instructions based on the estimated environmental conditions that are sent to a work team for completion. At least one module is a proximity module including inputting the estimated environmental conditions into the proximity module to generate a proximity alert action or not generate a proximity alert action, where generating a proximity alert (PA) action indicates a violation of at least one predetermined proximity rule, for example, an object moving within the environment has entered a predetermined object-prohibited designated area within the environment, and the computing processor converts the PA action into a PA signal and transmits the PA signal via the transceiver to a communications network, the PA signal is received and input into an alert processing module associated with the system to generate an output including one or more corrective proximity actions having a set of instructions based on the estimated environmental conditions that are transmitted to a work team for completion, the one or more corrective proximity actions including directing the moving object to move out of the predetermined object-prohibited designated area.

[0070] In another aspect, each estimated environmental state for each time period of the plurality of time periods determines a position of at least one object or organism within the environment, and each estimated environmental state is displayed on a display device to provide a visual tracking indication of the determined position of the at least one object or organism for that time period.

[0071] In an aspect, an executable program includes instructions for performing coordination between at least one wireless device using a plurality of antenna elements across a first communication channel of a first wireless band and other wireless devices including instructions using respective plurality of antenna elements across the first communication channel of the first wireless band, the instructions, when executed by a computing processor, performing coordination to time synchronize the at least one wireless device with the other wireless devices.

[0072] In another aspect, the stored data includes values ​​indicative of signal-to-noise ratio (SNR) measurements of a set of beams emitted at different beam angles by a phased antenna array and measured at a set of locations, which provides a mapping between different combinations of SNR values ​​of the set of beams and the set of locations, such that a location in the set of locations is a location for a period of time that maps to a unique combination of SNR values ​​of the set of beams, and further provides information associated with a type of behavior of the device at that location for that period of time, an attitude of the device at that location for that period of time, locations of physical objects in the environment for that period of time, and a type of behavior of surrounding users in the environment for that period of time.

[0073] Further, in an aspect, the stored data includes values ​​indicative of link attributes including one of a beam received signal strength indicator (RSSI) measurement, a beam channel state information (CSI) measurement, and a beam pattern or beam sequence, each link attribute including measurements of a set of beams radiated at different beam angles by a phased array of antennas and measured at a set of locations in the environment, the stored values ​​providing a mapping between different combinations of at least one link attribute value of the set of beams and the set of locations, wherein a location in the set of locations is mapped to a unique combination of at least one link attribute value of the set of beams. The link attribute further includes one or a combination of RSSI measurements or CSI measurements.

[0074] An aspect includes using a communications system with beamforming transmission of a millimeter wave spectrum in an environment, the system including a phased antenna array configured to perform beamforming to establish millimeter wave channel links with devices at different locations within the environment. The method includes performing beam training with a target device located within the environment to estimate SNR measurements of different beams transmitted over different beam angles using control circuitry coupled to the antenna. The control circuitry is configured to select at least one primary angle for beamforming communications with the target device in response to the beam training. A memory coupled to the phased antenna array is accessed, the memory storing data. The stored data includes values ​​indicative of SNR measurements of a set of beams radiated by the phased antenna array at different beam angles and measured at a set of locations within the environment. The stored values ​​provide a mapping between different combinations of SNR values ​​of the set of beams and a set of locations. Thus, a location within the set of locations is mapped to a unique combination of SNR values ​​of the set of beams. From the mapping stored in the memory, a location of the target device corresponding to the SNR values ​​of the different beams estimated during beam training is estimated. A phased antenna array is used to transmit an estimated location of the target device via beamforming transmissions over at least one primary angle.

[0075] In another aspect, the stored data from the data storage includes fingerprinting data, where the fingerprinting data includes each location from a set of locations mapped to a unique combination of SNR values ​​of a set of beams for a period of time, and thus the unique combination of SNR values ​​of a set of beams for that period of time further provides information associated with the type of behavior of the device at that location for that period of time, the attitude of the device at that location for that period of time, the location of physical objects in the environment for that period of time, and the type of behavior of surrounding users in the environment for that period of time.

[0076] Some aspects include a communication system using beamforming transmission of a millimeter wave spectrum in an environment, the communication system including a phased antenna array configured to perform beamforming to establish millimeter wave channel links with devices at different locations within the environment. The communication system includes a memory connected to the phased antenna array and having stored data. The stored data includes values ​​indicative of signal-to-noise ratio (SNR) measurements of a set of beams radiated by the phased antenna array at different beam angles and measured at a set of locations, providing a mapping between different combinations of SNR values ​​of the set of beams and the set of locations. Thus, a location in the set of locations is mapped to a unique combination of SNR values ​​of the set of beams. A control circuit is communicatively connected to the phased antenna array and the memory and configured to estimate SNR values ​​of different beams transmitted over different beam angles by performing beam training at a target device located within the environment. In response to the beam training, the control circuit selects at least one primary angle for beamforming communication with the target device. From the mapping stored in the memory, the control circuit estimates a location of the target device corresponding to the SNR values ​​of the different beams estimated during beam training. A phased antenna array is used to transmit an estimated location of the target device via beamforming transmissions across at least one primary angle.

[0077] In other aspects, the stored data includes each location of the set of locations mapped to a unique combination of SNR values ​​of the set of beams for a period of time, and thus the unique combination of SNR values ​​of the set of beams for that period of time further provides information associated with the type of behavior of the device at the location for that period of time, the attitude of the device at the location for that period of time, the location of physical objects in the environment for that period of time, and the type of behavior of surrounding users in the environment for that period of time.

[0078] The above-described embodiments of the present invention may be implemented in any of numerous ways. For example, the embodiments may be implemented using hardware, software, or a combination thereof. If implemented in software, the software code may run on any suitable processor or collection of processors, which may be located on one computer or distributed across multiple computers. Such a processor may be implemented as an integrated circuit, with one or more processors in integrated circuit components. However, the processor may be implemented using circuitry in any suitable format.

[0079] Also, embodiments of the present invention may be implemented as a method, an example of which is provided. The order of operations performed as part of this method may be determined in any suitable manner. Thus, embodiments may be configured to perform operations in an order different from that illustrated, which may include performing some operations simultaneously, even though in the illustrated embodiment they are shown as a sequence of operations.

[0080] In the claims, ordinal terms such as "first" and "second" modifying a claim element do not in themselves imply any priority, precedence, or order of a claim element relative to another element, or any chronological order in which the actions of a method should be performed, but are merely used as labels to distinguish claim elements (when no ordinal term is used) from other elements of the same name.

[0081] Although the invention has been described in terms of examples of preferred embodiments, it is to be understood that various other adaptations and modifications are possible within the spirit and scope of the invention.

[0082] Therefore, it is the object of the appended claims to cover all such variations and modifications as come within the true spirit and scope of the invention.

Claims

1. 1. A system for integrated computing, sensing, and communication, said system comprising: at least one communication link; at least one classical computing processor configured with a set of trainable parameters; at least one quantum computing processor configured with a set of variational parameters; at least one controller that constructs a set of computing graphs over a network connecting the at least one classical computing processor and the at least one quantum computing processor through the at least one communication link, such that gradients are backpropagated through the set of computing graphs; and at least one memory bank coupled to the at least one classical computing processor and the at least one quantum computing processor through the at least one communication link, wherein the at least one memory bank stores instructions for implementing a set of computing methods based on networked hybrid classical-quantum processing for data communication, machine learning, and environmental sensing according to the computing graph, the instructions, when executed by the at least one classical computing processor and the at least one quantum computing processor, perform the following steps, which comprise: The method includes a step of distributing a set of sub-instructions to the at least one classical computing processor and the at least one quantum computing processor, wherein the step of distributing the set of sub-instructions determines resource allocations and types of operations for the at least one classical computing processor and the at least one quantum computing processor, and the step further includes: causing the at least one classical processor to exchange data over the at least one communication link to adjust the set of trainable parameters and the set of variational parameters according to the set of computing graphs and to update a set of data in the at least one memory bank; causing the at least one quantum processor to perform a measurement of a quantum state according to the set of computing methods and taking into account the set of variational parameters and the set of data in the at least one memory bank.

2. 10. The system of claim 1, wherein the at least one communication link is configured using an interface, a gateway, a switching hub, a router, an access point, or variations thereof, and the at least one communication link is based on electrical wired communication, optical fiber communication, radio wireless communication, free space optical communication, magnetic coupling communication, acoustic communication, millimeter wave / terahertz communication, or variations thereof.

3. 10. The system of claim 1, wherein the at least one classical computing processor is based on a central processing unit, a graphics processing unit, a tensor processing unit, a field programmable gate array, a microprocessor, a digital signal processor, an application specific integrated circuit, a complex programmable logic device, or a variation thereof.

4. 10. The system of claim 1, wherein the at least one quantum computing processor is based on a superconducting quantum device, an ion trap quantum device, a photonic quantum device, a neutral atom device, a nuclear magnetic resonance device, a quantum annealing device, a boson sampling device, a quantum emulator device, or a variation thereof.

5. The system of claim 1 , wherein the quantum computing processor further includes a quantum state preparation module, a quantum state evolution module, and a quantum state measurement module.

6. 6. The system of claim 5, wherein the quantum state preparation module is based on angle embedding, amplitude embedding, basis embedding, displacement embedding, quantum approximate optimization algorithm embedding, squeezing embedding, instantaneous quantum polynomial time embedding, Mottonen state preparation Ansatz, or a variant thereof.

7. 6. The system of claim 5, wherein the quantum state evolution module is based on a simplified two-design Ansatz, a quantum approximate optimization algorithm Ansatz, a tree tensor network Ansatz, a matrix product state Ansatz, a multiscale entanglement renormalization Ansatz, a strong entanglement layer Ansatz, a basic entangler Ansatz, a random layer Ansatz, a continuously variable neural network layer, or a variation thereof.

8. 6. The system of claim 5, wherein the quantum state measurement module is based on expectation, sampling, variance, probability, quantum state, von Neumann entropy, mutual information, classical shadow protocol, computation-based quantum density matrix, or variations thereof.

9. 10. The system of claim 1, wherein the suite of computing methods is based on an adaptive filtering algorithm, a gradient descent algorithm, a feature extraction algorithm, a classification algorithm, a regression algorithm, a prediction algorithm, a compressive sensing algorithm, an estimation algorithm, an inference algorithm, a deep neural network, machine learning, a denoising algorithm, encoding, decoding, modulation, demodulation, equalization, or variations thereof.

10. 2. The system of claim 1, wherein the set of data is associated with an environmental state to be estimated, the environmental state including one or a combination of behavior type, state, posture, movement, and position of at least one object, and the at least one object is a stationary object, a moving object, a living object, or a non-living object such as one or a combination of surrounding furniture, surrounding materials, surrounding buildings, surrounding plants, surrounding pets, surrounding computers, surrounding robots, surrounding users, or communication devices.

11. 1. A computer-implemented method for signal processing, communication, and sensing performed by at least one classical computing processor and at least one quantum computing processor, wherein the at least one classical computing processor and the at least one quantum computing processor are coupled to a memory bank through at least one communication link, the memory bank storing instructions for implementing a set of computing methods based on networked hybrid classical-quantum processing, the instructions performing the following steps: exchanging a set of data between the at least one memory bank, the at least one classical computing processor, and the at least one quantum computing processor over the at least one communication link; Distributing a set of sub-instructions to the at least one classical computing processor and the at least one quantum computing processor; constructing a set of computing graphs on the at least one classical computing processor and the at least one quantum computing processor such that gradients are backpropagated through the set of computing graphs; adjusting a set of variational parameters for the at least one quantum computing processor according to the set of computing graphs; adjusting a set of trainable parameters for the at least one classical computing processor according to the set of computing graphs; modifying the set of data according to the set of subinstructions, the set of variational parameters, the set of trainable parameters, and the set of computing graphs; The method, wherein the step of distributing the set of subinstructions determines resource allocations and types of operations for the at least one classical computing processor and the at least one quantum computing processor.

12. 12. The method of claim 11, wherein tuning the set of trainable parameters is based on stochastic gradient descent, elastic backpropagation, root-mean-square propagation, Broyden-Fletcher-Goldfarb-Shanno algorithm, adaptive momentum optimization, metaheuristic optimization, simulated annealing, genetic algorithm, simplex method, adaptive subgradient, adaptive delta, evolutionary algorithm, evolutionary strategy, swarm intelligence, deep learning, reinforcement learning, Bayesian optimization, or variations thereof.

13. 12. The method of claim 11, wherein adjusting the set of variational parameters is based on stochastic gradient descent, parameter shifting rules, adjoint methods, finite differences, policy gradients, elastic backpropagation, root-mean-square propagation, Broyden-Fletcher-Goldfarb-Shanno algorithm, adaptive momentum optimization, simplex methods, adaptive subgradients, adaptive delta, metaheuristic optimization, simulated annealing, genetic algorithms, evolutionary algorithms, evolutionary strategies, swarm intelligence, deep learning, reinforcement learning, Bayesian optimization, or variations thereof.

14. 12. The method of claim 11, wherein the exchanging step further comprises encoding, decoding, modulating, demodulating, compressing, decompressing, equalizing, transmitting, receiving, relaying, filtering, measuring, synchronizing, queuing, scheduling, delaying, multiplexing, demultiplexing, sampling, resampling, authenticating, scrambling, interleaving, beamforming, shaping, or a combination thereof. How to do it.

15. 12. The method of claim 11 , wherein the set of computing methods is based on an adaptive filtering algorithm, a gradient descent algorithm, a feature extraction algorithm, a classification algorithm, a regression algorithm, a prediction algorithm, a compressive sensing algorithm, an estimation algorithm, an inference algorithm, a deep neural network, machine learning, a denoising algorithm, encoding, decoding, modulation, demodulation, equalization, or variations thereof.

16. The method of claim 11 , wherein modifying the set of data is based on a deep neural network specified by the set of trainable parameters for the at least one classical computing processor.

17. The method of claim 11 , wherein modifying the set of data is based on a variational quantum circuit specified by the set of variational parameters for the at least one quantum processor.

18. 12. The method of claim 11, wherein the set of data is based on one or a combination of a timestamp, a temperature amount, a sound volume, a light amount, image data, video data, a magnetic flux amount, an accelerometer output amount, a pressure amount, a vibration amount, an infrared red light amount, a humidity amount, a power amount, a particle density amount, an odor amount, a radiation amount, other digital data, and other analog data.

19. 12. The method of claim 11, wherein the set of data is associated with an environmental state to be estimated, the environmental state including one or a combination of behavior type, state, posture, movement, and position of at least one object, and the at least one object is a stationary object, a moving object, a living object, or a non-living object such as one or a combination of surrounding furniture, surrounding materials, surrounding buildings, surrounding plants, surrounding pets, surrounding computers, surrounding robots, surrounding users, or communication devices.

Images