A cross-domain identity recognition method and system based on gait-conditional generative adversarial network
By applying a generative adversarial network model based on gait conditions in the WiFi signal recognition system, the interference problems caused by the direction and speed of walking paths in the WiFi signal are solved, and high accuracy recognition of human gait is achieved.
Patent Information
- Application Number
- CN202411425202.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-12
- Publication Date
- 2025-02-11
- Estimated Expiration
- 2044-10-12
AI Technical Summary
The prior art is difficult to effectively remove interference caused by the direction and speed of walking paths in WiFi signals, affecting the accuracy of human gait recognition.
Using a generative adversarial network (CG-GAN) model based on gait conditions, WiFi CSI data is converted into an embedding layer through a feature extractor, and Gaussian noise perturbation is introduced to obtain domain generalization capabilities. The model includes generator, discriminator and classification discriminator to remove noise from the interference domain through a variety of loss functions (such as KL divergence loss, target adversity loss, cyclic consistency loss and identity mapping loss) learning domain adaptation feature extraction to remove noise from the interference domain through multiple loss functions (such as KL divergence loss, target adversity loss, cyclic consistency loss and identity mapping loss). And retain the unique characteristics of individual gait.
It effectively reduces the interference of gait on the direction of walking path, improves the accuracy of identification of different individuals, can alleviate the negative impact in multiple interference domains, and ensures that the WiFi perception system can accurately identify the human body's CSI gait characteristics.
Smart Images

Figure CN118964957B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of identity recognition technology, and in particular to a cross-domain identity recognition method and system based on a gait conditional generative adversarial network. Background Art
[0002] WiFi devices (such as routers, mobile phones, etc.) transmit radio frequency signals in the form of WiFi spectrum during the communication process. These signals are reflected and diffracted by the human body in the area, and can be used to identify activities such as hands, body or breathing. In real life scenarios, these identification methods can be used in a variety of fields such as security monitoring systems, elderly motor function status monitoring, smart home devices, etc. Since each individual's natural walking posture (hereinafter referred to as "gait") theoretically has the specificity of being uniquely bound to biological features, some existing technologies attempt to explore the possibility of using CSI (Channel State Information) corresponding to the human gait collected by WiFi devices for HI (Human Identification). Compared with traditional sensors (such as cameras, microphones, etc.), non-invasive human recognition systems based on WiFi signals involve fewer user privacy issues and are well adapted to personalized deployment applications in various sampling locations such as smart homes and offices. Therefore, their application in human recognition work has important research value. In various real environments, different walking trajectory directions and walking speeds will cause abnormal fluctuations in signal characteristics and introduce domain interference to the CSI signal collected by WiFi sensing, thereby negatively affecting the effectiveness of WiFi sensing. Existing technologies attempt to use transfer learning and data enhancement technology to remove the impact of interference domains, but they still cannot effectively solve the problem of removing interference from complex human walking paths. Summary of the invention
[0003] The main technical problem solved by the present invention is to provide a cross-domain identity recognition method and system based on a gait conditional generative adversarial network, wherein the cross-domain identity recognition method can reduce the interference of gait determined by WiFi signals on the walking path direction, and improve the recognition accuracy of different individuals.
[0004] In order to solve the above problems, the present invention provides a cross-domain identity recognition method based on a gait conditional generative adversarial network. The cross-domain identity recognition method based on the gait conditional generative adversarial network includes: inputting WiFi CSI human gait data to be classified into a CG-GAN model, learning feature extraction with domain adaptability by the CG-GAN model, autonomously adapting complex source domain information of different receiver layout positions of WiFi signals to a target domain, effectively extracting domain-independent information between interference domains, and retaining unique features of different individuals, wherein the CG-GAN model includes a pair of feature extractors, a pair of generators, a pair of discriminators, and a classification discriminator that retains human gait information to learn the mapping relationship between different domains, and the CG-GAN model uses a feature extractor to convert data samples in the source domain and data samples in the target domain into an embedding layer, and introduces Gaussian noise perturbation in the embedding layer, so that the feature extractor can cope with interference from multiple subdomains and obtain preliminary domain generalization capabilities.
[0005] In one embodiment, the CG-GAN model uses KL divergence loss to align the embedding layer distribution to a Gaussian distribution η~N(η|0,I) with zero mean and unit variance. The KL divergence loss can be formally described as follows:
[0006]
[0007] Among them, D KL (p||q)=-∫p(z)log p(z) / q(z)dz represents the KL divergence between two different distributions p(z) and q(z), which encourages the embedding representation of the latent space to be domain-independent. p and q refer to the probability distribution of z obtained by calculating the KL divergence. E x represents the source domain feature extractor, E y represents the target domain feature extractor, Z x represents the source domain data embedding layer, Z y represents the target domain data embedding layer, E X and E Y They represent the formal descriptions for source domain data and target domain data respectively.
[0008] In one embodiment, after obtaining the embedding layer perturbed by Gaussian noise, the CG-GAN model uses a generator to synthesize the embedding layer representation into a simulated data sample, uses a discriminator to determine whether the data is a source domain or a target domain, distinguishes the real data input, and guides the generator to generate realistic samples through the synthetic samples simulated by the generator, that is, to obtain the reconstructed source domain channel state information.
[0009] In one embodiment, for the mapping process from the source domain to the target domain, or the mapping process from the target domain to the source domain, the target adversarial loss involved is formally described as follows:
[0010] Among them, x represents the source domain data sample, and y represents the target domain data sample.
[0011] In one embodiment, the CG-GAN model uses cycle consistency loss CCL to preserve the semantic information of the original CSI during the domain adaptation process, and remaps the synthetic data in the target domain back to the original source domain. The cycle consistency loss formed by the cycle transformation is formally described as follows:
[0012]
[0013] In one embodiment, the CG-GAN model also applies an identity mapping loss so that when the sample is transferred to the generator corresponding to its original domain, a sample that maintains domain invariance is generated. The identity mapping loss can be formally described as follows:
[0014] in,
[0015] x represents the source domain data sample, and y represents the target domain data sample.
[0016] In one embodiment, the CG-GAN model uses a classification discriminator to maintain the uniqueness of the gait features reflected by the human body in different states during the domain adaptation process, and quantifies the difference between the predicted label of the gait sample transformed by the generative adversarial network and its true label. The gait classification loss can be formally described as follows:
[0017]
[0018] Where C represents the set of gait categories, l x represents the real source domain data label category, σ represents the softmax operation, Using cross entropy loss for supervised classification, the CG-GAN model uses the label information corresponding to the source domain data with known labels for supervised classification learning.
[0019] In one embodiment, the training loss function of the CG-GAN model is formally expressed as follows:
[0020]
[0021] Among them, λ 0 , 1 , 2 and λ 3 They represent the weights of the identity mapping loss, cycle consistency loss, gait classification loss, and KL divergence loss respectively.
[0022] The present invention also provides a cross-domain identity recognition system based on a gait conditional generative adversarial network, comprising an IoT device with a WiFi function, the IoT device having a domain filter model trained by a server, the domain filter model comprising a CG-GAN model, the CG-GAN model having input WiFi CSI human gait data to be classified, learning feature extraction with domain adaptation capability, autonomously adapting complex source domain information of different receiver layout positions of WiFi signals to a target domain, and effectively extracting domain-independent information between interference domains, wherein the CG-GAN model comprises a pair of feature extractors, a pair of generators, a pair of discriminators and a classification discriminator that retains human gait information to learn the mapping relationship between different domains, and the CG-GAN model uses the feature extractor to convert data samples x in the source domain X and data samples y in the target domain Y into an embedding layer Z x , Z y ,Gaussian noise perturbation is introduced in the embedding layer, so that the feature extractor can cope with the interference from multiple sub-domains and obtain preliminary domain generalization ability.
[0023] In one embodiment, the CG-GAN model uses KL divergence loss to align the embedding layer distribution to a Gaussian distribution η~N(η|0,I) with zero mean and unit variance. The KL divergence loss is formally described as follows:
[0024]
[0025] Among them, D KL (p||q)=-∫p(z)log p(z) / q(z)dz represents the KL divergence between two different distributions p(z) and q(z), which encourages that the embedding representation of the latent space should be domain-independent. p and q refer to the probability distribution of z obtained by calculating the KL divergence.
[0026] In one embodiment, after obtaining the embedding layer perturbed by Gaussian noise, the CG-GAN model uses the generator to synthesize the embedding layer representation into a simulated data sample, uses the discriminator to determine whether the data is a source domain or a target domain, distinguishes the real data input, and guides the generator to generate realistic samples through the synthetic samples simulated by the generator, that is, to obtain the reconstructed source domain channel state information. In one embodiment, for the mapping process from the source domain to the target domain, or the mapping process from the target domain to the source domain, the target adversarial loss involved is formally described as follows:
[0027]
[0028] In one embodiment, the CG-GAN model uses cycle consistency loss to preserve the semantic information of the original CSI during the domain adaptation process and remap the synthesized data in the target domain back to the original source domain. The cycle consistency loss formed by the cycle transformation is formally described as follows:
[0029]
[0030] In one embodiment, the CG-GAN model also applies the identity mapping loss so that when the sample is transferred to the generator corresponding to its original domain, it can generate samples that maintain domain invariance. The identity mapping loss can be formally described as follows:
[0031]
[0032] In one embodiment, the CG-GAN model uses a classification discriminator to maintain the uniqueness of the gait features reflected by the human body in different states during the domain adaptation process, and quantifies the difference between the predicted label of the gait sample transformed by the generative adversarial network and its true label. The gait classification loss can be formally described as follows:
[0033]
[0034] Where C represents the set of gait categories, l x represents the real source domain data label category, σ represents the softmax operation, Using cross entropy loss for supervised classification, the CG-GAN model uses the label information corresponding to the source domain data with known labels for supervised classification learning.
[0035] In one embodiment, the training loss function of the CG-GAN model is formally expressed as follows:
[0036]
[0037] Among them, λ 0 , 1 , 2 and λ 3 They represent the weights of the identity mapping loss, cycle consistency loss, gait classification loss, and KL divergence loss respectively.
[0038] The present invention is based on a cross-domain identity recognition method and system of a gait conditional generative adversarial network. By using the gait conditional generative adversarial network model to learn the mapping relationship between multiple interference domains, the system can improve the ability to adapt to multiple types of interference domains, introduce Gaussian noise in the middle hidden layer of the conditional generative adversarial network, and learn feature extraction with domain adaptation capabilities. The domain adaptive feature extractor acts as a domain filter to remove the noise of the complex interference domain mixed with multiple WiFi device layouts, while retaining the unique characteristics of different individuals, ensuring that the WiFi perception system can relatively accurately identify the CSI gait characteristics of the individual. It can eliminate the negative impact of WiFi device layout, walking direction, and speed and accurately identify different individuals. It can alleviate the negative impact of multiple interference domains. The CG-GAN feature extractor E trained on the server X It is used as a domain filter model and deployed as the backbone network of the inference model on devices with WiFi functions to extract the unique gait features of the human body in the WiFi CSI signal to realize human gait recognition. It can reduce the interference of determining the gait through WiFi signals on the walking path direction and improve the recognition accuracy of different individuals. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the description only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0040] Figure 1 It is a schematic diagram of a conditional gait generative adversarial network in a cross-domain identity recognition method based on a gait conditional generative adversarial network of the present invention.
[0041] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0042] The claims of the present invention are further described in detail below in conjunction with specific embodiments and drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments proposed by ordinary technicians in this field before making creative work also fall within the scope of protection of the present invention.
[0043] It should be understood that, in the description of the embodiments of the present invention, all directional indication terms, such as "up", "down", "left", "right", "front", "back", etc., indicate the orientation or position relationship based on the orientation, position relationship shown in the drawings or the orientation or position relationship in which the invention product is usually placed when used, which is only for the convenience of simplifying the description of the present invention, and does not expressly or implicitly indicate that the device, element or component referred to must have a specific orientation and a specific orientation structure, and should not be understood as a limitation on the present invention. It is only used to explain the relative position relationship, movement, etc. between the components shown in the drawings. When the specific posture changes, the directional indication may also change accordingly. For processes and methods, unless it is clearly stated in the specification that each step must be performed in sequence, excluding the case where the order of each step is changed, otherwise the corresponding invention purpose cannot be achieved, it is considered that for the sake of simplicity of description, the specification only selects the best or better one from various implementation methods as an example for explanation.
[0044] In addition, ordinal numbers such as "first" and "second" in the present invention are only used for the purpose of distinction, and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. The features defined as "first" and "second" can expressly or implicitly indicate at least one of the technical features. In the present invention, for the convenience of explanation, there may be quantifiers such as "one", "two", "multiple", "at least one" or "several" to define the technical (structural) features, where "multiple" means at least two, that is, two or more; "at least one" and "several" mean one or one and the corresponding technical features; quantifiers and other limitations are only for illustrating the specific embodiment or the best implementation method, and they should be included as long as they are not contrary to the overall concept and purpose of the invention, unless it is clearly stated that they must be defined by the quantifiers to be implemented or to achieve the purpose of the invention.
[0045] In the present invention, unless otherwise clearly stipulated and limited, the terms such as "installation", "setting", "connection", "fixation" and "screw-on" should be understood in a broad sense. For example, the positional relationship between components can be relatively fixed, or the components can be physically fixedly connected; they can be detachably connected or integrated; they can be mechanically connected or electrically connected; they can be directly connected or indirectly connected through an intermediate medium or component; they can be internally connected between two elements or interact with each other. Unless otherwise clearly defined in the specification, other interpretations may not achieve the corresponding functions or effects. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0046] The controller and control circuit involved in the present invention are conventional control technologies or units of those skilled in the art. For example, the control circuit of the controller can be realized by ordinary technicians in the field using existing technologies, such as simple programming. If the software or program involved in the control result is not described in detail, it belongs to the use of existing technologies or conventional technologies of ordinary technicians in the field. The power supply also uses the existing technologies in the field, and the main technical point of the present invention is to improve the mechanical device, so the present invention will not describe the specific circuit control relationship and circuit connection in detail.
[0047] The disclosure of the present invention provides many different embodiments or examples to realize different structures of the present invention. In order to simplify the disclosure of the present invention, the components and settings of specific examples are described in the present invention. Of course, they are only examples, and the purpose is not to limit the present invention. In addition, the present invention can repeat reference numbers and / or reference letters in different examples, and this repetition is for the purpose of simplicity and clarity, which itself does not indicate the relationship between the various embodiments and / or settings discussed. In addition, the present invention provides various specific examples of processes and materials, but those of ordinary skill in the art can be aware of the application of other processes and / or the use of other materials.
[0048] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0049] like Figure 1 As shown, an embodiment of a cross-domain identity recognition method based on a gait-conditional generative adversarial network is provided in the present invention.
[0050] The cross-domain identity recognition method based on gait conditional generative adversarial network includes inputting WiFiCSI human gait data to be classified into a CG-GAN (Conditional Gait Generative Adversarial Network) model, and the CG-GAN model learns feature extraction with domain adaptation ability, autonomously adapts complex source domain information of different receiver layout positions of WiFi signals to the target domain, and effectively extracts domain-independent information between interference domains. The CG-GAN model includes a pair of feature extractors, a pair of generators, a pair of discriminators and a classification discriminator that retains human gait information, and uses the mechanism of the CG-GAN model to learn the mapping relationship between different domains. The feature extractor represents the extraction of domain-independent features in CSI, and the discriminator used to generate data is the source domain or the target domain. The CG-GAN model uses the feature extractor to convert data samples x in the source domain X and data samples y in the target domain Y into source domain data embedding layer Z xand the target domain data embedding layer Z y , in the source domain data embedding layer Z x and the target domain data embedding layer Z y A Gaussian noise perturbation is introduced.
[0051] Specifically, the complex source domain information of different receiver layout positions of WiFi signals is autonomously adapted to the target domain, that is, the source domain contains multiple device layout positions or walking paths, and the target domain is a specific position or path. The correspondence between the source domain and the target domain is learned, and the model is migrated and converted to a specific target domain. The domain-independent information between the interference domains is effectively extracted. The domain-independent information is common information. The CG-GAN model can be used as a domain filter to migrate the source domain to the target domain while retaining the human gait features contained in the WiFi CSI. The gait features are unique to the human body and have no correlation with the interference domain. Therefore, the domain-independent information refers to the human gait information. The model can migrate and adapt to the target domain without losing the human gait information. Among them, the CG-GAN model includes a pair of feature extractors, namely the source domain feature extraction E X and the target domain feature extractor E Y , a pair of generators, namely the source domain generator G X and the target domain generator G Y , a pair of discriminators, namely the target domain discriminator D Y and source domain discriminator D X , and a one-class discriminator D that retains human gait information Xcls , using the mechanism of the CG-GAN model to learn the mapping relationship between different domains, the feature extractor E X , Feature Extractor E Y Denotes the extraction of domain-independent features in CSI, and the data generated is the discriminator D of the source domain X X Or the discriminator D of the target domain Y Y , the CG-GAN model uses the feature extractor E X and feature extractor E Y Transform data samples x in source domain X and data samples y in target domain Y into embedding layer Z x and embedding layer Z y , in the embedding layer Z x and embedding layer Z y Gaussian noise perturbations are introduced respectively. That is, the real source domain information state information is extracted by feature extractor E X Transform the data sample x in the source domain X into the embedding layer Z x , in the embedding layer Z x Gaussian noise perturbation is introduced and passed through the generator G Y The simulated synthetic samples, such as the target domain channel state information. The synthesized target domain channel state information is passed through the feature extractor EY Transform the data sample y in the original target domain Y into the embedding layer Z y , in the embedding layer Z y Gaussian noise perturbation is introduced, and then the generator G X Guided to produce realistic samples, that is, to generate reconstructed source domain channel state information.
[0052] The CG-GAN model inputs the WiFi CSI human gait data to be classified, and can first divide the source domain data and the target domain data. The source domain refers to the data pre-recorded by the equipment manufacturer, including multiple interference domains, and the target domain refers to the data collected by the user, including a specific interference domain. This patent can migrate and adapt to the specific target domain to extract human gait information. The CG-GAN model uses feature extractor E X and feature extractor E Y Convert the data sample x in the source domain X and the data sample y in the target domain Y into the embedded representation Z respectively x and Z y Considering the existence of various heterogeneous interference domains, such as walking paths, directions, device locations, etc., this embodiment adopts the embedded layer Z x and embedding layer Z y Gaussian noise perturbations are introduced to help the corresponding feature extractors cope with interference from multiple subdomains and obtain preliminary domain generalization capabilities, such as the embedding layer Z x When Gaussian noise is introduced, the feature extractor E X To cope with interference from multiple subdomains, embedding layer Z y When Gaussian noise is introduced, the feature extractor E Y To cope with interference from multiple subdomains. Subsequently, the CG-GAN model uses KL divergence loss to align the embedding layer Z separately. x and embedding layer Z y The distribution of is into a Gaussian distribution η~N(η|0,I) with zero mean and unit variance. The KL divergence loss can be formally expressed as formula (1).
[0053]
[0054] Where D KL (p||q)=-∫p(z)log p(z) / q(z)dz represents the KL divergence between two different distributions p(z) and q(z), which encourages that the embedding representation of the latent space should be domain-independent. p and q refer to the calculation method of KL divergence, that is, the probability distribution of z.
[0055] The embedded representation z after Gaussian noise perturbation is obtained x and z y After that, the CG-GAN model uses the generator GX and the generator G Y The embedded representation is synthesized into simulated data samples, while using the discriminator D X and the discriminator D Y Distinguish between real data input and synthetic samples simulated by the generator, thereby guiding the generator to produce realistic samples. For the mapping process from source domain X to target domain Y, the target adversarial loss can be formally described as shown in formula (2).
[0056]
[0057] Similarly, the target adversarial loss involved in the mapping process from target domain Y to source domain X can also be formally described as shown in formula (3).
[0058]
[0059] In order to enhance the model’s ability to retain the semantic information of the original CSI to a certain extent during the domain adaptation process, the CG-GAN model adopts cycle consistency loss (CCL) to remap the synthetic data in the target domain back to the original source domain. The loss formed by this cycle transformation is expressed as shown in formula (4).
[0060]
[0061] At the same time, the CG-GAN model also applies the identity mapping loss (IML) so that when the sample is sent to the generator corresponding to its original domain, it can generate samples that maintain domain invariance. This loss can be formally described as in formula (5).
[0062]
[0063] In addition, the CG-GAN model uses a classification discriminator D Xcls , in order to maintain the uniqueness of the gait features reflected by the human body in different states during the domain adaptation process. It quantifies the difference between the predicted label and the true label of the gait sample after the generative adversarial network transformation. The gait classification loss can be formally described as shown in formula (6).
[0064]
[0065] Where C represents the set of gait categories, l x represents the real source domain data label category, σ represents the softmax operation, The cross entropy loss is used for supervised classification, and the CG-GAN model uses the label information corresponding to the source domain data whose labels are known to perform supervised classification learning. Considering the above-mentioned various joint constraints, the training loss function of the CG-GAN model can be formally expressed as formula (7).
[0066]
[0067] Among them, λ 0 , 1 , 2 and λ 3 They represent the weights of the identity mapping loss, cycle consistency loss, gait classification loss, and KL divergence loss respectively.
[0068] The CG-GAN model has domain adaptation capabilities and can alleviate the negative impact of multiple interference domains. X It is used as a domain filter model, as the backbone network of the inference model, and deployed on devices with WiFi functions to extract the unique gait features of the human body in the WiFi CSI signal to realize human gait recognition.
[0069] Since the gait conditional generative adversarial network model is used to learn the mapping relationship between multiple interference domains, adapt to various types of interference domains, introduce Gaussian noise in the hidden layer in the middle of the CG-GAN model, and learn feature extraction with domain adaptation capabilities, the domain adaptive feature extractor acts as a domain filter to remove the noise of the complex interference domain mixed with multiple WiFi device layouts, while retaining the unique characteristics of different individuals, ensuring that the WiFi perception system can relatively accurately identify the CSI gait characteristics of the person coming. It can eliminate the negative impact of WiFi device layout, walking direction, and speed and accurately identify different individuals. It can alleviate the negative impact of multiple interference domains. The CG-GAN model feature extractor E trained on the server X It is used as a domain filter model and deployed as the backbone network of the inference model on devices with WiFi functions, and human gait recognition is realized based on the unique gait features of the human body in the WiFi CSI signal. It can reduce the interference of determining the gait through WiFi signals on the walking path direction and improve the recognition accuracy of different individuals.
[0070] The present invention also provides a cross-domain identity recognition system based on a gait conditional generative adversarial network, the cross-domain identity recognition system includes an IoT (Internet of Things) device with a WiFi function, the IoT device has a domain filter model trained by a server, and the domain filter model includes a CG-GAN model. The CG-GAN model adopts the above-mentioned implementation structure or function, that is, the CG-GAN model includes a pair of feature extractors, namely, feature extractor E X and feature extractor E Y , a pair of generators, namely generator G X and the generator G Y , a pair of discriminators, namely, discriminator D X and the discriminator D Y , and a classification discriminator D Xcls , to learn the mapping relationship between different domains, the feature extractor E x , the feature extractor represents the extraction of domain-independent features in CSI, and the generator G X and the generator G Y , discriminator D X and the discriminator D Y , the CG-GAN model uses the feature extractor E X and feature extractor E Y Transform the data samples x in the source domain X and the data samples y in the target domain Y into the embedding layer E X and embedding layer Z y , in the embedding layer Z x and embedding layer Z y A Gaussian noise perturbation is introduced.
[0071] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some technical features in one or more embodiments may be replaced or combined by equivalent means, and these modifications or replacements or combinations do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, unless the embodiments explicitly exclude the possibility of replacing or combining technical features in different embodiments, or this replacement or combination is contrary to the overall concept of the invention.
Claims
1. A cross-domain identity recognition method based on gait-conditional generative adversarial network, comprising: The WiFi CSI human gait data to be classified is input into the CG-GAN model, and the CG-GAN model learns feature extraction with domain adaptation ability, autonomously adapts the complex source domain information of different receiver layout positions of WiFi signals to the target domain, effectively extracts domain-independent information between interference domains, and retains the unique characteristics of different individuals. The CG-GAN model includes a pair of feature extractors, a pair of generators, a pair of discriminators, and a classification discriminator that retains human gait information to learn the mapping relationship between different domains. The CG-GAN model uses the feature extractor to convert data samples in the source domain and data samples in the target domain into an embedding layer, introduces Gaussian noise perturbation in the embedding layer, so that the feature extractor can cope with interference from multiple subdomains and obtain preliminary domain generalization capabilities; the CG-GAN model uses the KL divergence loss to align the distribution of the embedding layer to a Gaussian distribution η~N(η|0,I) with zero mean and unit variance. The KL divergence loss can be formally described as follows: Among them, D KL (p||q)=-∫p(z)log p(z) / q(z)dz represents the KL divergence between two different distributions p(z) and q(z), which encourages the embedding representation of the latent space to be domain-independent. p and q refer to the probability distribution of z obtained by calculating the KL divergence. E x represents the source domain feature extractor, E y represents the target domain feature extractor, Z x represents the source domain data embedding layer, Z y represents the target domain data embedding layer, E X and E Y They represent the formal descriptions for source domain data and target domain data respectively.
2. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 1 is characterized in that: After obtaining the embedding layer perturbed by Gaussian noise, the CG-GAN model uses the generator to synthesize the embedding layer representation into simulated data samples, uses the discriminator to determine whether the data is the source domain or the target domain, distinguishes the real data input, and guides the generator to produce realistic samples through the synthetic samples simulated by the generator.
3. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 2 is characterized in that: For the mapping process from the source domain to the target domain, or the mapping process from the target domain to the source domain, the target adversarial loss involved is formally described as follows:
4. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 2 is characterized in that: The CG-GAN model adopts cycle consistency loss, retains the semantic information of the original CSI in the domain adaptation process, and remaps the synthetic data in the target domain back to the original source domain. The cycle consistency loss formed by the cycle transformation is formally described as follows: Among them, x represents the source domain data sample, and y represents the target domain data sample.
5. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 4 is characterized in that: The CG-GAN model also applies the identity mapping loss so that when the sample is sent to the generator corresponding to its original domain, a sample that maintains domain invariance is generated. The identity mapping loss can be formally described as follows: Among them, x represents the source domain data sample, and y represents the target domain data sample.
6. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 5 is characterized in that: The CG-GAN model uses a classification discriminator to maintain the uniqueness of the gait characteristics reflected by the human body in different states during the domain adaptation process, and quantifies the difference between the predicted label and the true label of the gait sample after the generative adversarial network transformation. The gait classification loss can be formally described as follows: Where C represents the set of gait categories, l x represents the real source domain data label category, σ represents the softmax operation, Using cross entropy loss for supervised classification, the CG-GAN model uses the label information corresponding to the source domain data with known labels for supervised classification learning.
7. The cross-domain identity recognition method based on gait conditional generative adversarial network according to claim 6 is characterized in that: The training loss function of the CG-GAN model is formally expressed as follows: Among them, λ0, λ1, λ2 and λ3 represent the weights of identity mapping loss, cycle consistency loss, gait classification loss and KL divergence loss respectively.
8. A cross-domain identity recognition system based on gait conditional generative adversarial network, comprising an IoT device with WiFi function, the IoT device having a domain filter model trained by a server, the domain filter model comprising a CG-GAN model, characterized in that: The CG-GAN model has the features described in any one of claims 1-7.
Citation Information
Patent Citations
Multi-gesture human body target tracking method based on generative adversarial network positive sample enhancement
CN108960086A
Action recognition method based on generative adversarial network in WiFi environment
CN113378718A