Correspondence determination method and apparatus, storage medium, and electronic device

Abstract

The application discloses a kind of determination method and device of correspondence, storage medium and electronic device, wherein above-mentioned method includes: in the case where multiple user identifications are collected in target area by the mobile electronic fence module of image acquisition equipment, determine the signal strength set corresponding to each user identification in multiple user identifications and the signal-to-interference-plus-noise ratio set corresponding to each user identification;According to the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identification, determine the correspondence of multiple target objects and multiple user identifications, wherein multiple target objects are the objects included in the target image obtained by image acquisition equipment when multiple user identifications are collected in target area, for image acquisition to target area in target area.The technical scheme is adopted, in the case where multiple user identifications and multiple target objects are collected and determined in target area, the problem that multiple user identifications and multiple target objects cannot be accurately associated is solved.

Description

Technical Field

[0001] This invention relates to the field of communications, and more specifically, to a method and apparatus for determining correspondence, a storage medium, and an electronic device. Background Technology

[0002] To ensure social stability and public safety, management departments establish management systems in specific areas. For example, densely deployed mobile electronic fences and image acquisition systems continuously collect International Mobile Subscriber Identity (IMSI) codes and images of target pedestrians at various locations. This image-code association helps management departments conduct joint investigations and improves precision strike and prevention capabilities. However, it is often difficult to accurately associate the IMSI codes captured by mobile electronic fences with the target images captured by the image acquisition system, especially when multiple targets pass through the same fence location and have their IMSI codes collected simultaneously. Since the image acquisition system also collects multiple target images, it becomes difficult to specifically associate a particular IMSI code with a particular image.

[0003] Regarding the relevant technologies, there is currently no effective solution to the problem of not being able to accurately associate multiple user identifiers with multiple target objects when multiple user identifiers and multiple target objects have been identified in the target area.

[0004] Therefore, it is necessary to improve the relevant technology to overcome the aforementioned defects. Summary of the Invention

[0005] This invention provides a method, apparatus, storage medium, and electronic device for determining correspondence, to at least solve the problem that when multiple user identifiers and multiple target objects are collected and determined in a target area, it is impossible to accurately associate multiple user identifiers with multiple target objects.

[0006] According to one aspect of the present invention, a method for determining a correspondence is provided, comprising: when multiple user identifiers are acquired in a target area by a mobile phone electronic fence module of an image acquisition device, determining a set of signal strengths corresponding to each user identifier and a set of signal-to-interference-plus-noise ratios (SIRs) corresponding to each user identifier; determining a correspondence between multiple target objects and the multiple user identifiers based on the set of signal strengths and the set of SIRs corresponding to each user identifier, wherein the multiple target objects are objects included in a target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0007] In an exemplary embodiment, determining the signal strength set and the signal-to-interference-plus-noise ratio (SINNR) set corresponding to each of the plurality of user identifiers includes: acquiring multiple reporting information sent by the mobile terminal corresponding to each user identifier within a preset time period to obtain a plurality of reporting information, wherein each of the plurality of reporting information is different, and each reporting information has a signal strength and SINNR corresponding to the user identifier; determining the signal strength set and the SINNR set corresponding to each user identifier based on the plurality of reporting information, wherein the signal strength set includes the signal strength in each of the plurality of reporting information; and the SINNR set includes the SINNR in each of the plurality of reporting information.

[0008] In an exemplary embodiment, during the process of acquiring multiple reporting information sent by the mobile terminal corresponding to each user identifier within a preset time period, the method further includes: prohibiting the sending of a rejection code to the mobile terminal corresponding to each user identifier in each of the first to N-1 times of acquiring the reporting information sent by the mobile terminal corresponding to each user identifier, wherein N is a positive integer and multiple times is N times; in the case of acquiring the reporting information sent by the mobile terminal corresponding to each user identifier for the Nth time, sending a rejection code to the mobile terminal corresponding to each user identifier; wherein, if the mobile terminal does not receive a rejection code, it sends the reporting information to the mobile electronic fence module after a preset time interval, and if the mobile terminal receives a rejection code, it stops sending the reporting information to the mobile electronic fence module.

[0009] In an exemplary embodiment, if the reporting information sent by the mobile terminal corresponding to each user identifier is obtained from the first to the N-1th times, the method further includes: disconnecting the target radio control resource (RRC) connection between the mobile electronic fence module and the mobile terminal corresponding to each user identifier.

[0010] In an exemplary embodiment, determining the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier includes: determining a first set of movement trajectories corresponding to each user identifier based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier; determining a first movement trajectory of each of the multiple target objects based on the target image; and determining the correspondence between the multiple target objects and the multiple user identifiers based on the first movement trajectory of each target object and the first set of movement trajectories corresponding to each user identifier.

[0011] In an exemplary embodiment, determining a first set of movement trajectories corresponding to each user identifier based on a set of signal strengths and a set of signal-to-interference-plus-noise ratios (SNRs) for each user identifier includes: acquiring a signal strength database and an SNR database corresponding to the target area, wherein the signal strength database has a signal strength distribution range corresponding to each location in the target area, and the SNR database has an SNR distribution range corresponding to each location in the target area; determining one or more locations corresponding to each signal strength in the set of signal strengths for each user identifier based on the signal strength database, and determining a second set of movement trajectories corresponding to the set of signal strengths based on the one or more locations corresponding to each signal strength; determining one or more locations corresponding to each SNR in the set of SNRs for each user identifier based on the SNR database, and determining a third set of movement trajectories corresponding to the set of SNRs based on the one or more locations corresponding to each SNR; and determining the first set of movement trajectories based on the second set of movement trajectories and the third set of movement trajectories.

[0012] In an exemplary embodiment, determining the first movement trajectory set based on the second movement trajectory set and the third movement trajectory set includes: determining the first movement trajectory set within the third movement trajectory set, wherein each trajectory in the first movement trajectory set and a second movement trajectory in the second movement trajectory set meet a first preset condition, wherein the first preset condition includes: the overlap between each trajectory and the corresponding second movement trajectory exceeds a preset threshold; or determining the first movement trajectory set within the second movement trajectory set, wherein each trajectory in the first movement trajectory set and a third movement trajectory in the third movement trajectory set meet a second preset condition, wherein the second preset condition includes: the overlap between each trajectory and the corresponding third movement trajectory exceeds the preset threshold.

[0013] In an exemplary embodiment, before obtaining the signal strength database and signal-to-interference-plus-noise ratio (SIR) database corresponding to the target area, the method further includes: deploying target devices multiple times at each location in the target area, and collecting data on each deployed target device through the mobile phone electronic fence module of the image acquisition device to obtain multiple signal strengths and multiple SIRs corresponding to each location, wherein the target device has a chip corresponding to a user identifier, and the time interval between two adjacent deployments of the target device is greater than a second preset threshold; and determining the signal strength distribution range and SIR distribution range of each location based on the multiple signal strengths and multiple SIRs corresponding to each location.

[0014] In an exemplary embodiment, determining the correspondence between the plurality of target objects and the plurality of user identifiers based on the first movement trajectory of each target object and the first movement trajectory set corresponding to each user identifier includes: determining the overlap degree between the first movement trajectory of each target object and each trajectory in the first movement trajectory set corresponding to each user identifier; and, if a first user identifier exists among the plurality of user identifiers and a first target object exists among the plurality of target objects, establishing a correspondence between the first user identifier and the first target object, wherein the overlap degree between the first movement trajectory in the first movement trajectory set corresponding to the first user identifier and the first movement trajectory of the first target object is higher than a third preset threshold.

[0015] According to another aspect of the present invention, a device for determining a correspondence is also provided, comprising: a first determining module, configured to determine a set of signal strengths corresponding to each of the multiple user identifiers and a set of signal-to-interference-plus-noise ratios corresponding to each of the multiple user identifiers when multiple user identifiers are acquired in a target area by a mobile phone electronic fence module of an image acquisition device; and a second determining module, configured to determine a correspondence between multiple target objects and the multiple user identifiers based on the set of signal strengths and the set of signal-to-interference-plus-noise ratios corresponding to each user identifier, wherein the multiple target objects are objects included in a target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0016] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer program, and the computer program is configured to execute the above-described method for determining the correspondence when it is run.

[0017] According to another aspect of the present invention, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the method for determining the correspondence through the computer program.

[0018] This invention addresses the issue of determining the correspondence between multiple target objects and user identifiers when a mobile phone electronic fence module of an image acquisition device captures multiple user identifiers in a target area. This involves identifying the signal strength set and signal-to-interference-plus-noise ratio (SNR) set corresponding to each user identifier, and then using these sets to determine the relationship between multiple target objects and user identifiers. The target objects are those included in the target image obtained when the image acquisition device captures the multiple user identifiers in the target area. By determining the correspondence between multiple target objects and user identifiers based on their respective signal strength and SNR sets, the association between multiple user identifiers and multiple target objects can be accurately established, solving the problem of inaccurate association even when multiple user identifiers and target objects have been identified in the target area. Attached Figure Description

[0019] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with the description thereof, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0020] Figure 1 This is a hardware structure block diagram of a computer terminal for a method of determining correspondence in an embodiment of the present invention.

[0021] Figure 2 This is a flowchart (I) of a method for determining the correspondence according to an embodiment of the present invention;

[0022] Figure 3 This is a schematic diagram of a scenario (a) illustrating a method for determining correspondences according to an embodiment of the present invention;

[0023] Figure 4 This is a schematic diagram (II) of a method for determining the correspondence according to an embodiment of the present invention;

[0024] Figure 5 This is a flowchart (II) of a method for determining the correspondence according to an embodiment of the present invention;

[0025] Figure 6 This is a structural block diagram of a device for determining correspondence according to an embodiment of the present invention. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0028] The methods and embodiments provided in this application can be executed on a computer terminal or similar computing device. Taking running on a computer terminal as an example, Figure 1 This is a hardware structure block diagram of a computer terminal for a method of determining correspondences according to an embodiment of the present invention. For example... Figure 1 As shown, a computer terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor unit (MPU) or a programmable logic device (PLD)) and a memory 104 for storing data are also shown. In one exemplary embodiment, the computer terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the computer terminal described above. For example, the computer terminal may also include components that are more complex than those described above. Figure 1 The more or fewer components shown, or having the same Figure 1 Equivalent functions or ratios shown Figure 1 The functions shown have more different configurations.

[0029] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the correspondence determination method in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to a computer terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0030] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider for the computer terminal. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0031] Specifically, this embodiment provides a method for determining the correspondence. Figure 2 This is a flowchart (I) of a method for determining the correspondence according to an embodiment of the present invention, which includes the following steps:

[0032] Step S202: When multiple user identifiers are collected in the target area by the mobile phone electronic fence module of the image acquisition device, determine the signal strength set corresponding to each user identifier and the signal-to-interference-plus-noise ratio set corresponding to each user identifier.

[0033] In an exemplary embodiment, the user identifier is the International Mobile Subscriber Identity (IMSI), the signal strength is the Reference Signal Receiving Power (RSRP), and the signal-to-interference-plus-noise ratio (SINR) is the signal-to-interference-plus-noise ratio.

[0034] It should be noted that the signal strength set includes multiple signal strengths, and the signal-to-interference-plus-noise ratio (SIR) set includes multiple SIRs.

[0035] It should be noted that the image acquisition device performs multiple acquisitions on the mobile terminal corresponding to each user identifier within a preset time period, thereby determining the signal strength set and the signal-to-interference-plus-noise ratio set corresponding to each user identifier among the multiple user identifiers.

[0036] Step S204: Determine the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, wherein the multiple target objects are objects included in the target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0037] It should be noted that the target image is the image obtained by the image acquisition device from the target area within the preset time.

[0038] Through the above steps, when multiple user identifiers are acquired in the target area by the mobile phone electronic fence module of the image acquisition device, the signal strength set and signal-to-interference-plus-noise ratio (SIR / NNR) set corresponding to each user identifier are determined. Then, based on the signal strength set and SIR / NNR set corresponding to each user identifier, the correspondence between multiple target objects and multiple user identifiers is determined. The multiple target objects are the objects included in the target image obtained by the image acquisition device when acquiring the multiple user identifiers in the target area. Because the correspondence between multiple target objects and multiple user identifiers is determined based on the signal strength set and SIR / NNR set corresponding to each user identifier, the association between multiple user identifiers and multiple target objects can be accurately achieved, solving the problem of not being able to accurately associate multiple user identifiers with multiple target objects even when multiple user identifiers and multiple target objects have been acquired and determined in the target area.

[0039] In an exemplary embodiment, determining the set of signal strengths corresponding to each user identifier and the set of signal-to-interference-plus-noise ratios corresponding to each user identifier can be achieved through the following steps S11-S12:

[0040] Step S11: Within a preset time, acquire the reporting information sent multiple times by the mobile terminal corresponding to each user identifier to obtain multiple reporting information, wherein each of the multiple reporting information is different, and each reporting information has the signal strength and signal-to-interference-plus-noise ratio corresponding to the user identifier;

[0041] It should be noted that the mobile electronic fence module of the image acquisition device will collect data from the mobile terminal corresponding to each user identifier multiple times within a preset time period. During each collection, it will obtain the reporting information sent by the mobile terminal corresponding to each user identifier.

[0042] In an exemplary embodiment, during the process of acquiring multiple reports sent by the mobile terminal corresponding to each user identifier within a preset time period, the method further includes: prohibiting the sending of a rejection code to the mobile terminal corresponding to each user identifier in each of the first to N-1 times when the report information sent by the mobile terminal corresponding to each user identifier is acquired, where N is a positive integer and multiple times is N times; and sending a rejection code to the mobile terminal corresponding to each user identifier in the case of acquiring the report information sent by the mobile terminal corresponding to each user identifier in the Nth time.

[0043] It should be noted that if the mobile terminal does not receive a rejection code, it will send a reporting message to the mobile electronic fence module after a preset time interval. If the mobile terminal receives a rejection code, it will stop sending reporting messages to the mobile electronic fence module.

[0044] To better understand, the following is a detailed explanation: The mobile terminal sending the reported information to the mobile electronic fence module can be understood as the mobile terminal reporting the IMSI to the mobile electronic fence module during a registration process. When the mobile electronic fence module receives the IMSI information, it has achieved its purpose and completed one collection of the mobile terminal. Then, it will send a registration rejection code to the mobile terminal. After receiving the registration rejection code, the mobile terminal will not attempt to register in this cell (or cell on the same frequency) for a period of time (usually within a few minutes).

[0045] In this embodiment, in order to complete multiple data collections from the mobile terminal, the mobile electronic fence module will stop sending a registration rejection code after collecting the IMSI. Since the mobile terminal finds that its location has changed but it has not yet successfully registered, it will trigger its own mechanism to send the reporting information to the mobile electronic fence module again.

[0046] In other words, if the mobile terminal does not receive a rejection code after sending the reporting information to the mobile electronic fence module, the mobile terminal will send the reporting information to the mobile electronic fence module at a preset time interval, thereby enabling the mobile electronic fence module to collect data from the mobile terminal multiple times.

[0047] In an exemplary embodiment, when the reporting information sent by the mobile terminal corresponding to each user identifier is obtained in each of the first to N-1 times, the target radio control resource (RRC) connection between the mobile electronic fence module and the mobile terminal corresponding to each user identifier is cut off, so that the mobile terminal can access the Internet normally and avoid the interference of the mobile electronic fence module on the communication function of the mobile terminal.

[0048] To better understand, the following is a specific example. Suppose that the mobile electronic fence module detects multiple targets concentrated in the target area at a certain moment. The mobile electronic fence module then continuously collects data. That is, after collecting the IMSI of a target, it does not send a rejection code or redirect the target to the public network base station, but simply disconnects the target's RRC connection. In this way, the target terminal, noticing that it has not received a rejection code, will try to access the mobile electronic fence module again to report the IMSI. This process is repeated, allowing the mobile electronic fence module to collect the target IMSI multiple times in a short period of time. When the mobile electronic fence module collects the same target IMSI a set number of times N, it sends a rejection code to the target terminal, stopping the target terminal from continuing to request access.

[0049] Step S12: Determine the signal strength set and the signal-to-interference-plus-noise ratio (SINNR) set corresponding to each user identifier based on the plurality of reported information, wherein the signal strength set includes the signal strength in each of the plurality of reported information; and the SINNR set includes the SINNR in each of the plurality of reported information.

[0050] It should be noted that through the above steps S11-S12, when the mobile electronic fence module senses multiple targets entering the collection range simultaneously, it can obtain the RSRP and SINR motion sets of these targets through continuous collection. The number of consecutive collections N should not be too large to avoid excessively long collection times, which could affect the target terminal's normal access to the public network system.

[0051] In an exemplary embodiment, step S204 above can be implemented by the following steps S21-S22:

[0052] Step S21: Determine the first motion trajectory set corresponding to each user identifier based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, and determine the first motion trajectory of each of the plurality of target objects based on the target image;

[0053] In an exemplary embodiment, step S21 described above can be implemented by the following steps S31-S33:

[0054] Step S31: Obtain a signal strength database and a signal-to-interference-plus-noise ratio (SINR) database corresponding to the target area, wherein the signal strength database contains the signal strength distribution range corresponding to each location in the target area, and the SINR database contains the SINR distribution range corresponding to each location in the target area;

[0055] It should be noted that before performing step S31 above, the target device needs to be deployed multiple times at each location in the target area, and the mobile phone electronic fence module of the image acquisition device is used to collect data on the target device deployed each time to obtain multiple signal strengths and multiple signal-to-interference-plus-noise ratios corresponding to each location. The target device has a chip corresponding to the user identifier, and the time interval between two adjacent deployments of the target device is greater than a second preset threshold. The signal strength distribution range and signal-to-interference-plus-noise ratio distribution range of each location are determined based on the multiple signal strengths and multiple signal-to-interference-plus-noise ratios corresponding to each location.

[0056] It should be noted that the mobile electronic fence module needs to be turned off before deploying the target device at each location in the target area, and then turned on after the target device has been deployed at each location.

[0057] It should be noted that multiple deployments of the target device at each location can be of the same target device or different target devices. In a preferred embodiment, different models of target devices are selected for deployment. The purpose of ensuring that the time interval between two adjacent deployments of the target device is greater than a second preset threshold is to ensure that the environment in which the target device is located differs significantly between adjacent deployments.

[0058] It should be noted that, taking signal strength as RSPR, signal-to-interference-plus-noise ratio as SINR, and user identifier as IMSI as an example, when the mobile electronic fence module collects the mobile phone's IMSI, the strength of the uplink RSPR and SINR obtained can reflect the distance between the tester and the electronic fence in the most ideal open and interference-free environment. However, this data is not linear in the actual deployment environment. This is because the RSPR and SINR values ​​obtained during collection are related to the deployment environment of the electronic fence module, the location of the target, the surrounding obstacles, and the surrounding electromagnetic interference. This can lead to situations where the signal is weaker and the interference is greater at closer locations than at farther locations, or where the interference is different even with the same signal strength. For these reasons, in the actual deployment environment, the location of the target cannot be determined solely by the RSPR signal strength, nor can the interference at different locations be assessed linearly. Therefore, multiple deployment tests are conducted in the field to pre-calculate the distribution range of RSPR signal strength and SINR at different locations.

[0059] Step S32: Determine one or more locations corresponding to each signal strength in the signal strength set corresponding to each user identifier according to the signal strength database, and determine the second movement trajectory set corresponding to the signal strength set according to the one or more locations corresponding to each signal strength;

[0060] Step S33: Determine one or more locations corresponding to each signal-to-interference-plus-noise ratio (SIR) in the SIR set corresponding to each user identifier based on the SIR database, and determine the third movement trajectory set corresponding to the SIR set based on the one or more locations corresponding to each SIR;

[0061] It should be noted that since the signal strength / signal-to-interference-plus-noise ratio corresponding to each location in the signal strength database / signal-to-interference-plus-noise ratio database is a distribution range, and the distribution ranges of signal strength / signal-to-interference-plus-noise ratio at different locations may overlap, one signal strength / signal-to-interference-plus-noise ratio may correspond to one location or multiple locations.

[0062] After determining the position at different times based on the signal strength / signal-to-interference-plus-noise ratio, the corresponding movement trajectory can be determined based on the position.

[0063] It should be noted that the execution of steps S32 and S33 above is not sequential.

[0064] Step S34: Determine the first movement trajectory set based on the second movement trajectory set and the third movement trajectory set.

[0065] In an exemplary embodiment, step S34 above can be implemented in either method one or method two:

[0066] Method 1: Determine a first set of movement trajectories from the third set of movement trajectories, wherein each trajectory in the first set of movement trajectories and a second movement trajectory in the second set of movement trajectories meet a first preset condition, wherein the first preset condition includes: the overlap between each trajectory and the second movement trajectory corresponding to each trajectory exceeds a preset threshold.

[0067] Method 2: Determine a first set of movement trajectories from the second set of movement trajectories, wherein each trajectory in the first set of movement trajectories and a third movement trajectory in the third set of movement trajectories meet a second preset condition, wherein the second preset condition includes: the overlap between each trajectory and the third movement trajectory corresponding to each trajectory exceeds the preset threshold.

[0068] In other words, it is necessary to perform overlap analysis on the trajectories in the second and third sets of movement trajectories to eliminate invalid trajectories and obtain a valid first set of movement trajectories. For example, the aforementioned first preset threshold can be 90%.

[0069] Step S22: Determine the correspondence between the multiple target objects and the multiple user identifiers based on the first movement trajectory of each target object and the set of first movement trajectories corresponding to each user identifier.

[0070] In an exemplary embodiment, step S22 can be implemented as follows: determining the overlap between the first movement trajectory of each target object and each trajectory in the first movement trajectory set corresponding to each user identifier; and establishing a correspondence between the first user identifier and the first target object when there is a first user identifier among the plurality of user identifiers and a first target object among the plurality of target objects, wherein the overlap between the first movement trajectory in the first movement trajectory set corresponding to the first user identifier and the first movement trajectory of the first target object is higher than a third preset threshold.

[0071] Obviously, the embodiments described above are only some embodiments of the present invention, and not all embodiments. To better understand the method for determining the above correspondence, the process is described below in conjunction with embodiments, but this is not intended to limit the technical solutions of the embodiments of the present invention. Specifically:

[0072] Figure 3 This is a schematic diagram of a scenario (a) illustrating the method for determining the correspondence according to an embodiment of the present invention. Figure 3 The above, Figure 3 The data shows the RSRP and SINR corresponding to different locations, and then RSRP and SINR fingerprint databases corresponding to different locations in the collection area can be created.

[0073] Figure 4 This is a schematic diagram (II) illustrating a method for determining correspondences according to an embodiment of the present invention. Figure 4 This illustrates cross-matching by combining RSRP, SINR, and video parsing location.

[0074] In an optional embodiment, the present invention proposes a method and system for determining the correspondence between images and codes to improve the matching rate in scenarios with dense deployment of mobile phone electronic fences. For example... Figure 3 and Figure 4 Its working principle follows these principles:

[0075] This invention relates to an image acquisition device that combines a mobile phone electronic fence with a video acquisition module. It uses the mobile phone electronic fence to collect the IMSI codes of passing pedestrians and the onboard video acquisition module to capture images of the pedestrians, enabling the acquisition of pedestrian movement trajectories and behaviors in key areas. Image monitoring devices are typically deployed densely, usually at intervals of 200-300 meters, allowing for continuous pedestrian acquisition and easy trajectory mapping. This invention addresses the problem that when collecting pedestrian IMSI codes, the video acquisition module detects multiple people entering the acquisition area simultaneously, leading to one IMSI code corresponding to multiple pedestrian images, or multiple IMSI codes corresponding to multiple pedestrian images, making it impossible to determine which IMSI corresponds to which pedestrian image, resulting in a decreased image-code matching rate. This invention aims to create a two-dimensional database—an RSRP fingerprint database (equivalent to the RSRP database in the above embodiment) and a SINR fingerprint database (equivalent to the SINR database in the above embodiment)—for deployment scenarios. When multiple targets are detected entering the acquisition range simultaneously, the mobile phone electronic fence is triggered to perform multiple acquisitions of the targets, collecting the RSRP and SINR values ​​corresponding to the multiple IMSI acquisitions. Then, by comparing the collected RSRP and SINR sets with the RSRP fingerprint database and the SINR fingerprint database respectively, an RSRP trajectory and a SINR trajectory are drawn. Combined with multi-angle video from the same time of acquisition, the trajectory analysis of the target is performed. The location range of the target is delineated by the intersection and overlap of the three different trajectories—the RSRP trajectory, the SINR trajectory, and the video image trajectory—ultimately improving the target-image matching rate. Specific methods are as follows... Figure 5 (In Figure 5, steps S1-S12 are executed before steps 1-10). For better understanding, the following is a detailed explanation:

[0076] (1) Before deployment and operation, the data acquisition system needs to undergo extensive IMSI acquisition tests to obtain sample data. Specifically, the tester conducts fixed-point sample acquisition tests at each location within the coverage area of ​​each deployed mobile electronic fence. During the acquisition process, the mobile electronic fence device should not be activated initially. After the tester selects a location and stands still, the mobile electronic fence acquisition is activated. While acquiring the IMSI, the uplink RSRP signal strength value and its SINR signal-to-interference-plus-noise ratio (which reflects the degree of interference) are recorded. One RSRP and the location coordinate information form an RSRP fingerprint sample, and one SINR and the location coordinate information form a SINR fingerprint sample. The tester performs multiple sample acquisition tests at each location using the above method to obtain a large number of test samples.

[0077] (2) The above large amount of sample data is distributed and analyzed by big data to obtain the maximum probability uplink RSRP range value and SINR range value of each collection location within the collection range of each mobile electronic fence, forming an RSRP fingerprint database and a SINR fingerprint database.

[0078] It should be noted that RSPR is signal strength and SINR is signal-to-interference-plus-noise ratio. When a mobile phone electronic fence collects the IMSI of a mobile phone, the strength of the uplink RSPR and SINR obtained can reflect the distance between the tester and the electronic fence in the most ideal open and interference-free environment. However, this data is not linear in the actual deployment environment. This is because the RSPR and SINR values ​​obtained during collection are related to the deployment environment of the mobile phone electronic fence, the location of the target, the surrounding obstacles, and the surrounding electromagnetic interference. This can lead to situations where the signal is weaker and the interference is greater when the distance is closer than when the distance is farther, or where the interference is different even with the same signal strength. For these reasons, in the actual deployment environment, the location of the target cannot be determined solely by the RSPR signal strength, nor can the interference at different locations be assessed linearly. Therefore, in the deployment environment, the distribution of RSPR signal strength and SINR at different locations is calculated in advance through a large number of test samples.

[0079] (3) The usage scenario is as follows: Suppose that the video acquisition module detects multiple acquisition targets concentrated in its acquisition range at a certain moment, which is expected to lead to a decrease in the probability of successful image-code matching. In this case, the mobile phone electronic fence is notified to trigger continuous acquisition. That is, after acquiring the IMSI of a target, no rejection code is sent, nor is the target redirected to the public network base station. Instead, the target's RRC connection is simply cut off. In this way, the target terminal, which is being acquired, will find that the RRC is disconnected but has not received a rejection code, and will try to access the system again to report the IMSI. This process is repeated, and the electronic fence can acquire the target multiple times in a short period of time. When the electronic fence acquires the IMSI of the same target a set number of times N, it sends a rejection code to the target terminal to stop the target from continuing to request access. Through the above method, when the image acquisition device senses that multiple acquisition targets enter the acquisition range at the same time, it can obtain the RSRP and SINR motion sets of these targets through continuous acquisition. The number of continuous acquisitions N should not be too large to avoid the continuous acquisition taking too long and affecting the normal access of the target terminal to the public network system.

[0080] (4) When matching a target pedestrian image with a specific acquired IMSI code, the RSRP set obtained from the continuous acquisition of IMSIs is used to draw the RSRP trajectory corresponding to the target IMSI, i.e., trajectory 1 (trajectory 1 may have multiple paths, set as i trajectories), by comparing it with the RSRP fingerprint database. The SINR set obtained from the continuous acquisition of IMSIs is used to draw the SINR trajectory corresponding to the target IMSI, i.e., trajectory 2 (trajectories 2 may have multiple paths, set as j trajectories), by jointly calculating and drawing the image trajectories of multiple targets at the acquisition time through multi-angle video acquisition, i.e., trajectory 3 (the image trajectories of multiple targets are all trajectory 3). First, the i trajectories 1 and j trajectories 2 are overlaid and analyzed to eliminate invalid trajectories, resulting in k valid trajectories 4. Finally, by intersecting and overlapping all the target trajectories 3 with the k trajectories 4, the most likely target pedestrian image corresponding to the target IMSI is estimated through joint analysis, thereby improving the matching accuracy between IMSI and the image.

[0081] In summary, this invention, when the image acquisition device detects in advance that multiple targets simultaneously appearing in the acquisition area may cause image-code mismatch issues, triggers continuous acquisition via a mobile phone electronic fence. This allows the acquisition of the target's RSRP and SINR travel sets. A two-dimensional travel trajectory is drawn using multiple RSRP and SINR fingerprint databases, and a third-dimensional travel trajectory is calculated from the video image. This allows for the joint estimation of the target's location using the overlapping of these three trajectories, ultimately improving the image-code matching accuracy. The method utilizes three different dimensional feature values, and the three feature values ​​are obtained through continuous trajectories rather than single points, increasing the distinguishability of the feature values ​​and improving the probability of image-code matching.

[0082] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present invention.

[0083] This embodiment also provides a device for determining correspondence, which is used to implement the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0084] Figure 6 This is a structural block diagram of a device for determining correspondence according to an embodiment of the present invention, the device comprising:

[0085] The first determining module 62 is used to determine the signal strength set and the signal-to-interference-plus-noise ratio set corresponding to each user identifier when multiple user identifiers are collected in the target area by the mobile electronic fence module of the image acquisition device.

[0086] The second determining module 64 is used to determine the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, wherein the multiple target objects are objects included in the target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0087] Using the aforementioned device, when multiple user identifiers are captured in a target area by the mobile phone electronic fence module of the image acquisition device, the signal strength set and signal-to-interference-plus-noise ratio (SNR) set corresponding to each user identifier are determined. Then, based on these sets, the correspondence between multiple target objects and multiple user identifiers is determined. The multiple target objects are the objects included in the target image obtained by the image acquisition device when capturing the multiple user identifiers in the target area. Because the correspondence between multiple target objects and multiple user identifiers is determined based on the signal strength set and SNR set corresponding to each user identifier, the association between multiple user identifiers and multiple target objects can be accurately established. This solves the problem of not being able to accurately associate multiple user identifiers with multiple target objects even when they have been captured and identified in the target area.

[0088] In an exemplary embodiment, the first determining module 62 is further configured to acquire multiple reporting information sent by the mobile terminal corresponding to each user identifier within a preset time period, thereby obtaining multiple reporting information, wherein each of the multiple reporting information is different, and each reporting information has a signal strength and signal-to-interference-plus-noise ratio corresponding to the user identifier; determine a set of signal strengths and a set of signal-to-interference-plus-noise ratios corresponding to each user identifier based on the multiple reporting information, wherein the set of signal strengths includes the signal strength in each of the multiple reporting information; and the set of signal-to-interference-plus-noise ratios includes the signal-to-interference-plus-noise ratio in each of the multiple reporting information.

[0089] In an exemplary embodiment, the first determining module 62 is further configured to, during the process of acquiring multiple reports sent by the mobile terminal corresponding to each user identifier within a preset time, prohibit sending a rejection code to the mobile terminal corresponding to each user identifier in each of the first to N-1th acquisitions of the reported information sent by the mobile terminal corresponding to each user identifier; where N is a positive integer and multiple times is N times; and when the reported information sent by the mobile terminal corresponding to each user identifier is acquired for the Nth time, a rejection code is sent to the mobile terminal corresponding to each user identifier; wherein, if the mobile terminal does not receive a rejection code, it sends the reported information to the mobile electronic fence module after a preset time interval, and if the mobile terminal receives a rejection code, it stops sending the reported information to the mobile electronic fence module.

[0090] In an exemplary embodiment, the first determining module 62 is further configured to disconnect the target wireless control resource (RRC) connection between the mobile electronic fence module and the mobile terminal corresponding to each user identifier in each of the first to N-1 times when the reported information sent by the mobile terminal corresponding to each user identifier is obtained.

[0091] In an exemplary embodiment, the second determining module 64 is further configured to determine a first moving trajectory set corresponding to each user identifier based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, and to determine a first moving trajectory of each of the plurality of target objects based on the target image; and to determine the correspondence between the plurality of target objects and the plurality of user identifiers based on the first moving trajectory of each target object and the first moving trajectory set corresponding to each user identifier.

[0092] In an exemplary embodiment, the second determining module 64 is further configured to acquire a signal strength database and a signal-to-interference-plus-noise ratio (SNR) database corresponding to the target area, wherein the signal strength database has a signal strength distribution range corresponding to each location in the target area, and the SNR database has an SNR distribution range corresponding to each location in the target area; determine one or more locations corresponding to each signal strength in the signal strength set corresponding to each user identifier according to the signal strength database, and determine a second set of movement trajectories corresponding to the signal strength set according to the one or more locations corresponding to each signal strength; determine one or more locations corresponding to each SNR in the SNR set corresponding to each user identifier according to the SNR database, and determine a third set of movement trajectories corresponding to the SNR set according to the one or more locations corresponding to each SNR; and determine a first set of movement trajectories based on the second set of movement trajectories and the third set of movement trajectories.

[0093] In an exemplary embodiment, the second determining module 64 is further configured to determine a first moving trajectory set in the third moving trajectory set, wherein each trajectory in the first moving trajectory set and a second moving trajectory in the second moving trajectory set meet a first preset condition, wherein the first preset condition includes: the overlap between each trajectory and the second moving trajectory corresponding to each trajectory exceeds a preset threshold; or to determine a first moving trajectory set in the second moving trajectory set, wherein each trajectory in the first moving trajectory set and a third moving trajectory in the third moving trajectory set meet a second preset condition, wherein the second preset condition includes: the overlap between each trajectory and the third moving trajectory corresponding to each trajectory exceeds the preset threshold.

[0094] In an exemplary embodiment, the second determining module 64 is further configured to, before acquiring the signal strength database and signal-to-interference-plus-noise ratio (SIR) database corresponding to the target area, deploy target devices multiple times at each location in the target area, and collect data on each deployed target device through the mobile phone electronic fence module of the image acquisition device to obtain multiple signal strengths and multiple SIRs corresponding to each location, wherein the target device has a chip corresponding to a user identifier, and the time interval between two adjacent deployments of the target device is greater than a second preset threshold; and determine the signal strength distribution range and SIR distribution range of each location based on the multiple signal strengths and multiple SIRs corresponding to each location.

[0095] In an exemplary embodiment, the second determining module 64 is further configured to determine the overlap between the first movement trajectory of each target object and each trajectory in the first movement trajectory set corresponding to each user identifier; and, in the case that a first user identifier exists among the plurality of user identifiers and a first target object exists among the plurality of target objects, to establish a correspondence between the first user identifier and the first target object, wherein the overlap between the first movement trajectory in the first movement trajectory set corresponding to the first user identifier and the first movement trajectory of the first target object is higher than a third preset threshold.

[0096] Embodiments of the present invention also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to perform the steps in any of the above method embodiments when executed.

[0097] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0098] S1, when multiple user identifiers are collected in the target area through the mobile phone electronic fence module of the image acquisition device, determine the signal strength set and the signal-to-interference-plus-noise ratio set corresponding to each user identifier among the multiple user identifiers;

[0099] S2, determine the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, wherein the multiple target objects are the objects included in the target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0100] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.

[0101] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0102] Embodiments of the present invention also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0103] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0104] S1, when multiple user identifiers are collected in the target area through the mobile phone electronic fence module of the image acquisition device, determine the signal strength set and the signal-to-interference-plus-noise ratio set corresponding to each user identifier among the multiple user identifiers;

[0105] S2, determine the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, wherein the multiple target objects are the objects included in the target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area.

[0106] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0107] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0108] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those described herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0109] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for determining a correspondence, characterized in that, include: When multiple user identifiers are collected in the target area through the mobile phone electronic fence module of the image acquisition device, the signal strength set corresponding to each user identifier and the signal-to-interference-plus-noise ratio set corresponding to each user identifier are determined. The correspondence between multiple target objects and multiple user identifiers is determined based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier. The multiple target objects are the objects included in the target image obtained by the image acquisition device when the multiple user identifiers are acquired in the target area. The process of determining the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier includes: determining a first set of movement trajectories corresponding to each user identifier based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier; determining a first movement trajectory of each target object among the multiple target objects based on the target image; determining the overlap between the first movement trajectory of each target object and each trajectory in the first set of movement trajectories corresponding to each user identifier; and establishing a correspondence between the first user identifier and the first target object when a first user identifier exists among the multiple user identifiers and a first target object exists among the multiple target objects, wherein the overlap between the movement trajectory in the first set of movement trajectories corresponding to the first user identifier and the first movement trajectory of the first target object is higher than a third preset threshold.

2. The method according to claim 1, characterized in that, Determining the set of signal strengths corresponding to each user identifier and the set of signal-to-interference-plus-noise ratios corresponding to each user identifier includes: Within a preset time period, the reported information sent multiple times by the mobile terminal corresponding to each user identifier is obtained to obtain multiple reported information. Each of the multiple reported information is different, and each reported information has the signal strength and signal-to-interference-plus-noise ratio corresponding to the user identifier. The signal strength set and signal-to-interference-plus-noise ratio (SINNR) set corresponding to each user identifier are determined based on the plurality of reported information, wherein the signal strength set includes the signal strength in each of the plurality of reported information; and the SINNR set includes the SINNR in each of the plurality of reported information.

3. The method according to claim 2, characterized in that, During the process of acquiring the reported information sent multiple times by the mobile terminal corresponding to each user identifier within a preset time period, the method further includes: In each of the first to N-1 times when the reported information sent by the mobile terminal corresponding to each user identifier is obtained, the sending of the rejection code to the mobile terminal corresponding to each user identifier is prohibited, where N is a positive integer and N times; If the reported information sent by the mobile terminal corresponding to each user identifier is obtained for the Nth time, a rejection code is sent to the mobile terminal corresponding to each user identifier. If the mobile terminal does not receive a rejection code, it sends a reporting message to the mobile electronic fence module after a preset time interval. If the mobile terminal receives a rejection code, it stops sending reporting messages to the mobile electronic fence module.

4. The method according to claim 3, characterized in that, In each of the first to N-1 iterations, if the reported information sent by the mobile terminal corresponding to each user identifier is obtained, the method further includes: Disconnect the target wireless control resource (RRC) connection between the mobile electronic fence module and the mobile terminal corresponding to each user identifier.

5. The method according to claim 1, characterized in that, The first set of movement trajectories corresponding to each user identifier is determined based on the set of signal strengths and the set of signal-to-interference-plus-noise ratios corresponding to each user identifier, including: Obtain a signal strength database and a signal-to-interference-plus-noise ratio (SINR) database corresponding to the target region, wherein the signal strength database contains the signal strength distribution range corresponding to each location in the target region, and the SINR database contains the SINR distribution range corresponding to each location in the target region; Based on the signal strength database, determine one or more locations corresponding to each signal strength in the signal strength set corresponding to each user identifier, and determine a second set of movement trajectories corresponding to the signal strength set based on the one or more locations corresponding to each signal strength; and Based on the signal-to-interference-plus-noise ratio (SIR) database, determine one or more locations corresponding to each SIR in the SIR set corresponding to each user identifier, and determine a third set of movement trajectories corresponding to the SIR set based on the one or more locations corresponding to each SIR; The first set of movement trajectories is determined based on the second set of movement trajectories and the third set of movement trajectories.

6. The method according to claim 5, characterized in that, Determining the first set of movement trajectories based on the second set of movement trajectories and the third set of movement trajectories includes: A first set of movement trajectories is determined from the third set of movement trajectories, wherein each trajectory in the first set of movement trajectories and a second movement trajectory in the second set of movement trajectories meet a first preset condition, wherein the first preset condition includes: the overlap between each trajectory and the corresponding second movement trajectory exceeds a preset threshold; or A first set of movement trajectories is determined from the second set of movement trajectories, wherein each trajectory in the first set of movement trajectories and a third movement trajectory in the third set of movement trajectories meet a second preset condition, wherein the second preset condition includes: the overlap between each trajectory and the third movement trajectory corresponding to each trajectory exceeds the preset threshold.

7. The method according to claim 5, characterized in that, Before acquiring the signal strength database and signal-to-interference-plus-noise ratio database corresponding to the target region, the method further includes: Target devices are deployed multiple times at each location in the target area, and the mobile phone electronic fence module of the image acquisition device collects data on each deployed target device to obtain multiple signal strengths and multiple signal-to-interference-plus-noise ratios corresponding to each location. The target device has a chip corresponding to the user identifier, and the time interval between two adjacent deployments of the target device is greater than a second preset threshold. The signal strength distribution range and signal-to-interference-plus-noise ratio distribution range for each location are determined based on multiple signal strengths and multiple signal-to-interference-plus-noise ratios corresponding to each location.

8. A device for determining a correspondence, characterized in that, include: The first determining module is used to determine the signal strength set and the signal-to-interference-plus-noise ratio set corresponding to each user identifier when multiple user identifiers are collected in the target area by the mobile electronic fence module of the image acquisition device. The second determining module is used to determine the correspondence between multiple target objects and multiple user identifiers based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, wherein the multiple target objects are objects included in the target image obtained by the image acquisition device when the image acquisition device acquires the multiple user identifiers in the target area; The second determining module is further configured to determine a first movement trajectory set corresponding to each user identifier based on the signal strength set and signal-to-interference-plus-noise ratio set corresponding to each user identifier, and to determine a first movement trajectory of each of the plurality of target objects based on the target image; determine the overlap between the first movement trajectory of each target object and each trajectory in the first movement trajectory set corresponding to each user identifier; and, in the case where a first user identifier exists among the plurality of user identifiers and a first target object exists among the plurality of target objects, establish a correspondence between the first user identifier and the first target object, wherein the overlap between the movement trajectory in the first movement trajectory set corresponding to the first user identifier and the first movement trajectory of the first target object is higher than a third preset threshold.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method described in any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method described in any one of claims 1 to 7 through the computer program.

Images