Graph and code joint detection information processing system and method

Abstract

The invention provides a picture and code joint investigation information processing system and method, and belongs to the technical field of security equipment, and the method comprises the steps: building an information collection region which comprises at least one face camera and at least one hotspot device; the face camera is used for acquiring a face image in an image collection area, and the hotspot device is used for acquiring IMSI information and hotspot parameters of a communication terminal in a collection range; and filtering IMSI information acquired by the hot spot device according to the hot spot region and the hot spot parameter range corresponding to the hot spot device, and associating the face image with the filtered IMSI information. Collected face images and IMSI codes are pre-classified according to hot spot areas through face cameras and hot spot devices which are arranged in a distributed mode. And through a matching strategy based on the hot spot area, the distributed face camera and the hot spot equipment, the accuracy of matching the face image and the IMSI code can be improved, and the requirement on the system processing performance can be reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of security equipment, and more specifically relates to an image and code joint detection information processing system and method. Background Art

[0002] Image code joint detection equipment is a public security equipment, mainly used to track and locate specific people. By collecting and analyzing information about specific people, such as communication equipment, facial image features, etc., their location and movement trajectory can be determined. This equipment is usually used by the reconnaissance department of the public security agency and plays an important role in combating crime and protecting public safety.

[0003] The image in the joint detection refers to the face photo and vehicle photo, and the code refers to the mobile phone IMSI code. The face capture camera, vehicle capture camera and mobile phone code detection equipment deployed in the same location simultaneously capture face photos, vehicle photos and mobile phone IMSI codes. The system gradually matches the correspondence between face, license plate and IMSI code based on these data.

[0004] Face photos and mobile phone IMSI codes are collected through different devices. For streets with large pedestrian flow, a large number of images and data will be generated in a short period of time. The existing image-code joint detection equipment and image-code joint detection methods cannot accurately establish the association relationship between the image and the code. Summary of the invention

[0005] Based on this, an object of the present invention is to provide a method for processing image-code joint detection information, which is used to establish an association between face and IMSI information; comprising:

[0006] Establishing an information collection area, wherein the information collection area includes at least one face camera and at least one hotspot device; the face camera is used to obtain face images in the image collection area, and the hotspot device is used to obtain IMSI information and hotspot parameters of communication terminals within the collection range;

[0007] Establish at least one hotspot area in the image collection area of ​​the face camera, and obtain a hotspot parameter range corresponding to the hotspot area and the hotspot device;

[0008] Acquire facial images in the hotspot area through the facial camera;

[0009] The IMSI information obtained by the hotspot device is filtered according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the face image is associated with the filtered IMSI information.

[0010] Preferably, the information collection area includes a plurality of face cameras and at least one hotspot device;

[0011] The image collection area of ​​each face camera includes at least one hotspot area, each hotspot area is associated with at least one hotspot device, and each hotspot area and the associated hotspot device are respectively configured with a hotspot parameter range;

[0012] The face camera obtains the face image in the hotspot area to which it belongs and the time information of obtaining the face image, filters the IMSI information obtained by the hotspot device according to the time information and the hotspot parameter range associated with the hotspot area and the hotspot device, and associates the face image with the filtered IMSI information.

[0013] Preferably, the information collection area further includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area;

[0014] The panoramic camera is used to identify people who enter the panoramic camera and record the movement trajectory of people in the panoramic camera image collection area; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded;

[0015] The facial images and / or IMSI information collected from the same person in multiple hotspot areas are matched based on the time information of the person entering each hotspot area recorded by the panoramic camera.

[0016] Preferably, the panoramic camera can identify the person entering the panoramic camera and record the person's characteristic information; the face camera can obtain the face image and characteristic information of the person in the hot spot area;

[0017] Facial images and / or IMSI information collected from multiple hotspots of the same person are matched based on feature information.

[0018] Preferably, facial images and IMSI information acquired by multiple facial cameras and at least one hotspot device in the information collection area are matched based on the following strategy:

[0019] The face image obtained in the same hotspot area is matched with the filtered IMSI information, which is the IMSI information obtained by the hotspot device associated with the hotspot area and conforms to the hotspot parameter range;

[0020] The facial images collected at the same time or within a preset time range and in the same hotspot area are matched with the filtered IMSI information;

[0021] The facial images of the same person collected in multiple hot spots are matched with the IMSI information; the same person is a person whose time of entry into a hot spot collected by the panoramic camera is the same as the time of entry into the hot spot collected by the facial camera or corresponds to multiple persons within a preset time range, and / or whose feature information collected by the panoramic camera is the same as or similar to the feature information of the person collected by the facial camera.

[0022] Another object of the present invention is to provide an image and code joint detection information processing system, the image and code joint detection information processing system includes an information collection area, the information collection area includes at least one face camera and at least one hotspot device; the face camera is used to obtain face images in the image collection area, and the hotspot device is used to obtain IMSI information and hotspot parameters of communication terminals within the collection range;

[0023] The information collection area includes at least one hotspot area, and the face camera can obtain face images in the hotspot area; the image and code joint detection information processing system presets the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the image and code joint detection information processing system can filter the IMSI information obtained by the hotspot device according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and associate the face image with the filtered IMSI information.

[0024] Preferably, the image and code joint detection information processing system also includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area; the panoramic camera is used to identify the person entering the panoramic camera and record the movement trajectory of the person in the image collection area of ​​the panoramic camera; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded.

[0025] Preferably, the panoramic camera can identify the person entering the panoramic camera and record the person's characteristic information; the facial camera can obtain the facial image of the person in the hot spot area and the person's characteristic information.

[0026] Preferably, the image and code joint detection information processing system also includes a processor and a memory, the processor is used to store a computer program, and the computer program is used to execute the image and code joint detection information processing method.

[0027] The present invention also provides a computer-readable storage medium on which a computer program is stored, and the program is used to implement the aforementioned image-code joint detection information processing method.

[0028] According to an embodiment of the present invention, a system and method for image and code joint detection information processing can establish a correspondence between facial images and IMSI codes of communication devices. The image and code joint detection information processing system pre-classifies collected facial images and IMSI codes according to hotspot areas through distributed facial cameras and hotspot devices, and through a matching strategy based on hotspot areas and distributed facial cameras and hotspot devices, it can improve the accuracy of matching facial images with IMSI codes and reduce the requirements for system processing performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The present disclosure includes drawings, which should be considered to be included in and constitute a part of the specification, and together with the specification, illustrate various exemplary embodiments, features and aspects of the present disclosure, and are used to explain the principles of the present disclosure. The present invention will be more fully understood through the following detailed description in conjunction with the drawings. Among them:

[0030] Figure 1 is a flow chart of a method for processing image-code joint detection information according to an embodiment of the present invention;

[0031] Figure 2 2 is a schematic diagram of an information collection area of ​​a method for processing image-code joint detection information according to an embodiment of the present invention;

[0032] Figure 3 is a schematic diagram of an information matching strategy of a method for processing image-code joint detection information according to an embodiment of the present invention;

[0033] Figure 4 is a schematic diagram of an image-code joint detection information processing system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0034] The technical solution of the present invention is further described in detail below through embodiments and in conjunction with the accompanying drawings, but the present invention is not limited to the following embodiments.

[0035] Image code joint detection equipment is a public security equipment, mainly used to track and locate specific people. By collecting and analyzing information about specific people, such as communication equipment, facial image features, etc., their location and movement trajectory can be determined. This equipment is usually used by the reconnaissance department of the public security agency and plays an important role in combating crime and protecting public safety.

[0036] The image in the joint detection refers to the face photo and vehicle photo, and the code refers to the mobile phone IMSI code. The face capture camera, vehicle capture camera and mobile phone code detection equipment deployed in the same location simultaneously capture face photos, vehicle photos and mobile phone IMSI codes. The system gradually matches the correspondence between face, license plate and IMSI code based on these data.

[0037] Face photos and mobile phone IMSI codes are collected through different devices. For streets with large pedestrian flow, a large number of images and data will be generated in a short period of time. The existing image-code joint detection equipment and image-code joint detection methods cannot accurately establish the association relationship between the image and the code.

[0038] In order to solve the above problems, an object of the present invention is to provide a method for processing image-code joint detection information, which is used to establish an association between face and IMSI information; comprising:

[0039] Establishing an information collection area, wherein the information collection area includes at least one face camera and at least one hotspot device; the face camera is used to obtain face images in the image collection area, and the hotspot device is used to obtain IMSI information and hotspot parameters of communication terminals within the collection range;

[0040] Establish at least one hotspot area in the image collection area of ​​the face camera, and obtain a hotspot parameter range corresponding to the hotspot area and the hotspot device;

[0041] Acquire facial images in the hotspot area through the facial camera;

[0042] The IMSI information obtained by the hotspot device is filtered according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the face image is associated with the filtered IMSI information.

[0043] In this embodiment, the face camera refers to an image acquisition device that can meet the requirements of face recognition technology, specifically, the image quality of the face camera can meet the requirements of face recognition technology. In some embodiments, the face camera can be a device that uses near-infrared technology, which is not greatly affected by the surrounding ambient light when taking face images, and can also work normally at night. When collecting, the face recognition camera can transmit these face images in real time to the face recognition system database, and can complete the face recognition work in a very short time through a powerful face recognition algorithm.

[0044] The hotspot device can simulate a mobile communication base station, allowing a nearby mobile phone to connect to it and capture the IMSI number of the mobile phone in the process. In some embodiments, the hotspot device can also obtain the signal strength of the wireless connection with the mobile terminal, and the size of the signal strength value is related to the distance between the mobile terminal and the hotspot device.

[0045] A hotspot area refers to an area within the range of the image captured by the face camera. In some embodiments, the location of the hotspot area can be set on the sidewalk. The hotspot area can be a virtual area in the real environment. The location range in the real environment is consistent with the range of the corresponding hotspot area in the face camera. In other words, when a person enters the hotspot area in the real environment, he or she also enters the hotspot area in the image captured by the face camera.

[0046] The image collection area of ​​the face camera may include one hotspot area or multiple hotspot areas. In some embodiments, the face camera is set at an intersection, which is the intersection of two streets. Then two hotspot areas can be established for the two streets respectively. When a person enters a hotspot area and collects a face image, it can be marked which hotspot area the person has entered, thereby achieving pre-classification.

[0047] In the specific implementation process, the distances between multiple hotspot areas and the hotspot device are inconsistent, and thus the signal strengths collected by the hotspot device in different hotspot areas are inconsistent.

[0048] When establishing a hotspot area, a connection can be established with a hotspot device in the hotspot area to obtain a reference value of the signal strength. A theoretical value of the signal strength can also be calculated as a reference value based on the actual distance between the hotspot area and the hotspot device.

[0049] In some embodiments, the hotspot parameters include a signal strength value, and may also include a band in which the signal operates and a signal strength value corresponding to each band.

[0050] In the specific implementation process, Figure 1 As shown, after a person enters a hotspot area, he is detected by the face camera, and the face camera simultaneously collects the facial image information of the person, and within a certain time range of collecting the facial image information, obtains the IMSI code of the mobile communication terminal whose signal strength falls within the preset signal strength range of this hotspot area from the mobile communication terminal information collected by the hotspot device, and establishes an association between the facial image information and the IMSI code, and excludes the mobile communication terminal information of other hotspot areas through the hotspot parameters.

[0051] In the specific implementation process, for the same terminal, information may be collected multiple times by the hotspot device. After the information is collected, it is temporarily stored. After the facial image is obtained, the information collected by the hotspot device for a period of time near this time point is extracted according to the time point of obtaining the facial image. The time interval T0 can be specifically 0.5s~2s.

[0052] When the traffic volume on the street is large, a facial image may be associated with multiple IMSI codes, which can be stored in the system first. The information of multiple information collection areas in the system is compared with each other, and the final matching result is obtained according to the frequency of association between facial images and IMSI codes.

[0053] Further, the information collection area includes a plurality of face cameras and at least one hotspot device;

[0054] The image collection area of ​​each face camera includes at least one hotspot area, each hotspot area is associated with at least one hotspot device, and each hotspot area and the associated hotspot device are respectively configured with a hotspot parameter range;

[0055] The face camera obtains the face image in the hotspot area to which it belongs and the time information of obtaining the face image, filters the IMSI information obtained by the hotspot device according to the time information and the hotspot parameter range associated with the hotspot area and the hotspot device, and associates the face image with the filtered IMSI information.

[0056] In this embodiment, multiple hotspot areas are set in the information collection area. When a person passes through multiple hotspot areas, the IMSI information collected by the hotspot device is filtered according to the time when the facial image of the same person is collected in different hotspot areas.

[0057] For example, personnel P1 and personnel P2 enter the hotspot area A11 to which the face camera F1 belongs at the same time or at a similar time T11. According to the above content, the face camera F1 collects the facial image information of personnel P1 and personnel P2 at time T11, and the hotspot device records the IMSI code information C1 and IMSI code information C2 at time T11. The IMSI code information C1 of the terminal device carried by personnel P1 and the IMSI code information C2 of the terminal device carried by personnel P2 are collected and associated by the system.

[0058] At this time, it is not possible to distinguish between person P1 and person P2 and IMSI code information C1 and IMSI code information C2, and IMSI code information C1 and IMSI code information C2 are temporarily associated with person P1, and IMSI code information C1 and IMSI code information C2 are temporarily associated with person P2.

[0059] In some embodiments, after this, personnel P1 and personnel P2 successively enter the hotspot area A21 to which the face camera F2 belongs. The time difference between personnel P1 and personnel P2 entering the hotspot area A21 is greater than the time interval T0, so they can be distinguished. The face camera F2 collects the facial image information of personnel P1 and personnel P2 again. According to the above content, personnel P1 is associated with the IMSI code information C1, and personnel P2 is associated with the IMSI code information C2.

[0060] In some embodiments, after this, person P1 and person P3 enter the hotspot area A31 to which the face camera F3 belongs at the same time or at a similar time T12. According to the foregoing content, the face camera F3 collects facial image information of person P1 and person P3 at time T12, and the hotspot device records the IMSI code information C1 and IMSI code information C3 at time T12.

[0061] According to the information that has been temporarily associated before: IMSI code information C1 and IMSI code information C2 are associated with person P1. According to the frequency of information association, IMSI code information C1 and person P1 have been associated multiple times. At this time, the association information can be updated according to the frequency of information association to establish the association between IMSI code information C1 and person P1.

[0062] Furthermore, the information collection area also includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area;

[0063] The panoramic camera is used to identify people who enter the panoramic camera and record the movement trajectory of people in the panoramic camera image collection area; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded;

[0064] The facial images and / or IMSI information collected from the same person in multiple hotspot areas are matched based on the time information of the person entering each hotspot area recorded by the panoramic camera.

[0065] In this embodiment, the panoramic camera is a camera with a wide shooting range. The panoramic camera can be a shooting screen of a camera, and multiple hot spots in the information collection area are covered by the panoramic camera. The panoramic camera can also be a screen covered by multiple cameras, and multiple hot spots in the information collection area are respectively covered by the image acquisition ranges of multiple cameras.

[0066] The hot spots in the images captured by the panoramic camera and the hot spots in the facial camera are pre-calibrated when the information collection area is established, and are consistent with the locations of the hot spots in the real scene.

[0067] In some embodiments, the panoramic camera is used to distinguish people in the information collection area, calibrate the person when the same person passes through one or more hot spots, and record the time when the person enters the hot spot area. Specifically, when a person enters the image acquisition range of the panoramic camera, the system will generate a unique temporary person ID associated with the person. The panoramic camera will identify the person's movement within the image range and establish a movement trajectory. When the person enters a hot spot area, the time of entering the hot spot area, the hot spot area information, and the temporary person ID are recorded. The temporary person ID is used to distinguish the person to whom the trajectory belongs. When the person leaves the image acquisition range of the panoramic camera, the temporary person ID becomes invalid.

[0068] In the specific implementation process, the panoramic camera is used to identify and associate the data generated when the same person passes through different hot spots.

[0069] In the previous embodiment, the data generated when the same person passes through different hot spots can be associated by identifying the same person through facial images collected by facial cameras corresponding to multiple hot spots.

[0070] However, not all angles can capture a person's facial image, so the trajectory of the panoramic camera plays a role in supplementary recognition.

[0071] In some embodiments, the method for the panoramic camera to establish the trajectory of personnel movement can be a video target tracking algorithm based on mean shift, or a target tracking algorithm based on Kalman filtering.

[0072] Furthermore, the panoramic camera can identify the person entering the panoramic camera and record the person's characteristic information; the face camera can obtain the face image and characteristic information of the person in the hot spot area;

[0073] Facial images and / or IMSI information collected from multiple hotspots of the same person are matched based on feature information.

[0074] In this embodiment, the panoramic camera can also identify the characteristics of the person, which can be the person's gender, clothing and other appearance characteristics. The face camera can also perform feature recognition of the person. This embodiment proposes another method for associating the data generated when the same person passes through different hot spots.

[0075] For example, if Figure 2 As shown, the image acquisition range of the panoramic camera V1 is A1, and persons P1 and P2 enter the image acquisition range A1. The trajectory of person P1 is L1, and the trajectory of person P2 is L2.

[0076] Embodiment 1:

[0077] In this embodiment, personnel P1 and personnel P2 successively pass through hot spot area A11 and hot spot area A12 to which face camera F1 belongs, and the time difference between personnel P1 and personnel P2 entering hot spot area A11 and hot spot area A12 is greater than time interval T0.

[0078] Hotspot device S1 establishes an association between person P1 and IMSI code information C1 based on the signal strength and time when the communication terminal enters hotspot area A11 and hotspot area A12, and the face camera establishes an association between person P1 and person P2 and IMSI code information C2.

[0079] In some embodiments, multiple hotspot devices are set in the signal collection area. In this embodiment, a hotspot device S2 is also set. The hotspot area and each hotspot device are set with corresponding parameter intervals, which further enhances the ability to distinguish the same communication terminal entering different hotspot areas.

[0080] Embodiment 2:

[0081] In this embodiment, personnel P1 and personnel P2 pass through hotspot area A11 and hotspot area A12 at the same time or in a similar time interval. At this time, the association between personnel P1 and personnel P2 and IMSI code information C1 and IMSI code information C2 cannot be distinguished.

[0082] After that, person P1 passed through hotspot area A21 and hotspot area A22 to which face camera F2 belongs; person P2 passed through hotspot area A31 and hotspot area A32 to which face camera F3 belongs. Due to the direction of travel, face cameras F2 and F3 cannot capture facial images of persons P1 and P2. However, the panoramic camera records the time when person P1 enters hotspot area A21 and hotspot area A22, and hotspot devices S1 and S2 can record the hotspot areas to which IMSI code information C1 and IMSI code information C2 belong within the corresponding time range. Based on the above information, the association between person P1 and IMSI code information C1 can be established; the association between person P2 and IMSI code information C2 can be established.

[0083] In other embodiments, the panoramic camera identifies the characteristic information of person P1 and the characteristic information of person P2. When person P1 passes through hotspot area A21 and hotspot area A22, face camera F2 identifies the characteristic information of person P1. When person P2 passes through hotspot area A31 and hotspot area A32, face camera F3 identifies the characteristic information of person P2. At the same time, hotspot device S1 and hotspot device S2 can record the hotspot areas to which IMSI code information C1 and IMSI code information C2 belong within the corresponding time range. Based on the above information, an association between person P1 and IMSI code information C1 can be established; an association between person P2 and IMSI code information C2 can be established.

[0084] Furthermore, facial images and IMSI information acquired by multiple facial cameras and at least one hotspot device in the information collection area are matched based on the following strategy:

[0085] The face image obtained in the same hotspot area is matched with the filtered IMSI information, which is the IMSI information obtained by the hotspot device associated with the hotspot area and conforms to the hotspot parameter range;

[0086] The facial images collected at the same time or within a preset time range and in the same hotspot area are matched with the filtered IMSI information;

[0087] The facial images of the same person collected in multiple hot spots are matched with the IMSI information; the same person is a person whose time of entry into a hot spot collected by the panoramic camera is the same as the time of entry into the hot spot collected by the facial camera or corresponds to multiple persons within a preset time range, and / or whose feature information collected by the panoramic camera is the same as or similar to the feature information of the person collected by the facial camera.

[0088] This embodiment proposes a strategy for matching facial images and / or IMSI information collected from multiple hotspots of the same person based on feature information.

[0089] like Figure 3 As shown in the figure, the information matching strategy includes the following items:

[0090] 1) Based on the information filtering of the same hotspot area, after a person enters a hotspot area, the face camera captures the person's facial image, and the hotspot device filters out the IMSI information of the person who entered the hotspot area within the time range and whose signal strength falls within the preset signal strength range of the hotspot area based on the preset signal strength. The person is associated with these IMSI information.

[0091] 2) The association information of the same person in different hotspot areas based on the direction in 1) is screened and updated. The basis for information screening and updating is the number and frequency of association of the same person with one or more IMSI information.

[0092] 3) The identification of the same person is based on the following strategies:

[0093] People with similar facial images captured by multiple facial cameras belong to the same person.

[0094] The time when the same person recorded by the panoramic camera enters a hot spot area is the same as the time when the person recorded by the face camera enters the hot spot area, or the people within the preset time range are the same person.

[0095] Persons whose characteristics recorded by the panoramic camera are the same as or similar to those recorded by the facial camera are the same person.

[0096] Another object of the present invention is to provide an image and code joint detection information processing system, the image and code joint detection information processing system includes an information collection area, the information collection area includes at least one face camera and at least one hotspot device; the face camera is used to obtain face images in the image collection area, and the hotspot device is used to obtain IMSI information and hotspot parameters of communication terminals within the collection range;

[0097] The information collection area includes at least one hotspot area, and the face camera can obtain face images in the hotspot area; the image and code joint detection information processing system presets the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the image and code joint detection information processing system can filter the IMSI information obtained by the hotspot device according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and associate the face image with the filtered IMSI information.

[0098] In this embodiment, the face camera refers to an image acquisition device that can meet the requirements of face recognition technology, specifically, the imaging quality of the face camera can meet the requirements of face recognition technology. In some embodiments, the face camera can be a device that uses near-infrared technology, which is not greatly affected by the surrounding ambient light when taking facial images, and can also work normally at night. The hotspot device can simulate a mobile communication base station, allowing nearby mobile phones to connect to it and capture the IMSI number of the mobile phone in the process. In some embodiments, the hotspot device can also obtain the signal strength of the wireless connection with the mobile terminal, and the size of the signal strength value is related to the distance between the mobile terminal and the hotspot device.

[0099] When establishing a hotspot area, a connection can be established with a hotspot device in the hotspot area to obtain a reference value of the signal strength. The theoretical value of the signal strength can also be calculated as a reference value based on the actual distance between the hotspot area and the hotspot device. In some embodiments, the hotspot parameters include the signal strength value, and can also include the band in which the signal works and the signal strength value corresponding to each band.

[0100] After a person enters a hotspot area, he or she is detected by the face camera. The face camera also collects the facial image information of the person. Within a certain time range of collecting the facial image information, the IMSI code of the mobile communication terminal whose signal strength is within the preset signal strength range of this hotspot area is obtained from the mobile communication terminal information collected by the hotspot device, and an association is established between the facial image information and the IMSI code. The mobile communication terminal information of other hotspot areas is excluded through the hotspot parameters. When the flow of people on the street is large, one facial image information may be associated with multiple IMSI codes, and this information can be stored in the system first. The information of multiple information collection areas in the system is compared with each other, and the final matching result is obtained based on the frequency of association between facial images and IMSI codes.

[0101] Further, if Figure 4 As shown, the image and code joint detection information processing system also includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area; the panoramic camera is used to identify the person entering the panoramic camera and record the movement trajectory of the person in the image collection area of ​​the panoramic camera; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded.

[0102] The panoramic camera can identify the person entering the panoramic camera and record the person's characteristic information; the face camera can obtain the face image and characteristic information of the person in the hot spot area.

[0103] In this embodiment, the face camera obtains the face image in the hotspot area to which it belongs and the time information of obtaining the face image, filters the IMSI information obtained by the hotspot device according to the time information and the hotspot parameter range associated with the hotspot area and the hotspot device, and associates the face image with the filtered IMSI information. Multiple hotspot areas are set in the information collection area. When a person passes through multiple hotspot areas, the IMSI information collected by the hotspot device is filtered according to the time when the facial images of the same person are collected in different hotspot areas.

[0104] The panoramic camera is used to identify people entering the panoramic camera and record the person's movement trajectory in the panoramic camera image collection area; if the person's movement trajectory passes through any hot spot area, the time information of the person entering the hot spot area is recorded; the facial images and / or IMSI information collected by the same person in multiple hot spots are matched based on the time information of the person entering each hot spot area recorded by the panoramic camera.

[0105] Furthermore, the image and code joint detection information processing system also includes a processor and a memory, the processor is used to store a computer program, and the computer program is used to execute the image and code joint detection information processing method.

[0106] The present invention also provides a computer-readable storage medium on which a computer program is stored, and the program is used to implement the aforementioned image-code joint detection information processing method.

[0107] The various embodiments disclosed in the present invention have been described above. The above description is exemplary and not exhaustive, and the scope of the present invention is not limited to the above embodiments. Many modifications and changes are obvious to those of ordinary skill in the art without departing from the spirit and scope of the present invention. In other words, those of ordinary skill in the art can make various changes and improvements to the present invention in form and detail, and these are considered to fall within the scope of protection of the present invention. The choice of terms used herein is intended to best explain the principles of the various embodiments, practical applications, or improvements to the technology in the market, or to enable those of ordinary skill in the art to understand the various embodiments disclosed herein.

Claims

1. A method for processing image-code joint detection information, used to establish an association between face and IMSI information; characterized in that: include: Establishing an information collection area, wherein the information collection area includes at least one face camera and at least one hotspot device; The face camera is used to obtain face images within the image collection area, and the hotspot device is used to obtain the IMSI information and hotspot parameters of the communication terminals within the collection range; Establish at least one hotspot area in the image collection area of ​​the face camera, and obtain a hotspot parameter range corresponding to the hotspot area and the hotspot device; Acquire facial images in the hotspot area through the facial camera; The IMSI information obtained by the hotspot device is filtered according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the face image is associated with the filtered IMSI information.

2. The image-code joint detection information processing method according to claim 1, characterized in that: The information collection area includes a plurality of face cameras and at least one hotspot device; The image collection area of ​​each face camera includes at least one hotspot area, each hotspot area is associated with at least one hotspot device, and each hotspot area and the associated hotspot device are respectively configured with a hotspot parameter range; The face camera obtains the face image in the hotspot area to which it belongs and the time information of obtaining the face image, filters the IMSI information obtained by the hotspot device according to the time information and the hotspot parameter range associated with the hotspot area and the hotspot device, and associates the face image with the filtered IMSI information.

3. The image-code joint detection information processing method according to claim 2 is characterized in that: The information collection area also includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area; The panoramic camera is used to identify people who enter the panoramic camera and record the movement trajectory of people in the panoramic camera image collection area; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded; The facial images and / or IMSI information collected from the same person in multiple hotspot areas are matched based on the time information of the person entering each hotspot area recorded by the panoramic camera.

4. The image-code joint detection information processing method according to claim 3 is characterized in that: The panoramic camera can identify the person entering the panoramic camera and record the characteristic information of the person; The face camera can obtain the face images and feature information of people in the hotspot area; Facial images and / or IMSI information collected from multiple hotspots of the same person are matched based on feature information.

5. The method for processing image-code joint detection information according to claim 4, characterized in that: The facial images and IMSI information obtained by multiple facial cameras and at least one hotspot device in the information collection area are matched based on the following strategies: The face image obtained in the same hotspot area is matched with the filtered IMSI information, which is the IMSI information obtained by the hotspot device associated with the hotspot area and conforms to the hotspot parameter range; The facial images collected at the same time or within a preset time range and in the same hotspot area are matched with the filtered IMSI information; The facial images of the same person collected in multiple hotspots are matched with the IMSI information; The same person is a person whose time of entry into a hot spot area collected by the panoramic camera is the same as the time of entry into the hot spot area collected by the facial camera, or multiple times within a preset time range, and / or whose feature information collected by the panoramic camera is the same as or similar to the feature information collected by the facial camera.

6. A system for processing image-code joint detection information, applicable to the image-code joint detection information processing method according to any one of claims 1 to 5, characterized in that: The image and code joint detection information processing system includes an information collection area, which includes at least one face camera and at least one hotspot device; The face camera is used to obtain face images within the image collection area, and the hotspot device is used to obtain the IMSI information and hotspot parameters of the communication terminals within the collection range; The information collection area includes at least one hotspot area, and the face camera can obtain face images in the hotspot area; the image and code joint detection information processing system presets the hotspot parameter range corresponding to the hotspot area and the hotspot device, and the image and code joint detection information processing system can filter the IMSI information obtained by the hotspot device according to the hotspot parameter range corresponding to the hotspot area and the hotspot device, and associate the face image with the filtered IMSI information.

7. The image-code joint detection information processing system according to claim 6, characterized in that: The image code joint detection information processing system also includes at least one panoramic camera, and the image collection area of ​​the panoramic camera includes at least one hot spot area; The panoramic camera is used to identify people entering the panoramic camera and record the movement trajectory of the people in the panoramic camera image collection area; if the movement trajectory of the person passes through any hot spot area, the time information of the person entering the hot spot area is recorded.

8. The image-code joint detection information processing system according to claim 7, characterized in that: The panoramic camera can identify the person entering the panoramic camera and record the person's characteristic information; the face camera can obtain the face image and characteristic information of the person in the hot spot area.

9. The image-code joint detection information processing system according to any one of claims 6 to 8, characterized in that: The image and code joint detection information processing system also includes a processor and a memory, the processor is used to store a computer program, and the computer program is used to execute the image and code joint detection information processing method.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is used to implement the image code joint detection information processing method as described in any one of claims 1 to 5.

Images