Vehicle data processing method and device based on phase control direction finding and debugging method

Abstract

The present application relates to big data processing technical field, especially to a kind of based on phased direction finding's people and vehicle data processing method, device and debugging method, wherein, people and vehicle data processing method includes: the mobile terminal information and image data in the monitoring area are acquired;Mobile terminal information includes: the signal azimuth of mobile terminal and identification information;According to the acquisition time of mobile terminal information, determine target image from image data;According to signal azimuth and the first association relationship established in advance, determine and mark the target position of mobile terminal on target image;First association relationship is the association relationship of signal azimuth and image picture position;Extract target image feature information corresponding to target position, establish the association relationship of target image feature information and the identification information of mobile terminal, target image feature information includes vehicle feature information and / or pedestrian feature information, solve the technical problem that the accuracy of prior art people and vehicle association is low and the efficiency is low.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of big data processing, and in particular to a person-vehicle data processing method and device based on phased direction finding and a debugging method. BACKGROUND

[0002] When special events are traced and analyzed by relevant departments, the correspondence between license plates and mobile terminals is often used as an important breakthrough for event analysis. When determining the correspondence, the commonly used technical means is to deploy corresponding data acquisition devices at multiple locations to obtain fragmented mobile terminal information and license plate information, and after multi-dimensional data cleaning and collision under different spatio-temporal conditions, the fusion of multi-dimensional feature data such as people, vehicles, and codes is achieved.

[0003] However, many event targets have high mobility and do not meet the collision conditions for multiple appearances, or do not meet the collision conditions in multiple appearance scenarios. Using the above method for correlation analysis has low accuracy and is limited in many scenarios, is low in efficiency, and is difficult to meet the requirements of "one person one code, one vehicle one code" in actual combat. SUMMARY

[0004] The present application provides a person-vehicle data processing method and device based on phased direction finding and a debugging method, which is used to solve the technical problems of low accuracy and low efficiency of person-vehicle correlation in the prior art.

[0005] In one aspect, the present application provides a person-vehicle data processing method based on phased direction finding, comprising:

[0006] acquiring mobile terminal information and image data in a monitoring area; the mobile terminal information includes a signal bearing angle and identification information of a mobile terminal;

[0007] determining a target image from the image data according to the acquisition time of the mobile terminal information;

[0008] determining and labeling a target position of the mobile terminal on the target image according to the signal bearing angle and a pre-established first correlation relationship; the first correlation relationship is the correlation relationship between the signal bearing angle and the image screen position;

[0009] extracting target image feature information corresponding to the target position, establishing a correlation relationship between the target image feature information and the identification information of the mobile terminal, and the target image feature information includes vehicle feature information and / or pedestrian feature information.

[0010] Optionally, the image data is acquired by an image acquisition module, and the establishing step of the first correlation relationship comprises:

[0011] acquiring a signal bearing angle range covered by a full-frame screen of the image acquisition module;

[0012] According to the signal azimuth angle range, the full-width picture is equally divided into image picture positions, and each image picture position is associated with a signal azimuth angle represented by each image picture position, so as to obtain the first association relationship.

[0013] Optionally, the method further comprises:

[0014] According to the comparison result of the identification information and the preset identification information, it is judged whether the mobile terminal is a key target mobile terminal, and if so, the mobile terminal is periodically scheduled, and the signal azimuth angle of the mobile terminal is updated.

[0015] Optionally, after the target position of the mobile terminal is determined and marked on the target image according to the signal azimuth angle and the first association relationship established in advance, the method further comprises:

[0016] According to the target position, the position area of the mobile terminal is divided and marked.

[0017] Optionally, when the image area corresponding to the target position is a vehicle image area, the step of extracting the target image feature information corresponding to the target position and establishing the association relationship between the target image feature information and the identification information of the mobile terminal comprises:

[0018] The vehicle image area corresponding to the target position is binarized by using a gray level transition feature method to obtain a binarized image;

[0019] The license plate position is determined from the binarized image, and character segmentation and recognition operations are performed on the image area corresponding to the license plate position to obtain license plate information;

[0020] The association relationship between the license plate information and the identification information of the mobile terminal is established;

[0021] When the extracted license plate information is empty, vehicle attribute information is extracted from the vehicle image area corresponding to the target position;

[0022] The association relationship between the vehicle attribute information and the identification information of the mobile terminal is established;

[0023] The vehicle attribute information includes vehicle type, vehicle window rain eyebrow information, vehicle roof rack information, and vehicle body color.

[0024] Optionally, when the image area corresponding to the target position is a pedestrian image area, the step of extracting the target image feature information corresponding to the target position and establishing the association relationship between the target image feature information and the identification information of the mobile terminal comprises:

[0025] extracting face feature information corresponding to the target position in the image region;

[0026] matching the face feature information with a pre-stored face feature template and outputting a matching result;

[0027] establishing an association between the matching result and identification information of the mobile terminal;

[0028] when the extracted face feature information is empty, extracting body attribute information corresponding to the target position, and establishing an association between the body attribute information and the identification information of the mobile terminal; the body attribute includes gender, age stage, clothing type, clothing color, body orientation, and personal belongings.

[0029] In another aspect, the application provides a vehicle-person data processing device based on phase control direction finding, which comprises:

[0030] a terminal positioning module for collecting mobile terminal information in a monitoring area and sending the mobile terminal information to a central control console; the mobile terminal information includes a signal azimuth angle and identification information of the mobile terminal;

[0031] an image collection module for collecting image data in the monitoring area and sending the image data to the central control console;

[0032] the central control console is configured to acquire the mobile terminal information and the image data, determine a target image from the image data according to the collection time of the mobile terminal information, determine and mark a target position of the mobile terminal on the target image according to the signal azimuth angle and a pre-established first association, extract target image feature information corresponding to the target position, and establish an association between the target image feature information and the identification information of the mobile terminal; the first association is an association between the signal azimuth angle and an image frame position; and the target image feature information includes vehicle feature information and pedestrian feature information.

[0033] Optionally, the central control console is further configured to acquire a signal azimuth angle range covered by a full-frame image of the image collection module, divide the full-frame image into image frame positions according to the signal azimuth angle range, establish an association between each image frame position and a signal azimuth angle represented by each image frame position, and obtain the first association.

[0034] Optionally, the terminal positioning module is further configured to determine whether the mobile terminal is a key target mobile terminal according to a comparison result of the identification information and a preset identification information, periodically schedule the mobile terminal if the mobile terminal is a key target mobile terminal, and update the signal azimuth angle of the mobile terminal.

[0035] Another aspect of the present application provides a debugging method of a vehicle-person data processing device based on phased direction finding, applied to the device as described above, the method comprising:

[0036] The signal transmitter and the preset debugging scheme are used to perform associated debugging on the phased array components in the image acquisition module and the terminal positioning module, to obtain associated parameters of the image acquisition module and the phased array components; the associated parameters include position parameters of the phased array components, position parameters and camera parameters of the image acquisition module;

[0037] According to the associated parameters, the positions of the phased array components and the image acquisition module and the camera mode are fixed, and the fixed phased array components and the image acquisition module are arranged in the monitoring area.

[0038] From the above technical solutions, the present application has the following advantages:

[0039] An aspect of the present application provides a vehicle-person data processing method based on phased direction finding, comprising: acquiring mobile terminal information and image data in a monitoring area; the mobile terminal information includes signal azimuth and identification information of the mobile terminal; determining a target image from the image data according to the acquisition time of the mobile terminal information; determining and marking a target position of the mobile terminal on the target image according to the signal azimuth and a first associated relationship established in advance; the first associated relationship is the associated relationship between the signal azimuth and the image screen position; extracting target image feature information corresponding to the target position, and establishing the associated relationship between the target image feature information and the identification information of the mobile terminal; the target image feature information includes vehicle feature information and / or pedestrian feature information, solving the technical problems of low accuracy and low efficiency of vehicle-person association in the prior art.

[0040] Another aspect of the present application provides a vehicle-person data processing device based on phased direction finding, the device comprising: a terminal positioning module for collecting mobile terminal information in a monitoring area and sending the mobile terminal information to a central console; the mobile terminal information comprising: signal azimuth and identification information of the mobile terminal; an image acquisition module for acquiring image data in the monitoring area and sending the image data to the central console; the central console for obtaining the mobile terminal information and the image data, determining a target image from the image data according to the collection time of the mobile terminal information, determining and marking a target position of the mobile terminal on the target image according to the signal azimuth and a pre-established first correlation relationship, extracting target image feature information corresponding to the target position, and establishing a correlation between the target image feature information and the identification information of the mobile terminal, the first correlation relationship being a correlation between the signal azimuth and the image screen position, and the target image feature information comprising vehicle feature information and pedestrian feature information, solving the technical problems of low accuracy and low efficiency of existing vehicle-person correlation, achieving effective monitoring of the monitoring area at a single position, and efficiently correlating pedestrians, mobile terminals and vehicles passing through the monitoring area, greatly reducing deployment costs.

[0041] Another aspect of the present application provides a debugging method for a vehicle-person data processing device based on phased direction finding, the method comprising: using a signal transmitter and a pre-established debugging scheme to correlate and debug phased array components in an image acquisition module and a terminal positioning module, obtaining correlation parameters of the image acquisition module and the phased array components; the correlation parameters comprising: position parameters of the phased array components, position parameters and camera parameters of the image acquisition module; fixing the positions of the phased array components, the positions of the image acquisition module and the camera mode according to the correlation parameters, and setting the fixed phased array components and the image acquisition module in a monitoring area, achieving correlation of the terminal positioning module and the image acquisition module at the hardware level, providing hardware technical support for the central console to establish a first correlation relationship, and establishing a hardware technical foundation for improving the efficiency of vehicle-person correlation processing. BRIEF DESCRIPTION OF DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0043] Figure 1 A flowchart of a vehicle-person data processing method based on phased direction finding is provided for the first embodiment of the present application.

[0044] Figure 2 A flow chart of a vehicle-person data processing method based on phase-controlled direction finding provided for the second embodiment of the present application is shown in the figure.

[0045] Figure 3 A structural schematic diagram of a vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0046] Figure 4 A structural schematic diagram of another vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0047] Figure 5 A structural schematic diagram of still another vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0048] Figure 6 A partial schematic diagram of an equipment mounting structure provided by the present application is shown in the figure.

[0049] Figure 7 A partial schematic diagram of an installation effect provided by the present application is shown in the figure.

[0050] Figure 8 A front view of another vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0051] Figure 9 A front view of still another vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0052] Figure 10 A flow chart of a debugging method of a vehicle-person data processing device based on phase-controlled direction finding provided for the third embodiment of the present application is shown in the figure.

[0053] Figure 11 A principle schematic diagram of image acquisition module and terminal positioning module linkage debugging provided for the fourth embodiment of the present application is shown in the figure.

[0054] Figure 12 A position schematic diagram of signal sources of different signal azimuth angles and a vehicle-person data processing device provided for the fourth embodiment of the present application is shown in the figure.

[0055] Figure 13 A mobile terminal position area marking schematic diagram provided for the second embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0056] The embodiments of the present application provide a vehicle-person data processing method, device and debugging method based on phase-controlled direction finding, which are used to solve the technical problems of low accuracy and low efficiency of vehicle-person correlation in the prior art.

[0057] In order to make the inventive purposes, features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings of the embodiments of the present application. Obviously, the following described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the protection scope of the present application.

[0058] Please refer to Figure 1 , Figure 1 A flow chart of a vehicle-personnel data processing method based on phase control direction finding is provided for Embodiment One of the present application.

[0059] 101, acquire mobile terminal information and image data in a monitoring area; the mobile terminal information includes signal azimuth and identification information of the mobile terminal.

[0060] It should be noted that the present embodiment acquires the incident angle of the radio frequency signal by collecting the radio frequency signal emitted by the mobile terminal in the monitoring area, i.e. obtains the signal azimuth of the mobile terminal, so as to determine the spatial position of the mobile terminal based on the signal azimuth of the mobile terminal. And by establishing a communication connection with the mobile terminal in the monitoring area, the mobile terminal is instructed to report the identification information, wherein the identification information includes the first identification code IMSI (IMSI, International Mobile Subscriber Identity, International Mobile Subscriber Identity) and the second identification code RNTI (Radio Network Temporary Identity, Radio Network Temporary Identity).

[0061] The monitoring area can be determined according to actual monitoring requirements, for example, it can be set at a road checkpoint position or beside a pedestrian passage, etc. The image data includes pedestrian image data and / or vehicle image data. The image data can be video stream data.

[0062] 102, determine a target image from the image data according to the acquisition time of the mobile terminal information.

[0063] It should be noted that the mobile terminal information carries an acquisition time stamp, and the image data corresponding to the acquisition time of the mobile terminal information can be determined according to the time stamp. After receiving the image data, the video frame image data is obtained by analyzing the image data, and then the target image corresponding to the acquisition time is determined from the video frame image data according to the acquisition time of the mobile terminal information, so as to preliminarily determine the target image having an association relationship with the mobile terminal.

[0064] 103. determining and marking the target position of the mobile terminal on the target image according to the signal azimuth angle and the first pre-established correlation relationship; the first correlation relationship is the correlation relationship between the signal azimuth angle and the image frame position.

[0065] It should be noted that the correlation relationship between the signal azimuth angle and the image frame position is pre-established and stored in the database.

[0066] It can be understood that when the image data is collected by an image collection device such as a camera, the viewfinder frame of the camera can be divided into a preset number of frame positions, and by adjusting the position of the camera or adjusting the position of the device for collecting mobile terminal information, each frame position of the camera corresponds to a signal azimuth angle. Therefore, based on the corresponding relationship between the signal azimuth angle and the image frame position and the received signal azimuth angle, the image frame position corresponding to the received signal azimuth angle (i.e. the target position of the mobile terminal) can be determined, and then the target position of the mobile terminal is marked on the target image, which realizes the visualization of the position of the mobile terminal, so that the position of the mobile terminal can be directly determined based on the marked image. Wherein, when marking, it can be in the form of line drawing to mark the position of the mobile terminal.

[0067] 104. extracting target image feature information corresponding to the target position, establishing a correlation relationship between the target image feature information and the identification information of the mobile terminal, and the target image feature information includes vehicle feature information and / or pedestrian feature information.

[0068] It should be noted that the mobile terminal is generally carried on the body or in the vehicle, so after marking the position of the mobile terminal on the target image, the embodiment can preliminarily determine whether the mobile terminal is located on the vehicle or on the body of the pedestrian based on the marked image, and the embodiment can more accurately determine the correlation relationship between the mobile terminal and the vehicle and / or the pedestrian by extracting the target image feature corresponding to the target position of the mobile terminal and correlating the target image feature with the identification information of the mobile terminal, thereby solving the technical problems of low accuracy and low processing efficiency of the correlation between the person and the vehicle in the prior art, which requires deploying data collection devices at multiple points and using data from multiple points for big data collision correlation, the embodiment can realize the correlation of "one person one code and one vehicle one code" in a single monitoring area by obtaining data of a single monitoring area, which greatly reduces the construction cost and improves the processing efficiency of the correlation between the person and the vehicle.

[0069] The embodiment provides a vehicle-person data processing method based on phase control direction finding, which comprises the following steps: acquiring mobile terminal information and image data in a monitoring area; the mobile terminal information comprises signal azimuth and identification information of a mobile terminal; determining a target image from the image data according to the acquisition time of the mobile terminal information; determining and marking a target position of the mobile terminal on the target image according to the signal azimuth and a first correlation relationship established in advance; the first correlation relationship is the correlation relationship between the signal azimuth and the image screen position; extracting target image feature information corresponding to the target position, and establishing the correlation relationship between the target image feature information and the identification information of the mobile terminal, wherein the target image feature information comprises vehicle feature information and / or pedestrian feature information, the technical problems of low accuracy and low efficiency of person-vehicle correlation in the prior art are solved, the correlation processing of person-vehicle data is realized at a single point, and the deployment cost is greatly reduced.

[0070] Please refer to Figure 2 , Figure 2 A flow chart of a vehicle-person data processing method based on phase control direction finding is provided for the second embodiment of the present application.

[0071] 200. Acquire the signal azimuth range covered by the full-frame screen of the image acquisition module.

[0072] It should be noted that the signal azimuth range can be obtained by debugging the image acquisition module. For example, within the shooting range of the viewfinder frame of the image acquisition module, the signal transmitter is used to emit signals at multiple different positions, and the position is calculated by collecting the signals of the signal transmitter, so as to calculate the signal azimuth range covered by the full-frame screen of the viewfinder frame of the image acquisition module. In the embodiment, the signal azimuth range covered by the full-frame screen is +45° to -45°.

[0073] 201. According to the signal azimuth range, the image screen positions of the full-frame screen are equally divided, the correlation relationship between each image screen position and the signal azimuth represented by each image screen position is established, and the first correlation relationship is obtained.

[0074] It should be noted that according to the signal azimuth range covered by the full-frame screen, which is +45° to -45°, the image screen area of the full-frame screen shot by the camera can be divided into 90 space positions (i.e. image screen positions), each space position corresponds to a signal azimuth, and each signal azimuth is spaced by 1°. The correlation relationship between each space position and the signal azimuth corresponding to each space position is established, and the correlation relationship is stored in the database.

[0075] In the embodiment, the center position of the picture is set as the position corresponding to the 0° signal azimuth angle, and the whole picture is from left to right, and the signal azimuth angle is from -45° to 0°, 0°, and 0° to +45°.

[0076] It can be understood that the full-width picture of the image acquisition module is a picture with a fixed size specification obtained through pre-debugging, and therefore, when the picture is divided, the image picture position at the 0° signal azimuth angle can be used as a dividing line reference for equal vertical division, that is, the full-width picture can be divided into 90 image picture positions, and the establishment of the first association relationship can be completed by associating the image position parameters corresponding to each image picture position with the corresponding signal azimuth angle. The image position parameters can be coordinate positions obtained by establishing a coordinate system for the image.

[0077] 202, acquire mobile terminal information and image data in a monitoring area; the mobile terminal information includes a signal azimuth angle and identification information of the mobile terminal.

[0078] It should be noted that step 201 can refer to step 101, and the embodiment will not be repeated here.

[0079] 203, determine a target image from the image data according to the acquisition time of the mobile terminal information.

[0080] It should be noted that step 203 can refer to step 102, and the embodiment will not be repeated here.

[0081] 204, determine and mark a target position of the mobile terminal on the target image according to the signal azimuth angle and the first association relationship, and divide and mark a position area of the mobile terminal based on the target position.

[0082] It should be noted that the method for determining the target position can refer to step 103, and the embodiment will not be repeated here.

[0083] In the embodiment, when the target position of the mobile terminal on the target image is determined, the image area corresponding to a preset area range size is divided into left and right as the position area of the mobile terminal based on the target position, the embodiment provides an error interval for the determination of the position of the mobile terminal, thereby improving the fault tolerance rate of the determination of the position of the mobile terminal. When marking, different colors or different types of line segments can be used for division to distinguish the target position and the error interval, so that the target position and the error interval can be distinguished. Figure 13 For example, as shown in Figure 13As shown, if the calculated signal azimuth of the mobile terminal is -10°, then according to the first correlation relationship, the position of the image corresponding to -10° is marked with a solid line, and the position of the solid line represents the mobile terminal identification position. The two dotted lines on the left and right of the solid line are error intervals, and the two dotted lines and the area between the dotted lines constitute the position area of the mobile terminal.

[0084] In this embodiment, by marking the position of the mobile terminal on the image, the position of the mobile terminal is visualized, and the relationship between the mobile terminal and the person and the relationship between the mobile terminal and the vehicle are more concrete and intuitive.

[0085] It can be understood that, Figure 13 This is only an example of marking, and is not limited. Those skilled in the art can mark according to their own habits, using different colors or line types or other marking forms.

[0086] In this embodiment, when the received signal azimuth is outside the above-mentioned signal azimuth range, the target position of the mobile terminal is marked at the image position corresponding to +45° or -45°.

[0087] 205, extracting the target image feature information corresponding to the target position, establishing the correlation relationship between the target image feature information and the identification information of the mobile terminal, and the target image feature information includes vehicle feature information and / or pedestrian feature information.

[0088] It should be noted that the position area obtained by dividing in step 204 is subjected to image recognition to determine the object type corresponding to the area. When the image area corresponding to the target position is a vehicle image area, sub-step C1 is executed, and when the image area corresponding to the target position is a pedestrian image area, sub-step C2 is executed.

[0089] Sub-step C1 includes:

[0090] C11: using a gray level transition feature method to binarize the vehicle image area corresponding to the target position to obtain a binarized image.

[0091] It should be noted that by performing local binarization processing on the vehicle image area corresponding to the target position, a corresponding binarized image is obtained, so that the position of the license plate can be determined.

[0092] C12: determining the license plate position from the binarized image, and performing character segmentation and recognition operations on the image area corresponding to the license plate position to obtain license plate information.

[0093] It should be noted that the pixel value in the binary image can be used to determine the license plate position of the vehicle. After determining the license plate position, the gray level features of the license plate area characters and background color are used for frame removal and character segmentation. Finally, the license plate character recognition is realized by using the basic theory of computer vision to obtain the license plate number.

[0094] C13: Establishing the association between the license plate information and the identification information of the mobile terminal.

[0095] It should be noted that after obtaining the license plate number, the association between the license plate number and the mobile terminal identification information is established to construct the association file of the mobile terminal and the vehicle, thereby realizing the practical demand of "one machine one file".

[0096] C14: When the extracted license plate information is empty, extracting vehicle attribute information from the vehicle image area corresponding to the target position.

[0097] C15: Establishing the association between the vehicle attribute information and the identification information of the mobile terminal;

[0098] It should be noted that since the license plate image is usually obtained in complex environmental conditions, license plate recognition is relatively difficult. When the license plate information cannot be extracted, the appearance attributes of the vehicle in the vehicle image area are identified, such as vehicle type, vehicle window rain eyebrow feature information, roof rack information, vehicle body color and other vehicle appearance information that are easy to extract and identify. Thus, the extracted vehicle attribute information is used as temporary vehicle information for filing and stored in the database.

[0099] The sub-step C2 includes:

[0100] C21: Extracting the face feature information of the image area corresponding to the target position.

[0101] It should be noted that the extraction step includes: first, calibrating the histogram feature, color feature, template feature, structure feature and other face pattern features in the image area corresponding to the target position, then performing image preprocessing such as gray correction and noise filtering on the face image, and then using an algorithm to model the face features to obtain the face feature information. The algorithm includes a knowledge-based representation method or an algebraic feature or statistical learning-based representation method.

[0102] C22: Matching the face feature information with the pre-stored face feature template and outputting the matching result.

[0103] It should be noted that the extracted face feature is compared with the pre-stored feature module in the database for similarity. When the similarity exceeds the preset similarity threshold, the corresponding matching result is output. The matching result contains the face information.

[0104] C23: Establishing an association between the matching result and the identification information of the mobile terminal.

[0105] By establishing the association between the matching result containing the face information and the identification information of the mobile terminal, the association between the mobile terminal and the person is established.

[0106] C24: When the face feature information is empty, extracting the body attribute information corresponding to the target position, and establishing an association between the body attribute information and the identification information of the mobile terminal; the body attribute includes gender, age stage, clothing type, clothing color, body orientation, and personal belongings.

[0107] It should be noted that since the face image may fail to be recognized, the face feature information cannot be extracted. Therefore, when the face feature information is empty, the body image region corresponding to the target position is framed, the body attribute corresponding to the body image region is recognized, and the body attribute information is used as the pedestrian information for filing. The body attribute includes gender, age stage, clothing type (such as long-sleeved, short-sleeved, etc.), clothing color, body orientation, and personal belongings.

[0108] It should be noted that the existing image recognition algorithm can be used to extract and recognize the body attribute. For example, a neural network is trained to construct a body attribute recognition model to recognize the body attribute in the image.

[0109] 206: According to the comparison result of the identification information and the preset identification information, it is judged whether the mobile terminal is a key target mobile terminal. If yes, the mobile terminal is periodically scheduled, and the signal azimuth of the mobile terminal is updated.

[0110] It should be noted that step 206 can be after step 205 or after step 202.

[0111] The preset identification information refers to the key target mobile terminal identification code, which is stored in the key target database in advance. In this embodiment, the received mobile terminal identification code is used as a matching keyword to match in the key target database. When the key target database contains a key target mobile terminal identification code consistent with the received identification information, it means that the monitored mobile terminal is a key target mobile terminal, and the mobile terminal needs to be periodically scheduled, and the signal azimuth of the key target mobile terminal is updated, so as to timely follow up and mark the position of the key target.

[0112] The embodiment stores the key mobile terminal identification code in the key target database by using the hash algorithm when constructing the key target database, so as to accelerate the information retrieval and query speed, and realize the query of the million-level data in less than 1 millisecond.

[0113] Please refer to Figure 3 , Figure 3 The structure schematic diagram of a vehicle and pedestrian data processing device based on phased direction finding provided for the third embodiment.

[0114] The vehicle and pedestrian data processing device based on phased direction finding provided by the embodiment comprises a terminal positioning module 1, an image acquisition module 2 and a central control console 3.

[0115] The terminal positioning module 1 is used for acquiring the mobile terminal information in the monitoring area and sending the mobile terminal information to the central control console 3, wherein the mobile terminal information comprises the signal azimuth angle and the identification information of the mobile terminal.

[0116] It should be noted that the terminal positioning module 1 can acquire the incident angle of the radio frequency signal by acquiring the radio frequency signal emitted by the mobile terminal in the monitoring area, so as to obtain the signal azimuth angle of the mobile terminal, and determine the spatial position of the mobile terminal based on the signal azimuth angle of the mobile terminal. Moreover, the terminal positioning module 1 can establish a communication connection with the mobile terminal in the monitoring area, and make the mobile terminal report the identification information by issuing an instruction to the mobile terminal, wherein the identification information comprises the first identification code IMSI (IMSI, International Mobile Subscriber Identity, International Mobile Subscriber Identity) and the second identification code RNTI (Radio Network Temorary Identity, Radio Network Temorary Identity).

[0117] The image acquisition module 2 is used for acquiring the image data in the monitoring area and sending the image data to the central control console 3.

[0118] It should be noted that the monitoring area can be determined according to the actual monitoring demand, for example, it can be set at the road checkpoint position or beside the pedestrian passage, etc. The image data comprises the pedestrian image data and / or the vehicle image data. The image data can be the video stream data.

[0119] The central control console 3 is configured to acquire the mobile terminal information and the image data, determine a target image from the image data according to a collection time of the mobile terminal information, determine and mark a target position of the mobile terminal on the target image according to the signal azimuth and a first correlation relationship established in advance, extract target image feature information corresponding to the target position, and establish a correlation relationship between the target image feature information and identification information of the mobile terminal. The first correlation relationship is a correlation relationship between the signal azimuth and an image frame position. The target image feature information includes vehicle feature information and pedestrian feature information.

[0120] It should be noted that the mobile terminal information sent by the terminal positioning module 1 to the central control console 3 carries a collection time stamp. According to the time stamp, the image data corresponding to the collection time of the mobile terminal information can be determined. Therefore, after receiving the image data, the central control console 3 parses the image data to obtain video frame image data, and then determines a target image corresponding to the collection time from the video frame image data according to the collection time of the mobile terminal information, thereby preliminarily determining the target image having a correlation relationship with the mobile terminal.

[0121] The central control console 3 internally stores a correlation relationship between the signal azimuth and the image frame position. It can be understood that for the captured image of the image capturing module 2, the captured image can be divided into a preset number of image frame positions, so that each image frame position corresponds to a signal azimuth. Therefore, based on the corresponding relationship between the signal azimuth and the image frame position, the central control console 3 can determine the corresponding image frame position (i.e., the target position of the mobile terminal) according to the received signal azimuth, and mark the target position of the mobile terminal on the target image, thereby visualizing the position of the mobile terminal, so that the position of the mobile terminal can be directly determined based on the marked image. The visualization form can be in the form of a line.

[0122] Subsequently, the central control console 3 extracts target image features corresponding to the target position of the mobile terminal on the target image, and correlates the target image features with the identification information of the mobile terminal.

[0123] It can be understood that the mobile terminal is generally carried by a person or on a vehicle, so that the embodiment can preliminarily determine whether the mobile terminal is located on the vehicle or on the person after labeling the position of the mobile terminal on the target image, and the embodiment can more accurately determine the association relationship between the mobile terminal and the vehicle and / or the person by extracting the target image features corresponding to the target position of the mobile terminal and associating the target image features with the identification information of the mobile terminal, thereby solving the technical problems of low accuracy and low efficiency of person-vehicle association in the prior art, which requires deploying data collection devices at multiple points and using data at multiple points for big data collision association, and the embodiment realizes the association of "one person one code and one vehicle one code" at a single point, greatly reducing the construction cost and providing more effective, efficient and economic data support for traceability activities.

[0124] The embodiment provides a person-vehicle data processing device based on phased direction finding, which comprises: a terminal positioning module 1, which is used for acquiring mobile terminal information in a monitoring area and sending the mobile terminal information to a center console 3; the mobile terminal information comprises a signal azimuth of a mobile terminal and identification information; an image acquisition module 2, which is used for acquiring image data in the monitoring area and sending the image data to the center console 3; and the center console 3, which is used for determining a target image from the image data according to the acquisition time of the mobile terminal information, determining and labeling a target position of the mobile terminal on the target image according to the signal azimuth and a first association relationship established in advance, extracting target image feature information corresponding to the target position, and establishing an association relationship between the target image feature information and the identification information of the mobile terminal, wherein the first association relationship is an association relationship between the signal azimuth and an image frame position, and the target image feature information comprises vehicle feature information and pedestrian feature information, thereby solving the technical problems of low accuracy and low efficiency of person-vehicle association in the prior art, realizing effective monitoring of the monitoring area at a single position, efficiently realizing association processing of pedestrians, mobile terminals and vehicles passing through the monitoring area, greatly reducing the deployment cost and providing more economic and efficient technical support.

[0125] In a specific embodiment, the center console 3 is further used for acquiring a signal azimuth range covered by a full-frame image of the image acquisition module 2, dividing the image frame position of the full-frame image equally according to the signal azimuth range, establishing an association relationship between each image frame position and the signal azimuth represented by each image frame position, and obtaining the first association relationship.

[0126] In a specific embodiment, the center console 3 is further used for dividing and labeling the position area of the mobile terminal based on the target position after determining the target position of the mobile terminal.

[0127] In one specific embodiment, the identification information comprises a first identification code and a second identification code; and the terminal positioning module 1 comprises a terminal acquisition device and a phased array assembly.

[0128] The terminal acquisition device is configured to emit a radio frequency signal, and intercept the first identification information of a mobile terminal in a monitoring area.

[0129] The phased array assembly is configured to sample the radio frequency signal emitted by the mobile terminal in the monitoring area, and analyze and position the radio frequency signal to obtain the second identification information and the signal azimuth.

[0130] It should be noted that in this embodiment, the terminal positioning module 1 comprises a terminal acquisition device and a phased array assembly.

[0131] The terminal acquisition device emits a radio frequency signal through a baseband board, and intercepts the first identification code IMSI of a mobile terminal in a monitoring area.

[0132] The phased array assembly is configured to sample the radio frequency signal emitted by the mobile terminal in the monitoring area, and analyze and position the radio frequency signal to obtain the second identification information and the signal azimuth.

[0133] In this embodiment, the phased array assembly uses a spatial spectrum estimation technique to position the radio frequency signal emitted by the mobile terminal, and determines the signal azimuth of the mobile terminal.

[0134] It should be noted that for a general far-field signal, there is a wave path difference when the same signal reaches different antenna array elements. This wave path difference causes a phase difference between the receiving array elements, and the phase difference between the array elements can be used to estimate the direction of the signal, which is called the direction of arrival (DOA), i.e. the signal azimuth in this embodiment.

[0135] In this embodiment, the MUSIC algorithm in DOA is used to position the radio frequency signal emitted by the mobile terminal to obtain the signal azimuth of the mobile terminal, and the specific implementation principle is as follows:

[0136] From a geometric point of view, the observation space of signal processing can be decomposed into a signal subspace and a noise subspace, which are orthogonal. The signal subspace is composed of the eigenvectors corresponding to the signal in the data covariance matrix received by the array, and the noise subspace is composed of the eigenvectors corresponding to all the smallest eigenvalues (noise variance) in the covariance matrix. The MUSIC algorithm uses the orthogonality of the signal subspace and the noise subspace to construct a spatial spectrum function, and estimates the signal azimuth by searching for the spectral peak.

[0137] In the embodiment, the phased array assembly is arranged to measure the direction of arrival of the near-field ground mobile terminal transmitting signal, and analyze the spatial position distribution of the mobile terminal through high-precision direction finding algorithm, so as to realize the accurate correspondence between the person or vehicle in the image and the mobile terminal, make the efficient person-vehicle data processing method of "one pass, one measurement" become a reality, and improve the practicability of the person-vehicle data processing.

[0138] In one specific embodiment, referring to Figure 4 The phased array assembly includes an array antenna 13 and a terminal direction finding device 14, and the array antenna 13 is connected to the terminal direction finding device 14 through a feeder. The array antenna 13 includes a plurality of antenna elements for sampling the signals transmitted by the mobile terminal in the space of the monitoring area, and the terminal direction finding unit is used to calculate the position of the signals received by the array antenna 13 by using the MUSIC algorithm, obtain the azimuth angle of the mobile terminal, and analyze the received signals to obtain the second identification code RNTI.

[0139] In the embodiment, the terminal acquisition device and the terminal direction finding unit both use powerful DSP processors and high-performance wireless transceivers to ensure distortionless reception and low signal-to-noise ratio, so as to realize the judgment error of + / - 1° on the spatial position of the mobile terminal and realize the spatial position calculation of the target mobile terminal.

[0140] In one specific embodiment, the terminal positioning module 1 is further configured to determine whether the mobile terminal is a key target mobile terminal according to a comparison result of the identification information and the preset identification information, and if so, periodically schedule the mobile terminal and update the signal azimuth angle of the mobile terminal.

[0141] It should be noted that after the terminal acquisition device in the terminal positioning module 1 obtains the first identification code, it compares whether the first identification code is consistent with the key terminal identification code stored in the database in advance, and if so, determines that the mobile terminal is a key mobile target terminal, and periodically schedules the mobile terminal, and sends scheduling information including the second identification code corresponding to the key target mobile terminal, the scheduling time and the resource block position to the array antenna 13. The array antenna 13 analyzes the scheduling information, and according to the provisions of the communication protocol, acquires the uplink transmission signal of the key target mobile terminal at the unique time-frequency position, and through the analysis and calculation of the uplink transmission signal, obtains the direction of arrival angle of the key target mobile terminal, and sends the direction angle to the control console, so that the control console can timely mark the target position of the mobile terminal, and timely update the association relationship between the mobile terminal and the vehicle or the pedestrian.

[0142] The resource block position refers to the resource position information allocated on a carrier, which is identified by two dimensions of time slots and frequency domain. A resource block (Resource Block) is composed of 12 subcarriers in the frequency domain and 7 OFDM symbols in the time domain.

[0143] Generally, when the mobile terminal accesses the terminal collection device, the terminal collection device issues an instruction to the mobile terminal, so that the mobile terminal reports the first identification code. After receiving the first identification code, the terminal collection device issues a disconnection instruction, so that the mobile terminal returns to the public network. In the embodiment, after the terminal collection device monitors the online of the target mobile terminal, the terminal collection device performs periodic signaling communication with the target mobile terminal within the signaling communication timeout protection period, so that the target mobile terminal always remains in the non-disconnection state, thereby realizing long-time scheduling and monitoring of the target mobile terminal. Meanwhile, the terminal collection device sends the scheduling information of each scheduling to the array antenna 13, so that the array antenna 13 obtains the radio frequency information of the target mobile terminal in time, and the terminal direction finding unit determines the direction of arrival of the mobile terminal in time, thereby realizing the updating of the position of the target mobile terminal.

[0144] In a preferred embodiment, the terminal collection device can schedule multiple mobile terminals at the same time, and when interacting with the mobile terminal, the terminal collection device locks the mobile terminal at the physical layer according to the communication protocol, so that only one mobile terminal interacts in a time-frequency unit, thereby enabling the terminal direction finding unit to measure the position of the mobile terminal in a time-frequency unit.

[0145] In another preferred embodiment, the terminal collection device is used to schedule a preset number of mobile terminals in parallel, and the phased array assembly is used to measure the signal azimuth angle of multiple mobile terminals in parallel.

[0146] It should be noted that, in order to further improve the efficiency of processing the data of the person and the vehicle, in the embodiment, the terminal collection device supports scheduling multiple mobile terminals in parallel at the same time, and the phased array assembly measures the signal azimuth angle of multiple mobile terminals in parallel.

[0147] In the embodiment, the preset number is preferably 32.

[0148] In another preferred embodiment, when the number of mobile terminals online in the monitoring area exceeds the preset monitoring number, the terminal collection device preferentially schedules the target mobile terminal and filters the non-target mobile terminal.

[0149] It should be noted that when the number of mobile terminals online in the monitoring area exceeds the preset monitoring number, the scheduling efficiency of the terminal collection device is easily affected, which causes the target to be not scheduled in time and to be disconnected. In the embodiment, by setting the priority, the target mobile terminal is preferentially scheduled, so that 32 target mobile terminals can be scheduled at the same time without being disconnected.

[0150] In another preferred embodiment, the central control console 3 is further configured to extract all pedestrian feature information and vehicle feature information in the target image, and establish a mobile terminal file by using the labeled target image, the mobile terminal information, the association between the target image feature information and the identification information of the mobile terminal, and all the pedestrian feature information and vehicle feature information in the target image.

[0151] In the embodiment, when extracting all the pedestrian feature information in the target image, the human body attributes in the target image are detected, all the human bodies in the target image are detected and the rectangular frame position of each human body is returned, and multiple attributes of the human body are identified, including gender, age stage, clothing (including category / color), whether wearing a hat, whether wearing glasses, whether carrying a backpack, whether using a mobile terminal, body orientation, etc. When the human face cannot be extracted, the human body attributes are used as the pedestrian information for filing.

[0152] When extracting all the vehicle feature information in the target image, all the vehicles in the target image are detected and the type and attributes of the vehicle are returned, the vehicle type identification is realized, and multiple appearance attributes of the vehicle identification are identified, including vehicle window rain eyebrow, roof rack, vehicle body color, special vehicle type, etc. When the license plate cannot be extracted, the temporary vehicle attributes are used as the vehicle information for filing.

[0153] The embodiment establishes the mobile terminal file by using the labeled target image, the mobile terminal information, the association between the target image feature information and the identification information of the mobile terminal, and all the pedestrian feature information and vehicle feature information in the target image, which is more convenient for data management, traceability and correction.

[0154] It can be understood that in the embodiment, the above-mentioned filing is performed on each mobile terminal collected, so as to form a "one file per terminal" for data management.

[0155] In a specific embodiment, referring to Figure 4 , the terminal collection device includes a terminal collection device body 12 and a terminal collection antenna 11, wherein the terminal collection antenna 11 is connected to the terminal collection device body 12 through a feeder and serves as a signal transceiver end of the terminal collection device body 12.

[0156] The terminal collection device body 12 includes a full-standard baseband signal board, a power amplifier module, and a network board.

[0157] In a specific embodiment, the terminal direction finding device 14 includes a radio frequency transceiver unit, a signal processing unit, and a logic processing unit.

[0158] In a specific embodiment, referring to Figure 3 and Figure 4The human-vehicle data processing device further comprises a box 4;

[0159] The terminal positioning module 1 and the image acquisition module 2 are embedded in the box 4.

[0160] It should be noted that when the installation site is small, the terminal positioning module 1 and the image acquisition module 2 are arranged in the box 4, and the terminal positioning module 1, the image acquisition module 2 and the central control console 3 are remotely connected in communication.

[0161] As shown in Figure 4 , the terminal acquisition antenna 11 is fixed to the upper left corner of the box 4, the array antenna 13 is arranged at the lower left corner of the box 4, the image acquisition module 2 is arranged at the right end of the terminal acquisition antenna 11, the terminal acquisition device body 12 is arranged at the upper right in the box 4, and the terminal direction finding device 14 is arranged below the terminal acquisition device body 12.

[0162] In another specific embodiment, referring to Figure 3 and Figure 5 , the terminal positioning module 1, the image acquisition module 2 and the central control console 3 are embedded in the box 4.

[0163] It should be noted that when the installation site allows, the central control console 3 is arranged in the box 4. In this embodiment, by embedding the central control console 3 in the box 4, the stability of data transmission between the central control console 3 and the terminal acquisition device, the phased array assembly and the image acquisition module 2 is improved.

[0164] In one specific embodiment, referring to Figure 4 - Figure 6 , the back of the terminal acquisition device body 12 and the terminal direction finding device 14 are both provided with a mounting panel 5, and the mounting panel 5 is connected with the box 4 through a screw assembly.

[0165] It should be noted that the mounting panel 5 comprises a panel body 6 and a mechanical hook 6. The terminal acquisition device body 12 and the terminal direction finding device 14 are both provided with a mounting position 7 as shown in Figure 6 , the mechanical hook 6 is connected with the mounting position 7 at the back of the terminal acquisition device body 12 for mounting the terminal acquisition device body 12, and the panel body 6 is fixed in the box 4 through a screw assembly, wherein the screw assembly comprises a plurality of screws 8. An effect diagram of the back mounting is shown in Figure 7 .

[0166] In one specific embodiment, referring to Figure 5 - Figure 6 , the bottom of the image acquisition module 2 is provided with a mounting panel 5, and the mounting panel 5 is connected with the box 4 through a screw assembly.

[0167] It should be noted that the mounting mode of the image acquisition module 2 in this embodiment can refer to the previous embodiment.

[0168] In a specific embodiment, referring to Figure 5 Figure 6 The back of the center console 3 is provided with a mounting panel 5, which is connected with the box body 4 through a screw assembly.

[0169] It should be noted that the mounting mode of the center console 4 can refer to the previous embodiment.

[0170] In a specific embodiment, referring to Figure 8 The box body 4 is provided with a first heat dissipation hole 9 and a second heat dissipation hole 10;

[0171] The position of the first heat dissipation hole 9 corresponds to the position of the terminal acquisition device body 12;

[0172] The position of the second heat dissipation hole 10 corresponds to the position of the terminal direction finding device 14.

[0173] In a specific embodiment, the top and bottom of the box body 4 are provided with mounting holes.

[0174] It should be noted that the top and bottom of the box body 4 in this embodiment are each provided with 4 mounting holes (not shown in the figure). When the box body 4 is installed, it can be fixed through the mounting holes.

[0175] Please refer to Figure 10 , Figure 10 A flowchart of a debugging method of a vehicle and pedestrian data processing device based on phased array direction finding provided by the fourth embodiment of the present application.

[0176] The fourth embodiment of the present application provides a debugging method of a vehicle and pedestrian data processing device based on phased array direction finding, which is applied to the vehicle and pedestrian data processing device of the third embodiment, and the method comprises:

[0177] 301, using a signal transmitter and a preset debugging scheme to perform associated debugging on the phased array components in the image acquisition module and the terminal positioning module, to obtain associated parameters of the image acquisition module and the phased array components; the associated parameters include position parameters of the phased array components, position parameters and camera parameters of the image acquisition module;

[0178] It should be noted that before using the vehicle and pedestrian data processing device to acquire mobile terminal information and image data in the monitoring area, the signal transmitter and the preset debugging scheme are used to perform associated debugging on the phased array components in the image acquisition module and the terminal positioning module.

[0179] The preset debugging scheme comprises the following steps: ​

[0180] S1: Based on the preset monitoring range requirements, determine the debugging positions of the image acquisition module and the phased array component, and fix the image acquisition module and the phased array component at the debugging positions.

[0181] It should be noted that the debugging location can be the actual monitoring area or a microwave anechoic chamber. This embodiment selects a microwave anechoic chamber as the debugging location to avoid interference from invalid signals such as radio wave reflection and diffraction, thereby improving the accuracy of debugging.

[0182] Different monitoring scenarios correspond to different monitoring range requirements. For example, when the application scenario is road monitoring, the required monitoring area range can be 10m or 20m. During debugging, based on the monitoring range requirements, the position of the phased array components is adjusted so that the distance between the phased array components and the signal transmission position is consistent with the monitoring range.

[0183] See Figure 12 The microwave anechoic chamber was marked with the signal transmission positions corresponding to each signal azimuth angle. In order to improve the accuracy of the test, when setting the position of the phased array component, the phased array component was aligned with the signal transmission position corresponding to the 0° signal azimuth angle, and the straight-line distance between the phased array component and the signal transmission position was adjusted so that the distance between the two was consistent with the monitoring area. Then the phased array component was fixed, and it was ensured that there were no obstructions around the array antenna in the phased array component.

[0184] After fixing the position of the phased array components, initially fix the position of the image acquisition module to ensure that the image acquisition module's display is clear and not obstructed by the internal components of the enclosure.

[0185] It should be noted that the fixed position of the phased array component and the image acquisition module in this embodiment refers to fixing them inside the housing in Embodiment 3.

[0186] S2: Adjust the shooting position of the center of the image of the image acquisition module and the size of the full frame, so that the center of the image of the image acquisition module is aligned with the signal transmission position corresponding to the 0° signal azimuth angle, and the number of image positions of the full frame meets the preset number requirements;

[0187] It should be noted that the signal azimuth angle range that the human-vehicle data processing device can monitor is +45° to -45°. To better determine the signal azimuth angle corresponding to each image position, during debugging, the center of the image acquisition module's screen is aligned with the signal transmission position corresponding to the 0° signal azimuth angle. Then, by adjusting camera parameters such as the camera's focal length, the full-frame size of the image acquisition module is adjusted so that the full frame can be divided into 90 image positions, with each image position corresponding to a signal azimuth angle.

[0188] Different focal lengths will change the size of the image capture module, resulting in a change in the number of image positions in the full frame. Therefore, by adjusting the camera parameters multiple times, the center of the image capture module is aligned with the signal emission position corresponding to the 0° signal azimuth angle, and the number of image positions in the full frame is 90, so that each image position corresponds to a signal azimuth angle.

[0189] As shown in FIG. 1, when adjusting the center of the image capture module, the signal transmitter can be first set at the signal emission position corresponding to the 0° signal azimuth angle. When the image capture module is shooting, the frame will prompt the position of the center of the image. Therefore, based on the prompt of the frame position, the shooting angle and direction of the image capture module are adjusted so that the signal transmitter is in the center of the frame. Figure 11

[0190] In another preferred embodiment, the range of monitorable signal azimuth angles can also be determined in advance according to the monitoring area, and the number of divided image positions is determined according to the range of signal azimuth angles, and the camera parameters of the image capture module are adjusted according to the number of divisions. Therefore, the range of signal azimuth angles for debugging can not be limited to +45° to -45°.

[0191] S3: setting the signal transmitter at the signal emission position corresponding to the 0° signal azimuth angle, controlling the signal transmitter to emit radio frequency signals, and calculating the first difference value between the first signal azimuth angle output by the phased array assembly and the 0° signal azimuth angle;

[0192] It should be noted that the position adjustment of the signal transmitter can be manually adjusted by hand or automatically adjusted by using the central control console and the corresponding motor drive mechanism. When controlling the signal transmitter, the signal transmitter can be manually started by hand to emit radio frequency signals, or the central control console can send control instructions to the signal transmitter to make the signal transmitter emit radio frequency signals according to the received control instructions.

[0193] The phased array assembly receives the radio frequency signals emitted by the signal transmitter and calculates based on the radio frequency signals to output the first signal azimuth angle. The first difference value is the difference between the first signal azimuth angle and the 0° signal azimuth angle.

[0194] S4: adjusting the position of the signal transmitter to the position corresponding to the next preset angle, controlling the signal transmitter to emit radio frequency signals, and calculating the second difference value between the second signal azimuth angle output by the phased array assembly and the preset angle.

[0195] ​It should be noted that, according to the corresponding signal emission position of the signal azimuth angle marked in the microwave darkroom, the next signal azimuth angle can be selected in the order from small to large or from large to small or in random order, etc., the position of the signal emitter is adjusted to the signal emission position corresponding to the next signal azimuth angle, debugging is performed, and the debugged signal azimuth angle, the difference between the debugged signal azimuth angle and the signal azimuth angle output by the phased array component are recorded.

[0196] S5: repeatedly performing step S4 until testing of all preset angles is completed, and jumping to perform step S6;

[0197] S6: if the first difference and each second difference meet the preset deviation range requirement, the current correlation debugging is successful, and the position parameters of the phased array component, the position parameters of the image acquisition module and the camera parameters are saved.

[0198] It should be noted that the signal azimuth angle measured and calculated by the phased array component may have a deviation, and if the obtained difference is within the allowable deviation range, the deviation is considered negligible, the correlation debugging is successful, and the current position parameters of the phased array component, the position parameters of the image acquisition module and the camera parameters of the image acquisition module are recorded.

[0199] The position parameters of the phased array component include the specific position area of the phased array component in the box body, the orientation of the array antenna, etc. The position parameters of the image acquisition module include the specific position area of the image acquisition module in the box body, the shooting angle of the lens, etc., and the camera parameters include the focal length, etc.

[0200] 302, according to the correlation parameters, fix the position of the phased array component, the position of the image acquisition module and the camera mode, and set the fixed phased array component and the image acquisition module in the monitoring area.

[0201] It should be noted that after the debugging is completed, according to the correlation parameter value of step 301, the phased array component is fixed on the position in the box body corresponding to the position parameter of the phased array component, the image acquisition module is fixed on the position in the box body corresponding to the position parameter of the image acquisition module, and the camera mode of the image acquisition module is adjusted according to the camera parameter. Then, the adjusted phased array component and image acquisition module and other devices of the vehicle data processing module are set in the monitoring area for monitoring application, thereby building the correlation relationship between the image acquisition module and the terminal positioning module at the physical layer, and providing hardware layer support for the establishment of the first correlation relationship.

[0202] The embodiment provides a debugging method of a vehicle-person data processing device based on phased direction finding, which comprises the following steps: performing associated debugging on a phased array component in an image acquisition module and a terminal positioning module by using a signal transmitter and a preset debugging scheme, so as to obtain associated parameters of the image acquisition module and the phased array component; the associated parameters comprise position parameters of the phased array component, position parameters and photographing parameters of the image acquisition module; according to the associated parameters, the position of the phased array component, the position of the image acquisition module and a photographing mode are fixed, and the fixed phased array component and the image acquisition module are arranged in a monitoring area, so that the terminal positioning module and the image acquisition module are associated at a hardware level, technical support is provided for establishing a first associated relationship of a central control console, and a hardware technical foundation is established for improving the efficiency of vehicle-person associated processing.

[0203] In another preferred embodiment, the step S6 further comprises the following steps:

[0204] When the first difference exceeds the preset deviation range, a first compensation value of the first signal azimuth angle is calculated according to the first difference, and the sum of the first signal azimuth angle and the first compensation value is taken as the actual value corresponding to the first signal azimuth angle.

[0205] When the second difference exceeds the preset deviation range, a second compensation value of the second signal azimuth angle is calculated according to the second difference, and the sum of the second signal azimuth angle and the second compensation value is taken as the actual value corresponding to the second signal azimuth angle.

[0206] It should be noted that when the first difference or the second difference exceeds the preset deviation range, it indicates that the measurement of the phased array component has deviation, therefore, the corresponding compensation value is calculated to compensate for the deviation in the measurement of the phased array component, so as to improve the processing accuracy of the vehicle-person data processing method. The calculation method can be that the obtained difference is taken as the compensation value, that is, the actual value corresponding to the first signal azimuth angle is obtained by superimposing the difference on the basis of the first signal azimuth angle, and the actual value is taken as the final output signal azimuth angle of the phased array component.

[0207] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the system, device and unit described above can refer to the corresponding processes in the foregoing method embodiments, which will not be described herein.

[0208] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other manners. For example, the described apparatus embodiments are merely illustrative, and the division of the units can be different from the above. For example, the units can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0209] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0210] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each functional unit can be a physically independent unit, or two or more functional units can be integrated into a processing unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0211] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application, essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various program codes that can be stored in the medium.

[0212] The terms "first", "second", "third", "fourth" and the like in the description of this application and in the claims, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the use of these terms herein is to be construed to cover a generalised use of these terms to refer to similar elements independently of each other. It is to be understood that the data used herein can be interchanged, where appropriate, without departing from the scope of the application described herein. Furthermore, the terms "comprise", "comprising", "comprises" and "comprising" and any variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or units uses "comprising" is not necessarily limited to only those steps or units in the list, but can include additional steps or units not expressly listed or inherent to such process, method, article, or apparatus.

[0213] The above embodiments are only used to illustrate the technical solutions of the present application, not limit the present application; even though the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalent features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A vehicle data processing method based on phase control direction finding, characterized in that, The method comprises: acquiring mobile terminal information and image data in a monitoring area; the mobile terminal information comprises signal azimuth and identification information of the mobile terminal; determining a target image from the image data according to the acquisition time of the mobile terminal information; determining and marking a target position of the mobile terminal on the target image according to the signal azimuth and a first correlation relationship established in advance; the first correlation relationship is the correlation relationship between the signal azimuth and the image screen position; extracting target image feature information corresponding to the target position, and establishing the correlation relationship between the target image feature information and the identification information of the mobile terminal; the target image feature information comprises vehicle feature information and / or pedestrian feature information; the image data is acquired by an image acquisition module, and the establishment of the first correlation relationship comprises: acquiring a signal azimuth range covered by a full-frame screen of the image acquisition module; equally dividing the image screen position of the full-frame screen according to the signal azimuth range, establishing the correlation relationship between each image screen position and the signal azimuth represented by each image screen position, and obtaining the first correlation relationship.

2. The method of claim 1, wherein, The method further comprises: judging whether the mobile terminal is a key target mobile terminal according to the comparison result of the identification information and preset identification information, and periodically scheduling the mobile terminal and updating the signal azimuth of the mobile terminal if the mobile terminal is a key target mobile terminal.

3. The method of claim 1, wherein, After determining and marking the target position of the mobile terminal on the target image according to the signal azimuth and the first correlation relationship established in advance, the method further comprises: dividing and marking the position area of the mobile terminal based on the target position.

4. The method of claim 1, wherein, When the image area corresponding to the target position is a vehicle image area, the step of extracting the target image feature information corresponding to the target position and establishing the correlation relationship between the target image feature information and the identification information of the mobile terminal comprises: performing binaryzation on the vehicle image area corresponding to the target position by using a gray level transition feature method to obtain a binaryzation image; determining a license plate position from the binaryzation image, and performing character segmentation and recognition operations on the image area corresponding to the license plate position to obtain license plate information; establishing the correlation relationship between the license plate information and the identification information of the mobile terminal; when the extracted license plate information is empty, extracting vehicle attribute information from the vehicle image area corresponding to the target position; establishing the correlation relationship between the vehicle attribute information and the identification information of the mobile terminal; the vehicle attribute information comprises vehicle type, vehicle window rain eyebrow information, vehicle roof rack information, and vehicle body color.

5. The method of claim 1, wherein, When the image area corresponding to the target position is a pedestrian image area, the step of extracting the target image feature information corresponding to the target position and establishing the correlation relationship between the target image feature information and the identification information of the mobile terminal comprises: extracting face feature information of the image area corresponding to the target position; matching the face feature information and a pre-stored face feature template, and outputting a matching result; establishing the correlation relationship between the matching result and the identification information of the mobile terminal. When the facial feature information is empty, human body attribute information corresponding to the target position is extracted, and an association between the human body attribute information and the identification information of the mobile terminal is established; the human body attribute includes gender, age stage, clothing type, clothing color, body orientation, and personal belongings.

6. A vehicle data processing apparatus based on phase control direction finding, characterized by The device comprises: a terminal positioning module for collecting mobile terminal information in a monitoring area and sending the mobile terminal information to a central control console; the mobile terminal information includes a signal azimuth angle and identification information of the mobile terminal; an image collection module for collecting image data in the monitoring area and sending the image data to the central control console; the central control console for obtaining the mobile terminal information and the image data, determining a target image from the image data according to the collection time of the mobile terminal information, determining and marking a target position of the mobile terminal on the target image according to the signal azimuth angle and a first association previously established, extracting target image feature information corresponding to the target position, and establishing an association between the target image feature information and the identification information of the mobile terminal; the first association is an association between the signal azimuth angle and an image frame position, and the target image feature information includes vehicle feature information and pedestrian feature information; the central control console is further configured to obtain a signal azimuth angle range covered by a full-frame image of the image collection module, divide the image frame position of the full-frame image equally according to the signal azimuth angle range, establish an association between each image frame position and the signal azimuth angle represented by each image frame position, and obtain the first association.

7. The apparatus of claim 6, wherein, The terminal positioning module is further configured to determine whether the mobile terminal is a key target mobile terminal according to a comparison result of the identification information and a preset identification information, periodically schedule the mobile terminal if the mobile terminal is a key target mobile terminal, and update the signal azimuth angle of the mobile terminal.

8. A debugging method of a vehicle data processing device based on a phase control direction finding, characterized by, The method is applied to the device of any one of claims 6-7, and the method comprises: associating and debugging a phased array component in the image collection module and the terminal positioning module by using a signal transmitter and a preset debugging scheme, obtaining an association parameter of the image collection module and the phased array component; the association parameter includes a position parameter of the phased array component, a position parameter and a camera parameter of the image collection module; fixing the position of the phased array component, the position of the image collection module, and the camera mode according to the association parameter, and setting the fixed phased array component and the image collection module in a monitoring area.

Images