Data processing method and device for dynamic monitoring

Abstract

The invention discloses a data processing method and device for dynamic monitoring. The method comprises the following steps: acquiring to-be-processed video stream data, wherein the to-be-processed video stream data is video stream data used for representing dynamic monitoring of a camera; performing panorama construction processing based on frame extraction on the to-be-processed video stream data to obtain panorama data; when the camera motion information is received, obtaining motion monitoring data; the motion monitoring data and the panorama data are subjected to region calibration processing based on feature matching, target calibration region data are obtained, and the target calibration region data are data used for representing a calibration region in the motion monitoring data. According to the invention, the panorama of the monitoring area of the camera is constructed, the motion information of the camera is monitored, and when the motion of the camera is detected, the image currently acquired by the camera is matched with the panorama, so that the calibration area existing in the currently acquired image is realized, and the dynamic area calibration in the non-fixed scene is realized.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a data processing method and device for dynamic monitoring. Background Art

[0002] Border control is mainly regional control. There are different control requirements for the same category of targets appearing in different areas. For example, if ordinary people appear in our control area, we will not pay attention to them, but if people appear in the area in front of us, we need to track and alarm. Common border crossings in border control can be classified as regional entry, detention or exit detection.

[0003] Regional control is a major application in border monitoring scenarios. For fixed-position cameras such as gun cameras, regional calibration is relatively mature and widely used. However, in border control, due to the early construction period, a large number of cameras were built for manual monitoring. During use, the camera movement and zooming are controlled by manually operating the pan / tilt. During use, the camera orientation and scene content will change, so the regional calibration method based on fixed scenes cannot be directly applied.

[0004] This application is proposed to address the problems existing in the prior art. Summary of the invention

[0005] The main purpose of the present application is to provide a data processing method and device for dynamic monitoring to solve at least one of the above-mentioned problems.

[0006] In order to achieve the above-mentioned purpose, in a first aspect of the present application, a data processing method for dynamic monitoring is proposed, comprising:

[0007] Acquire the video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera;

[0008] Performing frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of a monitoring area;

[0009] When the camera motion information is received, motion monitoring data is acquired, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operation information;

[0010] The motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent a calibration region in the motion monitoring data.

[0011] Furthermore, the motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching, and the target calibration region data obtained includes:

[0012] Performing positioning processing based on key point matching on the motion monitoring data and the panoramic image data to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0013] Matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data for representing the calibration area corresponding to the panoramic relative position in the panoramic image;

[0014] The motion monitoring data is subjected to calibration area mapping processing according to the process calibration area data to obtain the target calibration area data.

[0015] Furthermore, the motion monitoring data and the panoramic image data are subjected to positioning processing based on key point matching to obtain panoramic relative position data including:

[0016] Performing image feature detection processing on the motion monitoring data and the panoramic view data respectively, to obtain first image feature data and second image feature data respectively, wherein the first image feature data is used to represent image feature data in the motion monitoring data, and the second image feature data is used to represent image feature data in the panoramic view;

[0017] Performing feature point matching on the first image feature data and the second image feature data to obtain matching feature point pair data, wherein the matching feature point pair data is data for representing matching feature point pairs in the first image feature data and the second image feature data;

[0018] The panoramic image data and the motion monitoring data are subjected to image mapping processing according to the matching feature point pair data to obtain the panoramic relative position data.

[0019] Furthermore, the panorama data to be processed is processed based on frame extraction to obtain the panorama data including:

[0020] Performing frame extraction processing on the video stream data to be processed with overlapping image features to obtain a plurality of spliced ​​image data;

[0021] Performing a panoramic image construction process based on image stitching on the plurality of stitched image data to obtain process stitched image data;

[0022] The process stitching image data is subjected to a region calibration process to obtain the panoramic image data, wherein the panoramic image data includes data for representing a calibration region and a panoramic image.

[0023] Furthermore, the process stitching image data is subjected to regional calibration processing to obtain the panoramic image data, including:

[0024] Acquiring regional calibration requirement data, wherein the regional calibration requirement data is requirement data for indicating regional calibration;

[0025] Performing identification processing on the regional calibration demand data based on regional monitoring characteristics to obtain regional monitoring characteristic data;

[0026] Performing a region matching process based on the region monitoring feature data on the process stitching image data to obtain panoramic calibration region data, wherein the panoramic calibration region data is data used to represent a region corresponding to the region monitoring feature data;

[0027] The panoramic image data is obtained according to the panoramic calibration area data and the process stitching image data.

[0028] Furthermore, after performing region calibration processing based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data, the method further includes:

[0029] Performing target detection processing on the motion monitoring data to obtain motion target data, wherein the motion target data is data used to represent the motion target present in the motion monitoring data;

[0030] Matching a target monitoring algorithm corresponding to the target calibration area data in a preset dynamic monitoring database;

[0031] The moving target data is subjected to target behavior analysis processing based on the target monitoring algorithm to obtain behavior analysis result data.

[0032] According to a second aspect of the present application, a data processing method for dynamic monitoring is proposed, comprising:

[0033] A data acquisition module, used to acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera;

[0034] A panoramic construction module, used for performing a panoramic image construction process based on frame extraction on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of a monitoring area;

[0035] A motion monitoring module, used for acquiring motion monitoring data when receiving camera motion information, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operation information;

[0036] The dynamic area calibration module is used to perform area calibration processing on the motion monitoring data and the panoramic image data based on feature matching to obtain target calibration area data, wherein the target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0037] Furthermore, the dynamic area calibration module includes:

[0038] A positioning and matching module, used for performing positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0039] A calibration area matching module, used to match the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data used to represent the calibration area corresponding to the panoramic relative position in the panoramic image;

[0040] The calibration area mapping module is used to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

[0041] According to a third aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the above-mentioned data processing method for dynamic monitoring.

[0042] According to the fourth aspect of the present application, an electronic device is proposed, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor executes the above-mentioned data processing method for dynamic monitoring.

[0043] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0044] In the present application, the video stream data to be processed is obtained, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of the camera; the video stream data to be processed is subjected to a panoramic image construction process based on frame extraction to obtain panoramic image data, wherein the panoramic image data is data used to represent a panoramic image of the monitoring area; when the camera motion information is received, the motion monitoring data is obtained, wherein the motion monitoring data is used to represent the monitoring image data collected by the camera under the operation information; the motion monitoring data and the panoramic image data are subjected to a region calibration process based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent the calibration region in the motion monitoring data. By constructing a panoramic image of the camera monitoring area and monitoring the camera's motion information, when the camera motion is detected, the image currently collected by the camera is matched with the panoramic image to realize the calibration region existing in the currently collected image, thereby realizing the calibration of dynamic regions in non-fixed scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings constituting a part of this application are used to provide a further understanding of this application, so that other features, purposes and advantages of this application become more obvious. The schematic embodiment drawings and their descriptions of this application are used to explain this application and do not constitute an improper limitation on this application. In the drawings:

[0046] Figure 1 A flowchart of a data processing method for dynamic monitoring provided by the present application;

[0047] Figure 2 A flowchart of a data processing method for dynamic monitoring provided by the present application;

[0048] Figure 3 A flowchart of a data processing method for dynamic monitoring provided by the present application;

[0049] Figure 4 A schematic diagram of a data processing device for dynamic monitoring provided by the present application;

[0050] Figure 5 A schematic diagram of another data processing device for dynamic monitoring provided in the present application. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] In the present application, the terms "upper", "lower", "left", "right", "front", "back", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the drawings. These terms are mainly used to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to have a specific orientation, or to be constructed and operated in a specific orientation.

[0054] In addition, some of the above terms may be used to express other meanings in addition to indicating orientation or positional relationship. For example, the term "on" may also be used to express a certain dependency or connection relationship in some cases. For those of ordinary skill in the art, the specific meanings of these terms in this application can be understood according to specific circumstances.

[0055] In addition, the terms "installed", "set", "provided with", "connected", "connected", and "socketed" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral structure; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be an internal connection between two devices, elements, or components. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0056] Regional control is a major application method in border monitoring scenarios. For fixed-position cameras such as gun cameras, regional calibration is relatively mature and widely used. After the camera moves, the camera orientation and scene content will change, and the regional calibration method based on fixed scenes cannot be directly applied. Alarms in specific areas usually require the use of fixed cameras. Once the camera is moved or rotated, the predetermined area will become invalid, resulting in the failure of alarms in specific areas; fixed surveillance cameras need to be manually rotated to observe other areas or monitor other areas; surveillance cameras in many places are movable cameras that can be operated by multiple people. After the camera is rotated, the previously calibrated area information becomes invalid. Adding fixed cameras is too costly and not very practical. In view of the above-mentioned problems existing in the prior art, this application is proposed.

[0057] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 1 A flowchart of a data processing method for dynamic monitoring provided in this application, such as Figure 1 As shown, the method comprises the following steps:

[0058] S101: Obtaining video stream data to be processed;

[0059] The video stream data to be processed is video stream data used to represent dynamic monitoring of the camera. The video stream data to be processed is used to control the rotation of the camera and collect panoramic continuous video stream data within the visible range during the rotation of the camera.

[0060] S102: performing frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data;

[0061] The panoramic data is data used to represent a panoramic view of a monitoring area, and includes a panoramic image within the visible range of a camera and data of a marked area in the panoramic image.

[0062] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 2 A flowchart of a data processing method for dynamic monitoring provided in this application, such as Figure 2 As shown, the method comprises the following steps:

[0063] S201: performing frame extraction processing on the video stream data to be processed with overlapping image features to obtain a plurality of spliced ​​image data;

[0064] The processed video stream data is subjected to image extraction processing. During the image extraction process, the processed video stream data is identified to obtain multiple video frame data. The multiple video frame data are subjected to overlap judgment processing to calculate the image overlap of adjacent extracted video frames. When the image overlap of the adjacent extracted video frames meets the frame extraction requirement, the adjacent extracted frames meet the frame extraction requirement, and multiple spliced ​​image data are obtained. The multiple spliced ​​image data are used to represent the above multiple adjacent extracted frames that meet the frame extraction requirement. For example, the processed video stream data is subjected to first frame extraction processing. Based on the first frame, the video frames whose image overlap with the first frame meets the preset frame extraction requirement are screened in the video stream data, and the video frames are subjected to extraction processing to obtain the second frame. The above frame extraction operation is repeated based on the second frame to obtain multiple spliced ​​image data, wherein the frame extraction requirement can be that the image overlap of adjacent extracted video frames is a preset value, or that the image overlap of adjacent extracted video frames is within a preset range. If the frame extraction requirement is that the image overlap of adjacent extracted video frames is within a preset range, a first frame extraction process is performed on the video stream data to be processed, and based on the first frame, video frames with image overlap within the preset range are screened to obtain multiple process first extracted video frames, and the above frame extraction process is repeated for the above multiple process first extracted video frames to obtain multiple process extracted video frames, and image overlap calculation processing based on adjacent extracted video frames is performed on the multiple process extracted video frames, and adjacent extracted video frames that meet the preset image overlap range are screened to obtain multiple stitched image data.

[0065] S202: performing a panoramic image construction process based on image stitching on a plurality of stitched image data to obtain process stitched image data;

[0066] A panoramic image within the visual range of the surveillance camera is generated using a panoramic generation algorithm.

[0067] S203: performing regional calibration processing on the process stitching image data to obtain panoramic image data.

[0068] The panoramic image data includes data representing a calibration area and a panoramic image.

[0069] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, comprising:

[0070] Acquire regional calibration requirement data, which is requirement data for representing regional calibration; perform recognition processing on the regional calibration requirement data based on regional monitoring features to obtain regional monitoring feature data; perform regional matching processing on the process stitching image data based on the regional monitoring feature data to obtain panoramic calibration region data, which is data for representing the region corresponding to the regional monitoring feature data; obtain panoramic image data based on the panoramic calibration region data and the process stitching image data.

[0071] In an optional embodiment of the present application, the process stitching image data is subjected to a regional matching process based on the regional monitoring feature data, including: performing semantic recognition processing on the process stitching image data to obtain a plurality of image semantic feature data; matching the plurality of image semantic feature data with the regional monitoring feature, and if there is a match between the image semantic feature data and the regional monitoring feature, performing a calibration process on the stitching image region corresponding to the image semantic feature data to obtain panoramic calibration region data. The process stitching image is subjected to a calibration process based on object capture, including: performing an action recognition process on the regional calibration requirement data to identify the position corresponding to the calibration action, according to the image position of the process stitching image corresponding to the calibration action position, identifying the image feature corresponding to the image position, and performing a calibration process on the process stitching image according to the image feature and the image position to obtain panoramic calibration region data.

[0072] S103: When camera motion information is received, motion monitoring data is obtained;

[0073] Motion monitoring data is used to represent monitoring image data collected by the camera under operation information;

[0074] S104: performing region calibration processing based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data.

[0075] The target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0076] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 3 A flowchart of a data processing method for dynamic monitoring provided in this application, such as Figure 3 As shown, the method comprises the following steps:

[0077] S301: performing positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data;

[0078] The panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic view;

[0079] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, comprising:

[0080] The motion monitoring data and the panoramic view data are respectively subjected to image feature detection processing to obtain first image feature data and second image feature data, wherein the first image feature data is used to represent the image feature data in the motion monitoring data, and the second image feature data is used to represent the image feature data in the panoramic view; the first image feature data and the second image feature data are subjected to feature point matching to obtain matching feature point pair data, wherein the matching feature point pair data is data used to represent the matching feature point pairs in the first image feature data and the second image feature data; image mapping processing is performed on the panoramic view data and the motion monitoring data according to the matching feature point pair data to obtain panoramic relative position data.

[0081] In an optional embodiment of the present application, a key point matching algorithm is used to match the position of the current image in the panoramic image; the calibration area information of the current image is determined according to the calibration area information of the panoramic image. For example, the homography matrix is ​​estimated using the matched feature points, the image is transformed and mapped according to the homography matrix, and the calibration area in the panoramic image is mapped to the current image, thereby determining the calibration area parameters of the current image. For example, the SIFT algorithm is used to detect key feature points in the current image and the panoramic image, and their descriptors are calculated; the FALNN algorithm is used to quickly find the feature point pairs of the two images; the correct matching point pairs are screened out through the RANSAC algorithm, and the screened matching point pairs are used to calculate the homography matrix between the two images, that is, the transformation matrix that maps one image to another image; according to the calculated transformation matrix, the global calibration area in the panoramic image is mapped to the corresponding area of ​​the current image, and the corresponding coordinate information of the calibration area in the current image is obtained.

[0082] S302: Matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data;

[0083] The process calibration area data is data used to represent the calibration area corresponding to the relative position of the panorama in the panorama;

[0084] S303: Perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain target calibration area data.

[0085] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, comprising: after performing a region calibration process based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data, the method further comprises:

[0086] Perform target detection processing on the motion monitoring data to obtain motion target data, wherein the motion target data is data used to represent the motion target existing in the motion monitoring data; match the target monitoring algorithm corresponding to the target calibration area data in a preset dynamic monitoring database; perform target behavior analysis processing on the motion target data based on the target monitoring algorithm to obtain behavior analysis result data.

[0087] In some optional embodiments of the present application, a data processing device for dynamic monitoring is proposed. Figure 4 A data processing device for dynamic monitoring provided by the present application, such as Figure 4 As shown, the device comprises:

[0088] The data acquisition module 41 is used to acquire the video stream data to be processed, wherein the video stream data to be processed is the video stream data used to represent the dynamic monitoring of the camera;

[0089] A panorama construction module 42, used for performing a panorama construction process based on frame extraction on the video stream data to be processed to obtain panorama data, wherein the panorama data is data for representing a panorama of a monitoring area;

[0090] The motion monitoring module 43 is used to obtain motion monitoring data when receiving the camera motion information, wherein the motion monitoring data is used to represent the monitoring image data collected by the camera under the operation information;

[0091] The dynamic area calibration module 44 is used to perform area calibration processing on the motion monitoring data and the panoramic image data based on feature matching to obtain target calibration area data, wherein the target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0092] In some optional embodiments of the present application, a data processing device for dynamic monitoring is proposed. Figure 5 Another data processing device for dynamic monitoring provided by the present application is as follows: Figure 5 As shown, the device comprises:

[0093] A positioning and matching module 51 is used to perform positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0094] A calibration region matching module 52 is used to match the calibration region corresponding to the panoramic relative position data to obtain process calibration region data, wherein the process calibration region data is data for representing the calibration region corresponding to the panoramic relative position in the panoramic image;

[0095] The calibration area mapping module 53 is used to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

[0096] The specific manner of executing the operation of each unit in the above embodiment has been described in detail in the embodiment of the method, and will not be elaborated here.

[0097] In summary, in the present application, the video stream data to be processed is obtained, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of the camera; the video stream data to be processed is subjected to a panoramic image construction process based on frame extraction to obtain panoramic image data, wherein the panoramic image data is data used to represent a panoramic image of the monitoring area; when the camera motion information is received, the motion monitoring data is obtained, wherein the motion monitoring data is monitoring image data used to represent the camera under the operating information; the motion monitoring data and the panoramic image data are subjected to a region calibration process based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent the calibration region in the motion monitoring data. By constructing a panoramic image of the camera monitoring area and monitoring the camera's motion information, when the camera motion is detected, the image currently captured by the camera is matched with the panoramic image to realize the calibration region existing in the currently captured image, thereby realizing the calibration of dynamic regions in non-fixed scenes.

[0098] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0099] Obviously, those skilled in the art should understand that the above-mentioned units or steps of the present application can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the present application is not limited to any specific combination of hardware and software.

[0100] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A data processing method for dynamic monitoring, characterized in that: include: Acquire the video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera; Performing frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of a monitoring area; When the camera motion information is received, motion monitoring data is acquired, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operation information; The motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent a calibration region in the motion monitoring data.

2. The data processing method according to claim 1, characterized in that: The motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching to obtain target calibration region data including: Performing positioning processing based on key point matching on the motion monitoring data and the panoramic image data to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image; Matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data for representing the calibration area corresponding to the panoramic relative position in the panoramic image; The motion monitoring data is subjected to calibration area mapping processing according to the process calibration area data to obtain the target calibration area data.

3. The data processing method according to claim 2, characterized in that: The motion monitoring data and the panoramic image data are subjected to positioning processing based on key point matching to obtain panoramic relative position data including: Performing image feature detection processing on the motion monitoring data and the panoramic view data respectively, to obtain first image feature data and second image feature data respectively, wherein the first image feature data is used to represent image feature data in the motion monitoring data, and the second image feature data is used to represent image feature data in the panoramic view; Performing feature point matching on the first image feature data and the second image feature data to obtain matching feature point pair data, wherein the matching feature point pair data is data for representing matching feature point pairs in the first image feature data and the second image feature data; The panoramic image data and the motion monitoring data are subjected to image mapping processing according to the matching feature point pair data to obtain the panoramic relative position data.

4. The data processing method according to claim 1, characterized in that: The video stream data to be processed is subjected to frame extraction-based panoramic image construction processing, and the obtained panoramic image data includes: Performing frame extraction processing on the video stream data to be processed with overlapping image features to obtain a plurality of spliced ​​image data; Performing a panoramic image construction process based on image stitching on the plurality of stitched image data to obtain process stitched image data; The process stitching image data is subjected to a region calibration process to obtain the panoramic image data, wherein the panoramic image data includes data for representing a calibration region and a panoramic image.

5. The data processing method according to claim 4, characterized in that: Performing regional calibration processing on the process stitching image data to obtain the panoramic image data includes: Acquiring regional calibration requirement data, wherein the regional calibration requirement data is requirement data for indicating regional calibration; Performing identification processing on the regional calibration demand data based on regional monitoring characteristics to obtain regional monitoring characteristic data; Performing a region matching process based on the region monitoring feature data on the process stitching image data to obtain panoramic calibration region data, wherein the panoramic calibration region data is data used to represent a region corresponding to the region monitoring feature data; The panoramic image data is obtained according to the panoramic calibration area data and the process stitching image data.

6. The data processing method according to claim 1, characterized in that: After performing feature matching-based area calibration processing on the motion monitoring data and the panoramic image data to obtain target calibration area data, the method further includes: Performing target detection processing on the motion monitoring data to obtain motion target data, wherein the motion target data is data used to represent the motion target present in the motion monitoring data; Matching a target monitoring algorithm corresponding to the target calibration area data in a preset dynamic monitoring database; The moving target data is subjected to target behavior analysis processing based on the target monitoring algorithm to obtain behavior analysis result data.

7. A data processing device for dynamic monitoring, characterized in that: include: A data acquisition module, used to acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera; A panoramic construction module, used for performing a panoramic image construction process based on frame extraction on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of a monitoring area; A motion monitoring module, used for acquiring motion monitoring data when receiving camera motion information, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operation information; The dynamic area calibration module is used to perform area calibration processing on the motion monitoring data and the panoramic image data based on feature matching to obtain target calibration area data, wherein the target calibration area data is data used to represent the calibration area in the motion monitoring data.

8. The data processing device according to claim 7, characterized in that: The dynamic area calibration module includes: A positioning and matching module, used for performing positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image; A calibration area matching module, used to match the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data used to represent the calibration area corresponding to the panoramic relative position in the panoramic image; The calibration area mapping module is used to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the data processing method for dynamic monitoring according to any one of claims 1 to 6.

10. An electronic device, characterized in that: include: at least one processor; And a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor executes the data processing method for dynamic monitoring described in any one of claims 1-6.

Images