Data processing method and device for dynamic monitoring

Abstract

The present application discloses a data processing method and device for dynamic monitoring. The method includes: obtaining video stream data to be processed, the video stream data to be processed is video stream data used to represent dynamic camera monitoring; performing frame-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data; when camera motion information is received, obtaining motion monitoring data; performing feature matching-based area calibration processing on the motion monitoring data and the panoramic image data to obtain target calibration area data, the target calibration area data is data used to represent the calibration area in the motion monitoring data. By constructing a panoramic image of the camera monitoring area and monitoring the camera's motion information, when camera motion is detected, the image currently captured by the camera is matched with the panoramic image to realize the calibration area existing in the currently captured image, thereby realizing dynamic area calibration in non-fixed scenes.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a data processing method and device for dynamic monitoring. Background Art

[0002] Border control primarily involves regional control. Targets of the same category appearing in different areas may require different control requirements. For example, if an ordinary person appears in our controlled area, we may not pay attention. However, if a person appears in the immediate area, we may need to track and issue an alert. Border control commonly involves border crossings, which can be categorized as entry, stay, or exit detection.

[0003] Regional control is a primary application in border surveillance scenarios. Regional calibration is relatively mature and widely used for fixed-position cameras, such as bolt-on cameras. However, in border control, due to the early construction period, a large number of cameras were built for manual monitoring. During use, the camera's pan / tilt control controls the camera's movement and zoom. Since the camera's position and scene content change during use, regional calibration methods based on fixed scenes cannot be directly applied.

[0004] This application is proposed to address the problems existing in the prior art. Summary of the Invention

[0005] The main purpose of this application is to provide a data processing method and device for dynamic monitoring to solve at least one of the above-mentioned problems.

[0006] To achieve the above objectives, the first aspect of the present application provides a data processing method for dynamic monitoring, comprising:

[0007] Acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera;

[0008] Performing a frame-based panoramic image construction process on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of the monitored area;

[0009] When camera motion information is received, motion monitoring data is acquired, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operation information;

[0010] The motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching to obtain target calibration region data, wherein the target calibration region data is data for representing a calibration region in the motion monitoring data.

[0011] Furthermore, the motion monitoring data and the panoramic image data are subjected to region calibration processing based on feature matching to obtain target calibration region data including:

[0012] Performing positioning processing based on key point matching on the motion monitoring data and the panoramic image data to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0013] Matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data for representing the calibration area corresponding to the panoramic relative position in the panoramic image;

[0014] The motion monitoring data is subjected to calibration area mapping processing according to the process calibration area data to obtain the target calibration area data.

[0015] Furthermore, positioning processing is performed on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data including:

[0016] performing image feature detection processing on the motion monitoring data and the panoramic image data, respectively, to obtain first image feature data and second image feature data, respectively, wherein the first image feature data is used to represent image feature data in the motion monitoring data, and the second image feature data is used to represent image feature data in the panoramic image;

[0017] Performing feature point matching on the first image feature data and the second image feature data to obtain matching feature point pair data, wherein the matching feature point pair data is data for representing matching feature point pairs in the first image feature data and the second image feature data;

[0018] Image mapping processing is performed on the panoramic image data and the motion monitoring data according to the matching feature point pair data to obtain the panoramic relative position data.

[0019] Furthermore, the video stream data to be processed is subjected to a panoramic image construction process based on frame extraction, and the obtained panoramic image data includes:

[0020] Performing frame extraction processing on the video stream data to be processed with overlapping image features to obtain a plurality of spliced ​​image data;

[0021] Performing a panorama construction process based on image stitching on the plurality of stitched image data to obtain process stitched image data;

[0022] Performing a region calibration process on the process stitching image data to obtain the panoramic image data, wherein the panoramic image data includes data for representing a calibration region and a panoramic image.

[0023] Furthermore, performing regional calibration processing on the process stitching image data to obtain the panoramic image data includes:

[0024] Acquiring regional calibration requirement data, wherein the regional calibration requirement data is requirement data for indicating regional calibration;

[0025] Performing identification processing on the regional calibration demand data based on regional monitoring characteristics to obtain regional monitoring feature data;

[0026] performing a region matching process based on the region monitoring feature data on the process stitching image data to obtain panoramic calibration region data, wherein the panoramic calibration region data is data for representing a region corresponding to the region monitoring feature data;

[0027] The panoramic image data is obtained according to the panoramic calibration area data and the process stitching image data.

[0028] Furthermore, after performing region calibration processing based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data, the method further includes:

[0029] Performing target detection processing on the motion monitoring data to obtain moving target data, wherein the moving target data is data used to represent a moving target present in the motion monitoring data;

[0030] Matching a target monitoring algorithm corresponding to the target calibration area data in a preset dynamic monitoring database;

[0031] The moving target data is subjected to target behavior analysis processing based on the target monitoring algorithm to obtain behavior analysis result data.

[0032] According to a second aspect of the present application, a data processing method for dynamic monitoring is proposed, comprising:

[0033] A data acquisition module is used to acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera;

[0034] A panoramic construction module, configured to perform frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of the monitored area;

[0035] A motion monitoring module, configured to obtain motion monitoring data upon receiving camera motion information, wherein the motion monitoring data is monitoring image data collected by the camera under the operating information;

[0036] The dynamic area calibration module is used to perform area calibration processing based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration area data, wherein the target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0037] Furthermore, the dynamic area calibration module includes:

[0038] a positioning and matching module, configured to perform positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0039] a calibration region matching module, configured to match a calibration region corresponding to the panoramic relative position data to obtain process calibration region data, wherein the process calibration region data is data for representing a calibration region corresponding to the panoramic relative position in the panoramic image;

[0040] The calibration area mapping module is used to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

[0041] According to a third aspect of the present application, a computer-readable storage medium is proposed, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the above-mentioned data processing method for dynamic monitoring.

[0042] According to the fourth aspect of the present application, an electronic device is proposed, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor executes the above-mentioned data processing method for dynamic monitoring.

[0043] The technical solutions provided by the embodiments of the present application may have the following beneficial effects:

[0044] In the present application, video stream data to be processed is obtained, wherein the video stream data to be processed is video stream data used to represent dynamic camera monitoring; a panoramic image construction process based on frame extraction is performed on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data used to represent a panoramic image of a monitoring area; when camera motion information is received, motion monitoring data is obtained, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operating information; the motion monitoring data and the panoramic image data are subjected to feature matching-based region calibration processing to obtain target calibration region data, wherein the target calibration region data is data used to represent a calibration region in the motion monitoring data. By constructing a panoramic image of the camera monitoring area and monitoring the camera's motion information, when camera motion is detected, the image currently collected by the camera is matched with the panoramic image to realize the calibration region existing in the currently collected image, thereby realizing the calibration of dynamic regions in non-fixed scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings that constitute part of this application are used to provide a further understanding of this application and make other features, objects and advantages of this application more apparent. The illustrative embodiment drawings of this application and their descriptions are used to explain this application and do not constitute an improper limitation of this application. In the drawings:

[0046] Figure 1 A flowchart of a data processing method for dynamic monitoring provided by this application;

[0047] Figure 2 A flowchart of a data processing method for dynamic monitoring provided by this application;

[0048] Figure 3 A flowchart of a data processing method for dynamic monitoring provided by this application;

[0049] Figure 4 A schematic diagram of a data processing device for dynamic monitoring provided by this application;

[0050] Figure 5 This is a schematic diagram of another data processing device for dynamic monitoring provided by this application. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] In this application, terms such as "upper," "lower," "left," "right," "front," "back," "top," "bottom," "inner," "outer," "center," "vertical," "horizontal," "transverse," and "longitudinal" indicate positions or locations based on the positions or locations shown in the accompanying drawings. These terms are primarily intended to better describe this application and its embodiments and are not intended to limit the devices, elements, or components indicated to having a specific orientation, or to being constructed or operated in a specific orientation.

[0054] Furthermore, some of the above terms may be used to express other meanings besides indicating a position or location. For example, the term "on" may also be used to indicate a dependency or connection in certain circumstances. Those skilled in the art will understand the specific meanings of these terms in this application based on the specific circumstances.

[0055] Furthermore, the terms "installed," "disposed," "provided with," "connected," "connected," and "socketed" should be interpreted broadly. For example, "connected" can mean a fixed connection, a removable connection, or an integral structure; it can be a mechanical connection or an electrical connection; it can be a direct connection, an indirect connection through an intermediary, or an internal communication between two devices, elements, or components. Those skilled in the art will understand the specific meanings of these terms in this application based on the specific circumstances.

[0056] Regional control is a major application method in border monitoring scenarios. For fixed-position cameras such as gun cameras, regional calibration is relatively mature and widely used. After the camera moves, the camera orientation and scene content will change, and the regional calibration method based on fixed scenes cannot be directly applied. Alarms in specific areas usually require the use of fixed cameras. Once the camera is moved or rotated, the predetermined area will become invalid, resulting in the failure of alarms in specific areas. Fixed surveillance cameras need to be manually rotated to observe or monitor other areas. Surveillance cameras in many places are movable cameras that can be operated by multiple people. After the camera is rotated, the previously calibrated area information becomes invalid. Adding fixed cameras is too expensive and not very practical. In response to the above-mentioned problems existing in the prior art, this application is proposed.

[0057] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 1 This is a flow chart of a data processing method for dynamic monitoring provided by this application, such as Figure 1 As shown, the method includes the following steps:

[0058] S101: Obtaining video stream data to be processed;

[0059] The video stream data to be processed is used to represent the dynamic monitoring video stream data of the camera. The video stream data to be processed is used to control the rotation of the camera and collect panoramic continuous video stream data within the visible range during the rotation of the camera.

[0060] S102: performing frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data;

[0061] The panoramic data is data used to represent a panoramic view of the monitoring area. The panoramic data includes a panoramic image within the visible range of the camera and data of a marked area in the panoramic image.

[0062] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 2 This is a flow chart of a data processing method for dynamic monitoring provided by this application, such as Figure 2 As shown, the method includes the following steps:

[0063] S201: performing frame extraction processing on the video stream data to be processed based on overlapping image features to obtain a plurality of spliced ​​image data;

[0064] The video stream data to be processed is subjected to image extraction processing. During the image extraction process, the video stream data to be processed is identified to obtain multiple video frame data. The multiple video frame data are subjected to overlap judgment processing, and the image overlap of adjacent extracted video frames is calculated. When the image overlap of the adjacent extracted video frames meets the frame extraction requirement, the adjacent extracted frames meet the frame extraction requirement, and multiple spliced ​​image data are obtained. The multiple spliced ​​image data are used to represent the multiple adjacent extracted frames that meet the frame extraction requirement. For example, if a first frame extraction process is performed on the video stream data to be processed, based on the first frame, a video frame in the video stream data is screened for image overlap with the first frame that meets the preset frame extraction requirement, and the video frame is extracted to obtain a second frame; the above frame extraction operation is repeated based on the second frame to obtain multiple spliced ​​image data, wherein the frame extraction requirement can be that the image overlap of adjacent extracted video frames is a preset value, or that the image overlap of adjacent extracted video frames is within a preset range. If the frame extraction requirement is that the image overlap of adjacent extracted video frames is within a preset range, the first frame extraction processing is performed on the processed video stream data, and based on the first frame, the video frames with image overlap within the preset range are screened to obtain multiple process first extracted video frames. The above frame extraction process is repeated for the above multiple process first extracted video frames to obtain multiple process extracted video frames, and the image overlap calculation processing based on adjacent extracted video frames is performed on the multiple process extracted video frames. Adjacent extracted video frames that meet the preset image overlap range are screened to obtain multiple spliced ​​image data.

[0065] S202: performing a panorama construction process based on image stitching on the plurality of stitched image data to obtain process stitched image data;

[0066] A panoramic image within the visual range of the surveillance camera is generated using a panoramic generation algorithm.

[0067] S203: performing regional calibration processing on the process stitching image data to obtain panoramic image data.

[0068] The panoramic image data includes data representing a calibration area and a panoramic image.

[0069] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, including:

[0070] Acquire regional calibration requirement data, which is requirement data for representing regional calibration; perform identification processing on the regional calibration requirement data based on regional monitoring features to obtain regional monitoring feature data; perform regional matching processing on the process stitching image data based on the regional monitoring feature data to obtain panoramic calibration region data, which is data for representing the region corresponding to the regional monitoring feature data; obtain panoramic image data based on the panoramic calibration region data and the process stitching image data.

[0071] In an optional embodiment of the present application, the process stitched image data is subjected to regional matching processing based on regional monitoring feature data, including: performing semantic recognition processing on the process stitched image data to obtain multiple image semantic feature data; matching the multiple image semantic feature data with regional monitoring features, and if there is a match between the image semantic feature data and the regional monitoring features, calibrating the stitched image region corresponding to the image semantic feature data to obtain panoramic calibration region data. The process stitched image is subjected to object capture-based calibration processing, including: performing action recognition processing on the regional calibration requirement data to identify the position corresponding to the calibration action, identifying the image position of the process stitched image corresponding to the calibration action position, and calibrating the process stitched image based on the image feature and image position to obtain panoramic calibration region data.

[0072] S103: When camera motion information is received, motion monitoring data is obtained;

[0073] Motion monitoring data is used to represent monitoring image data collected by the camera under operation information;

[0074] S104: performing region calibration processing based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data.

[0075] The target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0076] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed. Figure 3 This is a flow chart of a data processing method for dynamic monitoring provided by this application, such as Figure 3 As shown, the method includes the following steps:

[0077] S301: performing positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data;

[0078] The panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic view;

[0079] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, including:

[0080] Image feature detection processing is performed on the motion monitoring data and the panoramic view data respectively to obtain first image feature data and second image feature data respectively, wherein the first image feature data is used to represent the image feature data in the motion monitoring data, and the second image feature data is used to represent the image feature data in the panoramic view; feature point matching is performed on the first image feature data and the second image feature data to obtain matching feature point pair data, wherein the matching feature point pair data is data used to represent the matching feature point pairs in the first image feature data and the second image feature data; image mapping processing is performed on the panoramic view data and the motion monitoring data according to the matching feature point pair data to obtain panoramic relative position data.

[0081] In an optional embodiment of the present application, a key point matching algorithm is used to match the position of the current image in the panoramic image; the calibration area information of the current image is determined based on the calibration area information of the panoramic image. For example, the homography matrix is ​​estimated using the matched feature points, the image is transformed and mapped according to the homography matrix, and the calibration area in the panoramic image is mapped to the current image, thereby determining the calibration area parameters of the current image. For example, the SIFT algorithm is used to detect key feature points in the current image and the panoramic image, and their descriptors are calculated; the FALNN algorithm is used to quickly find the feature point pairs of the two images; the correct matching point pairs are screened out by the RANSAC algorithm, and the screened matching point pairs are used to calculate the homography matrix between the two images, that is, the transformation matrix that maps one image to another image; according to the calculated transformation matrix, the global calibration area in the panoramic image is mapped to the corresponding area of ​​the current image, and the corresponding coordinate information of the calibration area in the current image is obtained.

[0082] S302: Matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data;

[0083] The process calibration area data is data used to represent the calibration area corresponding to the relative position of the panorama in the panoramic image;

[0084] S303: Perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain target calibration area data.

[0085] In some optional embodiments of the present application, a data processing method for dynamic monitoring is proposed, comprising: after performing feature matching-based region calibration processing on motion monitoring data and panoramic image data to obtain target calibration region data, the method further comprises:

[0086] The motion monitoring data is subjected to target detection processing to obtain motion target data, wherein the motion target data is data used to represent the motion target present in the motion monitoring data; a target monitoring algorithm corresponding to the target calibration area data is matched in a preset dynamic monitoring database; the motion target data is subjected to target behavior analysis processing based on the target monitoring algorithm to obtain behavior analysis result data.

[0087] In some optional embodiments of the present application, a data processing device for dynamic monitoring is proposed. Figure 4 This application provides a data processing device for dynamic monitoring, such as Figure 4 As shown, the device includes:

[0088] The data acquisition module 41 is used to acquire the video stream data to be processed, wherein the video stream data to be processed is the video stream data used to represent the dynamic monitoring of the camera;

[0089] A panorama construction module 42 is configured to perform a panorama construction process based on frame extraction on the video stream data to be processed to obtain panorama data, wherein the panorama data is data for representing a panorama of the monitored area;

[0090] The motion monitoring module 43 is configured to obtain motion monitoring data when receiving camera motion information, wherein the motion monitoring data is monitoring image data collected by the camera under the operating information;

[0091] The dynamic area calibration module 44 is used to perform area calibration processing on the motion monitoring data and the panoramic image data based on feature matching to obtain target calibration area data, wherein the target calibration area data is data used to represent the calibration area in the motion monitoring data.

[0092] In some optional embodiments of the present application, a data processing device for dynamic monitoring is proposed. Figure 5 Another data processing device for dynamic monitoring provided by this application, such as Figure 5 As shown, the device includes:

[0093] a positioning and matching module 51 for performing positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image;

[0094] a calibration region matching module 52 for matching a calibration region corresponding to the panoramic relative position data to obtain process calibration region data, wherein the process calibration region data is data for representing a calibration region corresponding to the panoramic relative position in the panoramic image;

[0095] The calibration area mapping module 53 is configured to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

[0096] The specific manner of executing the operations of each unit in the above embodiment has been described in detail in the embodiment of the method, and will not be elaborated on here.

[0097] In summary, in the present application, the video stream data to be processed is obtained, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of the camera; the video stream data to be processed is subjected to a panoramic image construction process based on frame extraction to obtain panoramic image data, wherein the panoramic image data is data used to represent a panoramic image of the monitoring area; when the camera motion information is received, the motion monitoring data is obtained, wherein the motion monitoring data is used to represent the monitoring image data collected by the camera under the operating information; the motion monitoring data and the panoramic image data are subjected to a region calibration process based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent the calibration region in the motion monitoring data. By constructing a panoramic image of the camera monitoring area and monitoring the camera's motion information, when the camera motion is detected, the image currently collected by the camera is matched with the panoramic image to realize the calibration region existing in the currently collected image, thereby realizing the calibration of dynamic regions in non-fixed scenes.

[0098] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0099] Obviously, those skilled in the art should understand that the above-mentioned units or steps of the present application can be implemented using a general-purpose computing device. They can be concentrated on a single computing device or distributed across a network composed of multiple computing devices. Alternatively, they can be implemented using program codes executable by the computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps can be made into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0100] The above description is merely a preferred embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A data processing method for dynamic monitoring, characterized in that: include: Acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera; Performing a frame-based panoramic image construction process on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of the monitored area; When camera motion information is received, motion monitoring data is obtained, wherein the motion monitoring data is used to represent monitoring image data collected by the camera under the operating information; Performing a region calibration process based on feature matching on the motion monitoring data and the panoramic image data to obtain target calibration region data, wherein the target calibration region data is data used to represent a calibration region in the motion monitoring data; Performing feature matching-based area calibration processing on the motion monitoring data and the panoramic view data to obtain target calibration area data includes: performing key point matching-based positioning processing on the motion monitoring data and the panoramic view data to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic view; matching the calibration area corresponding to the panoramic relative position data to obtain process calibration area data, wherein the process calibration area data is data used to represent the calibration area corresponding to the panoramic relative position in the panoramic view; performing calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

2. The data processing method according to claim 1, wherein: Performing positioning processing based on key point matching on the motion monitoring data and the panoramic image data to obtain panoramic relative position data includes: performing image feature detection processing on the motion monitoring data and the panoramic image data, respectively, to obtain first image feature data and second image feature data, respectively, wherein the first image feature data is used to represent image feature data in the motion monitoring data, and the second image feature data is used to represent image feature data in the panoramic image; Performing feature point matching on the first image feature data and the second image feature data to obtain matching feature point pair data, wherein the matching feature point pair data is data for representing matching feature point pairs in the first image feature data and the second image feature data; Image mapping processing is performed on the panoramic image data and the motion monitoring data according to the matching feature point pair data to obtain the panoramic relative position data.

3. The data processing method according to claim 1, wherein: The panoramic image data to be processed is subjected to frame extraction-based panoramic image construction processing to obtain the panoramic image data including: Performing frame extraction processing on the video stream data to be processed with overlapping image features to obtain a plurality of spliced ​​image data; Performing a panorama construction process based on image stitching on the plurality of stitched image data to obtain process stitched image data; Performing a region calibration process on the process stitching image data to obtain the panoramic image data, wherein the panoramic image data includes data for representing a calibration region and a panoramic image.

4. The data processing method according to claim 3, wherein: Performing regional calibration processing on the process stitching image data to obtain the panoramic image data includes: Acquiring regional calibration requirement data, wherein the regional calibration requirement data is requirement data for indicating regional calibration; Performing identification processing on the regional calibration demand data based on regional monitoring characteristics to obtain regional monitoring feature data; performing a region matching process based on the region monitoring feature data on the process stitching image data to obtain panoramic calibration region data, wherein the panoramic calibration region data is data for representing a region corresponding to the region monitoring feature data; The panoramic image data is obtained according to the panoramic calibration area data and the process stitching image data.

5. The data processing method according to claim 1, wherein: After performing feature matching-based region calibration processing on the motion monitoring data and the panoramic image data to obtain target calibration region data, the method further includes: Performing target detection processing on the motion monitoring data to obtain moving target data, wherein the moving target data is data used to represent a moving target present in the motion monitoring data; Matching a target monitoring algorithm corresponding to the target calibration area data in a preset dynamic monitoring database; The moving target data is subjected to target behavior analysis processing based on the target monitoring algorithm to obtain behavior analysis result data.

6. A data processing device for dynamic monitoring, characterized in that: include: A data acquisition module is used to acquire video stream data to be processed, wherein the video stream data to be processed is video stream data used to represent dynamic monitoring of a camera; A panoramic construction module, configured to perform frame extraction-based panoramic image construction processing on the video stream data to be processed to obtain panoramic image data, wherein the panoramic image data is data for representing a panoramic image of the monitored area; A motion monitoring module, configured to obtain motion monitoring data upon receiving camera motion information, wherein the motion monitoring data is monitoring image data collected by the camera under operating information; a dynamic region calibration module, configured to perform region calibration processing on the motion monitoring data and the panoramic image data based on feature matching to obtain target calibration region data, wherein the target calibration region data is data used to represent a calibration region in the motion monitoring data; The dynamic area calibration module includes: a positioning and matching module, configured to perform positioning processing on the motion monitoring data and the panoramic image data based on key point matching to obtain panoramic relative position data, wherein the panoramic relative position data is data used to represent the relative position of the monitoring image corresponding to the motion monitoring data in the panoramic image; a calibration region matching module, configured to match a calibration region corresponding to the panoramic relative position data to obtain process calibration region data, wherein the process calibration region data is data for representing a calibration region corresponding to the panoramic relative position in the panoramic image; The calibration area mapping module is used to perform calibration area mapping processing on the motion monitoring data according to the process calibration area data to obtain the target calibration area data.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the data processing method for dynamic monitoring according to any one of claims 1 to 5.

8. An electronic device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor executes the data processing method for dynamic monitoring according to any one of claims 1 to 5.

Images