Polling Method, Device, Equipment and Storage Medium for Panoramic Monitoring Screen
By receiving the geographical location information of the surveillance camera and generating an automatic jump plan, automatic screen switching between the AR panoramic camera and the ordinary surveillance camera device is realized, solving the problems of cumbersome operations and missing images in the existing technology, and improving the monitoring effect.
Patent Information
- Application Number
- CN202210037789.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-13
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2042-01-13
AI Technical Summary
The prior art requires a manual click to jump to the normal surveillance camera screen in the AR panoramic camera image screen, and the image of a surveillance camera device is easily missed.
By receiving equipment information of the surveillance camera device, including geographical location information, and generating an automatic jump plan based on the set jump plan rules, the automatic switching of the surveillance screen between the target panoramic camera and the surveillance camera device is achieved.
It reduces the cumbersomeness of operation, avoids the omission of monitoring screens, improves the monitoring effect, and realizes automated monitoring screen polling.
Smart Images

Figure CN114449221B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and particularly to the field of monitoring technology, and provides a polling method, device, equipment and storage medium for panoramic monitoring images. Background Art
[0002] With the popularization of Artificial Intelligence (AI) and the development of the 5th generation (5G) mobile communication technology, machine vision has gradually become a trend. An Augmented Reality (AR) Panorama camera is a camera that shoots with an ultra-wide angle. The pictures and videos taken are more three-dimensional. Since the AR panorama camera can capture image content with a larger field of view angle, and ordinary monitoring camera devices can capture more accurate image details, the combination of the AR panorama camera and ordinary monitoring camera devices has been widely used in the security field.
[0003] Currently, in the image frame of an AR panorama camera, there will usually be one or more shooting positions of ordinary monitoring camera devices. In order to achieve a quick jump from the AR panoramic view to the ordinary monitoring camera device, a jump entry can be provided by tagging in the AR panoramic view, so as to further understand the specific situation of the location where the ordinary monitoring camera device is located through the tag.
[0004] However, currently when making a jump, it is necessary to manually click on the jump entry to perform the picture jump. Each jump requires an operation, which is cumbersome and complex, and it is easy to miss the monitoring pictures of a certain monitoring camera device. Summary of the Invention
[0005] Embodiments of this application provide a polling method, device, equipment and storage medium for panoramic monitoring images, which are used to implement the polling process of panoramic monitoring images, reduce the cumbersome degree of operation, avoid missing monitoring pictures, and improve the monitoring effect.
[0006] On the one hand, a polling method for panoramic monitoring images is provided. The method includes:
[0007] Receiving device information reported by each monitoring camera device in a set area around the target panoramic camera; wherein, the device information includes first position information indicating the geographical location where the corresponding monitoring camera device is located;
[0008] Based on a set jump plan rule, generating an automatic jump plan for monitoring images according to the target panoramic camera and the first position information corresponding to each of the monitoring camera devices;
[0009] Based on the automatic jump plan, perform the monitoring screen switching action between the target panoramic camera and each monitoring camera device, so that the monitoring screens of the target panoramic camera and each monitoring camera device are sequentially displayed according to the automatic jump plan.
[0010] On the one hand, a polling device for panoramic monitoring screens is provided. The device includes:
[0011] A receiving unit, configured to receive the device information reported by each monitoring camera device within a set area around the target panoramic camera; wherein, the device information includes first position information indicating the geographical location of the corresponding monitoring camera device.
[0012] A jump planning unit, configured to generate an automatic jump plan for the monitoring screen based on the set jump plan rules and according to the first position information corresponding to the target panoramic camera and each monitoring camera device.
[0013] A jump execution unit, configured to perform the monitoring screen switching action between the target panoramic camera and each monitoring camera device based on the automatic jump plan, so that the monitoring screens of the target panoramic camera and each monitoring camera device are sequentially displayed according to the automatic jump plan.
[0014] Optionally, the device further includes a label creation unit, configured to:
[0015] Based on the coordinate conversion rule between the image coordinate system and the world coordinate system of the target panoramic camera, and the first position information corresponding to each monitoring camera device, determine the second position information of each monitoring camera device in the panoramic monitoring screen captured by the target panoramic camera.
[0016] Based on the second position information, generate jump labels for each monitoring camera device in the panoramic monitoring screen.
[0017] In response to the display trigger of the panoramic monitoring screen of the target panoramic camera, generate a display screen data packet based on the generated jump labels and the panoramic monitoring screen, so that the monitoring screen is displayed based on the display screen data packet.
[0018] Optionally, the jump execution unit is further configured to:
[0019] In response to a trigger operation on a target jump label among the jump labels, determine the target monitoring camera device corresponding to the target jump label.
[0020] Based on the target monitoring screen corresponding to the target monitoring camera device and the jump label in the target monitoring screen, generate a new display screen data packet.
[0021] Optionally, the device further includes a conversion rule determination unit, configured to:
[0022] Select at least one reference point from the monitoring scenes corresponding to the panoramic monitoring images;
[0023] Obtain the first reference position information of each of the at least one reference point in the monitoring scene, and obtain the second reference position information of the at least one reference point in the panoramic monitoring image;
[0024] Determine the coordinate conversion rule based on the obtained first reference position information and second reference position information.
[0025] Optionally, the label creation unit is specifically configured to:
[0026] Generate jump labels of each monitoring camera device in the panoramic monitoring image based on the second position information and the monitoring types corresponding to the respective monitoring camera devices;
[0027] After generating a display screen data packet based on the generated jump labels and the panoramic monitoring image in response to the display trigger of the target panoramic camera's panoramic monitoring image, the method further includes:
[0028] In response to a trigger operation for displaying a jump label of a target monitoring type, filter out jump labels corresponding to other monitoring types in the display screen data packet to generate a new display screen data packet.
[0029] Optionally, the jump planning unit is specifically configured to:
[0030] Map the first position information of the target panoramic camera and each monitoring camera device to a set two-dimensional coordinate system; wherein, in the two-dimensional coordinate system, the target panoramic camera is used as the coordinate origin;
[0031] Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system, respectively determine the included angle values between the connection lines between each monitoring camera device and the target panoramic camera and a set coordinate axis;
[0032] Generate an automatic jump plan for the monitoring image according to the included angle values corresponding to each monitoring camera device.
[0033] Optionally, the jump planning unit is specifically configured to:
[0034] Map the first position information corresponding to the target panoramic camera and each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin;
[0035] Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine the distances between each monitoring camera device and the coordinate origin respectively;
[0036] Generate an automatic jump plan for the monitoring screen according to the distances corresponding to each monitoring camera device.
[0037] Optionally, the device information further includes the field of view angles corresponding to each monitoring camera device;
[0038] Then the jump planning unit is specifically configured to:
[0039] Map the first position information corresponding to the target panoramic camera and each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin;
[0040] Starting from the target panoramic camera, perform a traversal operation on the target panoramic camera and each monitoring camera device in turn, and obtain the automatic jump plan based on the traversal result; wherein each traversal operation includes:
[0041] According to the field of view angle of the currently traversed device and the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine whether there are other monitoring camera devices within the field of view angle area of the currently traversed device; the currently traversed device is the target panoramic camera or a monitoring camera device;
[0042] If there are other monitoring camera devices, update the automatic jump plan based on the other monitoring camera devices.
[0043] Optionally, the jump planning unit is specifically configured to:
[0044] If there are monitoring camera devices with repeated jumps in the traversal result, perform duplicate removal processing on the monitoring camera devices with repeated jumps to obtain the automatic jump plan.
[0045] On the one hand, provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, implement the steps of any of the above methods.
[0046] On the one hand, a computer storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the steps of any of the above methods are implemented.
[0047] On the one hand, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the steps of any of the above methods.
[0048] In the embodiments of the present application, device information reported by each monitoring camera device within a set area around the target panoramic camera is received. The device information includes first position information indicating the geographical location of the corresponding monitoring camera device. And based on the set jump plan rule, according to the target panoramic camera and the first position information corresponding to each monitoring camera device, an automatic jump plan for the monitoring screen is generated. Then, based on the automatic jump plan, a monitoring screen switching action between the target panoramic camera and each monitoring camera device is executed, so that the monitoring screens of the target panoramic camera and each monitoring camera device are sequentially displayed according to the automatic jump plan. It can be seen that in the embodiments of the present application, based on the geographical location information corresponding to the target panoramic camera and each monitoring camera device, a jump plan for the monitoring screen is formulated. Thus, when the monitoring screen is displayed, the monitoring screens of each device can be displayed once according to the automatic jump plan, without manual operation, reducing the complexity of the operation, being able to avoid the situation of missing monitoring screens, and formulating the jump plan according to the geographical location information can comprehensively consider the order of monitoring screen jumps in combination with the positions of each device, making the jump order more in line with the monitoring requirements in the actual scenario, covering the entire monitoring scenario comprehensively and orderly, and improving the monitoring effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.
[0050] Figure 1 It is a schematic diagram of an application scenario provided for the embodiments of the present application;
[0051] Figure 2 It is a schematic diagram of the architecture of the AR video interaction system provided for the embodiments of the present application;
[0052] Figure 3Schematic flowchart of the polling method for the panoramic monitoring screen provided by the embodiment of the present application;
[0053] Figure 4 Schematic diagram of a jump route planning provided by the embodiment of the present application;
[0054] Figure 5 Another schematic diagram of a jump route planning provided by the embodiment of the present application;
[0055] Figure 6 Schematic flowchart of the automatic creation process of jump labels provided by the embodiment of the present application;
[0056] Figure 7 Schematic diagram of calculating the second position information provided by the embodiment of the present application;
[0057] Figure 8 Schematic diagram of the information interface included in the jump label provided by the embodiment of the present application;
[0058] Figure 9 Schematic diagram of the instance display of the panoramic monitoring screen provided by the embodiment of the present application;
[0059] Figure 10 Schematic diagram of jump label selection provided by the embodiment of the present application;
[0060] Figure 11 A schematic structural diagram of the polling device for the panoramic monitoring screen provided by the embodiment of the present application;
[0061] Figure 12 A schematic structural diagram of a computer device provided by the embodiment of the present application. Detailed implementation manners
[0062] To make the objectives, technical solutions and advantages of the present application clearer and more understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are only a part rather than all of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application. Without conflict, the embodiments in the present application and the features in the embodiments can be combined with each other arbitrarily. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.
[0063] The design concept of the embodiments of the present application will be briefly introduced below.
[0064] Currently, in the image screen of an AR panoramic camera, there will usually be the shooting positions of one or more ordinary surveillance camera devices. In order to achieve a quick jump from the AR panoramic screen to an ordinary surveillance camera device, a jump entry can be provided by tagging the AR panoramic screen, so as to further understand the specific situation of the location where the ordinary surveillance camera device is located through the tag.
[0065] However, currently when making a jump, it is necessary to manually click on the jump entry to perform a screen jump. Each jump requires an operation, which is cumbersome and complex, and it is easy to miss the surveillance screen of a certain surveillance camera device.
[0066] In view of this, the embodiment of the present application provides a polling method for panoramic surveillance screens. In this method, device information reported by each surveillance camera device within a set area around the target panoramic camera is received. The device information includes first position information indicating the geographical location where the corresponding surveillance camera device is located, and based on the set jump plan rule, an automatic jump plan for the surveillance screen is generated according to the target panoramic camera and the first position information corresponding to each surveillance camera device. Then, based on the automatic jump plan, a surveillance screen switching action between the target panoramic camera and each surveillance camera device is executed, so that the surveillance screens of the target panoramic camera and each surveillance camera device are sequentially displayed according to the automatic jump plan. It can be seen that in the embodiment of the present application, based on the geographical location information corresponding to the target panoramic camera and each surveillance camera device, a jump plan for the surveillance screen is formulated. Thus, when displaying the surveillance screen, the surveillance screens of each device can be displayed at one time according to the automatic jump plan, without manual operation, reducing the cumbersome degree of operation, being able to avoid the situation of missing surveillance screens, and formulating the jump plan according to the geographical location information can comprehensively consider the order of surveillance screen jumps in combination with the positions of each device, so that the jump order can better meet the surveillance requirements in the actual scenario, comprehensively and orderly cover the entire surveillance scenario, and improve the surveillance effect.
[0067] In addition, in the related technology, the tagging method usually manually selects a position in the AR panoramic image for tagging. Operations such as adding and deleting tag management all need to be performed manually, with low efficiency. Moreover, there will be a deviation between the position of the camera in the AR panoramic screen and the real position, and there may be a situation where it is not clear about the position of the camera in the AR panoramic screen, thus making the tag annotation position inaccurate.
[0068] Therefore, in the embodiments of the present application, the geographical location information of each monitoring camera device is also converted into the second position information in the panoramic monitoring screen through the coordinate conversion rule, so as to generate the corresponding jump labels for each monitoring camera device according to the second position information, realizing the automatic creation of labels, reducing the complexity of label management, avoiding the problem of calibration omission, and the annotation of the jump labels is more accurate.
[0069] The following briefly introduces the application scenarios applicable to the technical solutions of the embodiments of the present application. It should be noted that the application scenarios introduced below are only for explaining the embodiments of the present application rather than limiting. In the specific implementation process, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.
[0070] The solution provided by the embodiments of the present application can be applied to most video monitoring scenarios, especially applicable to AR video interaction monitoring and the polling scenario of panoramic monitoring screens. As Figure 1 shown, it is a schematic diagram of the scenario of an AR video interaction system provided by the embodiments of the present application. In this scenario, it may include a display device 101, a server 102, and a front-end monitoring device 103.
[0071] The display device 101 can be any device with an image display function. For example, it can be a monitoring screen, a mobile phone, a tablet computer (PAD), a notebook computer, a desktop computer, a smart TV, a smart vehicle-mounted device, and a smart wearable device, etc. A display client can be installed in the display device 101 for displaying the monitoring screen.
[0072] The server 102 can be the background server corresponding to the display client in the display device 101, used to implement the display control function of the monitoring screen in the display device 101 to implement the steps of the panoramic monitoring screen polling method provided by the embodiments of the present application. For example, it can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN), and big data and artificial intelligence platforms, but it is not limited thereto.
[0073] The server 102 may include one or more processors 1021, a memory 1022, and an I / O interface 1023 for interacting with the terminal, etc. Among them, the program instructions of the panoramic monitoring screen polling method provided by the embodiments of the present application can also be stored in the memory 1022 of the server 102. When these program instructions are executed by the processor 1021, they can be used to implement the steps of the panoramic monitoring screen polling method provided by the embodiments of the present application.
[0074] The front-end monitoring device 103 can be any camera device capable of image acquisition functions. For example, it can include an AR panoramic camera, an IP camera (IPC), a high-definition (HD) camera, a standard-definition (SD) camera, etc., and will not be listed one by one here.
[0075] In practical applications, the front-end monitoring device 103 can collect the monitoring images in the corresponding monitoring area and upload them to the server 102. The server 102 can, based on the method provided in the embodiments of the present application, create jump labels in each monitoring image based on the actual geographical location information of each front-end monitoring device 103, and generate a display image data packet containing the jump labels when the display device 101 displays the monitoring image, so that the display device 101 displays the monitoring image containing the jump labels.
[0076] In addition, the server 103 can also create an automatic jump plan based on the actual geographical location information of each front-end monitoring device 103, so that the display device 101 can realize the automatic polling jump of the monitoring images according to the automatic jump plan. And because the order of the monitoring image jumps is comprehensively considered in combination with the positions of each device, the jump order can better meet the monitoring requirements in the actual scenario, comprehensively and orderly cover the entire monitoring scenario, and improve the monitoring effect.
[0077] The display device 101, the server 102, and the front-end monitoring device 103 can communicate directly or indirectly through one or more networks. The network can be a wired network or a wireless network. For example, the wireless network can be a mobile cellular network or a wireless fidelity (WIFI) network. Of course, it can also be other possible networks, and the embodiments of the present invention do not limit this.
[0078] It should be noted that in the embodiments of the present application, the functions of the above-mentioned devices are only one possible example. In the actual application process, the functions of each device can also be adjusted according to actual needs. For example, the above-mentioned display device 101 can implement some functions of the server 102. And the above-mentioned display device 101 and server 102 can also be implemented by the same device.
[0079] As Figure 2 shown, it is a schematic diagram of the architecture of an AR video interaction system provided by the embodiments of the present application. In this architecture, it includes an image display module, a label management module, an algorithm module, a network transmission module, a layer filtering module, a data storage module, a camera module, and an automatic jump module.
[0080] (1) Image display module, which is used to implement the display of surveillance images, including the display of surveillance images of ordinary surveillance cameras, panoramic cameras, etc. At the same time, relevant jump label icons can be drawn on the surveillance image according to the position information of the jump label, and this icon can be used to implement the jump of the surveillance images of other cameras.
[0081] The image display module can be implemented, for example, by Figure 1 the display device 101 shown.
[0082] (2) Label management module, which is used to implement operations such as adding, deleting, modifying, and querying label templates and jump labels. The label information of the jump label generally can include information such as label name, priority, and display method, etc.
[0083] (3) Algorithm module, which is used to implement the conversion algorithm for constructing different coordinate systems. For example, according to the Global Positioning System (GPS) information of the camera of the video surveillance device, calculate the coordinate position of the camera of the video surveillance device in the panoramic surveillance image of the panoramic camera, and at the same time, filter out the cameras within the camera's field of view. It is also used for functions such as automatic creation of jump labels and formulation of jump plans.
[0084] (4) Network transmission module, which is used to implement data transmission between various modules, and can include the data transmission part between devices and the data transmission part within the device.
[0085] (5) Layer filtering module, which is a filtering module for the image display module. The automatically added labels can mark their own characteristics when reporting information, for example, distinguish according to the surveillance type, so as to be used for filtering and classification later.
[0086] (6) Data storage module, which is mainly used to store the information required by the system, and can be used to store label management information, information of each camera (such as the above-mentioned GPS information), various layer filtering information, and server-related information, etc.
[0087] (7) Camera module, which refers to the camera used to capture surveillance images, and can be implemented, for example, by the above-mentioned front-end surveillance camera 103.
[0088] (8) Automatic jump module, which is used to formulate an automatic jump label task according to data such as the field of view angle and GPS information of the surveillance device, and is used to guide the function of automatic label jump.
[0089] In each of the above modules, the tag management module, the algorithm module, the network transmission module, the layer filtering module, the data storage module, and the automatic jump module can all be implemented by the display device 101 or by the server 102.
[0090] Of course, the method provided in the embodiments of the present application is not limited to Figure 1 the application scenarios shown or Figure 2 the architecture of, and can also be used in other possible application scenarios, which are not limited in the embodiments of the present application. For Figure 1 the functions that can be implemented by each device in the application scenarios shown, they will be described together in the subsequent method embodiments and will not be elaborated here.
[0091] The method flow provided in each embodiment of the present application can be executed by Figure 1 the server 102, the front-end monitoring device 103, or the display device 101 in, or can also be jointly executed by any combination of the server 102, the front-end monitoring device 103, and the display device 101. Here, the execution by the server 102 is mainly used as an example for introduction.
[0092] Refer to Figure 3 shown, which is a schematic flowchart of the polling method for the panoramic monitoring screen provided by the embodiments of the present application.
[0093] Step 301: Receive the device information reported by each monitoring camera device in a set area around the target panoramic camera; wherein, the device information includes the first position information indicating the geographical location of the corresponding monitoring camera device.
[0094] In the embodiments of the present application, the device information includes the first position information indicating the geographical location of the corresponding monitoring camera device, and may also include other information of the monitoring camera device, such as device identification and device field of view angle, etc.
[0095] Specifically, when each monitoring device is installed, its corresponding geographical location information can be set, or when the monitoring device includes a positioning device, the current geographical location information of the monitoring device can also be located through the positioning device. Among them, the monitoring device may include the above-mentioned target panoramic camera and monitoring camera devices. Here, the monitoring camera device refers to other monitoring devices different from the target panoramic camera. Other monitoring devices may be other panoramic cameras or ordinary monitoring devices, that is, monitoring devices with a smaller field of view angle compared to the panoramic camera and capable of focusing on the image details of a specific monitoring area.
[0096] Among them, the first position information can be, for example, the GPS information of the monitoring device. Each monitoring device can report its own GPS information to the server, or the server can actively request to obtain the GPS information of each monitoring device. Considering that the position of each monitoring device usually does not change once it is installed, therefore, when each monitoring device is put into use, the server can collect the device information including the GPS information of each monitoring device and store it in the database, and then can directly obtain it from the database when needed.
[0097] Step 302: Based on the set jump plan rules, generate an automatic jump plan for the monitoring screen according to the target panoramic camera and the first position information corresponding to each monitoring camera device.
[0098] In one implementation, the automatic jump plan can be user-defined, that is, the user can define the order of the monitoring screen jumps, the stay time of each monitoring device, and the number of jumps of each monitoring device by themselves, and then send the automatic jump plan to the image display module. The image display module performs polling monitoring of the AR panoramic monitoring screen according to the automatic jump plan.
[0099] In one implementation, an automatic jump plan for the monitoring screen can be automatically generated according to the pre-selected jump plan rules and according to the target panoramic camera and the first position information corresponding to each monitoring camera device, without human participation, reducing the operation complexity of polling monitoring.
[0100] Next, different jump plan rules will be introduced separately.
[0101] (1) Jump plan rules based on the coordinate system angle algorithm
[0102] Since the above first position information is the position in the three-dimensional coordinate system, the first position information corresponding to the target panoramic camera and each monitoring camera device can be respectively mapped to the set two-dimensional coordinate system.
[0103] Among them, in this two-dimensional coordinate system, the target panoramic camera is used as the coordinate origin. Of course, in practical applications, other monitoring camera devices can also be used as the coordinate origin, or any other specified reference point can be used as the coordinate origin. The embodiments of the present application do not limit this.
[0104] See Figure 4 As shown, it is a schematic diagram of a jump route planning. Among them, here, taking the target panoramic camera as the coordinate origin is specifically shown as an example.
[0105] Specifically, after determining the coordinate origin, that is, using the GPS information of the target panoramic camera as the coordinate origin, project the GPS information of each monitoring camera device within the set area around the target panoramic camera onto a two-dimensional coordinate system.
[0106] When planning the jump route, it can be planned and distinguished according to the quadrants of the two-dimensional coordinate system. For example, Figure 4 As shown, according to the known positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system, the included angle value between the line connecting each monitoring camera device and the target panoramic camera and the set coordinate axis can be calculated by the following formula:
[0107]
[0108] Among them, θ is used to represent the included angle value between the line connecting the monitoring camera device and the target panoramic camera and the set coordinate axis. The range of θ is 0° to 360°. Here, specifically taking the positive direction of the Y-axis as the set coordinate axis as an example, (x i , y i ) respectively represent the coordinate values of the monitoring camera device S i in the two-dimensional coordinate system.
[0109] Furthermore, obtain the included angle value θ corresponding to each monitoring camera device respectively. Then, the jump route can be planned according to the included angle value θ of each monitoring camera device to generate an automatic jump plan for the monitoring screen.
[0110] Specifically, based on the magnitude of the included angle value θ of each monitoring camera device, sort them in ascending order, so as to number each monitoring camera device in the sorted order to generate an automatic jump plan for the monitoring screen. In the automatic jump plan, the automatic jump process is executed according to the numbers. For example, Figure 4 As shown, sorting according to the magnitude of the included angle value θ, an automatic jump plan of AR1→S1→S2→S3→S4→S5→S6 can be obtained, where AR1 represents the target panoramic camera, and S1 to S6 represent the monitoring camera devices.
[0111] (2) Jump plan rules based on the coordinate system distance algorithm
[0112] Similarly, first map the first position information corresponding to the target panoramic camera and each monitoring camera device respectively to the set two-dimensional coordinate system.
[0113] Among them, in this two-dimensional coordinate system, use the target panoramic camera or each monitoring camera device as the coordinate origin. Of course, in practical applications, or any other arbitrarily specified reference point can also be used as the coordinate origin, and this application embodiment does not limit this.
[0114] See Figure 4 As shown, after determining the coordinate origin, that is, taking the GPS information of the target panoramic camera as the coordinate origin, project the GPS information of each monitoring camera device within the set area around the target panoramic camera onto a two-dimensional coordinate system.
[0115] When planning the jump route, it can be planned and distinguished according to the quadrants of the two-dimensional coordinate system. For example Figure 4 As shown, according to the known positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system, the distances between each monitoring camera device and the coordinate origin can be determined respectively based on their positions in the two-dimensional coordinate system. For example, according to the Pythagorean theorem in a right triangle, the distance between each monitoring camera device and the target panoramic camera can be calculated by the following formula
[0116]
[0117] where d is used to represent the distance between the monitoring camera device and the target panoramic camera.
[0118] Furthermore, obtain the corresponding distance d of each monitoring camera device respectively. Then, the jump route can be planned according to the distances d of each monitoring camera device to generate an automatic jump plan for the monitoring screen.
[0119] Specifically, based on the magnitudes of the distances d of each monitoring camera device, sort them in ascending order, so as to number each monitoring camera device in the sorted order to generate an automatic jump plan for the monitoring screen. In the automatic jump plan, the automatic jump process is executed according to the numbers. For example Figure 4 As shown, sorting according to the magnitudes of the distances d, an automatic jump plan such as AR1→S5→S4→S3→S6→S1→S2 can be obtained.
[0120] (3) Jump plan rules based on the circular algorithm
[0121] In the embodiments of the present application, the device information may further include the field of view (FOV) corresponding to each monitoring camera device. Then, according to the field of view and the first position information of each monitoring camera device, it is possible to determine the monitoring camera devices existing within the field of view of each monitoring camera device, and then specify the automatic jump plan based on this.
[0122] Specifically, for the convenience of subsequent processing, the first position information corresponding to the target panoramic camera and each monitoring camera device can still be mapped to a set two-dimensional coordinate system. In this two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin. Then, starting from the target panoramic camera, traverse the target panoramic camera and each monitoring camera device in sequence. Based on the traversal result, an automatic jump plan is obtained.
[0123] In the actual application process, it can also start from other monitoring camera devices, and the embodiments of the present application do not limit this.
[0124] During each traversal operation, according to the field of view angle of the current traversed device and the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system, it can be determined whether there are other monitoring camera devices within the field of view angle area of the current traversed device. If there are other monitoring camera devices, the automatic jump plan is updated based on the other monitoring camera devices, that is, the other monitoring camera devices within the field of view angle area are added to the automatic jump plan. Among them, the current traversed device can be the target panoramic camera or a monitoring camera device, that is, the other monitoring camera devices newly added to the automatic jump plan.
[0125] Exemplarily, as shown in Figure 5 Starting from the AR panoramic camera, the camera monitoring devices visible within its field of view angle area are S1 and S2. Then, the two camera monitoring devices S1 and S2 are added to the automatic jump plan. Further, after S1 and S2 jump, they are traversed and viewed according to the camera monitoring devices visible within the field of view angle area. For example, S1 can see S3, and S2 can see S3 and S4. Then, an automatic jump plan like AR panoramic camera → S1 → S3 → S2 → S3 → S4 can be obtained.
[0126] It can be seen that in the above automatic jump plan, S3 is polled twice. Therefore, in order to avoid duplication, the duplicate monitoring camera devices can be removed. That is, if there are duplicate jumped monitoring camera devices in the traversal result, the duplicate jumped monitoring camera devices are de-duplicated to obtain the automatic jump plan. After de-duplication, the obtained automatic jump plan is AR panoramic camera → S1 → S3 → S2 → S4.
[0127] Currently, in actual application, it may also be the case that some camera monitoring devices are not detected because they are not within the field of view angle range. Then, this traversal algorithm needs to be continued for the undetected camera monitoring devices. For example, if S5 is not traversed, then S5 is added to the end of the above automatic jump plan and traversed continuously. Then, the automatic jump plan is updated to AR panoramic camera → S1 → S3 → S2 → S4 → S5.
[0128] Step 303: Based on the automatic jump plan, perform the monitoring screen switching action between the target panoramic camera and each monitoring camera device, so that the monitoring screens of the target panoramic camera and each monitoring camera device are sequentially displayed according to the automatic jump plan.
[0129] In the embodiment of the present application, after generating the automatic jump plan through the above process, the corresponding monitoring screen switching action can be performed according to the automatic jump plan, so that each monitoring screen is sequentially displayed on the display device.
[0130] In one implementation, if the above process is executed by the server to obtain the automatic jump plan, the server can perform the monitoring screen switching action and switch the video stream sent to the display device, so that the display device can switch to the next monitoring screen for display.
[0131] In one implementation, if the above process is executed by the display device to obtain the automatic jump plan, the display device can perform the monitoring screen switching action and switch the monitoring screen to be currently displayed.
[0132] In the embodiment of the present application, in order to reduce the generation complexity and accuracy of jump labels in the related art, a method for automatically creating jump labels is also provided. See Figure 6 As shown, it is a flow diagram of the process for automatically creating jump labels.
[0133] Step 601: Receive the device information reported by each monitoring camera device in the set area around the target panoramic camera.
[0134] The process of step 601 is the same as the process of step 301 above, so the introduction of step 301 can be referred to above, and it will not be elaborated here.
[0135] Step 602: Based on the coordinate conversion rule between the image coordinate system and the world coordinate system of the target panoramic camera, and the first position information corresponding to each monitoring camera device, determine the second position information of each monitoring camera device in the panoramic monitoring screen captured by the target panoramic camera.
[0136] In the embodiment of the present application, in order to facilitate the conversion of the coordinate systems of each monitoring camera device, the coordinate conversion rule between the coordinate systems can be created in advance.
[0137] In one embodiment, a method of calibrating point mapping can be used to create a coordinate conversion rule. Specifically, at least one reference point can be selected from the monitoring scene corresponding to the panoramic monitoring image, and the first reference position information of each of the at least one reference point in the monitoring scene, such as GPS information, can be obtained, and the second reference position information of the at least one reference point in the panoramic monitoring image can be obtained. For example, reference points such as landmark buildings that are easy to select in the panoramic monitoring image can be selected to facilitate accurate determination of their corresponding second reference position information from the panoramic monitoring image.
[0138] Furthermore, based on the obtained first reference position information and second reference position information, a coordinate conversion rule between the image coordinate system and the world coordinate system is established.
[0139] Furthermore, after obtaining the coordinate conversion rule, based on this coordinate conversion rule and the first position information corresponding to each monitoring camera device, the second position information of each monitoring camera device in the panoramic monitoring image captured by the target panoramic camera can be accurately determined, thus eliminating the need to artificially fix the positions of the monitoring camera devices, obviously reducing the operation complexity, and improving the accuracy of the subsequent generated jump labels.
[0140] See Figure 7 As shown, it is a schematic diagram for calculating the second position information. In actual application, the coordinate conversion rule can be integrated into an algorithm module, and then the GPS information of each monitoring camera device, the FOV of the target panoramic camera, and the calibration parameters, i.e., other required parameters, are input into the algorithm module. Then, the algorithm module converts the GPS information into the coordinate position information in the panoramic monitoring image based on the coordinate conversion rule.
[0141] Step 603: Generate jump labels for each monitoring camera device in the panoramic monitoring image based on the second position information.
[0142] See Figure 8 As shown, it is a schematic diagram of the information interface included in the jump label. The jump label includes label template information, label name, and priority information. The label template is used to indicate the display style adopted by the jump label, such as Figure 8 As shown, whether to display the name, whether to display the polyline, and the label transparency when the label is displayed, etc. These information can be configured in advance. The label name can be customized or automatically generated according to the device identifier of the monitoring camera device. The priority can be customized or automatically generated according to the monitoring type of the monitoring camera device. For example, the priority of the hospital site is higher, and the priority of the street scene is slightly lower.
[0143] Each of the above-mentioned pieces of information can be pre-configured for the monitoring camera device, and then a jump label is generated according to the second position information. The second position information indicates at which position of the panoramic monitoring screen the jump label is to be displayed when the panoramic monitoring screen is displayed.
[0144] Step 604: In response to the display trigger of the panoramic monitoring screen of the target panoramic camera, a display screen data packet is generated based on each generated jump label and the panoramic monitoring screen, so that the monitoring screen is displayed based on the display screen data packet.
[0145] Specifically, when the above process is implemented by the server, when the display device requires the panoramic monitoring screen, the server can generate a display screen data packet based on the panoramic monitoring screen and the jump label to be displayed on the panoramic monitoring screen, and send the display screen data packet to the display device. After the display device parses the display screen data packet, it can display the panoramic monitoring screen including the jump label.
[0146] Specifically, when the above process is implemented by the display device, when the display device needs to display the panoramic monitoring screen, corresponding jump label icons are drawn according to the second position information of the label to display the panoramic monitoring screen including the jump label.
[0147] See Figure 9 As shown in the figure, it is a schematic diagram of an example display of the panoramic monitoring screen. Among them, in this panoramic monitoring screen, two jump labels are displayed, that is Figure 9 the jump label 1 and the jump label 2 shown in the figure.
[0148] In the embodiment of the present application, the jump label can realize the function of quickly jumping to the monitoring screen of the specified monitoring camera device. Furthermore, in the panoramic monitoring screen shown in the figure Figure 9 the user can intuitively perceive the monitoring camera devices included in the monitoring area, and then can perform a trigger operation on the target jump label among each jump label. Correspondingly, the device can respond to the trigger operation, determine the target monitoring camera device corresponding to the target jump label, and then generate a new display screen data packet based on the target monitoring screen corresponding to the target monitoring camera device and the jump label in the target monitoring screen, and display the monitoring screen based on the new display screen data packet.
[0149] Exemplarily, when the AR panoramic cameras are deployed, these AR panoramic cameras will automatically complete the addition of jump labels. Then, when the display device is displaying, when viewing the screen of an AR panoramic camera 1, the screen of another AR camera 2 or other monitoring cameras can be seen in the screen. By directly clicking on the jump label corresponding to the AR camera 2 in the AR panoramic camera 1, the interface can directly jump and switch to the panoramic monitoring screen of the AR camera 2. According to this feature, continuous jumping can be achieved. It can be seen that with the emergence of automatic labels, AR machine vision will bring a new wave of platform business transformation, and the AR automatic jump method will be completely platformized.
[0150] In the embodiments of the present application, different monitoring cameras can correspond to different monitoring types. Therefore, when displaying jump labels, they can also be displayed by category.
[0151] Specifically, when generating jump labels, jump labels of each monitoring camera in the panoramic monitoring screen can be generated based on the second position information and the monitoring types corresponding to each monitoring camera, that is, the monitoring type can also be included in the jump label information.
[0152] In actual application, the user can select which monitoring type jump labels need to be displayed currently, so as to filter some jump labels and quickly find the monitoring camera that the user wants to jump to.
[0153] See Figure 10 As shown, it is a schematic diagram of jump label selection. Among them, jump labels of each monitoring type can be located on the same layer, so that after selecting jump labels of certain types, filtering can be directly performed according to the layer, which is more convenient and fast.
[0154] See Figure 10 As shown, the user can select jump labels of the target monitoring type for display from them, and then in response to the trigger operation for displaying jump labels of the target monitoring type, filter out jump labels corresponding to other monitoring types in the display screen data packet to generate a new display screen data packet, and then display based on the new display screen data packet to achieve the effect of displaying jump labels of the target monitoring type.
[0155] Such as Figure 10 As shown, the ones shown in the thick frame are the selected types that need to be displayed, that is, currently all jump labels are selected to be displayed. Currently, the total number of all labels is 2, that is, 2 jump labels need to be displayed in the panoramic monitoring image.
[0156] It should be noted that although the above mentions are all about displaying jump labels in the panoramic monitoring screen, in fact, jump labels can also be displayed in the monitoring screen of ordinary monitoring devices, and the method is the same as that of the above panoramic monitoring screen, which will not be elaborated here.
[0157] In summary, in the embodiments of the present application, according to the GPS position information of each camera, the coordinate system in the panoramic camera is obtained through an algorithm, and then tags are automatically added according to the setting module, avoiding manual participation in tag addition, enhancing usability, solving the unfriendly problem of manually adding tags before, solving the customer usability problem, preventing customers from getting involved in complex tag addition and deletion, and also avoiding problems such as omission of some camera calibrations. At the same time, through the logical algorithm of automatic jump and the automatic jump plan for establishing automatic jump of tags, the problem of automatic jump between jump tags is solved, bringing a more intelligent visual experience to users.
[0158] Please refer to Figure 11 , based on the same inventive concept, the embodiments of the present application also provide a polling device 110 for a panoramic monitoring screen, and the device includes:
[0159] A receiving unit 1101, configured to receive device information reported by each monitoring camera device within a set area around the target panoramic camera; wherein, the device information includes first position information indicating the geographical location where the corresponding monitoring camera device is located;
[0160] A jump planning unit 1102, configured to generate an automatic jump plan for the monitoring screen based on the set jump plan rule and according to the target panoramic camera and the first position information corresponding to each monitoring camera device;
[0161] A jump execution unit 1103, configured to execute a monitoring screen switching action between the target panoramic camera and each monitoring camera device based on the automatic jump plan, so that the monitoring screens of the target panoramic camera and each monitoring camera device are sequentially displayed according to the automatic jump plan.
[0162] Optionally, the device further includes a tag creation unit 1104, configured to:
[0163] Based on the coordinate conversion rule between the image coordinate system and the world coordinate system of the target panoramic camera, and the first position information corresponding to each monitoring camera device, determine the second position information of each monitoring camera device in the panoramic monitoring screen captured by the target panoramic camera;
[0164] Based on the second position information, generate jump tags for each monitoring camera device in the panoramic monitoring screen;
[0165] In response to the display trigger of the panoramic monitoring screen of the target panoramic camera, generate a display screen data packet based on the generated jump tags and the panoramic monitoring screen, so that the monitoring screen is displayed based on the display screen data packet.
[0166] Optionally, the jump execution unit 1103 is further configured to:
[0167] In response to a triggering operation performed on a target jump label among the respective jump labels, determine a target monitoring camera device corresponding to the target jump label;
[0168] Generate a new display screen data packet based on the target monitoring screen corresponding to the target monitoring camera device and the jump label in the target monitoring screen.
[0169] Optionally, the apparatus further includes a conversion rule determination unit 1105, configured to:
[0170] Select at least one reference point from the monitoring scene corresponding to the panoramic monitoring screen;
[0171] Obtain the first reference position information of each of the at least one reference point in the monitoring scene, and obtain the second reference position information of the at least one reference point in the panoramic monitoring screen;
[0172] Determine a coordinate conversion rule based on the obtained respective first reference position information and respective second reference position information.
[0173] Optionally, the label creation unit 1104 is specifically configured to:
[0174] Generate jump labels of each monitoring camera device in the panoramic monitoring screen based on the second position information and the monitoring type corresponding to each monitoring camera device;
[0175] After generating a display screen data packet based on the generated respective jump labels and the panoramic monitoring screen in response to a display trigger of the panoramic monitoring screen of the target panoramic camera, the method further includes:
[0176] In response to a triggering operation for displaying a jump label of the target monitoring type, filter out jump labels corresponding to other monitoring types in the display screen data packet to generate a new display screen data packet.
[0177] Optionally, the jump planning unit 1102 is specifically configured to:
[0178] Map the target panoramic camera and the first position information corresponding to each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera is used as the coordinate origin;
[0179] Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system, determine the included angle values between the connection lines between each monitoring camera device and the target panoramic camera and the set coordinate axes respectively;
[0180] Generate an automatic jump plan for the monitoring screen according to the included angle values corresponding to each monitoring camera device.
[0181] Optionally, the jump planning unit 1102 is specifically configured to:
[0182] Map the first position information corresponding to the target panoramic camera and each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin;
[0183] Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine the distances between each monitoring camera device and the coordinate origin respectively;
[0184] Generate an automatic jump plan for the monitoring screen according to the distances corresponding to each monitoring camera device.
[0185] Optionally, the device information further includes the field of view angles corresponding to each monitoring camera device;
[0186] Then the jump planning unit 1102 is specifically configured to:
[0187] Map the first position information corresponding to the target panoramic camera and each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin;
[0188] Starting from the target panoramic camera, sequentially perform traversal operations on the target panoramic camera and each monitoring camera device, and obtain an automatic jump plan based on the traversal results; wherein, each traversal operation includes:
[0189] According to the field of view angle of the currently traversed device, and the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine whether there are other monitoring camera devices within the field of view angle area of the currently traversed device; the currently traversed device is the target panoramic camera or a monitoring camera device;
[0190] If there are other monitoring camera devices, update the automatic jump plan based on the other monitoring camera devices.
[0191] Optionally, the jump planning unit 1102 is specifically configured to:
[0192] If there are monitoring camera devices with repeated jumps in the traversal results, perform duplicate removal processing on the monitoring camera devices with repeated jumps to obtain an automatic jump plan.
[0193] Through the above device, based on the GPS position information of each camera, the coordinate system in the panoramic camera can be obtained through an algorithm, and then tags can be automatically added according to the setting module, avoiding manual participation in tag addition, enhancing usability, solving the unfriendly problem of manually adding tags before, solving the customer usability problem, preventing customers from getting involved in complex tag addition and deletion, and also avoiding problems such as omission of some camera calibrations. At the same time, through the logical algorithm of automatic jump and the automatic jump plan for establishing automatic tag jump, the problem of automatic jump between jump tags is solved, bringing a more intelligent visual experience to users.
[0194] This device can be used to execute the methods shown in the embodiments of the present application. Therefore, for the functions that can be realized by each functional module of this device, reference can be made to the descriptions of the foregoing embodiments, and details will not be repeated.
[0195] Please refer to Figure 12 , based on the same inventive concept, an embodiment of the present application further provides a computer device 120, which can be Figure 1 the display device, server or front-end monitoring device shown in the figure. The computer device 120 may include a memory 1201 and a processor 1202.
[0196] The memory 1201 is used to store the computer program executed by the processor 1202. The memory 1201 may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function, etc.; the data storage area may store data created according to the use of the computer device. The processor 1202 may be a central processing unit (CPU) or a digital processing unit, etc. In the embodiments of the present application, the specific connection medium between the memory 1201 and the processor 1202 is not limited. In Figure 12 this embodiment, the memory 1201 and the processor 1202 are connected through a bus 1203. The bus 1203 is represented by a thick line in Figure 12 the figure. The connection manners of other components are only for illustrative purposes and are not to be construed as limiting. The bus 1203 may be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity, Figure 12 only one thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.
[0197] The memory 1201 can be a volatile memory, such as a random-access memory (RAM); the memory 1201 can also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD), or a solid-state drive (SSD), or the memory 1201 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 1201 can be a combination of the above memories.
[0198] The processor 1202 is configured to execute the methods performed by the devices in the embodiments of the present application when invoking the computer programs stored in the memory 1201.
[0199] In some possible implementation manners, various aspects of the method provided in the present application can also be implemented in the form of a program product, which includes program code. When the program product runs on a computer device, the program code is used to cause the computer device to execute the steps in the methods according to various exemplary implementation manners of the present application described above in this specification. For example, the computer device can execute the methods performed by the devices in the embodiments of the present application.
[0200] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection with one or more wires, a portable disk, a hard disk, a random-access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0201] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications falling within the scope of the present application.
[0202] Obviously, those skilled in the art can make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to cover these changes and modifications.
Claims
1. A polling method for panoramic monitoring images, characterized in that, The method includes: Receiving device information reported by each monitoring camera device within a set area around the target panoramic camera; wherein, the device information includes first position information indicating the geographical location where the corresponding monitoring camera device is located; Generating an automatic jump plan for the monitoring screen based on the set jump plan rules, according to the target panoramic camera and the first position information corresponding to each of the monitoring camera devices; Based on the automatic jump plan, performing a monitoring screen switching action between the target panoramic camera and each of the monitoring camera devices, so that the monitoring screens of the target panoramic camera and each of the monitoring camera devices are sequentially displayed according to the automatic jump plan.
2. The method according to claim 1, wherein After receiving the device information reported by each monitoring camera device within a set area around the target panoramic camera, the method further includes: Based on the coordinate conversion rule between the image coordinate system and the world coordinate system of the target panoramic camera, and the first position information corresponding to each of the monitoring camera devices, determining second position information of each of the monitoring camera devices in the panoramic monitoring screen captured by the target panoramic camera; Generating jump labels for each of the monitoring camera devices in the panoramic monitoring screen based on the second position information; In response to the display trigger of the panoramic monitoring screen of the target panoramic camera, generating a display screen data packet based on the generated jump labels and the panoramic monitoring screen, so that the monitoring screen is displayed based on the display screen data packet.
3. The method according to claim 2, wherein After generating a display screen data packet based on the generated jump labels and the panoramic monitoring screen in response to the display trigger of the panoramic monitoring screen of the target panoramic camera, the method further includes: In response to a trigger operation on a target jump label among the jump labels, determining the target monitoring camera device corresponding to the target jump label; Generating a new display screen data packet based on the target monitoring screen corresponding to the target monitoring camera device and the jump label in the target monitoring screen.
4. The method according to claim 2, characterized in that, Before determining the second position information of each of the monitoring camera devices in the panoramic monitoring screen captured by the target panoramic camera based on the coordinate conversion rule between the image coordinate system and the world coordinate system of the target panoramic camera, and the first position information corresponding to each of the monitoring camera devices, the method further includes: Selecting at least one reference point from the monitoring scene corresponding to the panoramic monitoring screen; Obtaining first reference position information of each of the at least one reference point in the monitoring scene, and obtaining second reference position information of the at least one reference point in the panoramic monitoring screen; Determining the coordinate conversion rule based on the obtained first reference position information and second reference position information.
5. The method according to claim 2, characterized in that, Generating jump labels for each of the monitoring camera devices in the panoramic monitoring screen based on the second position information includes: Generating jump labels for each of the monitoring camera devices in the panoramic monitoring screen based on the second position information and the monitoring type corresponding to each of the monitoring camera devices; After generating a display screen data packet based on each generated jump label and the panoramic monitoring screen in response to the display trigger of the target panoramic camera's panoramic monitoring screen, the method further includes: In response to a trigger operation for a jump label for displaying a target monitoring type, filter out jump labels corresponding to other monitoring types in the display screen data packet to generate a new display screen data packet.
6. The method according to any one of claims 1 to 5, characterized in that, Based on a set jump plan rule, generate an automatic jump plan for the monitoring screen according to the target panoramic camera and the first position information corresponding to each monitoring camera device, including: Map the target panoramic camera and the first position information corresponding to each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera is used as the coordinate origin; Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine the included angle values between the lines connecting each monitoring camera device and the target panoramic camera and a set coordinate axis respectively; Generate an automatic jump plan for the monitoring screen according to the included angle values corresponding to each monitoring camera device.
7. The method according to any one of claims 1 to 5, characterized in that, Based on a set jump plan rule, generate an automatic jump plan for the monitoring screen according to the target panoramic camera and the first position information corresponding to each monitoring camera device, including: Map the target panoramic camera and the first position information corresponding to each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin; Based on the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine the distances between each monitoring camera device and the coordinate origin respectively; Generate an automatic jump plan for the monitoring screen according to the distances corresponding to each monitoring camera device.
8. The method according to any one of claims 1 to 5, characterized in that, The device information further includes the field of view angles corresponding to each monitoring camera device; Then, based on a set jump plan rule, generate an automatic jump plan for the monitoring screen according to the target panoramic camera and the first position information corresponding to each monitoring camera device, including: Map the target panoramic camera and the first position information corresponding to each monitoring camera device to a set two-dimensional coordinate system respectively; wherein, in the two-dimensional coordinate system, the target panoramic camera or each monitoring camera device is used as the coordinate origin; Starting from the target panoramic camera, perform a traversal operation on the target panoramic camera and each monitoring camera device in turn, and obtain the automatic jump plan based on the traversal result; wherein, each traversal operation includes: According to the field of view angle of the currently traversed device and the positions of the target panoramic camera and each monitoring camera device in the two-dimensional coordinate system respectively, determine whether there are other monitoring camera devices within the field of view angle area of the currently traversed device; the currently traversed device is the target panoramic camera or a monitoring camera device; If there are other monitoring camera devices, update the automatic jump plan based on the other monitoring camera devices.
9. The method according to claim 8, characterized in that, Starting from the target panoramic camera, perform a traversal operation on the target panoramic camera and each of the monitoring camera devices in sequence. Based on the traversal result, obtain the automatic jump plan, including: If there are monitoring camera devices with repeated jumps in the traversal result, perform deduplication processing on the monitoring camera devices with repeated jumps to obtain the automatic jump plan.
10. A polling device for panoramic monitoring images, characterized in that, The device includes: A receiving unit, configured to receive device information reported by each of the monitoring camera devices within a set area around the target panoramic camera; wherein, the device information includes first position information indicating the geographical location of the corresponding monitoring camera device. A jump planning unit, configured to generate an automatic jump plan for the monitoring screen based on the set jump plan rules according to the target panoramic camera and the first position information corresponding to each of the monitoring camera devices. A jump execution unit, configured to perform a monitoring screen switching action between the target panoramic camera and each of the monitoring camera devices based on the automatic jump plan, so that the monitoring screens of the target panoramic camera and each of the monitoring camera devices are sequentially displayed according to the automatic jump plan.
11. A computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 9 are implemented.
12. A computer storage medium, on which computer program instructions are stored, characterized in that: When the computer program instructions are executed by the processor, the steps of the method according to any one of claims 1 to 9 are implemented.
13. A computer program product, including computer program instructions, characterized in that: When the computer program instructions are executed by the processor, the steps of the method according to any one of claims 1 to 9 are implemented.
Citation Information
Patent Citations
Disaster situation position determination method and device, storage medium and electronic device
CN110706447A
Multi-view-field extension method and device based on edge information mining
CN110855941A
Panoramic monitoring display method, device and system and computer readable storage medium
CN111031293A
Video patrol method and device, electronic equipment and storage medium
CN113905211A