Scene data display method, device, equipment and storage medium
By using the area registration diagram in the monitoring system to display the first scene data of each target scene area, the problem of unintuitive changes in scene status information when monitoring large-area scenes is solved, and efficient and real-time scene data display is achieved.
Patent Information
- Application Number
- CN202010153124.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-03-06
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2040-03-06
AI Technical Summary
When monitoring large-area scenes, multiple cameras monitor each area separately, resulting in unintuitive changes in scene status information and it is difficult to locate the location and flow direction of specific items in real time.
By obtaining the area registration map of the scene to be displayed, the first scene data of each target scene area is extracted, and displayed according to its placement position in the area registration map, and the display data is updated to achieve real-time monitoring.
It realizes the intuitive and comprehensive display of large-area scene data, improves the real-time performance of scene data display, reduces the calculation amount and time-consuming of image registration algorithms, and meets the real-time needs of monitoring scenarios.
Smart Images

Figure CN113361306B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of image processing technology, and specifically to a method, device, equipment and storage medium for displaying scene data. Background Art
[0002] In real life, the status information of a scene area is often monitored through video. When a large area needs to be monitored, multiple cameras are often used to monitor multiple different areas. However, there are the following problems when multiple cameras monitor each area separately: the changes in the scene status information cannot be intuitively and clearly reflected.
[0003] For example, in large-scale sorting yards in the logistics field, there are a large number of express parcels to be sorted. If you want to check the location, flow direction and other information of a particular parcel under the monitoring of multiple cameras, you need to check the monitoring images of each camera separately to confirm. Summary of the invention
[0004] The embodiments of the present application provide a method, apparatus, device and storage medium for displaying scene data, which can intuitively and comprehensively display scene data and improve the real-time performance of scene data display.
[0005] On the one hand, an embodiment of the present application provides a method for displaying scene data, the method comprising:
[0006] Acquire a regional registration map of a scene to be displayed, and extract first scene data of each target scene area to which the scene to be displayed belongs;
[0007] Determine a first coordinate of each of the first scene data, where the first coordinate refers to a display position of the first scene data in the regional registration map;
[0008] According to the first coordinates, the respective first scene data are displayed in the region registration map.
[0009] In some embodiments of the present application, after displaying the respective first scene data in the region registration map according to the first coordinate, the method further includes:
[0010] Extracting second scene data of each target scene area, wherein acquisition time of the second scene data lags behind acquisition time of the first scene data;
[0011] Acquire a target identification number of the target scene area corresponding to the second scene data;
[0012] The respective first scene data displayed in the region registration map are updated according to the second scene data and the target identification number.
[0013] In some embodiments of the present application, extracting the first scene data of each target scene area to which the scene to be displayed belongs includes:
[0014] Acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs, wherein each of the target scene regions corresponds to one regional image;
[0015] According to each of the area images, first scene data of each of the target scene areas is extracted.
[0016] In some embodiments of the present application, the first scene data includes display information of a target object existing in the target scene area, and extracting the first scene data of each target scene area according to each area image includes:
[0017] Inputting each of the area images into a recognition model, so that the recognition model determines whether a target object exists in the target scene area according to the area image;
[0018] If it is determined that the target object exists in the target scene area, determining identification information of the target object according to the area image;
[0019] According to the identification information, display information of the target object existing in each of the target scene areas is determined.
[0020] In some embodiments of the present application, determining the first coordinate of each first scene data includes:
[0021] Obtaining an identification number of each target scene area, and determining a second coordinate of the target object according to the area image, wherein the second coordinate refers to a position of the target object in the target scene area;
[0022] Determine a third coordinate of each target scene region according to the identification number, wherein the third coordinate refers to a region position corresponding to the target scene region in the region registration map;
[0023] The first coordinate of each of the first scene data is determined according to the second coordinate and the third coordinate.
[0024] In some embodiments of the present application, the step of obtaining a regional registration map of a scene to be displayed includes:
[0025] Determine multiple scene areas to which the scenes to be displayed belong;
[0026] Obtaining the relative position relationship of each scene area;
[0027] The regional registration map is generated according to the relative position relationship.
[0028] In some embodiments of the present application, displaying each of the first scene data in the region registration map according to the first coordinates includes:
[0029] Fill each of the first scene data into the regional registration map according to the first coordinates of each of the first scene data to form a target scene data map;
[0030] The target scene data graph is displayed.
[0031] On the other hand, an embodiment of the present application provides a display device for scene data, the display device for scene data comprising:
[0032] An acquisition unit, used for acquiring a regional registration map of a scene to be displayed, and extracting first scene data of each target scene region to which the scene to be displayed belongs;
[0033] a determining unit, configured to determine a first coordinate of each of the first scene data extracted by the acquiring unit, wherein the first coordinate refers to a display position of the first scene data in the regional registration map;
[0034] A display unit is used to display the various first scene data in the region registration map according to the first coordinates determined by the determination unit.
[0035] In some embodiments of the present application, the acquisition unit is further configured to:
[0036] Extracting second scene data of each target scene area, wherein acquisition time of the second scene data lags behind acquisition time of the first scene data;
[0037] Acquire a target identification number of the target scene area corresponding to the second scene data;
[0038] The respective first scene data displayed in the region registration map are updated according to the second scene data and the target identification number.
[0039] In some embodiments of the present application, the acquisition unit is specifically used to:
[0040] Acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs, wherein each of the target scene regions corresponds to one regional image;
[0041] According to each of the area images, first scene data of each of the target scene areas is extracted.
[0042] In some embodiments of the present application, the first scene data includes display information of a target object existing in the target scene area, and the acquisition unit is specifically configured to:
[0043] Inputting each of the area images into a recognition model, so that the recognition model determines whether a target object exists in the target scene area according to the area image;
[0044] If it is determined that the target object exists in the target scene area, determining identification information of the target object according to the area image;
[0045] According to the identification information, display information of the target object existing in each of the target scene areas is determined.
[0046] In some embodiments of the present application, the determining unit is specifically configured to:
[0047] Obtaining an identification number of each target scene area, and determining a second coordinate of the target object according to the area image, wherein the second coordinate refers to a position of the target object in the target scene area;
[0048] Determine a third coordinate of each target scene region according to the identification number, wherein the third coordinate refers to a region position corresponding to the target scene region in the region registration map;
[0049] The first coordinate of each of the first scene data is determined according to the second coordinate and the third coordinate.
[0050] In some embodiments of the present application, the acquisition unit is specifically used to:
[0051] Determine multiple scene areas to which the scenes to be displayed belong;
[0052] Obtaining the relative position relationship of each scene area;
[0053] The regional registration map is generated according to the relative position relationship.
[0054] In some embodiments of the present application, the display unit is specifically used for:
[0055] Fill each of the first scene data into the regional registration map according to the first coordinates of each of the first scene data to form a target scene data map;
[0056] The target scene data graph is displayed.
[0057] On the other hand, an embodiment of the present application also provides a scene data display device, which includes a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, it executes the steps of any scene data display method provided in the embodiment of the present application.
[0058] On the other hand, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the steps in the scene data display method.
[0059] The embodiment of the present application obtains a regional registration map of the scene to be displayed, and extracts the scene data of each target scene area of the scene to be displayed; determines and displays the scene data of each target scene area in the regional registration map according to the display position of each scene data in the regional registration map. On the one hand, the scene data of a large scene area can be displayed intuitively and comprehensively. On the other hand, since effective scene data is extracted and fused to realize the display of comprehensive data, it avoids the problem of directly splicing a large number of images to realize the display of comprehensive data, thereby avoiding the large amount of calculation and time-consuming problems of the image registration algorithm, reducing the amount of data processing, improving the efficiency of scene data fusion, and meeting the real-time requirements of the monitoring scene. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0061] Figure 1 It is a schematic diagram of an application scenario of the method for displaying scene data provided in an embodiment of the present application;
[0062] Figure 2 This is a flow chart of an embodiment of a method for displaying scene data provided in an embodiment of the present application;
[0063] Figure 3 is a schematic diagram comparing a scene to be displayed and a regional registration map provided in an embodiment of the present application;
[0064] Figure 4 is a schematic diagram of a regional registration map provided in an embodiment of the present application;
[0065] Figure 5 is a schematic diagram of the coordinates of the regional registration map of the embodiment of the present application;
[0066] Figure 6 It is a flowchart of another embodiment of the method for displaying scene data provided in the embodiments of the present application;
[0067] Figure 7 is a scene schematic diagram of coordinates corresponding to the target scene area provided in an embodiment of the present application;
[0068] Figure 8is a schematic diagram of the structure of an embodiment of a display device for scene data provided in an embodiment of the present application;
[0069] Fig. 9 It is a schematic diagram of the structure of an embodiment of a scene data display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0070] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0071] In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0072] In order to enable any person skilled in the art to implement and use the present application, the following description is provided. In the following description, details are listed for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present application can also be implemented without using these specific details. In other examples, the known process will not be elaborated in detail to avoid unnecessary details that make the description of the present application embodiment obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in accordance with the embodiments of the present application.
[0073] First of all, before introducing the embodiments of the present application, the relevant content about the application background of the embodiments of the present application is introduced.
[0074] In the field of logistics, logistics transfer stations often undertake a large number of express delivery sorting tasks. Due to the limited field of view of a single camera and the relatively large area of a logistics transfer station, it is difficult to fully monitor multiple sorting areas of a logistics transfer station with one camera; in order to fully monitor the sorting conditions of each sorting area of a logistics transfer station (such as whether there are express deliveries in a certain transfer station, where a certain express delivery has arrived, and the flow direction of a certain express delivery, etc.), it is necessary to install multiple cameras to monitor different field of view areas respectively.
[0075] However, the images or videos taken by each camera are independent, and managers need to check the surveillance images of the cameras corresponding to each field of view one by one to determine where a particular express has reached.
[0076] By using existing image stitching technology, multiple images can be stitched together to form a panoramic view of the entire logistics transfer site. Based on the stitched panoramic view, managers can intuitively and comprehensively see the status information of the entire logistics transfer site, thereby quickly locating the location of the express.
[0077] However, image stitching technology relies on image registration algorithms, which are generally very computationally intensive and cannot adapt to the fusion of large amounts of images. On the one hand, the panoramic view of the entire logistics transfer site needs to be composed of images taken by multiple cameras. The amount of data processing required to form a panoramic view is large, and it is difficult to meet the large amount of data processing requirements in terms of hardware conditions. On the other hand, real-time monitoring scenarios have high requirements for data real-time performance. Image stitching technology will take a long time to process large amounts of data, so it is not suitable for real-time monitoring.
[0078] Based on the above-mentioned defects existing in the existing related technologies, an embodiment of the present application provides a method for displaying scene data. By extracting useful data from the field of view of each camera and filling it into a preset regional registration map, and displaying the useful data within the field of view of each camera in the preset regional registration map, the useful data of each area can be displayed comprehensively and intuitively, thereby overcoming the defects existing in the existing related technologies at least to a certain extent.
[0079] The present application embodiment provides a method for displaying scene data. Figure 1 , Figure 1 Schematic diagram of an application scenario of the method for displaying scene data provided in an embodiment of the present application. In an embodiment of the present application, the method for displaying scene data can be applied to any data monitoring scenario, specifically a scenario monitored by multiple cameras, for example, it can be applied to traffic flow monitoring on a road, such as Figure 1 (a). For example, in a sorting scenario, it is used to locate and monitor the flow of items to be sorted (such as packages). Figure 1 As shown in (b), the field of view of each camera can cover the area of multiple conveyor plates (each square in the figure represents a conveyor plate), and each conveyor plate is used to convey items in various directions.
[0080] The executor of the scene data display method of the embodiment of the present application may be a scene data display device provided in the embodiment of the present application, or a server device, a physical host or a user equipment (UE) and other different types of scene data display devices integrated with the scene data display device, wherein the scene data display device may be implemented in hardware or software, and the UE may specifically be a terminal device such as a smart phone, a tablet computer, a laptop computer, a PDA, a handheld computer, a desktop computer or a personal digital assistant (PDA).
[0081] The scene data display device can adopt a single-operation working mode, or it can also adopt a device cluster working mode. By applying the scene data display method provided in the embodiment of the present application, the scene data can be displayed intuitively and comprehensively, and the real-time performance of the scene data display can be improved.
[0082] Next, we will begin to introduce the scene data display method provided in the embodiment of the present application. In the embodiment of the present application, the scene data display device is used as the execution subject. For the sake of simplicity and ease of description, the execution subject will be omitted in the subsequent method embodiments, or the scene data display device will be directly referred to as the device (unless otherwise stated, the device refers to the scene data display device). The scene data display method includes: obtaining a regional registration map and extracting the first scene data of each target scene area; determining the first coordinates of each of the first scene data; and displaying the respective first scene data in the regional registration map according to the first coordinates.
[0083] Reference Figure 2 , Figure 2 A flow chart of a method for displaying scene data provided in an embodiment of the present application. It should be noted that although a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in a different order than that shown here. The method for displaying scene data includes steps S10 to S30, wherein:
[0084] S10, obtaining a regional registration map of the scene to be displayed, and extracting the first scene data of each target scene area to which the scene to be displayed belongs. Step S10 includes:
[0085] (1) Obtain the regional registration map of the scene to be displayed.
[0086] Among them, the scene to be displayed can be a crossroads or a sorting field, etc. The scene to be displayed is monitored by multiple cameras, and each target scene area refers to the field of view area covered by each camera. The regional registration map refers to a schematic diagram generated according to the relative positions of each scene area of the scene to be displayed (one scene area corresponds to the field of view area covered by one camera), and the actual shape, size and other characteristics of each scene area. The regional registration map is used to indicate the relative positions of each target scene area, and the area size of each target scene area. A plurality of block areas (such as rectangular areas) are divided in the regional registration map, and each block area is used to represent a target scene area. Therefore, through the display of each block area, the regional registration map approximately displays the scene to be displayed. In an embodiment of the present application, the regional registration map is used to approximately simulate the actual situation of the scene to be displayed. It is a schematic diagram generated by the actual shape, size and other characteristics of each scene area, so it is called a regional registration map. In an embodiment of the present application, the regional registration map can be regarded as a template map.
[0087] To understand the relationship between the scene to be displayed and the regional registration map, please refer to Figure 3 , Figure 3 is a schematic diagram of the comparison between the scene to be displayed and the regional registration map provided in the embodiment of the present application; the intersection scene (i.e., the scene to be displayed) is as follows Figure 3 (a), where each dotted rectangular box represents the coverage area of each camera’s field of view; the regional registration map corresponding to the intersection scene is shown in Figure 3 (b) as shown.
[0088] There are many ways to obtain the regional registration map of the scene to be displayed. For example, a preset regional registration map is stored locally in the scene data display device, and the scene data display device can directly read the preset regional registration map inside the device. Alternatively, a third-party device generates a regional registration map based on the scene to be displayed, and the scene data display device establishes a network connection with the third-party device, and the scene data display device obtains the regional registration map from the third-party device. Alternatively, the scene data display device obtains and generates a regional registration map of the scene to be displayed based on multiple target scene areas to which the scene to be displayed belongs that are manually input.
[0089] (2) Extracting the first scene data of each target scene area to which the scene to be displayed belongs.
[0090] The first scene data of each target scene area refers to the useful data of the target scene area. For example, the useful data in the sorting field is: whether there are express parcels in the sorting area, the size, shape, type and other information of the express parcels in the sorting area. The useful data in road monitoring is: whether there are vehicles on the road, the model and license plate number of the vehicles on the road and other information.
[0091] Specifically, the step of extracting the first scene data of each target scene area belonging to the scene to be displayed may include: first, based on multiple cameras monitoring the scene to be displayed, acquiring an image of each target scene area; then, identifying the image of each target scene area and extracting useful data of the target scene area therefrom as the first scene data of the target scene area.
[0092] In some embodiments of the present application, the step of obtaining a regional registration map of the scene to be displayed specifically includes: determining multiple scene areas of the scene to be displayed; obtaining the relative position relationship of the respective scene areas; and generating the regional registration map based on the relative position relationship.
[0093] Among them, the relative position relationship of each scene area refers to the position relationship of each scene area in the actual scene to be displayed. For the convenience of understanding, a specific embodiment is used for explanation. For example, the scene to be displayed is a sorting field. First, it is determined that the fields of view of each camera in the sorting field cover scene area 1, scene area 2, scene area 3, and scene area 4 respectively, and the scene areas covered by each camera field of view are the same size, and each scene area covered by the camera field of view includes 4 conveyor plates of the same size. Then, the relative position relationship of each scene area is obtained. Finally, a specific representation form (such as a rectangular area) is used to represent each conveyor plate, and according to the position and size relationship of each conveyor plate in each scene area, the rectangular areas representing each conveyor plate are spliced together to generate a registration map of the corresponding domain of the scene area. Then, according to the relative position relationship of each scene area, the corresponding registration maps representing each scene area are spliced together to generate a registration map such as Figure 4 The regional registration map shown.
[0094] There are many ways to obtain the relative position relationship of each scene area, for example, obtaining the relative position relationship input by the user. For another example, obtain the images of each scene area, then use the image stitching technology to stitch the images of each scene area to form a panoramic view of the scene to be displayed, and identify the panoramic view to determine the relative position relationship of each scene area; specifically, first establish a coordinate system, and use coordinates to represent the panoramic view of the scene to be displayed; then, determine the coordinates corresponding to the image of each scene area in the panoramic view; finally, according to the coordinates corresponding to the image of each scene area, determine the relative position relationship of each scene area (for example, determine that scene area 1 is adjacent to scene area 2 and is directly above scene area 2; determine that scene area 3 is adjacent to scene area 4 and is directly to the left of scene area 2). When it is necessary to generate a regional registration map according to the relative position relationship of each scene area, first clarify the representation form of each scene area (such as using a rectangular area representation, or a triangular area representation); then, directly generate the regional registration map based on the coordinates and representation form corresponding to the images of each scene area, and based on the proportional relationship between the panoramic view and the regional registration map (the specific proportional relationship can be pre-set).
[0095] In an embodiment of the present application, a regional registration map is generated based on the relative positional relationship of multiple scene areas of the scene to be displayed. Since the regional registration map matches the actual scene to be displayed, the authenticity and comprehensiveness of the scene data displayed in the regional registration map are improved, so that managers can more intuitively see the useful data in the scene to be displayed.
[0096] S20: Determine the first coordinates of each of the first scene data.
[0097] The first coordinate refers to the display position of the first scene data in the regional registration map.
[0098] Specifically, first, a basic coordinate system is established, and each point of the regional registration map is represented in the coordinate form of the basic coordinate system. Then, according to the representation area of each target scene area in the regional registration map and the coordinates of each point of the regional registration map, the coordinates of each target scene area in the regional registration map are determined. Finally, the identification number of the target scene area corresponding to the first scene data is obtained, and the coordinates of the target scene area of the identification number in the regional registration map are obtained as the first coordinates of the first scene data. Similarly, the first coordinates of each first scene data are determined.
[0099] For example, if the scene to be displayed is a scene area captured by four cameras (the scene area covered by each camera is a target scene area), then the regional registration map also has four corresponding areas, representing the four target scene areas. The points of the regional registration map are represented in the form of coordinates of the basic coordinate system, and each target scene area is represented by a unit coordinate. The representation range of the regional registration map is (0, 0) to (2, 2), such as Figure 5 As shown. Among them, if the identification number of the target scene area corresponding to the first scene data is "1", the first coordinates of the first scene data are determined to be (0, 0) to (1, 1). If the identification number of the target scene area corresponding to the first scene data is "2", the first coordinates of the first scene data are determined to be (1, 0) to (2, 1). If the identification number of the target scene area corresponding to the first scene data is "3", the first coordinates of the first scene data are determined to be (0, 1) to (1, 2). If the identification number of the target scene area corresponding to the first scene data is "4", the first coordinates of the first scene data are determined to be (1, 1) to (2, 2).
[0100] S30. Display each of the first scene data in the region registration map according to the first coordinates.
[0101] Specifically, first, according to the first coordinates of each first scene data, each first scene data is filled into the corresponding position of the regional registration map to form a target scene data map; then, the target scene data map is displayed.
[0102] For ease of understanding, the example in S20 of the above step is continued. For example, if the first coordinate of the first scene data is (0, 0) to (1, 1), the first scene data is filled in the corresponding regional position of (0, 0) to (1, 1) in the regional registration map. If the first coordinate of the first scene data is (1, 0) to (2, 1), the first scene data is filled in the corresponding regional position of (1, 0) to (2, 1) in the regional registration map. If the first coordinate of the first scene data is (0, 1) to (1, 2), the first scene data is filled in the corresponding regional position of (0, 1) to (1, 2) in the regional registration map. If the first coordinate of the first scene data is (1, 1) to (2, 2), the first scene data is filled in the corresponding regional position of (1, 1) to (2, 2) in the regional registration map. Finally, a target scene data graph is formed, and the target scene data graph is displayed.
[0103] After executing the above steps S10 to S30, the scene data of each scene area at a certain moment can be displayed simultaneously and comprehensively. By repeatedly executing steps S10 to S30, the scene data of each scene area at multiple moments can be displayed simultaneously and comprehensively, and real-time monitoring can be achieved.
[0104] In an embodiment of the present application, a regional registration map of the scene to be displayed is obtained, and scene data of each target scene area of the scene to be displayed is extracted; the scene data of each target scene area is displayed in the regional registration map according to the display position of each scene data in the regional registration map. On the one hand, the scene data of a large scene area can be displayed intuitively and comprehensively. On the other hand, since effective scene data is extracted and fused to realize the display of comprehensive data, it avoids directly splicing a large number of images to realize the display of comprehensive data, thereby avoiding the problem of large amount of calculation and time consumption of the image registration algorithm, reducing the amount of data processing, improving the efficiency of scene data fusion, and meeting the real-time requirements of the monitoring scene.
[0105] In some embodiments of the present application, step S30 may specifically include the following steps (a1) to (a2):
[0106] (a1) filling each of the first scene data into the regional registration map according to the first coordinates of each of the first scene data to form a target scene data map;
[0107] Specifically, first, determine whether there is a target object in the target scene area according to the first scene data. If there is a target object in the target scene area, then further determine the display information of the target object according to the first scene data. Then, according to the first coordinate of the first scene data, fill the display information into the first scene data filling regional registration map. If there is no target object in the target scene area, then according to the first coordinate of the first scene data, clear the display information of the area corresponding to the first coordinate in the regional registration map. Finally, complete filling each first scene data into the regional registration map to form a final target scene data map.
[0108] Taking the sorting monitoring scene as an example, for example, the target scene areas of the scene to be displayed are: sorting area 1, sorting area 2, sorting area 3, and sorting area 4. The regional registration map corresponds to the display of sorting area 1, sorting area 2, sorting area 3, and sorting area 4. If there are no items in sorting area 1, and there are clothing items in sorting area 2, cosmetics in sorting area 3, and food in sorting area 4, then no information is displayed in the sorting area 1 corresponding to the regional registration map, the logo of clothing items is displayed in the sorting area 2 corresponding to the regional registration map, the logo of cosmetics is displayed in the sorting area 3 corresponding to the regional registration map, and the logo of food is displayed in the sorting area 2 corresponding to the regional registration map, so as to form the final target scene data map.
[0109] (a2) Displaying the target scene data graph.
[0110] Finally, the target scene data graph is displayed through a display device so that the user can intuitively and comprehensively see the useful data of the scene to be displayed.
[0111] It can be seen from the above content that in an embodiment of the present application, by filling each first scene data into a regional registration map according to the first coordinate of each first scene data, a target scene data map is formed, so that the target scene data map can comprehensively display the scene data of the scene to be displayed. By viewing the target scene data map, the user can intuitively and comprehensively see the useful data of the scene to be displayed.
[0112] In actual application scenarios, for example, when monitoring various roads, real-time monitoring is usually required. Repeated execution of the above steps S10 to S30 can achieve the effect of real-time monitoring. However, this real-time monitoring method requires repeated acquisition of the regional registration map of the scene to be displayed and determination of the coordinates of each target scene area in the regional registration map, resulting in a large amount of data to be processed. Figure 6 In order to further reduce the amount of data to be processed and thus improve the real-time performance of scene data display, in an embodiment of the present application, after the step of displaying each of the first scene data in the regional registration map according to the first coordinate, the following steps S40 to S60 are also included:
[0113] S40: Extract second scene data of each target scene area.
[0114] The second scene data of each target scene area refers to the useful data of the target scene area. For example, the useful data in the sorting field is: whether there are express parcels in the sorting area, the size, shape, type and other information of the express parcels in the sorting area. The useful data in road monitoring is: whether there are vehicles on the road, the model and license plate number of the vehicles on the road and other information. The difference between the first scene data and the second scene data is that the acquisition time of the second scene data lags behind the acquisition time of the first scene data.
[0115] Among them, one implementation method of "extracting the second scene data of each target scene area" is: first, based on multiple cameras monitoring the scene to be displayed, an image of each target scene area is acquired; then, the image of each target scene area is identified, and useful data of the target scene area is extracted therefrom as the second scene data of the target scene area.
[0116] S50: Obtain a target identification number of the target scene area corresponding to the second scene data.
[0117] Among them, the target identification number refers to the identification mark used to distinguish the target scene area. For example, in the logistics sorting scenario, through the image of the target scene area with the identification number "1", the useful data extracted is "the existence of envelope parcel" (i.e., the second scene data). Through the image of the target scene area with the identification number "2", the useful data extracted is "the existence of box parcel" (i.e., the second scene data). Through the image of the target scene area with the identification number "3", the useful data extracted is "the absence of parcel" (i.e., the second scene data). Then the target identification number of the target scene area corresponding to "the existence of envelope parcel" is "1", the target identification number of the target scene area corresponding to "the existence of box parcel" is "2", and the target identification number of the target scene area corresponding to "the absence of parcel" is "3".
[0118] S60: Update the respective first scene data displayed in the region registration map according to the second scene data and the target identification number.
[0119] Specifically, first, the coordinates of each target scene area determined in step S20 in the regional registration map are obtained. Then, according to the target identification number of the target scene area corresponding to the second scene data, the coordinates of the target scene area corresponding to the second scene data in the regional registration map are determined as the target display position of the second scene data in the regional registration map. Finally, the first scene data having the same first coordinates as the target display position is replaced with the second scene data. Similarly, each first scene data displayed in the regional registration map is updated.
[0120] In the embodiment of the present application, by extracting the second scene data that lags behind the first scene data, and updating the first scene data displayed in the regional registration map according to the target identification number of the target scene area corresponding to the second scene data, and the second scene data, on the one hand, the real-time monitoring requirements of the scene to be displayed are achieved. On the other hand, there is no need to repeatedly obtain the regional registration map of the scene to be displayed and determine the coordinates of each target scene area in the regional registration map, which reduces the amount of data processing and improves the real-time performance of scene data display.
[0121] In some embodiments of the present application, the step of extracting the first scene data of each target scene area to which the scene to be displayed belongs specifically includes the following steps (b1) and (b2):
[0122] (b1) Acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs.
[0123] Among them, each target scene area corresponds to a regional image.
[0124] In actual applications, a display device that uses the scene data provided by the present application may directly include the various surveillance cameras in the scene to be displayed in terms of hardware, and locally store the area images captured by each camera, which can be directly read inside the device; alternatively, the device may establish a network connection with each camera in the scene to be displayed, and obtain the area images captured by each camera online from each camera based on the network connection; alternatively, the device may read the area images captured by each camera from a related storage medium that stores the area images captured by each camera in the scene to be displayed, and the specific acquisition method is not limited here.
[0125] (b2) Extracting first scene data of each target scene area based on each of the area images.
[0126] Specifically, the regional image of each target scene area is identified respectively, and it is detected whether there is a target object in the regional image (for example, in a logistics sorting monitoring scenario, it is detected whether there is a package in the regional image; in a road monitoring scenario, it is detected whether there is a vehicle in the regional image). If it is detected that there is no target object in the regional image, the first scene data of the corresponding target scene area is determined as the absence of the target object.
[0127] If a target object is detected in the regional image, the regional image is further identified to detect the attribute information of the target object, and the first scene data is determined to contain the target object and the attribute information of the target object, so that the display information in the regional registration map can be determined directly based on the first scene data.
[0128] In an embodiment of the present application, a regional image of each target scene area is obtained, and useful data is extracted as the first scene data based on the regional image of each target scene area, so that the first scene data can be subsequently displayed in the regional registration map. On the one hand, a comprehensive and intuitive display of useful data of the scene to be displayed is achieved. On the other hand, direct image stitching of the regional images of the target scene area taken by each camera is avoided, thereby avoiding the problem of large data processing volume, improving data processing efficiency, and meeting the real-time requirements of the monitoring scene.
[0129] In order to accurately extract the first scene data of each target scene area, in some embodiments of the present application, the first scene data includes display information of the target object existing in the target scene area, and the step of extracting the first scene data of each target scene area according to each of the area images specifically includes the following steps (c1) to (c3):
[0130] (c1) inputting each of the area images into a recognition model, so that the recognition model determines whether a target object exists in the target scene area according to the area image.
[0131] First, a recognition model is obtained. Specifically, a plurality of sample images are obtained, and the sample images are input into the initial model. The initial model is trained continuously with the goal of outputting whether a target object exists, until the training stop condition is met, and the trained initial model is determined as the recognition model, which is used to detect whether a target object exists in the target scene area according to the regional image.
[0132] Then, the recognition model is used to detect whether there is a target object in the target scene area. Specifically, each area image is input into the recognition model, and the detection result output by the recognition model is extracted.
[0133] (c2) If it is determined that the target object exists in the target scene area, determining identification information of the target object based on the area image.
[0134] Among them, the identification information refers to the attribute information of the target object, such as the type and size, which is used to distinguish the object. For example, in the sorting monitoring scenario, the identification information of the target object can be a box, an envelope, the size of the box, the size of the envelope, and other information.
[0135] If the detection result output by the recognition model is that a target object exists in the target scene area, recognition information of the target object in the target scene area is further determined based on the area image.
[0136] One implementation of "determining the identification information of the target object based on the area image" is: further identifying the identification information of the target object through a recognition model, and extracting the identification information output by the recognition model, so as to subsequently determine the display information of the target object existing in the target scene area based on the identification information of the target object.
[0137] Another implementation of "determining the identification information of the target object according to the regional image" is: first, the regional image is compared with a plurality of preset reference images respectively, and the image similarity between the regional image and each reference image is obtained. And based on the image similarity between the regional image and each reference image, a target reference image is obtained, wherein the target reference image refers to the reference image with the greatest image similarity with the regional image. Then, the identification information of the target object is obtained and determined according to the information tag of the target reference image, wherein the information tag of the target reference image is used to indicate the identification information of the target object, and each reference image corresponds to a unique information tag.
[0138] (c3) Determine, based on the identification information, display information of the target object existing in each of the target scene areas.
[0139] The display information of the target object refers to the expression form of the target object.
[0140] Specifically, first, the representation form of each type of object is preset, and after the identification information of the target object is determined, the type of the target object is determined according to the identification information of the target object. Then, the representation form of the target object is determined according to the type of the target object, and thus, the display information of the target object existing in the target scene area is determined.
[0141] For example, it is preset that a rectangle is used to represent an envelope and a cube is used to represent a box. If the target object is determined to be an envelope, a rectangle is used to represent the first scene data in the region registration map. If the target object is determined to be a box, a cube is used to represent the first scene data in the region registration map.
[0142] For another example, it is preset that a 2cm*2cm rectangle is used to represent a small envelope and a 3cm*3cm rectangle is used to represent a large envelope. If the target object is determined to be a small envelope, a 2cm*2cm rectangle is used to represent the first scene data in the regional registration map. If the target object is determined to be a large envelope, a 3cm*3cm rectangle is used to represent the first scene data in the regional registration map.
[0143] In an embodiment of the present application, by identifying the identification information of the target object and determining the representation form of the target object based on the identification information of the target object, the first scene data subsequently displayed in the regional registration map adopts different representation forms according to different objects, and different objects are easier to distinguish when displayed, thereby improving the readability of the scene data displayed in the regional registration map.
[0144] Since the field of view of each camera in the scene to be displayed is relatively large, simply determining in which target scene area the target object is located cannot accurately locate the target object. For example, in a sorting monitoring scene, the field of view of a camera includes 9 sorting conveyor boards. The method in step S20 can only determine which camera corresponds to the target scene area where the target object is located, but cannot accurately locate which conveyor board the target object is located on.
[0145] In order to accurately locate the target object and accurately display the specific position of the target object in the regional registration map, in some embodiments of the present application, when determining the regional registration map, after dividing the target scene area, the area corresponding to each target scene area in the regional registration map is gridded, and a number is set for each grid to obtain each grid of the regional registration map and the number of each grid; so that the position of the target object can be accurately located according to the grid where the target object is located. Step S20 includes the following steps (d1) to (d3):
[0146] (d1), obtaining an identification number of each target scene area, and determining a second coordinate of the target object based on the area image.
[0147] The second coordinate refers to the position of the target object in the regional image, and the second coordinate is used to indicate the position of the target object in the target scene region. The identification number of each target scene region refers to an identification mark used to distinguish the target scene region.
[0148] The camera corresponding to each regional image has a corresponding camera coordinate system, so each point in each regional image can be represented by the coordinates in the camera coordinate system.
[0149] Specifically, first, each point of the regional image is represented in the form of coordinates in the camera coordinate system according to the camera coordinate system. Then, according to the regional image, the target region of the target object in the regional image is identified, and according to the camera coordinates of each point in each region (i.e., the coordinates in the camera coordinate system) and the target region, the coordinates of the target object in the regional image are determined as the second coordinates of the target object.
[0150] (d2) determining the third coordinate of each target scene area according to the identification number.
[0151] The third coordinate refers to the position of the regional image data corresponding to the target scene region in the regional registration map, and the third coordinate is used to indicate the regional position corresponding to the target scene region in the regional registration map.
[0152] First, a global coordinate system is established, and each point of the regional registration map is represented in the form of coordinates in the global coordinate system. Then, the representation area of the regional image corresponding to each target scene area in the regional registration map is determined according to the identification number of each target scene area; and according to the representation area of the regional image corresponding to each target scene area in the regional registration map and the global coordinates of each point of the regional registration map (i.e., the coordinates in the global coordinate system), the coordinates of the regional image corresponding to each target scene area are determined as the third coordinates of each target scene area.
[0153] (d3) determining a first coordinate of each of the first scene data according to the second coordinate and the third coordinate.
[0154] First, the regional image of each target scene area is gridded, and each grid is numbered. The camera coordinates of each grid are determined, and the camera coordinates of each grid refer to the coordinates of the grid after being expressed in the camera coordinate system.
[0155] According to the global coordinates of the regional image corresponding to each target scene area (i.e., the third coordinates of the target scene area) and the camera coordinates of the regional image corresponding to each target scene area, the change relationship of each point in the regional image from the camera coordinates to the global coordinates is determined. Then, according to the camera coordinates of each grid and the change relationship of each point in the regional image from the camera coordinates to the global coordinates, the global coordinates of each grid are determined.
[0156] Then, according to the second coordinate of the target object, the camera coordinate of each grid and the number of each grid of the regional image, the target grid corresponding to the target object is determined, and the number of the target grid corresponding to the target object is obtained. Specifically, the second coordinate of the target object is compared with the camera coordinate of each grid. If the second coordinate of the target object falls within the camera coordinate of a certain grid, the target grid corresponding to the target object is determined to be the grid, and the number of the grid is the number of the target grid corresponding to the target object.
[0157] The target grid is used to indicate the position of the target object in the target scene area. For example, the area image is equally divided into 4 grids. If the target object is in the upper left grid of the area image, the target object is in the upper left of the target scene area.
[0158] Finally, the global coordinates of the target grid corresponding to the target object are determined based on the serial number of the target grid corresponding to the target object and the global coordinates of each grid of the regional image corresponding to the target scene area, so as to serve as the first coordinates of the first scene data.
[0159] For example, in the sorting monitoring scenario, there are four sorting conveyor plates corresponding to a target scene area 2, and there is a package (i.e., the target object) on conveyor plate A in target scene area 2. For ease of understanding, please refer to Figure 7 , the area image corresponding to the target scene area 2 is divided into 4 grids, each grid represents a transmission board, and the grid corresponding to the transmission board A in the area image is grid 1. Among them, each point of the area image corresponding to the target scene area 2 is expressed in the form of camera coordinates: (0, 0) to (2, 2), and each point of the area image corresponding to the target scene area 2 is expressed in the form of global coordinates (i.e., the third coordinate of the target scene area): (2, 0) to (4, 2).
[0160] According to the fact that each point of the regional image changes from (0, 0) to (2, 2) to (2, 0) to (4, 2) respectively, it can be known that the change relationship of each point of the regional image from camera coordinates to global coordinates is: the horizontal coordinate of the camera coordinate of the point plus 2 is used as the horizontal coordinate of the global coordinate of the point, and the vertical coordinate of the camera coordinate of the point remains unchanged as the vertical coordinate of the global coordinate of the point.
[0161] Since the package is in grid 1, the camera coordinates corresponding to grid 1 are: (0, 0) to (1, 1) (i.e., the second coordinates of the package), and the global coordinates corresponding to grid 1 are: (2, 0) to (3, 1) area. Therefore, the global coordinates corresponding to the package are: (2, 0) to (3, 1) area, that is, the first coordinates of the first scene data are: (2, 0) to (3, 1) area, such as Figure 7 shown.
[0162] In an embodiment of the present application, by determining the first coordinate of the first scene data corresponding to the target object in the regional registration map based on the second coordinate of the target object and the third coordinate of the target scene area, refined positioning is achieved, thereby improving the accuracy of the first scene data of each target scene area displayed in the regional registration map.
[0163] In order to better implement the scene data display method in the embodiment of the present application, based on the scene data display method, the embodiment of the present application also provides a scene data display device, such as Figure 8 FIG. 8 is a schematic diagram of a structure of an embodiment of a display device for scene data in an embodiment of the present application. The display device 800 for scene data includes:
[0164] An acquisition unit 801 is used to acquire a regional registration map of a scene to be displayed, and extract first scene data of each target scene region to which the scene to be displayed belongs;
[0165] A determining unit 802 is configured to determine a first coordinate of each of the first scene data extracted by the acquiring unit 801, where the first coordinate refers to a display position of the first scene data in the regional registration map;
[0166] The display unit 803 is used to display the various first scene data in the region registration map according to the first coordinates determined by the determination unit 802.
[0167] In some embodiments of the present application, the acquisition unit 801 is further configured to:
[0168] Extracting second scene data of each target scene area, wherein acquisition time of the second scene data lags behind acquisition time of the first scene data;
[0169] Acquire a target identification number of the target scene area corresponding to the second scene data;
[0170] The respective first scene data displayed in the region registration map are updated according to the second scene data and the target identification number.
[0171] In some embodiments of the present application, the acquisition unit 801 is specifically used to:
[0172] Acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs, wherein each of the target scene regions corresponds to one regional image;
[0173] According to each of the area images, first scene data of each of the target scene areas is extracted.
[0174] In some embodiments of the present application, the first scene data includes display information of a target object existing in the target scene area, and the acquisition unit 801 is specifically used to:
[0175] Inputting each of the area images into a recognition model, so that the recognition model determines whether a target object exists in the target scene area according to the area image;
[0176] If it is determined that the target object exists in the target scene area, determining identification information of the target object according to the area image;
[0177] According to the identification information, display information of the target object existing in each of the target scene areas is determined.
[0178] In some embodiments of the present application, the determining unit 802 is specifically configured to:
[0179] Obtaining an identification number of each target scene area, and determining a second coordinate of the target object according to the area image, wherein the second coordinate refers to a position of the target object in the target scene area;
[0180] Determine a third coordinate of each target scene region according to the identification number, wherein the third coordinate refers to a region position corresponding to the target scene region in the region registration map;
[0181] The first coordinate of each of the first scene data is determined according to the second coordinate and the third coordinate.
[0182] In some embodiments of the present application, the acquisition unit 801 is specifically used to:
[0183] Determine multiple scene areas to which the scenes to be displayed belong;
[0184] Obtaining the relative position relationship of each scene area;
[0185] The regional registration map is generated according to the relative position relationship.
[0186] In some embodiments of the present application, the display unit 803 is specifically used for:
[0187] Fill each of the first scene data into the regional registration map according to the first coordinates of each of the first scene data to form a target scene data map;
[0188] The target scene data graph is displayed.
[0189] In addition, in order to better implement the scene data display method in the embodiment of the present application, based on the scene data display method, the embodiment of the present application also provides a scene data display device, see Fig. 9 , Fig. 9 A schematic diagram of a structure of a display device for scene data in an embodiment of the present application is shown. Specifically, the display device for scene data provided in an embodiment of the present application includes a processor 901, and the processor 901 is used to execute a computer program stored in a memory 902 to implement the following Figures 1 to 7 Corresponding to each step of the method for displaying scene data in any embodiment; or, the processor 901 is used to execute the computer program stored in the memory 902 to implement the following Figure 8 The functions of each unit in the corresponding embodiment.
[0190] Exemplarily, the computer program may be divided into one or more modules / units, one or more modules / units are stored in the memory 902, and executed by the processor 901 to complete the embodiment of the present application. One or more modules / units may be a series of computer program instruction segments that can complete specific functions, and the instruction segments are used to describe the execution process of the computer program in the computer device.
[0191] The display device of scene data may include, but is not limited to, the processor 901 and the memory 902. Those skilled in the art will appreciate that the illustration is merely an example of the display device of scene data, and does not constitute a limitation on the display device of scene data, and may include more or fewer components than those shown in the illustration, or a combination of certain components, or different components, for example, the display device of scene data may also include input and output devices, network access devices, buses, etc., and the processor 901, the memory 902, the input and output devices, and the network access devices, etc. are connected via a bus.
[0192] The processor 901 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the display device for scene data, and uses various interfaces and lines to connect various parts of the display device for the entire scene data.
[0193] The memory 902 can be used to store computer programs and / or modules. The processor 901 implements various functions of the computer device by running or executing the computer programs and / or modules stored in the memory 902 and calling the data stored in the memory 902. The memory 902 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the display device of the scene data (such as audio data, video data, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0194] Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the scene data display device, equipment and its corresponding units described above can refer to the following. Figures 1 to 7 The description of the method for displaying scene data in any embodiment will not be repeated here.
[0195] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0196] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the present application as follows: Figures 1 to 7 For the steps in the method for displaying scene data in any embodiment, the specific operations can be referred to as follows Figures 1 to 7 The description of the method for displaying scene data in any embodiment will not be repeated here.
[0197] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0198] Due to the instructions stored in the computer-readable storage medium, the present application can be executed. Figures 1 to 7 Corresponding to the steps in the method for displaying scene data in any embodiment, therefore, the present application can be implemented as follows Figures 1 to 7 The beneficial effects that can be achieved by the method for displaying scene data in any embodiment are detailed in the previous description and will not be repeated here.
[0199] The above is a detailed introduction to a method, device, equipment and storage medium for displaying scene data provided in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A method for displaying scene data, characterized in that: The method comprises: Acquire a regional registration map of a scene to be displayed, and extract first scene data of each target scene area to which the scene to be displayed belongs; Determine a first coordinate of each of the first scene data, where the first coordinate refers to a display position of the first scene data in the regional registration map; Display each of the first scene data in the region registration map according to the first coordinates; The region registration map refers to a schematic diagram generated based on the relative positions of the various scene regions of the scene to be displayed, as well as the actual shape and size characteristics of each scene region; The extracting the first scene data of each target scene area to which the scene to be displayed belongs includes: Acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs, wherein each of the target scene regions corresponds to one regional image; Extracting first scene data of each target scene region according to each of the region images, wherein the first scene data refers to useful data of the target scene region; The determining the first coordinate of each of the first scene data comprises: Obtaining an identification number of each target scene area, and determining a second coordinate of the target object according to the area image, wherein the second coordinate refers to the position of the target object in the target scene area; Determine a third coordinate of each target scene region according to the identification number, wherein the third coordinate refers to a region position corresponding to the target scene region in the region registration map; The first coordinate of each of the first scene data is determined according to the second coordinate and the third coordinate.
2. The method for displaying scene data according to claim 1, characterized in that: After displaying the first scene data in the region registration map according to the first coordinate, the method further includes: Extracting second scene data of each target scene area, wherein the second scene data refers to useful data of the target scene area, wherein acquisition time of the second scene data lags behind acquisition time of the first scene data; Acquire a target identification number of the target scene area corresponding to the second scene data; The respective first scene data displayed in the region registration map are updated according to the second scene data and the target identification number.
3. The method for displaying scene data according to claim 1, characterized in that: The first scene data includes display information of a target object existing in the target scene area, and the extracting the first scene data of each target scene area according to each area image includes: Inputting each of the area images into a recognition model, so that the recognition model determines whether a target object exists in the target scene area according to the area image; If it is determined that the target object exists in the target scene area, determining identification information of the target object according to the area image; According to the identification information, display information of the target object existing in each of the target scene areas is determined.
4. The method for displaying scene data according to claim 1, characterized in that: The step of obtaining a regional registration map of a scene to be displayed includes: Determine multiple scene areas to which the scenes to be displayed belong; Obtaining the relative position relationship of each scene area; The regional registration map is generated according to the relative position relationship.
5. The method for displaying scene data according to any one of claims 1 to 4, characterized in that: The displaying of each of the first scene data in the region registration map according to the first coordinates includes: Fill each of the first scene data into the regional registration map according to the first coordinates of each of the first scene data to form a target scene data map; The target scene data graph is displayed.
6. A device for displaying scene data, characterized in that: The scene data display device comprises: An acquisition unit, used for acquiring a regional registration map of a scene to be displayed, and extracting first scene data of each target scene region to which the scene to be displayed belongs; a determining unit, configured to determine a first coordinate of each of the first scene data extracted by the acquiring unit, wherein the first coordinate refers to a display position of the first scene data in the regional registration map; a display unit, configured to display each of the first scene data in the region registration map according to the first coordinates determined by the determination unit; The region registration map refers to a schematic diagram generated based on the relative positions of the various scene regions of the scene to be displayed, as well as the actual shape and size characteristics of each scene region; The acquisition unit is further used to acquire regional images of a plurality of target scene regions to which the scene to be displayed belongs, wherein each target scene region corresponds to one regional image; Extracting first scene data of each target scene region according to each of the region images, wherein the first scene data refers to useful data of the target scene region; The determining unit is further configured to obtain an identification number of each target scene area, and determine a second coordinate of the target object according to the area image, wherein the second coordinate refers to a position of the target object in the target scene area; Determine a third coordinate of each target scene region according to the identification number, wherein the third coordinate refers to a region position corresponding to the target scene region in the region registration map; The first coordinate of each of the first scene data is determined according to the second coordinate and the third coordinate.
7. A scene data display device, characterized in that: It comprises a processor and a memory, wherein the memory stores a computer program, and when the processor calls the computer program in the memory, it executes the scene data display method according to any one of claims 1 to 5.
8. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in the scene data display method described in any one of claims 1 to 5.
Citation Information
Patent Citations
Full-automatic three-dimensional scene construction method based on single image
CN104134234A
Information processing method and device of panorama area
CN106446857A