Digital country processing method and system based on digital twinning

Abstract

The invention provides a digital country processing method and system based on digital twinning, a digital twinning space corresponding to a destination is generated according to data configuration information of a management end, the digital twinning space comprises a plurality of display elements, a time sequence updating strategy is called to obtain monitoring data corresponding to the display elements with dynamic attributes, and the monitoring data are sent to the management end. Obtaining time sequence updating data corresponding to the display element according to the monitoring data, obtaining environment data collected by monitoring equipment based on an environment updating strategy, and obtaining environment updating data corresponding to the corresponding display element according to the environment data, and updating the digital twin space based on the time sequence updating data and the environment updating data to obtain a dynamic display space, receiving a remote access point selected by a user side based on the dynamic display space, acquiring synchronous display data acquired by the monitoring equipment based on the remote access point, and sending the synchronous display data to the user side.

Description

Technical Field

[0001] The present invention relates to image processing technology, and in particular to a digital village processing method and system based on digital twins. Background Art

[0002] With the rapid development of science and technology, previewing rural scenes through remote viewing has brought great convenience to users and has greatly promoted the innovation and development of rural tourism.

[0003] In the prior art, when users preview rural scenes through remote viewing, they can often only view preset, single image display data, such as pre-shot summer rural images. This static display method cannot be flexibly adjusted dynamically based on the actual environment, resulting in the scene viewed by the user remotely being inconsistent with the actual rural scene.

[0004] Therefore, how to dynamically adjust the scene viewed remotely by users in combination with the actual rural scene has become an urgent problem to be solved. Summary of the invention

[0005] The present invention provides a digital village processing method and system based on digital twins, which can dynamically adjust the scene viewed remotely by users in combination with the actual village scene.

[0006] A first aspect of the present invention provides a digital village processing method based on digital twins, comprising: Generate a digital twin space corresponding to the target location according to the data configuration information of the management end, wherein the digital twin space includes multiple display elements; Retrieve the timing update strategy to obtain monitoring data corresponding to the display element of the dynamic attribute, and obtain the timing update data corresponding to the display element according to the monitoring data; Acquire environmental data collected by monitoring equipment based on an environmental update strategy, obtain environmental update data corresponding to the display element according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space; A remote access point selected by the user terminal based on the dynamic display space is received, and synchronous display data collected by the monitoring device based on the remote access point is acquired and sent to the user terminal.

[0007] Optionally, in a possible implementation manner of the first aspect, calling a timing update strategy to obtain monitoring data corresponding to a display element with a dynamic attribute, and obtaining timing update data corresponding to the display element according to the monitoring data includes: Acquire a monitoring frame corresponding to the monitoring data, and determine a monitoring area in the monitoring frame according to a region positioning template corresponding to the display element, wherein the region positioning template includes a positioning area corresponding to the monitoring area; Extracting a plurality of display outlines corresponding to the display elements in the monitoring area, and determining a display state corresponding to each of the display outlines based on a state analysis model, wherein the display state includes a closed state and an open state; Determining an original state of the display element, and counting the number of outlines of display outlines corresponding to display states inconsistent with the original state; Equally dividing the display area corresponding to the display element in the digital twin space according to the number of contours and the division direction to obtain a plurality of sub-display areas; The center point of each sub-display area is obtained, and the display module closest to the center point is determined as a timing update module. The timing update module is updated according to the display state to obtain timing update data. The display area includes multiple display modules corresponding to the display elements.

[0008] Optionally, in a possible implementation manner of the first aspect, acquiring environmental data collected by a monitoring device based on an environmental update strategy, and obtaining environmental update data corresponding to the display element according to the environmental data includes: Determine an environmental mode according to meteorological data, and when the environmental mode is a snow mode, obtain environmental data collected by a monitoring device based on multiple preset points; Acquire the display elements of the snow-covered attribute in the digital twin space as snow-covered elements, and determine the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data; Determine the reference snow thickness corresponding to each of the snow-covered elements according to the meteorological data, obtain the inclination corresponding to each of the snow-covered elements, and offset the reference snow thickness according to the inclination to obtain the displayed snow thickness corresponding to each of the snow-covered elements; A snow-covered layer corresponding to the display area of ​​each snow-covered element is generated based on the displayed snow thickness and the snow coverage rate, and the snow-covered layer is superimposed on the corresponding display area to obtain environmental update data.

[0009] Optionally, in a possible implementation manner of the first aspect, determining the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data includes: Acquire an image frame corresponding to each of the environmental data, and determine an analysis area corresponding to the snow-covered element in the image frame according to an element positioning template, wherein the element positioning template includes an extraction area corresponding to each of the snow-covered elements; Determine the pixel points whose pixel values ​​in the analysis areas are located in the snow-covered pixel interval as snow accumulation points, and count the first number of the snow accumulation points and the second number corresponding to all the pixel points in the analysis areas; The snow accumulation ratio corresponding to the analysis area is obtained according to the first quantity and the second quantity, and the snow accumulation ratio corresponding to each snow-covered element in different image frames is averaged to obtain the snow coverage rate corresponding to each snow-covered element.

[0010] Optionally, in a possible implementation manner of the first aspect, determining a reference snow thickness corresponding to each of the snow-covered elements according to the meteorological data, acquiring an inclination corresponding to each of the snow-covered elements, and offsetting the reference snow thickness according to the inclination to obtain a displayed snow thickness corresponding to each of the snow-covered elements, including: Acquire the current snow thickness corresponding to the meteorological data, and determine that the current snow thickness is the reference snow thickness corresponding to each of the snow-covered elements; Determine that the display area corresponding to each of the snow-covered elements is an adjustment area, and obtain the inclination corresponding to the adjustment area; Obtaining a tilt difference between the tilt and the reference tilt, traversing the snow distribution table according to the tilt difference, and determining a distribution division amount corresponding to a difference interval where the tilt difference is located as a target division amount; The snow distribution table includes a plurality of difference intervals and distribution division amounts corresponding to the difference intervals. The larger the value corresponding to the difference interval, the larger the distribution division amount. Dividing the adjustment area according to the inclined division direction corresponding to the adjustment area and the target division amount to obtain a plurality of sub-adjustment areas; The gradient adjustment coefficient corresponding to each sub-adjustment area is determined based on the tilt difference, the reference snow thickness is offset according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each sub-adjustment area, and the display snow thickness of the display area corresponding to the snow-covered element is obtained according to the sub-display thickness.

[0011] Optionally, in a possible implementation manner of the first aspect, determining a gradient adjustment coefficient corresponding to each of the sub-adjustment areas based on the tilt difference, and offsetting the reference snow thickness according to the gradient adjustment coefficient to obtain a sub-display thickness corresponding to each of the sub-adjustment areas, including: Performing level numbering on each of the sub-adjustment areas based on the oblique division direction to obtain the level number corresponding to each of the sub-adjustment areas, wherein the oblique division direction is the direction from the bottom of the sub-adjustment area to the top of the sub-adjustment area; The tilt difference is evenly divided according to the target division amount to obtain a unit difference, and the offset difference corresponding to each of the sub-adjustment areas is obtained based on the product of the unit difference and the number of levels; Obtaining a gradient adjustment coefficient based on a ratio of the offset difference to the reference difference, and obtaining an offset thickness corresponding to each of the sub-adjustment areas according to a product of the gradient adjustment coefficient and the reference adjustment thickness; The sub-display thickness corresponding to each sub-adjustment area is obtained according to the difference between the reference snow thickness and the offset thickness.

[0012] Optionally, in a possible implementation manner of the first aspect, generating a snow-covered layer corresponding to a display area of ​​each of the snow-covered elements based on the displayed snow thickness and the snow coverage rate, and superimposing the snow-covered layer onto the corresponding display area to obtain environment update data, including: Acquire a display area corresponding to the display area, and obtain the snow area according to the product of the snow coverage rate and the display area; Generate an initial snow-covered layer corresponding to the display area according to the area outline of the display area and the snow accumulation area; Based on the inclined division direction and the target division amount, the initial snow-covered layer is divided into a plurality of sub-areas; Determine a virtual adjustment parameter corresponding to the displayed snow thickness of each of the sub-adjustment areas, and adjust the display parameters of the sub-areas corresponding to each of the sub-adjustment areas according to the virtual adjustment parameter to obtain the snow-covered layer; The center point of the snow-covered layer is located based on the center point of the display area, and the snow-covered layer is superimposed on the corresponding display area to obtain environmental update data.

[0013] Optionally, in a possible implementation manner of the first aspect, receiving a remote access point selected by the user terminal based on the dynamic display space, acquiring synchronous display data collected by the monitoring device based on the remote access point and sending the synchronous display data to the user terminal includes: Acquire historical collection data corresponding to each of the remote access points in a recent time period, and determine that a remote access point that does not have the historical collection data is a current collection point; Generate a collection path connecting each of the current collection points, and control the monitoring device to collect data based on the collection path to obtain current collection data; The current collection data is split to obtain sub-collection data corresponding to each current collection point, the viewing order of each remote access point configuration configured by the user terminal is determined, and the historical collection data and / or sub-collection data are spliced ​​according to the viewing order to obtain synchronous display data.

[0014] Optionally, in a possible implementation manner of the first aspect, splitting the current acquisition data to obtain sub-acquisition data corresponding to each current acquisition point includes: Acquire the display range corresponding to each current collection point, and determine the path segment in the collection path that is located within each display range as the collection segment corresponding to the current collection point; Determine the start time and the end time corresponding to each acquisition segment, determine the corresponding video segment in the current acquisition data according to the start time and the end time, and determine the video segment as the sub-acquisition data corresponding to the current acquisition point.

[0015] A second aspect of the present invention provides a digital village processing system based on digital twins, comprising: A generation module, used to generate a digital twin space corresponding to the target location according to the data configuration information of the management end, wherein the digital twin space includes multiple display elements; A calling module, used for calling a timing update strategy to obtain monitoring data corresponding to a display element with dynamic attributes, and obtaining timing update data corresponding to the display element according to the monitoring data; An updating module, configured to obtain environmental data collected by a monitoring device based on an environmental update strategy, obtain environmental update data corresponding to the display element according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space; The receiving module is used to receive the remote access point selected by the user terminal based on the dynamic display space, obtain the synchronous display data collected by the monitoring device based on the remote access point, and send it to the user terminal.

[0016] The beneficial effects of the present invention are as follows: 1. The present invention can combine the actual collected data and update the initial digital twin space through different update strategies to obtain a digital twin space that fits the actual situation. Users can view the rural landscape that fits the actual scene through the updated digital twin space. The present invention can combine the morphological changes of the display elements and call the timing update strategy to update the display elements of dynamic attributes, and can obtain the corresponding timing update data, so that the morphological changes of the display elements of dynamic attributes can be updated in time, so that the display elements in the digital twin space can more truly reflect their actual state distribution.

[0017] 2. The present invention can call up the environment update strategy, and according to the environment update strategy, control the monitoring equipment to collect the corresponding environmental data of the display elements in reality. Combined with the actual environmental data, the environment update data for updating the corresponding display elements can be obtained, which can more realistically present the display appearance of the display elements in the actual environment. By updating the digital twin space according to the time series update data and the environment update data, a dynamic display space that highly matches the actual situation can be obtained. When obtaining the environment update data, the present invention can more accurately simulate the environmental changes in the snow mode by analyzing the snow coverage rate and snow thickness of the display elements with snow-covered attributes in the snow mode, so that the environmental display in the digital twin space is closer to the actual situation.

[0018] 3. When obtaining the snow coverage rate, the present invention obtains the snow coverage rate corresponding to the snow-covered element by combining the actual environmental data, so that the snow coverage rate of the snow-covered element can be obtained more accurately, and the user can see a more realistic snow effect in the virtual digital twin space. When obtaining the snow thickness, the present invention can offset the preset reference snow thickness in combination with the inclination to obtain the snow thickness corresponding to different positions of the snow-covered element, so as to more accurately simulate the actual distribution of snow on the inclined ground. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flowchart of a digital village processing method based on digital twins provided by an embodiment of the present invention; Figure 2 is a schematic diagram of a digital twin space from a top-down perspective provided by an embodiment of the present invention; Figure 3 is a schematic diagram of an analysis area provided by an embodiment of the present invention; Figure 4 is a schematic diagram of an adjustment area provided by an embodiment of the present invention; Figure 5 It is a structural schematic diagram of a digital village processing system based on digital twin provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0022] See also Figure 1 , is a schematic diagram of a digital village processing method based on digital twins provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows: S1. Generate a digital twin space corresponding to the target location according to data configuration information of the management end, wherein the digital twin space includes multiple display elements.

[0023] Among them, the management end refers to the terminal held by the manager, such as a computer. The data configuration information refers to the various parameters when the manager constructs the twin space based on the actual situation, such as the parameter data corresponding to each scenic spot in the actual village. The target place refers to the real village selected for building the digital twin space. The digital twin space is a virtual digital space that matches the real village. The display elements refer to the various display parts that constitute the digital twin space, such as the houses, benches, flowers, etc. that constitute each scenic spot. Together, they present the display environment of the village.

[0024] This solution can combine the actual collected data and update the initial digital twin space through different update strategies to obtain a digital twin space that fits the actual situation. Users can appreciate the diverse and dynamic rural landscape through the updated digital twin space.

[0025] Specifically, through the data configuration information input by the management end, such as the distribution location and area size of each scenic spot, a virtual digital space that is highly matched with the real village can be constructed, namely the digital twin space. The digital twin space contains the display data of each scenic spot, see Figure 2 , is a schematic diagram of a digital twin space from a top-down perspective provided by an embodiment of the present invention, such as Figure 2As shown in the figure, users can click on the digital twin space in the bird's-eye view to enjoy a bird's-eye view of the countryside that is more in line with reality. Subsequently, the digital twin space can be updated accordingly based on actual environmental changes or time series changes to obtain a virtual digital space that matches the actual scene.

[0026] S2, calling the timing update strategy to obtain monitoring data corresponding to the display element with dynamic attributes, and obtaining the timing update data corresponding to the display element according to the monitoring data.

[0027] It is understandable that the attributes corresponding to different display elements may be different. The shapes of some display elements will change over time, and their corresponding attributes are dynamic attributes, such as flowers that will gradually bloom or wither over time. For display elements with dynamic attributes that will change dynamically over time, in order to more realistically present their corresponding morphological changes in the digital twin space, such as flowers blooming in a flower bed, this solution can combine the morphological changes of the display elements, call the timing update strategy to update the display elements with dynamic attributes, and obtain the corresponding timing update data.

[0028] Specifically, since different display elements actually have corresponding location areas, for display elements with dynamic attributes, this solution can control a drone with a high-definition camera to collect data on the display elements. For example, for flowers in a flower bed, the drone can be controlled to go to the shooting position corresponding to the area where the flower bed is located for shooting, and the shooting height and shooting position of the drone can be pre-configured. By shooting the display elements with the drone, the actual morphological change data of the display elements, that is, monitoring data, can be collected. Through the monitoring data, it can be observed that the morphology of the display elements with dynamic attributes changes over time. Therefore, the time series update data for updating the display elements can be obtained in combination with the monitoring data.

[0029] When acquiring monitoring data, for display elements with dynamic attributes, since different display elements have different corresponding life cycles, different display elements can be configured with interval times corresponding to their life cycles. The drone can collect data on the display elements according to the interval times. For example, the flowers in the flower bed can be photographed and data collected every 7 days, so that relatively complete morphological change data can be obtained within the life cycle of the display elements.

[0030] Among them, the timing update strategy refers to the strategy for updating the display elements of dynamic attributes. The dynamic attribute refers to the attribute corresponding to the display element whose shape changes with time. For example, the state of a flower changes with time, so the corresponding attribute is a dynamic attribute. The monitoring data refers to the shooting data collected by a drone with a high-definition camera, and the timing update data refers to the data after the display elements of dynamic attributes are updated.

[0031] In some embodiments, the specific implementation of step S2 may be: S21, obtaining a monitoring frame corresponding to the monitoring data, and determining a monitoring area in the monitoring frame according to a region positioning template corresponding to the display element, wherein the region positioning template includes a positioning area corresponding to the monitoring area.

[0032] Specifically, the drone can collect image frames corresponding to the display elements. When collecting monitoring data, image data unrelated to the display elements may be collected. In order to reduce the interference of irrelevant image data on the display elements during monitoring, the monitoring frame can be divided into regions by calling the regional positioning template corresponding to the display element. The positioning area for locating the display element in the regional positioning template can be used to determine the monitoring area corresponding to the positioning area in the monitoring frame. The specifications of the regional positioning template are the same as those of the monitoring frame. Therefore, it can be ensured that the positions of the monitoring areas corresponding to different monitoring frames are the same. By comparing the monitoring frames at different time points in the same position area, the morphological changes of the display elements can be identified.

[0033] Among them, the monitoring frame refers to the image frame corresponding to the collected display element, the regional positioning template refers to the pre-configured template that can be used to determine the monitoring area, and the regional positioning templates corresponding to different display elements are different. The monitoring area refers to the area where the display element is located in the monitoring frame. For example, when the display element is a flower, the monitoring area can be the area corresponding to the flower bed in the monitoring frame. The positioning area refers to the area in the regional positioning template that can determine the monitoring area.

[0034] S22, extracting a plurality of display outlines corresponding to the display elements in the monitoring area, and determining a display state corresponding to each of the display outlines based on a state analysis model, wherein the display state includes a closed state and an open state.

[0035] Specifically, multiple display contours corresponding to the display elements can be extracted from the monitoring area through contour extraction technology such as edge detection algorithm. For example, when the display element is a flower, the contours of multiple flowers in the monitoring area can be extracted. Since the display states corresponding to the display elements in different time periods may be different, in order to more accurately identify the display states corresponding to each display contour, the present solution can pre-train the state analysis model so that it can determine the corresponding display state through the display contour. Therefore, the display state corresponding to each display contour can be determined through the state analysis model. For example, when the display element is a flower, if the display contour is an open flower contour, then the corresponding display state is an open state, and if the display contour is a closed flower contour, then the corresponding display state is a closed state.

[0036] When training the state analysis model, firstly, a large amount of data including display elements and their corresponding display states can be collected, and the collected data can be labeled, that is, one or more corresponding display state labels are assigned to each display element, and then the contour features of the display elements can be extracted, and these data are input into the state analysis model. The state analysis model can learn how to map the contour features of the display elements to the corresponding display states, so that the corresponding display states can be determined according to the display contours of the display elements.

[0037] Among them, the display outline refers to the outline corresponding to the display element, the state analysis model refers to a model that can analyze the state corresponding to the display outline, and the current state of the display element can be judged according to the characteristics of the display outline. The display state refers to the appearance state of the display element when it is displayed, such as the open and closed states of a flower.

[0038] S23, determining the original state of the display element, and counting the number of contours of the display contours corresponding to the display states that are inconsistent with the original state.

[0039] Specifically, the original state of the display element before monitoring data collection can be determined. Multiple display elements that are inconsistent with the original state can be obtained through monitoring data, and the number of contours of the display contours corresponding to the display state inconsistent with the original state can be counted. For example, the original state may be a closed state. When the display contour of the display element has an open state, the number of display contours corresponding to the open state, that is, the number of contours, can be counted.

[0040] The original state refers to the initial state of the display element before monitoring data collection, and the number of contours refers to the number of display contours corresponding to the display state that is inconsistent with the original state.

[0041] S24, equally dividing the display area corresponding to the display element in the digital twin space according to the number of contours and the division direction to obtain multiple sub-display areas.

[0042] Specifically, in the digital twin space, each display element has a corresponding display area. After obtaining the corresponding number of contours, this solution can pre-configure the corresponding division direction, and divide the display area equally according to the pre-configured division direction to obtain multiple sub-display areas. For example, when the number of contours is 4, the display area can be divided into 4 equal parts according to the pre-configured division direction to obtain the corresponding 4 sub-display areas. Among them, the division direction refers to the direction when dividing the display area, and the sub-display area refers to multiple sub-areas after the display area is equally divided.

[0043] S25, obtaining the center point of each sub-display area, determining the display module closest to the center point as a timing update module, updating the timing update module according to the display state to obtain timing update data, and the display area includes multiple display modules corresponding to the display elements.

[0044] It can be understood that there are multiple display modules corresponding to the display elements in each display area in the digital twin space. For example, when the display element is a flower, there are multiple flower modules in the display area corresponding to the flower in the digital twin space. When the display module corresponding to the display element is updated, the display module corresponding to the display state that is inconsistent with the original state must be updated. If the position of the display module to be updated is accurately located in turn, the data processing amount may increase. Therefore, this scheme can display the distribution of elements in different states according to the equally divided sub-display areas during display, which can improve data processing efficiency. For example, when the display element is a flower and about 1 / 2 of the flowers are open, 1 / 2 of the display modules in the display area can be obtained for updating.

[0045] Specifically, after obtaining multiple sub-display areas, the center point corresponding to each sub-display area can be determined, and the display module closest to the center point is used as the timing update module to be updated. The status of the timing update module is updated according to the corresponding display status. For example, when the display module is originally in a closed state, when the current state is an open state, the corresponding display module can be converted from a closed state to an open state, so that the corresponding timing update data can be obtained.

[0046] Among them, the display module refers to the virtual module corresponding to the display element in the display area, and the timing update module refers to the display module closest to the center point and the display status needs to be updated.

[0047] Through the above implementation, the morphological changes of dynamic attribute display elements can be updated in real time, so that the display elements in the digital twin space can more realistically reflect the actual state distribution.

[0048] S3, based on the environment update strategy, obtain the environment data collected by the monitoring equipment, obtain the environment update data corresponding to the corresponding display element according to the environment data, and update the digital twin space based on the time series update data and the environment update data to obtain a dynamic display space.

[0049] It is understandable that in actual applications, different weather conditions will change the appearance of the natural environment. Therefore, the corresponding display appearance of the display elements under different weather conditions may be different. For example, when the display element is a house, in clear weather conditions, its corresponding display appearance is usually its natural, undecorated appearance. In snowy weather conditions, the display appearance of the house may change significantly, and the snow will cover the house, causing the appearance of the house to change.

[0050] In order to more realistically present the display appearance of display elements under different weather conditions, this solution can call the environmental update strategy, and control the monitoring equipment to collect the corresponding environmental data of the display elements in reality according to the environmental update strategy. Combined with the actual environmental data, the environmental update data for updating the corresponding display elements can be obtained. The digital twin space can be updated according to the time series update data and the environmental update data to obtain a dynamic display space that is highly matched with the actual situation.

[0051] Among them, the environmental update strategy refers to the strategy of updating the display elements in combination with the actual environmental data. The monitoring equipment refers to the equipment that can collect the actual environmental data, such as a drone with an overhead camera. The environmental data refers to the shooting data collected by the monitoring equipment that can display the actual environment. The environmental update data refers to the data after the display elements are updated in combination with the environmental data. The dynamic display space refers to the digital twin space after the time series update and the environmental update.

[0052] In some embodiments, the step S3 of "obtaining environmental data collected by a monitoring device based on an environmental update strategy, and obtaining environmental update data corresponding to the display element according to the environmental data" includes the following steps: S31, determining an environmental mode according to meteorological data, and when the environmental mode is a snow mode, obtaining environmental data collected by a monitoring device based on multiple preset points.

[0053] When combining actual environmental data to obtain environmental update data for updating display elements, this solution can combine the digital twin space to display the environmental data of the countryside under snow conditions. Specifically, the layout in the virtual space can be displayed based on the actual environmental data, so that the digital twin space can be more in line with the actual rural scene.

[0054] Specifically, according to the meteorological data released by the meteorological department, when it is determined that the current weather condition is snowing, the corresponding environmental mode can be determined as the snow accumulation mode. At this time, the monitoring equipment can be controlled to go to multiple pre-configured preset points to collect environmental data. The monitoring equipment can collect data on snow coverage in real time. Through the analysis and processing of environmental data, the snow accumulation situation under the snow accumulation mode can be understood in a timely manner.

[0055] Among them, meteorological data refers to data collected by the meteorological department through satellite remote sensing technology that can describe weather conditions, including rainfall, snowfall, etc. Environmental mode refers to a description of the natural environment state based on current meteorological conditions, including sunny mode, rainy mode, snow mode, etc. Snow mode refers to an environmental mode corresponding to when meteorological data shows that the current weather condition is snowing. Preset points refer to location points that are pre-set and configured for monitoring environmental data.

[0056] S32, obtaining the display elements of the snow-covered attribute in the digital twin space as snow-covered elements, and determining the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data.

[0057] It can be understood that each display element in the digital twin space has corresponding attributes. For display elements that can be covered by snow in reality, the corresponding attribute is the snow-covered attribute, and the corresponding display element can be determined as a snow-covered element. For example, when the display element is a road, since the road can be covered by snow in reality, the corresponding attribute is the snow-covered attribute, and the road can be determined as a snow-covered element. After obtaining the environmental data under the snow mode, the snow coverage rate corresponding to the snow-covered element can be obtained, and the snow coverage rate corresponding to different snowfall amounts is different. When the snowfall is large, the corresponding snow coverage rate is also large. The display elements can be updated later according to the snow coverage rate.

[0058] In actual applications, there are many scenic spots in the countryside. If data is collected on the snow coverage of each scenic spot, the amount of data collected will be large and the data processing efficiency will be low. In order to improve the data processing efficiency, this solution can control the monitoring equipment to go to fixed data collection points for data collection, and combine the collected data to predict the overall snow coverage situation, which can reduce the amount of data collection and improve efficiency.

[0059] Among them, the snow-covered attribute refers to the property that describes the display element can be covered by snow in snowy weather, the snow-covered element refers to the display element with the snow-covered attribute, and the snow coverage rate refers to the predicted coverage rate corresponding to the snow-covered element in the entire digital twin space. Through the snow coverage rate, we can intuitively understand the degree of coverage of the display elements by snow.

[0060] In some embodiments, the step S32 of "determining the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data" includes the following steps: S321, acquiring an image frame corresponding to each of the environmental data, and determining an analysis area corresponding to the snow-covered element in the image frame according to an element positioning template, wherein the element positioning template includes an extraction area corresponding to each of the snow-covered elements.

[0061] It is understandable that the same snow-covered element may be widely distributed in different location areas in the actual environment, such as snow-covered ground, roofs, etc., and in multiple environmental data corresponding to multiple preset points, these areas may be captured in multiple image frames. In order to comprehensively evaluate the snow accumulation conditions of these snow-covered elements, the snow-covered elements appearing in each frame of the image can be identified and their snow accumulation ratio can be calculated.

[0062] Specifically, the image frames corresponding to each environmental data can be obtained. Since the shooting height and shooting parameters of the monitoring equipment will not change each time it collects data, and there may be multiple corresponding snow-covered elements in the image frame, in order to quickly locate each snow-covered element, the pre-configured element positioning template can be called out to identify and locate each snow-covered element. Since the element positioning template may contain multiple extraction areas for identifying and locating the area of ​​each snow-covered element, the analysis area corresponding to each snow-covered element can be determined from the image frame through the multiple extraction areas in the element positioning template, and each analysis area has a corresponding snow-covered element, see Figure 3 , is a schematic diagram of an analysis area provided by an embodiment of the present invention, such as Figure 3 As shown in , in the image frame, the snow-covered element corresponding to the analysis area 1 may be a road, and the snow-covered element corresponding to the analysis area 2 may be a flower. Different snow-covered elements have different corresponding snow coverage conditions.

[0063] Among them, the element positioning template refers to a template for identifying and locating areas corresponding to different snow-covered elements in the image frame, the analysis area refers to the area in the image frame that is determined to correspond to the snow-covered elements after being identified and located by the element positioning template, and the extraction area refers to the area in the element positioning template, which can be used to identify and extract the area corresponding to the snow-covered elements from the image frame.

[0064] S322, determining that the pixel points whose pixel values ​​in each analysis area are located in the snow-covered pixel interval are snow accumulation points, and counting a first number of the snow accumulation points and a second number corresponding to all the pixel points in the analysis area.

[0065] Specifically, pixel values ​​corresponding to multiple pixel points located in each analysis area can be obtained. Since the pixel values ​​corresponding to the snow-accumulated area are different from the pixel values ​​corresponding to other areas, the pixel value interval corresponding to the pixel points in the snow-accumulated area can be pre-configured, that is, the snow-covered pixel interval. For example, the snow-covered pixel interval can be the pixel interval corresponding to the white pixel value. After obtaining the pixel values ​​corresponding to the multiple pixel points in each analysis area, the pixel values ​​corresponding to the multiple pixel points are compared with the snow-covered pixel interval respectively. If the pixel value corresponding to the pixel point is within the snow-covered pixel interval, the corresponding pixel point can be considered to be a pixel point in the snow-accumulated area, that is, a snow accumulation point. By counting all the snow accumulation points in each analysis area, the first number corresponding to each analysis area can be obtained, and by counting all the pixel points in each analysis area, the second number corresponding to each analysis area can be obtained.

[0066] Among them, the snow-covered pixel interval refers to the pixel value interval of the pixel points corresponding to the snow accumulation area, the snow accumulation point refers to the pixel point whose pixel value is within the snow-covered pixel interval, the first number refers to the number of snow accumulation points in the analysis area, and the second number refers to the number of all pixel points in the analysis area.

[0067] S323, obtaining the snow accumulation ratio corresponding to the analysis area according to the first quantity and the second quantity, calculating the average of the snow accumulation ratios corresponding to each snow-covered element in different image frames, and obtaining the snow coverage rate corresponding to each snow-covered element.

[0068] By calculating the ratio of the first quantity and the second quantity, the snow accumulation ratio corresponding to the snow-covered elements in each analysis area can be obtained. Since the same snow-covered element may appear in multiple image frames, the snow accumulation ratio corresponding to the same snow-covered element in different image frames can be calculated. By calculating the average of multiple snow accumulation ratios, the snow coverage rate corresponding to each snow-covered element can be obtained. For example, if there are road elements in multiple image frames, then the road elements may correspond to multiple snow accumulation ratios. By calculating the average of multiple snow accumulation ratios, the snow coverage rate corresponding to the road elements can be obtained.

[0069] Among them, the snow accumulation ratio refers to the proportion of the snow-covered area on the snow-covered element.

[0070] Through the above implementation, the accuracy of panoramic prediction in the snow mode can be improved, and the efficiency of data processing can be improved.

[0071] S33, determining a reference snow thickness corresponding to each of the snow-covered elements according to the meteorological data, obtaining an inclination corresponding to each of the snow-covered elements, and offsetting the reference snow thickness according to the inclination to obtain a displayed snow thickness corresponding to each of the snow-covered elements.

[0072] In practical applications, the corresponding snowfall can be determined through the meteorological data published by the meteorological department, so that the snow thickness corresponding to the snow-covered element can be obtained, that is, the baseline snow thickness. When the snow-covered element is a flat element with no slope, such as a flat ground, the corresponding displayed snow thickness is the baseline snow thickness. When the snow-covered element is an element with a slope, such as an inclined ground, the snow on the inclined ground may slide down the slope due to the effect of gravity, resulting in an increase in the snow thickness at the bottom of the slope, while the snow thickness at the top of the slope may decrease due to the slide. Therefore, for snow-covered elements with a slope, such as an inclined ground, the inclination will affect the accumulation of snow at different positions, and the corresponding inclination can be obtained. The baseline snow thickness is offset by the inclination to obtain the snow thickness corresponding to different positions of the snow-covered element, and then the displayed snow thickness corresponding to the snow-covered element can be obtained.

[0073] Among them, the baseline snow thickness refers to the standard value of snow thickness without the influence of terrain factors, the inclination refers to the angle between the surface of the snow-covered element with a slope and the horizontal plane, and the display snow thickness refers to the snow thickness when displayed in the digital twin space after adjusting the baseline snow thickness in combination with the inclination. For flat ground, the display snow thickness may be the same as the baseline snow thickness, but for sloping ground, the display snow thickness will vary depending on the inclination.

[0074] In some embodiments, step S33 includes S331 to S335, which are specifically as follows: S331, obtaining the current snow thickness corresponding to the meteorological data, and determining that the current snow thickness is the reference snow thickness corresponding to each of the snow-covered elements.

[0075] Specifically, the current corresponding snow thickness, that is, the current snow thickness, can be obtained according to the snowfall in the meteorological data published by the meteorological department, and the current snow thickness can be determined as the reference snow thickness corresponding to the snow-covered element. Among them, the current snow thickness refers to the snow thickness obtained according to the snowfall in the meteorological data published by the meteorological department.

[0076] S332: Determine that the display area corresponding to each of the snow-covered elements is an adjustment area, and obtain the inclination corresponding to the adjustment area.

[0077] Specifically, the display area corresponding to the snow-covered element can be determined as the adjustment area. Since the snow-covered element corresponds to different position areas, the corresponding inclination may also be different. Under different inclinations, the snow coverage may also be different. Therefore, the inclination corresponding to the adjustment area can be obtained first, and then the snow thickness can be adjusted accordingly based on the inclination. Among them, the adjustment area refers to the area in the digital twin space where the snow coverage is adjusted.

[0078] S333, obtaining the inclination difference between the inclination and the reference inclination, traversing the snow distribution table according to the inclination difference, and determining the distribution division amount corresponding to the difference interval where the inclination difference is located as the target division amount.

[0079] Among them, the snow distribution table includes multiple difference intervals and distribution division amounts corresponding to the difference intervals. The larger the numerical value corresponding to the difference interval, the larger the distribution division amount.

[0080] It is understandable that the distribution of snow thickness on slopes corresponding to different inclinations may be different. The slope can be divided accordingly based on the inclination of the snow-covered elements, so that the snow thickness at different positions on the slope can be adjusted to make it more consistent with the snow conditions in the actual environment.

[0081] Specifically, the present scheme may pre-configure a snow distribution table containing multiple difference intervals. By calculating the difference between the inclination and the pre-configured reference inclination, the corresponding inclination difference can be obtained. By traversing the snow distribution table according to the inclination difference, the difference interval corresponding to the inclination difference can be determined, and then the corresponding distribution division amount can be obtained. The distribution division amount can be determined as the corresponding target division amount. The larger the inclination difference, the larger the corresponding difference interval, and the greater the difference in snow thickness between the top and the bottom of the slope, the larger the distribution division amount obtained.

[0082] Among them, the reference inclination refers to the pre-set inclination angle under normal circumstances, the inclination difference refers to the difference between the inclination and the reference inclination, the difference interval refers to the interval containing multiple inclination differences in the snow distribution table, the distribution division amount refers to the number of divisions corresponding to each difference interval, and the target division amount refers to the number of divisions corresponding to the difference interval where the inclination difference is located.

[0083] S334, dividing the adjustment area according to the inclined division direction corresponding to the adjustment area and the target division amount to obtain a plurality of sub-adjustment areas.

[0084] See also Figure 4 , is a schematic diagram of an adjustment zone provided by an embodiment of the present invention, such as Figure 4As shown in , the direction from bottom to top can be determined as the inclined division direction. When the target division amount is 3, the adjustment area can be divided into regions from bottom to top to obtain sub-adjustment area 1, sub-adjustment area 2, and sub-adjustment area 3.

[0085] The oblique division direction refers to the direction in which the adjustment area is divided, and the sub-adjustment area refers to a plurality of sub-areas after the adjustment area is divided.

[0086] S335, determining the gradient adjustment coefficient corresponding to each of the sub-adjustment areas based on the tilt difference, offsetting the reference snow thickness according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each of the sub-adjustment areas, and obtaining the display snow thickness of the display area corresponding to the snow-covered element according to the sub-display thickness.

[0087] For snow-covered elements with a certain inclination, due to the effect of gravity, the snow accumulation conditions in different areas on the same slope are different. Therefore, the gradient adjustment coefficients corresponding to different sub-adjustment areas are different. The gradient adjustment coefficient corresponding to each sub-adjustment area can be determined according to the inclination difference. By offsetting the benchmark snow thickness according to the gradient adjustment coefficient corresponding to each sub-adjustment area, the sub-display thickness corresponding to each sub-adjustment area can be obtained, and thus the display snow thickness of the display area corresponding to the snow-covered element can be obtained.

[0088] Among them, the gradient adjustment coefficient refers to the coefficient for adjusting the snow thickness in the sub-adjustment area, the sub-display thickness refers to the snow thickness corresponding to the sub-adjustment area, and the display snow thickness refers to the snow thickness displayed by the snow-covered element in the digital twin space.

[0089] In some embodiments, the step S335 of "determining the gradient adjustment coefficient corresponding to each of the sub-adjustment areas based on the slope difference, and offsetting the reference snow thickness according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each of the sub-adjustment areas" includes the following steps: S3351, numbering each of the sub-adjustment areas based on the oblique division direction to obtain a level number corresponding to each of the sub-adjustment areas, wherein the oblique division direction is a direction from the bottom of the sub-adjustment area to the top of the sub-adjustment area.

[0090] Specifically, each sub-adjustment area may be numbered according to the oblique division direction, for example Figure 4 As shown in , the sub-adjustment area 1, the sub-adjustment area 2, and the sub-adjustment area 3 can be numbered in order, and the number of levels corresponding to the sub-adjustment area 1 is 1, the number of levels corresponding to the sub-adjustment area 2 is 2, and the number of levels corresponding to the sub-adjustment area 3 is 3. When performing the level numbering, the corresponding number can be assigned to each sub-adjustment area according to the oblique division direction, and the level number refers to the number value corresponding to the sub-adjustment area.

[0091] S3352: Divide the tilt difference equally according to the target division amount to obtain a unit difference, and obtain the offset difference corresponding to each of the sub-adjustment areas based on the product of the unit difference and the number of levels.

[0092] Specifically, by calculating the ratio of the inclination difference to the target division amount, the inclination difference can be evenly divided to obtain the corresponding unit difference. In order to make the difference corresponding to each level increase step by step, the unit difference can be multiplied by the number of levels respectively to obtain the offset difference corresponding to each sub-adjustment area. For example, by multiplying the level number 1 corresponding to sub-adjustment area 1 by the unit difference, the offset difference corresponding to sub-adjustment area 1 can be obtained. When the snow thickness is subsequently adjusted, it can be gradually reduced from bottom to top, so that it can be more in line with the actual situation. Among them, the unit difference refers to the difference corresponding to each sub-adjustment area obtained when the total inclination difference is evenly distributed to each sub-adjustment area, and the offset difference refers to the difference that each sub-adjustment area actually needs to adjust.

[0093] S3353: Obtain a gradient adjustment coefficient based on a ratio of the offset difference to the reference difference, and obtain an offset thickness corresponding to each of the sub-adjustment areas according to a product of the gradient adjustment coefficient and the reference adjustment thickness.

[0094] Specifically, the offset difference corresponding to each sub-adjustment area is calculated by ratio calculation with the pre-configured reference difference, and the gradient adjustment coefficient corresponding to each sub-adjustment area can be obtained. By multiplying each gradient adjustment coefficient with the reference adjustment thickness, the reference adjustment thickness can be offset to obtain the offset thickness corresponding to each sub-adjustment area. Among them, the reference difference refers to a pre-set standard deviation value, the reference adjustment thickness refers to a pre-set standard adjustment thickness, the reference adjustment thickness can be set corresponding to the reference difference, so that the reference adjustment thickness can be offset according to the reference difference, and the offset thickness refers to the thickness value that each sub-adjustment area actually needs to adjust.

[0095] S3354: Obtain the sub-display thickness corresponding to each of the sub-adjustment areas according to the difference between the reference snow thickness and the offset thickness.

[0096] Specifically, by performing difference calculation between the reference snow thickness and the offset thickness corresponding to each sub-adjustment area, the sub-display thickness corresponding to each sub-adjustment area can be obtained.

[0097] Through the above implementation, the actual distribution of snow on the inclined ground can be simulated more accurately.

[0098] S34, generating a snow-covered layer corresponding to the display area of ​​each of the snow-covered elements based on the displayed snow thickness and the snow coverage rate, and superimposing the snow-covered layer on the corresponding display area to obtain environmental update data.

[0099] Specifically, after obtaining the display snow thickness, a snow-covered layer corresponding to the snow-covered element can be generated by combining the display snow thickness and the snow coverage rate corresponding to the snow-covered element. The snow-covered layer can be used to display the snow-covered condition. By generating a corresponding snow-covered layer and superimposing it on the corresponding display area, the display area corresponding to the snow-covered element can be updated to obtain the corresponding environment update data. The snow-covered layer refers to a layer for displaying the snow-covered condition.

[0100] Through the above real-time method, the environmental changes under the snow mode can be simulated more accurately, making the environmental display in the digital twin space closer to the actual situation, and can reduce the amount of data processing and improve data processing efficiency.

[0101] In some embodiments, the specific implementation of step S34 may be: S341, obtaining a display area corresponding to the display area, and obtaining a snow area according to the product of the snow coverage rate and the display area.

[0102] Specifically, the area corresponding to the display area, i.e., the display area, can be obtained. By multiplying the snow coverage rate by the display area, the corresponding snow area can be obtained. For example, when the snow coverage rate is 95%, it can be considered that 95% of the area in the display area will be covered with snow. The snow area refers to the area covered by snow in the display area.

[0103] S342: Generate an initial snow-covered layer corresponding to the display area according to the area outline of the display area and the snow accumulation area.

[0104] Specifically, after obtaining the snow area, an initial snow layer corresponding to the display area can be generated according to the snow area, and the outline of the initial snow layer is consistent with the regional outline of the display area, but because the snow coverage rate may not reach 100%, the specifications of the snow layer may be slightly smaller than those of the display area. Among them, the initial snow layer refers to a layer that displays the snow situation in the initial state obtained in combination with the display area, and the initial snow layer does not adjust the parameters corresponding to the snow thickness.

[0105] S343: Based on the inclined division direction and the target division amount, the initial snow-covered layer is divided into a plurality of sub-areas.

[0106] Specifically, the initial snow-covered layer can be divided according to the inclined division direction to obtain multiple sub-areas, and the number of sub-areas is the same as the target division amount. For example, when the target division amount is 3, the initial snow-covered layer can be divided into 3 sub-areas.

[0107] S344, determining virtual adjustment parameters corresponding to the displayed snow thickness of each of the sub-adjustment areas, and adjusting the display parameters of the sub-areas corresponding to each of the sub-adjustment areas according to the virtual adjustment parameters to obtain the snow-covered layer.

[0108] It can be understood that in actual applications, different displayed snow thicknesses have corresponding virtual adjustment parameters. Therefore, the virtual adjustment parameters corresponding to each sub-adjustment area can be obtained according to the displayed snow thickness of each sub-adjustment area. Since each sub-adjustment area has a corresponding sub-area in the initial snow-covered layer, the parameters corresponding to the display thickness of the corresponding sub-area can be adjusted according to the virtual adjustment parameters corresponding to each sub-adjustment area to obtain the corresponding snow-covered layer.

[0109] S345, locating the center point of the snow-covered layer based on the center point of the display area, and superimposing the snow-covered layer on the corresponding display area to obtain environmental update data.

[0110] Specifically, by locating the center point of the snow-covered layer with the center point of the corresponding display area, the snow-covered layer can be superimposed on the corresponding display area, thereby updating the display area and obtaining corresponding environmental update data.

[0111] S4, receiving a remote access point selected by the user terminal based on the dynamic display space, acquiring synchronous display data collected by the monitoring device based on the remote access point, and sending the data to the user terminal.

[0112] It is understandable that a village usually includes multiple areas, such as a square area, a street area, etc. After viewing the virtual dynamic display space, the user may become interested in the actual village scene and hope to further view the real scene of a specific location. At this time, the user can select the location point corresponding to the area where the real scene is desired to be viewed through the dynamic display space, that is, the remote access point. For example, if the user wants to view the square area in the village, then the location point corresponding to the square area in the dynamic display space is the remote access point. After receiving the remote access point selected by the user, the monitoring device can be controlled to go to the collection point corresponding to the remote access point to collect data, obtain the corresponding synchronous display data, and send it to the user. The user can view the actual scene of the specific location through the synchronous display data.

[0113] Based on the above embodiment, the specific implementation of step S4 may be: S41, obtaining historical collection data corresponding to each of the remote access points in a recent time period, and determining a remote access point for which the historical collection data does not exist as a current collection point.

[0114] Among them, historical collection data refers to the video data collected and saved by the monitoring equipment at the remote access point in the village in the recent period of time, and the current collection point refers to the remote access point currently selected by the user but has no corresponding historical collection data in the past time period.

[0115] Since multiple users may select the same remote access point for viewing within a time period, when the viewing time of multiple users is close, the actual scene corresponding to the remote access point will hardly change. Therefore, when a user requests to view the real scene of a remote access point that has been selected, since the data of the remote access point has been collected, in order to reduce the collection workload of the monitoring equipment, the historical collection data corresponding to the point can be directly obtained without re-collecting data, thereby saving time and resources. If the remote access point selected by the user does not have corresponding historical collection data in the past time period, the corresponding remote access point can be controlled to be determined as the current collection point, and the monitoring equipment can be controlled to go to the location corresponding to the current collection point for data collection.

[0116] S42, generating a collection path connecting each of the current collection points, and controlling the monitoring device to collect data based on the collection path to obtain current collection data.

[0117] Specifically, since there may be multiple current collection points, when collecting data for multiple current collection points, a collection path corresponding to the monitoring device can be generated in combination with the multiple current collection points, so that the monitoring device can be controlled to collect video data along the collection path to obtain the current collection data corresponding to the current collection point.

[0118] S43, splitting the current collection data to obtain sub-collection data corresponding to each current collection point, determining the viewing order of each remote access point configuration configured by the user terminal, and splicing each historical collection data and / or sub-collection data according to the viewing order to obtain synchronous display data.

[0119] After the monitoring device completes data collection for all current collection points, a continuous video data segment can be obtained, namely, the current collection data. The current collection data includes information of all current collection points. Since the viewing order of the user may be different from the order during data collection, the current collection data can be split so that the data of each current collection point can be extracted separately to form sub-collection data corresponding to each current collection point. After the sub-collection data of each current collection point is split, a corresponding viewing order is configured when the user requests to view the real-life data of a remote access point. According to the viewing order configured by the user, the historical collection data and / or sub-collection data can be spliced ​​to obtain corresponding synchronous display data.

[0120] When obtaining synchronous display data, if the remote access point selected by the user has historical collection data, then the historical collection data and the sub-collection data need to be spliced ​​in the viewing order to obtain the corresponding synchronous display data. If the remote access point selected by the user does not have historical collection data, then it is only necessary to splice each sub-collection data according to the viewing data to obtain the corresponding synchronous display data.

[0121] In some embodiments, the step S43 of "splitting the current acquisition data to obtain sub-acquisition data corresponding to each current acquisition point" includes the following steps: S431, obtaining a display range corresponding to each current collection point, and determining that a path segment in the collection path that is located within each display range is a collection segment corresponding to the current collection point.

[0122] Specifically, when the current display data is split, since each current collection point has a corresponding display range, the display range corresponding to each current collection point can be obtained. Combined with the collection path of the monitoring equipment, it can be determined which path segments are within the display range, and the path segments within the display range can be regarded as the collection segments corresponding to the corresponding collection points.

[0123] Among them, the display range refers to the video acquisition range corresponding to the current acquisition point, the path segment refers to the acquisition path within the display range, and the acquisition segment refers to the partial path segment in the acquisition path that is within the display range of the current acquisition point.

[0124] S432, determining the start time and the end time corresponding to each of the acquisition segments, determining the corresponding video segment in the current acquisition data according to the start time and the end time, and determining the video segment as the sub-acquisition data corresponding to the current acquisition point.

[0125] After determining the acquisition segment corresponding to each acquisition point, the start time and end time of each acquisition segment in the current acquisition data can be further determined, so that the video segment in the corresponding time period can be extracted from the current acquisition data as the sub-acquisition data corresponding to the current acquisition point. The start time refers to the time when the video acquisition of the acquisition segment starts, the end time refers to the time when the video acquisition of the acquisition segment ends, and the video segment refers to the video data corresponding to the acquisition segment in the acquisition data.

[0126] Through the above implementation, it can be ensured that each user can obtain the display data corresponding to his / her own needs in a timely and accurate manner, thereby improving the acquisition efficiency of the display data.

[0127] See also Figure 5 , is a structural diagram of a digital village processing system based on digital twins provided in an embodiment of the present invention. The digital village data processing system based on digital twins includes: A generation module, used to generate a digital twin space corresponding to the target location according to the data configuration information of the management end, wherein the digital twin space includes multiple display elements; A calling module, used for calling a timing update strategy to obtain monitoring data corresponding to a display element with dynamic attributes, and obtaining timing update data corresponding to the display element according to the monitoring data; An updating module, configured to obtain environmental data collected by a monitoring device based on an environmental update strategy, obtain environmental update data corresponding to the display element according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space; The receiving module is used to receive the remote access point selected by the user terminal based on the dynamic display space, obtain the synchronous display data collected by the monitoring device based on the remote access point, and send it to the user terminal.

[0128] Figure 5 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.

[0129] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A digital village processing method based on digital twins, characterized in that: include: Generate a digital twin space corresponding to the target location according to the data configuration information of the management end, wherein the digital twin space includes multiple display elements; Retrieve the timing update strategy to obtain monitoring data corresponding to the display element of the dynamic attribute, and obtain the timing update data corresponding to the display element according to the monitoring data; Acquire environmental data collected by monitoring equipment based on an environmental update strategy, obtain environmental update data corresponding to the display element according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space; A remote access point selected by the user terminal based on the dynamic display space is received, and synchronous display data collected by the monitoring device based on the remote access point is acquired and sent to the user terminal.

2. The method according to claim 1, characterized in that Retrieving the timing update strategy to obtain monitoring data corresponding to the display element of the dynamic attribute, and obtaining the timing update data corresponding to the display element according to the monitoring data, including: Acquire a monitoring frame corresponding to the monitoring data, and determine a monitoring area in the monitoring frame according to a region positioning template corresponding to the display element, wherein the region positioning template includes a positioning area corresponding to the monitoring area; Extracting a plurality of display outlines corresponding to the display elements in the monitoring area, and determining a display state corresponding to each of the display outlines based on a state analysis model, wherein the display state includes a closed state and an open state; Determining an original state of the display element, and counting the number of outlines of display outlines corresponding to display states inconsistent with the original state; Equally dividing the display area corresponding to the display element in the digital twin space according to the number of contours and the division direction to obtain a plurality of sub-display areas; The center point of each sub-display area is obtained, and the display module closest to the center point is determined as a timing update module. The timing update module is updated according to the display state to obtain timing update data. The display area includes multiple display modules corresponding to the display elements.

3. The method according to claim 1, characterized in that Acquiring environmental data collected by monitoring equipment based on an environmental update strategy, and obtaining environmental update data corresponding to the display element according to the environmental data, including: Determine an environmental mode according to meteorological data, and when the environmental mode is a snow mode, obtain environmental data collected by a monitoring device based on multiple preset points; Acquire the display elements of the snow-covered attribute in the digital twin space as snow-covered elements, and determine the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data; Determine the reference snow thickness corresponding to each of the snow-covered elements according to the meteorological data, obtain the inclination corresponding to each of the snow-covered elements, and offset the reference snow thickness according to the inclination to obtain the displayed snow thickness corresponding to each of the snow-covered elements; A snow-covered layer corresponding to the display area of ​​each of the snow-covered elements is generated based on the displayed snow thickness and the snow coverage rate, and the snow-covered layer is superimposed on the corresponding display area to obtain environmental update data.

4. The method according to claim 3, characterized in that Determining the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data includes: Acquire an image frame corresponding to each of the environmental data, and determine an analysis area corresponding to the snow-covered element in the image frame according to an element positioning template, wherein the element positioning template includes an extraction area corresponding to each of the snow-covered elements; Determine the pixel points whose pixel values ​​in the analysis areas are located in the snow-covered pixel interval as snow accumulation points, and count the first number of the snow accumulation points and the second number corresponding to all the pixel points in the analysis areas; The snow accumulation ratio corresponding to the analysis area is obtained according to the first quantity and the second quantity, and the snow accumulation ratio corresponding to each snow-covered element in different image frames is averaged to obtain the snow coverage rate corresponding to each snow-covered element.

5. The method according to claim 3, characterized in that: Determining a reference snow thickness corresponding to each of the snow-covered elements according to the meteorological data, obtaining an inclination corresponding to each of the snow-covered elements, and offsetting the reference snow thickness according to the inclination to obtain a displayed snow thickness corresponding to each of the snow-covered elements, including: Acquire the current snow thickness corresponding to the meteorological data, and determine that the current snow thickness is the reference snow thickness corresponding to each of the snow-covered elements; Determine that the display area corresponding to each of the snow-covered elements is an adjustment area, and obtain the inclination corresponding to the adjustment area; Obtaining a tilt difference between the tilt and the reference tilt, traversing the snow distribution table according to the tilt difference, and determining a distribution division amount corresponding to a difference interval where the tilt difference is located as a target division amount; The snow distribution table includes a plurality of difference intervals and distribution division amounts corresponding to the difference intervals. The larger the value corresponding to the difference interval, the larger the distribution division amount. Dividing the adjustment area according to the inclined division direction corresponding to the adjustment area and the target division amount to obtain a plurality of sub-adjustment areas; The gradient adjustment coefficient corresponding to each sub-adjustment area is determined based on the tilt difference, the reference snow thickness is offset according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each sub-adjustment area, and the display snow thickness of the display area corresponding to the snow-covered element is obtained according to the sub-display thickness.

6. The method according to claim 5, characterized in that Determining a gradient adjustment coefficient corresponding to each of the sub-adjustment areas based on the tilt difference, and offsetting the reference snow thickness according to the gradient adjustment coefficient to obtain a sub-display thickness corresponding to each of the sub-adjustment areas, including: Performing level numbering on each of the sub-adjustment areas based on the oblique division direction to obtain the level number corresponding to each of the sub-adjustment areas, wherein the oblique division direction is the direction from the bottom of the sub-adjustment area to the top of the sub-adjustment area; The tilt difference is evenly divided according to the target division amount to obtain a unit difference, and the offset difference corresponding to each of the sub-adjustment areas is obtained based on the product of the unit difference and the number of levels; Obtaining a gradient adjustment coefficient based on a ratio of the offset difference to the reference difference, and obtaining an offset thickness corresponding to each of the sub-adjustment areas according to a product of the gradient adjustment coefficient and the reference adjustment thickness; The sub-display thickness corresponding to each sub-adjustment area is obtained according to the difference between the reference snow thickness and the offset thickness.

7. The method according to claim 5, characterized in that Generating a snow-covered layer corresponding to the display area of ​​each snow-covered element based on the displayed snow thickness and the snow coverage rate, and superimposing the snow-covered layer on the corresponding display area to obtain environment update data, including: Acquire a display area corresponding to the display area, and obtain the snow area according to the product of the snow coverage rate and the display area; Generate an initial snow-covered layer corresponding to the display area according to the area outline of the display area and the snow accumulation area; Based on the inclined division direction and the target division amount, the initial snow-covered layer is divided into a plurality of sub-areas; Determine a virtual adjustment parameter corresponding to the displayed snow thickness of each of the sub-adjustment areas, and adjust the display parameters of the sub-areas corresponding to each of the sub-adjustment areas according to the virtual adjustment parameter to obtain the snow-covered layer; The center point of the snow-covered layer is located based on the center point of the display area, and the snow-covered layer is superimposed on the corresponding display area to obtain environmental update data.

8. The method according to claim 1, characterized in that Receiving a remote access point selected by a user terminal based on the dynamic display space, acquiring synchronous display data collected by the monitoring device based on the remote access point and sending the data to the user terminal, including: Acquire historical collection data corresponding to each of the remote access points in a recent time period, and determine that a remote access point that does not have the historical collection data is a current collection point; Generate a collection path connecting each of the current collection points, and control the monitoring device to collect data based on the collection path to obtain current collection data; The current collection data is split to obtain sub-collection data corresponding to each current collection point, the viewing order of each remote access point configuration configured by the user terminal is determined, and the historical collection data and / or sub-collection data are spliced ​​according to the viewing order to obtain synchronous display data.

9. The method according to claim 8, characterized in that The current collection data is split to obtain sub-collection data corresponding to each current collection point, including: Acquire the display range corresponding to each current collection point, and determine the path segment in the collection path that is located within each display range as the collection segment corresponding to the current collection point; Determine the start time and the end time corresponding to each acquisition segment, determine the corresponding video segment in the current acquisition data according to the start time and the end time, and determine the video segment as the sub-acquisition data corresponding to the current acquisition point.

10. A digital village processing system based on digital twins, characterized in that: include: A generation module, used to generate a digital twin space corresponding to the target location according to the data configuration information of the management end, wherein the digital twin space includes multiple display elements; A calling module, used for calling a timing update strategy to obtain monitoring data corresponding to a display element with dynamic attributes, and obtaining timing update data corresponding to the display element according to the monitoring data; An updating module, configured to obtain environmental data collected by a monitoring device based on an environmental update strategy, obtain environmental update data corresponding to the display element according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space; The receiving module is used to receive the remote access point selected by the user terminal based on the dynamic display space, obtain the synchronous display data collected by the monitoring device based on the remote access point, and send it to the user terminal.

Images