Digital Village Processing Method and System Based on Digital Twin

Abstract

The present invention provides a digital rural processing method and system based on digital twin. A digital twin space corresponding to a target location is generated according to the data configuration information of the management end. The digital twin space includes a plurality of display elements. The monitoring data corresponding to the display elements with dynamic attributes is obtained by retrieving the time-series update strategy. The time-series update data corresponding to the display elements is obtained according to the monitoring data. The environmental data collected by the monitoring devices is obtained based on the environmental update strategy. The environmental update data corresponding to the corresponding display elements is obtained according to the environmental data. The digital twin space is updated based on the time-series update data and the environmental update data to obtain a dynamic display space. The remote access point selected by the user end based on the dynamic display space is received, and the synchronous display data collected by the monitoring devices based on the remote access point is obtained and sent to the user end.

Description

Technical Field

[0001] The present invention relates to image processing technology, and in particular to a digital rural processing method and system based on digital twin. Background Art

[0002] With the rapid development of technology, previewing the rural scenery by remote viewing brings great convenience to users and greatly promotes the innovation and development of rural tourism.

[0003] In the prior art, when users preview the rural scenery by remote viewing, they can often only view the preset and single image display data, such as the pre-taken rural images in summer. This static display method cannot be flexibly adjusted dynamically in combination with the actual environment, resulting in the scenery remotely viewed by users may not match the actual rural scenery.

[0004] Therefore, how to dynamically adjust the scenery remotely viewed by users in combination with the actual rural scenery has become an urgent problem to be solved. Summary of the Invention

[0005] The present invention provides a digital rural processing method and system based on digital twin, which can dynamically adjust the scenery remotely viewed by users in combination with the actual rural scenery.

[0006] In the first aspect of the present invention, there is provided a digital rural processing method based on digital twin, including:

[0007] Generating a digital twin space corresponding to the target location according to the data configuration information of the management end, where the digital twin space includes a plurality of display elements;

[0008] Retrieving a time-series update strategy to obtain monitoring data corresponding to the display elements with dynamic attributes, and obtaining time-series update data corresponding to the display elements according to the monitoring data;

[0009] Obtaining environmental data collected by monitoring devices based on an environment update strategy, obtaining environment update data corresponding to the corresponding display elements according to the environmental data, and updating the digital twin space based on the time-series update data and the environment update data to obtain a dynamic display space;

[0010] Receiving a remote access point selected by the user end based on the dynamic display space, and obtaining synchronous display data collected by the monitoring device based on the remote access point and sending it to the user end.

[0011] Optionally, in a possible implementation manner of the first aspect, retrieving a time-series update strategy to obtain monitoring data corresponding to the display elements with dynamic attributes, and obtaining time-series update data corresponding to the display elements according to the monitoring data, includes:

[0012] Obtain the monitoring frame corresponding to the monitoring data, and determine the monitoring area in the monitoring frame according to the area positioning template corresponding to the display element, where the area positioning template includes a positioning area corresponding to the monitoring area;

[0013] Extract multiple display contours corresponding to the display element in the monitoring area, and determine the display state corresponding to each display contour based on the state analysis model, where the display state includes a closed state and an open state;

[0014] Determine the original state of the display element, and count the number of contours of the display contours corresponding to the display state inconsistent with the original state;

[0015] Equally divide the display area corresponding to the display element in the digital twin space according to the number of contours and the division direction to obtain a plurality of sub-display areas;

[0016] Obtain the center point of each sub-display area, determine the display module closest to the center point as the time series update module, and update the time series update module according to the display state to obtain time series update data, where the display area includes a plurality of display modules corresponding to the display element.

[0017] Optionally, in a possible implementation manner of the first aspect, obtain the environmental data collected by the monitoring device based on the environmental update strategy, and obtain the environmental update data corresponding to the corresponding display element according to the environmental data, including:

[0018] Determine the environmental mode according to the meteorological data. When the environmental mode is the snow accumulation mode, obtain the environmental data collected by the monitoring device based on a plurality of preset points;

[0019] Obtain the display elements with snow covering attributes in the digital twin space as snow-covered elements, and determine the snow coverage rate corresponding to each snow-covered element according to the environmental data;

[0020] Determine the reference snow thickness corresponding to each snow-covered element according to the meteorological data, obtain the inclination degree corresponding to each snow-covered element, and offset the reference snow thickness according to the inclination degree to obtain the display snow thickness corresponding to each snow-covered element;

[0021] Generate a snow-covered layer corresponding to the display area of each snow-covered element based on the display snow thickness and the snow coverage rate, and superimpose the snow-covered layer above the corresponding display area to obtain environmental update data.

[0022] Optionally, in a possible implementation manner of the first aspect, determine the snow coverage rate corresponding to each snow-covered element according to the environmental data, including:

[0023] Obtain the image frames corresponding to the respective environmental data, and determine the analysis regions corresponding to the snow-covered elements in the image frames according to the element positioning template, where the element positioning template includes extraction regions corresponding to the respective snow-covered elements;

[0024] Determine that the pixel points with pixel values within the snow-covered pixel range in the respective analysis regions are snow accumulation points, and count the first quantity of the snow accumulation points and the second quantity corresponding to all pixel points in the analysis regions;

[0025] Obtain the snow accumulation ratio corresponding to the analysis region according to the first quantity and the second quantity, and calculate the average value of the snow accumulation ratios corresponding to the respective snow-covered elements in different image frames to obtain the snow coverage rate corresponding to the respective snow-covered elements.

[0026] Optionally, in a possible implementation manner of the first aspect, determine the reference snow accumulation thickness corresponding to the respective snow-covered elements according to the meteorological data, obtain the inclination corresponding to the respective snow-covered elements, and offset the reference snow accumulation thickness according to the inclination to obtain the displayed snow accumulation thickness corresponding to the respective snow-covered elements, including:

[0027] Obtain the current snow accumulation thickness corresponding to the meteorological data, and determine the current snow accumulation thickness as the reference snow accumulation thickness corresponding to the respective snow-covered elements;

[0028] Determine the display regions corresponding to the respective snow-covered elements as adjustment regions, and obtain the inclination corresponding to the adjustment regions;

[0029] Obtain the inclination difference between the inclination and the reference inclination, traverse the snow distribution table according to the inclination difference, and determine that the distribution division quantity corresponding to the difference interval where the inclination difference is located is the target division quantity;

[0030] Wherein, the snow distribution table includes multiple difference intervals and the distribution division quantities corresponding to the difference intervals, and the larger the value corresponding to the difference interval, the larger the distribution division quantity;

[0031] Divide the adjustment region according to the inclination division direction corresponding to the adjustment region and the target division quantity to obtain a plurality of sub-adjustment regions;

[0032] Based on the inclination difference, determine the gradient adjustment coefficients corresponding to the respective sub-adjustment regions, offset the reference snow accumulation thickness according to the gradient adjustment coefficients to obtain the sub-display thicknesses corresponding to the respective sub-adjustment regions, and obtain the displayed snow accumulation thickness of the display region corresponding to the snow-covered element according to the sub-display thicknesses.

[0033] Optionally, in a possible implementation of the first aspect, determining a gradient adjustment coefficient corresponding to each of the sub-adjustment regions based on the tilt difference, and offsetting the reference snow depth according to the gradient adjustment coefficient to obtain a sub-display depth corresponding to each of the sub-adjustment regions, includes:

[0034] Hierarchically numbering each of the sub-adjustment regions based on the tilt division direction to obtain the number of levels corresponding to each of the sub-adjustment regions, where the tilt division direction is from the bottom to the top of the sub-adjustment region;

[0035] Dividing the tilt difference evenly according to the target division quantity to obtain a unit difference, and obtaining an offset difference corresponding to each of the sub-adjustment regions based on the product of the unit difference and the number of levels;

[0036] Obtaining a gradient adjustment coefficient based on the ratio of the offset difference to the reference difference, and obtaining an offset thickness corresponding to each of the sub-adjustment regions based on the product of the gradient adjustment coefficient and the reference adjustment thickness;

[0037] Obtaining a sub-display depth corresponding to each of the sub-adjustment regions based on the difference between the reference snow depth and the offset thickness.

[0038] Optionally, in a possible implementation of the first aspect, generating a snow-covered layer corresponding to the display area of each of the snow-covered elements based on the displayed snow depth and the snow coverage rate, and superimposing the snow-covered layer above the corresponding display area to obtain environment update data, includes:

[0039] Obtaining the display area corresponding to the display area, and obtaining the snow-covered area based on the product of the snow coverage rate and the display area;

[0040] Generating an initial snow-covered layer corresponding to the display area according to the regional contour of the display area and the snow-covered area;

[0041] Dividing the initial snow-covered layer based on the tilt division direction and the target division quantity to obtain a plurality of sub-regions;

[0042] Determining a virtual adjustment parameter corresponding to the displayed snow depth of each of the sub-adjustment regions, and adjusting the display parameters of the sub-regions corresponding to each of the sub-adjustment regions according to the virtual adjustment parameter to obtain the snow-covered layer;

[0043] Positioning the center point of the snow-covered layer based on the center point of the display area, and superimposing the snow-covered layer above the corresponding display area to obtain environment update data.

[0044] Optionally, in a possible implementation of the first aspect, receiving the remote access points selected by the client based on the dynamic display space, and obtaining the synchronous display data collected by the monitoring device based on the remote access points and sending the data to the client includes:

[0045] Obtaining the historical collection data corresponding to each of the remote access points in the recent time period, and determining the remote access points without the historical collection data as the current collection points;

[0046] Generating a collection path connecting each of the current collection points, and controlling the monitoring device to perform data collection based on the collection path to obtain current collection data;

[0047] Splitting the current collection data to obtain sub-collection data corresponding to each of the current collection points, determining the viewing order configured by the client for each of the remote access points, and splicing the historical collection data and / or the sub-collection data according to the viewing order to obtain synchronous display data.

[0048] Optionally, in a possible implementation of the first aspect, splitting the current collection data to obtain sub-collection data corresponding to each of the current collection points includes:

[0049] Obtaining the display range corresponding to each of the current collection points, and determining the path segments in the collection path within each of the display ranges as the collection segments corresponding to the respective current collection points;

[0050] Determining the start time and end time corresponding to each of the collection segments, determining the corresponding video segments in the current collection data according to the start time and the end time, and determining the video segments as the sub-collection data corresponding to the current collection points.

[0051] In a second aspect of the present invention, there is provided a digital rural processing system based on digital twin, including:

[0052] A generation module, configured to generate a digital twin space corresponding to a target location according to the data configuration information of the management end, where the digital twin space includes a plurality of display elements;

[0053] An extraction module, configured to extract a time series update policy to obtain monitoring data corresponding to the display elements with dynamic attributes, and obtain time series update data corresponding to the display elements according to the monitoring data;

[0054] An update module, configured to obtain environmental data collected by a monitoring device based on an environment update policy, obtain environmental update data corresponding to the respective display elements according to the environmental data, and update the digital twin space based on the time series update data and the environmental update data to obtain a dynamic display space;

[0055] A receiving module, configured to receive a remote access point selected by a client based on the dynamic display space, and obtain synchronous display data collected by the monitoring device based on the remote access point and send it to the client.

[0056] The beneficial effects of the present invention are as follows:

[0057] 1. The present invention can update the initial digital twin space through different update strategies in combination with the actually collected data to obtain a digital twin space that fits the actual situation. Users can view the rural scenery that fits the actual scene through the updated digital twin space. The present invention can combine the morphological changes of the display elements, retrieve the time-series update strategy to update the display elements with dynamic attributes, and corresponding time-series update data can be obtained, so that the morphological changes of the display elements with dynamic attributes can be updated in a timely manner, enabling the display elements in the digital twin space to more truly reflect their state distribution in reality.

[0058] 2. The present invention can retrieve the environment update strategy, control the monitoring device to collect the environmental data corresponding to the display elements in reality according to the environment update strategy, and combine the environmental data in reality to obtain the environment update data for updating the corresponding display elements, which can more truly present the display appearance of the display elements in the actual environment. Updating the digital twin space according to the time-series update data and the environment update data can obtain a dynamic display space that highly matches the actual situation. When the present invention obtains the environment update data, by analyzing the snow cover rate and snow depth of the display elements with snow cover attributes in the snow accumulation mode, the environmental changes in the snow accumulation mode can be more accurately simulated, making the environmental display in the digital twin space closer to the real situation.

[0059] 3. When the present invention obtains the snow cover rate, by combining the environmental data in reality, the snow cover rate corresponding to the snow-covered elements can be obtained, and the snow cover rate of the snow-covered elements can be obtained more accurately. Users can see a more realistic snow effect in the virtual digital twin space. When the present invention obtains the snow depth, the preset reference snow depth can be offset in combination with the inclination to obtain the snow depths corresponding to different positions of the snow-covered elements, and the actual distribution of snow on the inclined ground can be more accurately simulated. Description of the Drawings

[0060] Figure 1 is a schematic flowchart of a digital rural processing method based on digital twin provided by an embodiment of the present invention;

[0061] Figure 2 is a schematic diagram of a digital twin space from a top-down perspective provided by an embodiment of the present invention;

[0062] Figure 3 It is a schematic diagram of an analysis area provided by an embodiment of the present invention;

[0063] Figure 4 It is a schematic diagram of an adjustment area provided by an embodiment of the present invention;

[0064] Figure 5 It is a schematic structural diagram of a digital rural processing system based on digital twin provided by an embodiment of the present invention. Detailed implementation manners

[0065] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0066] The technical solutions of the present invention will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and for the same or similar concepts or processes, they may not be repeated in some embodiments.

[0067] See Figure 1 , which is a schematic diagram of a digital rural processing method based on digital twin provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown can be a software and / or hardware device. The execution subject of the present application may include, but is not limited to, at least one of the following: user equipment, network equipment, etc. Among them, the user equipment may include, but is not limited to, a computer, a smart phone, a personal digital assistant (Personal Digital Assistant, abbreviated as: PDA), and the above-mentioned electronic devices, etc. The network equipment may include, but is not limited to, a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of computers or network servers based on cloud computing. Among them, cloud computing is a type of distributed computing, which is composed of a group of loosely coupled computers to form a super virtual computer. This embodiment does not make any restrictions. It includes steps S1 to S4, specifically as follows:

[0068] S1, generate a digital twin space corresponding to the target location according to the data configuration information of the management end, and the digital twin space includes multiple display elements.

[0069] Among them, the management terminal refers to the terminal held by the management personnel, such as a computer. The data configuration information refers to various parameters when the management personnel construct the twin space according to the actual situation. For example, it can be the parameter data corresponding to each scenic spot in the actual village. The target location refers to the real village selected for constructing the digital twin space. The digital twin space is a virtual digital space that matches the real village. The display elements refer to each display part that constitutes the digital twin space. For example, the houses, benches, flowers, etc. that make up each scenic area, and they jointly present the display environment of the village.

[0070] This solution can combine the actually collected data and update the initial digital twin space through different update strategies to obtain a digital twin space that fits the actual situation. Users can view the diverse and dynamic rural scenery through the updated digital twin space.

[0071] Specifically, through the data configuration information input by the management terminal, such as the distribution location and area size of each scenic spot, a virtual digital space that highly matches the real village, that is, the digital twin space, can be constructed. The digital twin space contains the display data of each scenic spot. Refer to Figure 2 , which is a schematic diagram of the digital twin space from a top-down perspective provided by an embodiment of the present invention. As shown in Figure 2 , users can view the top-down view of the village that is more in line with the actual situation by clicking on the digital twin space from the top-down perspective, and subsequently, the digital twin space can be updated accordingly in combination with the environmental changes or time-series changes in the actual situation to obtain a virtual digital space that fits the actual scene.

[0072] S2, retrieve the time-series update strategy to obtain the monitoring data corresponding to the display elements with dynamic attributes, and obtain the time-series update data corresponding to the display elements according to the monitoring data.

[0073] It can be understood that the attributes corresponding to different display elements may be different. The forms of some display elements will change over time, and their corresponding attributes are dynamic attributes. For example, flowers that gradually bloom or wither over time. For the display elements with dynamic attributes that change dynamically over time, in order to more realistically present the corresponding morphological changes in the digital twin space, such as the flowers blooming in the flower bed, this solution can combine the morphological changes of the display elements and retrieve the time-series update strategy to update the display elements with dynamic attributes, and the corresponding time-series update data can be obtained.

[0074] Specifically, since different display elements have corresponding position areas in reality, for the display elements with dynamic attributes, this solution can control a drone equipped with a high-definition camera to collect data on the display elements. For example, for the flowers in a flower bed, the drone can be controlled to fly to the corresponding shooting position point in the area where the flower bed is located, and the shooting height and position point of the drone can be pre-configured. By shooting the display elements with the drone, the morphological change data of the display elements in reality, that is, the monitoring data, can be collected. Through the monitoring data, the changes in the morphology of the display elements with dynamic attributes over time can be observed. Therefore, the timing update data for updating the display elements can be obtained by combining the monitoring data.

[0075] When obtaining the monitoring data, for the display elements with dynamic attributes, since the corresponding lifecycles of different display elements are different, an interval time corresponding to their lifecycles can be configured for different display elements. The drone can collect data on the display elements according to the interval time. For example, the flowers in the flower bed can be photographed and data collected every 7 days, so that relatively complete morphological change data can be obtained within the lifecycle of the display elements.

[0076] Among them, the timing update strategy refers to the strategy for updating the display elements with dynamic attributes. The dynamic attribute refers to the attribute corresponding to the display element whose morphology changes over time. For example, the state of a flower changes over time, so the corresponding attribute is a dynamic attribute. The monitoring data refers to the shooting data collected by a drone equipped with a high-definition camera. The timing update data refers to the data after updating the display elements with dynamic attributes.

[0077] In some embodiments, the specific implementation manner of step S2 may be:

[0078] S21. Obtain the monitoring frame corresponding to the monitoring data, and determine the monitoring area in the monitoring frame according to the area positioning template corresponding to the display element. The area positioning template includes a positioning area corresponding to the monitoring area.

[0079] Specifically, the drone can collect the image frame corresponding to the display element. When collecting the monitoring data, it may collect image data irrelevant to the display element. In order to reduce the interference caused by the irrelevant image data to the display element during monitoring, the monitoring frame can be divided into areas by invoking the area positioning template corresponding to the display element. Through the positioning area in the area positioning template for positioning the display element, the monitoring area corresponding to the positioning area can be determined in the monitoring frame. The specifications of the area positioning template are the same as those of the monitoring frame. Therefore, it can be ensured that the positions of the monitoring areas corresponding to different monitoring frames are the same. By comparing the monitoring frames at different time points within the same position area, the morphological changes of the display element can be identified.

[0080] Among them, the monitoring frame refers to the image frame corresponding to the displayed element collected, the region positioning template refers to the pre-configured template that can be used to determine the monitoring area, and different displayed elements correspond to different region positioning templates. The monitoring area refers to the area where the displayed element is located in the monitoring frame. For example, when the displayed element is a flower, the monitoring area can be the area corresponding to the flower bed in the monitoring frame. The positioning area refers to the area in the region positioning template that can determine the monitoring area.

[0081] S22. Extract multiple display contours corresponding to the displayed element in the monitoring area, and determine the display state corresponding to each display contour based on the state analysis model. The display state includes a closed state and an open state.

[0082] Specifically, multiple display contours corresponding to the displayed element can be extracted from the monitoring area through contour extraction techniques such as edge detection algorithms. For example, when the displayed element is a flower, the contours of multiple flowers in the monitoring area can be extracted. Since the display state of the displayed element may be different at different time periods, in order to more accurately identify the display state corresponding to each display contour, this solution can pre-train the state analysis model so that it can determine the corresponding display state through the display contour. Therefore, the state analysis model can determine the display state corresponding to each display contour. For example, when the displayed element is a flower, if the display contour is an open flower contour, then the corresponding display state is the open state; if the display contour is a closed flower contour, then the corresponding display state is the closed state.

[0083] When training the state analysis model, first, a large amount of data containing the displayed element and its corresponding display state can be collected, and the collected data can be labeled, that is, one or more corresponding display state labels are assigned to each displayed element. Then, the contour features of the displayed element can be extracted, and these data are input into the state analysis model. The state analysis model can learn how to map the contour features of the displayed element to the corresponding display state, so that the corresponding display state can be determined according to the display contour of the displayed element.

[0084] Among them, the display contour refers to the contour corresponding to the displayed element, the state analysis model refers to the model that can analyze the state corresponding to the display contour, and the display state can be judged according to the features of the display contour. The display state refers to the appearance state of the displayed element during display, such as the open state and closed state of a flower.

[0085] S23. Determine the original state of the displayed element, and count the number of contours of the display contours corresponding to the display state that is inconsistent with the original state.

[0086] Specifically, the original state of the display element can be determined before the monitoring data is collected. Through the monitoring data, multiple display elements inconsistent with the original state can be obtained. The number of contours of the display contour corresponding to the display state inconsistent with the original state can be counted. For example, the original state can be a closed state. When the display contour of the display element has an open state, the number of display contours corresponding to the open state can be counted, that is, the number of contours.

[0087] Among them, the original state refers to the initial state of the display element before the monitoring data is collected, and the number of contours refers to the number of display contours corresponding to the display state inconsistent with the original state.

[0088] S24. According to the number of contours and the division direction, the display area corresponding to the display element in the digital twin space is evenly divided to obtain a plurality of sub-display areas.

[0089] Specifically, in the digital twin space, each display element has a corresponding display area. After obtaining the corresponding number of contours, this solution can pre-configure the corresponding division direction and evenly divide the display area according to the pre-configured division direction to obtain a plurality of sub-display areas. For example, when the number of contours is 4, the display area can be evenly divided into 4 parts according to the pre-configured division direction to obtain 4 corresponding sub-display areas. Among them, the division direction refers to the direction when the display area is divided into regions, and the sub-display area refers to a plurality of sub-regions obtained after the display area is evenly divided.

[0090] S25. Obtain the center points of each sub-display area, determine the display module closest to the center point as the time sequence update module, and update the time sequence update module according to the display state to obtain time sequence update data. The display area includes a plurality of display modules corresponding to the display element.

[0091] It can be understood that there are multiple display modules corresponding to the display element in each display area in the digital twin space. For example, when the display element is a flower, there are multiple flower modules in the display area corresponding to the flower in the digital twin space. When updating the display module corresponding to the display element, the display module corresponding to the display state inconsistent with the original state needs to be updated. If the positions of the display modules to be updated in state are accurately located in sequence, the data processing volume may increase. Therefore, this solution can display the distribution of elements in different states according to the evenly divided sub-display areas during display, which can improve the data processing efficiency. For example, when the display element is a flower and about 1 / 2 of the flowers are open, 1 / 2 of the display modules in the display area can be obtained for update.

[0092] Specifically, after obtaining multiple sub-display areas, the center points corresponding to each sub-display area can be determined, and the display module closest to the center point is used as the timing update module to be updated in terms of state. The timing update module is updated in terms of state according to the corresponding display state. For example, when the display module is originally in a closed state and the current state is an open state, the corresponding display module can be converted from the closed state to the open state, thereby obtaining corresponding timing update data.

[0093] Among them, the display module refers to the virtual module corresponding to the display element in the display area, and the timing update module refers to the display module closest to the center point and to be updated in terms of display state.

[0094] Through the above implementation method, the morphological changes of the dynamic attribute display elements can be updated in real time, so that the display elements in the digital twin space can more realistically reflect the state distribution in reality.

[0095] S3. Obtain the environmental data collected by the monitoring device based on the environmental update strategy, obtain the environmental update data corresponding to the corresponding display element according to the environmental data, and update the digital twin space based on the timing update data and the environmental update data to obtain a dynamic display space.

[0096] It can be understood that in practical applications, different weather conditions will change the appearance of the natural environment. Therefore, the corresponding display appearances of the display elements may be different under different weather conditions. For example, when the display element is a house, in sunny weather conditions, its corresponding display appearance is usually its natural and undecorated appearance. In snowy weather conditions, the display appearance of the house may change significantly, and the snow will cover the house, resulting in a change in the appearance of the house.

[0097] In order to more realistically present the display appearances of the display elements under different weather conditions, this solution can retrieve the environmental update strategy, control the monitoring device to collect the environmental data corresponding to the display elements in reality according to the environmental update strategy. Combining the environmental data in reality, the environmental update data for updating the corresponding display elements can be obtained. Updating the digital twin space according to the timing update data and the environmental update data can obtain a dynamic display space that highly matches the actual situation.

[0098] Among them, the environmental update strategy refers to the strategy of updating display elements in combination with actual environmental data. The monitoring device refers to a device that can collect actual environmental data, such as a drone with a downward camera. The environmental data refers to the captured data that can display the actual environment collected by the monitoring device. The environmental update data refers to the data obtained after updating the display elements in combination with the environmental data. The dynamic display space refers to the digital twin space after temporal update and environmental update.

[0099] In some embodiments, "obtaining the environmental data collected by the monitoring device based on the environmental update strategy and obtaining the environmental update data corresponding to the display elements according to the environmental data" in step S3 includes the following steps:

[0100] S31, determining the environmental mode according to the meteorological data. When the environmental mode is the snow accumulation mode, obtaining the environmental data collected by the monitoring device based on multiple preset points.

[0101] When combining the actual environmental data to obtain the environmental update data for updating the display elements, this solution can display the environmental data of the countryside under snow conditions in the digital twin space. Specifically, it can perform layout display in the virtual space according to the actual environmental data, so that the digital twin space can be more closely integrated with the actual rural scene.

[0102] Specifically, according to the meteorological data announced by the meteorological department, when it is determined that the current weather condition is snowy, the corresponding environmental mode can be determined as the snow accumulation mode. At this time, the monitoring device can be controlled to go to multiple preset points pre-configured for environmental data collection. The monitoring device can collect data on the snow coverage rate in real time. By analyzing and processing the environmental data, the snow situation under the snow accumulation mode can be understood in a timely manner.

[0103] Among them, the meteorological data refers to the data that can describe the weather conditions collected by the meteorological department through satellite remote sensing technology, including rainfall, snowfall, etc. The environmental mode refers to a description of the natural environmental state according to the current meteorological conditions, including sunny mode, rainy mode, snow accumulation mode, etc. The snow accumulation mode refers to an environmental mode corresponding when the meteorological data shows that the current weather condition is snowy. The preset point refers to the position point preset and configured in advance for monitoring environmental data.

[0104] S32, obtaining the display elements with snow-covered attributes in the digital twin space as snow-covered elements, and determining the snow coverage rate corresponding to each snow-covered element according to the environmental data.

[0105] It can be understood that each display element in the digital twin space has corresponding attributes. For a display element that can be covered by snow in reality, its corresponding attribute is the snow-covered attribute, and the corresponding display element can be determined as a snow-covered element. For example, when the display element is a road, since the road can be covered by snow in reality, the corresponding attribute is the snow-covered attribute, and the road can be determined as a snow-covered element. After obtaining the environmental data in the snowfall mode, the snow coverage rate corresponding to the snow-covered element can be obtained, and the snow coverage rates corresponding to different snowfall amounts are different. When the snowfall amount is larger, the corresponding snow coverage rate is also larger. Subsequently, the display element can be updated based on the snow coverage rate.

[0106] In practical applications, there are many scenic spots in the countryside. If data collection is carried out on the snow coverage of each scenic spot, the amount of data collection is large and the data processing efficiency is low. In order to improve the data processing efficiency, this solution can control the monitoring device to go to fixed data collection points for data collection, and predict the overall snow coverage based on the collected data, which can reduce the amount of data collection and improve the efficiency.

[0107] Among them, the snow-covered attribute refers to the characteristic that describes that the display element can be covered by snow in snowy weather. The snow-covered element refers to the display element with the snow-covered attribute. The snow coverage rate refers to the coverage rate corresponding to the snow-covered element in the entire digital twin space predicted. Through the snow coverage rate, the coverage degree of the snow on the display element can be intuitively understood.

[0108] In some embodiments, "determining the snow coverage rate corresponding to each of the snow-covered elements according to the environmental data" in step S32 includes the following steps:

[0109] S321, obtaining the image frames corresponding to each of the environmental data, and determining the analysis area corresponding to the snow-covered element in the image frame according to the element positioning template, where the element positioning template includes extraction areas corresponding to each of the snow-covered elements.

[0110] It can be understood that the same type of snow-covered element may be widely distributed in different position areas in the actual environment, such as the ground and roof covered by snow. And in the multiple environmental data corresponding to multiple preset points, these areas may be captured in multiple image frames. In order to comprehensively evaluate the snow conditions of these snow-covered elements, the snow-covered elements appearing in each frame of the image can be identified and their snow ratios can be calculated.

[0111] Specifically, image frames corresponding to various environmental data can be obtained. Since the shooting height and shooting parameters remain unchanged each time the monitoring device collects data, and there may be multiple snow-covered elements in the image frame, in order to quickly locate each snow-covered element, a pre-configured element positioning template can be retrieved to identify and locate each snow-covered element. Since the element positioning template may contain multiple extraction areas for identifying and locating the areas of each snow-covered element, through the multiple extraction areas in the element positioning template, the analysis areas corresponding to each snow-covered element can be determined from the image frame, and each analysis area has a corresponding snow-covered element. Refer to Figure 3 , which is a schematic diagram of an analysis area provided by an embodiment of the present invention. As shown in Figure 3 , in the image frame, the snow-covered element corresponding to analysis area 1 can be a road, and the snow-covered element corresponding to analysis area 2 can be a flower. Different snow-covered elements have different corresponding snow cover conditions.

[0112] Among them, the element positioning template refers to a template for identifying and locating the areas corresponding to different snow-covered elements in the image frame. The analysis area refers to the area determined to correspond to the snow-covered element after being identified and located by the element positioning template in the image frame. The extraction area refers to the area in the element positioning template, which can be used to identify and extract the area corresponding to the snow-covered element from the image frame.

[0113] S322. Determine that the pixel points with pixel values within the snow-covered pixel range in each of the analysis areas are snow accumulation points, and count the first quantity of the snow accumulation points and the second quantity corresponding to all pixel points in the analysis area.

[0114] Specifically, the pixel values corresponding to multiple pixel points located in each analysis area can be obtained. Since the pixel values corresponding to the snow accumulation area are different from those corresponding to other areas, the pixel value range where the pixel points corresponding to the snow accumulation area are located can be pre-configured, that is, the snow-covered pixel range. For example, the snow-covered pixel range can be the pixel range corresponding to white pixel values. After obtaining the pixel values corresponding to multiple pixel points in each analysis area, compare the pixel values corresponding to the multiple pixel points with the snow-covered pixel range respectively. If the pixel value corresponding to the pixel point is within the snow-covered pixel range, it can be considered that the corresponding pixel point is a pixel point in the snow accumulation area, that is, a snow accumulation point. By counting all the snow accumulation points in each analysis area, the first quantity corresponding to each analysis area can be obtained. By counting all the pixel points in each analysis area, the second quantity corresponding to each analysis area can be obtained.

[0115] Among them, the snow-covered pixel range refers to the pixel value range where the pixel points corresponding to the snow accumulation area are located. The snow accumulation point refers to the pixel point with a pixel value within the snow-covered pixel range. The first quantity refers to the number of snow accumulation points in the analysis area. The second quantity refers to the number of all pixel points in the analysis area.

[0116] S323. Obtain the snow cover ratio corresponding to the analysis area based on the first quantity and the second quantity, and calculate the average value of the snow cover ratios corresponding to each snow-covered element in different image frames to obtain the snow cover rate corresponding to each snow-covered element.

[0117] By calculating the ratio of the first quantity to the second quantity, the snow cover ratio corresponding to the snow-covered elements in each analysis area can be obtained. Since the same snow-covered element may appear in multiple image frames, the snow cover ratios corresponding to the same snow-covered element in different image frames can be calculated. By calculating the average value of multiple snow cover ratios, the snow cover rate corresponding to each snow-covered element can be obtained. For example, if there is a road element in multiple image frames, then the road element may correspond to multiple snow cover ratios. By calculating the average value of multiple snow cover ratios, the snow cover rate corresponding to the road element can be obtained.

[0118] Among them, the snow cover ratio refers to the proportion of the snow-covered area on the snow-covered element.

[0119] Through the above implementation manner, the accuracy of panoramic prediction in the snow cover mode can be improved, and the efficiency of data processing can also be improved.

[0120] S33. Determine the reference snow depth corresponding to each snow-covered element according to the meteorological data, obtain the inclination corresponding to each snow-covered element, and offset the reference snow depth according to the inclination to obtain the displayed snow depth corresponding to each snow-covered element.

[0121] In practical applications, the corresponding snowfall can be determined through the meteorological data published by the meteorological department, so that the snow depth corresponding to the snow-covered element, that is, the reference snow depth, can be obtained. When the snow-covered element is a flat element without slope, such as a flat ground, the corresponding displayed snow depth is the reference snow depth. When the snow-covered element is a sloped element, such as a sloped ground, since on the sloped ground, the snow is affected by gravity and may slide along the slope, resulting in an increase in the snow depth at the bottom of the slope and a possible decrease in the snow depth at the top of the slope due to sliding. Therefore, for a snow-covered element with a slope, such as a sloped ground, the inclination will affect the accumulation amount of snow at different positions. The corresponding inclination can be obtained, and the reference snow depth is offset according to the inclination to obtain the snow depths corresponding to different positions of the snow-covered element, and then the displayed snow depth corresponding to the snow-covered element can be obtained.

[0122] Among them, the reference snow depth refers to the standard value of the snow depth without the influence of terrain factors. The inclination refers to the angle between the surface of the snow-covered element with a slope and the horizontal plane. The displayed snow depth refers to the snow depth when it is displayed in the digital twin space after adjusting the reference snow depth in combination with the inclination. For a flat ground, the displayed snow depth may be the same as the reference snow depth, but for a ground with a slope, the displayed snow depth will vary depending on the inclination.

[0123] In some embodiments, step S33 includes S331 to S335, specifically as follows:

[0124] S331, obtain the current snow depth corresponding to the meteorological data, and determine the current snow depth as the reference snow depth corresponding to each snow-covered element.

[0125] Specifically, the current corresponding snow depth can be obtained according to the snowfall amount in the meteorological data announced by the meteorological department, that is, the current snow depth. The current snow depth can be determined as the reference snow depth corresponding to the snow-covered element. Among them, the current snow depth refers to the snowfall depth obtained according to the snowfall amount in the meteorological data announced by the meteorological department.

[0126] S332, determine the display area corresponding to each snow-covered element as the adjustment area, and obtain the inclination corresponding to the adjustment area.

[0127] Specifically, the display area corresponding to the snow-covered element can be determined as the adjustment area. Since the position areas corresponding to the snow-covered elements are different, the corresponding inclinations may also be different. Under different inclinations, the snow coverage may also be different. Therefore, first, the inclination corresponding to the adjustment area can be obtained, and then the snow depth can be adjusted accordingly in combination with the inclination. Among them, the adjustment area refers to the area for adjusting the snow coverage in the digital twin space.

[0128] S333, obtain the inclination difference between the inclination and the reference inclination, traverse the snow distribution table according to the inclination difference, and determine the distribution division amount corresponding to the difference interval where the inclination difference is located as the target division amount.

[0129] Among them, the snow distribution table includes multiple difference intervals and the distribution division amounts corresponding to the difference intervals. The larger the value corresponding to the difference interval, the larger the distribution division amount.

[0130] It can be understood that the distribution of the snow depth on the slopes corresponding to different inclinations may be different. The slope can be divided accordingly in combination with the inclination of the snow-covered element, so that the snow depth at different positions on the slope can be adjusted to make it more consistent with the actual snow situation in the environment.

[0131] Specifically, in this solution, a snow accumulation distribution table including multiple difference intervals can be pre-configured. By calculating the difference between the inclination and the pre-configured reference inclination, the corresponding inclination difference can be obtained. By traversing the snow accumulation distribution table according to the inclination difference, the difference interval corresponding to the inclination difference can be determined, and then the corresponding distribution division quantity can be obtained. This distribution division quantity can be determined as the corresponding target division quantity. The larger the inclination difference, the larger the corresponding difference interval, the greater the difference in snow thickness between the top and bottom of the slope, and the larger the obtained distribution division quantity.

[0132] Among them, the reference inclination refers to the inclination angle under normal circumstances set in advance. The inclination difference refers to the difference between the inclination and the reference inclination. The difference interval refers to the interval in the snow accumulation distribution table that contains multiple inclination differences. The distribution division quantity refers to the division quantity corresponding to each difference interval. The target division quantity refers to the division quantity corresponding to the difference interval where the inclination difference is located.

[0133] S334. Divide the adjustment area according to the inclination division direction corresponding to the adjustment area and the target division quantity to obtain multiple sub-adjustment areas.

[0134] See Figure 4 , which is a schematic diagram of an adjustment area provided by an embodiment of the present invention. As shown in Figure 4 , the direction from bottom to top can be determined as the inclination division direction. When the target division quantity is 3, the adjustment area can be divided into sub-adjustment area 1, sub-adjustment area 2, and sub-adjustment area 3 according to the direction from bottom to top.

[0135] Among them, the inclination division direction refers to the direction when dividing the adjustment area into regions. The sub-adjustment area refers to multiple sub-regions after dividing the adjustment area into regions.

[0136] S335. Determine the gradient adjustment coefficient corresponding to each sub-adjustment area based on the inclination difference. Offset the reference snow thickness according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each sub-adjustment area. Obtain the displayed snow thickness of the snow-covered element corresponding to the display area according to the sub-display thickness.

[0137] For snow-covered elements with a certain inclination, due to the action of gravity, the snow accumulation conditions corresponding to different regions on the same slope are different. Therefore, the gradient adjustment coefficients corresponding to different sub-adjustment areas are different. The gradient adjustment coefficient corresponding to each sub-adjustment area can be determined according to the inclination difference. Offset the reference snow thickness according to the gradient adjustment coefficient corresponding to each sub-adjustment area to obtain the sub-display thickness corresponding to each sub-adjustment area, so as to obtain the displayed snow thickness of the display area corresponding to the snow-covered element.

[0138] Among them, the gradient adjustment coefficient refers to the coefficient for adjusting the snow depth in the sub-adjustment area, the sub-display depth refers to the snow depth corresponding to the sub-adjustment area, and the displayed snow depth refers to the snow depth displayed by the snow-covered element in the digital twin space.

[0139] In some embodiments, "determining the gradient adjustment coefficient corresponding to each sub-adjustment area based on the tilt difference, and offsetting the reference snow depth according to the gradient adjustment coefficient to obtain the sub-display depth corresponding to each sub-adjustment area" in step S335 includes the following steps:

[0140] S3351, hierarchically numbering each sub-adjustment area based on the tilt division direction to obtain the level number corresponding to each sub-adjustment area, where the tilt division direction is from the bottom to the top of the sub-adjustment area.

[0141] Specifically, each sub-adjustment area can be hierarchically numbered according to the tilt division direction. For example, Figure 4 As shown in, the sub-adjustment area 1, sub-adjustment area 2, and sub-adjustment area 3 can be hierarchically numbered in sequence, and the level number corresponding to sub-adjustment area 1 can be obtained as 1, the level number corresponding to sub-adjustment area 2 can be obtained as 2, and the level number corresponding to sub-adjustment area 3 can be obtained as 3. Among them, when hierarchically numbering, the corresponding number can be assigned to each sub-adjustment area according to the tilt division direction, and the level number refers to the numerical value of the number corresponding to the sub-adjustment area.

[0142] S3352, evenly dividing the tilt difference according to the target division amount to obtain a unit difference, and obtaining the offset difference corresponding to each sub-adjustment area based on the product of the unit difference and the level number.

[0143] Specifically, by calculating the ratio of the tilt difference to the target division amount, the tilt difference can be evenly divided to obtain the corresponding unit difference. In order to make the differences corresponding to each level increase gradually, the unit difference can be multiplied by each level number respectively to obtain the offset difference corresponding to each sub-adjustment area. For example, by multiplying the level number 1 corresponding to sub-adjustment area 1 by the unit difference, the offset difference corresponding to sub-adjustment area 1 can be obtained. When adjusting the snow depth subsequently, it can be gradually decreased from bottom to top, so as to be more in line with the actual situation. Among them, the unit difference refers to the difference corresponding to each sub-adjustment area obtained by evenly distributing the total tilt difference to each sub-adjustment area, and the offset difference refers to the difference that each sub-adjustment area actually needs to adjust.

[0144] S3353, obtaining the gradient adjustment coefficient based on the ratio of the offset difference to the reference difference, and obtaining the offset thickness corresponding to each sub-adjustment area based on the product of the gradient adjustment coefficient and the reference adjustment thickness.

[0145] Specifically, by calculating the ratio of the offset difference corresponding to each sub-adjustment area to the pre-configured reference difference, the gradient adjustment coefficient corresponding to each sub-adjustment area can be obtained. By multiplying each gradient adjustment coefficient by the reference adjustment thickness, the reference adjustment thickness can be offset to obtain the offset thickness corresponding to each sub-adjustment area. Among them, the reference difference refers to a pre-set standard difference, the reference adjustment thickness refers to a pre-set standard adjustment thickness, and the reference adjustment thickness can be set corresponding to the reference difference, so that the reference adjustment thickness can be offset according to the reference difference. The offset thickness refers to the thickness value that each sub-adjustment area actually needs to adjust.

[0146] S3354, obtain the sub-display thickness corresponding to each sub-adjustment area according to the difference between the reference snow thickness and the offset thickness.

[0147] Specifically, by calculating the difference between the reference snow thickness and the offset thickness corresponding to each sub-adjustment area respectively, the sub-display thickness corresponding to each sub-adjustment area can be obtained.

[0148] Through the above implementation, the actual distribution of snow on the inclined ground can be simulated more accurately.

[0149] S34, generate a snow-covered layer corresponding to the display area of each snow-covered element based on the display snow thickness and the snow coverage rate, and superimpose the snow-covered layer above the corresponding display area to obtain environmental update data.

[0150] Specifically, after obtaining the display snow thickness, the snow-covered layer corresponding to the snow-covered element can be generated by combining the display snow thickness and the snow coverage rate corresponding to the snow-covered element. The snow-covered layer can be used to display the snow-covered situation. By generating the corresponding snow-covered layer and superimposing it above the corresponding display area, the display area corresponding to the snow-covered element can be updated to obtain the corresponding environmental update data. Among them, the snow-covered layer refers to the layer for displaying the snow-covered situation.

[0151] Through the above real-time method, the environmental changes in the snow-covered mode can be simulated more accurately, making the environmental display in the digital twin space closer to the real situation, and can reduce the data processing volume and improve the data processing efficiency.

[0152] In some embodiments, the specific implementation manner of step S34 may be:

[0153] S341, obtain the display area corresponding to the display area, and obtain the snow-covered area according to the product of the snow coverage rate and the display area.

[0154] Specifically, the corresponding area of the display area, that is, the display area, can be obtained. By multiplying the snow coverage rate by the display area, the corresponding snow area can be obtained. For example, when the snow coverage rate is 95%, it can be considered that 95% of the area of the display area will be covered by snow. Among them, the snow area refers to the area covered by snow in the display area.

[0155] S342. Generate an initial snow-covered layer corresponding to the display area according to the regional outline of the display area and the snow area.

[0156] Specifically, after obtaining the snow area, an initial snow-covered layer corresponding to the display area can be generated according to the snow area. And the outline of the initial snow-covered layer is consistent with the regional outline of the display area. However, since the snow coverage rate may not reach 100%, the specification of the snow-covered layer may be a little smaller than that of the display area. Among them, the initial snow-covered layer refers to the layer that displays the snow-covering situation in the initial state obtained by combining the display area, and the initial snow-covered layer does not adjust the parameters corresponding to the snow thickness.

[0157] S343. Divide the initial snow-covered layer based on the inclined division direction and the target division quantity to obtain a plurality of sub-regions.

[0158] Specifically, the initial snow-covered layer can be divided according to the inclined division direction to obtain a plurality of sub-regions, and the number of sub-regions is the same as the target division quantity. For example, when the target division quantity is 3, the initial snow-covered layer can be divided into 3 sub-regions.

[0159] S344. Determine the virtual adjustment parameters corresponding to the displayed snow thickness of each sub-adjustment area, and adjust the display parameters of the sub-regions corresponding to each sub-adjustment area according to the virtual adjustment parameters to obtain the snow-covered layer.

[0160] It can be understood that in practical applications, there are corresponding virtual adjustment parameters for different displayed snow thicknesses. Therefore, according to the displayed snow thickness of each sub-adjustment area, the virtual adjustment parameters corresponding to each sub-adjustment area can be obtained. Since each sub-adjustment area has a corresponding sub-region in the initial snow-covered layer, according to the virtual adjustment parameters corresponding to each sub-adjustment area, the parameters corresponding to the displayed thickness of the corresponding sub-region can be adjusted to obtain the corresponding snow-covered layer.

[0161] S345. Locate the center point of the snow-covered layer based on the center point of the display area, and superimpose the snow-covered layer above the corresponding display area to obtain environmental update data.

[0162] Specifically, by positioning the center point of the snow-covered layer with the center point of the corresponding display area, the snow-covered layer can be superimposed above the corresponding display area, thereby realizing the update of the display area and obtaining the corresponding environmental update data.

[0163] S4. Receive the remote access points selected by the user terminal based on the dynamic display space, and obtain the synchronous display data collected by the monitoring device based on the remote access points and send it to the user terminal.

[0164] It can be understood that a village usually contains multiple areas, such as a square area, a street area, etc. After the user views the virtual dynamic display space, they may become interested in the actual rural scene and hope to further view the real scene of a specific location. At this time, the user can select the position point corresponding to the area where they want to view the real scene through the dynamic display space, that is, the remote access point. For example, if the user wants to view the square area in the village, then the position point corresponding to the square area in the dynamic display space is the remote access point. After receiving the remote access point selected by the user, the monitoring device can be controlled to go to the collection point corresponding to the remote access point to collect data, obtain the corresponding synchronous display data, and send it to the user. The user can view the actual scene of a specific location through the synchronous display data.

[0165] Based on the above embodiments, the specific implementation manner of step S4 can be:

[0166] S41. Obtain the historical collection data corresponding to each of the remote access points in the recent period, and determine the remote access point without the historical collection data as the current collection point.

[0167] Among them, the historical collection data refers to the video data collected and saved by the monitoring device at the remote access points in the village in the recent period. The current collection point refers to the remote access point currently selected by the user but without corresponding historical collection data in the past period.

[0168] Since in a period of time, multiple users may choose the same remote access point to view. When multiple users view in a relatively short time, since the actual scene corresponding to the remote access point hardly changes, when a user requests to view the real scene of a remote access point that has been selected before, since the data of this remote access point has been collected, in order to reduce the collection workload of the monitoring device, the historical collection data corresponding to this point can be directly obtained without re-collecting data, thus saving time and resources. If the remote access point selected by the user does not have corresponding historical collection data in the past period, then the corresponding remote access point can be controlled to be determined as the current collection point, and the monitoring device can be controlled to go to the position corresponding to the current collection point to collect data.

[0169] S42. Generate a collection path connecting each of the current collection points, and control the monitoring device to perform data collection based on the collection path to obtain current collection data.

[0170] Specifically, since there may be multiple current collection points, when performing data collection on multiple current collection points, a collection path corresponding to the monitoring device can be generated in combination with the multiple current collection points, so that the monitoring device can be controlled to perform video data collection along the collection path to obtain the current collection data corresponding to the current collection points.

[0171] S43. Split the current collection data to obtain sub-collection data corresponding to each of the current collection points, determine the viewing order configured by the user terminal for each of the remote access points, and splice the historical collection data and / or sub-collection data according to the viewing order to obtain synchronous display data.

[0172] After the monitoring device completes data collection for all current collection points, a continuous video data, that is, current collection data, can be obtained. The current collection data contains information of all current collection points. Since the viewing order of the user may be different from the order during data collection, the current collection data can be split so as to separately extract the data of each current collection point to form sub-collection data corresponding to each current collection point. After splitting to obtain the sub-collection data of each current collection point, when the user requests to view the real-scene data of the remote access point, a corresponding viewing order is configured. According to the viewing order configured by the user, the historical collection data and / or sub-collection data can be spliced to obtain the corresponding synchronous display data.

[0173] When obtaining the synchronous display data, if there is historical collection data for the remote access point selected by the user, then the historical collection data and the sub-collection data need to be spliced according to the viewing order to obtain the corresponding synchronous display data. If there is no historical collection data for the remote access point selected by the user, then only the sub-collection data needs to be spliced according to the viewing data to obtain the corresponding synchronous display data.

[0174] In some embodiments, "splitting the current collection data to obtain sub-collection data corresponding to each of the current collection points" in step S43 includes the following steps:

[0175] S431. Obtain the display range corresponding to each of the current collection points, and determine the path segments in the collection path that are within each display range as the collection segments corresponding to the respective current collection points.

[0176] Specifically, when splitting the currently displayed data, since each current acquisition point has a corresponding display range, the display ranges corresponding to each current acquisition point can be obtained. Combining with the acquisition path of the monitoring device, it can be determined which path segments are within the display range, and the path segments within the display range can be regarded as the acquisition segments corresponding to the corresponding acquisition points.

[0177] Among them, the display range refers to the video acquisition range corresponding to the current acquisition point, the path segment refers to the acquisition path within the display range, and the acquisition segment refers to the partial path segment within the display range of the current acquisition point in the acquisition path.

[0178] S432. Determine the start time and end time corresponding to each of the acquisition segments, determine the corresponding video segment in the current acquisition data according to the start time and the end time, and determine the video segment as the sub-acquisition data corresponding to the current acquisition point.

[0179] After determining the acquisition segments corresponding to each acquisition point, the start time and end time of each acquisition segment in the current acquisition data can be further determined, so that the video segment within the corresponding time period can be extracted from the current acquisition data as the sub-acquisition data corresponding to the current acquisition point. Among them, the start time refers to the time when the video acquisition of the acquisition segment starts, the end time refers to the time when the video acquisition of the acquisition segment ends, and the video segment refers to the video data corresponding to the acquisition segment in the acquisition data.

[0180] Through the above implementation, it can be ensured that each user can obtain the display data corresponding to their own needs in a timely and accurate manner, improving the acquisition efficiency when obtaining the display data.

[0181] See Figure 5 , which is a schematic structural diagram of a digital rural processing system based on digital twins provided by an embodiment of the present invention. The data processing system for digital rural areas based on digital twins includes:

[0182] A generation module, configured to generate a digital twin space corresponding to the target location according to the data configuration information of the management end, where the digital twin space includes a plurality of display elements;

[0183] An extraction module, configured to extract the monitoring data corresponding to the display elements with dynamic attributes by retrieving the time-series update strategy, and obtain the time-series update data corresponding to the display elements according to the monitoring data;

[0184] An update module, configured to obtain the environmental data collected by the monitoring device based on the environmental update strategy, obtain the environmental update data corresponding to the corresponding display elements according to the environmental data, and update the digital twin space based on the time-series update data and the environmental update data to obtain a dynamic display space;

[0185] A receiving module, configured to receive a remote access point selected by a client based on the dynamic display space, and obtain synchronous display data collected by the monitoring device based on the remote access point and send the data to the client.

[0186] Figure 5 The device of the illustrated embodiment can correspondingly be used to execute Figure 1 the steps in the illustrated method embodiment, and the implementation principle and technical effects are similar, and will not be elaborated herein.

[0187] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A digital rural processing method based on digital twins, characterized in that, Including: Generate a digital twin space corresponding to the destination according to the data configuration information of the management terminal. The digital twin space includes multiple display elements; Retrieve the time-series update policy to obtain the monitoring data corresponding to the display elements with dynamic attributes, and obtain the time-series update data corresponding to the display elements according to the monitoring data; Obtain the environmental data collected by the monitoring device based on the environmental update policy, obtain the environmental update data corresponding to the corresponding display elements according to the environmental data, and update the digital twin space based on the time-series update data and the environmental update data to obtain a dynamic display space; Obtain the display elements with snow-covering attributes in the digital twin space as snow-covering elements, obtain the current snow depth corresponding to the meteorological data, and determine the current snow depth as the reference snow depth corresponding to each snow-covering element; Determine the display area corresponding to each snow-covering element as the adjustment area, and obtain the inclination of the adjustment area; Obtain the inclination difference between the inclination and the reference inclination, traverse the snow distribution table according to the inclination difference, and determine the distribution division amount corresponding to the difference interval where the inclination difference is located as the target division amount; Among them, the snow distribution table includes multiple difference intervals and the distribution division amounts corresponding to the difference intervals. The larger the value corresponding to the difference interval, the larger the distribution division amount; Divide the adjustment area according to the inclination division direction corresponding to the adjustment area and the target division amount to obtain multiple sub-adjustment areas; Determine the gradient adjustment coefficient corresponding to each sub-adjustment area based on the inclination difference, offset the reference snow depth according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each sub-adjustment area, and obtain the display snow depth of the display area corresponding to the snow-covering element according to the sub-display thickness; Receive the remote access point selected by the user terminal based on the dynamic display space, and obtain the synchronous display data collected by the monitoring device based on the remote access point and send it to the user terminal.

2. The method according to claim 1, wherein: Retrieve the time-series update policy to obtain the monitoring data corresponding to the display elements with dynamic attributes, and obtain the time-series update data corresponding to the display elements according to the monitoring data, including: Obtain the monitoring frame corresponding to the monitoring data, and determine the monitoring area in the monitoring frame according to the area positioning template corresponding to the display element. The area positioning template includes a positioning area corresponding to the monitoring area; Extract multiple display contours corresponding to the display element in the monitoring area, and determine the display state corresponding to each display contour based on the state analysis model. The display state includes a closed state and an open state; Determine the original state of the display element, and count the number of contours of the display contours corresponding to the display states inconsistent with the original state; Equally divide the display area corresponding to the display element in the digital twin space according to the number of contours and the division direction to obtain multiple sub-display areas; Obtain the center point of each sub-display area, determine the display module closest to the center point as the time-series update module, and update the time-series update module according to the display state to obtain the time-series update data. The display area includes multiple display modules corresponding to the display element.

3. The method according to claim 1, wherein: Obtain the environmental data collected by the monitoring device based on the environmental update strategy, and obtain the environmental update data corresponding to the display elements according to the environmental data, including: Determine the environmental mode according to the meteorological data. When the environmental mode is the snow accumulation mode, obtain the environmental data collected by the monitoring device based on multiple preset points; Determine the snow cover rate corresponding to each snow-covered element according to the environmental data; Obtain the inclination corresponding to each snow-covered element, and offset the reference snow thickness according to the inclination to obtain the displayed snow thickness corresponding to each snow-covered element; Determine the reference snow thickness corresponding to each snow-covered element according to the meteorological data; Generate a snow cover layer corresponding to the display area of each snow-covered element based on the displayed snow thickness and the snow cover rate, and superimpose the snow cover layer above the corresponding display area to obtain environmental update data.

4. The method according to claim 3, wherein Determining the snow cover rate corresponding to each snow-covered element according to the environmental data includes: Obtain the image frame corresponding to each environmental data, and determine the analysis area corresponding to the snow-covered element in the image frame according to the element positioning template. The element positioning template includes an extraction area corresponding to each snow-covered element; Determine that the pixel points in each analysis area whose pixel values are within the snow-covered pixel range are snow-covered points, and count the first quantity of the snow-covered points and the second quantity corresponding to all pixel points in the analysis area; Obtain the snow ratio corresponding to the analysis area according to the first quantity and the second quantity, and average the snow ratios corresponding to each snow-covered element in different image frames to obtain the snow cover rate corresponding to each snow-covered element.

5. The method according to claim 1, wherein Based on the inclination difference, determine the gradient adjustment coefficient corresponding to each sub-adjustment area, and offset the reference snow thickness according to the gradient adjustment coefficient to obtain the sub-display thickness corresponding to each sub-adjustment area, including: Number each sub-adjustment area hierarchically based on the inclination division direction to obtain the hierarchy number corresponding to each sub-adjustment area. The inclination division direction is from the bottom of the sub-adjustment area to the top of the sub-adjustment area; Average the inclination difference according to the target division quantity to obtain a unit difference, and obtain the offset difference corresponding to each sub-adjustment area based on the product of the unit difference and the hierarchy number; Obtain the gradient adjustment coefficient based on the ratio of the offset difference to the reference difference, and obtain the offset thickness corresponding to each sub-adjustment area based on the product of the gradient adjustment coefficient and the reference adjustment thickness; Obtain the sub-display thickness corresponding to each sub-adjustment area according to the difference between the reference snow thickness and the offset thickness.

6. The method according to claim 1, wherein Generating a snow cover layer corresponding to the display area of each snow-covered element based on the displayed snow thickness and the snow cover rate, and superimposing the snow cover layer above the corresponding display area to obtain environmental update data, including: Obtain the display area corresponding to the display area, and obtain the snow area based on the product of the snow cover rate and the display area; Generate an initial snow-covered layer corresponding to the display area according to the regional contour of the display area and the snow-covered area; Based on the inclined division direction and the target division quantity, divide the initial snow-covered layer to obtain a plurality of sub-regions; Determine the virtual adjustment parameters corresponding to the displayed snow thickness of each sub-adjustment area, and adjust the display parameters of the sub-regions corresponding to each sub-adjustment area according to the virtual adjustment parameters to obtain the snow-covered layer; Locate the center point of the snow-covered layer based on the center point of the display area, and superimpose the snow-covered layer above the corresponding display area to obtain environmental update data.

7. The method according to claim 1, wherein Receiving a remote access point selected by the user terminal based on the dynamic display space, and obtaining synchronous display data collected by the monitoring device based on the remote access point and sending it to the user terminal, including: Obtain the historical collection data corresponding to each remote access point in the recent period of time, and determine the remote access point without the historical collection data as the current collection point; Generate a collection path connecting each current collection point, and control the monitoring device to collect data based on the collection path to obtain current collection data; Split the current collection data to obtain sub-collection data corresponding to each current collection point, determine the viewing order configured by the user terminal for each remote access point, and splice the historical collection data and / or sub-collection data according to the viewing order to obtain synchronous display data.

8. The method according to claim 7, wherein Splitting the current collection data to obtain sub-collection data corresponding to each current collection point, including: Obtain the display range corresponding to each current collection point, and determine the path segment located within each display range in the collection path as the collection segment corresponding to the corresponding current collection point; Determine the start time and end time corresponding to each collection segment, determine the corresponding video segment in the current collection data according to the start time and the end time, and determine the video segment as the sub-collection data corresponding to the current collection point.

9. A processing system for the digital rural processing method based on digital twin described in claim 1, characterized in that, Including: A generation module for generating a digital twin space corresponding to the target location according to the data configuration information of the management terminal, where the digital twin space includes a plurality of display elements; A retrieval module for retrieving a time-series update policy to obtain monitoring data corresponding to the display elements with dynamic attributes, and obtaining time-series update data corresponding to the display elements according to the monitoring data; An update module for obtaining environmental data collected by the monitoring device based on an environmental update policy, obtaining environmental update data corresponding to the corresponding display elements according to the environmental data, and updating the digital twin space based on the time-series update data and the environmental update data to obtain a dynamic display space; A receiving module for receiving a remote access point selected by the user terminal based on the dynamic display space, and obtaining synchronous display data collected by the monitoring device based on the remote access point and sending it to the user terminal.

Images