A twin modeling method and system for garden design

Abstract

The present application provides a twin modeling method and system for garden design. First, a three-dimensional digital twin model of the garden planning area is constructed; the shadow area of ​​each virtual landscape in the three-dimensional digital twin model is further extracted, and light and shadow compensation is performed on the shadow area of ​​each virtual landscape to obtain the light and shadow dividing line of each virtual landscape, thereby determining the simulation granularity of the light and shadow of each virtual landscape; the color loss of the garden planning area during the three-dimensional twin modeling process is determined based on the color difference between different virtual landscapes; the simulation offset of each virtual landscape color is determined based on the color loss and the simulation granularity of each virtual landscape light and shadow, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets. The solution of the present application can achieve color transition of virtual landscapes under different virtual lighting conditions, thereby improving the visual effect of virtual landscapes in twin gardens.

Description

Technical Field

[0001] The present application relates to the technical field of twin modeling, and more specifically, to a twin modeling method and system for garden design. Background Art

[0002] Twin modeling can reflect the appearance and status of physical objects by creating virtual models to map real-world objects or systems. The created virtual models not only statically reflect the structure of the objects, but also simulate their dynamic behavior and future status through real-time data feedback. Twin modeling relies on technologies such as sensors, the Internet of Things and big data to continuously obtain the operating data of physical objects, and analyze, predict and optimize them through virtual models. Twin modeling is widely used in manufacturing, urban planning, energy management, medical care and other fields, and can improve management efficiency and optimize decision-making processes. For example, in garden design, twin modeling simulates plant growth, light and climate change through three-dimensional modeling and data feedback to assist in optimizing design solutions. With the continuous development of technology, twin modeling has become an important tool for realizing intelligent management, driving various industries to develop in the direction of refinement and automation.

[0003] Existing twin modeling methods for garden design combine 3D modeling, sensor data, and computer vision technology to create virtual models that match the real environment. These methods use laser scanning, drone aerial photography, and other means to accurately obtain the spatial layout, plant species, and growth status of the garden, and generate high-precision virtual landscapes through digital processing. However, the virtual light sources in twin gardens are often diverse and dynamically changing, such as virtual sunlight, artificial lighting, and ambient light. These virtual light sources will illuminate at different angles, causing different virtual landscapes in the twin to have different color performances, resulting in color distortion and oversaturation of the virtual landscape. Therefore, how to achieve color transition of virtual landscapes under different virtual lighting conditions, thereby improving the visual effects of virtual landscapes in twin gardens, has become a difficult problem faced by the industry. Summary of the Invention

[0004] The present application provides a twin modeling method and system for garden design, which can realize the color transition of virtual landscapes under different virtual lighting conditions, thereby improving the visual effect of virtual landscapes in twin gardens.

[0005] In a first aspect, the present application provides a twin modeling method for garden design, comprising the following steps:

[0006] Collecting three-dimensional point cloud data of a garden planning area, performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtaining a three-dimensional digital twin model of the garden planning area;

[0007] Extracting shadow areas of each virtual landscape within the three-dimensional digital twin model from overhead images at different observation positions within the garden planning area, performing light and shadow compensation on the shadow areas of each virtual landscape within the three-dimensional digital twin model, obtaining light and shadow boundary lines for each virtual landscape during the three-dimensional twin modeling process, and determining the simulation granularity of light and shadow for each virtual landscape based on all light and shadow boundary lines;

[0008] Determining the color loss of the garden planning area during the three-dimensional twin modeling process based on the color differences between different virtual landscapes in the three-dimensional digital twin model;

[0009] The simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined by the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets.

[0010] In some embodiments, performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data to obtain the three-dimensional digital twin model of the garden planning area specifically includes:

[0011] Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data;

[0012] Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data;

[0013] The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

[0014] In some embodiments, extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions within the garden planning area specifically includes:

[0015] Extracting shadow areas of each garden landscape in the garden planning area under different light source conditions from all overhead images based on a preset deep learning model;

[0016] Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape;

[0017] The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

[0018] In some embodiments, performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process specifically includes:

[0019] Determining a compensation amount for light and shadow in each shadow area according to the color saturation and color contrast of each shadow area;

[0020] Performing edge detection on each shadow area to obtain the light and shadow boundary of each shadow area;

[0021] The light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow in all shadow areas, so as to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process.

[0022] In some embodiments, determining the simulation granularity of each virtual landscape light and shadow based on all light and shadow boundary lines specifically includes:

[0023] Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape closest to the selected virtual landscape as a nearest neighbor virtual landscape;

[0024] Determining the boundary fuzziness of light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape;

[0025] Determining the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape;

[0026] Continue to determine the simulation granularity of the remaining virtual landscape light and shadow.

[0027] In some embodiments, determining the color loss of the garden planning area during the three-dimensional twin modeling process based on the color difference between different virtual landscapes in the three-dimensional digital twin model specifically includes:

[0028] extracting color features of each virtual landscape within the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features;

[0029] determining a color difference vector according to the color difference between different virtual landscapes;

[0030] The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

[0031] In some embodiments, determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model based on the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model specifically includes:

[0032] Determining the simulation loss of the color of each virtual landscape by the simulation granularity of all virtual landscape lights and shadows in the three-dimensional digital twin model;

[0033] A simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined according to the color loss and the simulation loss of each virtual landscape color.

[0034] In a second aspect, the present application provides a twin modeling system for garden design, comprising:

[0035] A modeling module is used to collect three-dimensional point cloud data of a garden planning area, perform three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtain a three-dimensional digital twin model of the garden planning area;

[0036] a processing module for extracting, from overhead images at different observation positions within the garden planning area, shadow regions of each virtual landscape within the three-dimensional digital twin model, performing light and shadow compensation on the shadow regions of each virtual landscape within the three-dimensional digital twin model, obtaining light and shadow boundary lines for each virtual landscape during the three-dimensional twin modeling process, and determining the simulation granularity of light and shadow for each virtual landscape based on all light and shadow boundary lines;

[0037] The processing module is further configured to determine the color loss of the garden planning area during the three-dimensional twin modeling process based on the color differences between different virtual landscapes in the three-dimensional digital twin model;

[0038] An execution module is used to determine the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model based on the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

[0039] In a third aspect, the present application provides a computer device comprising a memory and a processor, wherein the memory stores code, and the processor is configured to obtain the code and execute the above-mentioned twin modeling method for garden design.

[0040] In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program, which implements the above-mentioned twin modeling method for garden design when executed by a processor.

[0041] The technical solutions provided by the embodiments disclosed in this application have the following beneficial effects:

[0042] In the twin modeling method and system for garden design provided in the present application, first, three-dimensional point cloud data of the garden planning area is collected, and three-dimensional twin modeling is performed on the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area; the shadow area of ​​each virtual landscape in the three-dimensional digital twin model is extracted from the overhead images at different observation positions in the garden planning area, and light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process, and the simulation granularity of the light and shadow of each virtual landscape is determined based on all the light and shadow dividing lines; the color loss of the garden planning area in the three-dimensional twin modeling process is determined based on the color difference between different virtual landscapes in the three-dimensional digital twin model; the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model is determined by the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets.

[0043] It can be seen that in the present application, the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model can be determined by the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model; wherein, first, by collecting the three-dimensional point cloud data of the garden planning area and constructing a three-dimensional digital twin model based on this, an accurate geometric basis and spatial data are provided for the virtual landscape of the garden area; secondly, by extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead image, light and shadow compensation is performed on the shadow area, a light and shadow dividing line is generated, and the light and shadow simulation granularity of the virtual landscape is determined accordingly. This process not only refines the performance of virtual light and shadow, but also makes the light and shadow transition smoother, avoiding the light and shadow fault problem caused by changes in virtual lighting conditions, thereby significantly improving the layering and realism of the virtual landscape; then, by analyzing the different virtual landscapes in the three-dimensional digital twin model The color difference between the two images is detected, the color loss in the modeling process is identified, and the color simulation offset of the virtual landscape is calculated in combination with the light and shadow simulation granularity. This process effectively compensates for the color distortion problem caused by lighting changes or modeling errors in the rendering process of the virtual landscape, ensuring that the color performance of the virtual landscape is more natural and coordinated, while ensuring the color uniformity between different virtual landscapes. Finally, based on all color simulation offsets, the simulated color of each virtual landscape is globally adjusted, realizing the dynamic combination of light and shadow simulation and color optimization. The global adjustment enables the virtual landscape to show a smooth color transition effect under different virtual lighting conditions, which not only enhances the visual immersion of the overall scene, but also enhances the authenticity and naturalness of the virtual landscape under dynamic lighting. In summary, the scheme of the present application can realize the color transition of the virtual landscape under different virtual lighting conditions, thereby improving the visual effect of the virtual landscape in the twin garden. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 is an exemplary flow chart of a twin modeling method for garden design according to some embodiments of the present application;

[0045] Figure 2 is a schematic diagram illustrating the structure of a twin modeling architecture according to some embodiments of the present application;

[0046] Figure 3 is a schematic diagram of a process for determining a light-shadow boundary line according to some embodiments of the present application;

[0047] Figure 4 is a schematic structural diagram of a twin modeling system for garden design according to some embodiments of the present application;

[0048] Figure 5 It is a structural schematic diagram of a computer device for implementing a twin modeling method for garden design according to some embodiments of the present application. DETAILED DESCRIPTION

[0049] In order to better understand the technical solution of the present application, the technical solution of the present application will be described in detail below with reference to the accompanying drawings and specific implementation methods.

[0050] refer to Figure 1 , which is an exemplary flow chart of a twin modeling method for garden design according to some embodiments of the present application. The twin modeling method 100 for garden design mainly includes the following steps:

[0051] In step 101, three-dimensional point cloud data of a garden planning area is collected, and three-dimensional twin modeling of the garden planning area is performed based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area.

[0052] In specific implementation, a drone equipped with a lidar is used to obtain three-dimensional point cloud data of garden landscapes such as the ground, buildings, and vegetation within the garden planning area.

[0053] In some embodiments, three-dimensional twin modeling of the garden planning area is performed based on the three-dimensional point cloud data. Obtaining a three-dimensional digital twin model of the garden planning area can be achieved by the following steps:

[0054] Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data;

[0055] Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data;

[0056] The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

[0057] In the specific implementation, first, use the MeshLab tool to denoise the 3D point cloud data, and then use the Autodesk ReCap tool to align, align, and merge the 3D point cloud data, and use the processed data as 3D modeling data; secondly, import the 3D modeling data into the Blender modeling software to build a virtual model of the garden planning area, and then use the rendering engine (such as V-Ray) to map the texture (such as trees, grass, ground, etc.) to the corresponding virtual landscape in the virtual model, and further use the rendering engine to generate lighting and shadows, and use the rendered virtual model as the 3D scene model of the garden planning area; then, import the 3D scene model into the digital twin platform (such as ThingWorx), and further integrate the real-time sensor data of the garden planning area (such as ambient temperature and humidity, air quality, soil moisture, etc.) with the 3D scene model to generate a dynamic 3D digital twin model. Figure 2 As described above, this figure is a structural schematic diagram of the twin modeling architecture in some embodiments of the present application, showing the bidirectional mapping relationship between the physical world and the virtual model. In the physical world, garden terrain, plants and vegetation, building facilities, and monitoring sensors transmit data to the virtual space through the sensor network. In the virtual model, the physical world is digitally reproduced and dynamically analyzed using virtual landscape, landscape rendering, environmental simulation, and interactive experience functions. The data flow enables the virtual model to provide real-time feedback on the physical environment, optimize garden design and management, and realize intelligent garden design and management systems. Other methods can also be used in other embodiments, which are not limited here.

[0058] It should be noted that the three-dimensional digital twin model described in this application is a dynamic digital model composed of multiple virtual landscapes.

[0059] In step 102, the shadow area of ​​each virtual landscape in the three-dimensional digital twin model is extracted from the overhead images at different observation positions in the garden planning area, and light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process. The simulation granularity of the light and shadow of each virtual landscape is determined based on all the light and shadow dividing lines.

[0060] It should be noted that in this application, aerial images of each garden landscape under different light source conditions are collected by drones at different observation positions within the garden planning area, where the light source conditions include natural light sources (such as sunlight, moonlight, etc.) and artificial light sources (such as incandescent light, LED light, etc.). In addition, there are multiple observation positions for each garden landscape, and each garden landscape corresponds to a virtual landscape.

[0061] In some embodiments, extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions within the garden planning area can be achieved by using the following steps:

[0062] Extracting shadow areas of each garden landscape in the garden planning area under different light source conditions from all overhead images based on a preset deep learning model;

[0063] Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape;

[0064] The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

[0065] It should be noted that the deep learning model preset in this application can adopt deep learning models such as U-Net, DeepLabV3, MaskR-CNN, etc. These deep learning models can effectively extract the target area from the input image and perform pixel-level classification to identify the shadow area. In addition, it should be noted that the shadow area described in this application represents a shadow image composed of multiple pixels.

[0066] In the specific implementation, first, for each garden landscape, all the overhead images of the garden landscape at different observation positions under the same lighting conditions are classified into the same category, and then all the overhead images of the same category are input into the deep learning model, and all the output results of the deep learning model are used as the shadow area of ​​the garden landscape under different light source conditions, thereby obtaining the shadow area of ​​each garden landscape under different light source conditions; secondly, a garden landscape is selected as the selected garden landscape, and the distance between the selected garden landscape and the drone at different observation positions under different lighting conditions is obtained, and the average of the distances between different observation positions under the same lighting conditions is used as the lighting weight of the selected garden landscape under the same lighting conditions, thereby obtaining the lighting weight of the selected garden landscape under different lighting conditions, and further normalizing the lighting weights under different lighting conditions. The normalized lighting weights are used as standard lighting weights, and the standard lighting weights under different lighting conditions of the selected garden landscape are multiplied by all pixel values ​​in the shadow area of ​​the selected garden landscape under the same lighting conditions. The pixel values ​​of the pixel points at the same position in the shadow area under different lighting conditions are summed up, and the pixel values ​​obtained by summing up all the pixel points at the same position form a new shadow area, and the new shadow area obtained is used as the superimposed shadow area of ​​the selected garden landscape, and the superimposed shadow areas of the remaining garden landscapes are continued to be determined; then, the shadow area of ​​each garden landscape is projected onto the virtual landscape corresponding to each garden landscape using the ray projection method, so as to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model. Other methods can also be used in other embodiments, which are not limited here.

[0067] It should be noted that the shadow area described in this application represents an area on the virtual landscape that appears darker than other surrounding environments in the three-dimensional digital twin model, wherein each shadow area corresponds to a garden landscape, and each garden landscape contains multiple shadow areas, that is, each shadow area corresponds to multiple shadow areas.

[0068] In some embodiments, reference Figure 3 As shown in FIG, this figure is a schematic diagram of the process of determining the light and shadow dividing line in some embodiments of the present application. In this embodiment, light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process. The following steps can be used to achieve this:

[0069] First, in step 1021, the compensation amount of light and shadow of each shadow area is determined according to the color saturation and color contrast of each shadow area;

[0070] Next, in step 1022, edge detection is performed on each shadow region to obtain the light and shadow boundary of each shadow region;

[0071] Then, in step 1023, the light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow of all shadow areas, so as to obtain the light and shadow boundary line of each virtual landscape in the 3D twin modeling process.

[0072] In the specific implementation, first, for each shadow area, the color saturation and color contrast of the shadow area are obtained through OpenCV, and the quotient between the color saturation of the shadow area and the color contrast of the shadow area is used as the compensation amount of the light and shadow of the shadow area, and then the compensation amount of the light and shadow of all shadow areas is obtained; secondly, for each shadow area, an edge detection algorithm (such as Canny edge detection) is used to detect the boundary of each shadow area, and the detected boundaries are all used as the light and shadow boundaries of the shadow area, where the light and shadow boundary represents the transition area where the light intensity of the shadow area changes significantly; then, for each shadow area, a smoothing algorithm (such as Gaussian smoothing) is used, and the average of the compensation amounts of light and shadow of multiple shadow areas corresponding to the shadow area is used as the smoothing intensity of the smoothing algorithm to smooth the light and shadow boundaries of the shadow area, thereby generating the light and shadow dividing line of the virtual landscape corresponding to the shadow area in the three-dimensional twin modeling process, and then obtaining the light and shadow dividing line of all virtual landscapes in the three-dimensional twin modeling process.

[0073] It should be noted that the light and shadow dividing line described in this application represents the dividing line of the light and dark transition areas of the virtual landscape under different lighting conditions. The light and shadow dividing line controls the light and dark areas in the virtual landscape, thereby affecting the three-dimensional sense and texture details of the virtual landscape.

[0074] In some embodiments, determining the simulation granularity of each virtual landscape light and shadow based on all light and shadow boundary lines can be achieved by using the following steps:

[0075] Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape closest to the selected virtual landscape as a nearest neighbor virtual landscape;

[0076] Determining the boundary fuzziness of light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape;

[0077] Determining the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape;

[0078] Continue to determine the simulation granularity of the remaining virtual landscape light and shadow.

[0079] In specific implementation, first, the blurriness of the light and shadow boundary line of the selected virtual landscape and the blurriness of the light and shadow boundary line of the nearest neighboring virtual landscape are calculated by the gradient method, and then the inverse of the blurriness of the light and shadow boundary line of the selected virtual landscape is added to the inverse of the blurriness of the light and shadow boundary line of the nearest neighboring virtual landscape, and the sum obtained by the addition is used as the boundary blurriness of the light and shadow of the selected virtual landscape, where the boundary blurriness of the light and shadow represents the clarity of the transition between the light and shadow of adjacent virtual landscapes; secondly, the boundary blurriness of the light and shadow of the selected virtual landscape is multiplied by the distance between the selected virtual landscape and the nearest neighboring virtual landscape, and then the inverse of the multiplied value is taken, and the inverse value obtained by taking the inverse is used as the simulation granularity of the light and shadow of the selected virtual landscape.

[0080] It should be noted that the simulation granularity of light and shadow in this application represents the fineness of the light and shadow effects of the virtual landscape. The higher the simulation granularity of light and shadow, the finer the light and shadow effects of the virtual landscape, and vice versa.

[0081] In step 103, the color loss of the garden planning area during the three-dimensional twin modeling process is determined based on the color difference between different virtual landscapes in the three-dimensional digital twin model.

[0082] In some embodiments, determining the color loss of the garden planning area during the three-dimensional twin modeling process based on the color differences between different virtual landscapes in the three-dimensional digital twin model can be achieved by the following steps:

[0083] extracting color features of each virtual landscape within the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features;

[0084] determining a color difference vector according to the color difference between different virtual landscapes;

[0085] The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

[0086] In the specific implementation, first, a two-dimensional image of each virtual landscape in the three-dimensional digital twin model is generated by a rendering engine, and OpenCV is used to convert the two-dimensional image of each virtual landscape into a CIELAB color space. Then, OpenCV is used to extract the color vector of each virtual landscape in the CIELAB color space, and the obtained color vectors are used as the color features of each virtual landscape. A virtual landscape is selected as the selected virtual landscape, and the Euclidean distance between the color features of the selected virtual landscape and the color features of all remaining virtual landscapes is calculated. The maximum Euclidean distance is used as the color difference between the selected virtual landscape and the other virtual landscapes, and the color difference between the remaining virtual landscapes and the other virtual landscapes is further determined, thereby obtaining the color difference between different virtual landscapes; secondly, all color differences are sorted in ascending order, and the sequence obtained after sorting is used as a color difference vector; then, a differential operation is performed on all values ​​in the color difference vector, and the values ​​obtained by all differential operations are summed, and the summed value is used as the color loss of the garden planning area during the three-dimensional twin modeling process. In other embodiments, other methods can also be used for implementation, which is not limited here.

[0087] It should be noted that the color loss mentioned in this application refers to the color error between the actual rendering result of the virtual landscape color and the expected color.

[0088] In step 104, the simulated offset of the color of each virtual landscape in the three-dimensional digital twin model is determined by the color loss and the simulated granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and the simulated color of each virtual landscape is adjusted based on all the simulated offsets.

[0089] In some embodiments, determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model can be achieved by the following steps:

[0090] Determining the simulation loss of the color of each virtual landscape by the simulation granularity of all virtual landscape lights and shadows in the three-dimensional digital twin model;

[0091] A simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined according to the color loss and the simulation loss of each virtual landscape color.

[0092] It should be noted that the simulation loss described in this application represents the parameter value of the visual deviation caused by the color change between adjacent virtual landscapes.

[0093] In a specific implementation, first, a virtual landscape is selected from the three-dimensional digital twin model as the selected virtual landscape, and the difference between the simulation granularity of the selected virtual landscape light and shadow and the simulation granularity of the nearest neighbor virtual landscape light and shadow is divided by the simulation granularity of the selected virtual landscape light and shadow, and the value obtained by the division is used as the simulation loss of the selected virtual landscape color, and the simulation loss of the remaining virtual landscape colors in the three-dimensional digital twin model is further determined; then, the simulation loss of the color of the nearest neighbor virtual landscape of each virtual landscape is multiplied by the color loss, and the multiplied value is used as the simulation offset of each virtual landscape color in the three-dimensional digital twin model. Other methods can also be used in other embodiments, which are not limited here.

[0094] It should be noted that the simulation offset described in this application represents an adjustment amount for reducing the visual color difference between the virtual landscape color and the real world color.

[0095] In a specific implementation, adjusting the simulated color of each virtual landscape based on all the simulated offsets can be achieved in the following manner, namely: converting the RGB color space of each virtual landscape into the HSL color space (hue, saturation, brightness), further adding the simulated offset of each virtual landscape color to the hue, saturation, and brightness in the HSL color space of each virtual landscape, and then replacing the hue, saturation, and brightness in the HSL color space of each virtual landscape with all the added values, and then converting the HSL color space of each virtual landscape into the RGB color space, thereby completing the adjustment of the simulated color of each virtual landscape. In other embodiments, other methods can also be used for implementation, which will not be repeated here.

[0096] In addition, in another aspect of the present application, in some embodiments, the present application provides a twin modeling system for garden design, referring to Figure 4 , which is a schematic structural diagram of a twin modeling system for garden design according to some embodiments of the present application. The twin modeling system 400 for garden design includes: a modeling module 401, a processing module 402, and an execution module 403, which are described as follows:

[0097] Modeling module 401, in this application, the modeling module 401 is mainly used to collect three-dimensional point cloud data of the garden planning area, perform three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtain a three-dimensional digital twin model of the garden planning area;

[0098] Processing module 402, in the present application, is used to extract the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions within the garden planning area, perform light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process, and determine the simulation granularity of the light and shadow of each virtual landscape based on all the light and shadow dividing lines;

[0099] It should be noted that the processing module 402 in the present application is also used to determine the color loss of the garden planning area during the three-dimensional twin modeling process based on the color difference between different virtual landscapes in the three-dimensional digital twin model;

[0100] Execution module 403. In this application, execution module 403 is mainly used to determine the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model through the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

[0101] In addition, the present application also provides a computer device, which includes a memory and a processor, the memory storing code, and the processor being configured to obtain the code and execute the above-mentioned twin modeling method for garden design.

[0102] In some embodiments, reference Figure 5 , which is a schematic diagram of the structure of a computer device for implementing a twin modeling method for garden design according to some embodiments of the present application. The twin modeling method for garden design in the above embodiment can be Figure 5 The computer device 500 shown in FIG. 5 is implemented as shown in FIG. 5 . The computer device 500 includes at least one processor 501 , a communication bus 502 , a memory 503 , and at least one communication interface 504 .

[0103] The processor 501 can be a general-purpose central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more processors for controlling the execution of the twin modeling method for garden design in this application.

[0104] The communication bus 502 may be used to transmit information between the aforementioned components.

[0105] The memory 503 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, a random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. The memory 503 may be independent and connected to the processor 501 via the communication bus 502. The memory 503 may also be integrated with the processor 501.

[0106] The memory 503 is used to store program code for executing the solution of the present application, and is controlled by the processor 501. The processor 501 is used to execute the program code stored in the memory 503. The program code may include one or more software modules. The method described in the above method embodiment can be implemented by the processor 501 and one or more software modules in the program code in the memory 503.

[0107] The communication interface 504 uses any device such as a transceiver to communicate with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area network (WLAN), etc.

[0108] In a specific implementation, as an example, a computer device may include multiple processors, each of which may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0109] The aforementioned computer device can be a general-purpose computer device or a dedicated computer device. In a specific implementation, the computer device can be a desktop computer, a portable computer, a network server, a personal digital assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device, or an embedded device. The embodiments of this application do not limit the type of computer device.

[0110] In addition, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the above-mentioned twin modeling method for garden design.

[0111] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0112] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A twin modeling method for garden design, characterized in that: The steps include: Collecting three-dimensional point cloud data of a garden planning area, performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtaining a three-dimensional digital twin model of the garden planning area; Extracting a shadow area of ​​each virtual landscape within the three-dimensional digital twin model from overhead images at different observation positions within the garden planning area, wherein the shadow area represents an area on the virtual landscape that is darker than the rest of the surrounding environment within the three-dimensional digital twin model; performing light and shadow compensation on the shadow area of ​​each virtual landscape within the three-dimensional digital twin model to obtain a light and shadow dividing line for each virtual landscape during the three-dimensional twin modeling process; and determining the simulation granularity of light and shadow for each virtual landscape based on all the light and shadow dividing lines; Determining the color loss of the garden planning area during the three-dimensional twin modeling process based on the color differences between different virtual landscapes in the three-dimensional digital twin model; determining a simulated offset of the color of each virtual landscape in the three-dimensional digital twin model based on the color loss and the simulated granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and adjusting the simulated color of each virtual landscape based on all the simulated offsets; The specific steps of determining the simulation granularity of light and shadow of each virtual landscape based on all light and shadow boundaries include: Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape closest to the selected virtual landscape as a nearest neighbor virtual landscape; Determining the boundary fuzziness of light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape; Determining the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape; Continuing to determine the simulation granularity of the remaining virtual landscape light and shadow, the simulation granularity represents the degree of refinement of the virtual landscape light and shadow effect; The step of determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model by using the color loss and the simulated granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model specifically includes: Determining a simulation loss of the color of each virtual landscape by the simulation granularity of light and shadow of all virtual landscapes in the three-dimensional digital twin model, wherein the simulation loss represents a parameter value of visual deviation caused by color changes between adjacent virtual landscapes; A simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined based on the color loss and the simulation loss of each virtual landscape color. The simulation offset represents an adjustment amount for reducing the color visual difference between the virtual landscape color and the real world.

2. The method according to claim 1, wherein Performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area specifically includes: Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data; Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data; The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

3. The method according to claim 1, wherein Extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions within the garden planning area specifically includes: Extracting shadow areas of each garden landscape in the garden planning area under different light source conditions from all overhead images based on a preset deep learning model, wherein the shadow areas represent shadow images composed of multiple pixels; Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape; The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

4. The method according to claim 1, wherein Performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process specifically includes: determining a compensation amount for light and shadow of each shadow area according to a color saturation and a color contrast of each shadow area, wherein the shadow area represents a shadow image composed of a plurality of pixels; Performing edge detection on each shadow area to obtain the light and shadow boundary of each shadow area; The light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow in all shadow areas, so as to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process.

5. The method according to claim 1, wherein Determining the color loss of the garden planning area during the three-dimensional twin modeling process according to the color differences between different virtual landscapes in the three-dimensional digital twin model specifically includes: extracting color features of each virtual landscape within the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features; determining a color difference vector according to the color difference between different virtual landscapes; The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

6. A twin modeling system for garden design, which uses the method according to any one of claims 1 to 5 for twin modeling, characterized in that: The system includes: A modeling module is used to collect three-dimensional point cloud data of a garden planning area, perform three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtain a three-dimensional digital twin model of the garden planning area; a processing module for extracting, from overhead images at different observation positions within the garden planning area, shadow regions of each virtual landscape within the three-dimensional digital twin model, performing light and shadow compensation on the shadow regions of each virtual landscape within the three-dimensional digital twin model, obtaining light and shadow boundary lines for each virtual landscape during the three-dimensional twin modeling process, and determining the simulation granularity of light and shadow for each virtual landscape based on all light and shadow boundary lines; The processing module is further configured to determine the color loss of the garden planning area during the three-dimensional twin modeling process based on the color differences between different virtual landscapes in the three-dimensional digital twin model; An execution module is used to determine the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model based on the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the twin modeling method for garden design according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the twin modeling method for garden design according to any one of claims 1 to 5 is implemented.

Images