Twin modeling method and system for garden design

Abstract

The invention provides a twinborn modeling method and system for garden design. The method comprises the following steps: firstly, constructing a three-dimensional digital twinborn model of a garden planning area; further extracting a shadow area of each virtual landscape in the three-dimensional digital twin model, performing light and shadow compensation on the shadow area of each virtual landscape to obtain a light and shadow boundary of each virtual landscape, and further determining the simulation granularity of each virtual landscape light and shadow; determining the color loss of the garden planning area in the three-dimensional twinborn modeling process according to the color difference between different virtual landscapes; the simulation offset of each virtual landscape color is determined through the color loss and the simulation granularity of each virtual landscape shadow, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets. By adopting the scheme of the invention, the color transition of the virtual landscape under different virtual illumination conditions can be realized, so that the visual effect of the virtual landscape in the twin garden is improved.

Description

Technical Field

[0001] The present application relates to the technical field of twin modeling, and more specifically, to a twin modeling method and system for garden design. Background Art

[0002] Twin modeling reflects the appearance and state of physical objects by creating virtual models to map real-world objects or systems. The created virtual models not only statically reflect the structure of the objects, but also simulate their dynamic behavior and future state through real-time data feedback. Twin modeling relies on technologies such as sensors, the Internet of Things and big data to continuously obtain the operating data of physical objects, and analyze, predict and optimize them through virtual models. Twin modeling is widely used in manufacturing, urban planning, energy management, medical care and other fields. It can improve management efficiency and optimize decision-making processes. For example, in garden design, twin modeling simulates plant growth, light and climate change through three-dimensional modeling and data feedback to assist in optimizing design plans. With the continuous development of technology, twin modeling has become an important tool for realizing intelligent management, driving various industries to develop in the direction of refinement and automation.

[0003] Existing twin modeling methods for garden design combine 3D modeling, sensor data, and computer vision technology to create a virtual model that matches the real environment. These methods use laser scanning, drone aerial photography, and other means to accurately obtain the spatial layout, plant species, and growth status of the garden, and generate high-precision virtual landscapes through digital processing. However, the virtual light sources in twin gardens are often diverse and dynamically changing, such as virtual sunlight, artificial lighting, ambient light, etc. These virtual light sources will illuminate at different angles, causing different colors of different virtual landscapes in the twin, resulting in color distortion and oversaturation of the virtual landscape. Therefore, how to achieve color transition of virtual landscapes under different virtual lighting conditions, thereby improving the visual effect of virtual landscapes in twin gardens has become a difficult problem faced by the industry. Summary of the invention

[0004] The present application provides a twin modeling method and system for garden design, which can realize the color transition of virtual landscape under different virtual lighting conditions, thereby improving the visual effect of virtual landscape in twin gardens.

[0005] In a first aspect, the present application provides a twin modeling method for garden design, comprising the following steps: Collecting three-dimensional point cloud data of a garden planning area, and performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area; Extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area, performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtaining the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and determining the simulation granularity of the light and shadow of each virtual landscape according to all the light and shadow boundary lines; Determining the color loss of the garden planning area during the three-dimensional twin modeling process according to the color differences between different virtual landscapes in the three-dimensional digital twin model; The simulated offset of each virtual landscape color in the three-dimensional digital twin model is determined by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model, and the simulated color of each virtual landscape is adjusted based on all the simulated offsets.

[0006] In some embodiments, performing three-dimensional twin modeling on the garden planning area based on the three-dimensional point cloud data to obtain the three-dimensional digital twin model of the garden planning area specifically includes: Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data; Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data; The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

[0007] In some embodiments, extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area specifically includes: Extracting the shadow area of ​​each garden landscape in the garden planning area under different light source conditions from all the overhead images based on a preset deep learning model; Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape; The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

[0008] In some embodiments, performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process specifically includes: Determine the compensation amount of light and shadow of each shadow area according to the color saturation and color contrast of each shadow area; Performing edge detection on each shadow area to obtain the light and shadow boundary of each shadow area; The light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow of all shadow areas, so as to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process.

[0009] In some embodiments, determining the simulation granularity of each virtual landscape light and shadow according to all light and shadow boundary lines specifically includes: Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape that is closest to the selected virtual landscape as a nearest neighbor virtual landscape; Determining the boundary fuzziness of the light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape; Determine the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape; Continue to determine the simulation granularity of the remaining virtual landscape light and shadow.

[0010] In some embodiments, determining the color loss of the garden planning area during the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model specifically includes: Extracting color features of each virtual landscape in the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features; determining a color difference vector according to the color difference between different virtual landscapes; The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

[0011] In some embodiments, determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model specifically includes: Determining the simulation loss of the color of each virtual landscape through the simulation granularity of all virtual landscape lights and shadows in the three-dimensional digital twin model; The simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined according to the color loss and the simulation loss of each virtual landscape color.

[0012] In a second aspect, the present application provides a twin modeling system for garden design, comprising: A modeling module, used for collecting three-dimensional point cloud data of a garden planning area, performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtaining a three-dimensional digital twin model of the garden planning area; A processing module is used to extract the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area, perform light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and determine the simulation granularity of the light and shadow of each virtual landscape according to all the light and shadow boundary lines; The processing module is further used to determine the color loss of the garden planning area during the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model; An execution module is used to determine the simulation offset of each virtual landscape color in the three-dimensional digital twin model through the color loss and the simulation granularity of each virtual landscape light and shadow in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

[0013] In a third aspect, the present application provides a computer device, comprising a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the above-mentioned twin modeling method for garden design.

[0014] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the above-mentioned twin modeling method for garden design.

[0015] The technical solution provided by the embodiments disclosed in this application has the following beneficial effects: In the twin modeling method and system for garden design provided by the present application, first, three-dimensional point cloud data of a garden planning area is collected, and three-dimensional twin modeling is performed on the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area; the shadow area of ​​each virtual landscape in the three-dimensional digital twin model is extracted from the overhead images at different observation positions in the garden planning area, and light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process, and the simulation granularity of the light and shadow of each virtual landscape is determined according to all the light and shadow dividing lines; the color loss of the garden planning area in the three-dimensional twin modeling process is determined according to the color difference between different virtual landscapes in the three-dimensional digital twin model; the simulation offset of the color of each virtual landscape in the three-dimensional digital twin model is determined by the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets.

[0016] It can be seen that in the present application, the simulated offset of the color of each virtual landscape in the three-dimensional digital twin model can be determined by the color loss and the simulated granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model; wherein, firstly, by collecting the three-dimensional point cloud data of the garden planning area, and building a three-dimensional digital twin model based on this, an accurate geometric basis and spatial data are provided for the virtual landscape of the garden area; secondly, by extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead image, light and shadow compensation is performed on the shadow area, and a light and shadow dividing line is generated, and the light and shadow simulation granularity of the virtual landscape is determined accordingly. This process not only refines the performance of virtual light and shadow, but also makes the light and shadow transition smoother, avoiding the light and shadow fault problem caused by changes in virtual lighting conditions, thereby significantly improving the layering and realism of the virtual landscape; then, by analyzing the relationship between different virtual landscapes in the three-dimensional digital twin model The color difference between the two is detected, the color loss in the modeling process is identified, and the color simulation offset of the virtual landscape is calculated in combination with the light and shadow simulation granularity. This process effectively compensates for the color distortion problem caused by lighting changes or modeling errors in the rendering process of the virtual landscape, ensuring that the color performance of the virtual landscape is more natural and coordinated, while ensuring the uniformity of colors between different virtual landscapes. Finally, based on all color simulation offsets, the simulated color of each virtual landscape is globally adjusted, realizing the dynamic combination of light and shadow simulation and color optimization. The global adjustment enables the virtual landscape to show a smooth color transition effect under different virtual lighting conditions, which not only enhances the visual immersion of the overall scene, but also enhances the authenticity and naturalness of the virtual landscape under dynamic lighting. In summary, the scheme of the present application can realize the color transition of the virtual landscape under different virtual lighting conditions, thereby improving the visual effect of the virtual landscape in the twin garden. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is an exemplary flow chart of a twin modeling method for garden design according to some embodiments of the present application; Figure 2 It is a schematic diagram of the structure of the twin modeling architecture according to some embodiments of the present application; Figure 3 is a schematic diagram of a process for determining a light-shadow boundary line according to some embodiments of the present application; Figure 4 is a schematic diagram of the structure of a twin modeling system for garden design according to some embodiments of the present application; Figure 5 It is a structural schematic diagram of a computer device for implementing a twin modeling method for garden design according to some embodiments of the present application. DETAILED DESCRIPTION

[0018] In order to better understand the technical solution of the present application, the technical solution of the present application will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0019] refer to Figure 1 , which is an exemplary flow chart of a twin modeling method for garden design according to some embodiments of the present application. The twin modeling method 100 for garden design mainly includes the following steps: In step 101, three-dimensional point cloud data of a garden planning area is collected, and three-dimensional twin modeling is performed on the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area.

[0020] In specific implementation, a laser radar is mounted on a drone to obtain three-dimensional point cloud data of garden landscapes such as the ground, buildings, and vegetation within the garden planning area.

[0021] In some embodiments, three-dimensional twin modeling of the garden planning area is performed based on the three-dimensional point cloud data, and the three-dimensional digital twin model of the garden planning area can be obtained by the following steps: Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data; Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data; The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

[0022] In the specific implementation, first, the 3D point cloud data is denoised using the MeshLab tool, and then the 3D point cloud data is registered, aligned, and merged using the Autodesk ReCap tool, and the processed data is used as the 3D modeling data; secondly, the 3D modeling data is imported into the Blender modeling software to build a virtual model of the garden planning area, and then a rendering engine (such as V-Ray) is used to map textures (such as trees, grass, ground, etc.) to the corresponding virtual landscape in the virtual model, and then the rendering engine is used to generate lighting and shadows, and the virtual model obtained after rendering is used as the 3D scene model of the garden planning area; then, the 3D scene model is imported into the digital twin platform (such as ThingWorx), and the real-time sensor data of the garden planning area (such as ambient temperature and humidity, air quality, soil moisture, etc.) is further integrated with the 3D scene model to generate a dynamic 3D digital twin model, refer to Figure 2As described above, the figure is a structural schematic diagram of the twin modeling architecture in some embodiments of the present application, which shows the bidirectional mapping relationship between the physical world and the virtual model. In the physical world, garden terrain, plants and vegetation, building facilities, and monitoring sensors transmit data to the virtual space through a sensor network. In the virtual model, the physical world is digitally reproduced and dynamically analyzed using functions such as virtual landscape, landscape rendering, environmental simulation, and interactive experience. The data flow enables the virtual model to provide real-time feedback on the physical environment, optimize garden design and management, and realize an intelligent garden design and management system. Other methods may also be used in other embodiments, which are not limited here.

[0023] It should be noted that the three-dimensional digital twin model described in this application is a dynamic digital model composed of multiple virtual landscapes.

[0024] In step 102, the shadow area of ​​each virtual landscape in the three-dimensional digital twin model is extracted from the overhead images at different observation positions in the garden planning area, and light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and the simulation granularity of the light and shadow of each virtual landscape is determined according to all the light and shadow boundary lines.

[0025] It should be noted that in the present application, overhead images of each garden landscape under different light source conditions are collected by drones at different observation positions within the garden planning area, where the light source conditions include natural light sources (such as sunlight, moonlight, etc.) and artificial light sources (such as incandescent light, LED light, etc.). In addition, each garden landscape has multiple observation positions, and each garden landscape corresponds to a virtual landscape.

[0026] In some embodiments, extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area can be achieved by the following steps: Extracting the shadow area of ​​each garden landscape in the garden planning area under different light source conditions from all the overhead images based on a preset deep learning model; Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape; The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

[0027] It should be noted that the deep learning model preset in this application can adopt deep learning models such as U-Net, DeepLabV3, MaskR-CNN, etc. These deep learning models can effectively extract the target area from the input image and perform pixel-level classification to identify the shadow area. In addition, it should be noted that the shadow area described in this application represents a shadow image composed of multiple pixels.

[0028] In the specific implementation, first, for each garden landscape, all the overhead images of the garden landscape at different observation positions under the same lighting conditions are classified into the same category, and then all the overhead images of the same category are input into the deep learning model, and all the output results of the deep learning model are used as the shadow area of ​​the garden landscape under different light source conditions, thereby obtaining the shadow area of ​​each garden landscape under different light source conditions; secondly, a garden landscape is selected as the selected garden landscape, and the distance between the selected garden landscape and the different observation positions of the drone under different lighting conditions is obtained, and the average of the distances at different observation positions under the same lighting conditions is used as the lighting weight of the selected garden landscape under the same lighting conditions, thereby obtaining the lighting weight of the selected garden landscape under different lighting conditions, and further normalizing the lighting weights under different lighting conditions. The normalized illumination weights are all used as standard illumination weights, and the standard illumination weights under different illumination conditions of the selected garden landscape are multiplied by all pixel values ​​in the shadow area of ​​the selected garden landscape under the same illumination conditions, and then the pixel values ​​of the pixel points at the same position in the shadow area under different illumination conditions are summed up, and the pixel values ​​obtained by summing up all the pixel points at the same position form a new shadow area, and the obtained new shadow area is used as the superimposed shadow area of ​​the selected garden landscape, and the superimposed shadow areas of the remaining garden landscapes are further determined; then, the shadow area of ​​each garden landscape is projected onto the virtual landscape corresponding to each garden landscape using the ray projection method, so as to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model. Other methods can also be used in other embodiments, which are not limited here.

[0029] It should be noted that the shadow area described in the present application represents an area on the virtual landscape that appears darker than other surrounding environments in the three-dimensional digital twin model, wherein each shadow area corresponds to a garden landscape, and each garden landscape contains multiple shadow areas, that is, each shadow area corresponds to multiple shadow areas.

[0030] In some embodiments, reference Figure 3 As shown in FIG. 1 , this figure is a schematic diagram of the process of determining the light and shadow dividing line in some embodiments of the present application. In this embodiment, light and shadow compensation is performed on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process. The following steps can be used to achieve this: First, in step 1021, the compensation amount of light and shadow of each shadow area is determined according to the color saturation and color contrast of each shadow area; Next, in step 1022, edge detection is performed on each dark shadow area to obtain the light and shadow boundary of each dark shadow area; Then, in step 1023, the light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow of all shadow areas, so as to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process.

[0031] In the specific implementation, first, for each shadow area, the color saturation and color contrast of the shadow area are obtained through OpenCV, and the quotient between the color saturation of the shadow area and the color contrast of the shadow area is used as the compensation amount of light and shadow in the shadow area, and then the compensation amount of light and shadow in all shadow areas is obtained; secondly, for each shadow area, an edge detection algorithm (such as Canny edge detection) is used to detect the boundary of each shadow area, and the detected boundaries are all used as the light and shadow boundaries of the shadow area, where the light and shadow boundary represents the transition area where the illumination intensity of the shadow area changes significantly; then, for each shadow area, a smoothing algorithm (such as Gaussian smoothing) is used, and the average of the compensation amounts of light and shadow of multiple shadow areas corresponding to the shadow area is used as the smoothing intensity of the smoothing algorithm to smooth the light and shadow boundaries of the shadow area, thereby generating the light and shadow dividing line of the virtual landscape corresponding to the shadow area in the three-dimensional twin modeling process, and then obtaining the light and shadow dividing line of all virtual landscapes in the three-dimensional twin modeling process.

[0032] It should be noted that the light and shadow dividing line described in the present application represents the dividing line of the light and dark transition areas of the virtual landscape under different lighting conditions. The light and shadow dividing line controls the light and dark areas in the virtual landscape, thereby affecting the three-dimensional sense and texture details of the virtual landscape.

[0033] In some embodiments, determining the simulation granularity of each virtual landscape light and shadow according to all light and shadow boundary lines can be achieved by using the following steps: Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape that is closest to the selected virtual landscape as a nearest neighbor virtual landscape; Determining the boundary fuzziness of the light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape; Determine the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape; Continue to determine the simulation granularity of the remaining virtual landscape light and shadow.

[0034] In the specific implementation, first, the blurriness of the light and shadow boundary line of the selected virtual landscape and the blurriness of the light and shadow boundary line of the nearest neighbor virtual landscape are calculated by the gradient method, and then the inverse of the blurriness of the light and shadow boundary line of the selected virtual landscape is added to the inverse of the blurriness of the light and shadow boundary line of the nearest neighbor virtual landscape, and the sum obtained by the addition is used as the boundary blurriness of the light and shadow of the selected virtual landscape, wherein the boundary blurriness of the light and shadow represents the clarity of the transition of light and shadow of adjacent virtual landscapes; secondly, the boundary blurriness of the light and shadow of the selected virtual landscape is multiplied by the distance between the selected virtual landscape and the nearest neighbor virtual landscape, and then the inverse of the multiplied value is taken, and the inverse value obtained by taking the inverse is used as the simulation granularity of the light and shadow of the selected virtual landscape.

[0035] It should be noted that the simulation granularity of light and shadow in the present application represents the degree of refinement of the light and shadow effects of the virtual landscape. The higher the simulation granularity of light and shadow, the finer the light and shadow effects of the virtual landscape, and vice versa.

[0036] In step 103, the color loss of the garden planning area during the three-dimensional twin modeling process is determined according to the color difference between different virtual landscapes in the three-dimensional digital twin model.

[0037] In some embodiments, determining the color loss of the garden planning area during the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model can be achieved by the following steps: Extracting color features of each virtual landscape in the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features; determining a color difference vector according to the color difference between different virtual landscapes; The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

[0038] In the specific implementation, first, a two-dimensional image of each virtual landscape in the three-dimensional digital twin model is generated by a rendering engine, and OpenCV is used to convert the two-dimensional image of each virtual landscape into a CIELAB color space, and then OpenCV is used to extract the color vector of each virtual landscape in the CIELAB color space, and the obtained color vectors are used as the color features of each virtual landscape, and a virtual landscape is selected as the selected virtual landscape, and the Euclidean distance between the color features of the selected virtual landscape and the color features of all the remaining virtual landscapes is calculated, and the maximum Euclidean distance is used as the color difference between the selected virtual landscape and other virtual landscapes, and the color difference between the remaining virtual landscapes and other virtual landscapes is continued to be determined, so as to obtain the color difference between different virtual landscapes; secondly, all color differences are sorted in ascending order, and the sequence obtained after sorting is used as a color difference vector; then, all values ​​in the color difference vector are differentially operated, and the values ​​obtained by all differential operations are summed, and the summed value is used as the color loss of the garden planning area in the three-dimensional twin modeling process. Other methods can also be used in other embodiments, which are not limited here.

[0039] It should be noted that the color loss described in this application refers to the color error between the actual rendering result of the virtual landscape color and the expected color.

[0040] In step 104, the simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined by the color loss and the simulation granularity of each virtual landscape light and shadow in the three-dimensional digital twin model, and the simulation color of each virtual landscape is adjusted based on all the simulation offsets.

[0041] In some embodiments, determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model can be implemented by the following steps: Determining the simulation loss of the color of each virtual landscape through the simulation granularity of all virtual landscape lights and shadows in the three-dimensional digital twin model; The simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined according to the color loss and the simulation loss of each virtual landscape color.

[0042] It should be noted that the simulation loss described in the present application represents the parameter value of the visual deviation caused by the color change between adjacent virtual landscapes.

[0043] In specific implementation, first, a virtual landscape is selected from the three-dimensional digital twin model as the selected virtual landscape, the difference between the simulation granularity of the selected virtual landscape light and shadow and the simulation granularity of the nearest neighbor virtual landscape light and shadow is divided by the simulation granularity of the selected virtual landscape light and shadow, and the value obtained by the division is used as the simulation loss of the selected virtual landscape color, and the simulation loss of the remaining virtual landscape colors in the three-dimensional digital twin model is continued to be determined; then, the simulation loss of the color of the nearest neighbor virtual landscape of each virtual landscape is multiplied by the color loss, and the multiplied value is used as the simulation offset of each virtual landscape color in the three-dimensional digital twin model. Other methods can also be used in other embodiments, which are not limited here.

[0044] It should be noted that the simulation offset described in the present application represents an adjustment amount for reducing the color visual difference between the virtual landscape color and the real world color.

[0045] In specific implementation, adjusting the simulated color of each virtual landscape based on all the simulated offsets can be achieved in the following manner, namely: converting the RGB color space of each virtual landscape into the HSL color space (hue, saturation, brightness), further adding the hue, saturation and brightness in the HSL color space of each virtual landscape to the simulated offset of each virtual landscape color, and then replacing the hue, saturation and brightness in the HSL color space of each virtual landscape with all the added values, and then converting the HSL color space of each virtual landscape into the RGB color space, thereby completing the adjustment of the simulated color of each virtual landscape. In other embodiments, other methods can also be used for implementation, which will not be repeated here.

[0046] In addition, in another aspect of the present application, in some embodiments, the present application provides a twin modeling system for garden design, referring to Figure 4 , which is a schematic diagram of the structure of a twin modeling system for garden design according to some embodiments of the present application. The twin modeling system 400 for garden design includes: a modeling module 401, a processing module 402 and an execution module 403, which are described as follows: Modeling module 401: In the present application, the acquisition module 401 is mainly used to collect three-dimensional point cloud data of the garden planning area, perform three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtain a three-dimensional digital twin model of the garden planning area; Processing module 402, in the present application, is used to extract the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area, perform light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and determine the simulation granularity of the light and shadow of each virtual landscape according to all the light and shadow boundary lines; It should be noted that the processing module 402 in the present application is also used to determine the color loss of the garden planning area during the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model; Execution module 403. In the present application, execution module 403 is mainly used to determine the simulation offset of each virtual landscape color in the three-dimensional digital twin model through the color loss and the simulation granularity of the light and shadow of each virtual landscape in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

[0047] In addition, the present application also provides a computer device, which includes a memory and a processor, the memory stores code, and the processor is configured to obtain the code and execute the above-mentioned twin modeling method for garden design.

[0048] In some embodiments, reference Figure 5 , which is a schematic diagram of the structure of a computer device for implementing a twin modeling method for garden design according to some embodiments of the present application. The twin modeling method for garden design in the above embodiment can be Figure 5 The computer device 500 shown in the figure is implemented, and the computer device 500 includes at least one processor 501, a communication bus 502, a memory 503 and at least one communication interface 504.

[0049] The processor 501 may be a general-purpose central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more processors for controlling the execution of the twin modeling method for garden design in the present application.

[0050] The communication bus 502 may be used to transmit information between the above-mentioned components.

[0051] The memory 503 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CDROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 503 may exist independently and be connected to the processor 501 through the communication bus 502. The memory 503 may also be integrated with the processor 501.

[0052] The memory 503 is used to store the program code for executing the solution of the present application, and the execution is controlled by the processor 501. The processor 501 is used to execute the program code stored in the memory 503. The program code may include one or more software modules. The method described in the above method embodiment can be implemented by the processor 501 and one or more software modules in the program code in the memory 503.

[0053] The communication interface 504 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.

[0054] In a specific implementation, as an embodiment, a computer device may include multiple processors, each of which may be a single-core (singleCPU) processor or a multi-core (multiCPU) processor. The processor here may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0055] The above-mentioned computer device may be a general-purpose computer device or a special-purpose computer device. In a specific implementation, the computer device may be a desktop computer, a portable computer, a network server, a personal digital assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device or an embedded device. The embodiment of the present application does not limit the type of computer device.

[0056] In addition, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the above-mentioned twin modeling method for garden design.

[0057] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0058] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A twin modeling method for garden design, characterized in that: The steps include: Collecting three-dimensional point cloud data of a garden planning area, and performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data to obtain a three-dimensional digital twin model of the garden planning area; Extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area, performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtaining the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and determining the simulation granularity of the light and shadow of each virtual landscape according to all the light and shadow boundary lines; Determining the color loss of the garden planning area during the three-dimensional twin modeling process according to the color differences between different virtual landscapes in the three-dimensional digital twin model; The simulated offset of each virtual landscape color in the three-dimensional digital twin model is determined by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model, and the simulated color of each virtual landscape is adjusted based on all the simulated offsets.

2. The method according to claim 1, characterized in that The three-dimensional twin modeling of the garden planning area is performed based on the three-dimensional point cloud data to obtain the three-dimensional digital twin model of the garden planning area, which specifically includes: Preprocessing the three-dimensional point cloud data to obtain three-dimensional modeling data; Constructing a three-dimensional scene model of the garden planning area according to the three-dimensional modeling data; The three-dimensional scene model is imported into the digital twin platform to obtain a three-dimensional digital twin model of the garden planning area.

3. The method according to claim 1, characterized in that Extracting the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area specifically includes: Extracting the shadow area of ​​each garden landscape in the garden planning area under different light source conditions from all the overhead images based on a preset deep learning model; Superimposing the shadow areas of each garden landscape under different light source conditions to obtain the superimposed shadow areas of each garden landscape; The shadow area of ​​each garden landscape is mapped to the virtual landscape corresponding to each garden landscape to obtain the shadow area of ​​each virtual landscape in the three-dimensional digital twin model.

4. The method according to claim 1, characterized in that Performing light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model to obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process specifically includes: Determine the compensation amount of light and shadow of each shadow area according to the color saturation and color contrast of each shadow area; Performing edge detection on each shadow area to obtain the light and shadow boundary of each shadow area; The light and shadow boundary of each dark shadow area is compensated according to the compensation amount of light and shadow of all shadow areas, so as to obtain the light and shadow dividing line of each virtual landscape in the three-dimensional twin modeling process.

5. The method according to claim 1, characterized in that The simulation granularity of each virtual landscape light and shadow is determined based on all light and shadow boundaries, including: Selecting a virtual landscape as a selected virtual landscape, and then selecting a virtual landscape that is closest to the selected virtual landscape as a nearest neighbor virtual landscape; Determining the boundary fuzziness of the light and shadow of the selected virtual landscape according to the fuzziness of the light and shadow boundary line of the selected virtual landscape and the fuzziness of the light and shadow boundary line of the nearest neighboring virtual landscape; Determine the simulation granularity of the selected virtual landscape light and shadow by the boundary fuzziness of the selected virtual landscape light and shadow and the distance between the selected virtual landscape and the nearest neighboring virtual landscape; Continue to determine the simulation granularity of the remaining virtual landscape light and shadow.

6. The method according to claim 1, characterized in that Determining the color loss of the garden planning area in the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model specifically includes: Extracting color features of each virtual landscape in the three-dimensional digital twin model, and determining color differences between different virtual landscapes based on all color features; determining a color difference vector according to the color difference between different virtual landscapes; The color loss of the garden planning area during the three-dimensional twin modeling process is determined by the color difference vector.

7. The method according to claim 1, characterized in that Determining the simulated offset of each virtual landscape color in the three-dimensional digital twin model by the color loss and the simulated granularity of each virtual landscape light and shadow in the three-dimensional digital twin model specifically includes: Determining the simulation loss of the color of each virtual landscape through the simulation granularity of all virtual landscape lights and shadows in the three-dimensional digital twin model; The simulation offset of each virtual landscape color in the three-dimensional digital twin model is determined according to the color loss and the simulation loss of each virtual landscape color.

8. A twin modeling system for garden design, characterized in that: include: A modeling module, used for collecting three-dimensional point cloud data of a garden planning area, performing three-dimensional twin modeling of the garden planning area based on the three-dimensional point cloud data, and obtaining a three-dimensional digital twin model of the garden planning area; A processing module is used to extract the shadow area of ​​each virtual landscape in the three-dimensional digital twin model from the overhead images at different observation positions in the garden planning area, perform light and shadow compensation on the shadow area of ​​each virtual landscape in the three-dimensional digital twin model, obtain the light and shadow boundary line of each virtual landscape in the three-dimensional twin modeling process, and determine the simulation granularity of the light and shadow of each virtual landscape according to all the light and shadow boundary lines; The processing module is further used to determine the color loss of the garden planning area during the three-dimensional twin modeling process according to the color difference between different virtual landscapes in the three-dimensional digital twin model; An execution module is used to determine the simulation offset of each virtual landscape color in the three-dimensional digital twin model through the color loss and the simulation granularity of each virtual landscape light and shadow in the three-dimensional digital twin model, and adjust the simulation color of each virtual landscape based on all the simulation offsets.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the twin modeling method for garden design described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the twin modeling method for garden design according to any one of claims 1 to 7 is implemented.

Images