AR scene-based environmental analysis system, method, electronic device and storage medium

Abstract

The present invention relates to an environment analysis system, method, electronic device and storage medium based on AR scene, the system includes a client and a server, the client includes a client communication module, a digital three-dimensional model module, an environmental factor acquisition module, an environment fusion module and a display module, the server includes a server communication module and a modeling module; the digital three-dimensional model module obtains a digital three-dimensional model of a target geographical area from the server via the client communication module, and fuses it with a plane image collected by a user AR terminal device camera to obtain a target geographical simulation environment; the environmental factor acquisition module obtains environmental factors affecting the target geographical environment based on specified environmental analysis indicators; the environmental fusion module fuses environmental factors into the target geographical simulation environment to obtain a target geographical simulation analysis environment. The present invention can analyze the impact of different environmental factors on the target geographical area based on AR scene.

Description

Technical Field

[0001] The present invention relates to the field of AR (Augmented Reality) technology, and in particular to an environment analysis system, method, electronic device and storage medium based on AR scenarios. Background Art

[0002] In the fields of urban planning, real estate development, natural disaster warning, etc., when developing and planning a certain geographical area, the traditional technology is to use flat drawing design or CAD design, which cannot provide a vivid and intuitive impression either during the development process or after the development is completed; for natural disaster warning, the local geographical environment is usually understood based on maps. This flat geographical environment data is relatively abstract and not intuitive. The emergence of three-dimensional drawing technology and software has brought great changes to the above fields. Taking the real estate development and urban planning of a certain target geographical area as an example, it is usually first designed with three-dimensional drawing software based on detailed planning data. After passing the review, a physical model is made based on the rendering, such as the sand table used by common real estate development properties when they are sold. With the development of AR and VR (Virtual Reality, virtual reality) technology, AR and VR technology are also increasingly applied to the above fields. For example, VR communities, AR sand tables and AR model rooms in the real estate industry, etc. The VR community refers to a virtual three-dimensional space environment established by VR technology according to the design. People use wearable and other interactive tools to immerse themselves in the three-dimensional space, and experience, examine and evaluate the streets and buildings in the space in a dynamic way, and then modify the current design. In order to promote newly developed real estate, real estate developers usually create digital three-dimensional models based on the data of real estate projects or model rooms, and generate augmented reality sand tables or model rooms on the screen of mobile terminals through mobile APPs (Applications), so that customers can view real estate projects or model rooms from any angle. Summary of the invention

[0003] In view of the technical problems existing in the prior art, the present invention proposes an AR scene-based environment analysis system, method, electronic device and storage medium, which are used to use AR scenes to analyze the impact of environmental factors on a target geographical area.

[0004] In order to solve the above technical problems, according to one aspect of the present invention, the present invention provides a client of an environment analysis system based on an AR scene, which runs in a user AR terminal device, and the user AR terminal device at least includes a processor, a memory, a display screen and a camera, and the client includes a client communication module, a digital three-dimensional model module, an environmental factor acquisition module, an environment fusion module and a display module, wherein the client communication module is configured to communicate with a server; the digital three-dimensional model module is connected to the client communication module, and is configured to obtain a digital three-dimensional model of a target geographical area from the server via the client communication module, and fuse it with an image captured by the camera of the user AR terminal device to obtain an augmented reality target geographical simulation environment; the The environmental factor acquisition module is connected to the digital three-dimensional model module or the client communication module, and is configured to determine the environmental factors affecting the target geographical environment according to the corresponding analysis strategy based on the specified environmental analysis indicators and the current target geographical simulation environment, or send the specified environmental analysis indicators to the server through the client communication module, and receive the corresponding environmental factors returned by the server; the environmental fusion module is connected to the digital three-dimensional model module, and is configured to fuse the environmental factors into the target geographical simulation environment to obtain the target geographical simulation analysis environment; the display module is connected to the digital three-dimensional model module and the environmental fusion module, and is configured to display the target geographical simulation environment or the target geographical simulation analysis environment on the display screen of the user's AR terminal device.

[0005] According to another aspect of the present invention, the present invention also provides a server of an AR scene-based environmental analysis system, which is configured to include a server communication module and a modeling module, wherein the server communication module is configured to communicate with the above-mentioned client; the modeling module is connected to the server communication module, and is configured to create a digital three-dimensional model based on planning data of the target geographical area, and provide the digital three-dimensional model of the target geographical area to the client based on the client's resource request.

[0006] In order to solve the above technical problem, according to another aspect of the present invention, the present invention provides an environment analysis method based on AR scene, which is applied to a client, and includes the following steps:

[0007] Acquire a digital three-dimensional model of a target geographic area from a server based on a user-initiated operation;

[0008] Acquire an image captured by a camera of the user's AR terminal device and identify a plane therefrom, fuse the digital three-dimensional model with the three-dimensional model of the plane to obtain a target geographical simulation environment, and display it on a display screen of the user's AR terminal device;

[0009] Based on the specified environmental analysis indicators and the current target geographic simulation environment, determine the environmental factors affecting the target geographic environment according to the corresponding analysis strategy; or request the environmental factors corresponding to the specified environmental analysis indicators from the server; and

[0010] The environmental factors are integrated into the target geographic simulation environment to obtain the target geographic simulation analysis environment, and displayed on the display screen of the user's AR terminal device.

[0011] According to another aspect of the present invention, the present invention also provides an AR scene-based environment analysis method, which is applied to a server and includes the following steps:

[0012] Creating and storing a digital three-dimensional model based on planning data for a target geographic area; and

[0013] Communicate with the aforementioned client and provide the client with a digital three-dimensional model of the target geographical area based on the resource request sent by the client.

[0014] According to another aspect of the present invention, the present invention also provides an electronic device, which includes a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, it implements the aforementioned AR scene-based environment analysis method applied to the client; or implements the aforementioned AR scene-based environment analysis method applied to the server.

[0015] According to another aspect of the present invention, the present invention also provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement the aforementioned AR scene-based environment analysis method applied to a client; or implement the aforementioned AR scene-based environment analysis method applied to a server.

[0016] According to another aspect of the present invention, the present invention also provides a computer program product, which includes computer program instructions, which, when executed by a processor, implement the aforementioned AR scene-based environment analysis method applied to the client; or implement the aforementioned AR scene-based environment analysis method applied to the server.

[0017] According to another aspect of the present invention, the present invention also provides an AR terminal device, which includes at least a processor, a memory, a display screen and a camera, wherein the memory stores computer program instructions, and the processor implements the aforementioned AR scene-based environment analysis method applied to the client when executing the computer program instructions in the memory.

[0018] The AR scene-based environmental analysis system and method provided by the present invention can analyze the impact of natural environmental factors, social environmental factors, etc. on the target geographical area based on the AR scene, and the display is intuitive and has a strong sense of presence. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The preferred embodiments of the present invention will be further described in detail below with reference to the accompanying drawings, wherein:

[0020] Figure 1 is a principle block diagram of an AR scene-based environment analysis system according to Embodiment 1 of the present invention;

[0021] Figure 2 is a principle block diagram of a user AR terminal device according to an embodiment of the present invention;

[0022] Figure 3 is a flow chart of generating and displaying a geographical simulation environment of an AR scene-based environment analysis system according to an embodiment of the present invention;

[0023] Figure 4 is a flowchart of environment analysis based on AR scene according to an embodiment of the present invention;

[0024] Figure 5 is a principle block diagram of an environmental factor acquisition module according to an embodiment of the present invention;

[0025] Figure 6 is a principle block diagram of an environment fusion module according to an embodiment of the present invention;

[0026] Figure 7 is a principle block diagram of a sunshine analysis unit according to an embodiment of the present invention;

[0027] Figure 8 is a schematic diagram of the relationship between building spacing and shadows according to an embodiment of the present invention;

[0028] Fig. 9 is a principle block diagram of a precipitation analysis unit according to an embodiment of the present invention;

[0029] Fig.10 is a principle block diagram of an atmosphere analysis unit according to an embodiment of the present invention;

[0030] Fig.11 is a principle block diagram of a sound analysis unit according to an embodiment of the present invention;

[0031] Fig.12 is a principle block diagram of an environment analysis system client based on an AR scene according to Embodiment 2 of the present invention;

[0032] Fig.13 is a principle block diagram of an environment analysis system client based on an AR scene according to Embodiment 3 of the present invention;

[0033] Fig.14is a principle block diagram of an environmental assessment module according to an embodiment of the present invention;

[0034] Fig.15 is a principle block diagram of an environment analysis system client based on an AR scene according to a fourth embodiment of the present invention;

[0035] Fig.16 is a principle block diagram of the environment analysis system server based on AR scene according to the fourth embodiment of the present invention; and

[0036] Fig.17 It is a principle block diagram of the server side of an environment analysis system based on an AR scene according to an embodiment of the present invention. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] In the following detailed description, reference may be made to the various specification drawings that are part of the present application and are used to illustrate specific embodiments of the present application. In the accompanying drawings, similar reference numerals describe substantially similar components in different figures. The various specific embodiments of the present application are described below in sufficient detail so that a person of ordinary skill in the art with relevant knowledge and skills in the art can implement the technical solutions of the present application. It should be understood that other embodiments may also be used or structural, logical or electrical changes may be made to the embodiments of the present application.

[0039] The current application of AR technology in the above fields is usually limited to displaying simulated scenes, displaying virtual objects in simulated three-dimensional space, etc. The present invention further proposes a technical solution for applying AR scenes to analyze the natural environment of a certain geographical area.

[0040] For example, although the existing AR and VR technologies have brought new design experiences and marketing methods to urban planning, real estate development and other fields, for planners, such as real estate developers, AR sandboxes and AR model rooms are only used as a means to improve the experience of homebuyers, and AR technology is not well utilized in the planning stage of real estate projects. For homebuyers, they can only see the layout of the buildings and landscapes of the current real estate project through the AR sandbox, but it is unknown whether this layout is reasonable, and the impact of the natural environment and social environment on the geographical area, a certain floor, and a unit of the real estate project. Therefore, although homebuyers can have a certain understanding of the layout of the real estate project through the AR sandbox, there are still many factors to consider that cannot be obtained from the AR sandbox and AR model room. Similarly, for natural disaster warning and other fields, the existing AR technology is only used to provide the display function of the simulated environment, and the advantages of AR technology have not been fully utilized.

[0041] The present invention uses AR technology to analyze the real environment of the target geographical area, which is specifically described as follows:

[0042] Embodiment 1

[0043] Figure 1 1 is a block diagram of an AR scene-based environment analysis system according to Embodiment 1 of the present invention. In this embodiment, the AR scene-based environment analysis system includes a client 10 and a server 20, wherein the client 10 is located in a user AR terminal device 30, and the server 20 is located in a server 40. Figure 2 , Figure 2 : is a principle block diagram of a user AR terminal device according to an embodiment of the present invention. The user AR terminal device 30 includes at least a processor 31, a memory 32, a display screen 36 and a camera 34. Preferably, the user AR terminal device 30 also includes components or functional modules such as a network module 33, a sensor 35 and a speaker 37. Among them, the memory 32 can be a built-in memory or an external memory for storing various data and program instruction sets. The network module 33 is used to connect to the Internet so that the user AR terminal device 30 can access the Internet and obtain the desired data, information, etc. from it. The camera 34 can capture images and videos. The sensor 35 is one or more of a light sensor, a distance sensor, a gyroscope, an acceleration sensor, etc. The AR scene generated by the client 10 can be displayed through a display screen 36. The user AR terminal device 30 can be implemented as a smart phone, a tablet computer, AR glasses and other devices.

[0044] In this embodiment, the client 10 includes a client communication module 11, a digital three-dimensional model module 12, an environmental factor acquisition module 13, an environmental fusion module 14 and a display module 15. Among them, the client communication module 11 is used to communicate with the server 20. The digital three-dimensional model module 12 is connected to the client communication module 11, obtains the digital three-dimensional model of the target geographical area from the server 20 through the client communication module 11, and fuses it with the image collected by the camera 34 of the user AR terminal device 30 to obtain the target geographical simulation environment of augmented reality. The environmental factor acquisition module 13 is connected to the digital three-dimensional model module 12, and determines the environmental factors affecting the target geographical environment according to the corresponding analysis strategy based on the specified environmental analysis indicators and the current target geographical simulation environment. The environmental fusion module 14 is connected to the environmental factor acquisition module 13, and fuses the environmental factors affecting the target geographical environment into the target geographical simulation environment to obtain the target geographical simulation analysis environment. The display module 15 is connected to the digital three-dimensional model module 12 and the environment fusion module 14 to display the target geographic simulation environment or the target geographic simulation analysis environment on the display screen 26 of the user AR terminal device 30 .

[0045] Specifically, Figure 3 The following is a flow chart of generating and displaying a geographical simulation environment of an environment analysis system based on an AR scene according to an embodiment of the present invention. In this embodiment, in order to generate and display a target geographical simulation environment, the following steps are included:

[0046] Step S10, receiving the user's start operation. The start operation has different meanings according to different application scenarios. For example, when the client only provides an environmental analysis of one geographical area, because there is only one geographical area, when the client 10 is run in the user's AR terminal device 30, it can be considered that the user has implemented the start operation. When the client 10 provides environmental analysis of multiple different geographical areas, the user is required to select one as the target geographical area for the current operation. Therefore, the client 10 can provide a main interface, for example, in the form of a list or a map mark to provide geographical areas for the user to select. When the user selects an identification or mark of a geographical area as the target geographical area in the main interface, it is considered that the user has implemented the start operation.

[0047] Step S11, obtaining digital resources of the target geographical area from the server. After receiving the user's start operation, the digital three-dimensional model module 12 in the client 10 sends a digital resource request to the server, and the digital resource request includes the identification of the target geographical area. After receiving the request, the server 30 provides the corresponding digital resources according to the identification of the target geographical area, and the client 10 caches the digital resources locally after receiving them. The digital resources are, for example, the overall three-dimensional model of the target geographical area and the corresponding planning data. Taking a building as an example, the overall three-dimensional model includes the three-dimensional models of all the various ground / underground buildings and landscapes in the building and the relationship between them. The overall three-dimensional model can be generated by arranging the three-dimensional models of buildings and landscapes according to their relationship (such as the layout of buildings and landscapes, the distance between buildings, the position relationship with the local terrain, etc.). For another example, the overall three-dimensional model of a mountain includes the three-dimensional model of the mountain terrain, the three-dimensional models of vegetation, rivers, roads, artificial buildings, etc. in the mountain, and the layout of these three-dimensional models, etc. The digital resources of the mountain also include actual surveying and mapping data, such as the altitude of multiple observation points, rock formation data, vegetation type, river-related data, etc. The aforementioned planning data and actual surveying and mapping data provide data support for subsequent environmental analysis.

[0048] Step S12, determine whether the image is received. In order to display the aforementioned digital resources in the user's current environment, the user needs to input the current environment image. Specifically, the user can collect the image of the place where he is through the camera 34 under the prompt of the client. In order to display the digital model, it is necessary to have a plane in the image, such as a desktop, the ground, etc., and send it to the client 10. When the digital three-dimensional model module 12 of the client 10 receives the image transmitted by the user, step S13 is executed. If the image transmitted by the user is not received, a reminder message is sent in step S16, and displayed to the user on the display screen 36 to prompt the user to collect the image.

[0049] Step S13, judging whether the image meets the requirements. For example, judging whether the image has a plane, if yes, it meets the requirements, and executing step S14. If no, sending a reminder message in step S16, and displaying it to the user on the display screen 36, to prompt the user to capture an image with a plane.

[0050] Step S14, fusing the digital resource with the plane image to obtain an augmented reality target geographical simulation environment.

[0051] Step S15, the target geographical simulation environment is displayed on the display screen of the user's AR terminal device. At this time, the user can see the current location environment and the digital resources integrated into the current scene, such as a three-dimensional simulated building, a three-dimensional simulated city, a three-dimensional simulated natural mountain area, etc., through the display screen 36 of the AR terminal device 30.

[0052] In one embodiment of the present invention, the above process can be completed by the digital three-dimensional model module 12 generated by any AR development system / platform / software development kit, such as Google's ARCore software development kit, Apple's ARKit, Huawei's AREngine, etc. The digital three-dimensional model module 12 generated by these development tools instantly locates the user's current position based on Slam space technology, identifies the plane from the currently received location image, and constructs a three-dimensional model of the plane. Based on ARPlaneManager, the constructed plane three-dimensional model is identified, and ARRaycast is used to construct a ray using the position of the camera (user's eyes in the AR scene). When the ray collides with the plane three-dimensional model in the AR scene, the collision position coordinates can be obtained, and the three-dimensional model of the digital resource is generated at the determined collision position coordinate point, thereby presenting an AR effect.

[0053] When the user can see the target geographical simulation environment in his AR terminal device, he can view the simulation environment from various angles. For example, when the user moves with his AR terminal device, the digital three-dimensional model module 12 tracks and locates the user's position based on the data sensed by the gyroscope in the AR terminal device, converts it into the position of the three-dimensional space in the display screen 36, and updates the relative position of the three-dimensional model and the AR terminal device based on the new position, thereby changing the angle of the target geographical simulation environment to achieve the same effect as observing the target geographical area in the real world.

[0054] After the user can observe the target geographic simulation environment on the display screen 36 of his AR terminal device, he can select the environmental analysis index he is concerned about to obtain the target geographic simulation analysis environment. Figure 4 , Figure 4 It is a flowchart of environment analysis based on AR scene according to an embodiment of the present invention.

[0055] Step S20, monitoring the user's designated environment analysis index. The client 10 monitors whether the user has designated the environment analysis index during the process of displaying the target geographic simulation environment through the display screen 36 of the AR terminal device. For example, the user can call up the main interface through screen operation and designate the environment analysis index therefrom.

[0056] Step S21, determine whether the specified environmental analysis indicator is received, if received, execute step S22, if not received, return to step S20.

[0057] Step S22, based on the specified environmental analysis index and the current target geographical simulation environment, determine the environmental factors that affect the target geographical environment according to the corresponding analysis strategy. Figure 1 The environmental factor acquisition module 13 in the embodiment analyzes and calculates the environmental factors affecting the target geographical environment based on the planning data or actual surveying and mapping data of the current target geographical area in the digital resources according to the specified environmental analysis index, such as sunshine, precipitation, atmosphere and noise. For example, the environmental factor corresponding to sunshine is the sun shadow, the environmental factor corresponding to precipitation is the water accumulation height, the environmental factor corresponding to atmosphere is the air quality, and the environmental factor corresponding to noise is the sound volume. The environmental factor acquisition module 13 sends these environmental factors to the environmental fusion module 14.

[0058] Step S23, the environmental factors affecting the target geographical environment are integrated into the target geographical simulation environment to obtain the target geographical simulation analysis environment. After receiving the environmental factor data, the environmental integration module 14 integrates the environmental factor data into the original target geographical simulation environment.

[0059] Step S24, the target geographic simulation analysis environment is displayed on the display screen of the user's AR terminal device. At this time, when the user selects sunshine as the environmental analysis indicator, the user can see that the simulated objects such as buildings and landscapes in the current three-dimensional simulation space (hereinafter, various objects with three-dimensional spatial forms in the corresponding target geographical area, such as buildings, rocks, trees, etc., are collectively referred to as simulated objects) have sun shadows, and the sun shadows conform to the sun shadow law in the real world space. When the user selects precipitation as the environmental analysis indicator, the user can see the precipitation scene and ground water accumulation in the current three-dimensional simulation space. The precipitation described here can be rain, snow, hail, etc. The ground water accumulation situation corresponds to the cumulative height of rain, snow and hail. When the user selects the atmosphere as the environmental analysis indicator, the user can see the scene of the atmosphere in the current three-dimensional simulation space, such as a residential community in a haze weather, each area and floor is covered by haze. When the user selects noise as the environmental analysis indicator, the user can hear the noise of different areas, different floors and rooms on the same floor of the residential community when closing and opening windows. In each target geographic simulation analysis environment, users can view the impact of environmental factors on different areas and locations as needed. For example, they can view the shadows of other buildings covering the same floor / room at different times, or the different water accumulation caused by different levels of precipitation, or the air quality of the same floor / different floors at the same or different haze levels, or the noise volume at different distances from the sound source or on different floors, etc.

[0060] like Figure 5 and Figure 6 As shown, Figure 5 is a principle block diagram of an environmental factor acquisition module according to an embodiment of the present invention, Figure 6 It is a principle block diagram of an environment fusion module according to an embodiment of the present invention. In this embodiment, the environment factor acquisition module 13 includes one or more of a sunshine analysis unit 131, a precipitation analysis unit 132, an atmosphere analysis unit 133 and a sound analysis unit 134. Correspondingly, the environment fusion module 14 includes one or more of a projection mapping unit 141, a precipitation fusion unit 142, an atmosphere fusion unit 143 and a sound fusion unit 144. When the user specifies an environment analysis indicator, the corresponding analysis unit in the environment factor acquisition module 13 performs a corresponding environment analysis, and the corresponding unit in the environment fusion module 14 fuses the environment factors obtained after the analysis into the current target geographic simulation environment, so that the target geographic simulation analysis environment can be displayed on the display screen through the display module.

[0061] In one embodiment, Figure 7As shown, the sunshine analysis unit 131 includes a sun angle calculation subunit 1310, which is used to calculate the sun altitude angle and sun azimuth angle at the corresponding time based on the geographic location data and time information of the target geographic area and send the calculated data to the environment fusion module 14, which corresponds to the projection mapping unit 141. The sun altitude angle refers to the angle between the incident direction of sunlight and the ground plane, which affects the length of the shadow, and the sun azimuth angle is usually defined as the clockwise angle between the vertical line of the sun's rays on the ground and the north direction.

[0062] Since the solar altitude angle changes with the local latitude, local time and solar declination, the solar altitude angle can be obtained by calculating the trigonometric function value of the solar altitude angle according to formula 1-1 and then calculating its inverse trigonometric function value. h .

[0063] 1-1

[0064] in, h represents the solar altitude angle; The geographical latitude representing the target geographical area; represents the solar declination, , n is a natural number, representing the date serial number, on January 1, n=1; the solar declination and geographic latitude are both positive for north latitude and negative for south latitude; t represents local time (hour angle). h , and The unit is degree.

[0065] The hour angle t increases by 15° every hour, starting with sunrise (shadows are shown) and ending with sunset (no shadows are shown). Therefore, by calculating the local sunrise and sunset times, the hour angle t can be obtained based on the current time. For example, the longitude difference is obtained based on the local latitude and the solar declination, and then the sunrise and sunset times are calculated based on the longitude difference.

[0066] Taking July 5th and Shanghai (average latitude 31.28 degrees north) as an example, the sunrise and sunset times are calculated as follows:

[0067] First calculate the solar declination of Shanghai :

[0068] Then calculate the longitude difference:

[0069] Sunrise time:

[0070]

[0071] Find the sunset time by symmetry:

[0072]

[0073] The sun's azimuth A Z It can be calculated by the following formula 1-2:

[0074] 1-2

[0075] The sun angle calculation subunit 1310 obtains the latitude and longitude data of the target geographical area through the GPS positioning data of the user AR terminal device, and uses the above formula to calculate the solar altitude angle, azimuth angle, hour angle and other data of the target geographical area from sunrise to sunset, and then transmits the data to the projection mapping unit 141. The projection mapping unit 141 determines the location of the simulated sun based on these data and the spatial coordinate system of the digital resource and the scaling ratio of the real geographical area, and emits parallel light to the three-dimensional simulated object in the digital resource, calculates the sun projection of each three-dimensional simulated object, and then maps the sun projection to the current target geographical simulation environment, and renders the light and shadow effects according to the occlusion of the light, thereby forming a sun shadow.

[0076] In one embodiment, the user can specify any location to view the sun shadow at any time, or view the sun shadow within any time period. When the user specifies a time period, the display module 15 displays the changes of the sun shadow at the specified location or the overall environment in the current target geographic simulation environment according to the timeline.

[0077] In another embodiment, the sunshine analysis unit 131 further includes a shadow relationship acquisition subunit 1311, which is used to obtain the functional relationship between the distance between the simulated objects in the target geographical area, the height of the simulated objects and the sun shadow index. Taking a residential area as an example, Figure 8 is a schematic diagram of the relationship between building spacing and shadows according to an embodiment of the present invention. Figure 8 The schematic diagram and trigonometric function relationship show that the length of the sun's shadow is l , the relationship between building height H and solar altitude angle h conforms to the following formula 1-3:

[0078] 1-3

[0079] According to formula 1-3, when the building height H is fixed, the larger the solar altitude angle h, the longer the solar shadow of the building l In order to ensure that each floor has good lighting, at least one floor must not be blocked by the shadows of other buildings at noon, that is, the length of the sun's shadow l The distance between the two buildings, L, needs to satisfy the following formulas 1-4:

[0080] 1-4

[0081] According to formula 1-3 and formula 1-4, the shadow relationship can be obtained as formula 1-5:

[0082] 1-5

[0083] Fig. 9 1 is a principle block diagram of a precipitation analysis unit according to an embodiment of the present invention. In this embodiment, the precipitation analysis unit 132 includes a precipitation simulation subunit 1320 and a water accumulation calculation subunit 1321, wherein the precipitation simulation subunit 1320 generates a precipitation simulation effect through special effects based on a specified precipitation index and its level. The precipitation index in this embodiment includes rain, snow or hail, etc. Taking rain as an example, the precipitation simulation subunit 1320 can simulate the rainfall effect through particle special effects, and send the corresponding data of the rainfall effect composed of the particle special effects to the precipitation fusion unit 142 in the environment fusion module 14. The precipitation fusion unit 142 integrates the rainfall effect into the target geographical simulation environment, so that the simulated rainfall scene can be displayed on the display screen. The water accumulation calculation subunit 1321 calculates the surface water accumulation height within a specified time period based on the specified precipitation index and its level and the drainage volume of the target geographical area corresponding to the precipitation index. Among them, the obtained digital resources include drainage capacity data of the target geographical area. Taking rainfall as an example, the total amount of water accumulation per unit time can be calculated according to the rainfall level and drainage capacity data, and then the surface water accumulation height can be calculated according to the surface area. The water accumulation calculation subunit 1321 sends the surface water accumulation height to the precipitation fusion unit 142 in the environment fusion module 14, and superimposes the simulation scene of the surface water accumulation height in the target geographical simulation environment at the current location. When the user specifies the precipitation index and the corresponding level, the user can view the simulated rainfall scene and the ground water accumulation situation of the target geographical simulation environment through the display screen of the AR terminal device. In order to enable the user to clearly understand the water accumulation and rainfall conditions, an information box can be superimposed in the current scene, and the rainfall and water accumulation data can be displayed in the information box in the form of text or charts. In case of snowfall or hail, in addition to calculating the corresponding snow accumulation height or hail accumulation height on the ground through the water accumulation calculation subunit 1321, a calculation unit for the load-bearing and resistance capacity of the building surface may also be included. For example, in case of snowfall, for a residential community, the snow-bearing capacity of the roof is calculated based on the snow accumulation height on the roof and the load-bearing data of the building materials on the roof. In case of hail, the resistance capacity of various buildings in the community to hail of different levels is calculated.

[0084] Fig.101 is a principle block diagram of an atmospheric analysis unit according to an embodiment of the present invention; in this embodiment, the atmospheric analysis unit 133 is configured to include an air simulation subunit 1330 and a gas flow simulation subunit 1331, wherein the air simulation subunit 1330 generates an air simulation scene through special effects based on the specified air index and its quality level data. For example, the fog parameter is adjusted according to the specified air index to generate simulated air with different air granularity, different colors and different visibility, and these data are sent to the atmospheric fusion unit 143 in the environmental fusion module 14, and the atmospheric fusion unit 143 superimposes the simulated air on the target geographical simulation environment to generate the current air simulation scene. The gas flow simulation subunit 1331 is connected to the air simulation subunit 1330, and the flow data of the simulated air in different areas is calculated based on the wind direction, wind speed level and target geographical simulation environment to generate data of the simulated air flow scene, and the atmospheric fusion unit 143 superimposes the air flow simulation scene on the target geographical simulation environment at the current location. The different areas are, for example, different floors of a residential area, parks, green spaces, green belts and other areas in the area. When the user specifies the atmosphere as an analysis indicator, the analysis indicator includes data such as air quality, wind direction, and wind speed level. The user can view the overall air simulation scene in the target geographic simulation environment, and can also specify locations (such as different floors) to view the atmospheric data at the specified locations. The atmospheric data can be displayed to the user in the form of an information box.

[0085] Fig.11 1 is a principle block diagram of a sound analysis unit according to an embodiment of the present invention. In this embodiment, the sound analysis unit 134 is configured to include a sound effect subunit 1340 and a volume calculation subunit 1341, wherein the sound effect subunit 1340 is used to arrange a three-dimensional sound effect from a specified sound source for the target geographic simulation environment. The volume calculation subunit 1341 is connected to the sound effect subunit 1340, and calculates the volume of the target position according to the distance between the target position and the sound source, the target geographic environment and the sound attenuation function. The target position is, for example, a position specified by a user, such as the outside or inside of a certain floor. The sound attenuation function can, for example, adopt the following formulas 1-6:

[0086] Lp=Lw-K+DIm-Ae 1-6

[0087] Among them, when the sound source is point-shaped, it radiates spherical waves, the volume is Lw, and the divergence attenuation is K, where K=10log(10,4π)+20log(10,r), and r is the distance between the sound source and the specified position; the DIm is the directivity factor, indicating whether there is a reflection surface near the sound source, or the sound source itself is a non-point sound source, and each additional reflection surface can increase 3dB; the Ae is other additional attenuation, such as the air absorption Aa and the additional attenuation Abhp of obstacles under different air conditions, where the air absorption Aa is related to the sound frequency, air pressure, temperature, and humidity, and the additional attenuation Abhp of obstacles can be obtained by looking up the table according to the material of the obstacle.

[0088] Since the above formula is relatively complex and involves many factors, a relatively simple logarithmic function can also be used to replace the above formula, and by appropriately configuring the setting parameters of the sound source item in the development system, the same effect calculated using the above formulas 1-6 can be achieved. Among them, the parameters that can be configured in the development system include Doppler level, volume attenuation function, maximum and minimum distance parameters. The volume calculation subunit 1341 obtains the volume of the specified position based on the above configuration parameters, and sends it to the sound effect fusion unit 144 in the environment fusion module 14. The sound effect fusion unit 144 superimposes a three-dimensional sound effect of the corresponding volume at the target position in the target geographical simulation environment at the current position.

[0089] In order to allow the user to hear the three-dimensional sound effect, the client also includes an audio playback module (not shown in the figure), which generates corresponding audio according to the audio output configuration parameters in the development system, and plays the three-dimensional sound effect at the specified location in the target geographical simulation environment through the microphone in the user's AR terminal device. The audio output configuration parameters include volume, tone, stereo image, spatial mixing and other parameters.

[0090] When the user specifies a location, the user can hear the sound that should be heard at the location, including the tone (such as car horns, noise, etc.) and volume. Since the volume calculation subunit 1341 can calculate the volume of any location in the target geographical area, and refer to factors such as obstacles and different air conditions when calculating the volume, when the user specifies different floors and whether the window is open or not, the user can hear sounds of different volumes, so that the user can truly feel the impact of the sound source on different floors and when the window is open or not.

[0091] In the above embodiment, after the user starts the client 10 in the AR terminal device, the digital resources are obtained from the server according to the target geographical area specified by the user, and the three-dimensional simulated environment of the target geographical area is displayed on a plane of the current scene in the display screen 36. When the user specifies an environmental analysis indicator, the corresponding simulated analysis environment of the target geographical area can be obtained, for example, displaying the sun's shadow, displaying a virtual scene of rainfall and surface water, etc.

[0092] In a practical application embodiment, for a residential community for sale, sales staff can use this system to introduce the various specific conditions of the residential community in detail, and home buyers can learn more about the living factors they care about, and can more realistically experience the various living experiences, such as lighting conditions, water accumulation, noise, etc.

[0093] Embodiment 2

[0094] Fig.12 : is a principle block diagram of an environment analysis system client based on an AR scene according to Embodiment 2 of the present invention. Figure 1Compared with the embodiment in, this embodiment further includes a real-time weather simulation module 16a on the client 10a, which is connected to the digital three-dimensional model module 12a, the environmental factor acquisition module 13a and the environment fusion module 14a, and obtains the current real-time weather data through the network service of the user AR terminal device, generates a simulated sky according to the real-time weather data and adds it to the target geographical simulation environment, and specifies the environmental analysis index of the current target geographical simulation environment. For example, when the user starts the client to request the digital resources of the target geographical area from the server, the real-time weather simulation module 16a obtains the current real-time weather data through the network service of the user AR terminal device, for example, "sunny, northeast wind 2-3, current temperature 22 degrees Celsius, air quality light haze" and so on. The real-time weather simulation module 16a first generates a blue simulated sky according to the data and adds it to the obtained digital resources, and at the same time generates the specified environmental analysis index and sends it to the environmental factor acquisition module 13a. For example, when the weather is sunny, the environmental analysis index of "sunshine" can be obtained, and the environmental factor acquisition module 13a obtains the corresponding environmental factor of "sun shadow" in the manner of the aforementioned embodiment, and sends it to the environmental fusion module 14a. After the digital three-dimensional model module 12a generates the target geographic simulation environment, the corresponding sun shadow is fused therein to obtain the target geographic simulation analysis environment with sun shadow. For another example, the environmental analysis index of "atmosphere" is generated according to "northeast wind level 2-3, air quality light haze", and finally a simulated air scene with flowing haze effect is added to the target geographic simulation environment. Thus, the environment of the target geographic area can be displayed on the display screen of the user's AR terminal device according to the current real-time weather. When the user starts the client, it is currently raining, and the display screen of the user's AR terminal device displays the simulated environment of the target geographic area on a rainy day. Since the real-time weather simulation module 16a in this embodiment is the weather data obtained in real time, the simulated environment of the target geographic area displayed in the user's AR terminal device changes in real time and dynamically according to the local and current weather, which further enhances the sense of reality.

[0095] Embodiment 3

[0096] Fig.13 is a principle block diagram of an environment analysis system client based on an AR scene according to Embodiment 3 of the present invention. Figure 1 Compared with the embodiment of the present invention, the client 10b further includes an environmental assessment module 17b, which is connected to the environmental factor acquisition module 13b and is used to assess the environmental factors obtained by the environmental factor acquisition module 13b to obtain assessment data. Fig.14 As shown, Fig.141 is a principle block diagram of an environmental assessment module according to an embodiment of the present invention. The environmental assessment module 17b includes one or more of a sunshine assessment unit 171b, a drainage assessment unit 172b, an air quality assessment unit 173b and a noise assessment unit 174b. The sunshine assessment unit 171b generates sunshine assessment data with sun shadow as an influencing index based on the actual distance between simulated objects in the target geographical area, the height of the simulated objects and the simulated shadow relationship. For example, according to the building height, the distance between the buildings and the shadow relationship in the residential area, the sunshine illumination of any residential unit in the residential area is calculated, and the sun shadow is used as an influencing index to determine whether the distribution of residential buildings in the current residential area is reasonable. The drainage assessment unit 172b determines the drainage capacity assessment data of the target geographical area based on the planned drainage volume of the target geographical area and the simulated surface water height within a specified time period. For example, the current planned drainage volume is evaluated based on the calculated surface water height. The air quality assessment unit 173b determines the air quality assessment data of the specified location of the target geographical area based on the planned layout of the target geographical area and the simulated air quality data of different areas in the target geographical simulation environment. For example, the level of air quality corresponding to a certain floor is determined according to the haze data corresponding to the floor and the standard of haze harm to human body, such as excellent, good, poor, etc. The noise assessment unit 174b determines the noise assessment data of the designated location of the target geographical area based on the simulated sound source and the volume of the designated location of the target geographical area, for example, the level of noise impact on human body at the designated location is determined according to the volume of the designated location and the assessment standard of sound harm to human body.

[0097] Taking the real estate development residential area as an example, an application scenario of this embodiment is that in the development process, after the three-dimensional model of the residential area is completed according to the planning data, the developer as the user of this system can Fig.13 The system shown analyzes various environmental factors and obtains corresponding evaluation data to check whether the planning of the community is reasonable, whether it needs to be changed, etc. Another application scenario is that during the sale of residential properties, homebuyers as users of this system can view the target geographic simulation analysis environment with added environmental factors, and can view the evaluation data of related environmental factors, so as to intuitively understand the impact of environmental factors on the residential community or residential unit they are concerned about.

[0098] Embodiment 4

[0099] Fig.15 It is a principle block diagram of an environment analysis system client based on an AR scene according to Embodiment 4 of the present invention. Fig.16This is a block diagram of the server principle of the environment analysis system based on AR scene according to the fourth embodiment of the present invention. This embodiment further adds a model adjustment module 18c on the basis of the third embodiment. In one embodiment, the model adjustment module 18c provides a model adjustment interface, and parameter fields corresponding to various environmental factors are provided in the model adjustment interface. The user determines the parameters to be adjusted based on the evaluation data and planning data of the environmental evaluation module 17c, and enters appropriate values ​​in the corresponding parameter fields in the model adjustment interface. The model adjustment module 18c generates model adjustment data based on the parameter data input by the user, and sends the model adjustment data to the server 20c via the client communication module 11c. See Fig.16 , after receiving the model adjustment data sent by the client 10c, the server communication module 21c of the server 20c sends it to the model update module 23c. The model update module 23c modifies the current digital three-dimensional model stored in the database 25c according to the received model adjustment data, and sends the modified digital three-dimensional model to the client 10c through the server communication module 21c when the client requests the digital resource. After the client 10c receives it, it is processed by the digital three-dimensional model module 12c and displayed on the display screen 15c. The user can then use the environmental factor acquisition module 13c to perform environmental analysis according to the specified environmental analysis indicators, and the environmental assessment module 17c will then evaluate and determine whether the planning requirements are met. If not, adjust the corresponding parameters again, and iterate several times until the planning requirements are met after evaluation. In the above process, the digital three-dimensional model is adjusted by manually inputting parameters. In another embodiment, the model adjustment module 18c is provided with parameters and adjustment strategies that can be automatically adjusted. For example, for each environmental factor, such as sunshine, the model adjustment module 18c is provided with adjustment parameters, such as floor height and / or building distance, and the adjustment strategy includes the adjustable range of these parameters, such as floor height range, building distance range, and when there are multiple adjustable ranges, the adjustment priority is also provided. For example, when the building distance range does not meet the formula 1-5, that is, the minimum building distance L min Greater than or equal to the shortest sun shadow of the building l min According to formula 1-6, the building height can be reduced by lowering the floor height of each residential unit. H , or increase the distance between buildings L In this embodiment, the model adjustment module 18c can obtain the model adjustment data according to the internally set adjustment strategy, and no longer needs a dedicated person to set parameters.

[0100] In the above embodiment, the environmental analysis for various environmental analysis indicators is completed by the client. In another embodiment, it can also be completed by the server. Fig.17 As shown, Fig.17 This is a block diagram of the server principle of an environment analysis system based on an AR scene according to an embodiment of the present invention. In this embodiment, the server 20d also includes an environment analysis module 25d, which uses various data stored in the database 24d to perform environment analysis based on the environment analysis indicators sent by the client to obtain corresponding environmental factors, and sends these environmental factors to the client. The client's environmental factor acquisition module receives the environmental factors through the client communication module, and the environmental fusion module integrates them into the target geographic simulation environment. For example, Figure 7 , 9 , 10, and 11 are located at the server end, and the server end generates data such as sun shadow, precipitation simulation data, surface water height, air quality data, and volume at a specified location. Fig.12 Real-time weather simulation module in Fig.13 The environmental assessment module and Fig.15 The model adjustment module in the example can also be located on the server side, and the server side completes the corresponding functions. Since its principle and processing process are the same as those of the client, they will not be described here.

[0101] Based on the above-mentioned system and method, the present invention also provides an electronic device, which at least includes one or more processors and a memory storing computer program instructions. The electronic device implements the aforementioned client and the functions it needs to complete when the one or more processors execute the computer program instructions through components such as a configured screen and a camera.

[0102] Specifically, the processor may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0103] The memory may include a large capacity memory for data or instructions. By way of example and not limitation, the memory may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory may include a removable or non-removable (or fixed) medium. Where appropriate, the memory may be inside or outside the device. In a particular embodiment, the memory is a non-volatile solid-state memory.

[0104] The memory may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Therefore, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) including software of computer-executable instructions, and when the software is executed (e.g., by one or more processors), it can perform the operations described in the aforementioned methods and systems of the present invention.

[0105] In one example, the electronic device may further include a communication interface and a bus. The processor, memory, and communication interface are connected via the bus and communicate with each other. The electronic device in the embodiment of the present invention may be a server or other computing device, or a cloud server.

[0106] The communication interface is mainly used to implement the communication between the modules, units and / or devices in the aforementioned embodiments of the present invention.

[0107] The bus may include hardware, software or both. For example, but not limitation, the bus may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front side bus (FSB), a hypertransport (HT) interconnection, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnection, a low pin count (LPC) bus, a memory bus, a microchannel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable bus or a combination of two or more of these buses. In suitable cases, the bus may include one or more buses. Although the embodiments of the present invention describe and illustrate specific buses, the present invention contemplates any suitable bus or interconnection.

[0108] The electronic device at this time can be implemented as follows Figure 2 The user AR terminal device shown, such as a smart phone, a tablet computer, AR glasses, etc., can also be a device with a fixed-position host, a fixed-position screen and a flexibly rotating camera, etc.

[0109] Specifically, the electronic device executes the following operation instructions by running the computer program to implement the functions to be completed by the client:

[0110] Acquire a digital three-dimensional model of a target geographic area from a server based on a user-initiated operation;

[0111] Acquire an image captured by a camera and identify a plane therefrom, fuse the digital three-dimensional model with the plane to obtain a target geographical simulation environment, and display it on a display screen;

[0112] Based on the specified environmental analysis indicators and the current target geographic simulation environment, determine the environmental factors affecting the target geographic environment according to the corresponding analysis strategy; or request the environmental factors corresponding to the specified environmental analysis indicators from the server; and

[0113] Environmental factors are integrated into the target geographic simulation environment to obtain a target geographic simulation analysis environment, and the environment is displayed on a display screen.

[0114] Furthermore, the operation instructions executed by the electronic device by running the computer program also include:

[0115] When the specified environmental analysis index is sunshine and the corresponding environmental factor is sun shadow, the solar altitude angle and solar azimuth angle corresponding to the current time are calculated based on the geographical location data and time information of the target geographical area;

[0116] Correspondingly, the solar projection of the target geographic simulation environment at the current position at the current time is determined based on the solar altitude angle and the deflection angle, and the projection is mapped to the target geographic simulation environment to form a solar shadow.

[0117] Furthermore, the operation instructions executed by the electronic device by running the computer program also include:

[0118] When the user specifies a time or a time period, the sun shadow of the target geographic simulation analysis environment at the current location at the specified time or the change of the sun shadow within the specified time period is displayed on the display screen.

[0119] Furthermore, the operation instructions executed by the electronic device by running the computer program also include:

[0120] Obtain the shadow function relationship between the distance between simulation objects, the height of the simulation objects and the sun shadow index in the target geographic simulation environment.

[0121] Furthermore, the operation instructions executed by the electronic device by running the computer program also include:

[0122] Based on the actual distance between the simulated objects in the target geographical area, the functional relationship between the simulated object height and the simulated shadow, the evaluation data of the rationality of the layout of the simulated objects in the current target geographical area is generated with the sun shadow as the influencing index.

[0123] Furthermore, the operation instructions executed by the electronic device by running the computer program also include:

[0124] When the specified environmental analysis index is precipitation and the corresponding environmental factor is water accumulation height, a precipitation simulation scene is generated through special effects based on the specified precipitation index and its level; wherein the precipitation index includes rain, snow or hail; and

[0125] Calculate the surface water height within a specified time period based on a specified precipitation index and its level and the water discharge in the target geographic area corresponding to the said precipitation index;

[0126] Correspondingly, the precipitation simulation scene and the surface water height are superimposed in the current target geographical simulation environment.

[0127] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: determining drainage capacity assessment data of the target geographical area based on the planned drainage volume of the target geographical area and the simulated surface water height within a specified time period.

[0128] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: when the designated environmental analysis index is the atmosphere and the corresponding environmental factor is the air quality, generating an air simulation scene through special effects based on the designated air index and its quality grade data; and

[0129] Calculate and simulate air flow data in different areas based on wind direction, wind speed level and target geographic simulation environment to generate air flow simulation scenarios;

[0130] Correspondingly, the air simulation scene and the air fluidity simulation scene are superimposed in the current target geographical simulation environment.

[0131] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: obtaining simulated air quality index data of the corresponding area based on the flow data of the simulated air in different areas of the target geographical simulated environment; and

[0132] The air quality assessment data of the designated location in the target geographical area is determined based on the planning layout of the target geographical area and the simulated air quality data of different areas in the target geographical simulation environment.

[0133] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: when the designated environmental analysis index is noise and the corresponding environmental factor is sound, arranging three-dimensional sound effects for the target geographical simulation environment according to the sound source; and

[0134] Calculating the volume of the target location according to the distance between the target location and the sound source, the target geographical environment and the sound attenuation function;

[0135] Correspondingly, a three-dimensional sound effect of a corresponding volume is superimposed at the target position in the target geographical simulation environment of the current position.

[0136] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: playing three-dimensional sound effects at a specified position through a speaker of the user's AR terminal device.

[0137] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: determining noise assessment data of the designated location of the target geographical area based on the simulation of the sound source and the simulation of the designated location of the target geographical area.

[0138] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: receiving and specifying environmental analysis indicators based on user selection.

[0139] Furthermore, after receiving the user's start-up operation, the operation instruction executed by the electronic device by running the computer program also includes:

[0140] Obtaining current real-time weather data through the network service of the user's AR terminal device;

[0141] Analyzing the real-time weather data, generating a simulated sky based on the real-time weather data and adding it to a target geographic simulation environment; and

[0142] Environmental analysis indicators are specified based on the real-time weather data.

[0143] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: updating the weather data in real time or periodically, and updating the specified environmental analysis index and simulated sky based on the updated real-time weather data.

[0144] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: wherein the data information of corresponding environmental factors is displayed while the display screen of the user's AR terminal device displays the target geographic simulation analysis environment.

[0145] Furthermore, the operation instructions executed by the electronic device by running the computer program also include: providing a model adjustment interface and environmental factor data and related evaluation data of a target geographical area based on user operations;

[0146] generating model adjustment data in response to data input by a user in a model adjustment interface; and

[0147] The model adjustment data is sent to the server.

[0148] The electronic device can also implement the aforementioned server and the functions it needs to complete when executing the computer program instructions, such as a single server or a server cluster. The single server or server cluster executes the following operation instructions by executing a computer program stored in a computer-readable storage medium through one or more processors:

[0149] Creating and storing a digital three-dimensional model based on planning data for a target geographic area; and

[0150] A digital three-dimensional model of a target geographic area is provided to a client based on a request from the client.

[0151] The operation instructions executed by the computer program in the single server or server cluster also include:

[0152] modifying the current digital three-dimensional model based on the model adjustment data received from the client; and

[0153] The modified digital three-dimensional model is sent to the corresponding client.

[0154] The operation instructions executed by the computer program in the single server or server cluster also include: based on the environmental analysis indicators specified by the received client and the current target geographical simulation environment, determining the environmental factors affecting the target geographical environment according to the corresponding analysis strategy, and returning them to the corresponding client.

[0155] The present invention also provides a computer-readable storage medium having computer program instructions stored thereon, which can be executed by a processor to implement the client or server in the aforementioned embodiment. The computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in combination with an instruction execution system, device, and equipment. The storage medium can be a transient computer-readable storage medium or a non-transient computer-readable storage medium. Non-transient computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include, for example, magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, and the like.

[0156] The present invention also provides a computer program product, which includes computer program instructions, and when the computer program instructions are executed by a processor, the client or server in the above-mentioned embodiment is implemented. The computer program product includes but is not limited to application installation packages published on websites and application stores, application plug-ins, and small programs that can be run in certain applications, etc.

[0157] The above embodiments are only used to illustrate the present invention, but not to limit the present invention. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the scope of the present invention. Therefore, all equivalent technical solutions should also fall within the scope of the present invention.

Claims

1. A client of an environment analysis system based on an AR scene, which runs in a user AR terminal device, wherein the user AR terminal device comprises at least a processor, a memory, a display screen and a camera, and the client comprises: A client communication module, configured to communicate with the server; A digital three-dimensional model module is connected to the client communication module and is configured to obtain a digital three-dimensional model of a target geographical area from a server via the client communication module, and fuse it with an image captured by a camera of a user's AR terminal device to obtain an augmented reality target geographical simulation environment; An environmental factor acquisition module, which is connected to the digital three-dimensional model module or the client communication module, and is configured to determine the environmental factors affecting the target geographical environment according to the corresponding analysis strategy based on the specified environmental analysis indicators and the current target geographical simulation environment, or to send the specified environmental analysis indicators to the server through the client communication module, and receive the corresponding environmental factors returned by the server; An environment fusion module, which is connected to the environment factor acquisition module and is configured to fuse the environment factors into the target geographic simulation environment to obtain a target geographic simulation analysis environment; as well as A display module, which is connected to the digital three-dimensional model module and the environment fusion module, and is configured to display the target geographic simulation environment or the target geographic simulation analysis environment on a display screen of a user AR terminal device; An environmental assessment module, which is connected to the environmental factor acquisition module and is configured to obtain corresponding assessment data based on environmental factors affecting the target geographical environment and corresponding indicator data; The model adjustment module is connected to the environmental assessment module and the client communication module respectively, and is configured to generate model adjustment data based on the environmental factor data and related assessment data of the target geographical area, and send the model adjustment data to the server via the client communication module.

2. The client according to claim 1, wherein the environmental factor acquisition module includes a sunshine analysis unit when the corresponding environmental analysis indicator is sunshine and the corresponding environmental factor is sun shadow, which is configured to include a sun angle calculation subunit for calculating the sun altitude angle and the sun azimuth angle at the corresponding moment based on the geographic location data and time information of the target geographic area; correspondingly, the environmental fusion module includes a projection mapping unit, which determines the sun shadow of the target geographic simulation environment at the current position at the corresponding moment based on the sun altitude angle and the sun azimuth angle.

3. The client according to claim 2, wherein the sunshine analysis unit is configured to further include a shadow relationship acquisition subunit for acquiring a relationship between the distance between simulated objects in the target geographical area, the height of the simulated objects and the sun shadow index.

4. The client according to claim 2, wherein the display module displays on the display screen the sun shadow of the target geographic simulation analysis environment at the current location at a specified time or the change of the sun shadow within a specified time period.

5. The client according to claim 1, wherein the environmental factor acquisition module comprises a precipitation analysis unit when the corresponding environmental analysis indicator is precipitation and the corresponding environmental factor is water accumulation height, and the precipitation analysis unit is configured to include: A precipitation simulation subunit is configured to generate a precipitation simulation scene through special effects based on a specified precipitation index and its level; wherein the precipitation index includes rain, snow or hail; and a water accumulation calculation subunit configured to calculate the surface water accumulation height within a specified time period based on a specified precipitation index and its level and a water discharge corresponding to the precipitation index in a target geographical area; Correspondingly, the environment fusion module further includes a precipitation fusion unit, which is connected to the precipitation analysis unit and is configured to superimpose the precipitation simulation scene and the surface water height in the target geographical simulation environment of the current location.

6. The client according to claim 1, wherein the environmental factor acquisition module comprises an atmosphere analysis unit when the corresponding environmental analysis index is atmosphere and the corresponding environmental factor is air quality, and the atmosphere analysis unit is configured to include: an air simulation subunit, configured to generate an air simulation scene through special effects based on specified air indicators and their quality levels; as well as a gas flow simulation subunit, which is connected to the air simulation subunit and is configured to calculate the flow data of air in different areas based on wind direction, wind speed level and target geographical simulation environment to generate an air flow simulation scenario; Correspondingly, the environment fusion module further includes an atmosphere fusion unit, which is connected to the atmosphere analysis unit and is configured to superimpose the current air simulation scene and the air flow simulation scene in the target geographical simulation environment of the current location.

7. The client according to claim 1, wherein the environmental factor acquisition module comprises a sound analysis unit when the corresponding environmental analysis indicator is noise and the environmental factor is sound, and the sound analysis unit is configured to include: A sound effect subunit configured to arrange three-dimensional sound effects from designated sound sources for a target geographic simulation environment; as well as a volume calculation subunit, connected to the sound effect subunit, and configured to calculate the volume of the designated location according to the distance between the designated location and the designated sound source, the target geographical environment, and the sound attenuation function; Correspondingly, the environment fusion module further includes a sound effect fusion unit, which is connected to the sound analysis unit and is configured to superimpose a three-dimensional sound effect of a corresponding volume at a designated location in the target geographical simulation environment of the current location.

8. The client according to claim 7, further comprising an audio playback module configured to play three-dimensional sound effects at a specified location in the target geographical simulation environment.

9. The client according to claim 8, wherein the environment assessment module comprises one or more of the following units: A sunshine assessment unit configured to generate sunshine assessment data for a current target geographical area using sun shadow as an impact indicator based on a shadow relationship equation for the target geographical area; a drainage assessment unit configured to determine drainage capacity assessment data of the target geographical area based on a planned drainage index of the target geographical area and a surface water height within a specified time period; an air quality assessment unit configured to determine air quality assessment data of a designated location in the target geographic area based on a planned layout of the target geographic area and simulated air quality index data of different areas in a simulated environment of the target geographic area; as well as The noise evaluation unit is configured to determine noise evaluation data of the designated location in the target geographical area based on the simulated sound source and the simulated volume of the designated location in the target geographical area.

10. The client according to claim 1 further comprises a real-time weather simulation module, which is connected to the digital three-dimensional model module and is configured to obtain current real-time weather data through the network service of the user AR terminal device, generate a simulated sky based on the real-time weather data and add it to the target geographic simulation environment, and determine the environmental analysis indicators of the current target geographic simulation environment.

11. The client according to claim 1, wherein the display module displays data of corresponding environmental factors in the form of text, charts and / or animated images while displaying the target geographic simulation analysis environment.

12. A server of an environment analysis system based on an AR scene, configured to include: A server communication module configured to communicate with the client according to any one of claims 1 to 11; as well as a modeling module connected to the server communication module and configured to create a digital three-dimensional model based on planning data of a target geographical area and provide the digital three-dimensional model of the target geographical area to the client based on a resource request of the client; The model updating module is connected to the server communication module and is configured to modify the current digital three-dimensional model according to the received model adjustment data, and send the modified digital three-dimensional model to the client via the server communication module based on the resource request of the client.

13. The server according to claim 12 further comprises an environmental analysis module, which is connected to the server communication module and is configured to determine the environmental factors affecting the target geographical environment according to the corresponding analysis strategy based on the environmental analysis indicators specified by the client and the digital resources of the specified target geographical area received by the server communication module, and return them to the corresponding client.

14. An environment analysis method based on AR scene, which is applied to a client, comprising: Acquiring a digital three-dimensional model of a target geographic area from the server of any one of claims 12 or 13 based on a user-initiated operation; Acquire an image captured by a camera of a user's AR terminal device and identify a plane therefrom; fuse the digital three-dimensional model with the three-dimensional model of the plane to obtain a target geographical simulation environment, and display it on a display screen of the user's AR terminal device; Based on the specified environmental analysis indicators and the current target geographic simulation environment, determine the environmental factors affecting the target geographic environment according to the corresponding analysis strategy; or request the environmental factors corresponding to the specified environmental analysis indicators from the server; as well as Integrate environmental factors into the target geographic simulation environment to obtain a target geographic simulation analysis environment, and display it on a display screen of a user's AR terminal device; The method further includes: obtaining corresponding evaluation data based on environmental factors affecting the target geographical environment and corresponding indicator data; generating model adjustment data based on the environmental factor data of the target geographical area and related evaluation data; and sending the model adjustment data to the server.

15. The method according to claim 14, wherein when the specified environmental analysis index is sunshine and the corresponding environmental factor is sun shadow, the step of determining the environmental factors affecting the target geographical environment according to the corresponding analysis strategy comprises: Calculate the solar altitude angle and solar azimuth angle corresponding to the current time based on the geographical location data and time information of the target geographical area; Correspondingly, the step of integrating environmental factors into the target geographic simulation environment includes: The projection of the target geographic simulation environment at the current position at the current time is determined based on the solar altitude angle and the azimuth angle, and the projection is mapped to the target geographic simulation environment to form a solar shadow.

16. The method according to claim 15, further comprising the steps of: When the user specifies a time or a time period, the sun shadow of the target geographic simulation analysis environment at the current location at the specified time or the change of the sun shadow within the specified time period is displayed on the display screen.

17. The method according to claim 15, further comprising: Obtain a shadow relationship between distances between simulated objects in a target geographic area, simulated object heights, and a sun shadow index.

18. The method according to claim 17, further comprising: Based on the shadow relationship of the target geographical area, sunshine assessment data for the current target geographical area is generated with solar shadow as an influencing indicator.

19. The method according to claim 14, wherein when the designated environmental analysis index is precipitation and the corresponding environmental factor is water accumulation height, the step of determining the environmental factors affecting the target geographical environment according to the corresponding analysis strategy comprises: Based on the specified precipitation index and its level, a precipitation simulation scene is generated through special effects; wherein the precipitation index includes rain, snow or hail; and Calculate the surface water height within a specified time period based on a specified precipitation index and its level and the water discharge in the target geographic area corresponding to the said precipitation index; Correspondingly, the step of integrating environmental factors into the target geographic simulation environment includes: superimposing the precipitation simulation scene and surface water height in the current target geographic simulation environment.

20. The method of claim 19, further comprising: The drainage capacity assessment data of the target geographical area is determined based on the planned drainage indicators of the target geographical area and the simulated surface water height within a specified time period.

21. The method according to claim 14, wherein when the designated environmental analysis index is the atmosphere and the corresponding environmental factor is air quality, the step of determining the environmental factors affecting the target geographical environment according to the corresponding analysis strategy comprises: Generate air simulation scenes through special effects based on specified air indicators and their quality levels; as well as Calculate and simulate air flow data in different areas based on wind direction, wind speed level and target geographic simulation environment to generate air flow simulation scenarios; Correspondingly, the step of integrating environmental factors into the target geographic simulation environment includes: superimposing the air simulation scene and the air flow simulation scene in the current target geographic simulation environment.

22. The method according to claim 21, further comprising: Based on the simulated air flow data in different areas of the target geographical simulated environment, simulated air quality index data of the corresponding area is obtained; as well as The air quality assessment data of the designated location in the target geographical area is determined based on the planning layout of the target geographical area and the simulated air quality index data of different areas in the target geographical simulation environment.

23. The method according to claim 14, wherein when the designated environmental analysis index is noise and the corresponding environmental factor is sound, the step of determining the environmental factors affecting the target geographical environment according to the corresponding analysis strategy comprises: Arrange three-dimensional sound effects for the target geographical simulation environment according to the sound source; as well as Calculating the volume of the designated location according to the distance between the designated location and the sound source, the target geographical environment and the sound attenuation function; Correspondingly, the step of integrating environmental factors into the target geographic simulation environment includes: superimposing a three-dimensional sound effect of a corresponding volume at a designated position in the target geographic simulation environment at the current position.

24. The method of claim 23, further comprising: The 3D sound effects at the specified location are played through the speakers of the user's AR terminal device.

25. The method of claim 23, further comprising: Noise assessment data of the designated location in the target geographic area is determined based on the simulated sound source and the simulated volume of the designated location in the target geographic area.

26. The method of claim 14, further comprising: Specify environmental analysis indicators based on user selection operations.

27. The method according to claim 14, further comprising: after receiving a start operation from a user: Get current real-time weather data for the target geographic area; Analyzing the real-time weather data, generating a simulated sky based on the real-time weather data and adding it to a target geographic simulation environment; as well as Environmental analysis indicators are specified based on the real-time weather data.

28. The method of claim 27, further comprising: The weather data is updated in real time or periodically, and the designated environmental analysis index and the simulated sky are updated based on the updated real-time weather data.

29. The method according to claim 14, wherein while the display screen of the user's AR terminal device displays the target geographic simulation analysis environment, data of corresponding environmental factors are displayed in the form of text, charts and / or animated images.

30. An environment analysis method based on AR scene, which is applied to the server, comprising: Create and store digital three-dimensional models based on planning data of the target geographic area; as well as Communicating with the client of any one of claims 1-11, providing the client with a digital three-dimensional model of a target geographic area based on a resource request sent by the client; The method further includes: modifying the current digital three-dimensional model based on the model adjustment data received from the client; and sending the modified digital three-dimensional model to the corresponding client based on the resource request sent by the client.

31. The method of claim 30, further comprising: Based on the received client-specified environmental analysis indicators and the specified digital resources of the target geographical area, environmental factors affecting the target geographical environment are determined according to the corresponding analysis strategy and returned to the corresponding client.

32. An electronic device, comprising a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, it implements the AR scene-based environment analysis method as described in any one of claims 14-29; or it implements the AR scene-based environment analysis method as described in any one of claims 30-31.

33. A computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the AR scene-based environment analysis method as described in any one of claims 14-29; or implement the AR scene-based environment analysis method as described in any one of claims 30-31.

34. A computer program product, comprising computer program instructions, which, when executed by a processor, implement the AR scene-based environment analysis method as described in any one of claims 14-29; or implement the AR scene-based environment analysis method as described in any one of claims 30-31.

35. An AR terminal device, which comprises at least a processor, a memory, a display screen and a camera, wherein the memory stores computer program instructions, and the processor implements the AR scene-based environment analysis method as described in any one of claims 30-31 when executing the computer program instructions in the memory.

Images