A system and method for updating a mixed reality environment based on real-time weather data

By obtaining and parsing weather data in real time in mixed reality devices and dynamically updating the virtual environment, the problem of virtual objects not related to real weather is solved, and a more realistic user experience is achieved.

CN119784981APending Publication Date: 2025-04-08SHENZHEN YUANXIANG VISION TECH GRP CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411866261.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-10-17
Filing Date
2024-12-18
Publication Date
2025-04-08

AI Technical Summary

Technical Problem

In existing mixed reality technology, virtual objects cannot be associated with the weather in the real external environment and cannot be affected by external weather changes, resulting in unreal user experience.

Method used

By introducing weather data acquisition, analysis and environmental update modules into mixed reality devices, we can obtain the weather information of the current location in real time, and dynamically update the virtual environment based on the parsed weather data, so as to achieve synchronous response between virtual objects and weather changes.

Benefits of technology

Enhance the realism of the user experience. Through a virtual environment synchronized with the real weather, virtual objects can be affected by the weather like real objects, providing a more realistic experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119784981A_ABST
    Figure CN119784981A_ABST
Patent Text Reader

Abstract

The present invention discloses a system and method for updating a mixed reality environment based on real-time weather data, which is applied to MR devices, and the method includes: obtaining real-time weather information of the current location; parsing the real-time weather information to determine the current weather data; and dynamically updating the virtual environment in the MR device according to the parsed weather data. The embodiment of the present invention matches the weather change effect of the weather in the virtual environment with the external environment. When the weather in the external real environment changes, for example, when it rains in the external environment, the mixed reality device will automatically update the virtual environment in the state of networked weather data, synchronize the rain effect, and the virtual objects inside will also be affected by the rain at the same time, producing a wet material effect, thereby providing users with a more realistic experience and improving the user experience of the MR device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of mixed reality technology, and in particular to a system and method for updating a mixed reality environment based on real-time weather data. Background Art

[0002] Mixed reality (MR) is a technology that integrates the virtual world with the real world, creating an interactive environment for users that contains both real-world elements and virtual information. Mixed reality technology introduces real-world scene information into the virtual environment, and builds an interactive feedback information loop between the virtual world, the real world, and the user to enhance the realism of the user experience. It usually uses sensor technology (such as cameras, lidar, etc.) to obtain information such as the user's position, posture, and line of sight, so as to determine the position and direction of virtual objects. At the same time, computer vision technology is used to identify and track real scenes to achieve the fusion of virtual objects and real scenes.

[0003] Existing mixed reality devices are mostly used in games, education, medical and other fields to provide immersive experience. In the existing mixed reality (MR) technology, virtual objects cannot be associated with the weather in the real external environment, and will not be affected by external weather conditions (such as rain, snow, wind level, etc.), and cannot produce a reasonable and realistic experience like real objects, affecting the user experience.

[0004] Therefore the prior art needs further development. Summary of the invention

[0005] In response to the above technical problems, the embodiments of the present invention provide a system and method for updating a mixed reality environment based on real-time weather data, which can solve the technical problems in the mixed reality (MR) technology in the prior art, that is, virtual objects cannot be associated with the weather in the real external environment, will not be affected by the external weather conditions (such as rain, snow, wind level, etc.), and cannot produce a reasonable and realistic experience like real objects, thereby affecting the user experience.

[0006] A first aspect of an embodiment of the present invention provides a system for updating a mixed reality environment based on real-time weather data, which is applied to an MR device. The system includes:

[0007] Weather data acquisition module, used to obtain real-time weather information of the current location;

[0008] A data analysis module, used to analyze the real-time weather information to determine current weather data;

[0009] The environment update module is used to dynamically update the virtual environment in the MR device according to the parsed weather data.

[0010] Optionally, the weather data acquisition module includes:

[0011] A user location acquisition unit is used to locate the user's current location based on GPS or IP address;

[0012] The weather API calling unit is used to call the API through an HTTP request, input the user's current location into the API, and obtain real-time weather information of the current location.

[0013] Optionally, the data parsing module includes:

[0014] A data parsing unit, used for converting the real-time weather information into a target data structure;

[0015] A data extraction unit, used for extracting current weather data from the target data structure;

[0016] The data encapsulation and sending unit is used to encapsulate the current weather data and send the encapsulated weather data to the environment update module.

[0017] Optionally, the environment update module includes:

[0018] A weather effect acquisition unit, used to acquire dynamic weather effects corresponding to weather data;

[0019] A virtual environment dynamic rendering unit, used to render dynamic weather effects according to a rendering engine to obtain dynamic rendering parameters;

[0020] An instant updating unit, used for instant updating of the virtual environment in the MR device according to the dynamic rendering parameters;

[0021] The smooth transition unit is used to update the virtual environment in the MR device according to the dynamic rendering parameters and the preset update rate.

[0022] Optionally, the smooth transition unit includes:

[0023] The coroutine transition subunit is used to gradually adjust the parameters in the weather scene based on the coroutine to achieve a smooth transition of the virtual environment update;

[0024] The animation transition subunit is used to gradually adjust the parameters in the weather scene within a predetermined time period to achieve a smooth transition of the virtual environment update.

[0025] Optionally, the system further comprises:

[0026] The user interface module is used to display current weather information, receive user instructions to update the virtual environment of the MR device, or receive user instructions to switch the virtual environment of the MR device.

[0027] A second aspect of an embodiment of the present invention provides a method for updating a mixed reality environment based on real-time weather data based on the above system, which is applied to an MR device. The method includes:

[0028] Get real-time weather information for your current location;

[0029] Parsing the real-time weather information to determine current weather data;

[0030] The virtual environment in the MR device is dynamically updated based on the parsed weather data.

[0031] Optionally, obtaining real-time weather information of the current location includes:

[0032] Locate the user's current location based on GPS or IP address;

[0033] The API is called through an HTTP request, the user's current location is input into the API, and real-time weather information of the current location is obtained.

[0034] Optionally, parsing the real-time weather information to determine current weather data includes:

[0035] Converting the real-time weather information into a target data structure;

[0036] extracting current weather data from the target data structure;

[0037] The current weather data is packaged, and the packaged weather data is sent to the environment update module.

[0038] Optionally, dynamically updating the virtual environment in the MR device according to the parsed weather data includes:

[0039] Get the dynamic weather effects corresponding to the weather data;

[0040] Used to render dynamic weather effects according to the rendering engine and obtain dynamic rendering parameters;

[0041] The virtual environment in the MR device is updated in real time according to the dynamic rendering parameters, or the virtual environment in the MR device is updated according to the dynamic rendering parameters and a preset update rate.

[0042] In the technical solution provided by the embodiment of the present invention, the real-time weather information of the current location is obtained; the real-time weather information is parsed to determine the current weather data; and the virtual environment in the MR device is dynamically updated according to the parsed weather data. The embodiment of the present invention matches the weather change effect of the weather in the virtual environment with the external environment. When the weather in the external real environment changes, for example, when it rains in the external environment, the mixed reality device will automatically update the virtual environment in the state of networked weather data, synchronize the rain effect, and the virtual objects inside will also be affected by the rain, producing a wet material effect, thereby providing users with a more realistic experience and improving the user experience of the MR device. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 This is a schematic diagram of the module structure of another embodiment of a system for updating a mixed reality environment based on real-time weather data in an embodiment of the present invention;

[0044] Figure 2 The present invention is a flowchart of a preferred embodiment of a method for updating a mixed reality environment based on real-time weather data in an embodiment of the present invention. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0046] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0047] The following describes a system for updating a mixed reality environment based on real-time weather data in an embodiment of the present invention. Figure 1 , Figure 1 is a schematic diagram of a module of an embodiment of a system for updating a mixed reality environment based on real-time weather data in an embodiment of the present invention. Figure 1 As shown, the system includes:

[0048] The weather data acquisition module 100 is used to obtain real-time weather information of the current location;

[0049] A data analysis module 200, for analyzing the real-time weather information to determine current weather data;

[0050] The environment updating module 300 is used to dynamically update the virtual environment in the MR device according to the parsed weather data.

[0051] In specific implementation, the system of the embodiment of the present invention is applied to MR devices. The weather data acquisition module acquires real-time weather information of the current location by calling a public weather API (such as OpenWeatherMap API) and parses the data to determine the current weather conditions.

[0052] The data parsing module parses the JSON data obtained from the weather API and extracts key weather information, such as weather conditions (sunny, cloudy, rainy, etc.), temperature, humidity, etc.

[0053] The environment update module dynamically updates the virtual environment in the MR device based on the parsed weather data. For example, when the weather changes from sunny to cloudy or drizzling, the sky in the virtual environment gradually darkens and begins to generate raindrop effects. Use coroutines or animation transition effects to achieve smooth transitions of environmental changes.

[0054] The embodiments of the present invention match the weather change effects of the weather in the virtual environment with the external environment. When the weather in the external real environment changes, for example, it rains, the mixed reality device will automatically update the virtual environment under the state of networked weather data and synchronize the rain effect. The virtual objects in the virtual environment will also be affected by the rain at the same time, producing a wet material effect, thereby providing users with a more realistic experience.

[0055] Optionally, the weather data acquisition module 100 includes:

[0056] A user location acquisition unit is used to locate the user's current location based on GPS or IP address;

[0057] The weather API calling unit is used to call the API through an HTTP request, input the user's current location into the API, and obtain real-time weather information of the current location.

[0058] In specific implementation, the weather data acquisition module can call the public weather API (such as OpenWeatherMap API) and obtain weather data only through HTTP requests. This method has nothing to do with whether the map or weather APP is installed on the terminal device. The key steps to achieve this function include:

[0059] The user location acquisition unit is used to obtain weather information based on the user's current location. The location can be determined by using the device's GPS module or obtaining the IP address. Usually, this step is handled by the program itself without relying on an external map APP.

[0060] The weather API calling unit is used to call public APIs such as OpenWeatherMap through HTTP requests, pass in location information (such as city name or longitude and latitude), and obtain weather data. In addition to using the OpenWeatherMap API, other weather data API providers can also be used, such as Weather.com, AccuWeather, etc. These alternative APIs can provide similar weather data services. The advantage is that it increases the flexibility and reliability of the system and avoids the risk of service interruption of a single API provider. The disadvantage is that it needs to adapt to the formats and data parsing methods of different APIs.

[0061] After the API responds, get the data returned by the API in JSON or XML format.

[0062] Weather prediction based on machine learning: Use machine learning models to train historical weather data, predict weather changes in the short term in the future in real time, and apply the prediction results to the MR environment. The advantage is that weather changes can be predicted in advance to a certain extent, providing a faster response time for the update of the virtual environment. The disadvantage is that a large amount of historical weather data is required for model training, and the accuracy of the prediction depends on the performance of the model.

[0063] In some other embodiments, a periodic updating unit is further included, which sets a timer or a task to periodically send a request to obtain the latest weather information.

[0064] Optionally, the data parsing module 200 includes:

[0065] A data parsing unit, used for converting the real-time weather information into a target data structure;

[0066] A data extraction unit, used for extracting current weather data from the target data structure;

[0067] The data encapsulation and sending unit is used to encapsulate the current weather data and send the encapsulated weather data to the environment update module.

[0068] In specific implementation, the data parsing unit is used to obtain the JSON data returned by the API: By calling the public weather API, real-time weather data can be obtained. The data returned by the API is usually a string in JSON format, which contains detailed information about the current weather, such as temperature, humidity, weather conditions, wind speed, etc. For example, the content returned by the API may contain information such as "weather description", "temperature", "humidity", "wind speed", etc.

[0069] Parsing weather data in JSON format: First, use appropriate data parsing tools (such as JSON parsing libraries or tools commonly used in software development) to convert weather data in JSON format into a data structure that is easy to process.

[0070] The data extraction unit is used to extract data. Since the parsed data structure is generally in the form of key-value pairs, each key (field name) corresponds to a specific value or description.

[0071] For example, the "weather description" field may contain specific descriptions such as "sunny", "few clouds", "cloudy", "light rain", "thunderstorm", etc. to reflect the current weather conditions.

[0072] Extract key weather information: From the parsed data structure, extract the fields that have a significant impact on the MR-side weather simulation one by one, including:

[0073] Weather condition description: usually located in the "Description" subfield of the "Weather" field, describing the current weather type, such as "Sunny", "Light Rain", "Thunderstorm", etc. This field is directly used to determine the weather effects displayed in the virtual environment.

[0074] Temperature information: This can usually be obtained from the "temp" subfield under the "main" field. The temperature data provided by the API is mostly in Kelvin units, so it needs to be converted to Celsius or other required temperature units when used. Temperature data can affect the color change or lighting effects of the virtual environment.

[0075] Humidity information: recorded in the "humidity" subfield under the "main" field, indicating the humidity percentage in the air. The humidity level can determine the concentration of fog or the transparency of the air in the virtual environment.

[0076] Wind speed information: The "speed" subfield in the "wind" field indicates the current wind speed. Wind speed information can be used to generate wind effects in the virtual environment, such as swaying leaves and fluttering flags.

[0077] Cloud cover: Recorded in the "all" subfield under the "clouds" field, this indicates the percentage of cloud cover. High cloud cover generally corresponds to darker scenes, while low cover means clearer skies.

[0078] The data encapsulation and transmission unit encapsulates the parsing results and passes them to the environment update module: the parsed weather information is encapsulated in the form of data objects, and the temperature, humidity, weather description and other information are combined and passed to the environment update module on the MR side. The environment update module decides how to present the corresponding weather effects in the virtual environment based on these data. For example, when the "weather condition" is parsed as "light rain", the environment update module can generate a rainfall effect in the MR device, accompanied by the sound effects of raindrops and ground reflection effects.

[0079] Optionally, the environment update module 300 includes:

[0080] A weather effect acquisition unit, used to acquire dynamic weather effects corresponding to weather data;

[0081] A virtual environment dynamic rendering unit, used to render dynamic weather effects according to a rendering engine to obtain dynamic rendering parameters;

[0082] An instant updating unit, used for instant updating of the virtual environment in the MR device according to the dynamic rendering parameters;

[0083] The smooth transition unit is used to update the virtual environment in the MR device according to the dynamic rendering parameters and the preset update rate.

[0084] In specific implementation, the dynamic rendering unit of the virtual environment: the MR device uses its rendering engine to generate dynamic weather effects, for example, simulating scene changes such as sunny days, cloudy days, and rainy days through technologies such as lighting, fog, and particle systems.

[0085] Sky color, cloud density, light intensity, etc. will be adjusted based on the parsed weather data, for example:

[0086] Sunny to cloudy: When the weather data shows that the sky changes from sunny to cloudy, the MR device will gradually reduce the ambient light intensity, changing the color of the sky from bright blue to gray, generating sparse clouds.

[0087] Cloudy to light rain: When the analysis results show that the weather changes to light rain, the MR device will gradually increase the particle effect of raindrops in the scene and appropriately reduce the transparency of the scene to increase the wet ground effect.

[0088] Update method: instant update and smooth transition.

[0089] The real-time update unit is used in some cases to apply new weather effects to the MR device immediately after parsing the weather data changes. For example, switching from a sunny day to a thunderstorm may require the rapid generation of a strong flashing lightning effect.

[0090] In order to improve the user experience, an update rate is usually set to make the weather change more natural. For example, the change from sunny to light rain may be completed through a gradual transition over a few minutes, simulating a gradually darkening sky and increasing raindrops. This update rate can be controlled by the time step to ensure that the transition effect does not appear abrupt. The smooth transition unit is used to update the virtual environment in the MR device according to the dynamic rendering parameters and the preset update rate.

[0091] Acquisition and storage of weather effects:

[0092] Pre-stored in the terminal: Some common weather effects (such as sunny, cloudy, light rain, snow, etc.) can be pre-stored locally in the MR device. The advantage of this method is that it has a fast response speed, does not rely on network connection, and is suitable for fast switching of regular weather. For example, the pre-stored sunny effect includes a blue sky and a sun illumination model, while the rainy effect includes raindrop particles and a wet ground material.

[0093] Obtain from the backend server: For some more complex or special weather effects (such as special storm scenes, large snowfall effects), they can be downloaded from the backend server in real time. This can save storage space on the MR device and dynamically load the corresponding effects when needed. For example, when extreme weather such as a typhoon is detected, more detailed wind speed data and the corresponding storm model can be obtained from the server.

[0094] The process is updated to the virtual environment module in real time based on the analysis of networked weather data, dynamically changing the weather effects of the entire virtual environment, so that virtual objects can respond to weather changes in real time and change in form and material. For example, when the weather changes from sunny to rainy, the skybox (SkyBox, HDR, etc.) in the virtual environment will change from sunny to rainy, accompanied by rain effects (particle effects, Shader effects, etc.). In addition, the shader of the virtual object will receive weather information and undergo corresponding material changes. For example, when it rains, the material surface of the virtual object will show a wet effect, and when there is wind, the virtual object will also be swayed by physical feedback. If it is snowing, the shader of the virtual object will switch to the corresponding snow effect, and over time, the snow effect will gradually change from light to dark.

[0095] In other embodiments, an enhanced weather special effects algorithm may also be used: a more advanced weather special effects algorithm is developed to enhance the weather performance in the virtual environment through delicate particle effects and lighting simulation. The advantage is that the realism and visual effects of the virtual environment are improved, making the weather special effects more realistic. The disadvantage is that the computing load is increased, and the hardware performance requirements of the MR device are higher.

[0096] Optionally, the smooth transition unit includes:

[0097] The coroutine transition subunit is used to gradually adjust the parameters in the weather scene based on the coroutine to achieve a smooth transition of the virtual environment update;

[0098] The animation transition subunit is used to gradually adjust the parameters in the weather scene within a predetermined time period to achieve a smooth transition of the virtual environment update.

[0099] In specific implementation, in MR devices, in order to achieve a smooth transition of weather changes, coroutines or animation transition effects can be used to gradually adjust the visual elements in the virtual environment. The specific implementation methods of these two methods are as follows:

[0100] Use coroutines to achieve smooth transitions: Coroutines are a programming mechanism that can be paused and resumed, which is very suitable for processing effects that need to change gradually over a certain period of time. During the weather change, coroutines can be used to gradually adjust the parameters in the scene, such as sky color, light intensity, cloud density, etc., to achieve a natural transition effect.

[0101] Coroutine startup: After detecting a weather change, a coroutine is started to control the smooth transition of the scene, for example, the change from sunny to light rain.

[0102] Gradually adjust parameters: In the coroutine, gradually adjust the parameters in the virtual environment by setting the amount of change at each frame or each time step.

[0103] Light Intensity: Gradually reduce the current light intensity from a higher value to a lower value suitable for cloudy days, simulating the effect of the sky gradually darkening.

[0104] Sky Color: Gradually change the color of the sky from blue to gray. The coroutine gradually modifies the color parameter at each step.

[0105] Cloud Density: By gradually increasing the density of clouds, the effect of more and more clouds in the sky becomes more natural.

[0106] Example description: In the transition from sunny to light rain, the coroutine reduces the light intensity by 0.1 units every few milliseconds and increases the density of raindrop particle effects until the target value of the light rain scene is reached. This gradual adjustment process allows users to experience the gradual nature of weather changes.

[0107] Animation transition effect is a preset change curve or easing function used to gradually change certain parameter values ​​within a specified period of time. This method is usually combined with the animation system of the MR rendering engine to make the change of environmental parameters smoother by setting the start and end states of the transition.

[0108] Define animation curve: Set an easing curve (such as linear change, ease in and ease out, etc.) that defines how the value changes from the initial value to the target value. For example, a linear easing curve can be used to change from highlights to lowlights.

[0109] Apply animation effects: When the weather changes, activate the corresponding animation effects to smoothly transition various parameters in the scene (such as light intensity, fog concentration, raindrop density, etc.) from the current state to the target state.

[0110] Sky color change: Control the gradual change of sky color from blue to gray through animation curves, simulating the process of clouds gradually covering the sky.

[0111] Raindrop generation: By gradually starting the animation, the generation rate of raindrop particles gradually increases from zero to the rate of light rain, thus simulating the feeling of slowly increasing raindrops.

[0112] Sound effect transition: By controlling the volume gradient of rain or wind, a smooth transition of sound effects from sunny to rainy is achieved, making the weather change more immersive. Example description: In the transition from light rain to sunny, the animation system will gradually reduce the density of raindrops within 30 seconds, while increasing the light intensity and gradually changing the color of the sky from gray back to blue. The animation curve can ensure that each step of the transition is smooth and natural.

[0113] Combining coroutines with animations: In practical applications, coroutines can be used in combination with animation systems to achieve more flexible and efficient transition effects. For example, in the process of transitioning from rainy days to sunny days, coroutines can be used to control the generation rate of the raindrop particle system, while the animation system can be used to adjust the sky color and light intensity. In this way, the flexibility of coroutines and the fine control of animations can be used to make the entire transition process smoother and more natural.

[0114] Optionally, the system further comprises:

[0115] The user interface module is used to display current weather information, receive user instructions to update the virtual environment of the MR device, or receive user instructions to switch the virtual environment of the MR device.

[0116] In a specific implementation, the user interface module provides a user interface to display the current weather information and allow the user to manually refresh or switch the weather effect. For example, the current temperature and weather condition icons are displayed in the corner of the mixed reality view.

[0117] Furthermore, the virtual environment can be updated in real time: the real-time weather information or user interface module information is parsed by the environment update module and then the environment effect is updated in real time to keep it consistent with the real-time weather.

[0118] In some other embodiments, the current weather can also be obtained through local weather sensors. Local weather sensor integration: Instead of relying on networking to obtain weather data, local weather sensors such as thermometers, hygrometers, anemometers, etc. can be integrated into the MR device. These sensors are used to monitor the current weather conditions in real time. The advantage is that the real-time performance and data accuracy are improved, especially in an environment where the network connection is unstable or there is no network, and the disadvantage is that the hardware cost and device complexity are increased.

[0119] Manual switching based on preset weather scenes: Users manually select and switch preset weather scenes instead of automatic real-time updates. This method can be implemented through a simple user interface. The advantage is that it reduces the complexity of technical implementation and facilitates users to define and switch weather effects in specific scenarios. The disadvantage is that it cannot reflect the real weather changes in the outside world in real time and relies on manual operation by users.

[0120] In traditional mixed reality (MR) technology, virtual objects cannot interact with real weather changes, resulting in insufficient expressiveness and user experience. Traditional mixed reality (MR) technology does not reflect the changes in the form and effect of virtual objects affected by the weather, and the entire virtual weather environment is not synchronized with reality, resulting in a very abrupt user experience. The present invention obtains weather data through networking, transmits it to the skybox (SkyBox) of the virtual environment in real time, and synchronizes weather effects (rain, thunderstorm, snow, rain to clear, clear to rain, etc.), so as to synchronize the weather in the virtual environment with reality and enhance the realism, interaction and experience of the virtual environment.

[0121] The above describes the system for updating the mixed reality environment based on real-time weather data in the embodiment of the present invention. Figure 1 , Figure 1 FIG. 1 is a flow chart of an embodiment of a method for updating a mixed reality environment based on real-time weather data in an embodiment of the present invention. Figure 1 As shown, including:

[0122] Step S100, obtaining real-time weather information of the current location;

[0123] Step S200, parsing the real-time weather information to determine current weather data;

[0124] Step S300: dynamically update the virtual environment in the MR device according to the parsed weather data.

[0125] In specific implementation, the embodiment of the present invention integrates real-time weather data: current weather information is obtained through an online weather data API (such as OpenWeatherMap API), so as to achieve synchronous update of the virtual environment and the real world weather, ensure that the MR device can reflect the weather changes in the outside world in real time, and enhance the user's sense of immersion.

[0126] Dynamic environment update: Dynamically update the weather effects of the virtual environment based on weather data. For example, the skybox texture and weather effects (such as rain, snow, etc.) will automatically adjust according to real-time weather changes to achieve natural weather transitions and avoid abrupt environment switching.

[0127] Real-time changes in virtual object materials: The materials and shaders of virtual objects will be adjusted in real time according to weather information. For example, the surface of virtual objects will appear wet when it rains, and snow will accumulate on the surface of virtual objects when it snows. The snow will gradually deepen over time, enhancing the realism and interactivity of the virtual environment.

[0128] Through real-time monitoring and analysis of networked weather data, the virtual environment in the MR device is dynamically updated, achieving an immersive experience synchronized with weather changes in the real world, significantly enhancing the user's sense of reality and interactivity.

[0129] Furthermore, real-time weather information of the current location is obtained, including:

[0130] Locate the user's current location based on GPS or IP address;

[0131] The API is called via an HTTP request, the user's current location is input into the API, and real-time weather information for the current location is obtained.

[0132] The specific implementation steps are as described in the above system embodiment and will not be repeated here.

[0133] Further, the real-time weather information is parsed to determine current weather data, including:

[0134] Converting the real-time weather information into a target data structure;

[0135] extracting current weather data from the target data structure;

[0136] The current weather data is packaged, and the packaged weather data is sent to the environment update module.

[0137] The specific implementation steps are as described in the above system embodiment and will not be repeated here.

[0138] Furthermore, the virtual environment in the MR device is dynamically updated according to the parsed weather data, including:

[0139] Get the dynamic weather effects corresponding to the weather data;

[0140] Used to render dynamic weather effects according to the rendering engine and obtain dynamic rendering parameters;

[0141] The virtual environment in the MR device is updated in real time according to the dynamic rendering parameters, or the virtual environment in the MR device is updated according to the dynamic rendering parameters and a preset update rate.

[0142] The specific implementation steps during the specific implementation are as described in the above system embodiment and will not be repeated here.

[0143] It can be seen from the above embodiments that the embodiments of the present invention have the following beneficial effects:

[0144] Real-time update of the virtual environment: Keep it consistent with the real weather and enhance the user's immersion. By acquiring and parsing weather data in real time, the virtual environment in the MR device can reflect the weather changes in the real world in a timely manner.

[0145] Smooth transition effect: Avoids the abruptness of environment switching and provides a more natural visual experience. Use animation transition and special effects processing to ensure that weather changes in the virtual environment are presented more smoothly and naturally.

[0146] Enhanced user interaction experience: By providing weather information display and manual update functions, the user interaction experience is enhanced. Users can not only passively feel weather changes, but also perform certain controls and adjustments through the interface.

[0147] It should be noted that there is not necessarily a certain order between the above-mentioned steps. A person skilled in the art can understand, based on the description of the embodiments of the present invention, that in different embodiments, the above-mentioned steps may have different execution orders, that is, they may be executed in parallel, may be executed interchangeably, and so on.

[0148] An embodiment of the present invention provides a non-volatile computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example, to execute the above-described Figure 2 The method comprises steps S100 to S300.

[0149] As an example, the non-volatile storage medium can include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable ROM (EEPROM), or a flash memory. Volatile memory can include a random access memory (RAM) as an external cache memory. By way of illustration and not limitation, RAM can be obtained in many forms such as synchronous RAM (SRAM), dynamic RAM, DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synch link DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The disclosed memory components or memories of the operating environment described in the embodiments of the present invention are intended to include one or more of these and / or any other suitable types of memories.

[0150] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A system for updating a mixed reality environment based on real-time weather data, applied to an MR device, characterized in that: The system includes: Weather data acquisition module, used to obtain real-time weather information of the current location; A data analysis module, used to analyze the real-time weather information to determine current weather data; The environment update module is used to dynamically update the virtual environment in the MR device according to the parsed weather data.

2. The system for updating a mixed reality environment based on real-time weather data according to claim 1, characterized in that: The weather data acquisition module includes: A user location acquisition unit is used to locate the user's current location based on GPS or IP address; The weather API calling unit is used to call the API through an HTTP request, input the user's current location into the API, and obtain real-time weather information of the current location.

3. The system for updating a mixed reality environment based on real-time weather data according to claim 2, characterized in that: The data parsing module comprises: A data parsing unit, used for converting the real-time weather information into a target data structure; A data extraction unit, used for extracting current weather data from the target data structure; The data encapsulation and sending unit is used to encapsulate the current weather data and send the encapsulated weather data to the environment update module.

4. The system for updating a mixed reality environment based on real-time weather data according to claim 3, characterized in that: The environment update module includes: A weather effect acquisition unit, used to acquire dynamic weather effects corresponding to weather data; A virtual environment dynamic rendering unit, used to render dynamic weather effects according to a rendering engine to obtain dynamic rendering parameters; An instant updating unit, used for instant updating of the virtual environment in the MR device according to the dynamic rendering parameters; The smooth transition unit is used to update the virtual environment in the MR device according to the dynamic rendering parameters and the preset update rate.

5. The system for updating a mixed reality environment based on real-time weather data according to claim 4, characterized in that: The smooth transition unit comprises: The coroutine transition subunit is used to gradually adjust the parameters in the weather scene based on the coroutine to achieve a smooth transition of the virtual environment update; The animation transition subunit is used to gradually adjust the parameters in the weather scene within a predetermined time period to achieve a smooth transition of the virtual environment update.

6. The system for updating a mixed reality environment based on real-time weather data according to claim 1, characterized in that: The system further comprises: The user interface module is used to display current weather information, receive user instructions to update the virtual environment of the MR device, or receive user instructions to switch the virtual environment of the MR device.

7. A method for updating a mixed reality environment based on real-time weather data based on the system of any one of claims 1 to 6, applied to a MR device, characterized in that: The method comprises: Get real-time weather information for your current location; Parsing the real-time weather information to determine current weather data; The virtual environment in the MR device is dynamically updated based on the parsed weather data.

8. The method for updating a mixed reality environment based on real-time weather data according to claim 7, characterized in that: The method of obtaining real-time weather information of the current location includes: Locate the user's current location based on GPS or IP address; The API is called via an HTTP request, the user's current location is input into the API, and real-time weather information for the current location is obtained.

9. The method for updating a mixed reality environment based on real-time weather data according to claim 8, characterized in that: The parsing of the real-time weather information to determine current weather data includes: Converting the real-time weather information into a target data structure; extracting current weather data from the target data structure; The current weather data is packaged, and the packaged weather data is sent to the environment update module.

10. The method for updating a mixed reality environment based on real-time weather data according to claim 9, characterized in that: The dynamically updating the virtual environment in the MR device according to the parsed weather data includes: Get the dynamic weather effects corresponding to the weather data; Used to render dynamic weather effects according to the rendering engine and obtain dynamic rendering parameters; The virtual environment in the MR device is updated in real time according to the dynamic rendering parameters, or the virtual environment in the MR device is updated according to the dynamic rendering parameters and a preset update rate.

Citation Information

Cited By

  • Virtual sand interaction rendering method and device, equipment and medium

    CN121070505A